2024-04-25T22:45:26.648 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-25T22:45:26.649 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --archive /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674073 --name teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi --owner scheduled_teuthology@teuthology --description powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-low-osd-mem-target powercycle/default supported-distros/centos_latest tasks/cfuse_workunit_suites_fsx thrashosds-health} -- /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674073/orig.config.yaml 2024-04-25T22:45:26.680 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T22:45:26.754 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674073 branch: squid description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-low-osd-mem-target powercycle/default supported-distros/centos_latest tasks/cfuse_workunit_suites_fsx thrashosds-health} email: ceph-qa@ceph.com first_in_suite: false job_id: '7674073' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd memory target: 1610612736 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MDS_TRIM\) - \(MDS_SLOW_REQUEST\) - MDS_SLOW_METADATA_IO - Behind on trimming - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: b22e2ebdeb24376882b7bda2a7329c8cccc2276a owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - client.0 - - osd.0 - - osd.1 - - osd.2 seed: 9595 sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 sleep_before_teardown: 0 subset: 3/4 suite: powercycle suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_b22e2ebdeb24376882b7bda2a7329c8cccc2276a/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: b22e2ebdeb24376882b7bda2a7329c8cccc2276a targets: smithi052.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDSIcjkrs3fu9z3MaNgNEl/JlLCteLQGWKJlnH/58PrXWPsFPTZsI+fEypo4hx/vij1aB/m7mAzfQl1SxvV6lCg= smithi110.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNqPd0uUwDHoFDG/WUPEm8FI2EGSKKRWG2FEChX+x4ZO+tZhK8B90RhZvzQG92A5e0QdX2LZ+QdxfsoctE5a3+o= smithi164.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBleoW1Vdqjh/mQnCLfCpLdXKmQ+tsEeKQi8LfSy4bA2QvIoRJPyQKGWtoOseEbcLKQLnN+jnBY7yqVIdGWV7sE= smithi191.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHyrsHbeOR7s7w3ikPF9nZlOia6bmkuc84Y/HHyyEua2u8+le1UfVxmxRClhWEke2lDqUj1FE/7nbe/DNoErapg= tasks: - install: extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - thrashosds: chance_down: 1.0 powercycle: true timeout: 600 - ceph-fuse: null - workunit: clients: all: - suites/fsx.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-25_21:32:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-25T22:45:26.755 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_b22e2ebdeb24376882b7bda2a7329c8cccc2276a/qa; will attempt to use it 2024-04-25T22:45:26.755 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_b22e2ebdeb24376882b7bda2a7329c8cccc2276a/qa/tasks 2024-04-25T22:45:26.755 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-25T22:45:26.757 INFO:teuthology.task.internal:Checking packages... 2024-04-25T22:45:26.782 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd2c45d977142e024a59b68a8f1dce8f0b9840551' 2024-04-25T22:45:26.782 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T22:45:26.782 INFO:teuthology.packaging:ref: None 2024-04-25T22:45:26.782 INFO:teuthology.packaging:tag: None 2024-04-25T22:45:26.782 INFO:teuthology.packaging:branch: squid 2024-04-25T22:45:26.782 INFO:teuthology.packaging:sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T22:45:26.783 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-04-25T22:45:26.975 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2445.gd2c45d97 2024-04-25T22:45:27.013 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-25T22:45:27.026 INFO:teuthology.task.internal:no buildpackages task found 2024-04-25T22:45:27.026 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-25T22:45:27.083 INFO:teuthology.task.internal:Saving configuration 2024-04-25T22:45:27.095 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-25T22:45:27.117 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T22:45:27.143 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi052.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674073', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 22:40:08.290162', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDSIcjkrs3fu9z3MaNgNEl/JlLCteLQGWKJlnH/58PrXWPsFPTZsI+fEypo4hx/vij1aB/m7mAzfQl1SxvV6lCg='} 2024-04-25T22:45:27.161 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi110.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674073', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 22:40:08.291706', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNqPd0uUwDHoFDG/WUPEm8FI2EGSKKRWG2FEChX+x4ZO+tZhK8B90RhZvzQG92A5e0QdX2LZ+QdxfsoctE5a3+o='} 2024-04-25T22:45:27.185 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi164.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674073', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 22:40:08.293203', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBleoW1Vdqjh/mQnCLfCpLdXKmQ+tsEeKQi8LfSy4bA2QvIoRJPyQKGWtoOseEbcLKQLnN+jnBY7yqVIdGWV7sE='} 2024-04-25T22:45:27.205 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi191.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674073', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 22:40:08.288353', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHyrsHbeOR7s7w3ikPF9nZlOia6bmkuc84Y/HHyyEua2u8+le1UfVxmxRClhWEke2lDqUj1FE/7nbe/DNoErapg='} 2024-04-25T22:45:27.205 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-25T22:45:27.212 INFO:teuthology.task.internal:roles: ubuntu@smithi052.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'] 2024-04-25T22:45:27.212 INFO:teuthology.task.internal:roles: ubuntu@smithi110.front.sepia.ceph.com - ['osd.0'] 2024-04-25T22:45:27.212 INFO:teuthology.task.internal:roles: ubuntu@smithi164.front.sepia.ceph.com - ['osd.1'] 2024-04-25T22:45:27.212 INFO:teuthology.task.internal:roles: ubuntu@smithi191.front.sepia.ceph.com - ['osd.2'] 2024-04-25T22:45:27.212 INFO:teuthology.run_tasks:Running task console_log... 2024-04-25T22:45:27.360 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f0a2ef440d0>, signals=[15]) 2024-04-25T22:45:27.361 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-25T22:45:27.367 INFO:teuthology.task.internal:Opening connections... 2024-04-25T22:45:27.367 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi052.front.sepia.ceph.com 2024-04-25T22:45:27.369 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T22:45:27.455 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi110.front.sepia.ceph.com 2024-04-25T22:45:27.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T22:45:27.532 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi164.front.sepia.ceph.com 2024-04-25T22:45:27.533 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T22:45:27.614 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi191.front.sepia.ceph.com 2024-04-25T22:45:27.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T22:45:27.691 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-25T22:45:27.698 DEBUG:teuthology.orchestra.run.smithi052:> uname -m 2024-04-25T22:45:27.716 INFO:teuthology.orchestra.run.smithi052.stdout:x86_64 2024-04-25T22:45:27.717 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release 2024-04-25T22:45:27.775 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="CentOS Stream" 2024-04-25T22:45:27.775 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="9" 2024-04-25T22:45:27.775 INFO:teuthology.orchestra.run.smithi052.stdout:ID="centos" 2024-04-25T22:45:27.775 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE="rhel fedora" 2024-04-25T22:45:27.775 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="9" 2024-04-25T22:45:27.775 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM_ID="platform:el9" 2024-04-25T22:45:27.775 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T22:45:27.775 INFO:teuthology.orchestra.run.smithi052.stdout:ANSI_COLOR="0;31" 2024-04-25T22:45:27.775 INFO:teuthology.orchestra.run.smithi052.stdout:LOGO="fedora-logo-icon" 2024-04-25T22:45:27.775 INFO:teuthology.orchestra.run.smithi052.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T22:45:27.776 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://centos.org/" 2024-04-25T22:45:27.776 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T22:45:27.776 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T22:45:27.776 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T22:45:27.776 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server 2024-04-25T22:45:27.799 DEBUG:teuthology.orchestra.run.smithi110:> uname -m 2024-04-25T22:45:27.817 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64 2024-04-25T22:45:27.817 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2024-04-25T22:45:27.874 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="CentOS Stream" 2024-04-25T22:45:27.874 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="9" 2024-04-25T22:45:27.874 INFO:teuthology.orchestra.run.smithi110.stdout:ID="centos" 2024-04-25T22:45:27.874 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="rhel fedora" 2024-04-25T22:45:27.874 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="9" 2024-04-25T22:45:27.874 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el9" 2024-04-25T22:45:27.874 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T22:45:27.874 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31" 2024-04-25T22:45:27.874 INFO:teuthology.orchestra.run.smithi110.stdout:LOGO="fedora-logo-icon" 2024-04-25T22:45:27.875 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T22:45:27.875 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://centos.org/" 2024-04-25T22:45:27.875 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T22:45:27.875 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T22:45:27.875 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T22:45:27.875 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2024-04-25T22:45:27.899 DEBUG:teuthology.orchestra.run.smithi164:> uname -m 2024-04-25T22:45:27.916 INFO:teuthology.orchestra.run.smithi164.stdout:x86_64 2024-04-25T22:45:27.917 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release 2024-04-25T22:45:27.974 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="CentOS Stream" 2024-04-25T22:45:27.975 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="9" 2024-04-25T22:45:27.975 INFO:teuthology.orchestra.run.smithi164.stdout:ID="centos" 2024-04-25T22:45:27.975 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE="rhel fedora" 2024-04-25T22:45:27.975 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="9" 2024-04-25T22:45:27.975 INFO:teuthology.orchestra.run.smithi164.stdout:PLATFORM_ID="platform:el9" 2024-04-25T22:45:27.975 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T22:45:27.975 INFO:teuthology.orchestra.run.smithi164.stdout:ANSI_COLOR="0;31" 2024-04-25T22:45:27.975 INFO:teuthology.orchestra.run.smithi164.stdout:LOGO="fedora-logo-icon" 2024-04-25T22:45:27.975 INFO:teuthology.orchestra.run.smithi164.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T22:45:27.975 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://centos.org/" 2024-04-25T22:45:27.975 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T22:45:27.975 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T22:45:27.975 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T22:45:27.976 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2024-04-25T22:45:27.999 DEBUG:teuthology.orchestra.run.smithi191:> uname -m 2024-04-25T22:45:28.018 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64 2024-04-25T22:45:28.018 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2024-04-25T22:45:28.076 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="CentOS Stream" 2024-04-25T22:45:28.076 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="9" 2024-04-25T22:45:28.076 INFO:teuthology.orchestra.run.smithi191.stdout:ID="centos" 2024-04-25T22:45:28.076 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="rhel fedora" 2024-04-25T22:45:28.076 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="9" 2024-04-25T22:45:28.076 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el9" 2024-04-25T22:45:28.076 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T22:45:28.076 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2024-04-25T22:45:28.077 INFO:teuthology.orchestra.run.smithi191.stdout:LOGO="fedora-logo-icon" 2024-04-25T22:45:28.077 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T22:45:28.077 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://centos.org/" 2024-04-25T22:45:28.077 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T22:45:28.077 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T22:45:28.077 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T22:45:28.077 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2024-04-25T22:45:28.099 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-25T22:45:28.108 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-25T22:45:28.126 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-25T22:45:28.126 DEBUG:teuthology.orchestra.run.smithi052:> test '!' -e /home/ubuntu/cephtest 2024-04-25T22:45:28.128 DEBUG:teuthology.orchestra.run.smithi110:> test '!' -e /home/ubuntu/cephtest 2024-04-25T22:45:28.133 DEBUG:teuthology.orchestra.run.smithi164:> test '!' -e /home/ubuntu/cephtest 2024-04-25T22:45:28.136 DEBUG:teuthology.orchestra.run.smithi191:> test '!' -e /home/ubuntu/cephtest 2024-04-25T22:45:28.152 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-25T22:45:28.160 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-25T22:45:28.160 DEBUG:teuthology.orchestra.run.smithi052:> test -z $(ls -A /var/lib/ceph) 2024-04-25T22:45:28.187 DEBUG:teuthology.orchestra.run.smithi110:> test -z $(ls -A /var/lib/ceph) 2024-04-25T22:45:28.189 DEBUG:teuthology.orchestra.run.smithi164:> test -z $(ls -A /var/lib/ceph) 2024-04-25T22:45:28.192 DEBUG:teuthology.orchestra.run.smithi191:> test -z $(ls -A /var/lib/ceph) 2024-04-25T22:45:28.287 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-25T22:45:28.379 INFO:teuthology.run_tasks:Running task kernel... 2024-04-25T22:45:28.394 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-25T22:45:28.394 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'osd.0': {'kdb': 1, 'sha1': 'distro'}, 'osd.1': {'kdb': 1, 'sha1': 'distro'}, 'osd.2': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-25T22:45:28.395 DEBUG:teuthology.orchestra.run.smithi052:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T22:45:28.395 DEBUG:teuthology.orchestra.run.smithi110:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T22:45:28.395 DEBUG:teuthology.orchestra.run.smithi164:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T22:45:28.396 DEBUG:teuthology.orchestra.run.smithi191:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T22:45:28.412 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T22:45:28.413 DEBUG:teuthology.orchestra.run.smithi191:> uname -r 2024-04-25T22:45:28.414 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T22:45:28.414 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T22:45:28.414 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T22:45:28.415 DEBUG:teuthology.orchestra.run.smithi052:> uname -r 2024-04-25T22:45:28.415 DEBUG:teuthology.orchestra.run.smithi164:> uname -r 2024-04-25T22:45:28.416 DEBUG:teuthology.orchestra.run.smithi110:> uname -r 2024-04-25T22:45:28.470 INFO:teuthology.orchestra.run.smithi191.stdout:5.14.0-437.el9.x86_64 2024-04-25T22:45:28.470 INFO:teuthology.task.kernel:Running kernel on smithi191: 5.14.0-437.el9.x86_64 2024-04-25T22:45:28.471 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum install -y kernel 2024-04-25T22:45:28.472 INFO:teuthology.orchestra.run.smithi110.stdout:5.14.0-437.el9.x86_64 2024-04-25T22:45:28.472 INFO:teuthology.task.kernel:Running kernel on smithi110: 5.14.0-437.el9.x86_64 2024-04-25T22:45:28.472 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum install -y kernel 2024-04-25T22:45:28.474 INFO:teuthology.orchestra.run.smithi164.stdout:5.14.0-437.el9.x86_64 2024-04-25T22:45:28.474 INFO:teuthology.orchestra.run.smithi052.stdout:5.14.0-437.el9.x86_64 2024-04-25T22:45:28.474 INFO:teuthology.task.kernel:Running kernel on smithi164: 5.14.0-437.el9.x86_64 2024-04-25T22:45:28.474 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum install -y kernel 2024-04-25T22:45:28.474 INFO:teuthology.task.kernel:Running kernel on smithi052: 5.14.0-437.el9.x86_64 2024-04-25T22:45:28.475 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum install -y kernel 2024-04-25T22:45:30.750 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.0 MB 00:00 2024-04-25T22:45:30.911 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - BaseOS 9.4 MB/s | 8.0 MB 00:00 2024-04-25T22:45:30.953 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - BaseOS 8.6 MB/s | 8.0 MB 00:00 2024-04-25T22:45:31.127 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - BaseOS 7.6 MB/s | 8.0 MB 00:01 2024-04-25T22:45:32.585 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - AppStream 24 MB/s | 19 MB 00:00 2024-04-25T22:45:32.955 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - AppStream 21 MB/s | 19 MB 00:00 2024-04-25T22:45:32.979 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - AppStream 19 MB/s | 19 MB 00:01 2024-04-25T22:45:33.336 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - AppStream 16 MB/s | 19 MB 00:01 2024-04-25T22:45:36.819 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - CRB 9.0 MB/s | 6.2 MB 00:00 2024-04-25T22:45:37.262 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - CRB 9.5 MB/s | 6.2 MB 00:00 2024-04-25T22:45:37.380 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - CRB 8.3 MB/s | 6.2 MB 00:00 2024-04-25T22:45:37.470 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.2 MB 00:00 2024-04-25T22:45:38.725 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - Extras packages 31 kB/s | 16 kB 00:00 2024-04-25T22:45:38.812 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - Extras packages 72 kB/s | 16 kB 00:00 2024-04-25T22:45:38.845 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - Extras packages 37 kB/s | 16 kB 00:00 2024-04-25T22:45:38.960 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - Extras packages 52 kB/s | 16 kB 00:00 2024-04-25T22:45:40.407 INFO:teuthology.orchestra.run.smithi110.stdout:Extra Packages for Enterprise Linux 14 MB/s | 21 MB 00:01 2024-04-25T22:45:40.530 INFO:teuthology.orchestra.run.smithi164.stdout:Extra Packages for Enterprise Linux 14 MB/s | 21 MB 00:01 2024-04-25T22:45:40.533 INFO:teuthology.orchestra.run.smithi052.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-04-25T22:45:40.760 INFO:teuthology.orchestra.run.smithi191.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-04-25T22:45:45.379 INFO:teuthology.orchestra.run.smithi110.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-04-25T22:45:45.661 INFO:teuthology.orchestra.run.smithi164.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-04-25T22:45:45.672 INFO:teuthology.orchestra.run.smithi052.stdout:lab-extras 41 kB/s | 1.7 kB 00:00 2024-04-25T22:45:45.843 INFO:teuthology.orchestra.run.smithi191.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-04-25T22:45:47.294 INFO:teuthology.orchestra.run.smithi110.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-25T22:45:47.294 INFO:teuthology.orchestra.run.smithi110.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-25T22:45:47.384 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-04-25T22:45:47.385 INFO:teuthology.orchestra.run.smithi110.stdout:Nothing to do. 2024-04-25T22:45:47.385 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-04-25T22:45:47.492 DEBUG:teuthology.orchestra.run.smithi110:> echo no | sudo yum reinstall kernel || true 2024-04-25T22:45:47.569 INFO:teuthology.orchestra.run.smithi164.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-25T22:45:47.569 INFO:teuthology.orchestra.run.smithi164.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-25T22:45:47.611 INFO:teuthology.orchestra.run.smithi052.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-25T22:45:47.612 INFO:teuthology.orchestra.run.smithi052.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-25T22:45:47.662 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-25T22:45:47.663 INFO:teuthology.orchestra.run.smithi164.stdout:Nothing to do. 2024-04-25T22:45:47.663 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-25T22:45:47.706 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-04-25T22:45:47.708 INFO:teuthology.orchestra.run.smithi191.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-25T22:45:47.708 INFO:teuthology.orchestra.run.smithi191.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-25T22:45:47.708 INFO:teuthology.orchestra.run.smithi052.stdout:Nothing to do. 2024-04-25T22:45:47.708 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-04-25T22:45:47.765 DEBUG:teuthology.orchestra.run.smithi164:> echo no | sudo yum reinstall kernel || true 2024-04-25T22:45:47.801 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-04-25T22:45:47.803 INFO:teuthology.orchestra.run.smithi191.stdout:Nothing to do. 2024-04-25T22:45:47.803 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-04-25T22:45:47.805 DEBUG:teuthology.orchestra.run.smithi052:> echo no | sudo yum reinstall kernel || true 2024-04-25T22:45:47.910 DEBUG:teuthology.orchestra.run.smithi191:> echo no | sudo yum reinstall kernel || true 2024-04-25T22:45:47.991 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:00:02 ago on Thu 25 Apr 2024 10:45:45 PM UTC. 2024-04-25T22:45:48.109 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-04-25T22:45:48.124 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-04-25T22:45:48.124 INFO:teuthology.orchestra.run.smithi110.stdout: Package Architecture Version Repository Size 2024-04-25T22:45:48.124 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-04-25T22:45:48.124 INFO:teuthology.orchestra.run.smithi110.stdout:Reinstalling: 2024-04-25T22:45:48.124 INFO:teuthology.orchestra.run.smithi110.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T22:45:48.124 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-25T22:45:48.124 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-04-25T22:45:48.124 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-04-25T22:45:48.124 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-25T22:45:48.125 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 255 k 2024-04-25T22:45:48.125 INFO:teuthology.orchestra.run.smithi110.stdout:Installed size: 0 2024-04-25T22:45:48.125 INFO:teuthology.orchestra.run.smithi110.stderr:Operation aborted. 2024-04-25T22:45:48.183 INFO:teuthology.orchestra.run.smithi110.stdout:Is this ok [y/N]: 2024-04-25T22:45:48.183 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum reinstall -y kernel || true 2024-04-25T22:45:48.264 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 10:45:45 PM UTC. 2024-04-25T22:45:48.329 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 10:45:45 PM UTC. 2024-04-25T22:45:48.423 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-25T22:45:48.435 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-25T22:45:48.435 INFO:teuthology.orchestra.run.smithi164.stdout: Package Architecture Version Repository Size 2024-04-25T22:45:48.435 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-25T22:45:48.435 INFO:teuthology.orchestra.run.smithi164.stdout:Reinstalling: 2024-04-25T22:45:48.435 INFO:teuthology.orchestra.run.smithi164.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T22:45:48.435 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-25T22:45:48.436 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-25T22:45:48.436 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-25T22:45:48.436 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-25T22:45:48.436 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 255 k 2024-04-25T22:45:48.436 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 0 2024-04-25T22:45:48.436 INFO:teuthology.orchestra.run.smithi164.stderr:Operation aborted. 2024-04-25T22:45:48.444 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 10:45:45 PM UTC. 2024-04-25T22:45:48.452 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-04-25T22:45:48.470 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-04-25T22:45:48.470 INFO:teuthology.orchestra.run.smithi052.stdout: Package Architecture Version Repository Size 2024-04-25T22:45:48.471 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-04-25T22:45:48.471 INFO:teuthology.orchestra.run.smithi052.stdout:Reinstalling: 2024-04-25T22:45:48.471 INFO:teuthology.orchestra.run.smithi052.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T22:45:48.471 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:45:48.471 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-04-25T22:45:48.471 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-04-25T22:45:48.471 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:45:48.471 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 255 k 2024-04-25T22:45:48.471 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 0 2024-04-25T22:45:48.471 INFO:teuthology.orchestra.run.smithi052.stderr:Operation aborted. 2024-04-25T22:45:48.490 INFO:teuthology.orchestra.run.smithi164.stdout:Is this ok [y/N]: 2024-04-25T22:45:48.491 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum reinstall -y kernel || true 2024-04-25T22:45:48.522 INFO:teuthology.orchestra.run.smithi052.stdout:Is this ok [y/N]: 2024-04-25T22:45:48.523 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum reinstall -y kernel || true 2024-04-25T22:45:48.562 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-04-25T22:45:48.572 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-25T22:45:48.572 INFO:teuthology.orchestra.run.smithi191.stdout: Package Architecture Version Repository Size 2024-04-25T22:45:48.572 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-25T22:45:48.572 INFO:teuthology.orchestra.run.smithi191.stdout:Reinstalling: 2024-04-25T22:45:48.573 INFO:teuthology.orchestra.run.smithi191.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T22:45:48.573 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T22:45:48.573 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2024-04-25T22:45:48.573 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-25T22:45:48.573 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T22:45:48.573 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 255 k 2024-04-25T22:45:48.573 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 0 2024-04-25T22:45:48.574 INFO:teuthology.orchestra.run.smithi191.stderr:Operation aborted. 2024-04-25T22:45:48.630 INFO:teuthology.orchestra.run.smithi191.stdout:Is this ok [y/N]: 2024-04-25T22:45:48.630 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum reinstall -y kernel || true 2024-04-25T22:45:48.670 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 10:45:45 PM UTC. 2024-04-25T22:45:48.786 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-04-25T22:45:48.787 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-04-25T22:45:48.787 INFO:teuthology.orchestra.run.smithi110.stdout: Package Architecture Version Repository Size 2024-04-25T22:45:48.787 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-04-25T22:45:48.787 INFO:teuthology.orchestra.run.smithi110.stdout:Reinstalling: 2024-04-25T22:45:48.787 INFO:teuthology.orchestra.run.smithi110.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T22:45:48.787 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-25T22:45:48.787 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-04-25T22:45:48.787 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-04-25T22:45:48.787 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-25T22:45:48.787 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 255 k 2024-04-25T22:45:48.787 INFO:teuthology.orchestra.run.smithi110.stdout:Installed size: 0 2024-04-25T22:45:48.787 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-04-25T22:45:48.986 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 10:45:45 PM UTC. 2024-04-25T22:45:49.038 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:00:04 ago on Thu 25 Apr 2024 10:45:45 PM UTC. 2024-04-25T22:45:49.103 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-25T22:45:49.103 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-25T22:45:49.103 INFO:teuthology.orchestra.run.smithi164.stdout: Package Architecture Version Repository Size 2024-04-25T22:45:49.104 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-25T22:45:49.104 INFO:teuthology.orchestra.run.smithi164.stdout:Reinstalling: 2024-04-25T22:45:49.104 INFO:teuthology.orchestra.run.smithi164.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T22:45:49.104 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-25T22:45:49.104 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-25T22:45:49.105 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-25T22:45:49.105 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-25T22:45:49.105 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 255 k 2024-04-25T22:45:49.105 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 0 2024-04-25T22:45:49.105 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-25T22:45:49.121 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:00:04 ago on Thu 25 Apr 2024 10:45:45 PM UTC. 2024-04-25T22:45:49.158 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-04-25T22:45:49.159 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-04-25T22:45:49.159 INFO:teuthology.orchestra.run.smithi052.stdout: Package Architecture Version Repository Size 2024-04-25T22:45:49.159 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-04-25T22:45:49.159 INFO:teuthology.orchestra.run.smithi052.stdout:Reinstalling: 2024-04-25T22:45:49.159 INFO:teuthology.orchestra.run.smithi052.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T22:45:49.159 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:45:49.159 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-04-25T22:45:49.159 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-04-25T22:45:49.159 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:45:49.160 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 255 k 2024-04-25T22:45:49.160 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 0 2024-04-25T22:45:49.160 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-04-25T22:45:49.197 INFO:teuthology.orchestra.run.smithi110.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.7 MB/s | 255 kB 00:00 2024-04-25T22:45:49.198 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-04-25T22:45:49.198 INFO:teuthology.orchestra.run.smithi110.stdout:Total 619 kB/s | 255 kB 00:00 2024-04-25T22:45:49.217 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-04-25T22:45:49.237 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-04-25T22:45:49.238 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-25T22:45:49.238 INFO:teuthology.orchestra.run.smithi191.stdout: Package Architecture Version Repository Size 2024-04-25T22:45:49.239 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-25T22:45:49.239 INFO:teuthology.orchestra.run.smithi191.stdout:Reinstalling: 2024-04-25T22:45:49.239 INFO:teuthology.orchestra.run.smithi191.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T22:45:49.240 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T22:45:49.240 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2024-04-25T22:45:49.240 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-25T22:45:49.240 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T22:45:49.240 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 255 k 2024-04-25T22:45:49.240 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 0 2024-04-25T22:45:49.241 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2024-04-25T22:45:49.397 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-04-25T22:45:49.397 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-04-25T22:45:49.402 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-04-25T22:45:49.402 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-04-25T22:45:49.496 INFO:teuthology.orchestra.run.smithi164.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.9 MB/s | 255 kB 00:00 2024-04-25T22:45:49.497 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-25T22:45:49.497 INFO:teuthology.orchestra.run.smithi164.stdout:Total 646 kB/s | 255 kB 00:00 2024-04-25T22:45:49.503 INFO:teuthology.orchestra.run.smithi191.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.8 MB/s | 255 kB 00:00 2024-04-25T22:45:49.503 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2024-04-25T22:45:49.504 INFO:teuthology.orchestra.run.smithi191.stdout:Total 959 kB/s | 255 kB 00:00 2024-04-25T22:45:49.512 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-25T22:45:49.524 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2024-04-25T22:45:49.538 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-04-25T22:45:49.565 INFO:teuthology.orchestra.run.smithi052.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.9 MB/s | 255 kB 00:00 2024-04-25T22:45:49.566 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-04-25T22:45:49.566 INFO:teuthology.orchestra.run.smithi052.stdout:Total 626 kB/s | 255 kB 00:00 2024-04-25T22:45:49.586 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-04-25T22:45:49.599 INFO:teuthology.orchestra.run.smithi110.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T22:45:49.599 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T22:45:49.700 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2024-04-25T22:45:49.701 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2024-04-25T22:45:49.703 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-25T22:45:49.703 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-25T22:45:49.706 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2024-04-25T22:45:49.706 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2024-04-25T22:45:49.708 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-25T22:45:49.709 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-25T22:45:49.784 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-04-25T22:45:49.784 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-04-25T22:45:49.789 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-04-25T22:45:49.789 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-04-25T22:45:49.814 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-25T22:45:49.850 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2024-04-25T22:45:49.914 INFO:teuthology.orchestra.run.smithi164.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T22:45:49.915 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T22:45:49.918 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-04-25T22:45:49.937 INFO:teuthology.orchestra.run.smithi191.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T22:45:49.938 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T22:45:49.992 INFO:teuthology.orchestra.run.smithi052.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T22:45:49.992 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T22:45:50.227 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T22:45:50.227 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T22:45:50.601 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T22:45:50.601 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T22:45:50.674 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T22:45:50.674 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T22:45:50.694 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T22:45:50.694 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T22:45:50.910 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T22:45:50.910 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-25T22:45:50.910 INFO:teuthology.orchestra.run.smithi110.stdout:Reinstalled: 2024-04-25T22:45:50.910 INFO:teuthology.orchestra.run.smithi110.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-25T22:45:50.910 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-25T22:45:50.910 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-04-25T22:45:51.086 DEBUG:teuthology.orchestra.run.smithi110:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T22:45:51.173 INFO:teuthology.orchestra.run.smithi110.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-25T22:45:51.173 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-25T22:45:51.173 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-25T22:45:51.173 INFO:teuthology.task.kernel:Enabling kdb on osd.0... 2024-04-25T22:45:51.173 DEBUG:teuthology.orchestra.run.smithi110:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T22:45:51.200 INFO:teuthology.orchestra.run.smithi110.stdout:ttyS1 2024-04-25T22:45:51.219 DEBUG:teuthology.parallel:result is None 2024-04-25T22:45:51.316 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T22:45:51.316 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T22:45:51.316 INFO:teuthology.orchestra.run.smithi191.stdout:Reinstalled: 2024-04-25T22:45:51.317 INFO:teuthology.orchestra.run.smithi191.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-25T22:45:51.317 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T22:45:51.317 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-04-25T22:45:51.341 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T22:45:51.341 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-25T22:45:51.341 INFO:teuthology.orchestra.run.smithi164.stdout:Reinstalled: 2024-04-25T22:45:51.341 INFO:teuthology.orchestra.run.smithi164.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-25T22:45:51.341 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-25T22:45:51.341 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-25T22:45:51.412 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T22:45:51.413 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:45:51.413 INFO:teuthology.orchestra.run.smithi052.stdout:Reinstalled: 2024-04-25T22:45:51.413 INFO:teuthology.orchestra.run.smithi052.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-25T22:45:51.413 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:45:51.413 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-04-25T22:45:51.515 DEBUG:teuthology.orchestra.run.smithi191:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T22:45:51.526 DEBUG:teuthology.orchestra.run.smithi164:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T22:45:51.561 INFO:teuthology.orchestra.run.smithi191.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-25T22:45:51.562 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-25T22:45:51.562 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-25T22:45:51.562 INFO:teuthology.task.kernel:Enabling kdb on osd.2... 2024-04-25T22:45:51.562 DEBUG:teuthology.orchestra.run.smithi191:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T22:45:51.573 INFO:teuthology.orchestra.run.smithi164.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-25T22:45:51.573 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-25T22:45:51.573 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-25T22:45:51.573 INFO:teuthology.task.kernel:Enabling kdb on osd.1... 2024-04-25T22:45:51.573 DEBUG:teuthology.orchestra.run.smithi164:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T22:45:51.574 DEBUG:teuthology.orchestra.run.smithi052:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T22:45:51.592 INFO:teuthology.orchestra.run.smithi191.stdout:ttyS1 2024-04-25T22:45:51.605 INFO:teuthology.orchestra.run.smithi164.stdout:ttyS1 2024-04-25T22:45:51.620 DEBUG:teuthology.parallel:result is None 2024-04-25T22:45:51.622 INFO:teuthology.orchestra.run.smithi052.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-25T22:45:51.623 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-25T22:45:51.623 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-25T22:45:51.623 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-25T22:45:51.623 DEBUG:teuthology.orchestra.run.smithi052:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T22:45:51.628 DEBUG:teuthology.parallel:result is None 2024-04-25T22:45:51.657 INFO:teuthology.orchestra.run.smithi052.stdout:ttyS1 2024-04-25T22:45:51.679 DEBUG:teuthology.parallel:result is None 2024-04-25T22:45:51.680 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-25T22:45:51.690 INFO:teuthology.task.internal:Creating test directory... 2024-04-25T22:45:51.690 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T22:45:51.723 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T22:45:51.725 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T22:45:51.727 DEBUG:teuthology.orchestra.run.smithi191:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T22:45:51.741 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-25T22:45:51.748 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-25T22:45:51.778 INFO:teuthology.task.internal:Creating archive directory... 2024-04-25T22:45:51.778 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T22:45:51.781 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T22:45:51.783 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T22:45:51.785 DEBUG:teuthology.orchestra.run.smithi191:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T22:45:51.830 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-25T22:45:51.838 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-25T22:45:51.838 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T22:45:51.844 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T22:45:51.846 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T22:45:51.849 DEBUG:teuthology.orchestra.run.smithi191:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T22:45:51.879 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T22:45:51.881 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T22:45:51.884 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T22:45:51.889 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T22:45:51.891 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T22:45:51.894 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T22:45:51.906 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T22:45:51.915 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T22:45:51.916 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-25T22:45:51.923 INFO:teuthology.task.internal:Configuring sudo... 2024-04-25T22:45:51.924 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T22:45:51.938 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T22:45:51.940 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T22:45:51.943 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T22:45:51.979 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-25T22:45:51.988 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-25T22:45:51.989 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T22:45:52.003 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T22:45:52.005 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T22:45:52.007 DEBUG:teuthology.orchestra.run.smithi191:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T22:45:52.034 DEBUG:teuthology.orchestra.run.smithi052:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T22:45:52.099 DEBUG:teuthology.orchestra.run.smithi052:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T22:45:52.141 DEBUG:teuthology.orchestra.run.smithi052:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T22:45:52.223 DEBUG:teuthology.orchestra.run.smithi052:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T22:45:52.263 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-25T22:45:52.263 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T22:45:52.327 DEBUG:teuthology.orchestra.run.smithi110:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T22:45:52.370 DEBUG:teuthology.orchestra.run.smithi110:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T22:45:52.417 DEBUG:teuthology.orchestra.run.smithi110:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T22:45:52.498 DEBUG:teuthology.orchestra.run.smithi110:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T22:45:52.541 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-25T22:45:52.541 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T22:45:52.605 DEBUG:teuthology.orchestra.run.smithi164:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T22:45:52.647 DEBUG:teuthology.orchestra.run.smithi164:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T22:45:52.698 DEBUG:teuthology.orchestra.run.smithi164:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T22:45:52.781 DEBUG:teuthology.orchestra.run.smithi164:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T22:45:52.819 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-25T22:45:52.819 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T22:45:52.883 DEBUG:teuthology.orchestra.run.smithi191:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T22:45:52.926 DEBUG:teuthology.orchestra.run.smithi191:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T22:45:52.975 DEBUG:teuthology.orchestra.run.smithi191:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T22:45:53.056 DEBUG:teuthology.orchestra.run.smithi191:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T22:45:53.096 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-25T22:45:53.096 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T22:45:53.160 DEBUG:teuthology.orchestra.run.smithi052:> sudo service rsyslog restart 2024-04-25T22:45:53.162 DEBUG:teuthology.orchestra.run.smithi110:> sudo service rsyslog restart 2024-04-25T22:45:53.165 DEBUG:teuthology.orchestra.run.smithi164:> sudo service rsyslog restart 2024-04-25T22:45:53.167 DEBUG:teuthology.orchestra.run.smithi191:> sudo service rsyslog restart 2024-04-25T22:45:53.196 INFO:teuthology.orchestra.run.smithi052.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T22:45:53.199 INFO:teuthology.orchestra.run.smithi110.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T22:45:53.208 INFO:teuthology.orchestra.run.smithi164.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T22:45:53.238 INFO:teuthology.orchestra.run.smithi191.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T22:45:53.713 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-25T22:45:53.724 INFO:teuthology.task.internal:Starting timer... 2024-04-25T22:45:53.725 INFO:teuthology.run_tasks:Running task pcp... 2024-04-25T22:45:53.760 INFO:teuthology.run_tasks:Running task selinux... 2024-04-25T22:45:53.791 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-25T22:45:53.792 DEBUG:teuthology.orchestra.run.smithi052:> sudo service auditd rotate 2024-04-25T22:45:53.831 INFO:teuthology.orchestra.run.smithi052.stdout:Rotating logs: 2024-04-25T22:45:53.833 DEBUG:teuthology.orchestra.run.smithi110:> sudo service auditd rotate 2024-04-25T22:45:53.904 INFO:teuthology.orchestra.run.smithi110.stdout:Rotating logs: 2024-04-25T22:45:53.906 DEBUG:teuthology.orchestra.run.smithi164:> sudo service auditd rotate 2024-04-25T22:45:53.953 INFO:teuthology.orchestra.run.smithi164.stdout:Rotating logs: 2024-04-25T22:45:53.954 DEBUG:teuthology.orchestra.run.smithi191:> sudo service auditd rotate 2024-04-25T22:45:54.001 INFO:teuthology.orchestra.run.smithi191.stdout:Rotating logs: 2024-04-25T22:45:54.002 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-25T22:45:54.002 DEBUG:teuthology.orchestra.run.smithi052:> /usr/sbin/getenforce 2024-04-25T22:45:54.024 INFO:teuthology.orchestra.run.smithi052.stdout:Permissive 2024-04-25T22:45:54.024 DEBUG:teuthology.orchestra.run.smithi110:> /usr/sbin/getenforce 2024-04-25T22:45:54.044 INFO:teuthology.orchestra.run.smithi110.stdout:Permissive 2024-04-25T22:45:54.044 DEBUG:teuthology.orchestra.run.smithi164:> /usr/sbin/getenforce 2024-04-25T22:45:54.075 INFO:teuthology.orchestra.run.smithi164.stdout:Permissive 2024-04-25T22:45:54.076 DEBUG:teuthology.orchestra.run.smithi191:> /usr/sbin/getenforce 2024-04-25T22:45:54.101 INFO:teuthology.orchestra.run.smithi191.stdout:Permissive 2024-04-25T22:45:54.101 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi052.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi110.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi164.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi191.front.sepia.ceph.com': 'permissive'} 2024-04-25T22:45:54.101 DEBUG:teuthology.orchestra.run.smithi052:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T22:45:54.126 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T22:45:54.127 DEBUG:teuthology.orchestra.run.smithi110:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T22:45:54.152 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T22:45:54.152 DEBUG:teuthology.orchestra.run.smithi164:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T22:45:54.176 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T22:45:54.177 DEBUG:teuthology.orchestra.run.smithi191:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T22:45:54.200 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T22:45:54.200 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-25T22:45:54.201 DEBUG:teuthology.orchestra.run.smithi052:> sudo /usr/sbin/setenforce permissive 2024-04-25T22:45:54.226 DEBUG:teuthology.orchestra.run.smithi110:> sudo /usr/sbin/setenforce permissive 2024-04-25T22:45:54.250 DEBUG:teuthology.orchestra.run.smithi164:> sudo /usr/sbin/setenforce permissive 2024-04-25T22:45:54.274 DEBUG:teuthology.orchestra.run.smithi191:> sudo /usr/sbin/setenforce permissive 2024-04-25T22:45:54.298 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-25T22:45:54.312 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-25T22:45:54.317 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-25T22:45:54.450 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-25T22:45:54.466 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-25T22:45:54.468 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi052.front.sepia.ceph.com,smithi110.front.sepia.ceph.com,smithi164.front.sepia.ceph.com,smithi191.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-25T22:49:26.850 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi052.front.sepia.ceph.com'), Remote(name='ubuntu@smithi110.front.sepia.ceph.com'), Remote(name='ubuntu@smithi164.front.sepia.ceph.com'), Remote(name='ubuntu@smithi191.front.sepia.ceph.com')] 2024-04-25T22:49:26.852 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-04-25T22:49:26.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T22:49:26.971 DEBUG:teuthology.orchestra.run.smithi052:> true 2024-04-25T22:49:27.049 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-04-25T22:49:27.050 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-04-25T22:49:27.050 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T22:49:27.123 DEBUG:teuthology.orchestra.run.smithi110:> true 2024-04-25T22:49:27.197 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-04-25T22:49:27.197 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-04-25T22:49:27.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T22:49:27.274 DEBUG:teuthology.orchestra.run.smithi164:> true 2024-04-25T22:49:27.350 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-04-25T22:49:27.351 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-04-25T22:49:27.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T22:49:27.427 DEBUG:teuthology.orchestra.run.smithi191:> true 2024-04-25T22:49:27.506 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-04-25T22:49:27.507 INFO:teuthology.run_tasks:Running task clock... 2024-04-25T22:49:27.520 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-25T22:49:27.520 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T22:49:27.521 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T22:49:27.524 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T22:49:27.524 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T22:49:27.526 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T22:49:27.526 DEBUG:teuthology.orchestra.run.smithi164:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T22:49:27.530 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T22:49:27.530 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T22:49:27.551 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T22:49:27.553 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T22:49:27.555 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T22:49:27.564 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T22:49:27.568 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T22:49:27.569 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T22:49:27.576 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T22:49:27.586 INFO:teuthology.orchestra.run.smithi110.stderr:sudo: ntpd: command not found 2024-04-25T22:49:27.590 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T22:49:27.593 INFO:teuthology.orchestra.run.smithi164.stderr:sudo: ntpd: command not found 2024-04-25T22:49:27.593 INFO:teuthology.orchestra.run.smithi052.stderr:sudo: ntpd: command not found 2024-04-25T22:49:27.597 INFO:teuthology.orchestra.run.smithi110.stdout:506 Cannot talk to daemon 2024-04-25T22:49:27.602 INFO:teuthology.orchestra.run.smithi164.stdout:506 Cannot talk to daemon 2024-04-25T22:49:27.604 INFO:teuthology.orchestra.run.smithi052.stdout:506 Cannot talk to daemon 2024-04-25T22:49:27.609 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T22:49:27.614 INFO:teuthology.orchestra.run.smithi191.stderr:sudo: ntpd: command not found 2024-04-25T22:49:27.616 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T22:49:27.618 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T22:49:27.622 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T22:49:27.624 INFO:teuthology.orchestra.run.smithi191.stdout:506 Cannot talk to daemon 2024-04-25T22:49:27.629 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T22:49:27.632 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T22:49:27.637 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T22:49:27.650 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T22:49:27.679 INFO:teuthology.orchestra.run.smithi110.stderr:bash: line 1: ntpq: command not found 2024-04-25T22:49:27.682 INFO:teuthology.orchestra.run.smithi110.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T22:49:27.682 INFO:teuthology.orchestra.run.smithi110.stdout:=============================================================================== 2024-04-25T22:49:27.682 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T22:49:27.682 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T22:49:27.683 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T22:49:27.683 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T22:49:27.683 INFO:teuthology.orchestra.run.smithi164.stderr:bash: line 1: ntpq: command not found 2024-04-25T22:49:27.687 INFO:teuthology.orchestra.run.smithi164.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T22:49:27.687 INFO:teuthology.orchestra.run.smithi164.stdout:=============================================================================== 2024-04-25T22:49:27.687 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T22:49:27.687 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T22:49:27.687 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T22:49:27.687 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T22:49:27.701 INFO:teuthology.orchestra.run.smithi052.stderr:bash: line 1: ntpq: command not found 2024-04-25T22:49:27.704 INFO:teuthology.orchestra.run.smithi052.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T22:49:27.704 INFO:teuthology.orchestra.run.smithi052.stdout:=============================================================================== 2024-04-25T22:49:27.704 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T22:49:27.705 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T22:49:27.705 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T22:49:27.705 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T22:49:27.710 INFO:teuthology.orchestra.run.smithi191.stderr:bash: line 1: ntpq: command not found 2024-04-25T22:49:27.713 INFO:teuthology.orchestra.run.smithi191.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T22:49:27.713 INFO:teuthology.orchestra.run.smithi191.stdout:=============================================================================== 2024-04-25T22:49:27.713 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T22:49:27.713 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T22:49:27.713 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T22:49:27.713 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T22:49:27.714 INFO:teuthology.run_tasks:Running task install... 2024-04-25T22:49:27.723 DEBUG:teuthology.task.install:project ceph 2024-04-25T22:49:27.723 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}} 2024-04-25T22:49:27.723 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'} 2024-04-25T22:49:27.723 INFO:teuthology.task.install:Using flavor: default 2024-04-25T22:49:27.730 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-25T22:49:27.730 INFO:teuthology.task.install:extra packages: [] 2024-04-25T22:49:27.730 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'tag': None, 'wait_for_package': False} 2024-04-25T22:49:27.731 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T22:49:27.733 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'tag': None, 'wait_for_package': False} 2024-04-25T22:49:27.733 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T22:49:27.734 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'tag': None, 'wait_for_package': False} 2024-04-25T22:49:27.734 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T22:49:27.735 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'tag': None, 'wait_for_package': False} 2024-04-25T22:49:27.735 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T22:49:27.879 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/ 2024-04-25T22:49:27.879 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2445.gd2c45d97 2024-04-25T22:49:27.893 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/ 2024-04-25T22:49:27.893 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2445.gd2c45d97 2024-04-25T22:49:27.918 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/ 2024-04-25T22:49:27.918 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2445.gd2c45d97 2024-04-25T22:49:27.987 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/ 2024-04-25T22:49:27.988 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2445.gd2c45d97 2024-04-25T22:49:27.990 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T22:49:27.990 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-25T22:49:27.990 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T22:49:28.002 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T22:49:28.002 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-25T22:49:28.005 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T22:49:28.023 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-04-25T22:49:28.023 DEBUG:teuthology.orchestra.run.smithi052:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d2c45d977142e024a59b68a8f1dce8f0b9840551/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T22:49:28.031 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-04-25T22:49:28.031 DEBUG:teuthology.orchestra.run.smithi164:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d2c45d977142e024a59b68a8f1dce8f0b9840551/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T22:49:28.088 DEBUG:teuthology.orchestra.run.smithi052:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T22:49:28.096 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T22:49:28.096 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-25T22:49:28.096 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T22:49:28.099 DEBUG:teuthology.orchestra.run.smithi164:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T22:49:28.099 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T22:49:28.099 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-25T22:49:28.099 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T22:49:28.124 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-04-25T22:49:28.125 DEBUG:teuthology.orchestra.run.smithi110:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d2c45d977142e024a59b68a8f1dce8f0b9840551/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T22:49:28.126 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-04-25T22:49:28.126 DEBUG:teuthology.orchestra.run.smithi191:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d2c45d977142e024a59b68a8f1dce8f0b9840551/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T22:49:28.163 DEBUG:teuthology.orchestra.run.smithi052:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T22:49:28.171 DEBUG:teuthology.orchestra.run.smithi164:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T22:49:28.188 DEBUG:teuthology.orchestra.run.smithi110:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T22:49:28.191 DEBUG:teuthology.orchestra.run.smithi191:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T22:49:28.226 INFO:teuthology.orchestra.run.smithi052.stdout:check_obsoletes = 1 2024-04-25T22:49:28.228 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum clean all 2024-04-25T22:49:28.235 INFO:teuthology.orchestra.run.smithi164.stdout:check_obsoletes = 1 2024-04-25T22:49:28.236 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum clean all 2024-04-25T22:49:28.261 DEBUG:teuthology.orchestra.run.smithi110:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T22:49:28.263 DEBUG:teuthology.orchestra.run.smithi191:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T22:49:28.324 INFO:teuthology.orchestra.run.smithi110.stdout:check_obsoletes = 1 2024-04-25T22:49:28.326 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum clean all 2024-04-25T22:49:28.326 INFO:teuthology.orchestra.run.smithi191.stdout:check_obsoletes = 1 2024-04-25T22:49:28.328 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum clean all 2024-04-25T22:49:28.461 INFO:teuthology.orchestra.run.smithi052.stdout:48 files removed 2024-04-25T22:49:28.462 INFO:teuthology.orchestra.run.smithi164.stdout:48 files removed 2024-04-25T22:49:28.487 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-04-25T22:49:28.489 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-04-25T22:49:28.548 INFO:teuthology.orchestra.run.smithi110.stdout:48 files removed 2024-04-25T22:49:28.552 INFO:teuthology.orchestra.run.smithi191.stdout:48 files removed 2024-04-25T22:49:28.573 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-04-25T22:49:28.578 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-04-25T22:49:29.154 INFO:teuthology.orchestra.run.smithi164.stdout:ceph packages for x86_64 205 kB/s | 83 kB 00:00 2024-04-25T22:49:29.234 INFO:teuthology.orchestra.run.smithi052.stdout:ceph packages for x86_64 176 kB/s | 83 kB 00:00 2024-04-25T22:49:29.239 INFO:teuthology.orchestra.run.smithi110.stdout:ceph packages for x86_64 204 kB/s | 83 kB 00:00 2024-04-25T22:49:29.292 INFO:teuthology.orchestra.run.smithi191.stdout:ceph packages for x86_64 183 kB/s | 83 kB 00:00 2024-04-25T22:49:29.530 INFO:teuthology.orchestra.run.smithi164.stdout:ceph noarch packages 35 kB/s | 11 kB 00:00 2024-04-25T22:49:29.576 INFO:teuthology.orchestra.run.smithi052.stdout:ceph noarch packages 39 kB/s | 11 kB 00:00 2024-04-25T22:49:29.623 INFO:teuthology.orchestra.run.smithi110.stdout:ceph noarch packages 34 kB/s | 11 kB 00:00 2024-04-25T22:49:29.668 INFO:teuthology.orchestra.run.smithi191.stdout:ceph noarch packages 35 kB/s | 11 kB 00:00 2024-04-25T22:49:29.894 INFO:teuthology.orchestra.run.smithi052.stdout:ceph source packages 6.7 kB/s | 1.9 kB 00:00 2024-04-25T22:49:29.938 INFO:teuthology.orchestra.run.smithi164.stdout:ceph source packages 5.1 kB/s | 1.9 kB 00:00 2024-04-25T22:49:29.982 INFO:teuthology.orchestra.run.smithi110.stdout:ceph source packages 5.8 kB/s | 1.9 kB 00:00 2024-04-25T22:49:30.077 INFO:teuthology.orchestra.run.smithi191.stdout:ceph source packages 5.1 kB/s | 1.9 kB 00:00 2024-04-25T22:49:30.593 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.0 MB 00:00 2024-04-25T22:49:30.641 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.0 MB 00:00 2024-04-25T22:49:30.805 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.0 MB 00:00 2024-04-25T22:49:30.913 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - BaseOS 8.2 MB/s | 8.0 MB 00:00 2024-04-25T22:49:32.696 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - AppStream 18 MB/s | 19 MB 00:01 2024-04-25T22:49:33.243 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - AppStream 12 MB/s | 19 MB 00:01 2024-04-25T22:49:33.265 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - AppStream 14 MB/s | 19 MB 00:01 2024-04-25T22:49:33.481 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - AppStream 13 MB/s | 19 MB 00:01 2024-04-25T22:49:37.022 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - CRB 7.8 MB/s | 6.2 MB 00:00 2024-04-25T22:49:37.343 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-04-25T22:49:37.540 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - CRB 8.6 MB/s | 6.2 MB 00:00 2024-04-25T22:49:37.773 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-04-25T22:49:38.725 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - Extras packages 66 kB/s | 16 kB 00:00 2024-04-25T22:49:38.813 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - Extras packages 26 kB/s | 16 kB 00:00 2024-04-25T22:49:39.205 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 16 kB 00:00 2024-04-25T22:49:39.597 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - Extras packages 25 kB/s | 16 kB 00:00 2024-04-25T22:49:40.309 INFO:teuthology.orchestra.run.smithi110.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-04-25T22:49:41.876 INFO:teuthology.orchestra.run.smithi052.stdout:Extra Packages for Enterprise Linux 9.7 MB/s | 21 MB 00:02 2024-04-25T22:49:45.434 INFO:teuthology.orchestra.run.smithi110.stdout:lab-extras 18 kB/s | 1.7 kB 00:00 2024-04-25T22:49:45.442 INFO:teuthology.orchestra.run.smithi164.stdout:Extra Packages for Enterprise Linux 3.2 MB/s | 21 MB 00:06 2024-04-25T22:49:47.140 INFO:teuthology.orchestra.run.smithi052.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-04-25T22:49:47.599 INFO:teuthology.orchestra.run.smithi110.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T22:49:47.599 INFO:teuthology.orchestra.run.smithi110.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T22:49:47.667 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-04-25T22:49:47.675 INFO:teuthology.orchestra.run.smithi110.stdout:======================================================================================= 2024-04-25T22:49:47.675 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repository Size 2024-04-25T22:49:47.676 INFO:teuthology.orchestra.run.smithi110.stdout:======================================================================================= 2024-04-25T22:49:47.676 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-04-25T22:49:47.676 INFO:teuthology.orchestra.run.smithi110.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-25T22:49:47.676 INFO:teuthology.orchestra.run.smithi110.stdout: ceph x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 6.6 k 2024-04-25T22:49:47.676 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-base x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 5.4 M 2024-04-25T22:49:47.676 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-fuse x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 890 k 2024-04-25T22:49:47.676 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 145 k 2024-04-25T22:49:47.676 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 1.5 M 2024-04-25T22:49:47.676 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 141 k 2024-04-25T22:49:47.676 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 3.5 M 2024-04-25T22:49:47.676 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 7.4 M 2024-04-25T22:49:47.676 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-rook noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 49 k 2024-04-25T22:49:47.677 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-radosgw x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 10 M 2024-04-25T22:49:47.677 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-test x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 48 M 2024-04-25T22:49:47.677 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-volume noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 264 k 2024-04-25T22:49:47.677 INFO:teuthology.orchestra.run.smithi110.stdout: cephadm noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 762 k 2024-04-25T22:49:47.677 INFO:teuthology.orchestra.run.smithi110.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-25T22:49:47.677 INFO:teuthology.orchestra.run.smithi110.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-25T22:49:47.677 INFO:teuthology.orchestra.run.smithi110.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-25T22:49:47.677 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs-devel x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 32 k 2024-04-25T22:49:47.677 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs2 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 745 k 2024-04-25T22:49:47.677 INFO:teuthology.orchestra.run.smithi110.stdout: librados-devel x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 127 k 2024-04-25T22:49:47.677 INFO:teuthology.orchestra.run.smithi110.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-25T22:49:47.677 INFO:teuthology.orchestra.run.smithi110.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-25T22:49:47.677 INFO:teuthology.orchestra.run.smithi110.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-25T22:49:47.678 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cephfs x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 162 k 2024-04-25T22:49:47.678 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rados x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 321 k 2024-04-25T22:49:47.678 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rbd x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 299 k 2024-04-25T22:49:47.678 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rgw x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 99 k 2024-04-25T22:49:47.678 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-fuse x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 85 k 2024-04-25T22:49:47.678 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-mirror x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 3.1 M 2024-04-25T22:49:47.678 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-nbd x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 171 k 2024-04-25T22:49:47.678 INFO:teuthology.orchestra.run.smithi110.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-25T22:49:47.678 INFO:teuthology.orchestra.run.smithi110.stdout:Upgrading: 2024-04-25T22:49:47.678 INFO:teuthology.orchestra.run.smithi110.stdout: librados2 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 3.4 M 2024-04-25T22:49:47.678 INFO:teuthology.orchestra.run.smithi110.stdout: librbd1 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 3.1 M 2024-04-25T22:49:47.678 INFO:teuthology.orchestra.run.smithi110.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-25T22:49:47.678 INFO:teuthology.orchestra.run.smithi110.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-25T22:49:47.679 INFO:teuthology.orchestra.run.smithi110.stdout:Installing dependencies: 2024-04-25T22:49:47.679 INFO:teuthology.orchestra.run.smithi110.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T22:49:47.679 INFO:teuthology.orchestra.run.smithi110.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-25T22:49:47.679 INFO:teuthology.orchestra.run.smithi110.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T22:49:47.679 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-common x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 21 M 2024-04-25T22:49:47.679 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 32 k 2024-04-25T22:49:47.679 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mds x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 2.4 M 2024-04-25T22:49:47.679 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 249 k 2024-04-25T22:49:47.679 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mon x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 4.7 M 2024-04-25T22:49:47.679 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-osd x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 17 M 2024-04-25T22:49:47.679 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 15 k 2024-04-25T22:49:47.679 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-selinux x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 25 k 2024-04-25T22:49:47.679 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T22:49:47.680 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T22:49:47.680 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T22:49:47.680 INFO:teuthology.orchestra.run.smithi110.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T22:49:47.680 INFO:teuthology.orchestra.run.smithi110.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T22:49:47.680 INFO:teuthology.orchestra.run.smithi110.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T22:49:47.680 INFO:teuthology.orchestra.run.smithi110.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T22:49:47.680 INFO:teuthology.orchestra.run.smithi110.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T22:49:47.680 INFO:teuthology.orchestra.run.smithi110.stdout: libcephsqlite x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 163 k 2024-04-25T22:49:47.680 INFO:teuthology.orchestra.run.smithi110.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T22:49:47.680 INFO:teuthology.orchestra.run.smithi110.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T22:49:47.680 INFO:teuthology.orchestra.run.smithi110.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T22:49:47.680 INFO:teuthology.orchestra.run.smithi110.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T22:49:47.680 INFO:teuthology.orchestra.run.smithi110.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T22:49:47.681 INFO:teuthology.orchestra.run.smithi110.stdout: libradosstriper1 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 501 k 2024-04-25T22:49:47.681 INFO:teuthology.orchestra.run.smithi110.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T22:49:47.681 INFO:teuthology.orchestra.run.smithi110.stdout: librgw2 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 5.3 M 2024-04-25T22:49:47.681 INFO:teuthology.orchestra.run.smithi110.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T22:49:47.681 INFO:teuthology.orchestra.run.smithi110.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-25T22:49:47.681 INFO:teuthology.orchestra.run.smithi110.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T22:49:47.681 INFO:teuthology.orchestra.run.smithi110.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T22:49:47.681 INFO:teuthology.orchestra.run.smithi110.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T22:49:47.681 INFO:teuthology.orchestra.run.smithi110.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T22:49:47.681 INFO:teuthology.orchestra.run.smithi110.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T22:49:47.681 INFO:teuthology.orchestra.run.smithi110.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T22:49:47.681 INFO:teuthology.orchestra.run.smithi110.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T22:49:47.681 INFO:teuthology.orchestra.run.smithi110.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T22:49:47.682 INFO:teuthology.orchestra.run.smithi110.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T22:49:47.682 INFO:teuthology.orchestra.run.smithi110.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T22:49:47.682 INFO:teuthology.orchestra.run.smithi110.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T22:49:47.682 INFO:teuthology.orchestra.run.smithi110.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T22:49:47.682 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T22:49:47.682 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-argparse x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 45 k 2024-04-25T22:49:47.682 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-common x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 133 k 2024-04-25T22:49:47.682 INFO:teuthology.orchestra.run.smithi110.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T22:49:47.682 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T22:49:47.682 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T22:49:47.682 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T22:49:47.682 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T22:49:47.682 INFO:teuthology.orchestra.run.smithi110.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T22:49:47.683 INFO:teuthology.orchestra.run.smithi110.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T22:49:47.683 INFO:teuthology.orchestra.run.smithi110.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T22:49:47.683 INFO:teuthology.orchestra.run.smithi110.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T22:49:47.683 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T22:49:47.683 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T22:49:47.683 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T22:49:47.683 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T22:49:47.683 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T22:49:47.683 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T22:49:47.683 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T22:49:47.683 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T22:49:47.683 INFO:teuthology.orchestra.run.smithi110.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T22:49:47.683 INFO:teuthology.orchestra.run.smithi110.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T22:49:47.683 INFO:teuthology.orchestra.run.smithi110.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T22:49:47.684 INFO:teuthology.orchestra.run.smithi110.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T22:49:47.684 INFO:teuthology.orchestra.run.smithi110.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T22:49:47.684 INFO:teuthology.orchestra.run.smithi110.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T22:49:47.684 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T22:49:47.684 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T22:49:47.684 INFO:teuthology.orchestra.run.smithi110.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T22:49:47.684 INFO:teuthology.orchestra.run.smithi110.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T22:49:47.684 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T22:49:47.684 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T22:49:47.684 INFO:teuthology.orchestra.run.smithi110.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T22:49:47.684 INFO:teuthology.orchestra.run.smithi110.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T22:49:47.684 INFO:teuthology.orchestra.run.smithi110.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T22:49:47.684 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T22:49:47.684 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T22:49:47.685 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T22:49:47.685 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T22:49:47.685 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T22:49:47.685 INFO:teuthology.orchestra.run.smithi110.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T22:49:47.685 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T22:49:47.685 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T22:49:47.685 INFO:teuthology.orchestra.run.smithi110.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T22:49:47.685 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T22:49:47.685 INFO:teuthology.orchestra.run.smithi110.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T22:49:47.685 INFO:teuthology.orchestra.run.smithi110.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T22:49:47.685 INFO:teuthology.orchestra.run.smithi110.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T22:49:47.685 INFO:teuthology.orchestra.run.smithi110.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T22:49:47.685 INFO:teuthology.orchestra.run.smithi110.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T22:49:47.686 INFO:teuthology.orchestra.run.smithi110.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T22:49:47.686 INFO:teuthology.orchestra.run.smithi110.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T22:49:47.686 INFO:teuthology.orchestra.run.smithi110.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T22:49:47.686 INFO:teuthology.orchestra.run.smithi110.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T22:49:47.686 INFO:teuthology.orchestra.run.smithi110.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T22:49:47.686 INFO:teuthology.orchestra.run.smithi110.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T22:49:47.686 INFO:teuthology.orchestra.run.smithi110.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T22:49:47.686 INFO:teuthology.orchestra.run.smithi110.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T22:49:47.686 INFO:teuthology.orchestra.run.smithi110.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T22:49:47.686 INFO:teuthology.orchestra.run.smithi110.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T22:49:47.686 INFO:teuthology.orchestra.run.smithi110.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-25T22:49:47.686 INFO:teuthology.orchestra.run.smithi110.stdout:Installing weak dependencies: 2024-04-25T22:49:47.686 INFO:teuthology.orchestra.run.smithi110.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T22:49:47.686 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-25T22:49:47.687 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-04-25T22:49:47.687 INFO:teuthology.orchestra.run.smithi110.stdout:======================================================================================= 2024-04-25T22:49:47.687 INFO:teuthology.orchestra.run.smithi110.stdout:Install 135 Packages 2024-04-25T22:49:47.687 INFO:teuthology.orchestra.run.smithi110.stdout:Upgrade 4 Packages 2024-04-25T22:49:47.687 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-25T22:49:47.687 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 211 M 2024-04-25T22:49:47.688 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-04-25T22:49:48.549 INFO:teuthology.orchestra.run.smithi110.stdout:(1/139): ceph-19.0.0-2445.gd2c45d97.el9.x86_64. 28 kB/s | 6.6 kB 00:00 2024-04-25T22:49:48.882 INFO:teuthology.orchestra.run.smithi110.stdout:(2/139): ceph-fuse-19.0.0-2445.gd2c45d97.el9.x8 2.6 MB/s | 890 kB 00:00 2024-04-25T22:49:48.966 INFO:teuthology.orchestra.run.smithi110.stdout:(3/139): ceph-immutable-object-cache-19.0.0-244 1.7 MB/s | 145 kB 00:00 2024-04-25T22:49:49.367 INFO:teuthology.orchestra.run.smithi052.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T22:49:49.368 INFO:teuthology.orchestra.run.smithi052.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T22:49:49.440 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-04-25T22:49:49.441 INFO:teuthology.orchestra.run.smithi110.stdout:(4/139): ceph-base-19.0.0-2445.gd2c45d97.el9.x8 4.7 MB/s | 5.4 MB 00:01 2024-04-25T22:49:49.449 INFO:teuthology.orchestra.run.smithi052.stdout:======================================================================================= 2024-04-25T22:49:49.449 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2024-04-25T22:49:49.449 INFO:teuthology.orchestra.run.smithi052.stdout:======================================================================================= 2024-04-25T22:49:49.449 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-04-25T22:49:49.449 INFO:teuthology.orchestra.run.smithi052.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-25T22:49:49.450 INFO:teuthology.orchestra.run.smithi052.stdout: ceph x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 6.6 k 2024-04-25T22:49:49.450 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-base x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 5.4 M 2024-04-25T22:49:49.450 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-fuse x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 890 k 2024-04-25T22:49:49.450 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 145 k 2024-04-25T22:49:49.450 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 1.5 M 2024-04-25T22:49:49.450 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 141 k 2024-04-25T22:49:49.450 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 3.5 M 2024-04-25T22:49:49.450 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 7.4 M 2024-04-25T22:49:49.450 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-rook noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 49 k 2024-04-25T22:49:49.450 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-radosgw x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 10 M 2024-04-25T22:49:49.450 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-test x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 48 M 2024-04-25T22:49:49.450 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-volume noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 264 k 2024-04-25T22:49:49.451 INFO:teuthology.orchestra.run.smithi052.stdout: cephadm noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 762 k 2024-04-25T22:49:49.451 INFO:teuthology.orchestra.run.smithi052.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-25T22:49:49.451 INFO:teuthology.orchestra.run.smithi052.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-25T22:49:49.451 INFO:teuthology.orchestra.run.smithi052.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-25T22:49:49.451 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs-devel x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 32 k 2024-04-25T22:49:49.451 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs2 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 745 k 2024-04-25T22:49:49.451 INFO:teuthology.orchestra.run.smithi052.stdout: librados-devel x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 127 k 2024-04-25T22:49:49.451 INFO:teuthology.orchestra.run.smithi052.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-25T22:49:49.451 INFO:teuthology.orchestra.run.smithi052.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-25T22:49:49.451 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-25T22:49:49.451 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cephfs x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 162 k 2024-04-25T22:49:49.451 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rados x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 321 k 2024-04-25T22:49:49.451 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rbd x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 299 k 2024-04-25T22:49:49.452 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rgw x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 99 k 2024-04-25T22:49:49.452 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-fuse x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 85 k 2024-04-25T22:49:49.452 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-mirror x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 3.1 M 2024-04-25T22:49:49.452 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-nbd x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 171 k 2024-04-25T22:49:49.452 INFO:teuthology.orchestra.run.smithi052.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-25T22:49:49.452 INFO:teuthology.orchestra.run.smithi052.stdout:Upgrading: 2024-04-25T22:49:49.452 INFO:teuthology.orchestra.run.smithi052.stdout: librados2 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 3.4 M 2024-04-25T22:49:49.452 INFO:teuthology.orchestra.run.smithi052.stdout: librbd1 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 3.1 M 2024-04-25T22:49:49.452 INFO:teuthology.orchestra.run.smithi052.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-25T22:49:49.452 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-25T22:49:49.452 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2024-04-25T22:49:49.452 INFO:teuthology.orchestra.run.smithi052.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T22:49:49.452 INFO:teuthology.orchestra.run.smithi052.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-25T22:49:49.453 INFO:teuthology.orchestra.run.smithi052.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T22:49:49.453 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-common x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 21 M 2024-04-25T22:49:49.453 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 32 k 2024-04-25T22:49:49.453 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mds x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 2.4 M 2024-04-25T22:49:49.453 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 249 k 2024-04-25T22:49:49.453 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mon x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 4.7 M 2024-04-25T22:49:49.453 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-osd x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 17 M 2024-04-25T22:49:49.453 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 15 k 2024-04-25T22:49:49.453 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-selinux x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 25 k 2024-04-25T22:49:49.453 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T22:49:49.453 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T22:49:49.453 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T22:49:49.453 INFO:teuthology.orchestra.run.smithi052.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T22:49:49.453 INFO:teuthology.orchestra.run.smithi052.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T22:49:49.454 INFO:teuthology.orchestra.run.smithi052.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T22:49:49.454 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T22:49:49.454 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T22:49:49.454 INFO:teuthology.orchestra.run.smithi052.stdout: libcephsqlite x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 163 k 2024-04-25T22:49:49.454 INFO:teuthology.orchestra.run.smithi052.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T22:49:49.454 INFO:teuthology.orchestra.run.smithi052.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T22:49:49.454 INFO:teuthology.orchestra.run.smithi052.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T22:49:49.454 INFO:teuthology.orchestra.run.smithi052.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T22:49:49.454 INFO:teuthology.orchestra.run.smithi052.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T22:49:49.454 INFO:teuthology.orchestra.run.smithi052.stdout: libradosstriper1 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 501 k 2024-04-25T22:49:49.454 INFO:teuthology.orchestra.run.smithi052.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T22:49:49.454 INFO:teuthology.orchestra.run.smithi052.stdout: librgw2 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 5.3 M 2024-04-25T22:49:49.455 INFO:teuthology.orchestra.run.smithi052.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T22:49:49.455 INFO:teuthology.orchestra.run.smithi052.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-25T22:49:49.456 INFO:teuthology.orchestra.run.smithi052.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T22:49:49.456 INFO:teuthology.orchestra.run.smithi052.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T22:49:49.456 INFO:teuthology.orchestra.run.smithi052.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T22:49:49.456 INFO:teuthology.orchestra.run.smithi052.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T22:49:49.456 INFO:teuthology.orchestra.run.smithi052.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T22:49:49.456 INFO:teuthology.orchestra.run.smithi052.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T22:49:49.456 INFO:teuthology.orchestra.run.smithi052.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T22:49:49.456 INFO:teuthology.orchestra.run.smithi052.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T22:49:49.456 INFO:teuthology.orchestra.run.smithi052.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T22:49:49.456 INFO:teuthology.orchestra.run.smithi052.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T22:49:49.456 INFO:teuthology.orchestra.run.smithi052.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T22:49:49.457 INFO:teuthology.orchestra.run.smithi052.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T22:49:49.457 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T22:49:49.457 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-argparse x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 45 k 2024-04-25T22:49:49.457 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-common x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 133 k 2024-04-25T22:49:49.457 INFO:teuthology.orchestra.run.smithi052.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T22:49:49.458 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T22:49:49.458 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T22:49:49.458 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T22:49:49.458 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T22:49:49.458 INFO:teuthology.orchestra.run.smithi052.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T22:49:49.458 INFO:teuthology.orchestra.run.smithi052.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T22:49:49.458 INFO:teuthology.orchestra.run.smithi052.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T22:49:49.458 INFO:teuthology.orchestra.run.smithi052.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T22:49:49.458 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T22:49:49.458 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T22:49:49.458 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T22:49:49.458 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T22:49:49.459 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T22:49:49.459 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T22:49:49.459 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T22:49:49.459 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T22:49:49.459 INFO:teuthology.orchestra.run.smithi052.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T22:49:49.459 INFO:teuthology.orchestra.run.smithi052.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T22:49:49.459 INFO:teuthology.orchestra.run.smithi052.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T22:49:49.459 INFO:teuthology.orchestra.run.smithi052.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T22:49:49.459 INFO:teuthology.orchestra.run.smithi052.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T22:49:49.459 INFO:teuthology.orchestra.run.smithi052.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T22:49:49.459 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T22:49:49.459 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T22:49:49.459 INFO:teuthology.orchestra.run.smithi052.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T22:49:49.459 INFO:teuthology.orchestra.run.smithi052.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T22:49:49.460 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T22:49:49.460 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T22:49:49.460 INFO:teuthology.orchestra.run.smithi052.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T22:49:49.460 INFO:teuthology.orchestra.run.smithi052.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T22:49:49.460 INFO:teuthology.orchestra.run.smithi052.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T22:49:49.460 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T22:49:49.460 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T22:49:49.460 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T22:49:49.460 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T22:49:49.460 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T22:49:49.460 INFO:teuthology.orchestra.run.smithi052.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T22:49:49.460 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T22:49:49.460 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T22:49:49.460 INFO:teuthology.orchestra.run.smithi052.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T22:49:49.461 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T22:49:49.461 INFO:teuthology.orchestra.run.smithi052.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T22:49:49.461 INFO:teuthology.orchestra.run.smithi052.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T22:49:49.461 INFO:teuthology.orchestra.run.smithi052.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T22:49:49.461 INFO:teuthology.orchestra.run.smithi052.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T22:49:49.461 INFO:teuthology.orchestra.run.smithi052.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T22:49:49.461 INFO:teuthology.orchestra.run.smithi052.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T22:49:49.461 INFO:teuthology.orchestra.run.smithi052.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T22:49:49.461 INFO:teuthology.orchestra.run.smithi052.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T22:49:49.461 INFO:teuthology.orchestra.run.smithi052.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T22:49:49.461 INFO:teuthology.orchestra.run.smithi052.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T22:49:49.461 INFO:teuthology.orchestra.run.smithi052.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T22:49:49.461 INFO:teuthology.orchestra.run.smithi052.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T22:49:49.461 INFO:teuthology.orchestra.run.smithi052.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T22:49:49.462 INFO:teuthology.orchestra.run.smithi052.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T22:49:49.462 INFO:teuthology.orchestra.run.smithi052.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T22:49:49.462 INFO:teuthology.orchestra.run.smithi052.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-25T22:49:49.462 INFO:teuthology.orchestra.run.smithi052.stdout:Installing weak dependencies: 2024-04-25T22:49:49.462 INFO:teuthology.orchestra.run.smithi052.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T22:49:49.462 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:49:49.462 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-04-25T22:49:49.462 INFO:teuthology.orchestra.run.smithi052.stdout:======================================================================================= 2024-04-25T22:49:49.462 INFO:teuthology.orchestra.run.smithi052.stdout:Install 135 Packages 2024-04-25T22:49:49.462 INFO:teuthology.orchestra.run.smithi052.stdout:Upgrade 4 Packages 2024-04-25T22:49:49.462 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:49:49.463 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 211 M 2024-04-25T22:49:49.463 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-04-25T22:49:49.508 INFO:teuthology.orchestra.run.smithi110.stdout:(5/139): ceph-mds-19.0.0-2445.gd2c45d97.el9.x86 4.4 MB/s | 2.4 MB 00:00 2024-04-25T22:49:49.675 INFO:teuthology.orchestra.run.smithi110.stdout:(6/139): ceph-mgr-19.0.0-2445.gd2c45d97.el9.x86 6.4 MB/s | 1.5 MB 00:00 2024-04-25T22:49:49.934 INFO:teuthology.orchestra.run.smithi110.stdout:(7/139): ceph-common-19.0.0-2445.gd2c45d97.el9. 13 MB/s | 21 MB 00:01 2024-04-25T22:49:50.541 INFO:teuthology.orchestra.run.smithi164.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-04-25T22:49:50.633 INFO:teuthology.orchestra.run.smithi052.stdout:(1/139): ceph-19.0.0-2445.gd2c45d97.el9.x86_64. 13 kB/s | 6.6 kB 00:00 2024-04-25T22:49:50.659 INFO:teuthology.orchestra.run.smithi110.stdout:(8/139): ceph-radosgw-19.0.0-2445.gd2c45d97.el9 14 MB/s | 10 MB 00:00 2024-04-25T22:49:50.701 INFO:teuthology.orchestra.run.smithi110.stdout:(9/139): ceph-selinux-19.0.0-2445.gd2c45d97.el9 606 kB/s | 25 kB 00:00 2024-04-25T22:49:50.860 INFO:teuthology.orchestra.run.smithi110.stdout:(10/139): ceph-mon-19.0.0-2445.gd2c45d97.el9.x8 3.5 MB/s | 4.7 MB 00:01 2024-04-25T22:49:50.951 INFO:teuthology.orchestra.run.smithi110.stdout:(11/139): libcephfs-devel-19.0.0-2445.gd2c45d97 346 kB/s | 32 kB 00:00 2024-04-25T22:49:51.042 INFO:teuthology.orchestra.run.smithi052.stdout:(2/139): ceph-base-19.0.0-2445.gd2c45d97.el9.x8 6.0 MB/s | 5.4 MB 00:00 2024-04-25T22:49:51.083 INFO:teuthology.orchestra.run.smithi052.stdout:(3/139): ceph-fuse-19.0.0-2445.gd2c45d97.el9.x8 1.9 MB/s | 890 kB 00:00 2024-04-25T22:49:51.109 INFO:teuthology.orchestra.run.smithi052.stdout:(4/139): ceph-immutable-object-cache-19.0.0-244 2.1 MB/s | 145 kB 00:00 2024-04-25T22:49:51.135 INFO:teuthology.orchestra.run.smithi110.stdout:(12/139): libcephfs2-19.0.0-2445.gd2c45d97.el9. 4.0 MB/s | 745 kB 00:00 2024-04-25T22:49:51.261 INFO:teuthology.orchestra.run.smithi110.stdout:(13/139): libcephsqlite-19.0.0-2445.gd2c45d97.e 1.3 MB/s | 163 kB 00:00 2024-04-25T22:49:51.342 INFO:teuthology.orchestra.run.smithi052.stdout:(5/139): ceph-mgr-19.0.0-2445.gd2c45d97.el9.x86 6.4 MB/s | 1.5 MB 00:00 2024-04-25T22:49:51.369 INFO:teuthology.orchestra.run.smithi110.stdout:(14/139): librados-devel-19.0.0-2445.gd2c45d97. 1.1 MB/s | 127 kB 00:00 2024-04-25T22:49:51.569 INFO:teuthology.orchestra.run.smithi110.stdout:(15/139): libradosstriper1-19.0.0-2445.gd2c45d9 2.4 MB/s | 501 kB 00:00 2024-04-25T22:49:51.709 INFO:teuthology.orchestra.run.smithi052.stdout:(6/139): ceph-mds-19.0.0-2445.gd2c45d97.el9.x86 3.8 MB/s | 2.4 MB 00:00 2024-04-25T22:49:51.853 INFO:teuthology.orchestra.run.smithi110.stdout:(16/139): ceph-osd-19.0.0-2445.gd2c45d97.el9.x8 7.7 MB/s | 17 MB 00:02 2024-04-25T22:49:51.953 INFO:teuthology.orchestra.run.smithi110.stdout:(17/139): python3-ceph-argparse-19.0.0-2445.gd2 453 kB/s | 45 kB 00:00 2024-04-25T22:49:51.994 INFO:teuthology.orchestra.run.smithi052.stdout:(7/139): ceph-mon-19.0.0-2445.gd2c45d97.el9.x86 7.2 MB/s | 4.7 MB 00:00 2024-04-25T22:49:52.028 INFO:teuthology.orchestra.run.smithi110.stdout:(18/139): python3-ceph-common-19.0.0-2445.gd2c4 1.7 MB/s | 133 kB 00:00 2024-04-25T22:49:52.129 INFO:teuthology.orchestra.run.smithi110.stdout:(19/139): python3-cephfs-19.0.0-2445.gd2c45d97. 1.6 MB/s | 162 kB 00:00 2024-04-25T22:49:52.254 INFO:teuthology.orchestra.run.smithi110.stdout:(20/139): python3-rados-19.0.0-2445.gd2c45d97.e 2.5 MB/s | 321 kB 00:00 2024-04-25T22:49:52.379 INFO:teuthology.orchestra.run.smithi110.stdout:(21/139): python3-rbd-19.0.0-2445.gd2c45d97.el9 2.3 MB/s | 299 kB 00:00 2024-04-25T22:49:52.513 INFO:teuthology.orchestra.run.smithi110.stdout:(22/139): python3-rgw-19.0.0-2445.gd2c45d97.el9 744 kB/s | 99 kB 00:00 2024-04-25T22:49:52.614 INFO:teuthology.orchestra.run.smithi110.stdout:(23/139): rbd-fuse-19.0.0-2445.gd2c45d97.el9.x8 852 kB/s | 85 kB 00:00 2024-04-25T22:49:52.676 INFO:teuthology.orchestra.run.smithi164.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T22:49:52.677 INFO:teuthology.orchestra.run.smithi164.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T22:49:52.743 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-25T22:49:52.751 INFO:teuthology.orchestra.run.smithi164.stdout:======================================================================================= 2024-04-25T22:49:52.751 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2024-04-25T22:49:52.752 INFO:teuthology.orchestra.run.smithi164.stdout:======================================================================================= 2024-04-25T22:49:52.752 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-25T22:49:52.752 INFO:teuthology.orchestra.run.smithi164.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-25T22:49:52.752 INFO:teuthology.orchestra.run.smithi164.stdout: ceph x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 6.6 k 2024-04-25T22:49:52.752 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-base x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 5.4 M 2024-04-25T22:49:52.752 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-fuse x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 890 k 2024-04-25T22:49:52.752 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 145 k 2024-04-25T22:49:52.752 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 1.5 M 2024-04-25T22:49:52.752 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 141 k 2024-04-25T22:49:52.752 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 3.5 M 2024-04-25T22:49:52.752 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 7.4 M 2024-04-25T22:49:52.753 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-rook noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 49 k 2024-04-25T22:49:52.753 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-radosgw x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 10 M 2024-04-25T22:49:52.753 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-test x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 48 M 2024-04-25T22:49:52.753 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-volume noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 264 k 2024-04-25T22:49:52.753 INFO:teuthology.orchestra.run.smithi164.stdout: cephadm noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 762 k 2024-04-25T22:49:52.753 INFO:teuthology.orchestra.run.smithi164.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-25T22:49:52.753 INFO:teuthology.orchestra.run.smithi164.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-25T22:49:52.753 INFO:teuthology.orchestra.run.smithi164.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-25T22:49:52.753 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs-devel x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 32 k 2024-04-25T22:49:52.753 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs2 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 745 k 2024-04-25T22:49:52.753 INFO:teuthology.orchestra.run.smithi164.stdout: librados-devel x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 127 k 2024-04-25T22:49:52.753 INFO:teuthology.orchestra.run.smithi164.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-25T22:49:52.753 INFO:teuthology.orchestra.run.smithi164.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-25T22:49:52.753 INFO:teuthology.orchestra.run.smithi164.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-25T22:49:52.754 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cephfs x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 162 k 2024-04-25T22:49:52.754 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rados x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 321 k 2024-04-25T22:49:52.754 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rbd x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 299 k 2024-04-25T22:49:52.754 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rgw x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 99 k 2024-04-25T22:49:52.754 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-fuse x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 85 k 2024-04-25T22:49:52.754 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-mirror x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 3.1 M 2024-04-25T22:49:52.754 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-nbd x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 171 k 2024-04-25T22:49:52.754 INFO:teuthology.orchestra.run.smithi164.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-25T22:49:52.754 INFO:teuthology.orchestra.run.smithi164.stdout:Upgrading: 2024-04-25T22:49:52.754 INFO:teuthology.orchestra.run.smithi164.stdout: librados2 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 3.4 M 2024-04-25T22:49:52.754 INFO:teuthology.orchestra.run.smithi164.stdout: librbd1 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 3.1 M 2024-04-25T22:49:52.754 INFO:teuthology.orchestra.run.smithi164.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-25T22:49:52.755 INFO:teuthology.orchestra.run.smithi164.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-25T22:49:52.755 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2024-04-25T22:49:52.755 INFO:teuthology.orchestra.run.smithi164.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T22:49:52.755 INFO:teuthology.orchestra.run.smithi164.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-25T22:49:52.755 INFO:teuthology.orchestra.run.smithi164.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T22:49:52.755 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-common x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 21 M 2024-04-25T22:49:52.755 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 32 k 2024-04-25T22:49:52.755 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mds x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 2.4 M 2024-04-25T22:49:52.755 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 249 k 2024-04-25T22:49:52.755 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mon x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 4.7 M 2024-04-25T22:49:52.755 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-osd x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 17 M 2024-04-25T22:49:52.755 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 15 k 2024-04-25T22:49:52.755 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-selinux x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 25 k 2024-04-25T22:49:52.755 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T22:49:52.756 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T22:49:52.756 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T22:49:52.756 INFO:teuthology.orchestra.run.smithi164.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T22:49:52.756 INFO:teuthology.orchestra.run.smithi164.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T22:49:52.756 INFO:teuthology.orchestra.run.smithi164.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T22:49:52.756 INFO:teuthology.orchestra.run.smithi164.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T22:49:52.756 INFO:teuthology.orchestra.run.smithi164.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T22:49:52.756 INFO:teuthology.orchestra.run.smithi164.stdout: libcephsqlite x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 163 k 2024-04-25T22:49:52.756 INFO:teuthology.orchestra.run.smithi164.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T22:49:52.756 INFO:teuthology.orchestra.run.smithi164.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T22:49:52.756 INFO:teuthology.orchestra.run.smithi164.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T22:49:52.756 INFO:teuthology.orchestra.run.smithi164.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T22:49:52.757 INFO:teuthology.orchestra.run.smithi164.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T22:49:52.757 INFO:teuthology.orchestra.run.smithi164.stdout: libradosstriper1 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 501 k 2024-04-25T22:49:52.757 INFO:teuthology.orchestra.run.smithi164.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T22:49:52.757 INFO:teuthology.orchestra.run.smithi164.stdout: librgw2 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 5.3 M 2024-04-25T22:49:52.757 INFO:teuthology.orchestra.run.smithi164.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T22:49:52.757 INFO:teuthology.orchestra.run.smithi164.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-25T22:49:52.757 INFO:teuthology.orchestra.run.smithi164.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T22:49:52.757 INFO:teuthology.orchestra.run.smithi164.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T22:49:52.757 INFO:teuthology.orchestra.run.smithi164.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T22:49:52.757 INFO:teuthology.orchestra.run.smithi164.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T22:49:52.757 INFO:teuthology.orchestra.run.smithi164.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T22:49:52.757 INFO:teuthology.orchestra.run.smithi164.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T22:49:52.758 INFO:teuthology.orchestra.run.smithi164.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T22:49:52.758 INFO:teuthology.orchestra.run.smithi164.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T22:49:52.758 INFO:teuthology.orchestra.run.smithi164.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T22:49:52.758 INFO:teuthology.orchestra.run.smithi164.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T22:49:52.758 INFO:teuthology.orchestra.run.smithi164.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T22:49:52.758 INFO:teuthology.orchestra.run.smithi164.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T22:49:52.758 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T22:49:52.758 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-argparse x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 45 k 2024-04-25T22:49:52.758 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-common x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 133 k 2024-04-25T22:49:52.758 INFO:teuthology.orchestra.run.smithi164.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T22:49:52.758 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T22:49:52.758 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T22:49:52.758 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T22:49:52.758 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T22:49:52.759 INFO:teuthology.orchestra.run.smithi164.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T22:49:52.759 INFO:teuthology.orchestra.run.smithi164.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T22:49:52.759 INFO:teuthology.orchestra.run.smithi164.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T22:49:52.759 INFO:teuthology.orchestra.run.smithi164.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T22:49:52.759 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T22:49:52.759 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T22:49:52.759 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T22:49:52.759 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T22:49:52.759 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T22:49:52.759 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T22:49:52.759 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T22:49:52.759 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T22:49:52.759 INFO:teuthology.orchestra.run.smithi164.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T22:49:52.760 INFO:teuthology.orchestra.run.smithi164.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T22:49:52.760 INFO:teuthology.orchestra.run.smithi164.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T22:49:52.760 INFO:teuthology.orchestra.run.smithi164.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T22:49:52.760 INFO:teuthology.orchestra.run.smithi164.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T22:49:52.760 INFO:teuthology.orchestra.run.smithi164.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T22:49:52.760 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T22:49:52.760 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T22:49:52.760 INFO:teuthology.orchestra.run.smithi164.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T22:49:52.760 INFO:teuthology.orchestra.run.smithi164.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T22:49:52.760 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T22:49:52.760 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T22:49:52.760 INFO:teuthology.orchestra.run.smithi164.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T22:49:52.760 INFO:teuthology.orchestra.run.smithi164.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T22:49:52.760 INFO:teuthology.orchestra.run.smithi164.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T22:49:52.761 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T22:49:52.761 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T22:49:52.761 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T22:49:52.761 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T22:49:52.761 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T22:49:52.761 INFO:teuthology.orchestra.run.smithi164.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T22:49:52.761 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T22:49:52.761 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T22:49:52.761 INFO:teuthology.orchestra.run.smithi164.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T22:49:52.761 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T22:49:52.762 INFO:teuthology.orchestra.run.smithi164.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T22:49:52.762 INFO:teuthology.orchestra.run.smithi164.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T22:49:52.762 INFO:teuthology.orchestra.run.smithi164.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T22:49:52.762 INFO:teuthology.orchestra.run.smithi164.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T22:49:52.762 INFO:teuthology.orchestra.run.smithi164.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T22:49:52.762 INFO:teuthology.orchestra.run.smithi164.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T22:49:52.762 INFO:teuthology.orchestra.run.smithi164.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T22:49:52.762 INFO:teuthology.orchestra.run.smithi164.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T22:49:52.762 INFO:teuthology.orchestra.run.smithi164.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T22:49:52.762 INFO:teuthology.orchestra.run.smithi164.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T22:49:52.762 INFO:teuthology.orchestra.run.smithi164.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T22:49:52.762 INFO:teuthology.orchestra.run.smithi164.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T22:49:52.762 INFO:teuthology.orchestra.run.smithi164.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T22:49:52.763 INFO:teuthology.orchestra.run.smithi164.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T22:49:52.763 INFO:teuthology.orchestra.run.smithi164.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T22:49:52.763 INFO:teuthology.orchestra.run.smithi164.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-25T22:49:52.763 INFO:teuthology.orchestra.run.smithi164.stdout:Installing weak dependencies: 2024-04-25T22:49:52.763 INFO:teuthology.orchestra.run.smithi164.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T22:49:52.763 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-25T22:49:52.763 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-25T22:49:52.763 INFO:teuthology.orchestra.run.smithi164.stdout:======================================================================================= 2024-04-25T22:49:52.763 INFO:teuthology.orchestra.run.smithi164.stdout:Install 135 Packages 2024-04-25T22:49:52.763 INFO:teuthology.orchestra.run.smithi164.stdout:Upgrade 4 Packages 2024-04-25T22:49:52.763 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-25T22:49:52.764 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 211 M 2024-04-25T22:49:52.764 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-25T22:49:53.306 INFO:teuthology.orchestra.run.smithi110.stdout:(24/139): rbd-mirror-19.0.0-2445.gd2c45d97.el9. 4.5 MB/s | 3.1 MB 00:00 2024-04-25T22:49:53.318 INFO:teuthology.orchestra.run.smithi052.stdout:(8/139): ceph-radosgw-19.0.0-2445.gd2c45d97.el9 7.7 MB/s | 10 MB 00:01 2024-04-25T22:49:53.368 INFO:teuthology.orchestra.run.smithi052.stdout:(9/139): ceph-selinux-19.0.0-2445.gd2c45d97.el9 507 kB/s | 25 kB 00:00 2024-04-25T22:49:53.372 INFO:teuthology.orchestra.run.smithi110.stdout:(25/139): librgw2-19.0.0-2445.gd2c45d97.el9.x86 2.9 MB/s | 5.3 MB 00:01 2024-04-25T22:49:53.398 INFO:teuthology.orchestra.run.smithi110.stdout:(26/139): rbd-nbd-19.0.0-2445.gd2c45d97.el9.x86 1.8 MB/s | 171 kB 00:00 2024-04-25T22:49:53.457 INFO:teuthology.orchestra.run.smithi110.stdout:(27/139): ceph-grafana-dashboards-19.0.0-2445.g 380 kB/s | 32 kB 00:00 2024-04-25T22:49:53.537 INFO:teuthology.orchestra.run.smithi110.stdout:(28/139): ceph-mgr-cephadm-19.0.0-2445.gd2c45d9 1.4 MB/s | 141 kB 00:00 2024-04-25T22:49:54.160 INFO:teuthology.orchestra.run.smithi164.stdout:(1/139): ceph-19.0.0-2445.gd2c45d97.el9.x86_64. 12 kB/s | 6.6 kB 00:00 2024-04-25T22:49:54.960 INFO:teuthology.orchestra.run.smithi164.stdout:(2/139): ceph-fuse-19.0.0-2445.gd2c45d97.el9.x8 1.1 MB/s | 890 kB 00:00 2024-04-25T22:49:55.093 INFO:teuthology.orchestra.run.smithi164.stdout:(3/139): ceph-immutable-object-cache-19.0.0-244 1.1 MB/s | 145 kB 00:00 2024-04-25T22:49:55.149 INFO:teuthology.orchestra.run.smithi110.stdout:(29/139): ceph-mgr-dashboard-19.0.0-2445.gd2c45 2.1 MB/s | 3.5 MB 00:01 2024-04-25T22:49:55.333 INFO:teuthology.orchestra.run.smithi110.stdout:(30/139): ceph-mgr-diskprediction-local-19.0.0- 4.0 MB/s | 7.4 MB 00:01 2024-04-25T22:49:55.441 INFO:teuthology.orchestra.run.smithi110.stdout:(31/139): ceph-mgr-modules-core-19.0.0-2445.gd2 852 kB/s | 249 kB 00:00 2024-04-25T22:49:55.483 INFO:teuthology.orchestra.run.smithi110.stdout:(32/139): ceph-mgr-rook-19.0.0-2445.gd2c45d97.e 329 kB/s | 49 kB 00:00 2024-04-25T22:49:55.485 INFO:teuthology.orchestra.run.smithi164.stdout:(4/139): ceph-base-19.0.0-2445.gd2c45d97.el9.x8 2.8 MB/s | 5.4 MB 00:01 2024-04-25T22:49:55.542 INFO:teuthology.orchestra.run.smithi110.stdout:(33/139): ceph-prometheus-alerts-19.0.0-2445.gd 153 kB/s | 15 kB 00:00 2024-04-25T22:49:55.600 INFO:teuthology.orchestra.run.smithi110.stdout:(34/139): ceph-volume-19.0.0-2445.gd2c45d97.el9 2.2 MB/s | 264 kB 00:00 2024-04-25T22:49:55.886 INFO:teuthology.orchestra.run.smithi164.stdout:(5/139): ceph-mgr-19.0.0-2445.gd2c45d97.el9.x86 3.7 MB/s | 1.5 MB 00:00 2024-04-25T22:49:55.900 INFO:teuthology.orchestra.run.smithi110.stdout:(35/139): fuse-2.9.9-15.el9.x86_64.rpm 268 kB/s | 80 kB 00:00 2024-04-25T22:49:55.936 INFO:teuthology.orchestra.run.smithi164.stdout:(6/139): ceph-mds-19.0.0-2445.gd2c45d97.el9.x86 2.8 MB/s | 2.4 MB 00:00 2024-04-25T22:49:56.077 INFO:teuthology.orchestra.run.smithi052.stdout:(10/139): ceph-common-19.0.0-2445.gd2c45d97.el9 3.5 MB/s | 21 MB 00:05 2024-04-25T22:49:56.109 INFO:teuthology.orchestra.run.smithi110.stdout:(36/139): cephadm-19.0.0-2445.gd2c45d97.el9.noa 1.3 MB/s | 762 kB 00:00 2024-04-25T22:49:56.151 INFO:teuthology.orchestra.run.smithi110.stdout:(37/139): libgfortran-11.4.1-3.el9.x86_64.rpm 3.1 MB/s | 803 kB 00:00 2024-04-25T22:49:56.193 INFO:teuthology.orchestra.run.smithi110.stdout:(38/139): libquadmath-11.4.1-3.el9.x86_64.rpm 2.3 MB/s | 195 kB 00:00 2024-04-25T22:49:56.202 INFO:teuthology.orchestra.run.smithi052.stdout:(11/139): libcephfs-devel-19.0.0-2445.gd2c45d97 254 kB/s | 32 kB 00:00 2024-04-25T22:49:56.235 INFO:teuthology.orchestra.run.smithi110.stdout:(39/139): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-04-25T22:49:56.427 INFO:teuthology.orchestra.run.smithi110.stdout:(40/139): python3-cryptography-36.0.1-4.el9.x86 5.2 MB/s | 1.2 MB 00:00 2024-04-25T22:49:56.452 INFO:teuthology.orchestra.run.smithi110.stdout:(41/139): python3-ply-3.11-14.el9.noarch.rpm 491 kB/s | 106 kB 00:00 2024-04-25T22:49:56.502 INFO:teuthology.orchestra.run.smithi110.stdout:(42/139): python3-pycparser-2.20-6.el9.noarch.r 1.8 MB/s | 135 kB 00:00 2024-04-25T22:49:56.527 INFO:teuthology.orchestra.run.smithi110.stdout:(43/139): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-04-25T22:49:56.560 INFO:teuthology.orchestra.run.smithi052.stdout:(12/139): libcephfs2-19.0.0-2445.gd2c45d97.el9. 2.0 MB/s | 745 kB 00:00 2024-04-25T22:49:56.561 INFO:teuthology.orchestra.run.smithi110.stdout:(44/139): python3-urllib3-1.26.5-5.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-04-25T22:49:56.595 INFO:teuthology.orchestra.run.smithi110.stdout:(45/139): automake-1.16.2-8.el9.noarch.rpm 10 MB/s | 689 kB 00:00 2024-04-25T22:49:56.628 INFO:teuthology.orchestra.run.smithi110.stdout:(46/139): bison-3.7.4-5.el9.x86_64.rpm 14 MB/s | 943 kB 00:00 2024-04-25T22:49:56.654 INFO:teuthology.orchestra.run.smithi110.stdout:(47/139): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-04-25T22:49:56.661 INFO:teuthology.orchestra.run.smithi052.stdout:(13/139): libcephsqlite-19.0.0-2445.gd2c45d97.e 1.6 MB/s | 163 kB 00:00 2024-04-25T22:49:56.679 INFO:teuthology.orchestra.run.smithi110.stdout:(48/139): elfutils-libelf-devel-0.190-2.el9.x86 430 kB/s | 21 kB 00:00 2024-04-25T22:49:56.713 INFO:teuthology.orchestra.run.smithi110.stdout:(49/139): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 313 kB 00:00 2024-04-25T22:49:56.738 INFO:teuthology.orchestra.run.smithi110.stdout:(50/139): flexiblas-3.0.4-8.el9.x86_64.rpm 564 kB/s | 33 kB 00:00 2024-04-25T22:49:56.786 INFO:teuthology.orchestra.run.smithi052.stdout:(14/139): librados-devel-19.0.0-2445.gd2c45d97. 1.0 MB/s | 127 kB 00:00 2024-04-25T22:49:56.830 INFO:teuthology.orchestra.run.smithi110.stdout:(51/139): flexiblas-netlib-3.0.4-8.el9.x86_64.r 26 MB/s | 3.0 MB 00:00 2024-04-25T22:49:56.855 INFO:teuthology.orchestra.run.smithi110.stdout:(52/139): flexiblas-openblas-openmp-3.0.4-8.el9 158 kB/s | 18 kB 00:00 2024-04-25T22:49:56.869 INFO:teuthology.orchestra.run.smithi164.stdout:(7/139): ceph-mon-19.0.0-2445.gd2c45d97.el9.x86 4.8 MB/s | 4.7 MB 00:00 2024-04-25T22:49:56.880 INFO:teuthology.orchestra.run.smithi110.stdout:(53/139): libaio-devel-0.3.111-13.el9.x86_64.rp 223 kB/s | 11 kB 00:00 2024-04-25T22:49:56.906 INFO:teuthology.orchestra.run.smithi110.stdout:(54/139): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-04-25T22:49:56.931 INFO:teuthology.orchestra.run.smithi110.stdout:(55/139): librabbitmq-0.11.0-7.el9.x86_64.rpm 908 kB/s | 45 kB 00:00 2024-04-25T22:49:56.973 INFO:teuthology.orchestra.run.smithi110.stdout:(56/139): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-04-25T22:49:56.995 INFO:teuthology.orchestra.run.smithi052.stdout:(15/139): libradosstriper1-19.0.0-2445.gd2c45d9 2.3 MB/s | 501 kB 00:00 2024-04-25T22:49:56.998 INFO:teuthology.orchestra.run.smithi110.stdout:(57/139): libtool-2.4.6-45.el9.x86_64.rpm 8.5 MB/s | 582 kB 00:00 2024-04-25T22:49:57.040 INFO:teuthology.orchestra.run.smithi110.stdout:(58/139): libuuid-devel-2.37.4-18.el9.x86_64.rp 384 kB/s | 25 kB 00:00 2024-04-25T22:49:57.066 INFO:teuthology.orchestra.run.smithi110.stdout:(59/139): libzstd-devel-1.5.1-2.el9.x86_64.rpm 706 kB/s | 47 kB 00:00 2024-04-25T22:49:57.108 INFO:teuthology.orchestra.run.smithi110.stdout:(60/139): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-04-25T22:49:57.125 INFO:teuthology.orchestra.run.smithi110.stdout:(61/139): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 188 kB 00:00 2024-04-25T22:49:57.175 INFO:teuthology.orchestra.run.smithi110.stdout:(62/139): openblas-0.3.21-2.el9.x86_64.rpm 530 kB/s | 35 kB 00:00 2024-04-25T22:49:57.384 INFO:teuthology.orchestra.run.smithi110.stdout:(63/139): openblas-openmp-0.3.21-2.el9.x86_64.r 18 MB/s | 4.7 MB 00:00 2024-04-25T22:49:57.501 INFO:teuthology.orchestra.run.smithi110.stdout:(64/139): openssl-devel-3.2.1-1.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-04-25T22:49:57.534 INFO:teuthology.orchestra.run.smithi110.stdout:(65/139): protobuf-3.14.0-13.el9.x86_64.rpm 6.8 MB/s | 1.0 MB 00:00 2024-04-25T22:49:57.801 INFO:teuthology.orchestra.run.smithi110.stdout:(66/139): python3-babel-2.9.1-2.el9.noarch.rpm 20 MB/s | 6.0 MB 00:00 2024-04-25T22:49:57.826 INFO:teuthology.orchestra.run.smithi110.stdout:(67/139): python3-devel-3.9.18-3.el9.x86_64.rpm 837 kB/s | 244 kB 00:00 2024-04-25T22:49:57.868 INFO:teuthology.orchestra.run.smithi110.stdout:(68/139): python3-jinja2-2.11.3-5.el9.noarch.rp 5.8 MB/s | 248 kB 00:00 2024-04-25T22:49:57.893 INFO:teuthology.orchestra.run.smithi110.stdout:(69/139): python3-jsonpatch-1.21-16.el9.noarch. 384 kB/s | 26 kB 00:00 2024-04-25T22:49:57.919 INFO:teuthology.orchestra.run.smithi110.stdout:(70/139): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-04-25T22:49:57.944 INFO:teuthology.orchestra.run.smithi110.stdout:(71/139): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-04-25T22:49:57.978 INFO:teuthology.orchestra.run.smithi110.stdout:(72/139): python3-markupsafe-1.1.1-12.el9.x86_6 597 kB/s | 35 kB 00:00 2024-04-25T22:49:58.178 INFO:teuthology.orchestra.run.smithi110.stdout:(73/139): python3-numpy-1.20.1-5.el9.x86_64.rpm 22 MB/s | 5.1 MB 00:00 2024-04-25T22:49:58.203 INFO:teuthology.orchestra.run.smithi110.stdout:(74/139): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.1 MB/s | 250 kB 00:00 2024-04-25T22:49:58.228 INFO:teuthology.orchestra.run.smithi110.stdout:(75/139): python3-oauthlib-3.1.1-5.el9.noarch.r 4.4 MB/s | 222 kB 00:00 2024-04-25T22:49:58.254 INFO:teuthology.orchestra.run.smithi110.stdout:(76/139): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-04-25T22:49:58.287 INFO:teuthology.orchestra.run.smithi110.stdout:(77/139): python3-prettytable-0.7.2-27.el9.noar 720 kB/s | 42 kB 00:00 2024-04-25T22:49:58.338 INFO:teuthology.orchestra.run.smithi110.stdout:(78/139): python3-protobuf-3.14.0-13.el9.noarch 3.1 MB/s | 269 kB 00:00 2024-04-25T22:49:58.363 INFO:teuthology.orchestra.run.smithi110.stdout:(79/139): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-04-25T22:49:58.405 INFO:teuthology.orchestra.run.smithi110.stdout:(80/139): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 279 kB 00:00 2024-04-25T22:49:58.430 INFO:teuthology.orchestra.run.smithi110.stdout:(81/139): python3-pytz-2021.1-5.el9.noarch.rpm 760 kB/s | 51 kB 00:00 2024-04-25T22:49:58.456 INFO:teuthology.orchestra.run.smithi110.stdout:(82/139): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-04-25T22:49:58.653 INFO:teuthology.orchestra.run.smithi164.stdout:(8/139): ceph-common-19.0.0-2445.gd2c45d97.el9. 4.1 MB/s | 21 MB 00:05 2024-04-25T22:49:58.719 INFO:teuthology.orchestra.run.smithi164.stdout:(9/139): ceph-selinux-19.0.0-2445.gd2c45d97.el9 379 kB/s | 25 kB 00:00 2024-04-25T22:49:58.747 INFO:teuthology.orchestra.run.smithi110.stdout:(83/139): python3-toml-0.10.2-6.el9.noarch.rpm 143 kB/s | 42 kB 00:00 2024-04-25T22:49:58.970 INFO:teuthology.orchestra.run.smithi164.stdout:(10/139): ceph-radosgw-19.0.0-2445.gd2c45d97.el 4.9 MB/s | 10 MB 00:02 2024-04-25T22:49:58.986 INFO:teuthology.orchestra.run.smithi052.stdout:(16/139): librgw2-19.0.0-2445.gd2c45d97.el9.x86 2.7 MB/s | 5.3 MB 00:01 2024-04-25T22:49:59.020 INFO:teuthology.orchestra.run.smithi164.stdout:(11/139): libcephfs-devel-19.0.0-2445.gd2c45d97 639 kB/s | 32 kB 00:00 2024-04-25T22:49:59.087 INFO:teuthology.orchestra.run.smithi052.stdout:(17/139): python3-ceph-argparse-19.0.0-2445.gd2 452 kB/s | 45 kB 00:00 2024-04-25T22:49:59.089 INFO:teuthology.orchestra.run.smithi110.stdout:(84/139): python3-scipy-1.6.2-8.el9.x86_64.rpm 25 MB/s | 16 MB 00:00 2024-04-25T22:49:59.115 INFO:teuthology.orchestra.run.smithi110.stdout:(85/139): qatlib-24.02.0-1.el9.x86_64.rpm 604 kB/s | 221 kB 00:00 2024-04-25T22:49:59.140 INFO:teuthology.orchestra.run.smithi110.stdout:(86/139): qatlib-service-24.02.0-1.el9.x86_64.r 724 kB/s | 36 kB 00:00 2024-04-25T22:49:59.174 INFO:teuthology.orchestra.run.smithi110.stdout:(87/139): qatzip-libs-1.2.0-1.el9.x86_64.rpm 804 kB/s | 47 kB 00:00 2024-04-25T22:49:59.187 INFO:teuthology.orchestra.run.smithi164.stdout:(12/139): libcephfs2-19.0.0-2445.gd2c45d97.el9. 4.4 MB/s | 745 kB 00:00 2024-04-25T22:49:59.187 INFO:teuthology.orchestra.run.smithi052.stdout:(18/139): python3-ceph-common-19.0.0-2445.gd2c4 1.3 MB/s | 133 kB 00:00 2024-04-25T22:49:59.199 INFO:teuthology.orchestra.run.smithi110.stdout:(88/139): socat-1.7.4.1-5.el9.x86_64.rpm 5.1 MB/s | 305 kB 00:00 2024-04-25T22:49:59.224 INFO:teuthology.orchestra.run.smithi110.stdout:(89/139): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.8 MB/s | 94 kB 00:00 2024-04-25T22:49:59.250 INFO:teuthology.orchestra.run.smithi110.stdout:(90/139): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-04-25T22:49:59.270 INFO:teuthology.orchestra.run.smithi164.stdout:(13/139): libcephsqlite-19.0.0-2445.gd2c45d97.e 1.9 MB/s | 163 kB 00:00 2024-04-25T22:49:59.275 INFO:teuthology.orchestra.run.smithi110.stdout:(91/139): zlib-devel-1.2.11-41.el9.x86_64.rpm 893 kB/s | 45 kB 00:00 2024-04-25T22:49:59.287 INFO:teuthology.orchestra.run.smithi052.stdout:(19/139): python3-cephfs-19.0.0-2445.gd2c45d97. 1.6 MB/s | 162 kB 00:00 2024-04-25T22:49:59.300 INFO:teuthology.orchestra.run.smithi110.stdout:(92/139): lua-devel-5.4.4-4.el9.x86_64.rpm 444 kB/s | 22 kB 00:00 2024-04-25T22:49:59.334 INFO:teuthology.orchestra.run.smithi110.stdout:(93/139): protobuf-compiler-3.14.0-13.el9.x86_6 14 MB/s | 863 kB 00:00 2024-04-25T22:49:59.337 INFO:teuthology.orchestra.run.smithi164.stdout:(14/139): librados-devel-19.0.0-2445.gd2c45d97. 1.9 MB/s | 127 kB 00:00 2024-04-25T22:49:59.454 INFO:teuthology.orchestra.run.smithi164.stdout:(15/139): libradosstriper1-19.0.0-2445.gd2c45d9 4.2 MB/s | 501 kB 00:00 2024-04-25T22:49:59.796 INFO:teuthology.orchestra.run.smithi052.stdout:(20/139): ceph-test-19.0.0-2445.gd2c45d97.el9.x 7.5 MB/s | 48 MB 00:06 2024-04-25T22:49:59.822 INFO:teuthology.orchestra.run.smithi052.stdout:(21/139): python3-rados-19.0.0-2445.gd2c45d97.e 601 kB/s | 321 kB 00:00 2024-04-25T22:49:59.914 INFO:teuthology.orchestra.run.smithi052.stdout:(22/139): python3-rbd-19.0.0-2445.gd2c45d97.el9 2.5 MB/s | 299 kB 00:00 2024-04-25T22:49:59.939 INFO:teuthology.orchestra.run.smithi052.stdout:(23/139): python3-rgw-19.0.0-2445.gd2c45d97.el9 851 kB/s | 99 kB 00:00 2024-04-25T22:49:59.981 INFO:teuthology.orchestra.run.smithi052.stdout:(24/139): rbd-fuse-19.0.0-2445.gd2c45d97.el9.x8 1.2 MB/s | 85 kB 00:00 2024-04-25T22:50:00.056 INFO:teuthology.orchestra.run.smithi052.stdout:(25/139): rbd-nbd-19.0.0-2445.gd2c45d97.el9.x86 2.2 MB/s | 171 kB 00:00 2024-04-25T22:50:00.084 INFO:teuthology.orchestra.run.smithi110.stdout:(94/139): gperftools-libs-2.9.1-2.el9.x86_64.rp 412 kB/s | 309 kB 00:00 2024-04-25T22:50:00.123 INFO:teuthology.orchestra.run.smithi052.stdout:(26/139): ceph-grafana-dashboards-19.0.0-2445.g 476 kB/s | 32 kB 00:00 2024-04-25T22:50:00.151 INFO:teuthology.orchestra.run.smithi110.stdout:(95/139): abseil-cpp-20211102.0-3.el9.x86_64.rp 645 kB/s | 548 kB 00:00 2024-04-25T22:50:00.163 INFO:teuthology.orchestra.run.smithi164.stdout:(16/139): librgw2-19.0.0-2445.gd2c45d97.el9.x86 7.5 MB/s | 5.3 MB 00:00 2024-04-25T22:50:00.173 INFO:teuthology.orchestra.run.smithi052.stdout:(27/139): ceph-mgr-cephadm-19.0.0-2445.gd2c45d9 2.8 MB/s | 141 kB 00:00 2024-04-25T22:50:00.213 INFO:teuthology.orchestra.run.smithi164.stdout:(17/139): python3-ceph-argparse-19.0.0-2445.gd2 907 kB/s | 45 kB 00:00 2024-04-25T22:50:00.218 INFO:teuthology.orchestra.run.smithi110.stdout:(96/139): grpc-data-1.46.7-10.el9.noarch.rpm 145 kB/s | 19 kB 00:00 2024-04-25T22:50:00.288 INFO:teuthology.orchestra.run.smithi164.stdout:(18/139): python3-ceph-common-19.0.0-2445.gd2c4 1.7 MB/s | 133 kB 00:00 2024-04-25T22:50:00.343 INFO:teuthology.orchestra.run.smithi110.stdout:(97/139): libarrow-doc-9.0.0-10.el9.noarch.rpm 208 kB/s | 26 kB 00:00 2024-04-25T22:50:00.380 INFO:teuthology.orchestra.run.smithi164.stdout:(19/139): python3-cephfs-19.0.0-2445.gd2c45d97. 1.7 MB/s | 162 kB 00:00 2024-04-25T22:50:00.472 INFO:teuthology.orchestra.run.smithi164.stdout:(20/139): python3-rados-19.0.0-2445.gd2c45d97.e 3.4 MB/s | 321 kB 00:00 2024-04-25T22:50:00.502 INFO:teuthology.orchestra.run.smithi110.stdout:(98/139): liboath-2.6.7-2.el9.x86_64.rpm 307 kB/s | 49 kB 00:00 2024-04-25T22:50:00.564 INFO:teuthology.orchestra.run.smithi164.stdout:(21/139): python3-rbd-19.0.0-2445.gd2c45d97.el9 3.2 MB/s | 299 kB 00:00 2024-04-25T22:50:00.685 INFO:teuthology.orchestra.run.smithi110.stdout:(99/139): libarrow-9.0.0-10.el9.x86_64.rpm 8.3 MB/s | 4.4 MB 00:00 2024-04-25T22:50:00.711 INFO:teuthology.orchestra.run.smithi110.stdout:(100/139): libunwind-1.6.2-1.el9.x86_64.rpm 323 kB/s | 67 kB 00:00 2024-04-25T22:50:00.723 INFO:teuthology.orchestra.run.smithi164.stdout:(22/139): ceph-osd-19.0.0-2445.gd2c45d97.el9.x8 3.5 MB/s | 17 MB 00:04 2024-04-25T22:50:00.724 INFO:teuthology.orchestra.run.smithi052.stdout:(28/139): ceph-osd-19.0.0-2445.gd2c45d97.el9.x8 1.9 MB/s | 17 MB 00:09 2024-04-25T22:50:00.748 INFO:teuthology.orchestra.run.smithi164.stdout:(23/139): python3-rgw-19.0.0-2445.gd2c45d97.el9 540 kB/s | 99 kB 00:00 2024-04-25T22:50:00.791 INFO:teuthology.orchestra.run.smithi052.stdout:(29/139): ceph-mgr-dashboard-19.0.0-2445.gd2c45 5.7 MB/s | 3.5 MB 00:00 2024-04-25T22:50:00.807 INFO:teuthology.orchestra.run.smithi164.stdout:(24/139): rbd-fuse-19.0.0-2445.gd2c45d97.el9.x8 1.0 MB/s | 85 kB 00:00 2024-04-25T22:50:00.811 INFO:teuthology.orchestra.run.smithi110.stdout:(101/139): luarocks-3.9.2-1.el9.noarch.rpm 1.2 MB/s | 151 kB 00:00 2024-04-25T22:50:00.841 INFO:teuthology.orchestra.run.smithi052.stdout:(30/139): rbd-mirror-19.0.0-2445.gd2c45d97.el9. 3.4 MB/s | 3.1 MB 00:00 2024-04-25T22:50:00.891 INFO:teuthology.orchestra.run.smithi164.stdout:(25/139): rbd-nbd-19.0.0-2445.gd2c45d97.el9.x86 2.0 MB/s | 171 kB 00:00 2024-04-25T22:50:00.899 INFO:teuthology.orchestra.run.smithi052.stdout:(31/139): ceph-mgr-modules-core-19.0.0-2445.gd2 2.2 MB/s | 249 kB 00:00 2024-04-25T22:50:00.925 INFO:teuthology.orchestra.run.smithi052.stdout:(32/139): ceph-mgr-rook-19.0.0-2445.gd2c45d97.e 590 kB/s | 49 kB 00:00 2024-04-25T22:50:00.950 INFO:teuthology.orchestra.run.smithi052.stdout:(33/139): ceph-prometheus-alerts-19.0.0-2445.gd 306 kB/s | 15 kB 00:00 2024-04-25T22:50:00.966 INFO:teuthology.orchestra.run.smithi164.stdout:(26/139): ceph-grafana-dashboards-19.0.0-2445.g 422 kB/s | 32 kB 00:00 2024-04-25T22:50:01.017 INFO:teuthology.orchestra.run.smithi052.stdout:(34/139): ceph-volume-19.0.0-2445.gd2c45d97.el9 2.8 MB/s | 264 kB 00:00 2024-04-25T22:50:01.059 INFO:teuthology.orchestra.run.smithi052.stdout:(35/139): cephadm-19.0.0-2445.gd2c45d97.el9.noa 6.9 MB/s | 762 kB 00:00 2024-04-25T22:50:01.092 INFO:teuthology.orchestra.run.smithi164.stdout:(27/139): ceph-mgr-cephadm-19.0.0-2445.gd2c45d9 1.1 MB/s | 141 kB 00:00 2024-04-25T22:50:01.166 INFO:teuthology.orchestra.run.smithi164.stdout:(28/139): rbd-mirror-19.0.0-2445.gd2c45d97.el9. 7.4 MB/s | 3.1 MB 00:00 2024-04-25T22:50:01.245 INFO:teuthology.orchestra.run.smithi110.stdout:(102/139): ceph-test-19.0.0-2445.gd2c45d97.el9. 4.6 MB/s | 48 MB 00:10 2024-04-25T22:50:01.267 INFO:teuthology.orchestra.run.smithi052.stdout:(36/139): fuse-2.9.9-15.el9.x86_64.rpm 321 kB/s | 80 kB 00:00 2024-04-25T22:50:01.278 INFO:teuthology.orchestra.run.smithi110.stdout:(103/139): python3-asyncssh-2.13.2-5.el9.noarch 1.1 MB/s | 548 kB 00:00 2024-04-25T22:50:01.420 INFO:teuthology.orchestra.run.smithi110.stdout:(104/139): parquet-libs-9.0.0-10.el9.x86_64.rpm 1.2 MB/s | 838 kB 00:00 2024-04-25T22:50:01.437 INFO:teuthology.orchestra.run.smithi110.stdout:(105/139): python3-cachetools-4.2.4-1.el9.noarc 203 kB/s | 32 kB 00:00 2024-04-25T22:50:01.442 INFO:teuthology.orchestra.run.smithi052.stdout:(37/139): libquadmath-11.4.1-3.el9.x86_64.rpm 1.1 MB/s | 195 kB 00:00 2024-04-25T22:50:01.571 INFO:teuthology.orchestra.run.smithi110.stdout:(106/139): python3-certifi-2021.10.8-2.el9.noar 100 kB/s | 15 kB 00:00 2024-04-25T22:50:01.596 INFO:teuthology.orchestra.run.smithi110.stdout:(107/139): python3-cheroot-8.6.0-4.el9.noarch.r 1.1 MB/s | 172 kB 00:00 2024-04-25T22:50:01.626 INFO:teuthology.orchestra.run.smithi052.stdout:(38/139): libgfortran-11.4.1-3.el9.x86_64.rpm 1.4 MB/s | 803 kB 00:00 2024-04-25T22:50:01.746 INFO:teuthology.orchestra.run.smithi110.stdout:(108/139): python3-google-auth-2.29.0-1.el9.noa 1.3 MB/s | 206 kB 00:00 2024-04-25T22:50:01.772 INFO:teuthology.orchestra.run.smithi110.stdout:(109/139): python3-cherrypy-18.6.1-2.el9.noarch 1.7 MB/s | 358 kB 00:00 2024-04-25T22:50:01.813 INFO:teuthology.orchestra.run.smithi110.stdout:(110/139): python3-bcrypt-3.2.2-1.el9.x86_64.rp 76 kB/s | 43 kB 00:00 2024-04-25T22:50:01.826 INFO:teuthology.orchestra.run.smithi052.stdout:(39/139): python3-cffi-1.14.5-5.el9.x86_64.rpm 660 kB/s | 253 kB 00:00 2024-04-25T22:50:01.867 INFO:teuthology.orchestra.run.smithi164.stdout:(29/139): ceph-mgr-diskprediction-local-19.0.0- 11 MB/s | 7.4 MB 00:00 2024-04-25T22:50:01.930 INFO:teuthology.orchestra.run.smithi110.stdout:(111/139): python3-grpcio-1.46.7-10.el9.x86_64. 11 MB/s | 2.0 MB 00:00 2024-04-25T22:50:01.934 INFO:teuthology.orchestra.run.smithi164.stdout:(30/139): ceph-mgr-modules-core-19.0.0-2445.gd2 3.7 MB/s | 249 kB 00:00 2024-04-25T22:50:01.956 INFO:teuthology.orchestra.run.smithi110.stdout:(112/139): python3-jaraco-8.2.1-3.el9.noarch.rp 75 kB/s | 11 kB 00:00 2024-04-25T22:50:01.981 INFO:teuthology.orchestra.run.smithi110.stdout:(113/139): python3-grpcio-tools-1.46.7-10.el9.x 691 kB/s | 144 kB 00:00 2024-04-25T22:50:01.984 INFO:teuthology.orchestra.run.smithi164.stdout:(31/139): ceph-mgr-rook-19.0.0-2445.gd2c45d97.e 987 kB/s | 49 kB 00:00 2024-04-25T22:50:02.034 INFO:teuthology.orchestra.run.smithi164.stdout:(32/139): ceph-prometheus-alerts-19.0.0-2445.gd 307 kB/s | 15 kB 00:00 2024-04-25T22:50:02.040 INFO:teuthology.orchestra.run.smithi110.stdout:(114/139): python3-jaraco-classes-3.2.1-5.el9.n 162 kB/s | 18 kB 00:00 2024-04-25T22:50:02.099 INFO:teuthology.orchestra.run.smithi110.stdout:(115/139): python3-jaraco-functools-3.5.0-2.el9 166 kB/s | 19 kB 00:00 2024-04-25T22:50:02.103 INFO:teuthology.orchestra.run.smithi164.stdout:(33/139): ceph-volume-19.0.0-2445.gd2c45d97.el9 3.7 MB/s | 264 kB 00:00 2024-04-25T22:50:02.124 INFO:teuthology.orchestra.run.smithi110.stdout:(116/139): python3-jaraco-collections-3.0.0-8.e 138 kB/s | 23 kB 00:00 2024-04-25T22:50:02.135 INFO:teuthology.orchestra.run.smithi052.stdout:(40/139): python3-cryptography-36.0.1-4.el9.x86 2.4 MB/s | 1.2 MB 00:00 2024-04-25T22:50:02.149 INFO:teuthology.orchestra.run.smithi110.stdout:(117/139): python3-jaraco-text-3.2.0-6.el9.noar 180 kB/s | 20 kB 00:00 2024-04-25T22:50:02.162 INFO:teuthology.orchestra.run.smithi052.stdout:(41/139): python3-ply-3.11-14.el9.noarch.rpm 318 kB/s | 106 kB 00:00 2024-04-25T22:50:02.187 INFO:teuthology.orchestra.run.smithi052.stdout:(42/139): python3-pycparser-2.20-6.el9.noarch.r 2.5 MB/s | 135 kB 00:00 2024-04-25T22:50:02.203 INFO:teuthology.orchestra.run.smithi164.stdout:(34/139): ceph-mgr-dashboard-19.0.0-2445.gd2c45 3.2 MB/s | 3.5 MB 00:01 2024-04-25T22:50:02.213 INFO:teuthology.orchestra.run.smithi052.stdout:(43/139): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-04-25T22:50:02.254 INFO:teuthology.orchestra.run.smithi164.stdout:(35/139): cephadm-19.0.0-2445.gd2c45d97.el9.noa 5.0 MB/s | 762 kB 00:00 2024-04-25T22:50:02.271 INFO:teuthology.orchestra.run.smithi052.stdout:(44/139): python3-urllib3-1.26.5-5.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-04-25T22:50:02.291 INFO:teuthology.orchestra.run.smithi110.stdout:(118/139): python3-more-itertools-8.12.0-2.el9. 557 kB/s | 79 kB 00:00 2024-04-25T22:50:02.316 INFO:teuthology.orchestra.run.smithi110.stdout:(119/139): python3-logutils-0.3.5-21.el9.noarch 241 kB/s | 46 kB 00:00 2024-04-25T22:50:02.358 INFO:teuthology.orchestra.run.smithi110.stdout:(120/139): python3-kubernetes-26.1.0-2.el9.noar 3.9 MB/s | 1.0 MB 00:00 2024-04-25T22:50:02.371 INFO:teuthology.orchestra.run.smithi164.stdout:(36/139): fuse-2.9.9-15.el9.x86_64.rpm 482 kB/s | 80 kB 00:00 2024-04-25T22:50:02.417 INFO:teuthology.orchestra.run.smithi110.stdout:(121/139): python3-natsort-7.1.1-5.el9.noarch.r 460 kB/s | 58 kB 00:00 2024-04-25T22:50:02.430 INFO:teuthology.orchestra.run.smithi164.stdout:(37/139): libgfortran-11.4.1-3.el9.x86_64.rpm 5.2 MB/s | 803 kB 00:00 2024-04-25T22:50:02.455 INFO:teuthology.orchestra.run.smithi164.stdout:(38/139): libquadmath-11.4.1-3.el9.x86_64.rpm 2.3 MB/s | 195 kB 00:00 2024-04-25T22:50:02.480 INFO:teuthology.orchestra.run.smithi052.stdout:(45/139): automake-1.16.2-8.el9.noarch.rpm 2.5 MB/s | 689 kB 00:00 2024-04-25T22:50:02.480 INFO:teuthology.orchestra.run.smithi164.stdout:(39/139): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.9 MB/s | 253 kB 00:00 2024-04-25T22:50:02.492 INFO:teuthology.orchestra.run.smithi110.stdout:(122/139): python3-portend-3.1.0-2.el9.noarch.r 123 kB/s | 16 kB 00:00 2024-04-25T22:50:02.522 INFO:teuthology.orchestra.run.smithi052.stdout:(46/139): bison-3.7.4-5.el9.x86_64.rpm 3.7 MB/s | 943 kB 00:00 2024-04-25T22:50:02.522 INFO:teuthology.orchestra.run.smithi164.stdout:(40/139): python3-cryptography-36.0.1-4.el9.x86 18 MB/s | 1.2 MB 00:00 2024-04-25T22:50:02.539 INFO:teuthology.orchestra.run.smithi052.stdout:(47/139): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-04-25T22:50:02.547 INFO:teuthology.orchestra.run.smithi164.stdout:(41/139): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-04-25T22:50:02.559 INFO:teuthology.orchestra.run.smithi110.stdout:(123/139): python3-pyOpenSSL-21.0.0-1.el9.noarc 633 kB/s | 90 kB 00:00 2024-04-25T22:50:02.564 INFO:teuthology.orchestra.run.smithi052.stdout:(48/139): elfutils-libelf-devel-0.190-2.el9.x86 515 kB/s | 21 kB 00:00 2024-04-25T22:50:02.573 INFO:teuthology.orchestra.run.smithi164.stdout:(42/139): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-04-25T22:50:02.598 INFO:teuthology.orchestra.run.smithi164.stdout:(43/139): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-04-25T22:50:02.623 INFO:teuthology.orchestra.run.smithi052.stdout:(49/139): flex-2.6.4-9.el9.x86_64.rpm 3.7 MB/s | 313 kB 00:00 2024-04-25T22:50:02.632 INFO:teuthology.orchestra.run.smithi164.stdout:(44/139): python3-urllib3-1.26.5-5.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-04-25T22:50:02.634 INFO:teuthology.orchestra.run.smithi110.stdout:(124/139): python3-repoze-lru-0.7-16.el9.noarch 217 kB/s | 31 kB 00:00 2024-04-25T22:50:02.648 INFO:teuthology.orchestra.run.smithi052.stdout:(50/139): flexiblas-3.0.4-8.el9.x86_64.rpm 393 kB/s | 33 kB 00:00 2024-04-25T22:50:02.657 INFO:teuthology.orchestra.run.smithi164.stdout:(45/139): automake-1.16.2-8.el9.noarch.rpm 12 MB/s | 689 kB 00:00 2024-04-25T22:50:02.693 INFO:teuthology.orchestra.run.smithi110.stdout:(125/139): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-04-25T22:50:02.699 INFO:teuthology.orchestra.run.smithi164.stdout:(46/139): bison-3.7.4-5.el9.x86_64.rpm 14 MB/s | 943 kB 00:00 2024-04-25T22:50:02.718 INFO:teuthology.orchestra.run.smithi110.stdout:(126/139): python3-pecan-1.4.2-3.el9.noarch.rpm 678 kB/s | 272 kB 00:00 2024-04-25T22:50:02.724 INFO:teuthology.orchestra.run.smithi164.stdout:(47/139): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-04-25T22:50:02.749 INFO:teuthology.orchestra.run.smithi164.stdout:(48/139): elfutils-libelf-devel-0.190-2.el9.x86 431 kB/s | 21 kB 00:00 2024-04-25T22:50:02.760 INFO:teuthology.orchestra.run.smithi110.stdout:(127/139): python3-rsa-4.9-2.el9.noarch.rpm 471 kB/s | 59 kB 00:00 2024-04-25T22:50:02.779 INFO:teuthology.orchestra.run.smithi164.stdout:(49/139): flex-2.6.4-9.el9.x86_64.rpm 5.7 MB/s | 313 kB 00:00 2024-04-25T22:50:02.808 INFO:teuthology.orchestra.run.smithi164.stdout:(50/139): flexiblas-3.0.4-8.el9.x86_64.rpm 564 kB/s | 33 kB 00:00 2024-04-25T22:50:02.852 INFO:teuthology.orchestra.run.smithi110.stdout:(128/139): python3-tempora-5.0.0-2.el9.noarch.r 225 kB/s | 36 kB 00:00 2024-04-25T22:50:02.877 INFO:teuthology.orchestra.run.smithi110.stdout:(129/139): python3-typing-extensions-4.4.0-2.el 321 kB/s | 51 kB 00:00 2024-04-25T22:50:02.892 INFO:teuthology.orchestra.run.smithi164.stdout:(51/139): flexiblas-netlib-3.0.4-8.el9.x86_64.r 27 MB/s | 3.0 MB 00:00 2024-04-25T22:50:02.911 INFO:teuthology.orchestra.run.smithi110.stdout:(130/139): python3-webob-1.8.7-6.el9.noarch.rpm 1.5 MB/s | 230 kB 00:00 2024-04-25T22:50:02.917 INFO:teuthology.orchestra.run.smithi164.stdout:(52/139): flexiblas-openblas-openmp-3.0.4-8.el9 170 kB/s | 18 kB 00:00 2024-04-25T22:50:02.943 INFO:teuthology.orchestra.run.smithi164.stdout:(53/139): libaio-devel-0.3.111-13.el9.x86_64.rp 223 kB/s | 11 kB 00:00 2024-04-25T22:50:02.968 INFO:teuthology.orchestra.run.smithi164.stdout:(54/139): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-04-25T22:50:02.993 INFO:teuthology.orchestra.run.smithi164.stdout:(55/139): librabbitmq-0.11.0-7.el9.x86_64.rpm 909 kB/s | 45 kB 00:00 2024-04-25T22:50:02.998 INFO:teuthology.orchestra.run.smithi052.stdout:(51/139): flexiblas-netlib-3.0.4-8.el9.x86_64.r 8.0 MB/s | 3.0 MB 00:00 2024-04-25T22:50:03.024 INFO:teuthology.orchestra.run.smithi052.stdout:(52/139): flexiblas-openblas-openmp-3.0.4-8.el9 48 kB/s | 18 kB 00:00 2024-04-25T22:50:03.026 INFO:teuthology.orchestra.run.smithi164.stdout:(56/139): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-04-25T22:50:03.028 INFO:teuthology.orchestra.run.smithi110.stdout:(131/139): python3-websocket-client-1.2.3-2.el9 511 kB/s | 90 kB 00:00 2024-04-25T22:50:03.066 INFO:teuthology.orchestra.run.smithi052.stdout:(53/139): libaio-devel-0.3.111-13.el9.x86_64.rp 167 kB/s | 11 kB 00:00 2024-04-25T22:50:03.069 INFO:teuthology.orchestra.run.smithi164.stdout:(57/139): libtool-2.4.6-45.el9.x86_64.rpm 7.7 MB/s | 582 kB 00:00 2024-04-25T22:50:03.094 INFO:teuthology.orchestra.run.smithi164.stdout:(58/139): libuuid-devel-2.37.4-18.el9.x86_64.rp 380 kB/s | 25 kB 00:00 2024-04-25T22:50:03.108 INFO:teuthology.orchestra.run.smithi052.stdout:(54/139): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 160 kB 00:00 2024-04-25T22:50:03.133 INFO:teuthology.orchestra.run.smithi052.stdout:(55/139): librabbitmq-0.11.0-7.el9.x86_64.rpm 677 kB/s | 45 kB 00:00 2024-04-25T22:50:03.136 INFO:teuthology.orchestra.run.smithi164.stdout:(59/139): libzstd-devel-1.5.1-2.el9.x86_64.rpm 708 kB/s | 47 kB 00:00 2024-04-25T22:50:03.145 INFO:teuthology.orchestra.run.smithi110.stdout:(132/139): python3-zc-lockfile-2.0-10.el9.noarc 85 kB/s | 20 kB 00:00 2024-04-25T22:50:03.169 INFO:teuthology.orchestra.run.smithi164.stdout:(60/139): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-04-25T22:50:03.187 INFO:teuthology.orchestra.run.smithi110.stdout:(133/139): re2-20211101-3.el9.x86_64.rpm 1.2 MB/s | 192 kB 00:00 2024-04-25T22:50:03.203 INFO:teuthology.orchestra.run.smithi164.stdout:(61/139): lua-5.4.4-4.el9.x86_64.rpm 2.7 MB/s | 188 kB 00:00 2024-04-25T22:50:03.216 INFO:teuthology.orchestra.run.smithi052.stdout:(56/139): librdkafka-1.6.1-102.el9.x86_64.rpm 6.0 MB/s | 662 kB 00:00 2024-04-25T22:50:03.220 INFO:teuthology.orchestra.run.smithi164.stdout:(62/139): openblas-0.3.21-2.el9.x86_64.rpm 696 kB/s | 35 kB 00:00 2024-04-25T22:50:03.221 INFO:teuthology.orchestra.run.smithi110.stdout:(134/139): python3-werkzeug-2.0.3-3.el9.1.noarc 1.2 MB/s | 427 kB 00:00 2024-04-25T22:50:03.242 INFO:teuthology.orchestra.run.smithi052.stdout:(57/139): libtool-2.4.6-45.el9.x86_64.rpm 5.2 MB/s | 582 kB 00:00 2024-04-25T22:50:03.267 INFO:teuthology.orchestra.run.smithi052.stdout:(58/139): libuuid-devel-2.37.4-18.el9.x86_64.rp 520 kB/s | 25 kB 00:00 2024-04-25T22:50:03.317 INFO:teuthology.orchestra.run.smithi052.stdout:(59/139): libzstd-devel-1.5.1-2.el9.x86_64.rpm 630 kB/s | 47 kB 00:00 2024-04-25T22:50:03.351 INFO:teuthology.orchestra.run.smithi052.stdout:(60/139): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-04-25T22:50:03.379 INFO:teuthology.orchestra.run.smithi164.stdout:(63/139): openblas-openmp-0.3.21-2.el9.x86_64.r 27 MB/s | 4.7 MB 00:00 2024-04-25T22:50:03.379 INFO:teuthology.orchestra.run.smithi110.stdout:(135/139): thrift-0.15.0-2.el9.x86_64.rpm 6.8 MB/s | 1.6 MB 00:00 2024-04-25T22:50:03.384 INFO:teuthology.orchestra.run.smithi052.stdout:(61/139): lua-5.4.4-4.el9.x86_64.rpm 2.8 MB/s | 188 kB 00:00 2024-04-25T22:50:03.401 INFO:teuthology.orchestra.run.smithi052.stdout:(62/139): openblas-0.3.21-2.el9.x86_64.rpm 699 kB/s | 35 kB 00:00 2024-04-25T22:50:03.487 INFO:teuthology.orchestra.run.smithi164.stdout:(64/139): openssl-devel-3.2.1-1.el9.x86_64.rpm 17 MB/s | 4.4 MB 00:00 2024-04-25T22:50:03.512 INFO:teuthology.orchestra.run.smithi110.stdout:(136/139): openssl-3.2.1-1.el9.x86_64.rpm 10 MB/s | 1.3 MB 00:00 2024-04-25T22:50:03.521 INFO:teuthology.orchestra.run.smithi164.stdout:(65/139): protobuf-3.14.0-13.el9.x86_64.rpm 7.2 MB/s | 1.0 MB 00:00 2024-04-25T22:50:03.657 INFO:teuthology.orchestra.run.smithi110.stdout:(137/139): openssl-libs-3.2.1-1.el9.x86_64.rpm 17 MB/s | 2.4 MB 00:00 2024-04-25T22:50:03.705 INFO:teuthology.orchestra.run.smithi164.stdout:(66/139): python3-babel-2.9.1-2.el9.noarch.rpm 28 MB/s | 6.0 MB 00:00 2024-04-25T22:50:03.730 INFO:teuthology.orchestra.run.smithi164.stdout:(67/139): python3-devel-3.9.18-3.el9.x86_64.rpm 1.2 MB/s | 244 kB 00:00 2024-04-25T22:50:03.735 INFO:teuthology.orchestra.run.smithi052.stdout:(63/139): openblas-openmp-0.3.21-2.el9.x86_64.r 14 MB/s | 4.7 MB 00:00 2024-04-25T22:50:03.755 INFO:teuthology.orchestra.run.smithi164.stdout:(68/139): python3-jinja2-2.11.3-5.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-04-25T22:50:03.780 INFO:teuthology.orchestra.run.smithi164.stdout:(69/139): python3-jsonpatch-1.21-16.el9.noarch. 516 kB/s | 26 kB 00:00 2024-04-25T22:50:03.806 INFO:teuthology.orchestra.run.smithi164.stdout:(70/139): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-04-25T22:50:03.831 INFO:teuthology.orchestra.run.smithi164.stdout:(71/139): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-04-25T22:50:03.855 INFO:teuthology.orchestra.run.smithi052.stdout:(64/139): openssl-devel-3.2.1-1.el9.x86_64.rpm 9.8 MB/s | 4.4 MB 00:00 2024-04-25T22:50:03.856 INFO:teuthology.orchestra.run.smithi164.stdout:(72/139): python3-markupsafe-1.1.1-12.el9.x86_6 698 kB/s | 35 kB 00:00 2024-04-25T22:50:03.894 INFO:teuthology.orchestra.run.smithi052.stdout:(65/139): protobuf-3.14.0-13.el9.x86_64.rpm 6.5 MB/s | 1.0 MB 00:00 2024-04-25T22:50:03.963 INFO:teuthology.orchestra.run.smithi110.stdout:(138/139): librbd1-19.0.0-2445.gd2c45d97.el9.x8 4.2 MB/s | 3.1 MB 00:00 2024-04-25T22:50:04.096 INFO:teuthology.orchestra.run.smithi052.stdout:(66/139): python3-babel-2.9.1-2.el9.noarch.rpm 25 MB/s | 6.0 MB 00:00 2024-04-25T22:50:04.120 INFO:teuthology.orchestra.run.smithi052.stdout:(67/139): python3-devel-3.9.18-3.el9.x86_64.rpm 1.1 MB/s | 244 kB 00:00 2024-04-25T22:50:04.145 INFO:teuthology.orchestra.run.smithi052.stdout:(68/139): python3-jinja2-2.11.3-5.el9.noarch.rp 5.1 MB/s | 248 kB 00:00 2024-04-25T22:50:04.171 INFO:teuthology.orchestra.run.smithi052.stdout:(69/139): python3-jsonpatch-1.21-16.el9.noarch. 513 kB/s | 26 kB 00:00 2024-04-25T22:50:04.196 INFO:teuthology.orchestra.run.smithi052.stdout:(70/139): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-04-25T22:50:04.221 INFO:teuthology.orchestra.run.smithi052.stdout:(71/139): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-04-25T22:50:04.247 INFO:teuthology.orchestra.run.smithi052.stdout:(72/139): python3-markupsafe-1.1.1-12.el9.x86_6 698 kB/s | 35 kB 00:00 2024-04-25T22:50:04.272 INFO:teuthology.orchestra.run.smithi110.stdout:(139/139): librados2-19.0.0-2445.gd2c45d97.el9. 3.1 MB/s | 3.4 MB 00:01 2024-04-25T22:50:04.278 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-04-25T22:50:04.279 INFO:teuthology.orchestra.run.smithi110.stdout:Total 13 MB/s | 211 MB 00:16 2024-04-25T22:50:04.332 INFO:teuthology.orchestra.run.smithi164.stdout:(73/139): ceph-test-19.0.0-2445.gd2c45d97.el9.x 8.6 MB/s | 48 MB 00:05 2024-04-25T22:50:04.389 INFO:teuthology.orchestra.run.smithi052.stdout:(73/139): ceph-mgr-diskprediction-local-19.0.0- 2.0 MB/s | 7.4 MB 00:03 2024-04-25T22:50:04.407 INFO:teuthology.orchestra.run.smithi164.stdout:(74/139): python3-numpy-1.20.1-5.el9.x86_64.rpm 8.9 MB/s | 5.1 MB 00:00 2024-04-25T22:50:04.432 INFO:teuthology.orchestra.run.smithi164.stdout:(75/139): python3-numpy-f2py-1.20.1-5.el9.x86_6 436 kB/s | 250 kB 00:00 2024-04-25T22:50:04.457 INFO:teuthology.orchestra.run.smithi164.stdout:(76/139): python3-oauthlib-3.1.1-5.el9.noarch.r 1.8 MB/s | 222 kB 00:00 2024-04-25T22:50:04.464 INFO:teuthology.orchestra.run.smithi052.stdout:(74/139): python3-numpy-1.20.1-5.el9.x86_64.rpm 21 MB/s | 5.1 MB 00:00 2024-04-25T22:50:04.474 INFO:teuthology.orchestra.run.smithi164.stdout:(77/139): python3-packaging-20.9-5.el9.noarch.r 1.1 MB/s | 77 kB 00:00 2024-04-25T22:50:04.489 INFO:teuthology.orchestra.run.smithi052.stdout:(75/139): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.0 MB/s | 250 kB 00:00 2024-04-25T22:50:04.514 INFO:teuthology.orchestra.run.smithi052.stdout:(76/139): python3-oauthlib-3.1.1-5.el9.noarch.r 1.8 MB/s | 222 kB 00:00 2024-04-25T22:50:04.521 INFO:teuthology.orchestra.run.smithi164.stdout:(78/139): python3-prettytable-0.7.2-27.el9.noar 674 kB/s | 42 kB 00:00 2024-04-25T22:50:04.539 INFO:teuthology.orchestra.run.smithi052.stdout:(77/139): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-04-25T22:50:04.550 INFO:teuthology.orchestra.run.smithi164.stdout:(79/139): python3-protobuf-3.14.0-13.el9.noarch 2.9 MB/s | 269 kB 00:00 2024-04-25T22:50:04.564 INFO:teuthology.orchestra.run.smithi052.stdout:(78/139): python3-prettytable-0.7.2-27.el9.noar 565 kB/s | 42 kB 00:00 2024-04-25T22:50:04.575 INFO:teuthology.orchestra.run.smithi164.stdout:(80/139): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.6 MB/s | 159 kB 00:00 2024-04-25T22:50:04.590 INFO:teuthology.orchestra.run.smithi052.stdout:(79/139): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 269 kB 00:00 2024-04-25T22:50:04.600 INFO:teuthology.orchestra.run.smithi164.stdout:(81/139): python3-pyasn1-modules-0.4.8-6.el9.no 5.5 MB/s | 279 kB 00:00 2024-04-25T22:50:04.615 INFO:teuthology.orchestra.run.smithi052.stdout:(80/139): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-04-25T22:50:04.625 INFO:teuthology.orchestra.run.smithi164.stdout:(82/139): python3-pytz-2021.1-5.el9.noarch.rpm 683 kB/s | 51 kB 00:00 2024-04-25T22:50:04.640 INFO:teuthology.orchestra.run.smithi052.stdout:(81/139): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-04-25T22:50:04.650 INFO:teuthology.orchestra.run.smithi164.stdout:(83/139): python3-requests-oauthlib-1.3.0-12.el 720 kB/s | 54 kB 00:00 2024-04-25T22:50:04.665 INFO:teuthology.orchestra.run.smithi052.stdout:(82/139): python3-pytz-2021.1-5.el9.noarch.rpm 682 kB/s | 51 kB 00:00 2024-04-25T22:50:04.691 INFO:teuthology.orchestra.run.smithi052.stdout:(83/139): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-04-25T22:50:04.709 INFO:teuthology.orchestra.run.smithi164.stdout:(84/139): python3-toml-0.10.2-6.el9.noarch.rpm 500 kB/s | 42 kB 00:00 2024-04-25T22:50:04.841 INFO:teuthology.orchestra.run.smithi052.stdout:(84/139): python3-toml-0.10.2-6.el9.noarch.rpm 240 kB/s | 42 kB 00:00 2024-04-25T22:50:04.860 INFO:teuthology.orchestra.run.smithi164.stdout:(85/139): qatlib-24.02.0-1.el9.x86_64.rpm 1.0 MB/s | 221 kB 00:00 2024-04-25T22:50:04.875 INFO:teuthology.orchestra.run.smithi052.stdout:(85/139): qatlib-24.02.0-1.el9.x86_64.rpm 1.2 MB/s | 221 kB 00:00 2024-04-25T22:50:04.918 INFO:teuthology.orchestra.run.smithi164.stdout:(86/139): qatlib-service-24.02.0-1.el9.x86_64.r 174 kB/s | 36 kB 00:00 2024-04-25T22:50:05.117 INFO:teuthology.orchestra.run.smithi052.stdout:(86/139): python3-scipy-1.6.2-8.el9.x86_64.rpm 34 MB/s | 16 MB 00:00 2024-04-25T22:50:05.135 INFO:teuthology.orchestra.run.smithi164.stdout:(87/139): python3-scipy-1.6.2-8.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-04-25T22:50:05.142 INFO:teuthology.orchestra.run.smithi052.stdout:(87/139): qatlib-service-24.02.0-1.el9.x86_64.r 120 kB/s | 36 kB 00:00 2024-04-25T22:50:05.160 INFO:teuthology.orchestra.run.smithi164.stdout:(88/139): qatzip-libs-1.2.0-1.el9.x86_64.rpm 159 kB/s | 47 kB 00:00 2024-04-25T22:50:05.167 INFO:teuthology.orchestra.run.smithi052.stdout:(88/139): qatzip-libs-1.2.0-1.el9.x86_64.rpm 164 kB/s | 47 kB 00:00 2024-04-25T22:50:05.186 INFO:teuthology.orchestra.run.smithi164.stdout:(89/139): socat-1.7.4.1-5.el9.x86_64.rpm 1.1 MB/s | 305 kB 00:00 2024-04-25T22:50:05.193 INFO:teuthology.orchestra.run.smithi052.stdout:(89/139): socat-1.7.4.1-5.el9.x86_64.rpm 4.0 MB/s | 305 kB 00:00 2024-04-25T22:50:05.210 INFO:teuthology.orchestra.run.smithi164.stdout:(90/139): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.2 MB/s | 94 kB 00:00 2024-04-25T22:50:05.217 INFO:teuthology.orchestra.run.smithi052.stdout:(90/139): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.8 MB/s | 94 kB 00:00 2024-04-25T22:50:05.236 INFO:teuthology.orchestra.run.smithi164.stdout:(91/139): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-04-25T22:50:05.243 INFO:teuthology.orchestra.run.smithi052.stdout:(91/139): xmlstarlet-1.6.1-20.el9.x86_64.rpm 850 kB/s | 64 kB 00:00 2024-04-25T22:50:05.260 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-04-25T22:50:05.261 INFO:teuthology.orchestra.run.smithi164.stdout:(92/139): zlib-devel-1.2.11-41.el9.x86_64.rpm 599 kB/s | 45 kB 00:00 2024-04-25T22:50:05.268 INFO:teuthology.orchestra.run.smithi052.stdout:(92/139): zlib-devel-1.2.11-41.el9.x86_64.rpm 596 kB/s | 45 kB 00:00 2024-04-25T22:50:05.286 INFO:teuthology.orchestra.run.smithi164.stdout:(93/139): lua-devel-5.4.4-4.el9.x86_64.rpm 295 kB/s | 22 kB 00:00 2024-04-25T22:50:05.294 INFO:teuthology.orchestra.run.smithi052.stdout:(93/139): lua-devel-5.4.4-4.el9.x86_64.rpm 444 kB/s | 22 kB 00:00 2024-04-25T22:50:05.319 INFO:teuthology.orchestra.run.smithi052.stdout:(94/139): protobuf-compiler-3.14.0-13.el9.x86_6 11 MB/s | 863 kB 00:00 2024-04-25T22:50:05.329 INFO:teuthology.orchestra.run.smithi164.stdout:(94/139): protobuf-compiler-3.14.0-13.el9.x86_6 13 MB/s | 863 kB 00:00 2024-04-25T22:50:05.396 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-04-25T22:50:05.397 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-04-25T22:50:05.469 INFO:teuthology.orchestra.run.smithi052.stdout:(95/139): grpc-data-1.46.7-10.el9.noarch.rpm 130 kB/s | 19 kB 00:00 2024-04-25T22:50:05.587 INFO:teuthology.orchestra.run.smithi164.stdout:(95/139): grpc-data-1.46.7-10.el9.noarch.rpm 75 kB/s | 19 kB 00:00 2024-04-25T22:50:05.602 INFO:teuthology.orchestra.run.smithi052.stdout:(96/139): gperftools-libs-2.9.1-2.el9.x86_64.rp 1.1 MB/s | 309 kB 00:00 2024-04-25T22:50:05.636 INFO:teuthology.orchestra.run.smithi052.stdout:(97/139): abseil-cpp-20211102.0-3.el9.x86_64.rp 1.5 MB/s | 548 kB 00:00 2024-04-25T22:50:05.670 INFO:teuthology.orchestra.run.smithi052.stdout:(98/139): libarrow-doc-9.0.0-10.el9.noarch.rpm 387 kB/s | 26 kB 00:00 2024-04-25T22:50:05.703 INFO:teuthology.orchestra.run.smithi052.stdout:(99/139): liboath-2.6.7-2.el9.x86_64.rpm 729 kB/s | 49 kB 00:00 2024-04-25T22:50:05.729 INFO:teuthology.orchestra.run.smithi052.stdout:(100/139): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-04-25T22:50:05.796 INFO:teuthology.orchestra.run.smithi052.stdout:(101/139): luarocks-3.9.2-1.el9.noarch.rpm 1.6 MB/s | 151 kB 00:00 2024-04-25T22:50:05.837 INFO:teuthology.orchestra.run.smithi164.stdout:(96/139): gperftools-libs-2.9.1-2.el9.x86_64.rp 562 kB/s | 309 kB 00:00 2024-04-25T22:50:05.904 INFO:teuthology.orchestra.run.smithi164.stdout:(97/139): abseil-cpp-20211102.0-3.el9.x86_64.rp 853 kB/s | 548 kB 00:00 2024-04-25T22:50:05.913 INFO:teuthology.orchestra.run.smithi052.stdout:(102/139): libarrow-9.0.0-10.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2024-04-25T22:50:05.929 INFO:teuthology.orchestra.run.smithi164.stdout:(98/139): libarrow-doc-9.0.0-10.el9.noarch.rpm 283 kB/s | 26 kB 00:00 2024-04-25T22:50:05.955 INFO:teuthology.orchestra.run.smithi052.stdout:(103/139): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.6 MB/s | 838 kB 00:00 2024-04-25T22:50:05.977 INFO:teuthology.orchestra.run.smithi191.stdout:Extra Packages for Enterprise Linux 805 kB/s | 21 MB 00:26 2024-04-25T22:50:05.980 INFO:teuthology.orchestra.run.smithi052.stdout:(104/139): python3-asyncssh-2.13.2-5.el9.noarch 2.9 MB/s | 548 kB 00:00 2024-04-25T22:50:06.005 INFO:teuthology.orchestra.run.smithi164.stdout:(99/139): liboath-2.6.7-2.el9.x86_64.rpm 485 kB/s | 49 kB 00:00 2024-04-25T22:50:06.005 INFO:teuthology.orchestra.run.smithi052.stdout:(105/139): python3-bcrypt-3.2.2-1.el9.x86_64.rp 472 kB/s | 43 kB 00:00 2024-04-25T22:50:06.030 INFO:teuthology.orchestra.run.smithi052.stdout:(106/139): python3-cachetools-4.2.4-1.el9.noarc 427 kB/s | 32 kB 00:00 2024-04-25T22:50:06.056 INFO:teuthology.orchestra.run.smithi052.stdout:(107/139): python3-certifi-2021.10.8-2.el9.noar 198 kB/s | 15 kB 00:00 2024-04-25T22:50:06.082 INFO:teuthology.orchestra.run.smithi052.stdout:(108/139): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-04-25T22:50:06.106 INFO:teuthology.orchestra.run.smithi052.stdout:(109/139): python3-cherrypy-18.6.1-2.el9.noarch 4.7 MB/s | 358 kB 00:00 2024-04-25T22:50:06.122 INFO:teuthology.orchestra.run.smithi164.stdout:(100/139): libunwind-1.6.2-1.el9.x86_64.rpm 351 kB/s | 67 kB 00:00 2024-04-25T22:50:06.131 INFO:teuthology.orchestra.run.smithi052.stdout:(110/139): python3-google-auth-2.29.0-1.el9.noa 2.7 MB/s | 206 kB 00:00 2024-04-25T22:50:06.147 INFO:teuthology.orchestra.run.smithi164.stdout:(101/139): luarocks-3.9.2-1.el9.noarch.rpm 1.0 MB/s | 151 kB 00:00 2024-04-25T22:50:06.182 INFO:teuthology.orchestra.run.smithi052.stdout:(111/139): python3-grpcio-1.46.7-10.el9.x86_64. 20 MB/s | 2.0 MB 00:00 2024-04-25T22:50:06.207 INFO:teuthology.orchestra.run.smithi052.stdout:(112/139): python3-jaraco-8.2.1-3.el9.noarch.rp 142 kB/s | 11 kB 00:00 2024-04-25T22:50:06.232 INFO:teuthology.orchestra.run.smithi052.stdout:(113/139): python3-grpcio-tools-1.46.7-10.el9.x 1.1 MB/s | 144 kB 00:00 2024-04-25T22:50:06.258 INFO:teuthology.orchestra.run.smithi052.stdout:(114/139): python3-jaraco-classes-3.2.1-5.el9.n 234 kB/s | 18 kB 00:00 2024-04-25T22:50:06.283 INFO:teuthology.orchestra.run.smithi052.stdout:(115/139): python3-jaraco-collections-3.0.0-8.e 307 kB/s | 23 kB 00:00 2024-04-25T22:50:06.308 INFO:teuthology.orchestra.run.smithi052.stdout:(116/139): python3-jaraco-functools-3.5.0-2.el9 258 kB/s | 19 kB 00:00 2024-04-25T22:50:06.314 INFO:teuthology.orchestra.run.smithi164.stdout:(102/139): python3-asyncssh-2.13.2-5.el9.noarch 3.2 MB/s | 548 kB 00:00 2024-04-25T22:50:06.334 INFO:teuthology.orchestra.run.smithi052.stdout:(117/139): python3-jaraco-text-3.2.0-6.el9.noar 261 kB/s | 20 kB 00:00 2024-04-25T22:50:06.373 INFO:teuthology.orchestra.run.smithi164.stdout:(103/139): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.3 MB/s | 838 kB 00:00 2024-04-25T22:50:06.375 INFO:teuthology.orchestra.run.smithi052.stdout:(118/139): python3-logutils-0.3.5-21.el9.noarch 691 kB/s | 46 kB 00:00 2024-04-25T22:50:06.417 INFO:teuthology.orchestra.run.smithi052.stdout:(119/139): python3-kubernetes-26.1.0-2.el9.noar 7.6 MB/s | 1.0 MB 00:00 2024-04-25T22:50:06.439 INFO:teuthology.orchestra.run.smithi164.stdout:(104/139): libarrow-9.0.0-10.el9.x86_64.rpm 5.2 MB/s | 4.4 MB 00:00 2024-04-25T22:50:06.442 INFO:teuthology.orchestra.run.smithi052.stdout:(120/139): python3-more-itertools-8.12.0-2.el9. 726 kB/s | 79 kB 00:00 2024-04-25T22:50:06.464 INFO:teuthology.orchestra.run.smithi164.stdout:(105/139): python3-bcrypt-3.2.2-1.el9.x86_64.rp 289 kB/s | 43 kB 00:00 2024-04-25T22:50:06.468 INFO:teuthology.orchestra.run.smithi052.stdout:(121/139): python3-natsort-7.1.1-5.el9.noarch.r 626 kB/s | 58 kB 00:00 2024-04-25T22:50:06.490 INFO:teuthology.orchestra.run.smithi164.stdout:(106/139): python3-cachetools-4.2.4-1.el9.noarc 275 kB/s | 32 kB 00:00 2024-04-25T22:50:06.493 INFO:teuthology.orchestra.run.smithi052.stdout:(122/139): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-04-25T22:50:06.518 INFO:teuthology.orchestra.run.smithi052.stdout:(123/139): python3-portend-3.1.0-2.el9.noarch.r 217 kB/s | 16 kB 00:00 2024-04-25T22:50:06.540 INFO:teuthology.orchestra.run.smithi164.stdout:(107/139): python3-certifi-2021.10.8-2.el9.noar 149 kB/s | 15 kB 00:00 2024-04-25T22:50:06.543 INFO:teuthology.orchestra.run.smithi052.stdout:(124/139): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-04-25T22:50:06.569 INFO:teuthology.orchestra.run.smithi052.stdout:(125/139): python3-repoze-lru-0.7-16.el9.noarch 408 kB/s | 31 kB 00:00 2024-04-25T22:50:06.582 INFO:teuthology.orchestra.run.smithi164.stdout:(108/139): python3-cheroot-8.6.0-4.el9.noarch.r 1.4 MB/s | 172 kB 00:00 2024-04-25T22:50:06.594 INFO:teuthology.orchestra.run.smithi052.stdout:(126/139): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-04-25T22:50:06.607 INFO:teuthology.orchestra.run.smithi164.stdout:(109/139): python3-cherrypy-18.6.1-2.el9.noarch 3.0 MB/s | 358 kB 00:00 2024-04-25T22:50:06.619 INFO:teuthology.orchestra.run.smithi052.stdout:(127/139): python3-rsa-4.9-2.el9.noarch.rpm 782 kB/s | 59 kB 00:00 2024-04-25T22:50:06.641 INFO:teuthology.orchestra.run.smithi164.stdout:(110/139): python3-google-auth-2.29.0-1.el9.noa 2.0 MB/s | 206 kB 00:00 2024-04-25T22:50:06.644 INFO:teuthology.orchestra.run.smithi052.stdout:(128/139): python3-tempora-5.0.0-2.el9.noarch.r 474 kB/s | 36 kB 00:00 2024-04-25T22:50:06.678 INFO:teuthology.orchestra.run.smithi052.stdout:(129/139): python3-typing-extensions-4.4.0-2.el 610 kB/s | 51 kB 00:00 2024-04-25T22:50:06.703 INFO:teuthology.orchestra.run.smithi052.stdout:(130/139): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-04-25T22:50:06.708 INFO:teuthology.orchestra.run.smithi164.stdout:(111/139): python3-grpcio-tools-1.46.7-10.el9.x 1.4 MB/s | 144 kB 00:00 2024-04-25T22:50:06.729 INFO:teuthology.orchestra.run.smithi052.stdout:(131/139): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-04-25T22:50:06.733 INFO:teuthology.orchestra.run.smithi164.stdout:(112/139): python3-jaraco-8.2.1-3.el9.noarch.rp 116 kB/s | 11 kB 00:00 2024-04-25T22:50:06.754 INFO:teuthology.orchestra.run.smithi052.stdout:(132/139): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-04-25T22:50:06.779 INFO:teuthology.orchestra.run.smithi052.stdout:(133/139): python3-zc-lockfile-2.0-10.el9.noarc 264 kB/s | 20 kB 00:00 2024-04-25T22:50:06.800 INFO:teuthology.orchestra.run.smithi164.stdout:(113/139): python3-jaraco-classes-3.2.1-5.el9.n 192 kB/s | 18 kB 00:00 2024-04-25T22:50:06.805 INFO:teuthology.orchestra.run.smithi052.stdout:(134/139): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-04-25T22:50:06.825 INFO:teuthology.orchestra.run.smithi164.stdout:(114/139): python3-jaraco-collections-3.0.0-8.e 252 kB/s | 23 kB 00:00 2024-04-25T22:50:06.876 INFO:teuthology.orchestra.run.smithi164.stdout:(115/139): python3-grpcio-1.46.7-10.el9.x86_64. 7.0 MB/s | 2.0 MB 00:00 2024-04-25T22:50:06.892 INFO:teuthology.orchestra.run.smithi164.stdout:(116/139): python3-jaraco-functools-3.5.0-2.el9 211 kB/s | 19 kB 00:00 2024-04-25T22:50:06.905 INFO:teuthology.orchestra.run.smithi052.stdout:(135/139): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-04-25T22:50:06.926 INFO:teuthology.orchestra.run.smithi164.stdout:(117/139): python3-jaraco-text-3.2.0-6.el9.noar 196 kB/s | 20 kB 00:00 2024-04-25T22:50:06.993 INFO:teuthology.orchestra.run.smithi164.stdout:(118/139): python3-logutils-0.3.5-21.el9.noarch 462 kB/s | 46 kB 00:00 2024-04-25T22:50:07.005 INFO:teuthology.orchestra.run.smithi052.stdout:(136/139): openssl-3.2.1-1.el9.x86_64.rpm 14 MB/s | 1.3 MB 00:00 2024-04-25T22:50:07.026 INFO:teuthology.orchestra.run.smithi164.stdout:(119/139): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2024-04-25T22:50:07.046 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-04-25T22:50:07.046 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-04-25T22:50:07.052 INFO:teuthology.orchestra.run.smithi164.stdout:(120/139): python3-more-itertools-8.12.0-2.el9. 628 kB/s | 79 kB 00:00 2024-04-25T22:50:07.094 INFO:teuthology.orchestra.run.smithi164.stdout:(121/139): python3-natsort-7.1.1-5.el9.noarch.r 575 kB/s | 58 kB 00:00 2024-04-25T22:50:07.122 INFO:teuthology.orchestra.run.smithi052.stdout:(137/139): librbd1-19.0.0-2445.gd2c45d97.el9.x8 9.9 MB/s | 3.1 MB 00:00 2024-04-25T22:50:07.136 INFO:teuthology.orchestra.run.smithi164.stdout:(122/139): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2024-04-25T22:50:07.153 INFO:teuthology.orchestra.run.smithi164.stdout:(123/139): python3-portend-3.1.0-2.el9.noarch.r 163 kB/s | 16 kB 00:00 2024-04-25T22:50:07.194 INFO:teuthology.orchestra.run.smithi164.stdout:(124/139): python3-pyOpenSSL-21.0.0-1.el9.noarc 897 kB/s | 90 kB 00:00 2024-04-25T22:50:07.228 INFO:teuthology.orchestra.run.smithi164.stdout:(125/139): python3-repoze-lru-0.7-16.el9.noarch 334 kB/s | 31 kB 00:00 2024-04-25T22:50:07.254 INFO:teuthology.orchestra.run.smithi164.stdout:(126/139): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-04-25T22:50:07.264 INFO:teuthology.orchestra.run.smithi052.stdout:(138/139): openssl-libs-3.2.1-1.el9.x86_64.rpm 9.3 MB/s | 2.4 MB 00:00 2024-04-25T22:50:07.287 INFO:teuthology.orchestra.run.smithi164.stdout:(127/139): python3-rsa-4.9-2.el9.noarch.rpm 639 kB/s | 59 kB 00:00 2024-04-25T22:50:07.321 INFO:teuthology.orchestra.run.smithi164.stdout:(128/139): python3-tempora-5.0.0-2.el9.noarch.r 388 kB/s | 36 kB 00:00 2024-04-25T22:50:07.346 INFO:teuthology.orchestra.run.smithi164.stdout:(129/139): python3-typing-extensions-4.4.0-2.el 553 kB/s | 51 kB 00:00 2024-04-25T22:50:07.396 INFO:teuthology.orchestra.run.smithi164.stdout:(130/139): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-04-25T22:50:07.422 INFO:teuthology.orchestra.run.smithi164.stdout:(131/139): python3-websocket-client-1.2.3-2.el9 892 kB/s | 90 kB 00:00 2024-04-25T22:50:07.455 INFO:teuthology.orchestra.run.smithi164.stdout:(132/139): python3-werkzeug-2.0.3-3.el9.1.noarc 3.8 MB/s | 427 kB 00:00 2024-04-25T22:50:07.497 INFO:teuthology.orchestra.run.smithi164.stdout:(133/139): python3-zc-lockfile-2.0-10.el9.noarc 198 kB/s | 20 kB 00:00 2024-04-25T22:50:07.522 INFO:teuthology.orchestra.run.smithi164.stdout:(134/139): re2-20211101-3.el9.x86_64.rpm 1.9 MB/s | 192 kB 00:00 2024-04-25T22:50:07.589 INFO:teuthology.orchestra.run.smithi164.stdout:(135/139): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-04-25T22:50:07.673 INFO:teuthology.orchestra.run.smithi164.stdout:(136/139): openssl-3.2.1-1.el9.x86_64.rpm 16 MB/s | 1.3 MB 00:00 2024-04-25T22:50:07.798 INFO:teuthology.orchestra.run.smithi164.stdout:(137/139): openssl-libs-3.2.1-1.el9.x86_64.rpm 19 MB/s | 2.4 MB 00:00 2024-04-25T22:50:07.923 INFO:teuthology.orchestra.run.smithi164.stdout:(138/139): librbd1-19.0.0-2445.gd2c45d97.el9.x8 7.8 MB/s | 3.1 MB 00:00 2024-04-25T22:50:08.166 INFO:teuthology.orchestra.run.smithi052.stdout:(139/139): librados2-19.0.0-2445.gd2c45d97.el9. 2.4 MB/s | 3.4 MB 00:01 2024-04-25T22:50:08.169 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-04-25T22:50:08.170 INFO:teuthology.orchestra.run.smithi052.stdout:Total 11 MB/s | 211 MB 00:18 2024-04-25T22:50:08.398 INFO:teuthology.orchestra.run.smithi164.stdout:(139/139): librados2-19.0.0-2445.gd2c45d97.el9. 3.8 MB/s | 3.4 MB 00:00 2024-04-25T22:50:08.403 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-25T22:50:08.403 INFO:teuthology.orchestra.run.smithi164.stdout:Total 13 MB/s | 211 MB 00:15 2024-04-25T22:50:09.170 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-04-25T22:50:09.323 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-04-25T22:50:09.323 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-04-25T22:50:09.377 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-25T22:50:09.515 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-25T22:50:09.515 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-25T22:50:10.986 INFO:teuthology.orchestra.run.smithi191.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-04-25T22:50:11.104 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-04-25T22:50:11.105 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-04-25T22:50:11.187 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-25T22:50:11.187 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-25T22:50:12.548 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-04-25T22:50:12.626 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/143 2024-04-25T22:50:12.665 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/143 2024-04-25T22:50:12.718 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/143 2024-04-25T22:50:12.751 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/143 2024-04-25T22:50:12.777 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/143 2024-04-25T22:50:12.820 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/143 2024-04-25T22:50:13.204 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/143 2024-04-25T22:50:13.262 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 8/143 2024-04-25T22:50:13.270 INFO:teuthology.orchestra.run.smithi191.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T22:50:13.271 INFO:teuthology.orchestra.run.smithi191.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T22:50:13.336 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-04-25T22:50:13.344 INFO:teuthology.orchestra.run.smithi191.stdout:======================================================================================= 2024-04-25T22:50:13.344 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repository Size 2024-04-25T22:50:13.344 INFO:teuthology.orchestra.run.smithi191.stdout:======================================================================================= 2024-04-25T22:50:13.344 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2024-04-25T22:50:13.344 INFO:teuthology.orchestra.run.smithi191.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-25T22:50:13.345 INFO:teuthology.orchestra.run.smithi191.stdout: ceph x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 6.6 k 2024-04-25T22:50:13.345 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-base x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 5.4 M 2024-04-25T22:50:13.345 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-fuse x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 890 k 2024-04-25T22:50:13.345 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 145 k 2024-04-25T22:50:13.345 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 1.5 M 2024-04-25T22:50:13.345 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 141 k 2024-04-25T22:50:13.345 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 3.5 M 2024-04-25T22:50:13.345 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 7.4 M 2024-04-25T22:50:13.345 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-rook noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 49 k 2024-04-25T22:50:13.345 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-radosgw x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 10 M 2024-04-25T22:50:13.345 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-test x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 48 M 2024-04-25T22:50:13.345 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-volume noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 264 k 2024-04-25T22:50:13.346 INFO:teuthology.orchestra.run.smithi191.stdout: cephadm noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 762 k 2024-04-25T22:50:13.346 INFO:teuthology.orchestra.run.smithi191.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-25T22:50:13.346 INFO:teuthology.orchestra.run.smithi191.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-25T22:50:13.346 INFO:teuthology.orchestra.run.smithi191.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-25T22:50:13.346 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs-devel x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 32 k 2024-04-25T22:50:13.346 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs2 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 745 k 2024-04-25T22:50:13.346 INFO:teuthology.orchestra.run.smithi191.stdout: librados-devel x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 127 k 2024-04-25T22:50:13.346 INFO:teuthology.orchestra.run.smithi191.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-25T22:50:13.346 INFO:teuthology.orchestra.run.smithi191.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-25T22:50:13.346 INFO:teuthology.orchestra.run.smithi191.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-25T22:50:13.346 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cephfs x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 162 k 2024-04-25T22:50:13.346 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rados x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 321 k 2024-04-25T22:50:13.346 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rbd x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 299 k 2024-04-25T22:50:13.347 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rgw x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 99 k 2024-04-25T22:50:13.347 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-fuse x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 85 k 2024-04-25T22:50:13.347 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-mirror x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 3.1 M 2024-04-25T22:50:13.347 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-nbd x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 171 k 2024-04-25T22:50:13.347 INFO:teuthology.orchestra.run.smithi191.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-25T22:50:13.347 INFO:teuthology.orchestra.run.smithi191.stdout:Upgrading: 2024-04-25T22:50:13.347 INFO:teuthology.orchestra.run.smithi191.stdout: librados2 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 3.4 M 2024-04-25T22:50:13.347 INFO:teuthology.orchestra.run.smithi191.stdout: librbd1 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 3.1 M 2024-04-25T22:50:13.347 INFO:teuthology.orchestra.run.smithi191.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-25T22:50:13.347 INFO:teuthology.orchestra.run.smithi191.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-25T22:50:13.347 INFO:teuthology.orchestra.run.smithi191.stdout:Installing dependencies: 2024-04-25T22:50:13.347 INFO:teuthology.orchestra.run.smithi191.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T22:50:13.348 INFO:teuthology.orchestra.run.smithi191.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-25T22:50:13.348 INFO:teuthology.orchestra.run.smithi191.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T22:50:13.348 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-common x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 21 M 2024-04-25T22:50:13.348 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 32 k 2024-04-25T22:50:13.348 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mds x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 2.4 M 2024-04-25T22:50:13.348 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 249 k 2024-04-25T22:50:13.348 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mon x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 4.7 M 2024-04-25T22:50:13.348 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-osd x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 17 M 2024-04-25T22:50:13.348 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 15 k 2024-04-25T22:50:13.348 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-selinux x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 25 k 2024-04-25T22:50:13.348 INFO:teuthology.orchestra.run.smithi191.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T22:50:13.348 INFO:teuthology.orchestra.run.smithi191.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T22:50:13.348 INFO:teuthology.orchestra.run.smithi191.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T22:50:13.349 INFO:teuthology.orchestra.run.smithi191.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T22:50:13.349 INFO:teuthology.orchestra.run.smithi191.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T22:50:13.349 INFO:teuthology.orchestra.run.smithi191.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T22:50:13.349 INFO:teuthology.orchestra.run.smithi191.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T22:50:13.349 INFO:teuthology.orchestra.run.smithi191.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T22:50:13.349 INFO:teuthology.orchestra.run.smithi191.stdout: libcephsqlite x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 163 k 2024-04-25T22:50:13.349 INFO:teuthology.orchestra.run.smithi191.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T22:50:13.349 INFO:teuthology.orchestra.run.smithi191.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T22:50:13.349 INFO:teuthology.orchestra.run.smithi191.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T22:50:13.349 INFO:teuthology.orchestra.run.smithi191.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T22:50:13.349 INFO:teuthology.orchestra.run.smithi191.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T22:50:13.349 INFO:teuthology.orchestra.run.smithi191.stdout: libradosstriper1 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 501 k 2024-04-25T22:50:13.349 INFO:teuthology.orchestra.run.smithi191.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T22:50:13.350 INFO:teuthology.orchestra.run.smithi191.stdout: librgw2 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 5.3 M 2024-04-25T22:50:13.350 INFO:teuthology.orchestra.run.smithi191.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T22:50:13.350 INFO:teuthology.orchestra.run.smithi191.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-25T22:50:13.350 INFO:teuthology.orchestra.run.smithi191.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T22:50:13.350 INFO:teuthology.orchestra.run.smithi191.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T22:50:13.350 INFO:teuthology.orchestra.run.smithi191.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T22:50:13.350 INFO:teuthology.orchestra.run.smithi191.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T22:50:13.350 INFO:teuthology.orchestra.run.smithi191.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T22:50:13.350 INFO:teuthology.orchestra.run.smithi191.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T22:50:13.350 INFO:teuthology.orchestra.run.smithi191.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T22:50:13.350 INFO:teuthology.orchestra.run.smithi191.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T22:50:13.350 INFO:teuthology.orchestra.run.smithi191.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T22:50:13.351 INFO:teuthology.orchestra.run.smithi191.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T22:50:13.351 INFO:teuthology.orchestra.run.smithi191.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T22:50:13.351 INFO:teuthology.orchestra.run.smithi191.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T22:50:13.351 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T22:50:13.351 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-argparse x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 45 k 2024-04-25T22:50:13.351 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-common x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 133 k 2024-04-25T22:50:13.351 INFO:teuthology.orchestra.run.smithi191.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T22:50:13.351 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T22:50:13.351 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T22:50:13.351 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T22:50:13.351 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T22:50:13.351 INFO:teuthology.orchestra.run.smithi191.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T22:50:13.351 INFO:teuthology.orchestra.run.smithi191.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T22:50:13.351 INFO:teuthology.orchestra.run.smithi191.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T22:50:13.352 INFO:teuthology.orchestra.run.smithi191.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T22:50:13.352 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T22:50:13.352 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T22:50:13.352 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T22:50:13.352 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T22:50:13.352 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T22:50:13.352 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T22:50:13.352 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T22:50:13.352 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T22:50:13.352 INFO:teuthology.orchestra.run.smithi191.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T22:50:13.352 INFO:teuthology.orchestra.run.smithi191.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T22:50:13.352 INFO:teuthology.orchestra.run.smithi191.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T22:50:13.352 INFO:teuthology.orchestra.run.smithi191.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T22:50:13.353 INFO:teuthology.orchestra.run.smithi191.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T22:50:13.353 INFO:teuthology.orchestra.run.smithi191.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T22:50:13.353 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T22:50:13.353 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T22:50:13.353 INFO:teuthology.orchestra.run.smithi191.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T22:50:13.353 INFO:teuthology.orchestra.run.smithi191.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T22:50:13.353 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T22:50:13.353 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T22:50:13.353 INFO:teuthology.orchestra.run.smithi191.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T22:50:13.353 INFO:teuthology.orchestra.run.smithi191.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T22:50:13.353 INFO:teuthology.orchestra.run.smithi191.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T22:50:13.353 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T22:50:13.353 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T22:50:13.354 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T22:50:13.354 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T22:50:13.354 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T22:50:13.354 INFO:teuthology.orchestra.run.smithi191.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T22:50:13.354 INFO:teuthology.orchestra.run.smithi191.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T22:50:13.354 INFO:teuthology.orchestra.run.smithi191.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T22:50:13.354 INFO:teuthology.orchestra.run.smithi191.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T22:50:13.354 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T22:50:13.354 INFO:teuthology.orchestra.run.smithi191.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T22:50:13.354 INFO:teuthology.orchestra.run.smithi191.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T22:50:13.354 INFO:teuthology.orchestra.run.smithi191.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T22:50:13.354 INFO:teuthology.orchestra.run.smithi191.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T22:50:13.354 INFO:teuthology.orchestra.run.smithi191.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T22:50:13.355 INFO:teuthology.orchestra.run.smithi191.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T22:50:13.355 INFO:teuthology.orchestra.run.smithi191.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T22:50:13.355 INFO:teuthology.orchestra.run.smithi191.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T22:50:13.355 INFO:teuthology.orchestra.run.smithi191.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T22:50:13.355 INFO:teuthology.orchestra.run.smithi191.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T22:50:13.355 INFO:teuthology.orchestra.run.smithi191.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T22:50:13.355 INFO:teuthology.orchestra.run.smithi191.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T22:50:13.355 INFO:teuthology.orchestra.run.smithi191.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T22:50:13.355 INFO:teuthology.orchestra.run.smithi191.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T22:50:13.355 INFO:teuthology.orchestra.run.smithi191.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T22:50:13.355 INFO:teuthology.orchestra.run.smithi191.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-25T22:50:13.355 INFO:teuthology.orchestra.run.smithi191.stdout:Installing weak dependencies: 2024-04-25T22:50:13.355 INFO:teuthology.orchestra.run.smithi191.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T22:50:13.356 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T22:50:13.356 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2024-04-25T22:50:13.356 INFO:teuthology.orchestra.run.smithi191.stdout:======================================================================================= 2024-04-25T22:50:13.356 INFO:teuthology.orchestra.run.smithi191.stdout:Install 135 Packages 2024-04-25T22:50:13.356 INFO:teuthology.orchestra.run.smithi191.stdout:Upgrade 4 Packages 2024-04-25T22:50:13.356 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T22:50:13.356 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 211 M 2024-04-25T22:50:13.357 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2024-04-25T22:50:13.385 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 8/143 2024-04-25T22:50:13.413 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 9/143 2024-04-25T22:50:13.505 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 9/143 2024-04-25T22:50:13.546 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rados-2:19.0.0-2445.gd2c45d97.el9.x86_64 10/143 2024-04-25T22:50:13.581 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 11/143 2024-04-25T22:50:13.686 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 11/143 2024-04-25T22:50:13.716 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86 12/143 2024-04-25T22:50:13.778 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86 12/143 2024-04-25T22:50:13.800 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-04-25T22:50:13.821 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-04-25T22:50:14.016 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 14/143 2024-04-25T22:50:14.050 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 14/143 2024-04-25T22:50:14.071 INFO:teuthology.orchestra.run.smithi191.stdout:(1/139): ceph-19.0.0-2445.gd2c45d97.el9.x86_64. 27 kB/s | 6.6 kB 00:00 2024-04-25T22:50:14.160 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/143 2024-04-25T22:50:14.254 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 16/143 2024-04-25T22:50:14.310 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/143 2024-04-25T22:50:14.351 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/143 2024-04-25T22:50:14.423 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/143 2024-04-25T22:50:14.429 INFO:teuthology.orchestra.run.smithi191.stdout:(2/139): ceph-fuse-19.0.0-2445.gd2c45d97.el9.x8 2.4 MB/s | 890 kB 00:00 2024-04-25T22:50:14.458 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/143 2024-04-25T22:50:14.496 INFO:teuthology.orchestra.run.smithi191.stdout:(3/139): ceph-immutable-object-cache-19.0.0-244 2.1 MB/s | 145 kB 00:00 2024-04-25T22:50:14.501 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 21/143 2024-04-25T22:50:14.534 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 22/143 2024-04-25T22:50:14.562 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : lua-5.4.4-4.el9.x86_64 23/143 2024-04-25T22:50:14.630 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 24/143 2024-04-25T22:50:14.692 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 25/143 2024-04-25T22:50:14.723 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 26/143 2024-04-25T22:50:14.758 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 27/143 2024-04-25T22:50:14.834 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 28/143 2024-04-25T22:50:14.869 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-ceph-common-2:19.0.0-2445.gd2c45d97.el9. 29/143 2024-04-25T22:50:14.905 INFO:teuthology.orchestra.run.smithi191.stdout:(4/139): ceph-mds-19.0.0-2445.gd2c45d97.el9.x86 5.8 MB/s | 2.4 MB 00:00 2024-04-25T22:50:14.912 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-ceph-argparse-2:19.0.0-2445.gd2c45d97.el 30/143 2024-04-25T22:50:14.941 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cephfs-2:19.0.0-2445.gd2c45d97.el9.x86_6 31/143 2024-04-25T22:50:14.997 INFO:teuthology.orchestra.run.smithi191.stdout:(5/139): ceph-base-19.0.0-2445.gd2c45d97.el9.x8 4.6 MB/s | 5.4 MB 00:01 2024-04-25T22:50:15.009 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 32/143 2024-04-25T22:50:15.056 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : luarocks-3.9.2-1.el9.noarch 33/143 2024-04-25T22:50:15.147 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 34/143 2024-04-25T22:50:15.197 INFO:teuthology.orchestra.run.smithi191.stdout:(6/139): ceph-mgr-19.0.0-2445.gd2c45d97.el9.x86 5.1 MB/s | 1.5 MB 00:00 2024-04-25T22:50:15.279 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 35/143 2024-04-25T22:50:15.342 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 36/143 2024-04-25T22:50:15.530 INFO:teuthology.orchestra.run.smithi191.stdout:(7/139): ceph-mon-19.0.0-2445.gd2c45d97.el9.x86 8.8 MB/s | 4.7 MB 00:00 2024-04-25T22:50:15.860 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rsa-4.9-2.el9.noarch 37/143 2024-04-25T22:50:15.945 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 38/143 2024-04-25T22:50:15.975 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 39/143 2024-04-25T22:50:16.017 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 40/143 2024-04-25T22:50:16.055 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librados-devel-2:19.0.0-2445.gd2c45d97.el9.x86_6 41/143 2024-04-25T22:50:16.097 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 42/143 2024-04-25T22:50:16.265 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 43/143 2024-04-25T22:50:16.317 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 44/143 2024-04-25T22:50:16.372 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 45/143 2024-04-25T22:50:16.444 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/143 2024-04-25T22:50:16.476 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 47/143 2024-04-25T22:50:16.512 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 48/143 2024-04-25T22:50:16.559 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/143 2024-04-25T22:50:16.590 INFO:teuthology.orchestra.run.smithi191.stdout:(8/139): ceph-common-19.0.0-2445.gd2c45d97.el9. 7.6 MB/s | 21 MB 00:02 2024-04-25T22:50:16.604 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/143 2024-04-25T22:50:16.646 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 51/143 2024-04-25T22:50:16.723 INFO:teuthology.orchestra.run.smithi191.stdout:(9/139): ceph-radosgw-19.0.0-2445.gd2c45d97.el9 8.6 MB/s | 10 MB 00:01 2024-04-25T22:50:16.748 INFO:teuthology.orchestra.run.smithi191.stdout:(10/139): ceph-selinux-19.0.0-2445.gd2c45d97.el 159 kB/s | 25 kB 00:00 2024-04-25T22:50:16.781 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 52/143 2024-04-25T22:50:16.807 INFO:teuthology.orchestra.run.smithi191.stdout:(11/139): libcephfs-devel-19.0.0-2445.gd2c45d97 543 kB/s | 32 kB 00:00 2024-04-25T22:50:16.830 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-04-25T22:50:16.832 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 53/143 2024-04-25T22:50:16.873 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 54/143 2024-04-25T22:50:16.880 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-25T22:50:16.935 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/143 2024-04-25T22:50:16.965 INFO:teuthology.orchestra.run.smithi191.stdout:(12/139): libcephfs2-19.0.0-2445.gd2c45d97.el9. 4.6 MB/s | 745 kB 00:00 2024-04-25T22:50:16.966 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 55/143 2024-04-25T22:50:16.983 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/143 2024-04-25T22:50:17.007 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 56/143 2024-04-25T22:50:17.010 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/143 2024-04-25T22:50:17.037 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/143 2024-04-25T22:50:17.047 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 57/143 2024-04-25T22:50:17.066 INFO:teuthology.orchestra.run.smithi191.stdout:(13/139): libcephsqlite-19.0.0-2445.gd2c45d97.e 1.6 MB/s | 163 kB 00:00 2024-04-25T22:50:17.072 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 58/143 2024-04-25T22:50:17.074 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/143 2024-04-25T22:50:17.078 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/143 2024-04-25T22:50:17.097 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 59/143 2024-04-25T22:50:17.103 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/143 2024-04-25T22:50:17.127 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/143 2024-04-25T22:50:17.139 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/143 2024-04-25T22:50:17.149 INFO:teuthology.orchestra.run.smithi191.stdout:(14/139): librados-devel-19.0.0-2445.gd2c45d97. 1.5 MB/s | 127 kB 00:00 2024-04-25T22:50:17.161 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/143 2024-04-25T22:50:17.171 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 60/143 2024-04-25T22:50:17.187 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/143 2024-04-25T22:50:17.229 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/143 2024-04-25T22:50:17.298 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 61/143 2024-04-25T22:50:17.333 INFO:teuthology.orchestra.run.smithi191.stdout:(15/139): ceph-osd-19.0.0-2445.gd2c45d97.el9.x8 7.9 MB/s | 17 MB 00:02 2024-04-25T22:50:17.338 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 62/143 2024-04-25T22:50:17.366 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 63/143 2024-04-25T22:50:17.366 INFO:teuthology.orchestra.run.smithi191.stdout:(16/139): libradosstriper1-19.0.0-2445.gd2c45d9 2.3 MB/s | 501 kB 00:00 2024-04-25T22:50:17.403 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 64/143 2024-04-25T22:50:17.433 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 65/143 2024-04-25T22:50:17.433 INFO:teuthology.orchestra.run.smithi191.stdout:(17/139): python3-ceph-argparse-19.0.0-2445.gd2 676 kB/s | 45 kB 00:00 2024-04-25T22:50:17.467 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 66/143 2024-04-25T22:50:17.495 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/143 2024-04-25T22:50:17.501 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 67/143 2024-04-25T22:50:17.517 INFO:teuthology.orchestra.run.smithi191.stdout:(18/139): python3-ceph-common-19.0.0-2445.gd2c4 1.6 MB/s | 133 kB 00:00 2024-04-25T22:50:17.542 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 68/143 2024-04-25T22:50:17.554 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/143 2024-04-25T22:50:17.576 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 69/143 2024-04-25T22:50:17.593 INFO:teuthology.orchestra.run.smithi191.stdout:(19/139): python3-cephfs-19.0.0-2445.gd2c45d97. 2.1 MB/s | 162 kB 00:00 2024-04-25T22:50:17.604 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 8/143 2024-04-25T22:50:17.663 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 70/143 2024-04-25T22:50:17.663 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 8/143 2024-04-25T22:50:17.676 INFO:teuthology.orchestra.run.smithi191.stdout:(20/139): python3-rados-19.0.0-2445.gd2c45d97.e 3.8 MB/s | 321 kB 00:00 2024-04-25T22:50:17.706 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 71/143 2024-04-25T22:50:17.728 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 8/143 2024-04-25T22:50:17.747 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 72/143 2024-04-25T22:50:17.755 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 9/143 2024-04-25T22:50:17.760 INFO:teuthology.orchestra.run.smithi191.stdout:(21/139): python3-rbd-19.0.0-2445.gd2c45d97.el9 3.5 MB/s | 299 kB 00:00 2024-04-25T22:50:17.784 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 8/143 2024-04-25T22:50:17.794 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 73/143 2024-04-25T22:50:17.814 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 9/143 2024-04-25T22:50:17.835 INFO:teuthology.orchestra.run.smithi191.stdout:(22/139): python3-rgw-19.0.0-2445.gd2c45d97.el9 1.3 MB/s | 99 kB 00:00 2024-04-25T22:50:17.847 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 9/143 2024-04-25T22:50:17.892 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-packaging-20.9-5.el9.noarch 74/143 2024-04-25T22:50:17.895 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rados-2:19.0.0-2445.gd2c45d97.el9.x86_64 10/143 2024-04-25T22:50:17.905 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 9/143 2024-04-25T22:50:17.910 INFO:teuthology.orchestra.run.smithi191.stdout:(23/139): librgw2-19.0.0-2445.gd2c45d97.el9.x86 9.2 MB/s | 5.3 MB 00:00 2024-04-25T22:50:17.923 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 11/143 2024-04-25T22:50:17.936 INFO:teuthology.orchestra.run.smithi191.stdout:(24/139): rbd-fuse-19.0.0-2445.gd2c45d97.el9.x8 849 kB/s | 85 kB 00:00 2024-04-25T22:50:17.954 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rados-2:19.0.0-2445.gd2c45d97.el9.x86_64 10/143 2024-04-25T22:50:17.982 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 11/143 2024-04-25T22:50:18.011 INFO:teuthology.orchestra.run.smithi191.stdout:(25/139): rbd-nbd-19.0.0-2445.gd2c45d97.el9.x86 2.2 MB/s | 171 kB 00:00 2024-04-25T22:50:18.028 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 11/143 2024-04-25T22:50:18.058 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86 12/143 2024-04-25T22:50:18.077 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 11/143 2024-04-25T22:50:18.087 INFO:teuthology.orchestra.run.smithi191.stdout:(26/139): ceph-grafana-dashboards-19.0.0-2445.g 420 kB/s | 32 kB 00:00 2024-04-25T22:50:18.090 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 75/143 2024-04-25T22:50:18.099 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86 12/143 2024-04-25T22:50:18.145 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86 12/143 2024-04-25T22:50:18.162 INFO:teuthology.orchestra.run.smithi191.stdout:(27/139): ceph-mgr-cephadm-19.0.0-2445.gd2c45d9 1.8 MB/s | 141 kB 00:00 2024-04-25T22:50:18.166 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-04-25T22:50:18.170 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86 12/143 2024-04-25T22:50:18.188 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-04-25T22:50:18.192 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-04-25T22:50:18.212 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-04-25T22:50:18.237 INFO:teuthology.orchestra.run.smithi191.stdout:(28/139): rbd-mirror-19.0.0-2445.gd2c45d97.el9. 9.5 MB/s | 3.1 MB 00:00 2024-04-25T22:50:18.376 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 14/143 2024-04-25T22:50:18.392 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 14/143 2024-04-25T22:50:18.408 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 14/143 2024-04-25T22:50:18.425 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 14/143 2024-04-25T22:50:18.519 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/143 2024-04-25T22:50:18.532 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/143 2024-04-25T22:50:18.616 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 16/143 2024-04-25T22:50:18.627 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 16/143 2024-04-25T22:50:18.654 INFO:teuthology.orchestra.run.smithi191.stdout:(29/139): ceph-mgr-dashboard-19.0.0-2445.gd2c45 7.1 MB/s | 3.5 MB 00:00 2024-04-25T22:50:18.657 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/143 2024-04-25T22:50:18.657 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/143 2024-04-25T22:50:18.692 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/143 2024-04-25T22:50:18.692 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/143 2024-04-25T22:50:18.746 INFO:teuthology.orchestra.run.smithi191.stdout:(30/139): ceph-mgr-modules-core-19.0.0-2445.gd2 2.7 MB/s | 249 kB 00:00 2024-04-25T22:50:18.765 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/143 2024-04-25T22:50:18.768 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/143 2024-04-25T22:50:18.799 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/143 2024-04-25T22:50:18.805 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 76/143 2024-04-25T22:50:18.808 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/143 2024-04-25T22:50:18.830 INFO:teuthology.orchestra.run.smithi191.stdout:(31/139): ceph-mgr-rook-19.0.0-2445.gd2c45d97.e 592 kB/s | 49 kB 00:00 2024-04-25T22:50:18.843 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 21/143 2024-04-25T22:50:18.852 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 21/143 2024-04-25T22:50:18.854 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 77/143 2024-04-25T22:50:18.884 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 22/143 2024-04-25T22:50:18.884 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 22/143 2024-04-25T22:50:18.887 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 78/143 2024-04-25T22:50:18.897 INFO:teuthology.orchestra.run.smithi191.stdout:(32/139): ceph-prometheus-alerts-19.0.0-2445.gd 229 kB/s | 15 kB 00:00 2024-04-25T22:50:18.912 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : lua-5.4.4-4.el9.x86_64 23/143 2024-04-25T22:50:18.912 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : lua-5.4.4-4.el9.x86_64 23/143 2024-04-25T22:50:18.980 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 24/143 2024-04-25T22:50:18.984 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 24/143 2024-04-25T22:50:18.989 INFO:teuthology.orchestra.run.smithi191.stdout:(33/139): ceph-volume-19.0.0-2445.gd2c45d97.el9 2.8 MB/s | 264 kB 00:00 2024-04-25T22:50:18.995 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 79/143 2024-04-25T22:50:19.030 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 80/143 2024-04-25T22:50:19.033 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 25/143 2024-04-25T22:50:19.044 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 25/143 2024-04-25T22:50:19.065 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 26/143 2024-04-25T22:50:19.072 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 26/143 2024-04-25T22:50:19.091 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 27/143 2024-04-25T22:50:19.106 INFO:teuthology.orchestra.run.smithi191.stdout:(34/139): ceph-mgr-diskprediction-local-19.0.0- 8.5 MB/s | 7.4 MB 00:00 2024-04-25T22:50:19.108 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 27/143 2024-04-25T22:50:19.148 INFO:teuthology.orchestra.run.smithi191.stdout:(35/139): cephadm-19.0.0-2445.gd2c45d97.el9.noa 4.7 MB/s | 762 kB 00:00 2024-04-25T22:50:19.167 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 28/143 2024-04-25T22:50:19.187 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 28/143 2024-04-25T22:50:19.202 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-ceph-common-2:19.0.0-2445.gd2c45d97.el9. 29/143 2024-04-25T22:50:19.207 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : openblas-0.3.21-2.el9.x86_64 81/143 2024-04-25T22:50:19.227 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-ceph-common-2:19.0.0-2445.gd2c45d97.el9. 29/143 2024-04-25T22:50:19.244 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 82/143 2024-04-25T22:50:19.246 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-ceph-argparse-2:19.0.0-2445.gd2c45d97.el 30/143 2024-04-25T22:50:19.257 INFO:teuthology.orchestra.run.smithi191.stdout:(36/139): fuse-2.9.9-15.el9.x86_64.rpm 535 kB/s | 80 kB 00:00 2024-04-25T22:50:19.271 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-ceph-argparse-2:19.0.0-2445.gd2c45d97.el 30/143 2024-04-25T22:50:19.274 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cephfs-2:19.0.0-2445.gd2c45d97.el9.x86_6 31/143 2024-04-25T22:50:19.299 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cephfs-2:19.0.0-2445.gd2c45d97.el9.x86_6 31/143 2024-04-25T22:50:19.307 INFO:teuthology.orchestra.run.smithi191.stdout:(37/139): libquadmath-11.4.1-3.el9.x86_64.rpm 3.8 MB/s | 195 kB 00:00 2024-04-25T22:50:19.321 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 83/143 2024-04-25T22:50:19.340 INFO:teuthology.orchestra.run.smithi191.stdout:(38/139): libgfortran-11.4.1-3.el9.x86_64.rpm 4.7 MB/s | 803 kB 00:00 2024-04-25T22:50:19.343 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 32/143 2024-04-25T22:50:19.366 INFO:teuthology.orchestra.run.smithi191.stdout:(39/139): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2024-04-25T22:50:19.374 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 32/143 2024-04-25T22:50:19.389 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : luarocks-3.9.2-1.el9.noarch 33/143 2024-04-25T22:50:19.424 INFO:teuthology.orchestra.run.smithi191.stdout:(40/139): python3-cryptography-36.0.1-4.el9.x86 15 MB/s | 1.2 MB 00:00 2024-04-25T22:50:19.431 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : luarocks-3.9.2-1.el9.noarch 33/143 2024-04-25T22:50:19.443 INFO:teuthology.orchestra.run.smithi191.stdout:(41/139): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-04-25T22:50:19.463 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 34/143 2024-04-25T22:50:19.466 INFO:teuthology.orchestra.run.smithi191.stdout:(42/139): python3-pycparser-2.20-6.el9.noarch.r 3.2 MB/s | 135 kB 00:00 2024-04-25T22:50:19.492 INFO:teuthology.orchestra.run.smithi191.stdout:(43/139): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-04-25T22:50:19.509 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 34/143 2024-04-25T22:50:19.517 INFO:teuthology.orchestra.run.smithi191.stdout:(44/139): python3-urllib3-1.26.5-5.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-04-25T22:50:19.551 INFO:teuthology.orchestra.run.smithi191.stdout:(45/139): automake-1.16.2-8.el9.noarch.rpm 12 MB/s | 689 kB 00:00 2024-04-25T22:50:19.593 INFO:teuthology.orchestra.run.smithi191.stdout:(46/139): bison-3.7.4-5.el9.x86_64.rpm 12 MB/s | 943 kB 00:00 2024-04-25T22:50:19.603 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 35/143 2024-04-25T22:50:19.618 INFO:teuthology.orchestra.run.smithi191.stdout:(47/139): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-04-25T22:50:19.645 INFO:teuthology.orchestra.run.smithi191.stdout:(48/139): elfutils-libelf-devel-0.190-2.el9.x86 426 kB/s | 21 kB 00:00 2024-04-25T22:50:19.657 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 35/143 2024-04-25T22:50:19.657 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 36/143 2024-04-25T22:50:19.678 INFO:teuthology.orchestra.run.smithi191.stdout:(49/139): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 313 kB 00:00 2024-04-25T22:50:19.703 INFO:teuthology.orchestra.run.smithi191.stdout:(50/139): flexiblas-3.0.4-8.el9.x86_64.rpm 561 kB/s | 33 kB 00:00 2024-04-25T22:50:19.718 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 36/143 2024-04-25T22:50:19.770 INFO:teuthology.orchestra.run.smithi191.stdout:(51/139): flexiblas-netlib-3.0.4-8.el9.x86_64.r 33 MB/s | 3.0 MB 00:00 2024-04-25T22:50:19.795 INFO:teuthology.orchestra.run.smithi191.stdout:(52/139): flexiblas-openblas-openmp-3.0.4-8.el9 202 kB/s | 18 kB 00:00 2024-04-25T22:50:19.820 INFO:teuthology.orchestra.run.smithi191.stdout:(53/139): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-04-25T22:50:19.846 INFO:teuthology.orchestra.run.smithi191.stdout:(54/139): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-04-25T22:50:19.871 INFO:teuthology.orchestra.run.smithi191.stdout:(55/139): librabbitmq-0.11.0-7.el9.x86_64.rpm 903 kB/s | 45 kB 00:00 2024-04-25T22:50:19.905 INFO:teuthology.orchestra.run.smithi191.stdout:(56/139): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-04-25T22:50:19.930 INFO:teuthology.orchestra.run.smithi191.stdout:(57/139): libtool-2.4.6-45.el9.x86_64.rpm 9.9 MB/s | 582 kB 00:00 2024-04-25T22:50:19.955 INFO:teuthology.orchestra.run.smithi191.stdout:(58/139): libuuid-devel-2.37.4-18.el9.x86_64.rp 515 kB/s | 25 kB 00:00 2024-04-25T22:50:19.963 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 84/143 2024-04-25T22:50:19.972 INFO:teuthology.orchestra.run.smithi191.stdout:(59/139): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-04-25T22:50:19.998 INFO:teuthology.orchestra.run.smithi191.stdout:(60/139): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.8 MB/s | 292 kB 00:00 2024-04-25T22:50:20.023 INFO:teuthology.orchestra.run.smithi191.stdout:(61/139): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-04-25T22:50:20.040 INFO:teuthology.orchestra.run.smithi191.stdout:(62/139): openblas-0.3.21-2.el9.x86_64.rpm 847 kB/s | 35 kB 00:00 2024-04-25T22:50:20.084 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 85/143 2024-04-25T22:50:20.149 INFO:teuthology.orchestra.run.smithi191.stdout:(63/139): openblas-openmp-0.3.21-2.el9.x86_64.r 38 MB/s | 4.7 MB 00:00 2024-04-25T22:50:20.181 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rsa-4.9-2.el9.noarch 37/143 2024-04-25T22:50:20.240 INFO:teuthology.orchestra.run.smithi191.stdout:(64/139): openssl-devel-3.2.1-1.el9.x86_64.rpm 22 MB/s | 4.4 MB 00:00 2024-04-25T22:50:20.270 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 38/143 2024-04-25T22:50:20.274 INFO:teuthology.orchestra.run.smithi191.stdout:(65/139): protobuf-3.14.0-13.el9.x86_64.rpm 8.2 MB/s | 1.0 MB 00:00 2024-04-25T22:50:20.284 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rsa-4.9-2.el9.noarch 37/143 2024-04-25T22:50:20.299 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 39/143 2024-04-25T22:50:20.342 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 40/143 2024-04-25T22:50:20.380 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librados-devel-2:19.0.0-2445.gd2c45d97.el9.x86_6 41/143 2024-04-25T22:50:20.382 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 38/143 2024-04-25T22:50:20.415 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 39/143 2024-04-25T22:50:20.421 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 42/143 2024-04-25T22:50:20.458 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 40/143 2024-04-25T22:50:20.506 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librados-devel-2:19.0.0-2445.gd2c45d97.el9.x86_6 41/143 2024-04-25T22:50:20.556 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 42/143 2024-04-25T22:50:20.587 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 43/143 2024-04-25T22:50:20.633 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 44/143 2024-04-25T22:50:20.687 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 45/143 2024-04-25T22:50:20.724 INFO:teuthology.orchestra.run.smithi191.stdout:(66/139): ceph-test-19.0.0-2445.gd2c45d97.el9.x 12 MB/s | 48 MB 00:04 2024-04-25T22:50:20.735 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 43/143 2024-04-25T22:50:20.769 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/143 2024-04-25T22:50:20.800 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 47/143 2024-04-25T22:50:20.801 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 44/143 2024-04-25T22:50:20.816 INFO:teuthology.orchestra.run.smithi191.stdout:(67/139): python3-babel-2.9.1-2.el9.noarch.rpm 10 MB/s | 6.0 MB 00:00 2024-04-25T22:50:20.836 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 48/143 2024-04-25T22:50:20.841 INFO:teuthology.orchestra.run.smithi191.stdout:(68/139): python3-devel-3.9.18-3.el9.x86_64.rpm 432 kB/s | 244 kB 00:00 2024-04-25T22:50:20.856 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 45/143 2024-04-25T22:50:20.867 INFO:teuthology.orchestra.run.smithi191.stdout:(69/139): python3-jinja2-2.11.3-5.el9.noarch.rp 1.7 MB/s | 248 kB 00:00 2024-04-25T22:50:20.891 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/143 2024-04-25T22:50:20.892 INFO:teuthology.orchestra.run.smithi191.stdout:(70/139): python3-jsonpatch-1.21-16.el9.noarch. 517 kB/s | 26 kB 00:00 2024-04-25T22:50:20.917 INFO:teuthology.orchestra.run.smithi191.stdout:(71/139): python3-jsonpointer-2.0-4.el9.noarch. 256 kB/s | 19 kB 00:00 2024-04-25T22:50:20.930 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/143 2024-04-25T22:50:20.937 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/143 2024-04-25T22:50:20.942 INFO:teuthology.orchestra.run.smithi191.stdout:(72/139): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-04-25T22:50:20.966 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 47/143 2024-04-25T22:50:20.968 INFO:teuthology.orchestra.run.smithi191.stdout:(73/139): python3-markupsafe-1.1.1-12.el9.x86_6 694 kB/s | 35 kB 00:00 2024-04-25T22:50:20.979 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 51/143 2024-04-25T22:50:21.003 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 48/143 2024-04-25T22:50:21.051 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/143 2024-04-25T22:50:21.085 INFO:teuthology.orchestra.run.smithi191.stdout:(74/139): python3-numpy-1.20.1-5.el9.x86_64.rpm 31 MB/s | 5.1 MB 00:00 2024-04-25T22:50:21.096 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/143 2024-04-25T22:50:21.115 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 52/143 2024-04-25T22:50:21.118 INFO:teuthology.orchestra.run.smithi191.stdout:(75/139): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.4 MB/s | 250 kB 00:00 2024-04-25T22:50:21.138 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 51/143 2024-04-25T22:50:21.143 INFO:teuthology.orchestra.run.smithi191.stdout:(76/139): python3-oauthlib-3.1.1-5.el9.noarch.r 1.3 MB/s | 222 kB 00:00 2024-04-25T22:50:21.156 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 53/143 2024-04-25T22:50:21.197 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 54/143 2024-04-25T22:50:21.206 INFO:teuthology.orchestra.run.smithi191.stdout:(77/139): python3-packaging-20.9-5.el9.noarch.r 646 kB/s | 77 kB 00:00 2024-04-25T22:50:21.261 INFO:teuthology.orchestra.run.smithi191.stdout:(78/139): python3-prettytable-0.7.2-27.el9.noar 362 kB/s | 42 kB 00:00 2024-04-25T22:50:21.286 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 52/143 2024-04-25T22:50:21.286 INFO:teuthology.orchestra.run.smithi191.stdout:(79/139): python3-protobuf-3.14.0-13.el9.noarch 1.9 MB/s | 269 kB 00:00 2024-04-25T22:50:21.291 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 55/143 2024-04-25T22:50:21.309 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 86/143 2024-04-25T22:50:21.311 INFO:teuthology.orchestra.run.smithi191.stdout:(80/139): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.5 MB/s | 159 kB 00:00 2024-04-25T22:50:21.322 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 56/143 2024-04-25T22:50:21.331 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 53/143 2024-04-25T22:50:21.337 INFO:teuthology.orchestra.run.smithi191.stdout:(81/139): python3-pyasn1-modules-0.4.8-6.el9.no 5.5 MB/s | 279 kB 00:00 2024-04-25T22:50:21.362 INFO:teuthology.orchestra.run.smithi191.stdout:(82/139): python3-pytz-2021.1-5.el9.noarch.rpm 682 kB/s | 51 kB 00:00 2024-04-25T22:50:21.362 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 57/143 2024-04-25T22:50:21.373 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 54/143 2024-04-25T22:50:21.378 INFO:teuthology.orchestra.run.smithi191.stdout:(83/139): python3-requests-oauthlib-1.3.0-12.el 809 kB/s | 54 kB 00:00 2024-04-25T22:50:21.382 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 87/143 2024-04-25T22:50:21.387 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 58/143 2024-04-25T22:50:21.410 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 88/143 2024-04-25T22:50:21.429 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 59/143 2024-04-25T22:50:21.429 INFO:teuthology.orchestra.run.smithi191.stdout:(84/139): python3-toml-0.10.2-6.el9.noarch.rpm 626 kB/s | 42 kB 00:00 2024-04-25T22:50:21.443 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 89/143 2024-04-25T22:50:21.472 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 55/143 2024-04-25T22:50:21.504 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 60/143 2024-04-25T22:50:21.506 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 56/143 2024-04-25T22:50:21.512 INFO:teuthology.orchestra.run.smithi191.stdout:(85/139): qatlib-24.02.0-1.el9.x86_64.rpm 1.6 MB/s | 221 kB 00:00 2024-04-25T22:50:21.546 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 57/143 2024-04-25T22:50:21.579 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 58/143 2024-04-25T22:50:21.579 INFO:teuthology.orchestra.run.smithi191.stdout:(86/139): qatlib-service-24.02.0-1.el9.x86_64.r 242 kB/s | 36 kB 00:00 2024-04-25T22:50:21.604 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 59/143 2024-04-25T22:50:21.631 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 61/143 2024-04-25T22:50:21.661 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 62/143 2024-04-25T22:50:21.683 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 60/143 2024-04-25T22:50:21.689 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 63/143 2024-04-25T22:50:21.726 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 64/143 2024-04-25T22:50:21.756 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 65/143 2024-04-25T22:50:21.756 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 90/143 2024-04-25T22:50:21.771 INFO:teuthology.orchestra.run.smithi191.stdout:(87/139): python3-scipy-1.6.2-8.el9.x86_64.rpm 40 MB/s | 16 MB 00:00 2024-04-25T22:50:21.790 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 66/143 2024-04-25T22:50:21.797 INFO:teuthology.orchestra.run.smithi191.stdout:(88/139): qatzip-libs-1.2.0-1.el9.x86_64.rpm 168 kB/s | 47 kB 00:00 2024-04-25T22:50:21.797 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 91/143 2024-04-25T22:50:21.820 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 61/143 2024-04-25T22:50:21.822 INFO:teuthology.orchestra.run.smithi191.stdout:(89/139): socat-1.7.4.1-5.el9.x86_64.rpm 1.2 MB/s | 305 kB 00:00 2024-04-25T22:50:21.823 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 67/143 2024-04-25T22:50:21.839 INFO:teuthology.orchestra.run.smithi191.stdout:(90/139): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.4 MB/s | 94 kB 00:00 2024-04-25T22:50:21.861 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 62/143 2024-04-25T22:50:21.864 INFO:teuthology.orchestra.run.smithi191.stdout:(91/139): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-04-25T22:50:21.865 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 68/143 2024-04-25T22:50:21.889 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 91/143 2024-04-25T22:50:21.889 INFO:teuthology.orchestra.run.smithi191.stdout:(92/139): zlib-devel-1.2.11-41.el9.x86_64.rpm 670 kB/s | 45 kB 00:00 2024-04-25T22:50:21.890 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 63/143 2024-04-25T22:50:21.900 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 69/143 2024-04-25T22:50:21.915 INFO:teuthology.orchestra.run.smithi191.stdout:(93/139): lua-devel-5.4.4-4.el9.x86_64.rpm 296 kB/s | 22 kB 00:00 2024-04-25T22:50:21.920 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 92/143 2024-04-25T22:50:21.926 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 64/143 2024-04-25T22:50:21.955 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 93/143 2024-04-25T22:50:21.956 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 65/143 2024-04-25T22:50:21.957 INFO:teuthology.orchestra.run.smithi191.stdout:(94/139): protobuf-compiler-3.14.0-13.el9.x86_6 13 MB/s | 863 kB 00:00 2024-04-25T22:50:21.986 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 70/143 2024-04-25T22:50:21.990 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 66/143 2024-04-25T22:50:22.024 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 67/143 2024-04-25T22:50:22.030 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 71/143 2024-04-25T22:50:22.066 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 68/143 2024-04-25T22:50:22.070 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 72/143 2024-04-25T22:50:22.100 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 69/143 2024-04-25T22:50:22.117 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 73/143 2024-04-25T22:50:22.123 INFO:teuthology.orchestra.run.smithi191.stdout:(95/139): grpc-data-1.46.7-10.el9.noarch.rpm 117 kB/s | 19 kB 00:00 2024-04-25T22:50:22.192 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 70/143 2024-04-25T22:50:22.214 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-packaging-20.9-5.el9.noarch 74/143 2024-04-25T22:50:22.262 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 75/143 2024-04-25T22:50:22.290 INFO:teuthology.orchestra.run.smithi191.stdout:(96/139): gperftools-libs-2.9.1-2.el9.x86_64.rp 825 kB/s | 309 kB 00:00 2024-04-25T22:50:22.318 INFO:teuthology.orchestra.run.smithi191.stdout:(97/139): abseil-cpp-20211102.0-3.el9.x86_64.rp 1.3 MB/s | 548 kB 00:00 2024-04-25T22:50:22.332 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 71/143 2024-04-25T22:50:22.366 INFO:teuthology.orchestra.run.smithi191.stdout:(98/139): libarrow-doc-9.0.0-10.el9.noarch.rpm 345 kB/s | 26 kB 00:00 2024-04-25T22:50:22.370 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 72/143 2024-04-25T22:50:22.408 INFO:teuthology.orchestra.run.smithi191.stdout:(99/139): liboath-2.6.7-2.el9.x86_64.rpm 528 kB/s | 49 kB 00:00 2024-04-25T22:50:22.418 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 94/143 2024-04-25T22:50:22.418 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 73/143 2024-04-25T22:50:22.433 INFO:teuthology.orchestra.run.smithi191.stdout:(100/139): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2024-04-25T22:50:22.451 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 95/143 2024-04-25T22:50:22.500 INFO:teuthology.orchestra.run.smithi191.stdout:(101/139): luarocks-3.9.2-1.el9.noarch.rpm 1.6 MB/s | 151 kB 00:00 2024-04-25T22:50:22.523 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 95/143 2024-04-25T22:50:22.530 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-packaging-20.9-5.el9.noarch 74/143 2024-04-25T22:50:22.544 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 96/143 2024-04-25T22:50:22.590 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 75/143 2024-04-25T22:50:22.634 INFO:teuthology.orchestra.run.smithi191.stdout:(102/139): libarrow-9.0.0-10.el9.x86_64.rpm 8.7 MB/s | 4.4 MB 00:00 2024-04-25T22:50:22.668 INFO:teuthology.orchestra.run.smithi191.stdout:(103/139): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.5 MB/s | 838 kB 00:00 2024-04-25T22:50:22.718 INFO:teuthology.orchestra.run.smithi191.stdout:(104/139): python3-asyncssh-2.13.2-5.el9.noarch 2.5 MB/s | 548 kB 00:00 2024-04-25T22:50:22.743 INFO:teuthology.orchestra.run.smithi191.stdout:(105/139): python3-bcrypt-3.2.2-1.el9.x86_64.rp 398 kB/s | 43 kB 00:00 2024-04-25T22:50:22.768 INFO:teuthology.orchestra.run.smithi191.stdout:(106/139): python3-cachetools-4.2.4-1.el9.noarc 320 kB/s | 32 kB 00:00 2024-04-25T22:50:22.835 INFO:teuthology.orchestra.run.smithi191.stdout:(107/139): python3-cheroot-8.6.0-4.el9.noarch.r 1.8 MB/s | 172 kB 00:00 2024-04-25T22:50:22.861 INFO:teuthology.orchestra.run.smithi191.stdout:(108/139): python3-certifi-2021.10.8-2.el9.noar 105 kB/s | 15 kB 00:00 2024-04-25T22:50:22.886 INFO:teuthology.orchestra.run.smithi191.stdout:(109/139): python3-cherrypy-18.6.1-2.el9.noarch 3.0 MB/s | 358 kB 00:00 2024-04-25T22:50:22.920 INFO:teuthology.orchestra.run.smithi191.stdout:(110/139): python3-google-auth-2.29.0-1.el9.noa 2.4 MB/s | 206 kB 00:00 2024-04-25T22:50:22.970 INFO:teuthology.orchestra.run.smithi191.stdout:(111/139): python3-grpcio-tools-1.46.7-10.el9.x 1.7 MB/s | 144 kB 00:00 2024-04-25T22:50:22.982 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 76/143 2024-04-25T22:50:22.995 INFO:teuthology.orchestra.run.smithi191.stdout:(112/139): python3-jaraco-8.2.1-3.el9.noarch.rp 142 kB/s | 11 kB 00:00 2024-04-25T22:50:23.026 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 77/143 2024-04-25T22:50:23.054 INFO:teuthology.orchestra.run.smithi191.stdout:(113/139): python3-grpcio-1.46.7-10.el9.x86_64. 11 MB/s | 2.0 MB 00:00 2024-04-25T22:50:23.060 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 78/143 2024-04-25T22:50:23.079 INFO:teuthology.orchestra.run.smithi191.stdout:(114/139): python3-jaraco-classes-3.2.1-5.el9.n 162 kB/s | 18 kB 00:00 2024-04-25T22:50:23.104 INFO:teuthology.orchestra.run.smithi191.stdout:(115/139): python3-jaraco-collections-3.0.0-8.e 213 kB/s | 23 kB 00:00 2024-04-25T22:50:23.130 INFO:teuthology.orchestra.run.smithi191.stdout:(116/139): python3-jaraco-functools-3.5.0-2.el9 258 kB/s | 19 kB 00:00 2024-04-25T22:50:23.160 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 79/143 2024-04-25T22:50:23.180 INFO:teuthology.orchestra.run.smithi191.stdout:(117/139): python3-jaraco-text-3.2.0-6.el9.noar 262 kB/s | 20 kB 00:00 2024-04-25T22:50:23.194 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 80/143 2024-04-25T22:50:23.222 INFO:teuthology.orchestra.run.smithi191.stdout:(118/139): python3-kubernetes-26.1.0-2.el9.noar 8.7 MB/s | 1.0 MB 00:00 2024-04-25T22:50:23.247 INFO:teuthology.orchestra.run.smithi191.stdout:(119/139): python3-logutils-0.3.5-21.el9.noarch 395 kB/s | 46 kB 00:00 2024-04-25T22:50:23.297 INFO:teuthology.orchestra.run.smithi191.stdout:(120/139): python3-more-itertools-8.12.0-2.el9. 672 kB/s | 79 kB 00:00 2024-04-25T22:50:23.323 INFO:teuthology.orchestra.run.smithi191.stdout:(121/139): python3-natsort-7.1.1-5.el9.noarch.r 574 kB/s | 58 kB 00:00 2024-04-25T22:50:23.348 INFO:teuthology.orchestra.run.smithi191.stdout:(122/139): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-04-25T22:50:23.365 INFO:teuthology.orchestra.run.smithi191.stdout:(123/139): python3-portend-3.1.0-2.el9.noarch.r 244 kB/s | 16 kB 00:00 2024-04-25T22:50:23.371 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : openblas-0.3.21-2.el9.x86_64 81/143 2024-04-25T22:50:23.373 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 76/143 2024-04-25T22:50:23.407 INFO:teuthology.orchestra.run.smithi191.stdout:(124/139): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2024-04-25T22:50:23.418 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 77/143 2024-04-25T22:50:23.432 INFO:teuthology.orchestra.run.smithi191.stdout:(125/139): python3-repoze-lru-0.7-16.el9.noarch 367 kB/s | 31 kB 00:00 2024-04-25T22:50:23.452 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 78/143 2024-04-25T22:50:23.457 INFO:teuthology.orchestra.run.smithi191.stdout:(126/139): python3-routes-2.5.1-5.el9.noarch.rp 2.0 MB/s | 188 kB 00:00 2024-04-25T22:50:23.475 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 82/143 2024-04-25T22:50:23.491 INFO:teuthology.orchestra.run.smithi191.stdout:(127/139): python3-rsa-4.9-2.el9.noarch.rpm 705 kB/s | 59 kB 00:00 2024-04-25T22:50:23.516 INFO:teuthology.orchestra.run.smithi191.stdout:(128/139): python3-tempora-5.0.0-2.el9.noarch.r 425 kB/s | 36 kB 00:00 2024-04-25T22:50:23.550 INFO:teuthology.orchestra.run.smithi191.stdout:(129/139): python3-typing-extensions-4.4.0-2.el 552 kB/s | 51 kB 00:00 2024-04-25T22:50:23.553 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 83/143 2024-04-25T22:50:23.559 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 79/143 2024-04-25T22:50:23.584 INFO:teuthology.orchestra.run.smithi191.stdout:(130/139): python3-webob-1.8.7-6.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-04-25T22:50:23.595 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 80/143 2024-04-25T22:50:23.609 INFO:teuthology.orchestra.run.smithi191.stdout:(131/139): python3-websocket-client-1.2.3-2.el9 972 kB/s | 90 kB 00:00 2024-04-25T22:50:23.651 INFO:teuthology.orchestra.run.smithi191.stdout:(132/139): python3-werkzeug-2.0.3-3.el9.1.noarc 4.2 MB/s | 427 kB 00:00 2024-04-25T22:50:23.676 INFO:teuthology.orchestra.run.smithi191.stdout:(133/139): python3-zc-lockfile-2.0-10.el9.noarc 216 kB/s | 20 kB 00:00 2024-04-25T22:50:23.710 INFO:teuthology.orchestra.run.smithi191.stdout:(134/139): re2-20211101-3.el9.x86_64.rpm 1.9 MB/s | 192 kB 00:00 2024-04-25T22:50:23.780 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : openblas-0.3.21-2.el9.x86_64 81/143 2024-04-25T22:50:23.801 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 82/143 2024-04-25T22:50:23.810 INFO:teuthology.orchestra.run.smithi191.stdout:(135/139): thrift-0.15.0-2.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2024-04-25T22:50:23.869 INFO:teuthology.orchestra.run.smithi191.stdout:(136/139): openssl-3.2.1-1.el9.x86_64.rpm 23 MB/s | 1.3 MB 00:00 2024-04-25T22:50:23.881 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 83/143 2024-04-25T22:50:23.952 INFO:teuthology.orchestra.run.smithi191.stdout:(137/139): openssl-libs-3.2.1-1.el9.x86_64.rpm 29 MB/s | 2.4 MB 00:00 2024-04-25T22:50:24.185 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 84/143 2024-04-25T22:50:24.211 INFO:teuthology.orchestra.run.smithi191.stdout:(138/139): librbd1-19.0.0-2445.gd2c45d97.el9.x8 6.3 MB/s | 3.1 MB 00:00 2024-04-25T22:50:24.261 INFO:teuthology.orchestra.run.smithi191.stdout:(139/139): librados2-19.0.0-2445.gd2c45d97.el9. 5.8 MB/s | 3.4 MB 00:00 2024-04-25T22:50:24.266 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2024-04-25T22:50:24.266 INFO:teuthology.orchestra.run.smithi191.stdout:Total 19 MB/s | 211 MB 00:10 2024-04-25T22:50:24.297 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 85/143 2024-04-25T22:50:24.575 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 84/143 2024-04-25T22:50:24.696 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 85/143 2024-04-25T22:50:24.800 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 97/143 2024-04-25T22:50:24.833 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 97/143 2024-04-25T22:50:25.191 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2024-04-25T22:50:25.328 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2024-04-25T22:50:25.328 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2024-04-25T22:50:25.368 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 97/143 2024-04-25T22:50:25.411 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 98/143 2024-04-25T22:50:25.504 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 98/143 2024-04-25T22:50:25.504 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T22:50:25.504 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T22:50:25.504 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-25T22:50:25.508 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 86/143 2024-04-25T22:50:25.529 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 99/143 2024-04-25T22:50:25.595 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 87/143 2024-04-25T22:50:25.622 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 88/143 2024-04-25T22:50:25.656 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 89/143 2024-04-25T22:50:25.968 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 90/143 2024-04-25T22:50:26.010 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 91/143 2024-04-25T22:50:26.014 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 86/143 2024-04-25T22:50:26.096 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 87/143 2024-04-25T22:50:26.110 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 91/143 2024-04-25T22:50:26.125 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 88/143 2024-04-25T22:50:26.141 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 92/143 2024-04-25T22:50:26.157 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 89/143 2024-04-25T22:50:26.176 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 93/143 2024-04-25T22:50:26.486 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 90/143 2024-04-25T22:50:26.528 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 91/143 2024-04-25T22:50:26.612 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 91/143 2024-04-25T22:50:26.650 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 92/143 2024-04-25T22:50:26.653 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 94/143 2024-04-25T22:50:26.687 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 93/143 2024-04-25T22:50:26.697 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 95/143 2024-04-25T22:50:26.768 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 95/143 2024-04-25T22:50:26.799 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 96/143 2024-04-25T22:50:27.004 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2024-04-25T22:50:27.005 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2024-04-25T22:50:27.186 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 94/143 2024-04-25T22:50:27.223 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 95/143 2024-04-25T22:50:27.295 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 95/143 2024-04-25T22:50:27.325 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 96/143 2024-04-25T22:50:29.088 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 97/143 2024-04-25T22:50:29.128 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 97/143 2024-04-25T22:50:29.671 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 97/143 2024-04-25T22:50:29.699 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 97/143 2024-04-25T22:50:29.715 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 98/143 2024-04-25T22:50:29.730 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 97/143 2024-04-25T22:50:29.798 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 98/143 2024-04-25T22:50:29.798 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T22:50:29.799 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T22:50:29.799 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-25T22:50:29.833 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 99/143 2024-04-25T22:50:30.299 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 97/143 2024-04-25T22:50:30.341 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 98/143 2024-04-25T22:50:30.432 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 98/143 2024-04-25T22:50:30.432 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T22:50:30.432 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T22:50:30.432 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:50:30.459 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 99/143 2024-04-25T22:50:32.535 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2024-04-25T22:50:32.615 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/143 2024-04-25T22:50:32.653 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/143 2024-04-25T22:50:32.706 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/143 2024-04-25T22:50:32.741 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/143 2024-04-25T22:50:32.766 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/143 2024-04-25T22:50:32.808 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/143 2024-04-25T22:50:33.133 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/143 2024-04-25T22:50:33.242 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 8/143 2024-04-25T22:50:33.364 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 8/143 2024-04-25T22:50:33.394 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 9/143 2024-04-25T22:50:33.468 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 9/143 2024-04-25T22:50:33.509 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rados-2:19.0.0-2445.gd2c45d97.el9.x86_64 10/143 2024-04-25T22:50:33.545 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 11/143 2024-04-25T22:50:33.631 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 11/143 2024-04-25T22:50:33.654 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86 12/143 2024-04-25T22:50:33.717 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86 12/143 2024-04-25T22:50:33.739 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-04-25T22:50:33.760 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-04-25T22:50:33.914 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 14/143 2024-04-25T22:50:33.946 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 14/143 2024-04-25T22:50:34.054 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/143 2024-04-25T22:50:34.148 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 16/143 2024-04-25T22:50:34.179 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/143 2024-04-25T22:50:34.214 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/143 2024-04-25T22:50:34.278 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/143 2024-04-25T22:50:34.313 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/143 2024-04-25T22:50:34.356 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 21/143 2024-04-25T22:50:34.389 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 22/143 2024-04-25T22:50:34.417 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : lua-5.4.4-4.el9.x86_64 23/143 2024-04-25T22:50:34.487 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 24/143 2024-04-25T22:50:34.538 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 25/143 2024-04-25T22:50:34.570 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 26/143 2024-04-25T22:50:34.605 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 27/143 2024-04-25T22:50:34.689 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 28/143 2024-04-25T22:50:34.724 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-ceph-common-2:19.0.0-2445.gd2c45d97.el9. 29/143 2024-04-25T22:50:34.768 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-ceph-argparse-2:19.0.0-2445.gd2c45d97.el 30/143 2024-04-25T22:50:34.796 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cephfs-2:19.0.0-2445.gd2c45d97.el9.x86_6 31/143 2024-04-25T22:50:34.866 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 32/143 2024-04-25T22:50:34.911 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : luarocks-3.9.2-1.el9.noarch 33/143 2024-04-25T22:50:34.985 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 34/143 2024-04-25T22:50:35.116 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 35/143 2024-04-25T22:50:35.171 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 36/143 2024-04-25T22:50:35.691 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rsa-4.9-2.el9.noarch 37/143 2024-04-25T22:50:35.775 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 38/143 2024-04-25T22:50:35.805 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 39/143 2024-04-25T22:50:35.851 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 40/143 2024-04-25T22:50:35.886 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librados-devel-2:19.0.0-2445.gd2c45d97.el9.x86_6 41/143 2024-04-25T22:50:35.953 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 42/143 2024-04-25T22:50:36.110 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 43/143 2024-04-25T22:50:36.155 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 44/143 2024-04-25T22:50:36.211 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 45/143 2024-04-25T22:50:36.283 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/143 2024-04-25T22:50:36.315 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 47/143 2024-04-25T22:50:36.351 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 48/143 2024-04-25T22:50:36.397 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/143 2024-04-25T22:50:36.443 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/143 2024-04-25T22:50:36.485 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 51/143 2024-04-25T22:50:36.620 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 52/143 2024-04-25T22:50:36.662 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 53/143 2024-04-25T22:50:36.703 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 54/143 2024-04-25T22:50:36.754 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 99/143 2024-04-25T22:50:36.754 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /sys 2024-04-25T22:50:36.754 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /proc 2024-04-25T22:50:36.754 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /mnt 2024-04-25T22:50:36.755 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /var/tmp 2024-04-25T22:50:36.755 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /home 2024-04-25T22:50:36.755 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /root 2024-04-25T22:50:36.755 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /tmp 2024-04-25T22:50:36.755 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-25T22:50:36.797 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 55/143 2024-04-25T22:50:36.829 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 56/143 2024-04-25T22:50:36.869 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 57/143 2024-04-25T22:50:36.894 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 58/143 2024-04-25T22:50:36.919 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 59/143 2024-04-25T22:50:36.925 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 100/143 2024-04-25T22:50:36.940 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 100/143 2024-04-25T22:50:36.940 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T22:50:36.940 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T22:50:36.940 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-25T22:50:36.994 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 60/143 2024-04-25T22:50:37.122 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 61/143 2024-04-25T22:50:37.160 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 62/143 2024-04-25T22:50:37.188 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 63/143 2024-04-25T22:50:37.225 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 64/143 2024-04-25T22:50:37.255 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 65/143 2024-04-25T22:50:37.290 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 66/143 2024-04-25T22:50:37.323 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 67/143 2024-04-25T22:50:37.356 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 68/143 2024-04-25T22:50:37.391 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 69/143 2024-04-25T22:50:37.487 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 70/143 2024-04-25T22:50:37.529 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 71/143 2024-04-25T22:50:37.561 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 72/143 2024-04-25T22:50:37.608 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 73/143 2024-04-25T22:50:37.705 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-packaging-20.9-5.el9.noarch 74/143 2024-04-25T22:50:37.762 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 75/143 2024-04-25T22:50:38.412 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 101/143 2024-04-25T22:50:38.438 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 101/143 2024-04-25T22:50:38.438 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T22:50:38.438 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T22:50:38.438 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T22:50:38.438 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T22:50:38.439 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-25T22:50:38.477 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 76/143 2024-04-25T22:50:38.526 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 77/143 2024-04-25T22:50:38.560 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 78/143 2024-04-25T22:50:38.656 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 79/143 2024-04-25T22:50:38.662 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 102/143 2024-04-25T22:50:38.685 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 102/143 2024-04-25T22:50:38.685 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T22:50:38.685 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T22:50:38.685 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T22:50:38.685 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T22:50:38.685 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-25T22:50:38.694 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 80/143 2024-04-25T22:50:38.874 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : openblas-0.3.21-2.el9.x86_64 81/143 2024-04-25T22:50:38.900 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 82/143 2024-04-25T22:50:38.970 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 83/143 2024-04-25T22:50:39.130 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 103/143 2024-04-25T22:50:39.152 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 103/143 2024-04-25T22:50:39.152 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T22:50:39.152 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T22:50:39.152 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T22:50:39.152 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T22:50:39.153 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-25T22:50:39.277 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : automake-1.16.2-8.el9.noarch 104/143 2024-04-25T22:50:39.333 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-ply-3.11-14.el9.noarch 105/143 2024-04-25T22:50:39.397 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 106/143 2024-04-25T22:50:39.583 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 107/143 2024-04-25T22:50:39.610 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 84/143 2024-04-25T22:50:39.639 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 108/143 2024-04-25T22:50:39.724 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 109/143 2024-04-25T22:50:39.742 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 85/143 2024-04-25T22:50:39.820 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 110/143 2024-04-25T22:50:39.961 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 111/143 2024-04-25T22:50:39.997 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 112/143 2024-04-25T22:50:40.029 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 113/143 2024-04-25T22:50:40.065 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : fuse-2.9.9-15.el9.x86_64 114/143 2024-04-25T22:50:40.505 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 115/143 2024-04-25T22:50:40.531 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 115/143 2024-04-25T22:50:40.562 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2445.gd2c45d97.e 116/143 2024-04-25T22:50:40.623 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2445.gd2c45d97. 117/143 2024-04-25T22:50:40.654 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noa 118/143 2024-04-25T22:50:40.949 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 86/143 2024-04-25T22:50:41.030 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 87/143 2024-04-25T22:50:41.058 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 88/143 2024-04-25T22:50:41.091 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 89/143 2024-04-25T22:50:41.308 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 99/143 2024-04-25T22:50:41.309 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /sys 2024-04-25T22:50:41.309 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /proc 2024-04-25T22:50:41.309 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /mnt 2024-04-25T22:50:41.309 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /var/tmp 2024-04-25T22:50:41.309 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /home 2024-04-25T22:50:41.309 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /root 2024-04-25T22:50:41.309 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /tmp 2024-04-25T22:50:41.309 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-25T22:50:41.404 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 90/143 2024-04-25T22:50:41.484 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 100/143 2024-04-25T22:50:41.496 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 91/143 2024-04-25T22:50:41.500 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 100/143 2024-04-25T22:50:41.500 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T22:50:41.500 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T22:50:41.500 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-25T22:50:41.571 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 91/143 2024-04-25T22:50:41.601 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 92/143 2024-04-25T22:50:41.638 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 93/143 2024-04-25T22:50:41.678 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noa 118/143 2024-04-25T22:50:41.714 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.n 119/143 2024-04-25T22:50:42.162 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 99/143 2024-04-25T22:50:42.162 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /sys 2024-04-25T22:50:42.162 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /proc 2024-04-25T22:50:42.162 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /mnt 2024-04-25T22:50:42.162 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /var/tmp 2024-04-25T22:50:42.162 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /home 2024-04-25T22:50:42.162 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /root 2024-04-25T22:50:42.162 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /tmp 2024-04-25T22:50:42.163 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:50:42.272 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 94/143 2024-04-25T22:50:42.307 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 95/143 2024-04-25T22:50:42.330 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 100/143 2024-04-25T22:50:42.346 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 100/143 2024-04-25T22:50:42.347 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T22:50:42.347 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T22:50:42.347 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:50:42.378 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 95/143 2024-04-25T22:50:42.400 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 96/143 2024-04-25T22:50:42.674 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.n 119/143 2024-04-25T22:50:42.706 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c 120/143 2024-04-25T22:50:42.810 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c 120/143 2024-04-25T22:50:42.935 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 101/143 2024-04-25T22:50:42.960 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 101/143 2024-04-25T22:50:42.961 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T22:50:42.961 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T22:50:42.961 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T22:50:42.961 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T22:50:42.961 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-25T22:50:42.977 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2445.gd2c45d97.el 121/143 2024-04-25T22:50:43.008 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 122/143 2024-04-25T22:50:43.032 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 122/143 2024-04-25T22:50:43.032 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T22:50:43.032 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T22:50:43.032 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T22:50:43.032 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T22:50:43.033 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-25T22:50:43.076 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 123/143 2024-04-25T22:50:43.087 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 123/143 2024-04-25T22:50:43.185 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-2:19.0.0-2445.gd2c45d97.el9.x86_64 124/143 2024-04-25T22:50:43.185 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 102/143 2024-04-25T22:50:43.208 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 102/143 2024-04-25T22:50:43.208 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T22:50:43.208 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T22:50:43.208 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T22:50:43.208 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T22:50:43.209 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-25T22:50:43.232 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 125/143 2024-04-25T22:50:43.653 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 103/143 2024-04-25T22:50:43.675 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 103/143 2024-04-25T22:50:43.675 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T22:50:43.676 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T22:50:43.676 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T22:50:43.676 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T22:50:43.676 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-25T22:50:43.782 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : automake-1.16.2-8.el9.noarch 104/143 2024-04-25T22:50:43.830 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-ply-3.11-14.el9.noarch 105/143 2024-04-25T22:50:43.891 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 101/143 2024-04-25T22:50:43.894 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 106/143 2024-04-25T22:50:43.918 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 101/143 2024-04-25T22:50:43.918 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T22:50:43.918 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T22:50:43.918 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T22:50:43.918 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T22:50:43.918 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:50:44.077 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 107/143 2024-04-25T22:50:44.120 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 108/143 2024-04-25T22:50:44.130 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libtool-2.4.6-45.el9.x86_64 126/143 2024-04-25T22:50:44.150 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 102/143 2024-04-25T22:50:44.162 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 127/143 2024-04-25T22:50:44.174 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 102/143 2024-04-25T22:50:44.174 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T22:50:44.175 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T22:50:44.175 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T22:50:44.175 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T22:50:44.175 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:50:44.184 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 127/143 2024-04-25T22:50:44.184 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T22:50:44.184 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T22:50:44.184 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T22:50:44.184 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T22:50:44.185 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-25T22:50:44.196 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 109/143 2024-04-25T22:50:44.229 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2445.gd2c45 128/143 2024-04-25T22:50:44.251 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2445.gd2c45 128/143 2024-04-25T22:50:44.251 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T22:50:44.251 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T22:50:44.251 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-25T22:50:44.284 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 110/143 2024-04-25T22:50:44.431 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 111/143 2024-04-25T22:50:44.470 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 112/143 2024-04-25T22:50:44.502 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 113/143 2024-04-25T22:50:44.530 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : fuse-2.9.9-15.el9.x86_64 114/143 2024-04-25T22:50:44.555 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 129/143 2024-04-25T22:50:44.577 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 129/143 2024-04-25T22:50:44.578 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T22:50:44.578 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T22:50:44.578 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T22:50:44.578 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T22:50:44.578 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-25T22:50:44.642 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 103/143 2024-04-25T22:50:44.666 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 103/143 2024-04-25T22:50:44.749 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T22:50:44.750 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T22:50:44.750 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T22:50:44.750 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T22:50:44.750 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:50:44.751 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 97/143 2024-04-25T22:50:44.751 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 97/143 2024-04-25T22:50:44.782 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : automake-1.16.2-8.el9.noarch 104/143 2024-04-25T22:50:44.841 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-ply-3.11-14.el9.noarch 105/143 2024-04-25T22:50:44.921 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 106/143 2024-04-25T22:50:44.978 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 115/143 2024-04-25T22:50:45.003 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 115/143 2024-04-25T22:50:45.034 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2445.gd2c45d97.e 116/143 2024-04-25T22:50:45.096 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2445.gd2c45d97. 117/143 2024-04-25T22:50:45.126 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noa 118/143 2024-04-25T22:50:45.127 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 107/143 2024-04-25T22:50:45.178 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 108/143 2024-04-25T22:50:45.272 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 97/143 2024-04-25T22:50:45.285 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 109/143 2024-04-25T22:50:45.310 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 98/143 2024-04-25T22:50:45.382 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 110/143 2024-04-25T22:50:45.394 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 98/143 2024-04-25T22:50:45.394 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T22:50:45.394 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T22:50:45.394 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T22:50:45.427 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 99/143 2024-04-25T22:50:45.535 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 111/143 2024-04-25T22:50:45.577 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 112/143 2024-04-25T22:50:45.609 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 113/143 2024-04-25T22:50:45.636 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : fuse-2.9.9-15.el9.x86_64 114/143 2024-04-25T22:50:46.045 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 115/143 2024-04-25T22:50:46.077 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 115/143 2024-04-25T22:50:46.109 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2445.gd2c45d97.e 116/143 2024-04-25T22:50:46.151 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noa 118/143 2024-04-25T22:50:46.174 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2445.gd2c45d97. 117/143 2024-04-25T22:50:46.186 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.n 119/143 2024-04-25T22:50:46.200 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noa 118/143 2024-04-25T22:50:47.148 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.n 119/143 2024-04-25T22:50:47.170 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c 120/143 2024-04-25T22:50:47.272 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c 120/143 2024-04-25T22:50:47.294 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noa 118/143 2024-04-25T22:50:47.326 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.n 119/143 2024-04-25T22:50:47.432 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2445.gd2c45d97.el 121/143 2024-04-25T22:50:47.472 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 122/143 2024-04-25T22:50:47.495 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 122/143 2024-04-25T22:50:47.495 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T22:50:47.495 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T22:50:47.495 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T22:50:47.495 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T22:50:47.495 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-25T22:50:47.539 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 123/143 2024-04-25T22:50:47.550 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 123/143 2024-04-25T22:50:47.648 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-2:19.0.0-2445.gd2c45d97.el9.x86_64 124/143 2024-04-25T22:50:47.696 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 125/143 2024-04-25T22:50:48.343 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.n 119/143 2024-04-25T22:50:48.369 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c 120/143 2024-04-25T22:50:48.480 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c 120/143 2024-04-25T22:50:48.595 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libtool-2.4.6-45.el9.x86_64 126/143 2024-04-25T22:50:48.625 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 127/143 2024-04-25T22:50:48.648 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 127/143 2024-04-25T22:50:48.648 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T22:50:48.648 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T22:50:48.648 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T22:50:48.648 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T22:50:48.648 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-25T22:50:48.655 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2445.gd2c45d97.el 121/143 2024-04-25T22:50:48.687 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 122/143 2024-04-25T22:50:48.692 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2445.gd2c45 128/143 2024-04-25T22:50:48.712 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 122/143 2024-04-25T22:50:48.712 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T22:50:48.712 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T22:50:48.712 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T22:50:48.712 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T22:50:48.712 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:50:48.714 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2445.gd2c45 128/143 2024-04-25T22:50:48.714 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T22:50:48.714 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T22:50:48.714 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-25T22:50:48.766 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 123/143 2024-04-25T22:50:48.774 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 123/143 2024-04-25T22:50:48.876 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-2:19.0.0-2445.gd2c45d97.el9.x86_64 124/143 2024-04-25T22:50:48.930 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 125/143 2024-04-25T22:50:49.018 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 129/143 2024-04-25T22:50:49.041 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 129/143 2024-04-25T22:50:49.041 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T22:50:49.041 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T22:50:49.041 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T22:50:49.041 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T22:50:49.041 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-25T22:50:49.084 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-test-2:19.0.0-2445.gd2c45d97.el9.x86_64 130/143 2024-04-25T22:50:49.125 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : rbd-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 131/143 2024-04-25T22:50:49.166 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : rbd-nbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 132/143 2024-04-25T22:50:49.198 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 133/143 2024-04-25T22:50:49.225 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 134/143 2024-04-25T22:50:49.876 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libtool-2.4.6-45.el9.x86_64 126/143 2024-04-25T22:50:49.907 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 127/143 2024-04-25T22:50:49.932 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 127/143 2024-04-25T22:50:49.932 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T22:50:49.932 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T22:50:49.932 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T22:50:49.932 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T22:50:49.932 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:50:49.974 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2445.gd2c45 128/143 2024-04-25T22:50:49.998 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2445.gd2c45 128/143 2024-04-25T22:50:49.998 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T22:50:49.998 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T22:50:49.998 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:50:50.068 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libcephfs-devel-2:19.0.0-2445.gd2c45d97.el9.x86_ 135/143 2024-04-25T22:50:50.159 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 136/143 2024-04-25T22:50:50.209 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 137/143 2024-04-25T22:50:50.289 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flex-2.6.4-9.el9.x86_64 138/143 2024-04-25T22:50:50.317 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 129/143 2024-04-25T22:50:50.329 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : bison-3.7.4-5.el9.x86_64 139/143 2024-04-25T22:50:50.330 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 140/143 2024-04-25T22:50:50.340 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 129/143 2024-04-25T22:50:50.340 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T22:50:50.340 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T22:50:50.340 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T22:50:50.341 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T22:50:50.341 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:50:50.422 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 140/143 2024-04-25T22:50:50.447 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 141/143 2024-04-25T22:50:50.447 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/143 2024-04-25T22:50:50.539 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/143 2024-04-25T22:50:50.604 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 143/143 2024-04-25T22:50:53.538 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-test-2:19.0.0-2445.gd2c45d97.el9.x86_64 130/143 2024-04-25T22:50:53.579 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 131/143 2024-04-25T22:50:53.621 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-nbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 132/143 2024-04-25T22:50:53.652 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 133/143 2024-04-25T22:50:53.679 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 134/143 2024-04-25T22:50:54.518 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcephfs-devel-2:19.0.0-2445.gd2c45d97.el9.x86_ 135/143 2024-04-25T22:50:54.604 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 136/143 2024-04-25T22:50:54.645 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 137/143 2024-04-25T22:50:54.727 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flex-2.6.4-9.el9.x86_64 138/143 2024-04-25T22:50:54.766 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : bison-3.7.4-5.el9.x86_64 139/143 2024-04-25T22:50:54.766 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 140/143 2024-04-25T22:50:54.842 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 140/143 2024-04-25T22:50:54.883 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 141/143 2024-04-25T22:50:54.883 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/143 2024-04-25T22:50:54.956 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/143 2024-04-25T22:50:55.031 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 143/143 2024-04-25T22:50:55.113 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-test-2:19.0.0-2445.gd2c45d97.el9.x86_64 130/143 2024-04-25T22:50:55.154 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 131/143 2024-04-25T22:50:55.196 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-nbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 132/143 2024-04-25T22:50:55.227 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 133/143 2024-04-25T22:50:55.254 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 134/143 2024-04-25T22:50:56.144 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 143/143 2024-04-25T22:50:56.145 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-2:19.0.0-2445.gd2c45d97.el9.x86_64 1/143 2024-04-25T22:50:56.145 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 2/143 2024-04-25T22:50:56.145 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 3/143 2024-04-25T22:50:56.145 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 4/143 2024-04-25T22:50:56.145 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2445.gd2c45 5/143 2024-04-25T22:50:56.145 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 6/143 2024-04-25T22:50:56.145 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 7/143 2024-04-25T22:50:56.145 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 8/143 2024-04-25T22:50:56.145 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 9/143 2024-04-25T22:50:56.145 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 10/143 2024-04-25T22:50:56.146 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 11/143 2024-04-25T22:50:56.146 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-test-2:19.0.0-2445.gd2c45d97.el9.x86_64 12/143 2024-04-25T22:50:56.146 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libcephfs-devel-2:19.0.0-2445.gd2c45d97.el9.x86_ 13/143 2024-04-25T22:50:56.146 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 14/143 2024-04-25T22:50:56.146 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 15/143 2024-04-25T22:50:56.146 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librados-devel-2:19.0.0-2445.gd2c45d97.el9.x86_6 16/143 2024-04-25T22:50:56.146 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86 17/143 2024-04-25T22:50:56.146 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 18/143 2024-04-25T22:50:56.146 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2445.gd2c45d97.el 19/143 2024-04-25T22:50:56.147 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-ceph-common-2:19.0.0-2445.gd2c45d97.el9. 20/143 2024-04-25T22:50:56.149 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cephfs-2:19.0.0-2445.gd2c45d97.el9.x86_6 21/143 2024-04-25T22:50:56.149 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rados-2:19.0.0-2445.gd2c45d97.el9.x86_64 22/143 2024-04-25T22:50:56.150 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 23/143 2024-04-25T22:50:56.150 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 24/143 2024-04-25T22:50:56.150 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : rbd-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 25/143 2024-04-25T22:50:56.150 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 26/143 2024-04-25T22:50:56.150 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : rbd-nbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 27/143 2024-04-25T22:50:56.150 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2445.gd2c45d97. 28/143 2024-04-25T22:50:56.150 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noa 29/143 2024-04-25T22:50:56.150 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.n 30/143 2024-04-25T22:50:56.150 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c 31/143 2024-04-25T22:50:56.150 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2445.gd2c45d97.el 32/143 2024-04-25T22:50:56.150 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 33/143 2024-04-25T22:50:56.151 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2445.gd2c45d97.e 34/143 2024-04-25T22:50:56.151 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 35/143 2024-04-25T22:50:56.151 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 36/143 2024-04-25T22:50:56.151 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 37/143 2024-04-25T22:50:56.151 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 38/143 2024-04-25T22:50:56.151 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 39/143 2024-04-25T22:50:56.151 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 40/143 2024-04-25T22:50:56.151 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 41/143 2024-04-25T22:50:56.151 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-ply-3.11-14.el9.noarch 42/143 2024-04-25T22:50:56.151 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 43/143 2024-04-25T22:50:56.151 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 44/143 2024-04-25T22:50:56.152 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 45/143 2024-04-25T22:50:56.152 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : automake-1.16.2-8.el9.noarch 46/143 2024-04-25T22:50:56.152 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : bison-3.7.4-5.el9.x86_64 47/143 2024-04-25T22:50:56.152 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 48/143 2024-04-25T22:50:56.152 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 49/143 2024-04-25T22:50:56.152 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flex-2.6.4-9.el9.x86_64 50/143 2024-04-25T22:50:56.152 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 51/143 2024-04-25T22:50:56.152 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 52/143 2024-04-25T22:50:56.152 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 53/143 2024-04-25T22:50:56.153 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 54/143 2024-04-25T22:50:56.153 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 55/143 2024-04-25T22:50:56.153 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 56/143 2024-04-25T22:50:56.153 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 57/143 2024-04-25T22:50:56.153 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 58/143 2024-04-25T22:50:56.153 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 59/143 2024-04-25T22:50:56.153 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 60/143 2024-04-25T22:50:56.153 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 61/143 2024-04-25T22:50:56.153 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : lua-5.4.4-4.el9.x86_64 62/143 2024-04-25T22:50:56.153 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 63/143 2024-04-25T22:50:56.153 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 64/143 2024-04-25T22:50:56.153 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 65/143 2024-04-25T22:50:56.154 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 66/143 2024-04-25T22:50:56.154 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 67/143 2024-04-25T22:50:56.154 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 68/143 2024-04-25T22:50:56.154 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 69/143 2024-04-25T22:50:56.154 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 70/143 2024-04-25T22:50:56.154 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 71/143 2024-04-25T22:50:56.154 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 72/143 2024-04-25T22:50:56.154 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 73/143 2024-04-25T22:50:56.154 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 74/143 2024-04-25T22:50:56.154 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 75/143 2024-04-25T22:50:56.154 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 76/143 2024-04-25T22:50:56.155 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 77/143 2024-04-25T22:50:56.155 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 78/143 2024-04-25T22:50:56.155 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 79/143 2024-04-25T22:50:56.155 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 80/143 2024-04-25T22:50:56.155 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 81/143 2024-04-25T22:50:56.155 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 82/143 2024-04-25T22:50:56.155 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/143 2024-04-25T22:50:56.155 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 84/143 2024-04-25T22:50:56.155 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 85/143 2024-04-25T22:50:56.155 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 86/143 2024-04-25T22:50:56.155 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 87/143 2024-04-25T22:50:56.155 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 88/143 2024-04-25T22:50:56.156 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 89/143 2024-04-25T22:50:56.156 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 90/143 2024-04-25T22:50:56.156 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 91/143 2024-04-25T22:50:56.156 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 92/143 2024-04-25T22:50:56.156 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 93/143 2024-04-25T22:50:56.156 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 94/143 2024-04-25T22:50:56.156 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 95/143 2024-04-25T22:50:56.156 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 96/143 2024-04-25T22:50:56.156 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 97/143 2024-04-25T22:50:56.156 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 98/143 2024-04-25T22:50:56.156 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 99/143 2024-04-25T22:50:56.156 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 100/143 2024-04-25T22:50:56.156 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 101/143 2024-04-25T22:50:56.157 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 102/143 2024-04-25T22:50:56.157 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 103/143 2024-04-25T22:50:56.157 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 104/143 2024-04-25T22:50:56.157 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 105/143 2024-04-25T22:50:56.157 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 106/143 2024-04-25T22:50:56.157 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 107/143 2024-04-25T22:50:56.157 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 108/143 2024-04-25T22:50:56.157 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 109/143 2024-04-25T22:50:56.157 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 110/143 2024-04-25T22:50:56.157 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 111/143 2024-04-25T22:50:56.158 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 112/143 2024-04-25T22:50:56.158 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 113/143 2024-04-25T22:50:56.158 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 114/143 2024-04-25T22:50:56.158 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 115/143 2024-04-25T22:50:56.158 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 116/143 2024-04-25T22:50:56.158 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 117/143 2024-04-25T22:50:56.158 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 118/143 2024-04-25T22:50:56.158 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 119/143 2024-04-25T22:50:56.158 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 120/143 2024-04-25T22:50:56.158 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 121/143 2024-04-25T22:50:56.158 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 122/143 2024-04-25T22:50:56.159 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 123/143 2024-04-25T22:50:56.159 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 124/143 2024-04-25T22:50:56.159 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 125/143 2024-04-25T22:50:56.159 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 126/143 2024-04-25T22:50:56.159 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 127/143 2024-04-25T22:50:56.159 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 128/143 2024-04-25T22:50:56.159 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 129/143 2024-04-25T22:50:56.159 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 130/143 2024-04-25T22:50:56.159 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 131/143 2024-04-25T22:50:56.159 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 132/143 2024-04-25T22:50:56.160 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 133/143 2024-04-25T22:50:56.160 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : re2-1:20211101-3.el9.x86_64 134/143 2024-04-25T22:50:56.160 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 135/143 2024-04-25T22:50:56.160 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 136/143 2024-04-25T22:50:56.160 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 137/143 2024-04-25T22:50:56.160 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 138/143 2024-04-25T22:50:56.160 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 139/143 2024-04-25T22:50:56.160 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 140/143 2024-04-25T22:50:56.160 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 141/143 2024-04-25T22:50:56.160 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 142/143 2024-04-25T22:50:56.175 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcephfs-devel-2:19.0.0-2445.gd2c45d97.el9.x86_ 135/143 2024-04-25T22:50:56.278 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 136/143 2024-04-25T22:50:56.321 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 137/143 2024-04-25T22:50:56.415 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flex-2.6.4-9.el9.x86_64 138/143 2024-04-25T22:50:56.449 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : bison-3.7.4-5.el9.x86_64 139/143 2024-04-25T22:50:56.449 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 140/143 2024-04-25T22:50:56.533 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 140/143 2024-04-25T22:50:56.566 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 141/143 2024-04-25T22:50:56.566 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/143 2024-04-25T22:50:56.652 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/143 2024-04-25T22:50:56.726 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 143/143 2024-04-25T22:50:57.133 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 99/143 2024-04-25T22:50:57.133 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /sys 2024-04-25T22:50:57.133 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /proc 2024-04-25T22:50:57.134 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /mnt 2024-04-25T22:50:57.134 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /var/tmp 2024-04-25T22:50:57.134 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /home 2024-04-25T22:50:57.134 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /root 2024-04-25T22:50:57.134 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /tmp 2024-04-25T22:50:57.134 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T22:50:57.301 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 100/143 2024-04-25T22:50:57.316 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 100/143 2024-04-25T22:50:57.316 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T22:50:57.316 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T22:50:57.316 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T22:50:58.111 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 143/143 2024-04-25T22:50:58.111 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-25T22:50:58.111 INFO:teuthology.orchestra.run.smithi110.stdout:Upgraded: 2024-04-25T22:50:58.111 INFO:teuthology.orchestra.run.smithi110.stdout: librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:50:58.111 INFO:teuthology.orchestra.run.smithi110.stdout: librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:50:58.111 INFO:teuthology.orchestra.run.smithi110.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-25T22:50:58.111 INFO:teuthology.orchestra.run.smithi110.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-25T22:50:58.112 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-04-25T22:50:58.112 INFO:teuthology.orchestra.run.smithi110.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T22:50:58.112 INFO:teuthology.orchestra.run.smithi110.stdout: automake-1.16.2-8.el9.noarch 2024-04-25T22:50:58.112 INFO:teuthology.orchestra.run.smithi110.stdout: bison-3.7.4-5.el9.x86_64 2024-04-25T22:50:58.112 INFO:teuthology.orchestra.run.smithi110.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T22:50:58.112 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:50:58.112 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:50:58.112 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:50:58.112 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:50:58.112 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-grafana-dashboards-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T22:50:58.112 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-immutable-object-cache-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:50:58.112 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:50:58.112 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:50:58.112 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T22:50:58.113 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T22:50:58.113 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T22:50:58.113 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-modules-core-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T22:50:58.113 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T22:50:58.113 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:50:58.113 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:50:58.113 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-prometheus-alerts-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T22:50:58.113 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:50:58.113 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:50:58.113 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-test-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:50:58.113 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T22:50:58.113 INFO:teuthology.orchestra.run.smithi110.stdout: cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T22:50:58.113 INFO:teuthology.orchestra.run.smithi110.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-25T22:50:58.114 INFO:teuthology.orchestra.run.smithi110.stdout: flex-2.6.4-9.el9.x86_64 2024-04-25T22:50:58.114 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T22:50:58.114 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T22:50:58.114 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T22:50:58.114 INFO:teuthology.orchestra.run.smithi110.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-25T22:50:58.114 INFO:teuthology.orchestra.run.smithi110.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T22:50:58.114 INFO:teuthology.orchestra.run.smithi110.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T22:50:58.114 INFO:teuthology.orchestra.run.smithi110.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-25T22:50:58.114 INFO:teuthology.orchestra.run.smithi110.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T22:50:58.114 INFO:teuthology.orchestra.run.smithi110.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T22:50:58.114 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs-devel-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:50:58.114 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:50:58.114 INFO:teuthology.orchestra.run.smithi110.stdout: libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:50:58.115 INFO:teuthology.orchestra.run.smithi110.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T22:50:58.115 INFO:teuthology.orchestra.run.smithi110.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T22:50:58.115 INFO:teuthology.orchestra.run.smithi110.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T22:50:58.115 INFO:teuthology.orchestra.run.smithi110.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T22:50:58.115 INFO:teuthology.orchestra.run.smithi110.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T22:50:58.115 INFO:teuthology.orchestra.run.smithi110.stdout: librados-devel-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:50:58.115 INFO:teuthology.orchestra.run.smithi110.stdout: libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:50:58.115 INFO:teuthology.orchestra.run.smithi110.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T22:50:58.115 INFO:teuthology.orchestra.run.smithi110.stdout: librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:50:58.115 INFO:teuthology.orchestra.run.smithi110.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-25T22:50:58.115 INFO:teuthology.orchestra.run.smithi110.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T22:50:58.115 INFO:teuthology.orchestra.run.smithi110.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-25T22:50:58.115 INFO:teuthology.orchestra.run.smithi110.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-25T22:50:58.116 INFO:teuthology.orchestra.run.smithi110.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T22:50:58.116 INFO:teuthology.orchestra.run.smithi110.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T22:50:58.116 INFO:teuthology.orchestra.run.smithi110.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T22:50:58.116 INFO:teuthology.orchestra.run.smithi110.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T22:50:58.116 INFO:teuthology.orchestra.run.smithi110.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T22:50:58.116 INFO:teuthology.orchestra.run.smithi110.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T22:50:58.116 INFO:teuthology.orchestra.run.smithi110.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-25T22:50:58.116 INFO:teuthology.orchestra.run.smithi110.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T22:50:58.116 INFO:teuthology.orchestra.run.smithi110.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T22:50:58.116 INFO:teuthology.orchestra.run.smithi110.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T22:50:58.116 INFO:teuthology.orchestra.run.smithi110.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T22:50:58.116 INFO:teuthology.orchestra.run.smithi110.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T22:50:58.116 INFO:teuthology.orchestra.run.smithi110.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T22:50:58.117 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T22:50:58.117 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-argparse-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:50:58.117 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:50:58.117 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cephfs-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:50:58.117 INFO:teuthology.orchestra.run.smithi110.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T22:50:58.117 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T22:50:58.117 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T22:50:58.117 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T22:50:58.117 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T22:50:58.117 INFO:teuthology.orchestra.run.smithi110.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T22:50:58.117 INFO:teuthology.orchestra.run.smithi110.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T22:50:58.117 INFO:teuthology.orchestra.run.smithi110.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T22:50:58.117 INFO:teuthology.orchestra.run.smithi110.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T22:50:58.117 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T22:50:58.118 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T22:50:58.118 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T22:50:58.118 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T22:50:58.118 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T22:50:58.118 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T22:50:58.118 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T22:50:58.118 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T22:50:58.118 INFO:teuthology.orchestra.run.smithi110.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T22:50:58.118 INFO:teuthology.orchestra.run.smithi110.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T22:50:58.118 INFO:teuthology.orchestra.run.smithi110.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T22:50:58.118 INFO:teuthology.orchestra.run.smithi110.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T22:50:58.118 INFO:teuthology.orchestra.run.smithi110.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T22:50:58.118 INFO:teuthology.orchestra.run.smithi110.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T22:50:58.119 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T22:50:58.119 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T22:50:58.119 INFO:teuthology.orchestra.run.smithi110.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T22:50:58.119 INFO:teuthology.orchestra.run.smithi110.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T22:50:58.119 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T22:50:58.119 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T22:50:58.119 INFO:teuthology.orchestra.run.smithi110.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T22:50:58.119 INFO:teuthology.orchestra.run.smithi110.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T22:50:58.119 INFO:teuthology.orchestra.run.smithi110.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T22:50:58.119 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T22:50:58.119 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T22:50:58.119 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T22:50:58.119 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T22:50:58.120 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T22:50:58.120 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rados-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:50:58.120 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:50:58.120 INFO:teuthology.orchestra.run.smithi110.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T22:50:58.120 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T22:50:58.120 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T22:50:58.120 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:50:58.120 INFO:teuthology.orchestra.run.smithi110.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T22:50:58.120 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T22:50:58.120 INFO:teuthology.orchestra.run.smithi110.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T22:50:58.120 INFO:teuthology.orchestra.run.smithi110.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T22:50:58.120 INFO:teuthology.orchestra.run.smithi110.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T22:50:58.120 INFO:teuthology.orchestra.run.smithi110.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T22:50:58.121 INFO:teuthology.orchestra.run.smithi110.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T22:50:58.121 INFO:teuthology.orchestra.run.smithi110.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T22:50:58.121 INFO:teuthology.orchestra.run.smithi110.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T22:50:58.121 INFO:teuthology.orchestra.run.smithi110.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T22:50:58.121 INFO:teuthology.orchestra.run.smithi110.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T22:50:58.121 INFO:teuthology.orchestra.run.smithi110.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T22:50:58.121 INFO:teuthology.orchestra.run.smithi110.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T22:50:58.121 INFO:teuthology.orchestra.run.smithi110.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T22:50:58.121 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:50:58.121 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:50:58.121 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-nbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:50:58.121 INFO:teuthology.orchestra.run.smithi110.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T22:50:58.121 INFO:teuthology.orchestra.run.smithi110.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T22:50:58.121 INFO:teuthology.orchestra.run.smithi110.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T22:50:58.122 INFO:teuthology.orchestra.run.smithi110.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-25T22:50:58.122 INFO:teuthology.orchestra.run.smithi110.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T22:50:58.122 INFO:teuthology.orchestra.run.smithi110.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-25T22:50:58.122 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-25T22:50:58.123 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-04-25T22:50:58.506 DEBUG:teuthology.parallel:result is None 2024-04-25T22:50:58.769 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 101/143 2024-04-25T22:50:58.794 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 101/143 2024-04-25T22:50:58.794 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T22:50:58.795 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T22:50:58.795 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T22:50:58.795 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T22:50:58.795 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T22:50:59.020 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 102/143 2024-04-25T22:50:59.042 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 102/143 2024-04-25T22:50:59.042 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T22:50:59.042 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T22:50:59.043 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T22:50:59.043 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T22:50:59.043 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T22:50:59.487 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 103/143 2024-04-25T22:50:59.509 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 103/143 2024-04-25T22:50:59.509 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T22:50:59.509 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T22:50:59.510 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T22:50:59.510 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T22:50:59.510 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T22:50:59.626 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : automake-1.16.2-8.el9.noarch 104/143 2024-04-25T22:50:59.674 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-ply-3.11-14.el9.noarch 105/143 2024-04-25T22:50:59.730 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 106/143 2024-04-25T22:50:59.912 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 107/143 2024-04-25T22:50:59.974 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 108/143 2024-04-25T22:51:00.049 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 109/143 2024-04-25T22:51:00.146 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 110/143 2024-04-25T22:51:00.285 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 111/143 2024-04-25T22:51:00.322 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 112/143 2024-04-25T22:51:00.354 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 113/143 2024-04-25T22:51:00.382 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : fuse-2.9.9-15.el9.x86_64 114/143 2024-04-25T22:51:00.492 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 143/143 2024-04-25T22:51:00.492 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-2:19.0.0-2445.gd2c45d97.el9.x86_64 1/143 2024-04-25T22:51:00.492 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 2/143 2024-04-25T22:51:00.492 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 3/143 2024-04-25T22:51:00.493 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 4/143 2024-04-25T22:51:00.493 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2445.gd2c45 5/143 2024-04-25T22:51:00.493 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 6/143 2024-04-25T22:51:00.493 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 7/143 2024-04-25T22:51:00.493 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 8/143 2024-04-25T22:51:00.493 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 9/143 2024-04-25T22:51:00.493 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 10/143 2024-04-25T22:51:00.493 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 11/143 2024-04-25T22:51:00.493 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-test-2:19.0.0-2445.gd2c45d97.el9.x86_64 12/143 2024-04-25T22:51:00.493 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcephfs-devel-2:19.0.0-2445.gd2c45d97.el9.x86_ 13/143 2024-04-25T22:51:00.493 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 14/143 2024-04-25T22:51:00.493 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 15/143 2024-04-25T22:51:00.493 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados-devel-2:19.0.0-2445.gd2c45d97.el9.x86_6 16/143 2024-04-25T22:51:00.493 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86 17/143 2024-04-25T22:51:00.494 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 18/143 2024-04-25T22:51:00.494 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2445.gd2c45d97.el 19/143 2024-04-25T22:51:00.494 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-ceph-common-2:19.0.0-2445.gd2c45d97.el9. 20/143 2024-04-25T22:51:00.494 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cephfs-2:19.0.0-2445.gd2c45d97.el9.x86_6 21/143 2024-04-25T22:51:00.494 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rados-2:19.0.0-2445.gd2c45d97.el9.x86_64 22/143 2024-04-25T22:51:00.494 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 23/143 2024-04-25T22:51:00.494 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 24/143 2024-04-25T22:51:00.494 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 25/143 2024-04-25T22:51:00.494 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 26/143 2024-04-25T22:51:00.494 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-nbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 27/143 2024-04-25T22:51:00.494 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2445.gd2c45d97. 28/143 2024-04-25T22:51:00.494 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noa 29/143 2024-04-25T22:51:00.505 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.n 30/143 2024-04-25T22:51:00.505 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c 31/143 2024-04-25T22:51:00.505 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2445.gd2c45d97.el 32/143 2024-04-25T22:51:00.505 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 33/143 2024-04-25T22:51:00.505 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2445.gd2c45d97.e 34/143 2024-04-25T22:51:00.506 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 35/143 2024-04-25T22:51:00.506 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 36/143 2024-04-25T22:51:00.506 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 37/143 2024-04-25T22:51:00.506 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 38/143 2024-04-25T22:51:00.506 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 39/143 2024-04-25T22:51:00.506 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 40/143 2024-04-25T22:51:00.506 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 41/143 2024-04-25T22:51:00.506 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-ply-3.11-14.el9.noarch 42/143 2024-04-25T22:51:00.506 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 43/143 2024-04-25T22:51:00.506 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 44/143 2024-04-25T22:51:00.506 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 45/143 2024-04-25T22:51:00.506 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : automake-1.16.2-8.el9.noarch 46/143 2024-04-25T22:51:00.506 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : bison-3.7.4-5.el9.x86_64 47/143 2024-04-25T22:51:00.507 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 48/143 2024-04-25T22:51:00.507 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 49/143 2024-04-25T22:51:00.507 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flex-2.6.4-9.el9.x86_64 50/143 2024-04-25T22:51:00.507 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 51/143 2024-04-25T22:51:00.507 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 52/143 2024-04-25T22:51:00.508 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 53/143 2024-04-25T22:51:00.508 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 54/143 2024-04-25T22:51:00.508 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 55/143 2024-04-25T22:51:00.508 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 56/143 2024-04-25T22:51:00.508 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 57/143 2024-04-25T22:51:00.509 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 58/143 2024-04-25T22:51:00.509 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 59/143 2024-04-25T22:51:00.509 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 60/143 2024-04-25T22:51:00.509 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 61/143 2024-04-25T22:51:00.509 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : lua-5.4.4-4.el9.x86_64 62/143 2024-04-25T22:51:00.509 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 63/143 2024-04-25T22:51:00.509 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 64/143 2024-04-25T22:51:00.509 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 65/143 2024-04-25T22:51:00.509 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 66/143 2024-04-25T22:51:00.509 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 67/143 2024-04-25T22:51:00.509 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 68/143 2024-04-25T22:51:00.509 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 69/143 2024-04-25T22:51:00.510 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 70/143 2024-04-25T22:51:00.510 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 71/143 2024-04-25T22:51:00.510 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 72/143 2024-04-25T22:51:00.511 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 73/143 2024-04-25T22:51:00.511 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 74/143 2024-04-25T22:51:00.511 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 75/143 2024-04-25T22:51:00.511 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 76/143 2024-04-25T22:51:00.511 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 77/143 2024-04-25T22:51:00.511 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 78/143 2024-04-25T22:51:00.511 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 79/143 2024-04-25T22:51:00.511 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 80/143 2024-04-25T22:51:00.511 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 81/143 2024-04-25T22:51:00.511 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 82/143 2024-04-25T22:51:00.511 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/143 2024-04-25T22:51:00.511 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 84/143 2024-04-25T22:51:00.512 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 85/143 2024-04-25T22:51:00.512 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 86/143 2024-04-25T22:51:00.512 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 87/143 2024-04-25T22:51:00.512 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 88/143 2024-04-25T22:51:00.512 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 89/143 2024-04-25T22:51:00.512 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 90/143 2024-04-25T22:51:00.512 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 91/143 2024-04-25T22:51:00.512 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 92/143 2024-04-25T22:51:00.512 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 93/143 2024-04-25T22:51:00.512 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 94/143 2024-04-25T22:51:00.512 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 95/143 2024-04-25T22:51:00.512 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 96/143 2024-04-25T22:51:00.512 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 97/143 2024-04-25T22:51:00.512 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 98/143 2024-04-25T22:51:00.513 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 99/143 2024-04-25T22:51:00.513 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 100/143 2024-04-25T22:51:00.513 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 101/143 2024-04-25T22:51:00.513 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 102/143 2024-04-25T22:51:00.513 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 103/143 2024-04-25T22:51:00.513 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 104/143 2024-04-25T22:51:00.513 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 105/143 2024-04-25T22:51:00.513 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 106/143 2024-04-25T22:51:00.513 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 107/143 2024-04-25T22:51:00.513 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 108/143 2024-04-25T22:51:00.513 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 109/143 2024-04-25T22:51:00.513 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 110/143 2024-04-25T22:51:00.514 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 111/143 2024-04-25T22:51:00.514 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 112/143 2024-04-25T22:51:00.515 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 113/143 2024-04-25T22:51:00.515 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 114/143 2024-04-25T22:51:00.515 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 115/143 2024-04-25T22:51:00.515 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 116/143 2024-04-25T22:51:00.515 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 117/143 2024-04-25T22:51:00.515 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 118/143 2024-04-25T22:51:00.515 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 119/143 2024-04-25T22:51:00.515 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 120/143 2024-04-25T22:51:00.515 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 121/143 2024-04-25T22:51:00.515 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 122/143 2024-04-25T22:51:00.515 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 123/143 2024-04-25T22:51:00.515 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 124/143 2024-04-25T22:51:00.516 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 125/143 2024-04-25T22:51:00.516 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 126/143 2024-04-25T22:51:00.516 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 127/143 2024-04-25T22:51:00.516 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 128/143 2024-04-25T22:51:00.516 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 129/143 2024-04-25T22:51:00.516 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 130/143 2024-04-25T22:51:00.516 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 131/143 2024-04-25T22:51:00.516 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 132/143 2024-04-25T22:51:00.516 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 133/143 2024-04-25T22:51:00.516 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : re2-1:20211101-3.el9.x86_64 134/143 2024-04-25T22:51:00.516 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 135/143 2024-04-25T22:51:00.516 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 136/143 2024-04-25T22:51:00.516 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 137/143 2024-04-25T22:51:00.516 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 138/143 2024-04-25T22:51:00.516 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 139/143 2024-04-25T22:51:00.517 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 140/143 2024-04-25T22:51:00.517 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 141/143 2024-04-25T22:51:00.517 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 142/143 2024-04-25T22:51:00.764 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 115/143 2024-04-25T22:51:00.789 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 115/143 2024-04-25T22:51:00.821 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2445.gd2c45d97.e 116/143 2024-04-25T22:51:00.882 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2445.gd2c45d97. 117/143 2024-04-25T22:51:00.912 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noa 118/143 2024-04-25T22:51:01.938 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noa 118/143 2024-04-25T22:51:01.973 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.n 119/143 2024-04-25T22:51:02.187 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 143/143 2024-04-25T22:51:02.187 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-2:19.0.0-2445.gd2c45d97.el9.x86_64 1/143 2024-04-25T22:51:02.187 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 2/143 2024-04-25T22:51:02.187 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 3/143 2024-04-25T22:51:02.187 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 4/143 2024-04-25T22:51:02.187 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2445.gd2c45 5/143 2024-04-25T22:51:02.187 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 6/143 2024-04-25T22:51:02.187 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 7/143 2024-04-25T22:51:02.187 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 8/143 2024-04-25T22:51:02.188 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 9/143 2024-04-25T22:51:02.188 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 10/143 2024-04-25T22:51:02.188 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 11/143 2024-04-25T22:51:02.188 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-test-2:19.0.0-2445.gd2c45d97.el9.x86_64 12/143 2024-04-25T22:51:02.188 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcephfs-devel-2:19.0.0-2445.gd2c45d97.el9.x86_ 13/143 2024-04-25T22:51:02.188 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 14/143 2024-04-25T22:51:02.188 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 15/143 2024-04-25T22:51:02.188 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados-devel-2:19.0.0-2445.gd2c45d97.el9.x86_6 16/143 2024-04-25T22:51:02.188 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86 17/143 2024-04-25T22:51:02.188 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 18/143 2024-04-25T22:51:02.188 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2445.gd2c45d97.el 19/143 2024-04-25T22:51:02.188 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-ceph-common-2:19.0.0-2445.gd2c45d97.el9. 20/143 2024-04-25T22:51:02.188 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cephfs-2:19.0.0-2445.gd2c45d97.el9.x86_6 21/143 2024-04-25T22:51:02.189 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rados-2:19.0.0-2445.gd2c45d97.el9.x86_64 22/143 2024-04-25T22:51:02.189 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 23/143 2024-04-25T22:51:02.189 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 24/143 2024-04-25T22:51:02.189 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 25/143 2024-04-25T22:51:02.189 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 26/143 2024-04-25T22:51:02.189 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-nbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 27/143 2024-04-25T22:51:02.189 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2445.gd2c45d97. 28/143 2024-04-25T22:51:02.189 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noa 29/143 2024-04-25T22:51:02.189 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.n 30/143 2024-04-25T22:51:02.189 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c 31/143 2024-04-25T22:51:02.189 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2445.gd2c45d97.el 32/143 2024-04-25T22:51:02.189 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 33/143 2024-04-25T22:51:02.189 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2445.gd2c45d97.e 34/143 2024-04-25T22:51:02.190 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 35/143 2024-04-25T22:51:02.190 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 36/143 2024-04-25T22:51:02.190 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 37/143 2024-04-25T22:51:02.190 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 38/143 2024-04-25T22:51:02.190 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 39/143 2024-04-25T22:51:02.190 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 40/143 2024-04-25T22:51:02.190 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 41/143 2024-04-25T22:51:02.190 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-ply-3.11-14.el9.noarch 42/143 2024-04-25T22:51:02.190 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 43/143 2024-04-25T22:51:02.190 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 44/143 2024-04-25T22:51:02.190 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 45/143 2024-04-25T22:51:02.190 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : automake-1.16.2-8.el9.noarch 46/143 2024-04-25T22:51:02.190 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : bison-3.7.4-5.el9.x86_64 47/143 2024-04-25T22:51:02.191 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 48/143 2024-04-25T22:51:02.191 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 49/143 2024-04-25T22:51:02.191 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flex-2.6.4-9.el9.x86_64 50/143 2024-04-25T22:51:02.191 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 51/143 2024-04-25T22:51:02.191 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 52/143 2024-04-25T22:51:02.191 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 53/143 2024-04-25T22:51:02.191 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 54/143 2024-04-25T22:51:02.191 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 55/143 2024-04-25T22:51:02.191 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 56/143 2024-04-25T22:51:02.191 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 57/143 2024-04-25T22:51:02.191 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 58/143 2024-04-25T22:51:02.191 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 59/143 2024-04-25T22:51:02.191 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 60/143 2024-04-25T22:51:02.191 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 61/143 2024-04-25T22:51:02.192 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : lua-5.4.4-4.el9.x86_64 62/143 2024-04-25T22:51:02.192 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 63/143 2024-04-25T22:51:02.192 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 64/143 2024-04-25T22:51:02.192 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 65/143 2024-04-25T22:51:02.192 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 66/143 2024-04-25T22:51:02.192 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 67/143 2024-04-25T22:51:02.192 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 68/143 2024-04-25T22:51:02.192 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 69/143 2024-04-25T22:51:02.192 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 70/143 2024-04-25T22:51:02.192 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 71/143 2024-04-25T22:51:02.192 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 72/143 2024-04-25T22:51:02.192 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 73/143 2024-04-25T22:51:02.192 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 74/143 2024-04-25T22:51:02.193 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 75/143 2024-04-25T22:51:02.193 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 76/143 2024-04-25T22:51:02.193 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 77/143 2024-04-25T22:51:02.193 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 78/143 2024-04-25T22:51:02.193 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 79/143 2024-04-25T22:51:02.193 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 80/143 2024-04-25T22:51:02.193 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 81/143 2024-04-25T22:51:02.193 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 82/143 2024-04-25T22:51:02.193 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/143 2024-04-25T22:51:02.193 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 84/143 2024-04-25T22:51:02.193 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 85/143 2024-04-25T22:51:02.193 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 86/143 2024-04-25T22:51:02.193 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 87/143 2024-04-25T22:51:02.194 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 88/143 2024-04-25T22:51:02.194 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 89/143 2024-04-25T22:51:02.194 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 90/143 2024-04-25T22:51:02.194 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 91/143 2024-04-25T22:51:02.194 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 92/143 2024-04-25T22:51:02.194 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 93/143 2024-04-25T22:51:02.194 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 94/143 2024-04-25T22:51:02.194 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 95/143 2024-04-25T22:51:02.194 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 96/143 2024-04-25T22:51:02.194 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 97/143 2024-04-25T22:51:02.194 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 98/143 2024-04-25T22:51:02.194 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 99/143 2024-04-25T22:51:02.194 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 100/143 2024-04-25T22:51:02.194 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 101/143 2024-04-25T22:51:02.195 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 102/143 2024-04-25T22:51:02.195 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 103/143 2024-04-25T22:51:02.195 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 104/143 2024-04-25T22:51:02.195 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 105/143 2024-04-25T22:51:02.195 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 106/143 2024-04-25T22:51:02.195 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 107/143 2024-04-25T22:51:02.195 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 108/143 2024-04-25T22:51:02.195 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 109/143 2024-04-25T22:51:02.195 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 110/143 2024-04-25T22:51:02.195 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 111/143 2024-04-25T22:51:02.195 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 112/143 2024-04-25T22:51:02.195 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 113/143 2024-04-25T22:51:02.195 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 114/143 2024-04-25T22:51:02.196 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 115/143 2024-04-25T22:51:02.196 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 116/143 2024-04-25T22:51:02.196 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 117/143 2024-04-25T22:51:02.196 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 118/143 2024-04-25T22:51:02.196 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 119/143 2024-04-25T22:51:02.196 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 120/143 2024-04-25T22:51:02.196 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 121/143 2024-04-25T22:51:02.196 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 122/143 2024-04-25T22:51:02.196 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 123/143 2024-04-25T22:51:02.196 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 124/143 2024-04-25T22:51:02.196 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 125/143 2024-04-25T22:51:02.196 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 126/143 2024-04-25T22:51:02.196 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 127/143 2024-04-25T22:51:02.196 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 128/143 2024-04-25T22:51:02.197 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 129/143 2024-04-25T22:51:02.197 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 130/143 2024-04-25T22:51:02.197 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 131/143 2024-04-25T22:51:02.197 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 132/143 2024-04-25T22:51:02.197 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 133/143 2024-04-25T22:51:02.197 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : re2-1:20211101-3.el9.x86_64 134/143 2024-04-25T22:51:02.197 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 135/143 2024-04-25T22:51:02.197 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 136/143 2024-04-25T22:51:02.197 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 137/143 2024-04-25T22:51:02.197 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 138/143 2024-04-25T22:51:02.197 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 139/143 2024-04-25T22:51:02.197 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 140/143 2024-04-25T22:51:02.197 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 141/143 2024-04-25T22:51:02.197 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 142/143 2024-04-25T22:51:02.385 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 143/143 2024-04-25T22:51:02.385 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-25T22:51:02.386 INFO:teuthology.orchestra.run.smithi164.stdout:Upgraded: 2024-04-25T22:51:02.386 INFO:teuthology.orchestra.run.smithi164.stdout: librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:02.386 INFO:teuthology.orchestra.run.smithi164.stdout: librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:02.386 INFO:teuthology.orchestra.run.smithi164.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-25T22:51:02.386 INFO:teuthology.orchestra.run.smithi164.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-25T22:51:02.386 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-25T22:51:02.386 INFO:teuthology.orchestra.run.smithi164.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T22:51:02.386 INFO:teuthology.orchestra.run.smithi164.stdout: automake-1.16.2-8.el9.noarch 2024-04-25T22:51:02.386 INFO:teuthology.orchestra.run.smithi164.stdout: bison-3.7.4-5.el9.x86_64 2024-04-25T22:51:02.386 INFO:teuthology.orchestra.run.smithi164.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T22:51:02.386 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:02.386 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:02.386 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:02.387 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:02.387 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-grafana-dashboards-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T22:51:02.387 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-immutable-object-cache-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:02.387 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:02.387 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:02.387 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T22:51:02.387 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T22:51:02.387 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T22:51:02.387 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-modules-core-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T22:51:02.387 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T22:51:02.387 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:02.387 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:02.387 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-prometheus-alerts-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T22:51:02.388 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:02.388 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:02.388 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-test-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:02.388 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T22:51:02.388 INFO:teuthology.orchestra.run.smithi164.stdout: cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T22:51:02.388 INFO:teuthology.orchestra.run.smithi164.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-25T22:51:02.388 INFO:teuthology.orchestra.run.smithi164.stdout: flex-2.6.4-9.el9.x86_64 2024-04-25T22:51:02.388 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T22:51:02.388 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T22:51:02.388 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T22:51:02.388 INFO:teuthology.orchestra.run.smithi164.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-25T22:51:02.388 INFO:teuthology.orchestra.run.smithi164.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T22:51:02.388 INFO:teuthology.orchestra.run.smithi164.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T22:51:02.389 INFO:teuthology.orchestra.run.smithi164.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-25T22:51:02.389 INFO:teuthology.orchestra.run.smithi164.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T22:51:02.389 INFO:teuthology.orchestra.run.smithi164.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T22:51:02.389 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs-devel-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:02.389 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:02.389 INFO:teuthology.orchestra.run.smithi164.stdout: libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:02.389 INFO:teuthology.orchestra.run.smithi164.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T22:51:02.389 INFO:teuthology.orchestra.run.smithi164.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T22:51:02.389 INFO:teuthology.orchestra.run.smithi164.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T22:51:02.389 INFO:teuthology.orchestra.run.smithi164.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T22:51:02.389 INFO:teuthology.orchestra.run.smithi164.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T22:51:02.389 INFO:teuthology.orchestra.run.smithi164.stdout: librados-devel-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:02.389 INFO:teuthology.orchestra.run.smithi164.stdout: libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:02.389 INFO:teuthology.orchestra.run.smithi164.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T22:51:02.389 INFO:teuthology.orchestra.run.smithi164.stdout: librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:02.390 INFO:teuthology.orchestra.run.smithi164.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-25T22:51:02.390 INFO:teuthology.orchestra.run.smithi164.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T22:51:02.390 INFO:teuthology.orchestra.run.smithi164.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-25T22:51:02.390 INFO:teuthology.orchestra.run.smithi164.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-25T22:51:02.390 INFO:teuthology.orchestra.run.smithi164.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T22:51:02.390 INFO:teuthology.orchestra.run.smithi164.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T22:51:02.390 INFO:teuthology.orchestra.run.smithi164.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T22:51:02.390 INFO:teuthology.orchestra.run.smithi164.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T22:51:02.390 INFO:teuthology.orchestra.run.smithi164.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T22:51:02.390 INFO:teuthology.orchestra.run.smithi164.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T22:51:02.390 INFO:teuthology.orchestra.run.smithi164.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-25T22:51:02.390 INFO:teuthology.orchestra.run.smithi164.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T22:51:02.390 INFO:teuthology.orchestra.run.smithi164.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T22:51:02.391 INFO:teuthology.orchestra.run.smithi164.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T22:51:02.391 INFO:teuthology.orchestra.run.smithi164.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T22:51:02.391 INFO:teuthology.orchestra.run.smithi164.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T22:51:02.391 INFO:teuthology.orchestra.run.smithi164.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T22:51:02.391 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T22:51:02.391 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-argparse-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:02.391 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:02.391 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cephfs-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:02.391 INFO:teuthology.orchestra.run.smithi164.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T22:51:02.391 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T22:51:02.391 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T22:51:02.391 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T22:51:02.391 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T22:51:02.391 INFO:teuthology.orchestra.run.smithi164.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T22:51:02.392 INFO:teuthology.orchestra.run.smithi164.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T22:51:02.392 INFO:teuthology.orchestra.run.smithi164.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T22:51:02.392 INFO:teuthology.orchestra.run.smithi164.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T22:51:02.392 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T22:51:02.392 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T22:51:02.392 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T22:51:02.392 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T22:51:02.392 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T22:51:02.392 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T22:51:02.392 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T22:51:02.392 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T22:51:02.392 INFO:teuthology.orchestra.run.smithi164.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T22:51:02.392 INFO:teuthology.orchestra.run.smithi164.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T22:51:02.392 INFO:teuthology.orchestra.run.smithi164.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T22:51:02.393 INFO:teuthology.orchestra.run.smithi164.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T22:51:02.393 INFO:teuthology.orchestra.run.smithi164.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T22:51:02.393 INFO:teuthology.orchestra.run.smithi164.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T22:51:02.393 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T22:51:02.393 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T22:51:02.393 INFO:teuthology.orchestra.run.smithi164.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T22:51:02.393 INFO:teuthology.orchestra.run.smithi164.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T22:51:02.393 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T22:51:02.393 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T22:51:02.393 INFO:teuthology.orchestra.run.smithi164.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T22:51:02.393 INFO:teuthology.orchestra.run.smithi164.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T22:51:02.393 INFO:teuthology.orchestra.run.smithi164.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T22:51:02.393 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T22:51:02.393 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T22:51:02.394 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T22:51:02.394 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T22:51:02.394 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T22:51:02.394 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rados-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:02.394 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:02.394 INFO:teuthology.orchestra.run.smithi164.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T22:51:02.394 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T22:51:02.394 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T22:51:02.394 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:02.394 INFO:teuthology.orchestra.run.smithi164.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T22:51:02.394 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T22:51:02.394 INFO:teuthology.orchestra.run.smithi164.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T22:51:02.394 INFO:teuthology.orchestra.run.smithi164.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T22:51:02.395 INFO:teuthology.orchestra.run.smithi164.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T22:51:02.395 INFO:teuthology.orchestra.run.smithi164.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T22:51:02.395 INFO:teuthology.orchestra.run.smithi164.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T22:51:02.395 INFO:teuthology.orchestra.run.smithi164.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T22:51:02.395 INFO:teuthology.orchestra.run.smithi164.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T22:51:02.395 INFO:teuthology.orchestra.run.smithi164.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T22:51:02.395 INFO:teuthology.orchestra.run.smithi164.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T22:51:02.395 INFO:teuthology.orchestra.run.smithi164.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T22:51:02.395 INFO:teuthology.orchestra.run.smithi164.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T22:51:02.395 INFO:teuthology.orchestra.run.smithi164.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T22:51:02.395 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:02.395 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:02.395 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-nbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:02.395 INFO:teuthology.orchestra.run.smithi164.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T22:51:02.396 INFO:teuthology.orchestra.run.smithi164.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T22:51:02.396 INFO:teuthology.orchestra.run.smithi164.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T22:51:02.396 INFO:teuthology.orchestra.run.smithi164.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-25T22:51:02.396 INFO:teuthology.orchestra.run.smithi164.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T22:51:02.396 INFO:teuthology.orchestra.run.smithi164.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-25T22:51:02.396 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-25T22:51:02.396 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-25T22:51:02.788 DEBUG:teuthology.parallel:result is None 2024-04-25T22:51:02.933 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.n 119/143 2024-04-25T22:51:02.956 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c 120/143 2024-04-25T22:51:03.057 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c 120/143 2024-04-25T22:51:03.219 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2445.gd2c45d97.el 121/143 2024-04-25T22:51:03.251 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 122/143 2024-04-25T22:51:03.273 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 122/143 2024-04-25T22:51:03.273 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T22:51:03.273 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T22:51:03.274 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T22:51:03.274 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T22:51:03.274 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T22:51:03.318 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 123/143 2024-04-25T22:51:03.329 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 123/143 2024-04-25T22:51:03.426 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-2:19.0.0-2445.gd2c45d97.el9.x86_64 124/143 2024-04-25T22:51:03.482 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 125/143 2024-04-25T22:51:04.152 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 143/143 2024-04-25T22:51:04.152 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:51:04.152 INFO:teuthology.orchestra.run.smithi052.stdout:Upgraded: 2024-04-25T22:51:04.152 INFO:teuthology.orchestra.run.smithi052.stdout: librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:04.152 INFO:teuthology.orchestra.run.smithi052.stdout: librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:04.152 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-25T22:51:04.152 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-25T22:51:04.152 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-04-25T22:51:04.152 INFO:teuthology.orchestra.run.smithi052.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T22:51:04.152 INFO:teuthology.orchestra.run.smithi052.stdout: automake-1.16.2-8.el9.noarch 2024-04-25T22:51:04.152 INFO:teuthology.orchestra.run.smithi052.stdout: bison-3.7.4-5.el9.x86_64 2024-04-25T22:51:04.153 INFO:teuthology.orchestra.run.smithi052.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T22:51:04.153 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:04.153 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:04.153 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:04.153 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:04.153 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-grafana-dashboards-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T22:51:04.153 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-immutable-object-cache-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:04.153 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:04.153 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:04.153 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T22:51:04.153 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T22:51:04.153 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T22:51:04.153 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-modules-core-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T22:51:04.153 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T22:51:04.153 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:04.154 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:04.154 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-prometheus-alerts-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T22:51:04.154 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:04.154 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:04.154 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-test-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:04.154 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T22:51:04.154 INFO:teuthology.orchestra.run.smithi052.stdout: cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T22:51:04.154 INFO:teuthology.orchestra.run.smithi052.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-25T22:51:04.154 INFO:teuthology.orchestra.run.smithi052.stdout: flex-2.6.4-9.el9.x86_64 2024-04-25T22:51:04.154 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T22:51:04.154 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T22:51:04.154 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T22:51:04.154 INFO:teuthology.orchestra.run.smithi052.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-25T22:51:04.154 INFO:teuthology.orchestra.run.smithi052.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T22:51:04.155 INFO:teuthology.orchestra.run.smithi052.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T22:51:04.155 INFO:teuthology.orchestra.run.smithi052.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-25T22:51:04.155 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T22:51:04.155 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T22:51:04.155 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs-devel-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:04.155 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:04.155 INFO:teuthology.orchestra.run.smithi052.stdout: libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:04.155 INFO:teuthology.orchestra.run.smithi052.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T22:51:04.155 INFO:teuthology.orchestra.run.smithi052.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T22:51:04.155 INFO:teuthology.orchestra.run.smithi052.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T22:51:04.155 INFO:teuthology.orchestra.run.smithi052.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T22:51:04.155 INFO:teuthology.orchestra.run.smithi052.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T22:51:04.155 INFO:teuthology.orchestra.run.smithi052.stdout: librados-devel-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:04.155 INFO:teuthology.orchestra.run.smithi052.stdout: libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:04.155 INFO:teuthology.orchestra.run.smithi052.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T22:51:04.156 INFO:teuthology.orchestra.run.smithi052.stdout: librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:04.156 INFO:teuthology.orchestra.run.smithi052.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-25T22:51:04.156 INFO:teuthology.orchestra.run.smithi052.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T22:51:04.156 INFO:teuthology.orchestra.run.smithi052.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-25T22:51:04.156 INFO:teuthology.orchestra.run.smithi052.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-25T22:51:04.156 INFO:teuthology.orchestra.run.smithi052.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T22:51:04.156 INFO:teuthology.orchestra.run.smithi052.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T22:51:04.156 INFO:teuthology.orchestra.run.smithi052.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T22:51:04.156 INFO:teuthology.orchestra.run.smithi052.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T22:51:04.156 INFO:teuthology.orchestra.run.smithi052.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T22:51:04.156 INFO:teuthology.orchestra.run.smithi052.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T22:51:04.156 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-25T22:51:04.157 INFO:teuthology.orchestra.run.smithi052.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T22:51:04.157 INFO:teuthology.orchestra.run.smithi052.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T22:51:04.157 INFO:teuthology.orchestra.run.smithi052.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T22:51:04.157 INFO:teuthology.orchestra.run.smithi052.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T22:51:04.157 INFO:teuthology.orchestra.run.smithi052.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T22:51:04.157 INFO:teuthology.orchestra.run.smithi052.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T22:51:04.157 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T22:51:04.157 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-argparse-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:04.157 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:04.157 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cephfs-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:04.157 INFO:teuthology.orchestra.run.smithi052.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T22:51:04.157 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T22:51:04.157 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T22:51:04.158 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T22:51:04.158 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T22:51:04.158 INFO:teuthology.orchestra.run.smithi052.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T22:51:04.158 INFO:teuthology.orchestra.run.smithi052.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T22:51:04.158 INFO:teuthology.orchestra.run.smithi052.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T22:51:04.158 INFO:teuthology.orchestra.run.smithi052.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T22:51:04.158 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T22:51:04.158 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T22:51:04.158 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T22:51:04.158 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T22:51:04.158 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T22:51:04.158 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T22:51:04.159 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T22:51:04.159 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T22:51:04.159 INFO:teuthology.orchestra.run.smithi052.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T22:51:04.159 INFO:teuthology.orchestra.run.smithi052.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T22:51:04.159 INFO:teuthology.orchestra.run.smithi052.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T22:51:04.159 INFO:teuthology.orchestra.run.smithi052.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T22:51:04.159 INFO:teuthology.orchestra.run.smithi052.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T22:51:04.159 INFO:teuthology.orchestra.run.smithi052.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T22:51:04.159 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T22:51:04.159 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T22:51:04.159 INFO:teuthology.orchestra.run.smithi052.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T22:51:04.159 INFO:teuthology.orchestra.run.smithi052.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T22:51:04.159 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T22:51:04.160 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T22:51:04.160 INFO:teuthology.orchestra.run.smithi052.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T22:51:04.160 INFO:teuthology.orchestra.run.smithi052.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T22:51:04.160 INFO:teuthology.orchestra.run.smithi052.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T22:51:04.160 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T22:51:04.160 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T22:51:04.160 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T22:51:04.160 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T22:51:04.160 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T22:51:04.160 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rados-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:04.160 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:04.161 INFO:teuthology.orchestra.run.smithi052.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T22:51:04.161 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T22:51:04.161 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T22:51:04.161 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:04.161 INFO:teuthology.orchestra.run.smithi052.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T22:51:04.161 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T22:51:04.161 INFO:teuthology.orchestra.run.smithi052.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T22:51:04.161 INFO:teuthology.orchestra.run.smithi052.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T22:51:04.161 INFO:teuthology.orchestra.run.smithi052.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T22:51:04.161 INFO:teuthology.orchestra.run.smithi052.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T22:51:04.161 INFO:teuthology.orchestra.run.smithi052.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T22:51:04.161 INFO:teuthology.orchestra.run.smithi052.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T22:51:04.161 INFO:teuthology.orchestra.run.smithi052.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T22:51:04.161 INFO:teuthology.orchestra.run.smithi052.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T22:51:04.161 INFO:teuthology.orchestra.run.smithi052.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T22:51:04.162 INFO:teuthology.orchestra.run.smithi052.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T22:51:04.162 INFO:teuthology.orchestra.run.smithi052.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T22:51:04.162 INFO:teuthology.orchestra.run.smithi052.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T22:51:04.162 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:04.162 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:04.162 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-nbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:04.162 INFO:teuthology.orchestra.run.smithi052.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T22:51:04.162 INFO:teuthology.orchestra.run.smithi052.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T22:51:04.162 INFO:teuthology.orchestra.run.smithi052.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T22:51:04.163 INFO:teuthology.orchestra.run.smithi052.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-25T22:51:04.163 INFO:teuthology.orchestra.run.smithi052.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T22:51:04.163 INFO:teuthology.orchestra.run.smithi052.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-25T22:51:04.163 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:51:04.163 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-04-25T22:51:04.381 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libtool-2.4.6-45.el9.x86_64 126/143 2024-04-25T22:51:04.412 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 127/143 2024-04-25T22:51:04.434 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 127/143 2024-04-25T22:51:04.434 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T22:51:04.434 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T22:51:04.434 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T22:51:04.434 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T22:51:04.434 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T22:51:04.480 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2445.gd2c45 128/143 2024-04-25T22:51:04.501 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2445.gd2c45 128/143 2024-04-25T22:51:04.501 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T22:51:04.501 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T22:51:04.501 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T22:51:04.511 DEBUG:teuthology.parallel:result is None 2024-04-25T22:51:04.805 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 129/143 2024-04-25T22:51:04.827 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 129/143 2024-04-25T22:51:04.828 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T22:51:04.828 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T22:51:04.828 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T22:51:04.828 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T22:51:04.828 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T22:51:09.388 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-test-2:19.0.0-2445.gd2c45d97.el9.x86_64 130/143 2024-04-25T22:51:09.426 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : rbd-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 131/143 2024-04-25T22:51:09.467 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : rbd-nbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 132/143 2024-04-25T22:51:09.498 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 133/143 2024-04-25T22:51:09.525 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 134/143 2024-04-25T22:51:10.354 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libcephfs-devel-2:19.0.0-2445.gd2c45d97.el9.x86_ 135/143 2024-04-25T22:51:10.445 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 136/143 2024-04-25T22:51:10.486 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 137/143 2024-04-25T22:51:10.567 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : flex-2.6.4-9.el9.x86_64 138/143 2024-04-25T22:51:10.601 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : bison-3.7.4-5.el9.x86_64 139/143 2024-04-25T22:51:10.601 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 140/143 2024-04-25T22:51:10.676 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 140/143 2024-04-25T22:51:10.710 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 141/143 2024-04-25T22:51:10.710 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/143 2024-04-25T22:51:10.811 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/143 2024-04-25T22:51:10.875 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 143/143 2024-04-25T22:51:16.702 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 143/143 2024-04-25T22:51:16.702 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-2:19.0.0-2445.gd2c45d97.el9.x86_64 1/143 2024-04-25T22:51:16.703 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 2/143 2024-04-25T22:51:16.703 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 3/143 2024-04-25T22:51:16.703 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 4/143 2024-04-25T22:51:16.703 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2445.gd2c45 5/143 2024-04-25T22:51:16.703 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 6/143 2024-04-25T22:51:16.703 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 7/143 2024-04-25T22:51:16.703 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 8/143 2024-04-25T22:51:16.703 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 9/143 2024-04-25T22:51:16.703 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 10/143 2024-04-25T22:51:16.703 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 11/143 2024-04-25T22:51:16.703 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-test-2:19.0.0-2445.gd2c45d97.el9.x86_64 12/143 2024-04-25T22:51:16.703 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libcephfs-devel-2:19.0.0-2445.gd2c45d97.el9.x86_ 13/143 2024-04-25T22:51:16.704 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 14/143 2024-04-25T22:51:16.704 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 15/143 2024-04-25T22:51:16.704 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librados-devel-2:19.0.0-2445.gd2c45d97.el9.x86_6 16/143 2024-04-25T22:51:16.704 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86 17/143 2024-04-25T22:51:16.704 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 18/143 2024-04-25T22:51:16.704 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2445.gd2c45d97.el 19/143 2024-04-25T22:51:16.704 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-ceph-common-2:19.0.0-2445.gd2c45d97.el9. 20/143 2024-04-25T22:51:16.704 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cephfs-2:19.0.0-2445.gd2c45d97.el9.x86_6 21/143 2024-04-25T22:51:16.704 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rados-2:19.0.0-2445.gd2c45d97.el9.x86_64 22/143 2024-04-25T22:51:16.704 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 23/143 2024-04-25T22:51:16.704 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 24/143 2024-04-25T22:51:16.705 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : rbd-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 25/143 2024-04-25T22:51:16.705 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 26/143 2024-04-25T22:51:16.705 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : rbd-nbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 27/143 2024-04-25T22:51:16.705 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2445.gd2c45d97. 28/143 2024-04-25T22:51:16.705 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noa 29/143 2024-04-25T22:51:16.705 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.n 30/143 2024-04-25T22:51:16.705 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c 31/143 2024-04-25T22:51:16.705 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2445.gd2c45d97.el 32/143 2024-04-25T22:51:16.705 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 33/143 2024-04-25T22:51:16.705 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2445.gd2c45d97.e 34/143 2024-04-25T22:51:16.705 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 35/143 2024-04-25T22:51:16.706 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 36/143 2024-04-25T22:51:16.706 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 37/143 2024-04-25T22:51:16.706 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 38/143 2024-04-25T22:51:16.706 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 39/143 2024-04-25T22:51:16.706 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 40/143 2024-04-25T22:51:16.706 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 41/143 2024-04-25T22:51:16.706 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-ply-3.11-14.el9.noarch 42/143 2024-04-25T22:51:16.706 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 43/143 2024-04-25T22:51:16.706 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 44/143 2024-04-25T22:51:16.706 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 45/143 2024-04-25T22:51:16.706 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : automake-1.16.2-8.el9.noarch 46/143 2024-04-25T22:51:16.707 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : bison-3.7.4-5.el9.x86_64 47/143 2024-04-25T22:51:16.707 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 48/143 2024-04-25T22:51:16.707 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 49/143 2024-04-25T22:51:16.707 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : flex-2.6.4-9.el9.x86_64 50/143 2024-04-25T22:51:16.707 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 51/143 2024-04-25T22:51:16.707 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 52/143 2024-04-25T22:51:16.707 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 53/143 2024-04-25T22:51:16.707 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 54/143 2024-04-25T22:51:16.707 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 55/143 2024-04-25T22:51:16.707 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 56/143 2024-04-25T22:51:16.707 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 57/143 2024-04-25T22:51:16.707 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 58/143 2024-04-25T22:51:16.708 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 59/143 2024-04-25T22:51:16.708 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 60/143 2024-04-25T22:51:16.708 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 61/143 2024-04-25T22:51:16.708 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : lua-5.4.4-4.el9.x86_64 62/143 2024-04-25T22:51:16.708 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 63/143 2024-04-25T22:51:16.708 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 64/143 2024-04-25T22:51:16.708 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 65/143 2024-04-25T22:51:16.708 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 66/143 2024-04-25T22:51:16.708 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 67/143 2024-04-25T22:51:16.708 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 68/143 2024-04-25T22:51:16.708 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 69/143 2024-04-25T22:51:16.709 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 70/143 2024-04-25T22:51:16.709 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 71/143 2024-04-25T22:51:16.709 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 72/143 2024-04-25T22:51:16.709 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 73/143 2024-04-25T22:51:16.709 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 74/143 2024-04-25T22:51:16.709 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 75/143 2024-04-25T22:51:16.709 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 76/143 2024-04-25T22:51:16.709 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 77/143 2024-04-25T22:51:16.709 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 78/143 2024-04-25T22:51:16.709 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 79/143 2024-04-25T22:51:16.709 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 80/143 2024-04-25T22:51:16.709 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 81/143 2024-04-25T22:51:16.710 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 82/143 2024-04-25T22:51:16.710 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/143 2024-04-25T22:51:16.710 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 84/143 2024-04-25T22:51:16.710 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 85/143 2024-04-25T22:51:16.710 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 86/143 2024-04-25T22:51:16.710 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 87/143 2024-04-25T22:51:16.710 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 88/143 2024-04-25T22:51:16.710 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 89/143 2024-04-25T22:51:16.710 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 90/143 2024-04-25T22:51:16.710 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 91/143 2024-04-25T22:51:16.711 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 92/143 2024-04-25T22:51:16.711 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 93/143 2024-04-25T22:51:16.711 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 94/143 2024-04-25T22:51:16.711 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 95/143 2024-04-25T22:51:16.711 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 96/143 2024-04-25T22:51:16.711 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 97/143 2024-04-25T22:51:16.711 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 98/143 2024-04-25T22:51:16.711 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 99/143 2024-04-25T22:51:16.711 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 100/143 2024-04-25T22:51:16.711 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 101/143 2024-04-25T22:51:16.712 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 102/143 2024-04-25T22:51:16.712 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 103/143 2024-04-25T22:51:16.712 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 104/143 2024-04-25T22:51:16.712 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 105/143 2024-04-25T22:51:16.712 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 106/143 2024-04-25T22:51:16.712 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 107/143 2024-04-25T22:51:16.712 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 108/143 2024-04-25T22:51:16.712 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 109/143 2024-04-25T22:51:16.712 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 110/143 2024-04-25T22:51:16.712 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 111/143 2024-04-25T22:51:16.712 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 112/143 2024-04-25T22:51:16.713 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 113/143 2024-04-25T22:51:16.713 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 114/143 2024-04-25T22:51:16.713 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 115/143 2024-04-25T22:51:16.713 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 116/143 2024-04-25T22:51:16.713 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 117/143 2024-04-25T22:51:16.713 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 118/143 2024-04-25T22:51:16.713 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 119/143 2024-04-25T22:51:16.713 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 120/143 2024-04-25T22:51:16.713 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 121/143 2024-04-25T22:51:16.713 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 122/143 2024-04-25T22:51:16.713 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 123/143 2024-04-25T22:51:16.714 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 124/143 2024-04-25T22:51:16.714 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 125/143 2024-04-25T22:51:16.714 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 126/143 2024-04-25T22:51:16.714 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 127/143 2024-04-25T22:51:16.714 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 128/143 2024-04-25T22:51:16.714 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 129/143 2024-04-25T22:51:16.714 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 130/143 2024-04-25T22:51:16.714 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 131/143 2024-04-25T22:51:16.714 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 132/143 2024-04-25T22:51:16.714 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 133/143 2024-04-25T22:51:16.714 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : re2-1:20211101-3.el9.x86_64 134/143 2024-04-25T22:51:16.714 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 135/143 2024-04-25T22:51:16.715 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 136/143 2024-04-25T22:51:16.715 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 137/143 2024-04-25T22:51:16.715 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 138/143 2024-04-25T22:51:16.715 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 139/143 2024-04-25T22:51:16.715 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 140/143 2024-04-25T22:51:16.715 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 141/143 2024-04-25T22:51:16.715 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 142/143 2024-04-25T22:51:18.693 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 143/143 2024-04-25T22:51:18.693 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T22:51:18.693 INFO:teuthology.orchestra.run.smithi191.stdout:Upgraded: 2024-04-25T22:51:18.693 INFO:teuthology.orchestra.run.smithi191.stdout: librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:18.694 INFO:teuthology.orchestra.run.smithi191.stdout: librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:18.694 INFO:teuthology.orchestra.run.smithi191.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-25T22:51:18.694 INFO:teuthology.orchestra.run.smithi191.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-25T22:51:18.694 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2024-04-25T22:51:18.694 INFO:teuthology.orchestra.run.smithi191.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T22:51:18.694 INFO:teuthology.orchestra.run.smithi191.stdout: automake-1.16.2-8.el9.noarch 2024-04-25T22:51:18.694 INFO:teuthology.orchestra.run.smithi191.stdout: bison-3.7.4-5.el9.x86_64 2024-04-25T22:51:18.694 INFO:teuthology.orchestra.run.smithi191.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T22:51:18.694 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:18.694 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:18.694 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:18.694 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:18.695 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-grafana-dashboards-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T22:51:18.695 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-immutable-object-cache-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:18.695 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:18.695 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:18.695 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T22:51:18.695 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T22:51:18.695 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T22:51:18.695 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-modules-core-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T22:51:18.695 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T22:51:18.695 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:18.695 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:18.695 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-prometheus-alerts-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T22:51:18.695 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:18.695 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:18.696 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-test-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:18.696 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T22:51:18.696 INFO:teuthology.orchestra.run.smithi191.stdout: cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T22:51:18.696 INFO:teuthology.orchestra.run.smithi191.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-25T22:51:18.696 INFO:teuthology.orchestra.run.smithi191.stdout: flex-2.6.4-9.el9.x86_64 2024-04-25T22:51:18.696 INFO:teuthology.orchestra.run.smithi191.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T22:51:18.696 INFO:teuthology.orchestra.run.smithi191.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T22:51:18.696 INFO:teuthology.orchestra.run.smithi191.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T22:51:18.696 INFO:teuthology.orchestra.run.smithi191.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-25T22:51:18.696 INFO:teuthology.orchestra.run.smithi191.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T22:51:18.696 INFO:teuthology.orchestra.run.smithi191.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T22:51:18.696 INFO:teuthology.orchestra.run.smithi191.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-25T22:51:18.696 INFO:teuthology.orchestra.run.smithi191.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T22:51:18.697 INFO:teuthology.orchestra.run.smithi191.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T22:51:18.697 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs-devel-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:18.697 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:18.697 INFO:teuthology.orchestra.run.smithi191.stdout: libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:18.697 INFO:teuthology.orchestra.run.smithi191.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T22:51:18.697 INFO:teuthology.orchestra.run.smithi191.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T22:51:18.697 INFO:teuthology.orchestra.run.smithi191.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T22:51:18.697 INFO:teuthology.orchestra.run.smithi191.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T22:51:18.697 INFO:teuthology.orchestra.run.smithi191.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T22:51:18.697 INFO:teuthology.orchestra.run.smithi191.stdout: librados-devel-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:18.697 INFO:teuthology.orchestra.run.smithi191.stdout: libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:18.697 INFO:teuthology.orchestra.run.smithi191.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T22:51:18.697 INFO:teuthology.orchestra.run.smithi191.stdout: librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:18.698 INFO:teuthology.orchestra.run.smithi191.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-25T22:51:18.698 INFO:teuthology.orchestra.run.smithi191.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T22:51:18.698 INFO:teuthology.orchestra.run.smithi191.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-25T22:51:18.698 INFO:teuthology.orchestra.run.smithi191.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-25T22:51:18.698 INFO:teuthology.orchestra.run.smithi191.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T22:51:18.698 INFO:teuthology.orchestra.run.smithi191.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T22:51:18.699 INFO:teuthology.orchestra.run.smithi191.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T22:51:18.699 INFO:teuthology.orchestra.run.smithi191.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T22:51:18.699 INFO:teuthology.orchestra.run.smithi191.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T22:51:18.699 INFO:teuthology.orchestra.run.smithi191.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T22:51:18.699 INFO:teuthology.orchestra.run.smithi191.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-25T22:51:18.699 INFO:teuthology.orchestra.run.smithi191.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T22:51:18.699 INFO:teuthology.orchestra.run.smithi191.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T22:51:18.699 INFO:teuthology.orchestra.run.smithi191.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T22:51:18.699 INFO:teuthology.orchestra.run.smithi191.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T22:51:18.699 INFO:teuthology.orchestra.run.smithi191.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T22:51:18.700 INFO:teuthology.orchestra.run.smithi191.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T22:51:18.700 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T22:51:18.700 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-argparse-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:18.700 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:18.700 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cephfs-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:18.700 INFO:teuthology.orchestra.run.smithi191.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T22:51:18.700 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T22:51:18.700 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T22:51:18.700 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T22:51:18.700 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T22:51:18.700 INFO:teuthology.orchestra.run.smithi191.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T22:51:18.701 INFO:teuthology.orchestra.run.smithi191.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T22:51:18.701 INFO:teuthology.orchestra.run.smithi191.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T22:51:18.701 INFO:teuthology.orchestra.run.smithi191.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T22:51:18.701 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T22:51:18.701 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T22:51:18.701 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T22:51:18.701 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T22:51:18.701 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T22:51:18.701 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T22:51:18.701 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T22:51:18.701 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T22:51:18.701 INFO:teuthology.orchestra.run.smithi191.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T22:51:18.701 INFO:teuthology.orchestra.run.smithi191.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T22:51:18.702 INFO:teuthology.orchestra.run.smithi191.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T22:51:18.702 INFO:teuthology.orchestra.run.smithi191.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T22:51:18.702 INFO:teuthology.orchestra.run.smithi191.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T22:51:18.702 INFO:teuthology.orchestra.run.smithi191.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T22:51:18.702 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T22:51:18.702 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T22:51:18.702 INFO:teuthology.orchestra.run.smithi191.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T22:51:18.702 INFO:teuthology.orchestra.run.smithi191.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T22:51:18.702 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T22:51:18.702 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T22:51:18.702 INFO:teuthology.orchestra.run.smithi191.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T22:51:18.702 INFO:teuthology.orchestra.run.smithi191.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T22:51:18.702 INFO:teuthology.orchestra.run.smithi191.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T22:51:18.703 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T22:51:18.703 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T22:51:18.703 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T22:51:18.703 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T22:51:18.703 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T22:51:18.703 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rados-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:18.703 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:18.703 INFO:teuthology.orchestra.run.smithi191.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T22:51:18.703 INFO:teuthology.orchestra.run.smithi191.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T22:51:18.703 INFO:teuthology.orchestra.run.smithi191.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T22:51:18.703 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:18.703 INFO:teuthology.orchestra.run.smithi191.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T22:51:18.703 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T22:51:18.704 INFO:teuthology.orchestra.run.smithi191.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T22:51:18.704 INFO:teuthology.orchestra.run.smithi191.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T22:51:18.704 INFO:teuthology.orchestra.run.smithi191.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T22:51:18.704 INFO:teuthology.orchestra.run.smithi191.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T22:51:18.704 INFO:teuthology.orchestra.run.smithi191.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T22:51:18.704 INFO:teuthology.orchestra.run.smithi191.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T22:51:18.704 INFO:teuthology.orchestra.run.smithi191.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T22:51:18.704 INFO:teuthology.orchestra.run.smithi191.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T22:51:18.704 INFO:teuthology.orchestra.run.smithi191.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T22:51:18.704 INFO:teuthology.orchestra.run.smithi191.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T22:51:18.704 INFO:teuthology.orchestra.run.smithi191.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T22:51:18.705 INFO:teuthology.orchestra.run.smithi191.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T22:51:18.705 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:18.705 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:18.705 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-nbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T22:51:18.705 INFO:teuthology.orchestra.run.smithi191.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T22:51:18.705 INFO:teuthology.orchestra.run.smithi191.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T22:51:18.705 INFO:teuthology.orchestra.run.smithi191.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T22:51:18.705 INFO:teuthology.orchestra.run.smithi191.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-25T22:51:18.705 INFO:teuthology.orchestra.run.smithi191.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T22:51:18.706 INFO:teuthology.orchestra.run.smithi191.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-25T22:51:18.706 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T22:51:18.706 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-04-25T22:51:19.127 DEBUG:teuthology.parallel:result is None 2024-04-25T22:51:19.127 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T22:51:19.351 DEBUG:teuthology.orchestra.run.smithi052:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T22:51:19.377 INFO:teuthology.orchestra.run.smithi052.stdout:19.0.0-2445.gd2c45d97.el9 2024-04-25T22:51:19.378 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2445.gd2c45d97.el9 2024-04-25T22:51:19.378 INFO:teuthology.task.install:The correct ceph version 19.0.0-2445.gd2c45d97 is installed. 2024-04-25T22:51:19.380 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T22:51:19.603 DEBUG:teuthology.orchestra.run.smithi110:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T22:51:19.629 INFO:teuthology.orchestra.run.smithi110.stdout:19.0.0-2445.gd2c45d97.el9 2024-04-25T22:51:19.629 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2445.gd2c45d97.el9 2024-04-25T22:51:19.629 INFO:teuthology.task.install:The correct ceph version 19.0.0-2445.gd2c45d97 is installed. 2024-04-25T22:51:19.631 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T22:51:19.852 DEBUG:teuthology.orchestra.run.smithi164:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T22:51:19.877 INFO:teuthology.orchestra.run.smithi164.stdout:19.0.0-2445.gd2c45d97.el9 2024-04-25T22:51:19.877 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2445.gd2c45d97.el9 2024-04-25T22:51:19.877 INFO:teuthology.task.install:The correct ceph version 19.0.0-2445.gd2c45d97 is installed. 2024-04-25T22:51:19.879 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T22:51:20.034 DEBUG:teuthology.orchestra.run.smithi191:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T22:51:20.056 INFO:teuthology.orchestra.run.smithi191.stdout:19.0.0-2445.gd2c45d97.el9 2024-04-25T22:51:20.056 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2445.gd2c45d97.el9 2024-04-25T22:51:20.056 INFO:teuthology.task.install:The correct ceph version 19.0.0-2445.gd2c45d97 is installed. 2024-04-25T22:51:20.058 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-25T22:51:20.058 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-25T22:51:20.058 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T22:51:20.090 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-25T22:51:20.090 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T22:51:20.121 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-25T22:51:20.121 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T22:51:20.153 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-25T22:51:20.153 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T22:51:20.179 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-25T22:51:20.179 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-25T22:51:20.179 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T22:51:20.208 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T22:51:20.278 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-25T22:51:20.278 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T22:51:20.307 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T22:51:20.374 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-25T22:51:20.374 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T22:51:20.403 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T22:51:20.470 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-25T22:51:20.470 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T22:51:20.494 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T22:51:20.557 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-25T22:51:20.558 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-25T22:51:20.558 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T22:51:20.588 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T22:51:20.655 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-25T22:51:20.656 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T22:51:20.687 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T22:51:20.751 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-25T22:51:20.752 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T22:51:20.777 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T22:51:20.842 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-25T22:51:20.842 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T22:51:20.866 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T22:51:20.930 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-25T22:51:20.930 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-25T22:51:20.930 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T22:51:20.956 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T22:51:21.038 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-25T22:51:21.038 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T22:51:21.062 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T22:51:21.124 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-25T22:51:21.124 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T22:51:21.148 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T22:51:21.211 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-25T22:51:21.211 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T22:51:21.235 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T22:51:21.298 INFO:teuthology.run_tasks:Running task ceph... 2024-04-25T22:51:21.395 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-25T22:51:21.395 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 777 /var/log/ceph 2024-04-25T22:51:21.397 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 777 /var/log/ceph 2024-04-25T22:51:21.400 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 777 /var/log/ceph 2024-04-25T22:51:21.402 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 777 /var/log/ceph 2024-04-25T22:51:21.425 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-25T22:51:21.425 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T22:51:21.462 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T22:51:21.465 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T22:51:21.467 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T22:51:21.489 INFO:tasks.ceph:Creating extra log directories... 2024-04-25T22:51:21.489 DEBUG:teuthology.orchestra.run.smithi052:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T22:51:21.526 DEBUG:teuthology.orchestra.run.smithi110:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T22:51:21.529 DEBUG:teuthology.orchestra.run.smithi164:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T22:51:21.531 DEBUG:teuthology.orchestra.run.smithi191:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T22:51:21.565 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-25T22:51:21.565 INFO:tasks.ceph:config {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-25T22:51:21.566 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674073', 'branch': 'squid', 'description': 'powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-low-osd-mem-target powercycle/default supported-distros/centos_latest tasks/cfuse_workunit_suites_fsx thrashosds-health}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7674073', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED'], 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'b22e2ebdeb24376882b7bda2a7329c8cccc2276a'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'], ['osd.0'], ['osd.1'], ['osd.2']], 'seed': 9595, 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'sleep_before_teardown': 0, 'subset': '3/4', 'suite': 'powercycle', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_b22e2ebdeb24376882b7bda2a7329c8cccc2276a/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'b22e2ebdeb24376882b7bda2a7329c8cccc2276a', 'targets': {'smithi052.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDSIcjkrs3fu9z3MaNgNEl/JlLCteLQGWKJlnH/58PrXWPsFPTZsI+fEypo4hx/vij1aB/m7mAzfQl1SxvV6lCg=', 'smithi110.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNqPd0uUwDHoFDG/WUPEm8FI2EGSKKRWG2FEChX+x4ZO+tZhK8B90RhZvzQG92A5e0QdX2LZ+QdxfsoctE5a3+o=', 'smithi164.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBleoW1Vdqjh/mQnCLfCpLdXKmQ+tsEeKQi8LfSy4bA2QvIoRJPyQKGWtoOseEbcLKQLnN+jnBY7yqVIdGWV7sE=', 'smithi191.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHyrsHbeOR7s7w3ikPF9nZlOia6bmkuc84Y/HHyyEua2u8+le1UfVxmxRClhWEke2lDqUj1FE/7nbe/DNoErapg='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}}, {'ceph': None}, {'thrashosds': {'chance_down': 1.0, 'powercycle': True, 'timeout': 600}}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/fsx.sh']}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-25_21:32:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-25T22:51:21.566 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T22:51:21.590 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T22:51:21.593 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T22:51:21.595 DEBUG:teuthology.orchestra.run.smithi191:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T22:51:21.610 DEBUG:teuthology.orchestra.run.smithi052:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T22:51:21.646 DEBUG:teuthology.orchestra.run.smithi110:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T22:51:21.649 DEBUG:teuthology.orchestra.run.smithi164:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T22:51:21.651 DEBUG:teuthology.orchestra.run.smithi191:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T22:51:21.676 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-25T22:51:21.676 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T22:51:21.725 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T22:51:21.725 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_1 2024-04-25T22:51:21.779 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T22:51:21.780 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T22:51:21.780 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-04-25T22:51:21.780 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T22:51:21.780 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T22:51:21.780 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-04-25 22:50:50.968759413 +0000 2024-04-25T22:51:21.781 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-04-25 22:49:05.037578194 +0000 2024-04-25T22:51:21.781 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-04-25 22:49:05.037578194 +0000 2024-04-25T22:51:21.781 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2024-04-25 22:49:05.037578194 +0000 2024-04-25T22:51:21.781 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T22:51:21.841 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-04-25T22:51:21.841 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-04-25T22:51:21.842 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000106836 s, 4.8 MB/s 2024-04-25T22:51:21.843 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T22:51:21.898 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_2 2024-04-25T22:51:21.953 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T22:51:21.954 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T22:51:21.954 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-04-25T22:51:21.954 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T22:51:21.954 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T22:51:21.954 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-04-25 22:50:50.968759413 +0000 2024-04-25T22:51:21.954 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-04-25 22:49:05.370572334 +0000 2024-04-25T22:51:21.954 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-04-25 22:49:05.370572334 +0000 2024-04-25T22:51:21.954 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2024-04-25 22:49:05.370572334 +0000 2024-04-25T22:51:21.955 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T22:51:22.015 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-04-25T22:51:22.015 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-04-25T22:51:22.015 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 9.9602e-05 s, 5.1 MB/s 2024-04-25T22:51:22.016 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T22:51:22.072 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_3 2024-04-25T22:51:22.126 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T22:51:22.127 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T22:51:22.127 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-04-25T22:51:22.127 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T22:51:22.127 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T22:51:22.127 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-04-25 22:50:50.969759397 +0000 2024-04-25T22:51:22.127 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-04-25 22:49:05.708566386 +0000 2024-04-25T22:51:22.127 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-04-25 22:49:05.708566386 +0000 2024-04-25T22:51:22.127 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2024-04-25 22:49:05.708566386 +0000 2024-04-25T22:51:22.127 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T22:51:22.188 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-04-25T22:51:22.188 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-04-25T22:51:22.188 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000105678 s, 4.8 MB/s 2024-04-25T22:51:22.189 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T22:51:22.245 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_4 2024-04-25T22:51:22.299 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T22:51:22.299 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T22:51:22.299 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-04-25T22:51:22.299 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T22:51:22.300 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T22:51:22.300 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-04-25 22:50:50.969759397 +0000 2024-04-25T22:51:22.300 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-04-25 22:49:06.024560825 +0000 2024-04-25T22:51:22.300 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-04-25 22:49:06.024560825 +0000 2024-04-25T22:51:22.300 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2024-04-25 22:49:06.024560825 +0000 2024-04-25T22:51:22.300 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T22:51:22.361 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-04-25T22:51:22.361 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-04-25T22:51:22.361 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 9.836e-05 s, 5.2 MB/s 2024-04-25T22:51:22.362 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T22:51:22.419 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-25T22:51:22.419 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-25T22:51:22.419 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T22:51:22.436 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T22:51:22.436 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_1 2024-04-25T22:51:22.493 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T22:51:22.493 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T22:51:22.493 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-04-25T22:51:22.494 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T22:51:22.494 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T22:51:22.494 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-04-25 22:50:55.384601662 +0000 2024-04-25T22:51:22.494 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-04-25 22:49:06.962166223 +0000 2024-04-25T22:51:22.495 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-04-25 22:49:06.962166223 +0000 2024-04-25T22:51:22.495 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-04-25 22:49:06.962166223 +0000 2024-04-25T22:51:22.495 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T22:51:22.557 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-04-25T22:51:22.558 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-04-25T22:51:22.558 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000267216 s, 1.9 MB/s 2024-04-25T22:51:22.559 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T22:51:22.616 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_2 2024-04-25T22:51:22.672 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T22:51:22.672 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T22:51:22.672 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-04-25T22:51:22.672 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T22:51:22.672 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T22:51:22.672 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-04-25 22:50:55.385601646 +0000 2024-04-25T22:51:22.672 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-04-25 22:49:07.318159845 +0000 2024-04-25T22:51:22.672 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-04-25 22:49:07.318159845 +0000 2024-04-25T22:51:22.672 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-04-25 22:49:07.318159845 +0000 2024-04-25T22:51:22.673 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T22:51:22.735 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-04-25T22:51:22.735 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-04-25T22:51:22.735 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000216434 s, 2.4 MB/s 2024-04-25T22:51:22.737 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T22:51:22.794 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_3 2024-04-25T22:51:22.849 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T22:51:22.849 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T22:51:22.849 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-04-25T22:51:22.849 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T22:51:22.849 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T22:51:22.849 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-04-25 22:50:55.385601646 +0000 2024-04-25T22:51:22.849 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-04-25 22:49:07.653153843 +0000 2024-04-25T22:51:22.850 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-04-25 22:49:07.653153843 +0000 2024-04-25T22:51:22.850 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-04-25 22:49:07.653153843 +0000 2024-04-25T22:51:22.850 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T22:51:22.911 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-04-25T22:51:22.911 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-04-25T22:51:22.912 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000172435 s, 3.0 MB/s 2024-04-25T22:51:22.913 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T22:51:22.967 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_4 2024-04-25T22:51:23.022 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T22:51:23.022 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T22:51:23.022 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-04-25T22:51:23.022 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T22:51:23.022 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T22:51:23.022 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-04-25 22:50:55.385601646 +0000 2024-04-25T22:51:23.022 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-04-25 22:49:07.993147751 +0000 2024-04-25T22:51:23.022 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-04-25 22:49:07.993147751 +0000 2024-04-25T22:51:23.022 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-04-25 22:49:07.993147751 +0000 2024-04-25T22:51:23.023 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T22:51:23.086 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-04-25T22:51:23.086 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-04-25T22:51:23.086 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000262019 s, 2.0 MB/s 2024-04-25T22:51:23.086 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T22:51:23.142 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-04-25T22:51:23.142 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-25T22:51:23.142 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T22:51:23.161 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T22:51:23.161 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_1 2024-04-25T22:51:23.218 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T22:51:23.218 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T22:51:23.218 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-04-25T22:51:23.219 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T22:51:23.219 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T22:51:23.219 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2024-04-25 22:51:11.230271793 +0000 2024-04-25T22:51:23.219 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2024-04-25 22:49:07.155640419 +0000 2024-04-25T22:51:23.219 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2024-04-25 22:49:07.155640419 +0000 2024-04-25T22:51:23.219 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: 2024-04-25 22:49:07.155640419 +0000 2024-04-25T22:51:23.219 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T22:51:23.284 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2024-04-25T22:51:23.284 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2024-04-25T22:51:23.284 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000308115 s, 1.7 MB/s 2024-04-25T22:51:23.285 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T22:51:23.344 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_2 2024-04-25T22:51:23.400 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T22:51:23.401 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T22:51:23.401 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-04-25T22:51:23.401 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T22:51:23.401 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T22:51:23.401 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2024-04-25 22:51:11.230271793 +0000 2024-04-25T22:51:23.401 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2024-04-25 22:49:07.493634127 +0000 2024-04-25T22:51:23.401 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2024-04-25 22:49:07.493634127 +0000 2024-04-25T22:51:23.401 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: 2024-04-25 22:49:07.493634127 +0000 2024-04-25T22:51:23.401 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T22:51:23.465 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2024-04-25T22:51:23.465 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2024-04-25T22:51:23.465 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000188545 s, 2.7 MB/s 2024-04-25T22:51:23.466 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T22:51:23.523 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_3 2024-04-25T22:51:23.579 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T22:51:23.579 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T22:51:23.579 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-04-25T22:51:23.579 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T22:51:23.579 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T22:51:23.579 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2024-04-25 22:51:11.230271793 +0000 2024-04-25T22:51:23.579 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2024-04-25 22:49:07.817628097 +0000 2024-04-25T22:51:23.579 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2024-04-25 22:49:07.817628097 +0000 2024-04-25T22:51:23.580 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: 2024-04-25 22:49:07.817628097 +0000 2024-04-25T22:51:23.580 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T22:51:23.643 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2024-04-25T22:51:23.643 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2024-04-25T22:51:23.643 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000193144 s, 2.7 MB/s 2024-04-25T22:51:23.645 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T22:51:23.701 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_4 2024-04-25T22:51:23.756 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T22:51:23.756 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T22:51:23.756 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-04-25T22:51:23.756 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T22:51:23.756 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T22:51:23.756 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2024-04-25 22:51:11.231271776 +0000 2024-04-25T22:51:23.757 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2024-04-25 22:49:08.150621899 +0000 2024-04-25T22:51:23.757 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2024-04-25 22:49:08.150621899 +0000 2024-04-25T22:51:23.757 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: 2024-04-25 22:49:08.150621899 +0000 2024-04-25T22:51:23.757 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T22:51:23.819 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2024-04-25T22:51:23.819 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2024-04-25T22:51:23.819 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000167535 s, 3.1 MB/s 2024-04-25T22:51:23.820 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T22:51:23.876 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-04-25T22:51:23.876 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi110.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi164.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi191.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-04-25T22:51:23.876 INFO:tasks.ceph:Generating config... 2024-04-25T22:51:23.877 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-25T22:51:23.877 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-25T22:51:23.877 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-25T22:51:23.877 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-25T22:51:23.877 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-25T22:51:23.878 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-25T22:51:23.878 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-25T22:51:23.878 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-25T22:51:23.878 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-25T22:51:23.878 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-25T22:51:23.878 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-25T22:51:23.878 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-25T22:51:23.878 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-25T22:51:23.878 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-25T22:51:23.878 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-25T22:51:23.878 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-25T22:51:23.878 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-25T22:51:23.878 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-25T22:51:23.879 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-25T22:51:23.879 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-25T22:51:23.879 INFO:tasks.ceph:[osd] osd memory target = 1610612736 2024-04-25T22:51:23.879 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-25T22:51:23.879 INFO:tasks.ceph:Setting up mon.a... 2024-04-25T22:51:23.879 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-25T22:51:23.936 INFO:teuthology.orchestra.run.smithi052.stdout:creating /etc/ceph/ceph.keyring 2024-04-25T22:51:23.939 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-25T22:51:23.985 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T22:51:24.011 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.52'), ('mon.b', '[v2:172.21.15.52:3301,v1:172.21.15.52:6790]'), ('mon.c', '[v2:172.21.15.52:3302,v1:172.21.15.52:6791]')] 2024-04-25T22:51:24.011 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.52,[v2:172.21.15.52:3301,v1:172.21.15.52:6790],[v2:172.21.15.52:3302,v1:172.21.15.52:6791]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}} 2024-04-25T22:51:24.012 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-25T22:51:24.012 DEBUG:teuthology.orchestra.run.smithi052:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T22:51:24.067 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.52 --addv b '[v2:172.21.15.52:3301,v1:172.21.15.52:6790]' --addv c '[v2:172.21.15.52:3302,v1:172.21.15.52:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-25T22:51:24.155 INFO:teuthology.orchestra.run.smithi052.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-25T22:51:24.155 INFO:teuthology.orchestra.run.smithi052.stdout:monmaptool: generated fsid 5355b70e-3f7d-4bce-8676-89cee61d2089 2024-04-25T22:51:24.155 INFO:teuthology.orchestra.run.smithi052.stdout:setting min_mon_release = quincy 2024-04-25T22:51:24.156 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 0 2024-04-25T22:51:24.156 INFO:teuthology.orchestra.run.smithi052.stdout:fsid 5355b70e-3f7d-4bce-8676-89cee61d2089 2024-04-25T22:51:24.156 INFO:teuthology.orchestra.run.smithi052.stdout:last_changed 2024-04-25T22:51:24.155118+0000 2024-04-25T22:51:24.156 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-04-25T22:51:24.155118+0000 2024-04-25T22:51:24.156 INFO:teuthology.orchestra.run.smithi052.stdout:min_mon_release 17 (quincy) 2024-04-25T22:51:24.156 INFO:teuthology.orchestra.run.smithi052.stdout:election_strategy: 1 2024-04-25T22:51:24.156 INFO:teuthology.orchestra.run.smithi052.stdout:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2024-04-25T22:51:24.156 INFO:teuthology.orchestra.run.smithi052.stdout:1: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.b 2024-04-25T22:51:24.156 INFO:teuthology.orchestra.run.smithi052.stdout:2: [v2:172.21.15.52:3302/0,v1:172.21.15.52:6791/0] mon.c 2024-04-25T22:51:24.156 INFO:teuthology.orchestra.run.smithi052.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-25T22:51:24.158 DEBUG:teuthology.orchestra.run.smithi052:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T22:51:24.173 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 5355b70e-3f7d-4bce-8676-89cee61d2089... 2024-04-25T22:51:24.175 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T22:51:24.215 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T22:51:24.218 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T22:51:24.222 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T22:51:24.257 INFO:teuthology.orchestra.run.smithi052.stdout:[global] 2024-04-25T22:51:24.257 INFO:teuthology.orchestra.run.smithi052.stdout: chdir = "" 2024-04-25T22:51:24.257 INFO:teuthology.orchestra.run.smithi052.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T22:51:24.257 INFO:teuthology.orchestra.run.smithi052.stdout: auth supported = cephx 2024-04-25T22:51:24.257 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:51:24.257 INFO:teuthology.orchestra.run.smithi052.stdout: filestore xattr use omap = true 2024-04-25T22:51:24.257 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:51:24.257 INFO:teuthology.orchestra.run.smithi052.stdout: mon clock drift allowed = 1.000 2024-04-25T22:51:24.257 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:51:24.258 INFO:teuthology.orchestra.run.smithi052.stdout: osd crush chooseleaf type = 0 2024-04-25T22:51:24.258 INFO:teuthology.orchestra.run.smithi052.stdout: auth debug = true 2024-04-25T22:51:24.258 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:51:24.258 INFO:teuthology.orchestra.run.smithi052.stdout: ms die on old message = true 2024-04-25T22:51:24.258 INFO:teuthology.orchestra.run.smithi052.stdout: ms die on bug = true 2024-04-25T22:51:24.258 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:51:24.258 INFO:teuthology.orchestra.run.smithi052.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T22:51:24.258 INFO:teuthology.orchestra.run.smithi052.stdout: mon pg warn max object skew = 0 2024-04-25T22:51:24.258 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:51:24.258 INFO:teuthology.orchestra.run.smithi052.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T22:51:24.258 INFO:teuthology.orchestra.run.smithi052.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T22:51:24.258 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:51:24.258 INFO:teuthology.orchestra.run.smithi052.stdout: osd pool default size = 2 2024-04-25T22:51:24.259 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:51:24.259 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd allow primary affinity = true 2024-04-25T22:51:24.259 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd allow pg remap = true 2024-04-25T22:51:24.259 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on legacy crush tunables = false 2024-04-25T22:51:24.259 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on crush straw calc version zero = false 2024-04-25T22:51:24.259 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on no sortbitwise = false 2024-04-25T22:51:24.259 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on osd down out interval zero = false 2024-04-25T22:51:24.259 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on too few osds = false 2024-04-25T22:51:24.259 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T22:51:24.259 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T22:51:24.259 INFO:teuthology.orchestra.run.smithi052.stdout: mon_allow_pool_size_one = true 2024-04-25T22:51:24.259 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:51:24.259 INFO:teuthology.orchestra.run.smithi052.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T22:51:24.259 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:51:24.260 INFO:teuthology.orchestra.run.smithi052.stdout: osd default data pool replay window = 5 2024-04-25T22:51:24.260 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:51:24.260 INFO:teuthology.orchestra.run.smithi052.stdout: mon allow pool delete = true 2024-04-25T22:51:24.260 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:51:24.260 INFO:teuthology.orchestra.run.smithi052.stdout: mon cluster log file level = debug 2024-04-25T22:51:24.260 INFO:teuthology.orchestra.run.smithi052.stdout: debug asserts on shutdown = true 2024-04-25T22:51:24.260 INFO:teuthology.orchestra.run.smithi052.stdout: mon health detail to clog = false 2024-04-25T22:51:24.260 INFO:teuthology.orchestra.run.smithi052.stdout: mon host = "172.21.15.52,[v2:172.21.15.52:3301,v1:172.21.15.52:6790],[v2:172.21.15.52:3302,v1:172.21.15.52:6791]" 2024-04-25T22:51:24.260 INFO:teuthology.orchestra.run.smithi052.stdout: fsid = 5355b70e-3f7d-4bce-8676-89cee61d2089 2024-04-25T22:51:24.260 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:51:24.260 INFO:teuthology.orchestra.run.smithi052.stdout:[osd] 2024-04-25T22:51:24.260 INFO:teuthology.orchestra.run.smithi052.stdout: osd journal size = 100 2024-04-25T22:51:24.260 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:51:24.260 INFO:teuthology.orchestra.run.smithi052.stdout: osd scrub load threshold = 5.0 2024-04-25T22:51:24.261 INFO:teuthology.orchestra.run.smithi052.stdout: osd scrub max interval = 600 2024-04-25T22:51:24.261 INFO:teuthology.orchestra.run.smithi052.stdout: osd mclock profile = high_recovery_ops 2024-04-25T22:51:24.261 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:51:24.261 INFO:teuthology.orchestra.run.smithi052.stdout: osd recover clone overlap = true 2024-04-25T22:51:24.261 INFO:teuthology.orchestra.run.smithi052.stdout: osd recovery max chunk = 1048576 2024-04-25T22:51:24.261 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:51:24.261 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug shutdown = true 2024-04-25T22:51:24.261 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug op order = true 2024-04-25T22:51:24.261 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug verify stray on activate = true 2024-04-25T22:51:24.261 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug trim objects = true 2024-04-25T22:51:24.261 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:51:24.261 INFO:teuthology.orchestra.run.smithi052.stdout: osd open classes on start = true 2024-04-25T22:51:24.261 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug pg log writeout = true 2024-04-25T22:51:24.261 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:51:24.262 INFO:teuthology.orchestra.run.smithi052.stdout: osd deep scrub update digest min age = 30 2024-04-25T22:51:24.262 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:51:24.262 INFO:teuthology.orchestra.run.smithi052.stdout: osd map max advance = 10 2024-04-25T22:51:24.262 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:51:24.262 INFO:teuthology.orchestra.run.smithi052.stdout: journal zero on create = true 2024-04-25T22:51:24.262 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:51:24.262 INFO:teuthology.orchestra.run.smithi052.stdout: filestore ondisk finisher threads = 3 2024-04-25T22:51:24.262 INFO:teuthology.orchestra.run.smithi052.stdout: filestore apply finisher threads = 3 2024-04-25T22:51:24.262 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:51:24.262 INFO:teuthology.orchestra.run.smithi052.stdout: bdev debug aio = true 2024-04-25T22:51:24.262 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug misdirected ops = true 2024-04-25T22:51:24.262 INFO:teuthology.orchestra.run.smithi052.stdout: bdev async discard = True 2024-04-25T22:51:24.262 INFO:teuthology.orchestra.run.smithi052.stdout: bdev enable discard = True 2024-04-25T22:51:24.262 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore block size = 96636764160 2024-04-25T22:51:24.263 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore fsck on mount = True 2024-04-25T22:51:24.263 INFO:teuthology.orchestra.run.smithi052.stdout: debug bluefs = 1/20 2024-04-25T22:51:24.263 INFO:teuthology.orchestra.run.smithi052.stdout: debug bluestore = 1/20 2024-04-25T22:51:24.263 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-04-25T22:51:24.263 INFO:teuthology.orchestra.run.smithi052.stdout: debug osd = 20 2024-04-25T22:51:24.263 INFO:teuthology.orchestra.run.smithi052.stdout: debug rocksdb = 4/10 2024-04-25T22:51:24.263 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T22:51:24.263 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd full ratio = 0.9 2024-04-25T22:51:24.263 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd nearfull ratio = 0.8 2024-04-25T22:51:24.263 INFO:teuthology.orchestra.run.smithi052.stdout: osd blocked scrub grace period = 3600 2024-04-25T22:51:24.263 INFO:teuthology.orchestra.run.smithi052.stdout: osd failsafe full ratio = 0.95 2024-04-25T22:51:24.263 INFO:teuthology.orchestra.run.smithi052.stdout: osd max markdown count = 1000 2024-04-25T22:51:24.263 INFO:teuthology.orchestra.run.smithi052.stdout: osd memory target = 1610612736 2024-04-25T22:51:24.264 INFO:teuthology.orchestra.run.smithi052.stdout: osd objectstore = bluestore 2024-04-25T22:51:24.264 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:51:24.264 INFO:teuthology.orchestra.run.smithi052.stdout:[mgr] 2024-04-25T22:51:24.264 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-04-25T22:51:24.264 INFO:teuthology.orchestra.run.smithi052.stdout: debug mgr = 20 2024-04-25T22:51:24.264 INFO:teuthology.orchestra.run.smithi052.stdout: debug mon = 20 2024-04-25T22:51:24.264 INFO:teuthology.orchestra.run.smithi052.stdout: debug auth = 20 2024-04-25T22:51:24.264 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min pgs per osd = 4 2024-04-25T22:51:24.264 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min bytes per osd = 10 2024-04-25T22:51:24.264 INFO:teuthology.orchestra.run.smithi052.stdout: mgr/telemetry/nag = false 2024-04-25T22:51:24.264 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:51:24.264 INFO:teuthology.orchestra.run.smithi052.stdout:[mon] 2024-04-25T22:51:24.265 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-04-25T22:51:24.265 INFO:teuthology.orchestra.run.smithi052.stdout: debug mon = 20 2024-04-25T22:51:24.265 INFO:teuthology.orchestra.run.smithi052.stdout: debug paxos = 20 2024-04-25T22:51:24.265 INFO:teuthology.orchestra.run.smithi052.stdout: debug auth = 20 2024-04-25T22:51:24.265 INFO:teuthology.orchestra.run.smithi052.stdout: mon data avail warn = 5 2024-04-25T22:51:24.265 INFO:teuthology.orchestra.run.smithi052.stdout: mon mgr mkfs grace = 240 2024-04-25T22:51:24.265 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min pgs per osd = 4 2024-04-25T22:51:24.265 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd reporter subtree level = osd 2024-04-25T22:51:24.265 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd prime pg temp = true 2024-04-25T22:51:24.265 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min bytes per osd = 10 2024-04-25T22:51:24.265 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:51:24.266 INFO:teuthology.orchestra.run.smithi052.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T22:51:24.266 INFO:teuthology.orchestra.run.smithi052.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T22:51:24.266 INFO:teuthology.orchestra.run.smithi052.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T22:51:24.266 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:51:24.266 INFO:teuthology.orchestra.run.smithi052.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T22:51:24.266 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T22:51:24.266 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T22:51:24.266 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:51:24.266 INFO:teuthology.orchestra.run.smithi052.stdout: # 1m isn't quite enough 2024-04-25T22:51:24.266 INFO:teuthology.orchestra.run.smithi052.stdout: mon_down_mkfs_grace = 2m 2024-04-25T22:51:24.266 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:51:24.266 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_filestore_osds = false 2024-04-25T22:51:24.266 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:51:24.266 INFO:teuthology.orchestra.run.smithi052.stdout:[client] 2024-04-25T22:51:24.267 INFO:teuthology.orchestra.run.smithi052.stdout: rgw cache enabled = true 2024-04-25T22:51:24.267 INFO:teuthology.orchestra.run.smithi052.stdout: rgw enable ops log = true 2024-04-25T22:51:24.267 INFO:teuthology.orchestra.run.smithi052.stdout: rgw enable usage log = true 2024-04-25T22:51:24.267 INFO:teuthology.orchestra.run.smithi052.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T22:51:24.267 INFO:teuthology.orchestra.run.smithi052.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T22:51:24.267 INFO:teuthology.orchestra.run.smithi052.stdout:[mon.a] 2024-04-25T22:51:24.267 INFO:teuthology.orchestra.run.smithi052.stdout:[mon.b] 2024-04-25T22:51:24.267 INFO:teuthology.orchestra.run.smithi052.stdout:[mon.c] 2024-04-25T22:51:24.267 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.a] 2024-04-25T22:51:24.268 INFO:teuthology.orchestra.run.smithi164.stdout:[global] 2024-04-25T22:51:24.268 INFO:teuthology.orchestra.run.smithi164.stdout: chdir = "" 2024-04-25T22:51:24.268 INFO:teuthology.orchestra.run.smithi164.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T22:51:24.268 INFO:teuthology.orchestra.run.smithi164.stdout: auth supported = cephx 2024-04-25T22:51:24.268 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-25T22:51:24.269 INFO:teuthology.orchestra.run.smithi164.stdout: filestore xattr use omap = true 2024-04-25T22:51:24.269 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-25T22:51:24.269 INFO:teuthology.orchestra.run.smithi164.stdout: mon clock drift allowed = 1.000 2024-04-25T22:51:24.269 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-25T22:51:24.269 INFO:teuthology.orchestra.run.smithi164.stdout: osd crush chooseleaf type = 0 2024-04-25T22:51:24.269 INFO:teuthology.orchestra.run.smithi164.stdout: auth debug = true 2024-04-25T22:51:24.269 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-25T22:51:24.269 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on old message = true 2024-04-25T22:51:24.269 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on bug = true 2024-04-25T22:51:24.269 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-25T22:51:24.269 INFO:teuthology.orchestra.run.smithi164.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T22:51:24.269 INFO:teuthology.orchestra.run.smithi164.stdout: mon pg warn max object skew = 0 2024-04-25T22:51:24.269 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-25T22:51:24.270 INFO:teuthology.orchestra.run.smithi164.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T22:51:24.270 INFO:teuthology.orchestra.run.smithi164.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T22:51:24.270 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-25T22:51:24.270 INFO:teuthology.orchestra.run.smithi164.stdout: osd pool default size = 2 2024-04-25T22:51:24.270 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-25T22:51:24.270 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd allow primary affinity = true 2024-04-25T22:51:24.270 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd allow pg remap = true 2024-04-25T22:51:24.270 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on legacy crush tunables = false 2024-04-25T22:51:24.270 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on crush straw calc version zero = false 2024-04-25T22:51:24.270 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on no sortbitwise = false 2024-04-25T22:51:24.270 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on osd down out interval zero = false 2024-04-25T22:51:24.270 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on too few osds = false 2024-04-25T22:51:24.270 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T22:51:24.270 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T22:51:24.271 INFO:teuthology.orchestra.run.smithi164.stdout: mon_allow_pool_size_one = true 2024-04-25T22:51:24.271 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-25T22:51:24.271 INFO:teuthology.orchestra.run.smithi164.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T22:51:24.271 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-25T22:51:24.271 INFO:teuthology.orchestra.run.smithi164.stdout: osd default data pool replay window = 5 2024-04-25T22:51:24.271 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-25T22:51:24.271 INFO:teuthology.orchestra.run.smithi164.stdout: mon allow pool delete = true 2024-04-25T22:51:24.271 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-25T22:51:24.271 INFO:teuthology.orchestra.run.smithi164.stdout: mon cluster log file level = debug 2024-04-25T22:51:24.271 INFO:teuthology.orchestra.run.smithi164.stdout: debug asserts on shutdown = true 2024-04-25T22:51:24.271 INFO:teuthology.orchestra.run.smithi164.stdout: mon health detail to clog = false 2024-04-25T22:51:24.271 INFO:teuthology.orchestra.run.smithi164.stdout: mon host = "172.21.15.52,[v2:172.21.15.52:3301,v1:172.21.15.52:6790],[v2:172.21.15.52:3302,v1:172.21.15.52:6791]" 2024-04-25T22:51:24.271 INFO:teuthology.orchestra.run.smithi164.stdout: fsid = 5355b70e-3f7d-4bce-8676-89cee61d2089 2024-04-25T22:51:24.271 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-25T22:51:24.272 INFO:teuthology.orchestra.run.smithi164.stdout:[osd] 2024-04-25T22:51:24.272 INFO:teuthology.orchestra.run.smithi164.stdout: osd journal size = 100 2024-04-25T22:51:24.272 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-25T22:51:24.272 INFO:teuthology.orchestra.run.smithi164.stdout: osd scrub load threshold = 5.0 2024-04-25T22:51:24.272 INFO:teuthology.orchestra.run.smithi164.stdout: osd scrub max interval = 600 2024-04-25T22:51:24.272 INFO:teuthology.orchestra.run.smithi164.stdout: osd mclock profile = high_recovery_ops 2024-04-25T22:51:24.272 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-25T22:51:24.272 INFO:teuthology.orchestra.run.smithi164.stdout: osd recover clone overlap = true 2024-04-25T22:51:24.272 INFO:teuthology.orchestra.run.smithi164.stdout: osd recovery max chunk = 1048576 2024-04-25T22:51:24.272 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-25T22:51:24.272 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug shutdown = true 2024-04-25T22:51:24.272 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug op order = true 2024-04-25T22:51:24.272 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug verify stray on activate = true 2024-04-25T22:51:24.272 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug trim objects = true 2024-04-25T22:51:24.273 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-25T22:51:24.273 INFO:teuthology.orchestra.run.smithi164.stdout: osd open classes on start = true 2024-04-25T22:51:24.273 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug pg log writeout = true 2024-04-25T22:51:24.273 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-25T22:51:24.273 INFO:teuthology.orchestra.run.smithi164.stdout: osd deep scrub update digest min age = 30 2024-04-25T22:51:24.273 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-25T22:51:24.273 INFO:teuthology.orchestra.run.smithi164.stdout: osd map max advance = 10 2024-04-25T22:51:24.273 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-25T22:51:24.273 INFO:teuthology.orchestra.run.smithi164.stdout: journal zero on create = true 2024-04-25T22:51:24.273 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-25T22:51:24.273 INFO:teuthology.orchestra.run.smithi164.stdout: filestore ondisk finisher threads = 3 2024-04-25T22:51:24.273 INFO:teuthology.orchestra.run.smithi164.stdout: filestore apply finisher threads = 3 2024-04-25T22:51:24.273 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-25T22:51:24.273 INFO:teuthology.orchestra.run.smithi164.stdout: bdev debug aio = true 2024-04-25T22:51:24.274 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug misdirected ops = true 2024-04-25T22:51:24.274 INFO:teuthology.orchestra.run.smithi164.stdout: bdev async discard = True 2024-04-25T22:51:24.274 INFO:teuthology.orchestra.run.smithi164.stdout: bdev enable discard = True 2024-04-25T22:51:24.274 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore block size = 96636764160 2024-04-25T22:51:24.274 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore fsck on mount = True 2024-04-25T22:51:24.274 INFO:teuthology.orchestra.run.smithi164.stdout: debug bluefs = 1/20 2024-04-25T22:51:24.274 INFO:teuthology.orchestra.run.smithi164.stdout: debug bluestore = 1/20 2024-04-25T22:51:24.274 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-04-25T22:51:24.274 INFO:teuthology.orchestra.run.smithi164.stdout: debug osd = 20 2024-04-25T22:51:24.274 INFO:teuthology.orchestra.run.smithi164.stdout: debug rocksdb = 4/10 2024-04-25T22:51:24.274 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T22:51:24.274 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd full ratio = 0.9 2024-04-25T22:51:24.274 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd nearfull ratio = 0.8 2024-04-25T22:51:24.274 INFO:teuthology.orchestra.run.smithi164.stdout: osd blocked scrub grace period = 3600 2024-04-25T22:51:24.275 INFO:teuthology.orchestra.run.smithi164.stdout: osd failsafe full ratio = 0.95 2024-04-25T22:51:24.275 INFO:teuthology.orchestra.run.smithi164.stdout: osd max markdown count = 1000 2024-04-25T22:51:24.275 INFO:teuthology.orchestra.run.smithi164.stdout: osd memory target = 1610612736 2024-04-25T22:51:24.275 INFO:teuthology.orchestra.run.smithi164.stdout: osd objectstore = bluestore 2024-04-25T22:51:24.275 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-25T22:51:24.275 INFO:teuthology.orchestra.run.smithi164.stdout:[mgr] 2024-04-25T22:51:24.275 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-04-25T22:51:24.275 INFO:teuthology.orchestra.run.smithi164.stdout: debug mgr = 20 2024-04-25T22:51:24.275 INFO:teuthology.orchestra.run.smithi164.stdout: debug mon = 20 2024-04-25T22:51:24.275 INFO:teuthology.orchestra.run.smithi164.stdout: debug auth = 20 2024-04-25T22:51:24.275 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min pgs per osd = 4 2024-04-25T22:51:24.275 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min bytes per osd = 10 2024-04-25T22:51:24.275 INFO:teuthology.orchestra.run.smithi164.stdout: mgr/telemetry/nag = false 2024-04-25T22:51:24.275 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-25T22:51:24.276 INFO:teuthology.orchestra.run.smithi164.stdout:[mon] 2024-04-25T22:51:24.276 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-04-25T22:51:24.276 INFO:teuthology.orchestra.run.smithi164.stdout: debug mon = 20 2024-04-25T22:51:24.276 INFO:teuthology.orchestra.run.smithi164.stdout: debug paxos = 20 2024-04-25T22:51:24.276 INFO:teuthology.orchestra.run.smithi164.stdout: debug auth = 20 2024-04-25T22:51:24.276 INFO:teuthology.orchestra.run.smithi164.stdout: mon data avail warn = 5 2024-04-25T22:51:24.276 INFO:teuthology.orchestra.run.smithi164.stdout: mon mgr mkfs grace = 240 2024-04-25T22:51:24.276 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min pgs per osd = 4 2024-04-25T22:51:24.276 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd reporter subtree level = osd 2024-04-25T22:51:24.276 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd prime pg temp = true 2024-04-25T22:51:24.276 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min bytes per osd = 10 2024-04-25T22:51:24.276 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-25T22:51:24.276 INFO:teuthology.orchestra.run.smithi164.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T22:51:24.276 INFO:teuthology.orchestra.run.smithi164.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T22:51:24.277 INFO:teuthology.orchestra.run.smithi164.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T22:51:24.277 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-25T22:51:24.277 INFO:teuthology.orchestra.run.smithi164.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T22:51:24.277 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T22:51:24.277 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T22:51:24.277 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-25T22:51:24.277 INFO:teuthology.orchestra.run.smithi164.stdout: # 1m isn't quite enough 2024-04-25T22:51:24.277 INFO:teuthology.orchestra.run.smithi164.stdout: mon_down_mkfs_grace = 2m 2024-04-25T22:51:24.277 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-25T22:51:24.277 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_filestore_osds = false 2024-04-25T22:51:24.277 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-25T22:51:24.277 INFO:teuthology.orchestra.run.smithi164.stdout:[client] 2024-04-25T22:51:24.277 INFO:teuthology.orchestra.run.smithi164.stdout: rgw cache enabled = true 2024-04-25T22:51:24.277 INFO:teuthology.orchestra.run.smithi164.stdout: rgw enable ops log = true 2024-04-25T22:51:24.278 INFO:teuthology.orchestra.run.smithi164.stdout: rgw enable usage log = true 2024-04-25T22:51:24.278 INFO:teuthology.orchestra.run.smithi164.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T22:51:24.278 INFO:teuthology.orchestra.run.smithi164.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T22:51:24.278 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.a] 2024-04-25T22:51:24.278 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.b] 2024-04-25T22:51:24.278 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.c] 2024-04-25T22:51:24.278 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.a] 2024-04-25T22:51:24.278 INFO:teuthology.orchestra.run.smithi191.stdout:[global] 2024-04-25T22:51:24.278 INFO:teuthology.orchestra.run.smithi191.stdout: chdir = "" 2024-04-25T22:51:24.278 INFO:teuthology.orchestra.run.smithi191.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T22:51:24.278 INFO:teuthology.orchestra.run.smithi191.stdout: auth supported = cephx 2024-04-25T22:51:24.278 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T22:51:24.279 INFO:teuthology.orchestra.run.smithi191.stdout: filestore xattr use omap = true 2024-04-25T22:51:24.279 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T22:51:24.279 INFO:teuthology.orchestra.run.smithi191.stdout: mon clock drift allowed = 1.000 2024-04-25T22:51:24.279 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T22:51:24.279 INFO:teuthology.orchestra.run.smithi191.stdout: osd crush chooseleaf type = 0 2024-04-25T22:51:24.279 INFO:teuthology.orchestra.run.smithi191.stdout: auth debug = true 2024-04-25T22:51:24.279 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T22:51:24.279 INFO:teuthology.orchestra.run.smithi191.stdout: ms die on old message = true 2024-04-25T22:51:24.279 INFO:teuthology.orchestra.run.smithi191.stdout: ms die on bug = true 2024-04-25T22:51:24.279 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T22:51:24.279 INFO:teuthology.orchestra.run.smithi191.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T22:51:24.279 INFO:teuthology.orchestra.run.smithi191.stdout: mon pg warn max object skew = 0 2024-04-25T22:51:24.279 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T22:51:24.279 INFO:teuthology.orchestra.run.smithi191.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T22:51:24.280 INFO:teuthology.orchestra.run.smithi191.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T22:51:24.280 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T22:51:24.280 INFO:teuthology.orchestra.run.smithi191.stdout: osd pool default size = 2 2024-04-25T22:51:24.280 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T22:51:24.280 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd allow primary affinity = true 2024-04-25T22:51:24.280 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd allow pg remap = true 2024-04-25T22:51:24.280 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on legacy crush tunables = false 2024-04-25T22:51:24.280 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on crush straw calc version zero = false 2024-04-25T22:51:24.280 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on no sortbitwise = false 2024-04-25T22:51:24.280 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on osd down out interval zero = false 2024-04-25T22:51:24.280 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on too few osds = false 2024-04-25T22:51:24.280 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T22:51:24.280 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T22:51:24.280 INFO:teuthology.orchestra.run.smithi191.stdout: mon_allow_pool_size_one = true 2024-04-25T22:51:24.281 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T22:51:24.281 INFO:teuthology.orchestra.run.smithi191.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T22:51:24.281 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T22:51:24.281 INFO:teuthology.orchestra.run.smithi191.stdout: osd default data pool replay window = 5 2024-04-25T22:51:24.281 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T22:51:24.281 INFO:teuthology.orchestra.run.smithi191.stdout: mon allow pool delete = true 2024-04-25T22:51:24.281 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T22:51:24.281 INFO:teuthology.orchestra.run.smithi191.stdout: mon cluster log file level = debug 2024-04-25T22:51:24.281 INFO:teuthology.orchestra.run.smithi191.stdout: debug asserts on shutdown = true 2024-04-25T22:51:24.281 INFO:teuthology.orchestra.run.smithi191.stdout: mon health detail to clog = false 2024-04-25T22:51:24.281 INFO:teuthology.orchestra.run.smithi191.stdout: mon host = "172.21.15.52,[v2:172.21.15.52:3301,v1:172.21.15.52:6790],[v2:172.21.15.52:3302,v1:172.21.15.52:6791]" 2024-04-25T22:51:24.281 INFO:teuthology.orchestra.run.smithi191.stdout: fsid = 5355b70e-3f7d-4bce-8676-89cee61d2089 2024-04-25T22:51:24.281 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T22:51:24.281 INFO:teuthology.orchestra.run.smithi191.stdout:[osd] 2024-04-25T22:51:24.282 INFO:teuthology.orchestra.run.smithi191.stdout: osd journal size = 100 2024-04-25T22:51:24.282 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T22:51:24.282 INFO:teuthology.orchestra.run.smithi191.stdout: osd scrub load threshold = 5.0 2024-04-25T22:51:24.282 INFO:teuthology.orchestra.run.smithi191.stdout: osd scrub max interval = 600 2024-04-25T22:51:24.282 INFO:teuthology.orchestra.run.smithi191.stdout: osd mclock profile = high_recovery_ops 2024-04-25T22:51:24.282 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T22:51:24.282 INFO:teuthology.orchestra.run.smithi191.stdout: osd recover clone overlap = true 2024-04-25T22:51:24.282 INFO:teuthology.orchestra.run.smithi191.stdout: osd recovery max chunk = 1048576 2024-04-25T22:51:24.282 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T22:51:24.282 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug shutdown = true 2024-04-25T22:51:24.282 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug op order = true 2024-04-25T22:51:24.282 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug verify stray on activate = true 2024-04-25T22:51:24.282 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug trim objects = true 2024-04-25T22:51:24.283 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T22:51:24.283 INFO:teuthology.orchestra.run.smithi191.stdout: osd open classes on start = true 2024-04-25T22:51:24.283 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug pg log writeout = true 2024-04-25T22:51:24.283 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T22:51:24.283 INFO:teuthology.orchestra.run.smithi191.stdout: osd deep scrub update digest min age = 30 2024-04-25T22:51:24.283 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T22:51:24.283 INFO:teuthology.orchestra.run.smithi191.stdout: osd map max advance = 10 2024-04-25T22:51:24.283 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T22:51:24.283 INFO:teuthology.orchestra.run.smithi191.stdout: journal zero on create = true 2024-04-25T22:51:24.283 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T22:51:24.283 INFO:teuthology.orchestra.run.smithi191.stdout: filestore ondisk finisher threads = 3 2024-04-25T22:51:24.283 INFO:teuthology.orchestra.run.smithi191.stdout: filestore apply finisher threads = 3 2024-04-25T22:51:24.283 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T22:51:24.283 INFO:teuthology.orchestra.run.smithi191.stdout: bdev debug aio = true 2024-04-25T22:51:24.283 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug misdirected ops = true 2024-04-25T22:51:24.284 INFO:teuthology.orchestra.run.smithi191.stdout: bdev async discard = True 2024-04-25T22:51:24.284 INFO:teuthology.orchestra.run.smithi191.stdout: bdev enable discard = True 2024-04-25T22:51:24.284 INFO:teuthology.orchestra.run.smithi191.stdout: bluestore block size = 96636764160 2024-04-25T22:51:24.284 INFO:teuthology.orchestra.run.smithi191.stdout: bluestore fsck on mount = True 2024-04-25T22:51:24.284 INFO:teuthology.orchestra.run.smithi191.stdout: debug bluefs = 1/20 2024-04-25T22:51:24.284 INFO:teuthology.orchestra.run.smithi191.stdout: debug bluestore = 1/20 2024-04-25T22:51:24.284 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2024-04-25T22:51:24.284 INFO:teuthology.orchestra.run.smithi191.stdout: debug osd = 20 2024-04-25T22:51:24.284 INFO:teuthology.orchestra.run.smithi191.stdout: debug rocksdb = 4/10 2024-04-25T22:51:24.284 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T22:51:24.284 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd full ratio = 0.9 2024-04-25T22:51:24.284 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd nearfull ratio = 0.8 2024-04-25T22:51:24.284 INFO:teuthology.orchestra.run.smithi191.stdout: osd blocked scrub grace period = 3600 2024-04-25T22:51:24.284 INFO:teuthology.orchestra.run.smithi191.stdout: osd failsafe full ratio = 0.95 2024-04-25T22:51:24.285 INFO:teuthology.orchestra.run.smithi191.stdout: osd max markdown count = 1000 2024-04-25T22:51:24.285 INFO:teuthology.orchestra.run.smithi191.stdout: osd memory target = 1610612736 2024-04-25T22:51:24.285 INFO:teuthology.orchestra.run.smithi191.stdout: osd objectstore = bluestore 2024-04-25T22:51:24.285 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T22:51:24.285 INFO:teuthology.orchestra.run.smithi191.stdout:[mgr] 2024-04-25T22:51:24.285 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2024-04-25T22:51:24.285 INFO:teuthology.orchestra.run.smithi191.stdout: debug mgr = 20 2024-04-25T22:51:24.285 INFO:teuthology.orchestra.run.smithi191.stdout: debug mon = 20 2024-04-25T22:51:24.285 INFO:teuthology.orchestra.run.smithi191.stdout: debug auth = 20 2024-04-25T22:51:24.285 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min pgs per osd = 4 2024-04-25T22:51:24.285 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min bytes per osd = 10 2024-04-25T22:51:24.285 INFO:teuthology.orchestra.run.smithi191.stdout: mgr/telemetry/nag = false 2024-04-25T22:51:24.285 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T22:51:24.285 INFO:teuthology.orchestra.run.smithi191.stdout:[mon] 2024-04-25T22:51:24.286 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2024-04-25T22:51:24.286 INFO:teuthology.orchestra.run.smithi191.stdout: debug mon = 20 2024-04-25T22:51:24.286 INFO:teuthology.orchestra.run.smithi191.stdout: debug paxos = 20 2024-04-25T22:51:24.286 INFO:teuthology.orchestra.run.smithi191.stdout: debug auth = 20 2024-04-25T22:51:24.286 INFO:teuthology.orchestra.run.smithi191.stdout: mon data avail warn = 5 2024-04-25T22:51:24.286 INFO:teuthology.orchestra.run.smithi191.stdout: mon mgr mkfs grace = 240 2024-04-25T22:51:24.286 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min pgs per osd = 4 2024-04-25T22:51:24.286 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd reporter subtree level = osd 2024-04-25T22:51:24.286 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd prime pg temp = true 2024-04-25T22:51:24.286 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min bytes per osd = 10 2024-04-25T22:51:24.286 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T22:51:24.286 INFO:teuthology.orchestra.run.smithi191.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T22:51:24.286 INFO:teuthology.orchestra.run.smithi191.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T22:51:24.286 INFO:teuthology.orchestra.run.smithi191.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T22:51:24.287 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T22:51:24.287 INFO:teuthology.orchestra.run.smithi191.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T22:51:24.287 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T22:51:24.287 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T22:51:24.287 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T22:51:24.287 INFO:teuthology.orchestra.run.smithi191.stdout: # 1m isn't quite enough 2024-04-25T22:51:24.287 INFO:teuthology.orchestra.run.smithi191.stdout: mon_down_mkfs_grace = 2m 2024-04-25T22:51:24.287 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T22:51:24.287 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_filestore_osds = false 2024-04-25T22:51:24.287 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T22:51:24.287 INFO:teuthology.orchestra.run.smithi191.stdout:[client] 2024-04-25T22:51:24.287 INFO:teuthology.orchestra.run.smithi191.stdout: rgw cache enabled = true 2024-04-25T22:51:24.287 INFO:teuthology.orchestra.run.smithi191.stdout: rgw enable ops log = true 2024-04-25T22:51:24.288 INFO:teuthology.orchestra.run.smithi191.stdout: rgw enable usage log = true 2024-04-25T22:51:24.288 INFO:teuthology.orchestra.run.smithi191.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T22:51:24.288 INFO:teuthology.orchestra.run.smithi191.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T22:51:24.288 INFO:teuthology.orchestra.run.smithi191.stdout:[mon.a] 2024-04-25T22:51:24.288 INFO:teuthology.orchestra.run.smithi191.stdout:[mon.b] 2024-04-25T22:51:24.288 INFO:teuthology.orchestra.run.smithi191.stdout:[mon.c] 2024-04-25T22:51:24.288 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.a] 2024-04-25T22:51:24.288 INFO:teuthology.orchestra.run.smithi110.stdout:[global] 2024-04-25T22:51:24.288 INFO:teuthology.orchestra.run.smithi110.stdout: chdir = "" 2024-04-25T22:51:24.288 INFO:teuthology.orchestra.run.smithi110.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T22:51:24.288 INFO:teuthology.orchestra.run.smithi110.stdout: auth supported = cephx 2024-04-25T22:51:24.288 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-25T22:51:24.289 INFO:teuthology.orchestra.run.smithi110.stdout: filestore xattr use omap = true 2024-04-25T22:51:24.289 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-25T22:51:24.289 INFO:teuthology.orchestra.run.smithi110.stdout: mon clock drift allowed = 1.000 2024-04-25T22:51:24.289 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-25T22:51:24.289 INFO:teuthology.orchestra.run.smithi110.stdout: osd crush chooseleaf type = 0 2024-04-25T22:51:24.289 INFO:teuthology.orchestra.run.smithi110.stdout: auth debug = true 2024-04-25T22:51:24.289 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-25T22:51:24.289 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on old message = true 2024-04-25T22:51:24.289 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on bug = true 2024-04-25T22:51:24.289 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-25T22:51:24.289 INFO:teuthology.orchestra.run.smithi110.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T22:51:24.289 INFO:teuthology.orchestra.run.smithi110.stdout: mon pg warn max object skew = 0 2024-04-25T22:51:24.289 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-25T22:51:24.289 INFO:teuthology.orchestra.run.smithi110.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T22:51:24.289 INFO:teuthology.orchestra.run.smithi110.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T22:51:24.290 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-25T22:51:24.290 INFO:teuthology.orchestra.run.smithi110.stdout: osd pool default size = 2 2024-04-25T22:51:24.290 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-25T22:51:24.290 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd allow primary affinity = true 2024-04-25T22:51:24.290 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd allow pg remap = true 2024-04-25T22:51:24.290 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on legacy crush tunables = false 2024-04-25T22:51:24.290 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on crush straw calc version zero = false 2024-04-25T22:51:24.290 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on no sortbitwise = false 2024-04-25T22:51:24.290 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on osd down out interval zero = false 2024-04-25T22:51:24.290 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on too few osds = false 2024-04-25T22:51:24.290 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T22:51:24.290 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T22:51:24.290 INFO:teuthology.orchestra.run.smithi110.stdout: mon_allow_pool_size_one = true 2024-04-25T22:51:24.291 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-25T22:51:24.291 INFO:teuthology.orchestra.run.smithi110.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T22:51:24.291 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-25T22:51:24.291 INFO:teuthology.orchestra.run.smithi110.stdout: osd default data pool replay window = 5 2024-04-25T22:51:24.291 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-25T22:51:24.291 INFO:teuthology.orchestra.run.smithi110.stdout: mon allow pool delete = true 2024-04-25T22:51:24.291 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-25T22:51:24.291 INFO:teuthology.orchestra.run.smithi110.stdout: mon cluster log file level = debug 2024-04-25T22:51:24.291 INFO:teuthology.orchestra.run.smithi110.stdout: debug asserts on shutdown = true 2024-04-25T22:51:24.291 INFO:teuthology.orchestra.run.smithi110.stdout: mon health detail to clog = false 2024-04-25T22:51:24.291 INFO:teuthology.orchestra.run.smithi110.stdout: mon host = "172.21.15.52,[v2:172.21.15.52:3301,v1:172.21.15.52:6790],[v2:172.21.15.52:3302,v1:172.21.15.52:6791]" 2024-04-25T22:51:24.291 INFO:teuthology.orchestra.run.smithi110.stdout: fsid = 5355b70e-3f7d-4bce-8676-89cee61d2089 2024-04-25T22:51:24.291 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-25T22:51:24.291 INFO:teuthology.orchestra.run.smithi110.stdout:[osd] 2024-04-25T22:51:24.291 INFO:teuthology.orchestra.run.smithi110.stdout: osd journal size = 100 2024-04-25T22:51:24.292 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-25T22:51:24.292 INFO:teuthology.orchestra.run.smithi110.stdout: osd scrub load threshold = 5.0 2024-04-25T22:51:24.292 INFO:teuthology.orchestra.run.smithi110.stdout: osd scrub max interval = 600 2024-04-25T22:51:24.292 INFO:teuthology.orchestra.run.smithi110.stdout: osd mclock profile = high_recovery_ops 2024-04-25T22:51:24.292 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-25T22:51:24.292 INFO:teuthology.orchestra.run.smithi110.stdout: osd recover clone overlap = true 2024-04-25T22:51:24.292 INFO:teuthology.orchestra.run.smithi110.stdout: osd recovery max chunk = 1048576 2024-04-25T22:51:24.292 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-25T22:51:24.292 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug shutdown = true 2024-04-25T22:51:24.292 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug op order = true 2024-04-25T22:51:24.292 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug verify stray on activate = true 2024-04-25T22:51:24.292 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug trim objects = true 2024-04-25T22:51:24.292 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-25T22:51:24.292 INFO:teuthology.orchestra.run.smithi110.stdout: osd open classes on start = true 2024-04-25T22:51:24.293 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug pg log writeout = true 2024-04-25T22:51:24.293 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-25T22:51:24.293 INFO:teuthology.orchestra.run.smithi110.stdout: osd deep scrub update digest min age = 30 2024-04-25T22:51:24.293 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-25T22:51:24.293 INFO:teuthology.orchestra.run.smithi110.stdout: osd map max advance = 10 2024-04-25T22:51:24.293 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-25T22:51:24.293 INFO:teuthology.orchestra.run.smithi110.stdout: journal zero on create = true 2024-04-25T22:51:24.293 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-25T22:51:24.293 INFO:teuthology.orchestra.run.smithi110.stdout: filestore ondisk finisher threads = 3 2024-04-25T22:51:24.293 INFO:teuthology.orchestra.run.smithi110.stdout: filestore apply finisher threads = 3 2024-04-25T22:51:24.293 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-25T22:51:24.293 INFO:teuthology.orchestra.run.smithi110.stdout: bdev debug aio = true 2024-04-25T22:51:24.293 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug misdirected ops = true 2024-04-25T22:51:24.293 INFO:teuthology.orchestra.run.smithi110.stdout: bdev async discard = True 2024-04-25T22:51:24.294 INFO:teuthology.orchestra.run.smithi110.stdout: bdev enable discard = True 2024-04-25T22:51:24.294 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore block size = 96636764160 2024-04-25T22:51:24.294 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore fsck on mount = True 2024-04-25T22:51:24.294 INFO:teuthology.orchestra.run.smithi110.stdout: debug bluefs = 1/20 2024-04-25T22:51:24.294 INFO:teuthology.orchestra.run.smithi110.stdout: debug bluestore = 1/20 2024-04-25T22:51:24.294 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-04-25T22:51:24.294 INFO:teuthology.orchestra.run.smithi110.stdout: debug osd = 20 2024-04-25T22:51:24.294 INFO:teuthology.orchestra.run.smithi110.stdout: debug rocksdb = 4/10 2024-04-25T22:51:24.294 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T22:51:24.294 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd full ratio = 0.9 2024-04-25T22:51:24.294 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd nearfull ratio = 0.8 2024-04-25T22:51:24.294 INFO:teuthology.orchestra.run.smithi110.stdout: osd blocked scrub grace period = 3600 2024-04-25T22:51:24.294 INFO:teuthology.orchestra.run.smithi110.stdout: osd failsafe full ratio = 0.95 2024-04-25T22:51:24.294 INFO:teuthology.orchestra.run.smithi110.stdout: osd max markdown count = 1000 2024-04-25T22:51:24.295 INFO:teuthology.orchestra.run.smithi110.stdout: osd memory target = 1610612736 2024-04-25T22:51:24.295 INFO:teuthology.orchestra.run.smithi110.stdout: osd objectstore = bluestore 2024-04-25T22:51:24.295 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-25T22:51:24.295 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr] 2024-04-25T22:51:24.295 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-04-25T22:51:24.295 INFO:teuthology.orchestra.run.smithi110.stdout: debug mgr = 20 2024-04-25T22:51:24.295 INFO:teuthology.orchestra.run.smithi110.stdout: debug mon = 20 2024-04-25T22:51:24.295 INFO:teuthology.orchestra.run.smithi110.stdout: debug auth = 20 2024-04-25T22:51:24.295 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min pgs per osd = 4 2024-04-25T22:51:24.295 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min bytes per osd = 10 2024-04-25T22:51:24.295 INFO:teuthology.orchestra.run.smithi110.stdout: mgr/telemetry/nag = false 2024-04-25T22:51:24.295 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-25T22:51:24.295 INFO:teuthology.orchestra.run.smithi110.stdout:[mon] 2024-04-25T22:51:24.295 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-04-25T22:51:24.296 INFO:teuthology.orchestra.run.smithi110.stdout: debug mon = 20 2024-04-25T22:51:24.296 INFO:teuthology.orchestra.run.smithi110.stdout: debug paxos = 20 2024-04-25T22:51:24.296 INFO:teuthology.orchestra.run.smithi110.stdout: debug auth = 20 2024-04-25T22:51:24.296 INFO:teuthology.orchestra.run.smithi110.stdout: mon data avail warn = 5 2024-04-25T22:51:24.296 INFO:teuthology.orchestra.run.smithi110.stdout: mon mgr mkfs grace = 240 2024-04-25T22:51:24.296 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min pgs per osd = 4 2024-04-25T22:51:24.296 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd reporter subtree level = osd 2024-04-25T22:51:24.296 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd prime pg temp = true 2024-04-25T22:51:24.296 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min bytes per osd = 10 2024-04-25T22:51:24.296 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-25T22:51:24.296 INFO:teuthology.orchestra.run.smithi110.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T22:51:24.296 INFO:teuthology.orchestra.run.smithi110.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T22:51:24.296 INFO:teuthology.orchestra.run.smithi110.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T22:51:24.296 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-25T22:51:24.296 INFO:teuthology.orchestra.run.smithi110.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T22:51:24.297 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T22:51:24.297 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T22:51:24.297 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-25T22:51:24.297 INFO:teuthology.orchestra.run.smithi110.stdout: # 1m isn't quite enough 2024-04-25T22:51:24.297 INFO:teuthology.orchestra.run.smithi110.stdout: mon_down_mkfs_grace = 2m 2024-04-25T22:51:24.297 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-25T22:51:24.297 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_filestore_osds = false 2024-04-25T22:51:24.297 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-25T22:51:24.297 INFO:teuthology.orchestra.run.smithi110.stdout:[client] 2024-04-25T22:51:24.297 INFO:teuthology.orchestra.run.smithi110.stdout: rgw cache enabled = true 2024-04-25T22:51:24.297 INFO:teuthology.orchestra.run.smithi110.stdout: rgw enable ops log = true 2024-04-25T22:51:24.297 INFO:teuthology.orchestra.run.smithi110.stdout: rgw enable usage log = true 2024-04-25T22:51:24.297 INFO:teuthology.orchestra.run.smithi110.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T22:51:24.297 INFO:teuthology.orchestra.run.smithi110.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T22:51:24.298 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.a] 2024-04-25T22:51:24.298 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.b] 2024-04-25T22:51:24.298 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.c] 2024-04-25T22:51:24.298 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.a] 2024-04-25T22:51:24.300 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-25T22:51:24.300 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-25T22:51:24.393 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-25T22:51:24.393 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-25T22:51:24.393 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-25T22:51:24.409 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-25T22:51:24.409 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-25T22:51:24.464 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi052.front.sepia.ceph.com 2024-04-25T22:51:24.464 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-25T22:51:24.464 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T22:51:24.464 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T22:51:24.538 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-25T22:51:24.538 DEBUG:teuthology.orchestra.run.smithi052:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T22:51:24.593 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi110.front.sepia.ceph.com 2024-04-25T22:51:24.594 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-25T22:51:24.594 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T22:51:24.594 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T22:51:24.631 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-25T22:51:24.631 DEBUG:teuthology.orchestra.run.smithi110:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T22:51:24.688 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi164.front.sepia.ceph.com 2024-04-25T22:51:24.688 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-25T22:51:24.688 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T22:51:24.688 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T22:51:24.728 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-25T22:51:24.728 DEBUG:teuthology.orchestra.run.smithi164:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T22:51:24.785 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi191.front.sepia.ceph.com 2024-04-25T22:51:24.785 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-25T22:51:24.785 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T22:51:24.785 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T22:51:24.821 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-25T22:51:24.821 DEBUG:teuthology.orchestra.run.smithi191:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T22:51:24.877 INFO:tasks.ceph:Setting up mon nodes... 2024-04-25T22:51:24.877 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-25T22:51:24.878 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T22:51:24.929 INFO:teuthology.orchestra.run.smithi052.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T22:51:24.931 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T22:51:24.981 INFO:teuthology.orchestra.run.smithi052.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T22:51:24.983 INFO:tasks.ceph:Setting up mds nodes... 2024-04-25T22:51:24.984 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T22:51:25.034 INFO:teuthology.orchestra.run.smithi052.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T22:51:25.036 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-25T22:51:25.060 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-25T22:51:25.060 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-25T22:51:25.140 INFO:teuthology.orchestra.run.smithi052.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-25T22:51:25.152 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-25T22:51:25.153 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi110.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi164.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi191.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-04-25T22:51:25.153 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-25T22:51:25.180 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-25T22:51:25.181 INFO:tasks.ceph:role: osd.0 2024-04-25T22:51:25.181 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi110.front.sepia.ceph.com 2024-04-25T22:51:25.181 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T22:51:25.249 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T22:51:25.249 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T22:51:25.249 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T22:51:25.249 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T22:51:25.249 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T22:51:25.249 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2024-04-25T22:51:25.249 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T22:51:25.249 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T22:51:25.250 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T22:51:25.250 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T22:51:25.281 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2024-04-25T22:51:25.283 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2024-04-25T22:51:25.283 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-25T22:51:25.353 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-25T22:51:25.423 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T22:51:25.547 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-25T22:51:25.545+0000 7fc450701640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-25T22:51:25.547 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-25T22:51:25.545+0000 7fc450701640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-25T22:51:25.547 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-25T22:51:25.545+0000 7fc450701640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T22:51:25.547 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-25T22:51:25.545+0000 7fc450701640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T22:51:25.547 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-25T22:51:25.545+0000 7fc450701640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T22:51:25.547 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-25T22:51:25.546+0000 7fc450701640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-25T22:51:28.391 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-25T22:51:28.419 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-25T22:51:28.447 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-04-25T22:51:28.448 INFO:tasks.ceph:role: osd.1 2024-04-25T22:51:28.448 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi164.front.sepia.ceph.com 2024-04-25T22:51:28.448 DEBUG:teuthology.orchestra.run.smithi164:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T22:51:28.521 INFO:teuthology.orchestra.run.smithi164.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T22:51:28.521 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T22:51:28.522 INFO:teuthology.orchestra.run.smithi164.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T22:51:28.522 INFO:teuthology.orchestra.run.smithi164.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T22:51:28.522 INFO:teuthology.orchestra.run.smithi164.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T22:51:28.522 INFO:teuthology.orchestra.run.smithi164.stdout: = sunit=0 swidth=0 blks 2024-04-25T22:51:28.522 INFO:teuthology.orchestra.run.smithi164.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T22:51:28.522 INFO:teuthology.orchestra.run.smithi164.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T22:51:28.522 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T22:51:28.522 INFO:teuthology.orchestra.run.smithi164.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T22:51:29.048 INFO:teuthology.orchestra.run.smithi164.stdout:Discarding blocks...Done. 2024-04-25T22:51:29.051 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi164.front.sepia.ceph.com -o noatime 2024-04-25T22:51:29.051 DEBUG:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-04-25T22:51:29.166 DEBUG:teuthology.orchestra.run.smithi164:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-25T22:51:29.196 DEBUG:teuthology.orchestra.run.smithi164:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T22:51:29.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-25T22:51:29.299+0000 7f01e94db640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-25T22:51:29.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-25T22:51:29.302+0000 7f01e94db640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-25T22:51:29.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-25T22:51:29.302+0000 7f01e94db640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T22:51:29.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-25T22:51:29.302+0000 7f01e94db640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T22:51:29.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-25T22:51:29.302+0000 7f01e94db640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T22:51:29.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-25T22:51:29.309+0000 7f01e94db640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-25T22:51:32.151 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-25T22:51:32.178 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-25T22:51:32.207 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-04-25T22:51:32.208 INFO:tasks.ceph:role: osd.2 2024-04-25T22:51:32.208 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi191.front.sepia.ceph.com 2024-04-25T22:51:32.208 DEBUG:teuthology.orchestra.run.smithi191:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T22:51:32.281 INFO:teuthology.orchestra.run.smithi191.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T22:51:32.282 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T22:51:32.282 INFO:teuthology.orchestra.run.smithi191.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T22:51:32.282 INFO:teuthology.orchestra.run.smithi191.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T22:51:32.282 INFO:teuthology.orchestra.run.smithi191.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T22:51:32.282 INFO:teuthology.orchestra.run.smithi191.stdout: = sunit=0 swidth=0 blks 2024-04-25T22:51:32.282 INFO:teuthology.orchestra.run.smithi191.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T22:51:32.282 INFO:teuthology.orchestra.run.smithi191.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T22:51:32.282 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T22:51:32.282 INFO:teuthology.orchestra.run.smithi191.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T22:51:32.797 INFO:teuthology.orchestra.run.smithi191.stdout:Discarding blocks...Done. 2024-04-25T22:51:32.799 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi191.front.sepia.ceph.com -o noatime 2024-04-25T22:51:32.799 DEBUG:teuthology.orchestra.run.smithi191:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-04-25T22:51:32.942 DEBUG:teuthology.orchestra.run.smithi191:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-25T22:51:32.979 DEBUG:teuthology.orchestra.run.smithi191:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T22:51:33.079 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T22:51:33.077+0000 7f1e3cce3640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-25T22:51:33.081 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T22:51:33.079+0000 7f1e3cce3640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-25T22:51:33.081 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T22:51:33.079+0000 7f1e3cce3640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T22:51:33.081 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T22:51:33.079+0000 7f1e3cce3640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T22:51:33.081 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T22:51:33.079+0000 7f1e3cce3640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T22:51:33.087 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T22:51:33.086+0000 7f1e3cce3640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-25T22:51:35.932 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-25T22:51:36.004 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-25T22:51:36.004 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-25T22:51:36.004 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-25T22:51:36.034 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-25T22:51:36.034 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-25T22:51:36.102 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-25T22:51:36.102 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-25T22:51:36.170 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-25T22:51:36.170 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-25T22:51:36.198 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-25T22:51:36.198 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-25T22:51:36.227 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-25T22:51:36.227 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-25T22:51:36.255 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-25T22:51:36.255 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-25T22:51:36.272 INFO:tasks.ceph:Adding keys to all mons... 2024-04-25T22:51:36.272 DEBUG:teuthology.orchestra.run.smithi052:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T22:51:36.337 INFO:teuthology.orchestra.run.smithi052.stdout:[mgr.x] 2024-04-25T22:51:36.338 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBs3ipmvVplNxAAY9uxxngUzEjiXtLIJ7+JJA== 2024-04-25T22:51:36.338 INFO:teuthology.orchestra.run.smithi052.stdout:[mgr.y] 2024-04-25T22:51:36.338 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBs3ipmlcSAOhAA/S+GAyU6FtyXYo4jqOQBhg== 2024-04-25T22:51:36.338 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.a] 2024-04-25T22:51:36.338 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBt3ipmEh0KAhAAKHr7ZHfJ0e/v5IgRia9vJw== 2024-04-25T22:51:36.338 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.0] 2024-04-25T22:51:36.338 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBt3ipmAeiTIBAAiW94+KglRACNiDSZEIT29w== 2024-04-25T22:51:36.338 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.1] 2024-04-25T22:51:36.338 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBx3ipmljPhERAA2Y1uSl79NiHWEe5QCRTtrQ== 2024-04-25T22:51:36.338 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.2] 2024-04-25T22:51:36.338 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQB13ipml165BBAA7/1z/MH7t+Kd5d9fHjw+HA== 2024-04-25T22:51:36.339 INFO:teuthology.orchestra.run.smithi052.stdout:[client.0] 2024-04-25T22:51:36.339 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBt3ipm/0ZkCBAAHDhz1HxVSKROD5wFld0kdw== 2024-04-25T22:51:36.340 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T22:51:36.434 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T22:51:36.486 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T22:51:36.540 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T22:51:36.589 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T22:51:36.639 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T22:51:36.689 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T22:51:36.741 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-25T22:51:36.741 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-25T22:51:36.765 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T22:51:36.859 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-25T22:51:36.884 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-25T22:51:36.948 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T22:51:37.045 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-25T22:51:37.070 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-25T22:51:37.135 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T22:51:37.231 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-25T22:51:37.255 DEBUG:teuthology.orchestra.run.smithi052:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T22:51:37.311 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-25T22:51:37.312 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-25T22:51:37.312 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-25T22:51:37.355 INFO:tasks.ceph.mon.a:Started 2024-04-25T22:51:37.356 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-25T22:51:37.356 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-25T22:51:37.358 INFO:tasks.ceph.mon.b:Started 2024-04-25T22:51:37.358 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-25T22:51:37.358 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-25T22:51:37.360 INFO:tasks.ceph.mon.c:Started 2024-04-25T22:51:37.360 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-25T22:51:37.360 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-25T22:51:37.360 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-25T22:51:37.362 INFO:tasks.ceph.mgr.x:Started 2024-04-25T22:51:37.362 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-25T22:51:37.363 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-25T22:51:37.365 INFO:tasks.ceph.mgr.y:Started 2024-04-25T22:51:37.365 INFO:tasks.ceph:Setting crush tunables to default 2024-04-25T22:51:37.365 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph osd crush tunables default 2024-04-25T22:51:37.801 INFO:teuthology.orchestra.run.smithi052.stderr:adjusted tunables profile to default 2024-04-25T22:51:37.812 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-25T22:51:37.811+0000 7fcb3c80d040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T22:51:37.816 INFO:tasks.ceph:check_enable_crimson: False 2024-04-25T22:51:37.816 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-25T22:51:37.817 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-25T22:51:37.817 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-25T22:51:37.845 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-25T22:51:37.845 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-25T22:51:37.873 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-25T22:51:37.873 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-25T22:51:37.901 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new b785a86a-6391-4a0d-8aec-c2016380832e 0 2024-04-25T22:51:37.960 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-25T22:51:37.959+0000 7fcb3c80d040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T22:51:38.016 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-25T22:51:38.015+0000 7fcb3c80d040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T22:51:38.124 INFO:teuthology.orchestra.run.smithi191.stdout:0 2024-04-25T22:51:38.135 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new 088b4733-ccbd-41a6-8a31-8d811169c28a 1 2024-04-25T22:51:38.166 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-25T22:51:38.166+0000 7f33dc081040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T22:51:38.277 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-25T22:51:38.277+0000 7fcb3c80d040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T22:51:38.298 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-25T22:51:38.298+0000 7f33dc081040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T22:51:38.307 INFO:teuthology.orchestra.run.smithi191.stdout:1 2024-04-25T22:51:38.319 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new 6a6aad8c-22ac-45c0-baf9-928314e7fef9 2 2024-04-25T22:51:38.326 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-25T22:51:38.326+0000 7fcb3c80d040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T22:51:38.348 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-25T22:51:38.348+0000 7f33dc081040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T22:51:38.494 INFO:teuthology.orchestra.run.smithi191.stdout:2 2024-04-25T22:51:38.505 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-25T22:51:38.505 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-25T22:51:38.508 INFO:tasks.ceph.osd.0:Started 2024-04-25T22:51:38.508 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-25T22:51:38.508 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-25T22:51:38.511 INFO:tasks.ceph.osd.1:Started 2024-04-25T22:51:38.511 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-25T22:51:38.511 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-25T22:51:38.513 INFO:tasks.ceph.osd.2:Started 2024-04-25T22:51:38.514 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:51:38.568 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-25T22:51:38.568+0000 7f33dc081040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T22:51:38.615 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-25T22:51:38.615+0000 7f33dc081040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T22:51:38.688 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:51:38.688 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":5,"fsid":"5355b70e-3f7d-4bce-8676-89cee61d2089","created":"2024-04-25T22:51:37.688525+0000","modified":"2024-04-25T22:51:38.491924+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T22:51:38.491924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b785a86a-6391-4a0d-8aec-c2016380832e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"088b4733-ccbd-41a6-8a31-8d811169c28a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6a6aad8c-22ac-45c0-baf9-928314e7fef9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:51:38.701 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-25T22:51:38.701 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-25T22:51:39.004 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T22:51:39.060 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-25T22:51:39.060+0000 7fcb3c80d040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T22:51:39.097 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:51:39.096+0000 7f554121c640 -1 Falling back to public interface 2024-04-25T22:51:39.102 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:51:39.100+0000 7fabed20c640 -1 Falling back to public interface 2024-04-25T22:51:39.105 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:51:39.103+0000 7f682fe86640 -1 Falling back to public interface 2024-04-25T22:51:39.136 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-25T22:51:39.136+0000 7f33dc081040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T22:51:39.156 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-25T22:51:39.155+0000 7fcb3c80d040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T22:51:39.170 INFO:teuthology.misc.health.smithi052.stdout: 2024-04-25T22:51:39.170 INFO:teuthology.misc.health.smithi052.stdout:{"epoch":5,"fsid":"5355b70e-3f7d-4bce-8676-89cee61d2089","created":"2024-04-25T22:51:37.688525+0000","modified":"2024-04-25T22:51:38.491924+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T22:51:38.491924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b785a86a-6391-4a0d-8aec-c2016380832e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"088b4733-ccbd-41a6-8a31-8d811169c28a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6a6aad8c-22ac-45c0-baf9-928314e7fef9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:51:39.180 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-04-25T22:51:39.202 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-25T22:51:39.202+0000 7fcb3c80d040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T22:51:39.227 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-25T22:51:39.227+0000 7f33dc081040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T22:51:39.271 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-25T22:51:39.271+0000 7f33dc081040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T22:51:39.377 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-25T22:51:39.377+0000 7fcb3c80d040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T22:51:39.427 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-25T22:51:39.427+0000 7fcb3c80d040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T22:51:39.444 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-25T22:51:39.444+0000 7f33dc081040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T22:51:39.483 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-25T22:51:39.483+0000 7fcb3c80d040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T22:51:39.491 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-25T22:51:39.491+0000 7f33dc081040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T22:51:39.543 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-25T22:51:39.543+0000 7f33dc081040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T22:51:39.602 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-25T22:51:39.602+0000 7fcb3c80d040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T22:51:39.660 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-25T22:51:39.660+0000 7f33dc081040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T22:51:40.007 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-25T22:51:40.007+0000 7fcb3c80d040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T22:51:40.019 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-25T22:51:40.018+0000 7f33dc081040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T22:51:40.282 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-25T22:51:40.281+0000 7f33dc081040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T22:51:40.282 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-25T22:51:40.282+0000 7fcb3c80d040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T22:51:40.337 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-25T22:51:40.337+0000 7fcb3c80d040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T22:51:40.338 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-25T22:51:40.337+0000 7f33dc081040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T22:51:40.460 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-25T22:51:40.460+0000 7fcb3c80d040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T22:51:40.461 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-25T22:51:40.460+0000 7f33dc081040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T22:51:40.753 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-25T22:51:40.753+0000 7fcb3c80d040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T22:51:40.754 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-25T22:51:40.753+0000 7f33dc081040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T22:51:40.804 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-25T22:51:40.803+0000 7f33dc081040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T22:51:40.804 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-25T22:51:40.803+0000 7fcb3c80d040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T22:51:40.969 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-25T22:51:40.969+0000 7fcb3c80d040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T22:51:40.970 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-25T22:51:40.970+0000 7f33dc081040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T22:51:41.115 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-25T22:51:41.114+0000 7f33dc081040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T22:51:41.115 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-25T22:51:41.114+0000 7fcb3c80d040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T22:51:41.167 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-25T22:51:41.167+0000 7fcb3c80d040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T22:51:41.167 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-25T22:51:41.167+0000 7f33dc081040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T22:51:41.242 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-25T22:51:41.241+0000 7f33dc081040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T22:51:41.242 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-25T22:51:41.242+0000 7fcb3c80d040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T22:51:41.289 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-25T22:51:41.289+0000 7f33dc081040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T22:51:41.290 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-25T22:51:41.289+0000 7fcb3c80d040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T22:51:41.796 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-25T22:51:41.796+0000 7f33dc081040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T22:51:41.796 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-25T22:51:41.796+0000 7fcb3c80d040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T22:51:41.918 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-25T22:51:41.918+0000 7fcb3c80d040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T22:51:41.919 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-25T22:51:41.918+0000 7f33dc081040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T22:51:42.533 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:51:42.532+0000 7fabed20c640 -1 osd.0 0 log_to_monitors true 2024-04-25T22:51:42.534 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:51:42.532+0000 7f554121c640 -1 osd.2 0 log_to_monitors true 2024-04-25T22:51:42.546 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:51:42.545+0000 7f682fe86640 -1 osd.1 0 log_to_monitors true 2024-04-25T22:51:42.935 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-25T22:51:42.934+0000 7fcadd096640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-25T22:51:42.935 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-25T22:51:42.934+0000 7fcadd096640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-25T22:51:44.752 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:51:44.750+0000 7fabe82ac640 -1 osd.0 0 waiting for initial osdmap 2024-04-25T22:51:44.764 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:51:44.764+0000 7fabe08de640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T22:51:44.914 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:51:44.913+0000 7f553c2e9640 -1 osd.2 0 waiting for initial osdmap 2024-04-25T22:51:44.924 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:51:44.922+0000 7f682b5f9640 -1 osd.1 0 waiting for initial osdmap 2024-04-25T22:51:44.935 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:51:44.933+0000 7f6823c2b640 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T22:51:44.940 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:51:44.939+0000 7f553491b640 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T22:51:45.481 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T22:51:45.786 INFO:teuthology.misc.health.smithi052.stdout: 2024-04-25T22:51:45.787 INFO:teuthology.misc.health.smithi052.stdout:{"epoch":8,"fsid":"5355b70e-3f7d-4bce-8676-89cee61d2089","created":"2024-04-25T22:51:37.688525+0000","modified":"2024-04-25T22:51:45.753740+0000","last_up_change":"2024-04-25T22:51:45.753740+0000","last_in_change":"2024-04-25T22:51:38.491924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b785a86a-6391-4a0d-8aec-c2016380832e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6801","nonce":3666753097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6803","nonce":3666753097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6807","nonce":3666753097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6805","nonce":3666753097}]},"public_addr":"172.21.15.110:6801/3666753097","cluster_addr":"172.21.15.110:6803/3666753097","heartbeat_back_addr":"172.21.15.110:6807/3666753097","heartbeat_front_addr":"172.21.15.110:6805/3666753097","state":["exists","up"]},{"osd":1,"uuid":"088b4733-ccbd-41a6-8a31-8d811169c28a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":479301362},{"type":"v1","addr":"172.21.15.164:6801","nonce":479301362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":479301362},{"type":"v1","addr":"172.21.15.164:6803","nonce":479301362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":479301362},{"type":"v1","addr":"172.21.15.164:6807","nonce":479301362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":479301362},{"type":"v1","addr":"172.21.15.164:6805","nonce":479301362}]},"public_addr":"172.21.15.164:6801/479301362","cluster_addr":"172.21.15.164:6803/479301362","heartbeat_back_addr":"172.21.15.164:6807/479301362","heartbeat_front_addr":"172.21.15.164:6805/479301362","state":["exists","up"]},{"osd":2,"uuid":"6a6aad8c-22ac-45c0-baf9-928314e7fef9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6801","nonce":349040881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6803","nonce":349040881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6807","nonce":349040881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6805","nonce":349040881}]},"public_addr":"172.21.15.191:6801/349040881","cluster_addr":"172.21.15.191:6803/349040881","heartbeat_back_addr":"172.21.15.191:6807/349040881","heartbeat_front_addr":"172.21.15.191:6805/349040881","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:51:45.798 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-04-25T22:51:45.798 INFO:tasks.ceph:Creating RBD pool 2024-04-25T22:51:45.798 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-25T22:51:46.756 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'rbd' created 2024-04-25T22:51:46.771 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-25T22:51:47.757 INFO:teuthology.orchestra.run.smithi052.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-25T22:51:47.771 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-25T22:51:47.772 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T22:51:47.772 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T22:51:47.774 INFO:tasks.ceph.mds.a:Started 2024-04-25T22:51:47.774 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-25T22:51:47.774 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:51:47.853 INFO:tasks.ceph.mds.a.smithi052.stdout:starting mds.a at 2024-04-25T22:51:48.079 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:51:48.079 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":10,"fsid":"5355b70e-3f7d-4bce-8676-89cee61d2089","created":"2024-04-25T22:51:37.688525+0000","modified":"2024-04-25T22:51:47.755934+0000","last_up_change":"2024-04-25T22:51:45.753740+0000","last_in_change":"2024-04-25T22:51:38.491924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:51:45.966439+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:51:46.128416+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b785a86a-6391-4a0d-8aec-c2016380832e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6801","nonce":3666753097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6803","nonce":3666753097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6807","nonce":3666753097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6805","nonce":3666753097}]},"public_addr":"172.21.15.110:6801/3666753097","cluster_addr":"172.21.15.110:6803/3666753097","heartbeat_back_addr":"172.21.15.110:6807/3666753097","heartbeat_front_addr":"172.21.15.110:6805/3666753097","state":["exists","up"]},{"osd":1,"uuid":"088b4733-ccbd-41a6-8a31-8d811169c28a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":479301362},{"type":"v1","addr":"172.21.15.164:6801","nonce":479301362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":479301362},{"type":"v1","addr":"172.21.15.164:6803","nonce":479301362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":479301362},{"type":"v1","addr":"172.21.15.164:6807","nonce":479301362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":479301362},{"type":"v1","addr":"172.21.15.164:6805","nonce":479301362}]},"public_addr":"172.21.15.164:6801/479301362","cluster_addr":"172.21.15.164:6803/479301362","heartbeat_back_addr":"172.21.15.164:6807/479301362","heartbeat_front_addr":"172.21.15.164:6805/479301362","state":["exists","up"]},{"osd":2,"uuid":"6a6aad8c-22ac-45c0-baf9-928314e7fef9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6801","nonce":349040881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6803","nonce":349040881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6807","nonce":349040881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6805","nonce":349040881}]},"public_addr":"172.21.15.191:6801/349040881","cluster_addr":"172.21.15.191:6803/349040881","heartbeat_back_addr":"172.21.15.191:6807/349040881","heartbeat_front_addr":"172.21.15.191:6805/349040881","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:51:43.531709+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:51:43.589701+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:51:43.566226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:51:48.091 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T22:51:45.966439+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '10', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T22:51:46.128416+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '10', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T22:51:48.092 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T22:51:48.394 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2024-04-25T22:51:48.407 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T22:51:48.706 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2024-04-25T22:51:48.720 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T22:51:49.064 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:51:49.065 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4193,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6803/4196269333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":4196269333},{"type":"v1","addr":"172.21.15.52:6803","nonce":4196269333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-25T22:51:49.065 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 2 2024-04-25T22:51:49.078 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:51:49.374 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:51:49.375 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":11,"fsid":"5355b70e-3f7d-4bce-8676-89cee61d2089","created":"2024-04-25T22:51:37.688525+0000","modified":"2024-04-25T22:51:48.756885+0000","last_up_change":"2024-04-25T22:51:45.753740+0000","last_in_change":"2024-04-25T22:51:38.491924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:51:45.966439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:51:46.128416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b785a86a-6391-4a0d-8aec-c2016380832e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6801","nonce":3666753097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6803","nonce":3666753097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6807","nonce":3666753097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6805","nonce":3666753097}]},"public_addr":"172.21.15.110:6801/3666753097","cluster_addr":"172.21.15.110:6803/3666753097","heartbeat_back_addr":"172.21.15.110:6807/3666753097","heartbeat_front_addr":"172.21.15.110:6805/3666753097","state":["exists","up"]},{"osd":1,"uuid":"088b4733-ccbd-41a6-8a31-8d811169c28a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":479301362},{"type":"v1","addr":"172.21.15.164:6801","nonce":479301362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":479301362},{"type":"v1","addr":"172.21.15.164:6803","nonce":479301362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":479301362},{"type":"v1","addr":"172.21.15.164:6807","nonce":479301362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":479301362},{"type":"v1","addr":"172.21.15.164:6805","nonce":479301362}]},"public_addr":"172.21.15.164:6801/479301362","cluster_addr":"172.21.15.164:6803/479301362","heartbeat_back_addr":"172.21.15.164:6807/479301362","heartbeat_front_addr":"172.21.15.164:6805/479301362","state":["exists","up"]},{"osd":2,"uuid":"6a6aad8c-22ac-45c0-baf9-928314e7fef9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6801","nonce":349040881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6803","nonce":349040881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6807","nonce":349040881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6805","nonce":349040881}]},"public_addr":"172.21.15.191:6801/349040881","cluster_addr":"172.21.15.191:6803/349040881","heartbeat_back_addr":"172.21.15.191:6807/349040881","heartbeat_front_addr":"172.21.15.191:6805/349040881","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:51:43.531709+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:51:43.589701+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:51:43.566226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:51:49.387 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T22:51:45.966439+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T22:51:46.128416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T22:51:49.388 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T22:51:49.683 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2024-04-25T22:51:49.697 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T22:51:49.995 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2024-04-25T22:51:50.009 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T22:51:50.304 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:51:50.304 INFO:teuthology.orchestra.run.smithi052.stdout:[ 2024-04-25T22:51:50.304 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-25T22:51:50.304 INFO:teuthology.orchestra.run.smithi052.stdout: "poolnum": 1, 2024-04-25T22:51:50.305 INFO:teuthology.orchestra.run.smithi052.stdout: "poolname": ".mgr" 2024-04-25T22:51:50.305 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T22:51:50.305 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-25T22:51:50.305 INFO:teuthology.orchestra.run.smithi052.stdout: "poolnum": 2, 2024-04-25T22:51:50.305 INFO:teuthology.orchestra.run.smithi052.stdout: "poolname": "rbd" 2024-04-25T22:51:50.305 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-25T22:51:50.305 INFO:teuthology.orchestra.run.smithi052.stdout:] 2024-04-25T22:51:50.317 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T22:51:50.317 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T22:51:51.000 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' created 2024-04-25T22:51:51.015 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T22:51:52.005 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' created 2024-04-25T22:51:52.023 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T22:51:53.009 INFO:teuthology.orchestra.run.smithi052.stderr:new fs with metadata pool 3 and data pool 4 2024-04-25T22:51:53.028 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:51:53.329 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:51:53.329 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":14,"fsid":"5355b70e-3f7d-4bce-8676-89cee61d2089","created":"2024-04-25T22:51:37.688525+0000","modified":"2024-04-25T22:51:52.369175+0000","last_up_change":"2024-04-25T22:51:45.753740+0000","last_in_change":"2024-04-25T22:51:38.491924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:51:45.966439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:51:46.128416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:51:50.648525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:51:51.351497+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b785a86a-6391-4a0d-8aec-c2016380832e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6801","nonce":3666753097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6803","nonce":3666753097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6807","nonce":3666753097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6805","nonce":3666753097}]},"public_addr":"172.21.15.110:6801/3666753097","cluster_addr":"172.21.15.110:6803/3666753097","heartbeat_back_addr":"172.21.15.110:6807/3666753097","heartbeat_front_addr":"172.21.15.110:6805/3666753097","state":["exists","up"]},{"osd":1,"uuid":"088b4733-ccbd-41a6-8a31-8d811169c28a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":479301362},{"type":"v1","addr":"172.21.15.164:6801","nonce":479301362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":479301362},{"type":"v1","addr":"172.21.15.164:6803","nonce":479301362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":479301362},{"type":"v1","addr":"172.21.15.164:6807","nonce":479301362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":479301362},{"type":"v1","addr":"172.21.15.164:6805","nonce":479301362}]},"public_addr":"172.21.15.164:6801/479301362","cluster_addr":"172.21.15.164:6803/479301362","heartbeat_back_addr":"172.21.15.164:6807/479301362","heartbeat_front_addr":"172.21.15.164:6805/479301362","state":["exists","up"]},{"osd":2,"uuid":"6a6aad8c-22ac-45c0-baf9-928314e7fef9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6801","nonce":349040881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6803","nonce":349040881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6807","nonce":349040881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6805","nonce":349040881}]},"public_addr":"172.21.15.191:6801/349040881","cluster_addr":"172.21.15.191:6803/349040881","heartbeat_back_addr":"172.21.15.191:6807/349040881","heartbeat_front_addr":"172.21.15.191:6805/349040881","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:51:43.531709+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:51:43.589701+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:51:43.566226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:51:53.343 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:51:53.641 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:51:53.641 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":14,"fsid":"5355b70e-3f7d-4bce-8676-89cee61d2089","created":"2024-04-25T22:51:37.688525+0000","modified":"2024-04-25T22:51:52.369175+0000","last_up_change":"2024-04-25T22:51:45.753740+0000","last_in_change":"2024-04-25T22:51:38.491924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:51:45.966439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:51:46.128416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:51:50.648525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:51:51.351497+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b785a86a-6391-4a0d-8aec-c2016380832e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6801","nonce":3666753097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6803","nonce":3666753097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6807","nonce":3666753097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6805","nonce":3666753097}]},"public_addr":"172.21.15.110:6801/3666753097","cluster_addr":"172.21.15.110:6803/3666753097","heartbeat_back_addr":"172.21.15.110:6807/3666753097","heartbeat_front_addr":"172.21.15.110:6805/3666753097","state":["exists","up"]},{"osd":1,"uuid":"088b4733-ccbd-41a6-8a31-8d811169c28a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":479301362},{"type":"v1","addr":"172.21.15.164:6801","nonce":479301362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":479301362},{"type":"v1","addr":"172.21.15.164:6803","nonce":479301362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":479301362},{"type":"v1","addr":"172.21.15.164:6807","nonce":479301362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":479301362},{"type":"v1","addr":"172.21.15.164:6805","nonce":479301362}]},"public_addr":"172.21.15.164:6801/479301362","cluster_addr":"172.21.15.164:6803/479301362","heartbeat_back_addr":"172.21.15.164:6807/479301362","heartbeat_front_addr":"172.21.15.164:6805/479301362","state":["exists","up"]},{"osd":2,"uuid":"6a6aad8c-22ac-45c0-baf9-928314e7fef9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6801","nonce":349040881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6803","nonce":349040881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6807","nonce":349040881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6805","nonce":349040881}]},"public_addr":"172.21.15.191:6801/349040881","cluster_addr":"172.21.15.191:6803/349040881","heartbeat_back_addr":"172.21.15.191:6807/349040881","heartbeat_front_addr":"172.21.15.191:6805/349040881","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:51:43.531709+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:51:43.589701+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:51:43.566226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:51:53.655 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T22:51:54.028 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T22:51:54.029 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T22:51:55.033 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T22:51:55.033 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T22:51:55.371 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:51:55.371 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T22:51:52.369470+0000","modified":"2024-04-25T22:51:54.363680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4193":{"gid":4193,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6803/4196269333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":4196269333},{"type":"v1","addr":"172.21.15.52:6803","nonce":4196269333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4193,"qdb_cluster":[4193]},"id":1}]} 2024-04-25T22:51:55.371 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 5 2024-04-25T22:51:55.384 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:51:55.678 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:51:55.678 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":15,"fsid":"5355b70e-3f7d-4bce-8676-89cee61d2089","created":"2024-04-25T22:51:37.688525+0000","modified":"2024-04-25T22:51:54.011012+0000","last_up_change":"2024-04-25T22:51:45.753740+0000","last_in_change":"2024-04-25T22:51:38.491924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:51:45.966439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:51:46.128416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:51:50.648525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:51:51.351497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b785a86a-6391-4a0d-8aec-c2016380832e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6801","nonce":3666753097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6803","nonce":3666753097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6807","nonce":3666753097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6805","nonce":3666753097}]},"public_addr":"172.21.15.110:6801/3666753097","cluster_addr":"172.21.15.110:6803/3666753097","heartbeat_back_addr":"172.21.15.110:6807/3666753097","heartbeat_front_addr":"172.21.15.110:6805/3666753097","state":["exists","up"]},{"osd":1,"uuid":"088b4733-ccbd-41a6-8a31-8d811169c28a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":479301362},{"type":"v1","addr":"172.21.15.164:6801","nonce":479301362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":479301362},{"type":"v1","addr":"172.21.15.164:6803","nonce":479301362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":479301362},{"type":"v1","addr":"172.21.15.164:6807","nonce":479301362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":479301362},{"type":"v1","addr":"172.21.15.164:6805","nonce":479301362}]},"public_addr":"172.21.15.164:6801/479301362","cluster_addr":"172.21.15.164:6803/479301362","heartbeat_back_addr":"172.21.15.164:6807/479301362","heartbeat_front_addr":"172.21.15.164:6805/479301362","state":["exists","up"]},{"osd":2,"uuid":"6a6aad8c-22ac-45c0-baf9-928314e7fef9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6801","nonce":349040881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6803","nonce":349040881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6807","nonce":349040881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6805","nonce":349040881}]},"public_addr":"172.21.15.191:6801/349040881","cluster_addr":"172.21.15.191:6803/349040881","heartbeat_back_addr":"172.21.15.191:6807/349040881","heartbeat_front_addr":"172.21.15.191:6805/349040881","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:51:43.531709+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:51:43.589701+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:51:43.566226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:51:55.691 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T22:51:55.692 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:51:55.993 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:51:55.994 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-25T22:51:56.003 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-04-25T22:51:55.926796+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":6,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":95804,"kb_used_data":1448,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":283019716,"statfs":{"total":289910292480,"available":289812189184,"internally_reserved":0,"allocated":1482752,"data_stored":1264088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.926135"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":208,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-25T22:51:48.957416+0000","last_change":"2024-04-25T22:51:47.764624+0000","last_active":"2024-04-25T22:51:48.957416+0000","last_peered":"2024-04-25T22:51:48.957416+0000","last_clean":"2024-04-25T22:51:48.957416+0000","last_became_active":"2024-04-25T22:51:47.764176+0000","last_became_peered":"2024-04-25T22:51:47.764176+0000","last_unstale":"2024-04-25T22:51:48.957416+0000","last_undegraded":"2024-04-25T22:51:48.957416+0000","last_fullsized":"2024-04-25T22:51:48.957416+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:59:39.005489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-25T22:51:48.945130+0000","last_change":"2024-04-25T22:51:47.768368+0000","last_active":"2024-04-25T22:51:48.945130+0000","last_peered":"2024-04-25T22:51:48.945130+0000","last_clean":"2024-04-25T22:51:48.945130+0000","last_became_active":"2024-04-25T22:51:47.768003+0000","last_became_peered":"2024-04-25T22:51:47.768003+0000","last_unstale":"2024-04-25T22:51:48.945130+0000","last_undegraded":"2024-04-25T22:51:48.945130+0000","last_fullsized":"2024-04-25T22:51:48.945130+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:10:00.098072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-25T22:51:48.945067+0000","last_change":"2024-04-25T22:51:47.764591+0000","last_active":"2024-04-25T22:51:48.945067+0000","last_peered":"2024-04-25T22:51:48.945067+0000","last_clean":"2024-04-25T22:51:48.945067+0000","last_became_active":"2024-04-25T22:51:47.764229+0000","last_became_peered":"2024-04-25T22:51:47.764229+0000","last_unstale":"2024-04-25T22:51:48.945067+0000","last_undegraded":"2024-04-25T22:51:48.945067+0000","last_fullsized":"2024-04-25T22:51:48.945067+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:32.854624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-25T22:51:48.837975+0000","last_change":"2024-04-25T22:51:47.762564+0000","last_active":"2024-04-25T22:51:48.837975+0000","last_peered":"2024-04-25T22:51:48.837975+0000","last_clean":"2024-04-25T22:51:48.837975+0000","last_became_active":"2024-04-25T22:51:47.762218+0000","last_became_peered":"2024-04-25T22:51:47.762218+0000","last_unstale":"2024-04-25T22:51:48.837975+0000","last_undegraded":"2024-04-25T22:51:48.837975+0000","last_fullsized":"2024-04-25T22:51:48.837975+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:09:06.117740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-25T22:51:48.945130+0000","last_change":"2024-04-25T22:51:47.768269+0000","last_active":"2024-04-25T22:51:48.945130+0000","last_peered":"2024-04-25T22:51:48.945130+0000","last_clean":"2024-04-25T22:51:48.945130+0000","last_became_active":"2024-04-25T22:51:47.767991+0000","last_became_peered":"2024-04-25T22:51:47.767991+0000","last_unstale":"2024-04-25T22:51:48.945130+0000","last_undegraded":"2024-04-25T22:51:48.945130+0000","last_fullsized":"2024-04-25T22:51:48.945130+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:01:54.134289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-25T22:51:48.837976+0000","last_change":"2024-04-25T22:51:47.761131+0000","last_active":"2024-04-25T22:51:48.837976+0000","last_peered":"2024-04-25T22:51:48.837976+0000","last_clean":"2024-04-25T22:51:48.837976+0000","last_became_active":"2024-04-25T22:51:47.760894+0000","last_became_peered":"2024-04-25T22:51:47.760894+0000","last_unstale":"2024-04-25T22:51:48.837976+0000","last_undegraded":"2024-04-25T22:51:48.837976+0000","last_fullsized":"2024-04-25T22:51:48.837976+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:38:28.554024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-25T22:51:48.837767+0000","last_change":"2024-04-25T22:51:47.765532+0000","last_active":"2024-04-25T22:51:48.837767+0000","last_peered":"2024-04-25T22:51:48.837767+0000","last_clean":"2024-04-25T22:51:48.837767+0000","last_became_active":"2024-04-25T22:51:47.765247+0000","last_became_peered":"2024-04-25T22:51:47.765247+0000","last_unstale":"2024-04-25T22:51:48.837767+0000","last_undegraded":"2024-04-25T22:51:48.837767+0000","last_fullsized":"2024-04-25T22:51:48.837767+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:55:05.342938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-25T22:51:48.838036+0000","last_change":"2024-04-25T22:51:47.762468+0000","last_active":"2024-04-25T22:51:48.838036+0000","last_peered":"2024-04-25T22:51:48.838036+0000","last_clean":"2024-04-25T22:51:48.838036+0000","last_became_active":"2024-04-25T22:51:47.762199+0000","last_became_peered":"2024-04-25T22:51:47.762199+0000","last_unstale":"2024-04-25T22:51:48.838036+0000","last_undegraded":"2024-04-25T22:51:48.838036+0000","last_fullsized":"2024-04-25T22:51:48.838036+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:32.854624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-25T22:51:48.945123+0000","last_change":"2024-04-25T22:51:47.764288+0000","last_active":"2024-04-25T22:51:48.945123+0000","last_peered":"2024-04-25T22:51:48.945123+0000","last_clean":"2024-04-25T22:51:48.945123+0000","last_became_active":"2024-04-25T22:51:47.763961+0000","last_became_peered":"2024-04-25T22:51:47.763961+0000","last_unstale":"2024-04-25T22:51:48.945123+0000","last_undegraded":"2024-04-25T22:51:48.945123+0000","last_fullsized":"2024-04-25T22:51:48.945123+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:03:07.164842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738371,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":692224,"data_stored":618152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27120,"kb_used_data":96,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344720,"statfs":{"total":96636764160,"available":96608993280,"internally_reserved":0,"allocated":98304,"data_stored":27784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738371,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36580,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335260,"statfs":{"total":96636764160,"available":96599306240,"internally_reserved":0,"allocated":692224,"data_stored":618152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:51:56.011 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:51:56.349 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:51:56.424 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-25T22:51:56.426 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-04-25T22:51:55.926796+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":6,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":95804,"kb_used_data":1448,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":283019716,"statfs":{"total":289910292480,"available":289812189184,"internally_reserved":0,"allocated":1482752,"data_stored":1264088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.926135"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":208,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-25T22:51:48.957416+0000","last_change":"2024-04-25T22:51:47.764624+0000","last_active":"2024-04-25T22:51:48.957416+0000","last_peered":"2024-04-25T22:51:48.957416+0000","last_clean":"2024-04-25T22:51:48.957416+0000","last_became_active":"2024-04-25T22:51:47.764176+0000","last_became_peered":"2024-04-25T22:51:47.764176+0000","last_unstale":"2024-04-25T22:51:48.957416+0000","last_undegraded":"2024-04-25T22:51:48.957416+0000","last_fullsized":"2024-04-25T22:51:48.957416+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:59:39.005489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-25T22:51:48.945130+0000","last_change":"2024-04-25T22:51:47.768368+0000","last_active":"2024-04-25T22:51:48.945130+0000","last_peered":"2024-04-25T22:51:48.945130+0000","last_clean":"2024-04-25T22:51:48.945130+0000","last_became_active":"2024-04-25T22:51:47.768003+0000","last_became_peered":"2024-04-25T22:51:47.768003+0000","last_unstale":"2024-04-25T22:51:48.945130+0000","last_undegraded":"2024-04-25T22:51:48.945130+0000","last_fullsized":"2024-04-25T22:51:48.945130+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:10:00.098072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-25T22:51:48.945067+0000","last_change":"2024-04-25T22:51:47.764591+0000","last_active":"2024-04-25T22:51:48.945067+0000","last_peered":"2024-04-25T22:51:48.945067+0000","last_clean":"2024-04-25T22:51:48.945067+0000","last_became_active":"2024-04-25T22:51:47.764229+0000","last_became_peered":"2024-04-25T22:51:47.764229+0000","last_unstale":"2024-04-25T22:51:48.945067+0000","last_undegraded":"2024-04-25T22:51:48.945067+0000","last_fullsized":"2024-04-25T22:51:48.945067+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:32.854624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-25T22:51:48.837975+0000","last_change":"2024-04-25T22:51:47.762564+0000","last_active":"2024-04-25T22:51:48.837975+0000","last_peered":"2024-04-25T22:51:48.837975+0000","last_clean":"2024-04-25T22:51:48.837975+0000","last_became_active":"2024-04-25T22:51:47.762218+0000","last_became_peered":"2024-04-25T22:51:47.762218+0000","last_unstale":"2024-04-25T22:51:48.837975+0000","last_undegraded":"2024-04-25T22:51:48.837975+0000","last_fullsized":"2024-04-25T22:51:48.837975+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:09:06.117740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-25T22:51:48.945130+0000","last_change":"2024-04-25T22:51:47.768269+0000","last_active":"2024-04-25T22:51:48.945130+0000","last_peered":"2024-04-25T22:51:48.945130+0000","last_clean":"2024-04-25T22:51:48.945130+0000","last_became_active":"2024-04-25T22:51:47.767991+0000","last_became_peered":"2024-04-25T22:51:47.767991+0000","last_unstale":"2024-04-25T22:51:48.945130+0000","last_undegraded":"2024-04-25T22:51:48.945130+0000","last_fullsized":"2024-04-25T22:51:48.945130+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:01:54.134289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-25T22:51:48.837976+0000","last_change":"2024-04-25T22:51:47.761131+0000","last_active":"2024-04-25T22:51:48.837976+0000","last_peered":"2024-04-25T22:51:48.837976+0000","last_clean":"2024-04-25T22:51:48.837976+0000","last_became_active":"2024-04-25T22:51:47.760894+0000","last_became_peered":"2024-04-25T22:51:47.760894+0000","last_unstale":"2024-04-25T22:51:48.837976+0000","last_undegraded":"2024-04-25T22:51:48.837976+0000","last_fullsized":"2024-04-25T22:51:48.837976+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:38:28.554024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-25T22:51:48.837767+0000","last_change":"2024-04-25T22:51:47.765532+0000","last_active":"2024-04-25T22:51:48.837767+0000","last_peered":"2024-04-25T22:51:48.837767+0000","last_clean":"2024-04-25T22:51:48.837767+0000","last_became_active":"2024-04-25T22:51:47.765247+0000","last_became_peered":"2024-04-25T22:51:47.765247+0000","last_unstale":"2024-04-25T22:51:48.837767+0000","last_undegraded":"2024-04-25T22:51:48.837767+0000","last_fullsized":"2024-04-25T22:51:48.837767+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:55:05.342938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-25T22:51:48.838036+0000","last_change":"2024-04-25T22:51:47.762468+0000","last_active":"2024-04-25T22:51:48.838036+0000","last_peered":"2024-04-25T22:51:48.838036+0000","last_clean":"2024-04-25T22:51:48.838036+0000","last_became_active":"2024-04-25T22:51:47.762199+0000","last_became_peered":"2024-04-25T22:51:47.762199+0000","last_unstale":"2024-04-25T22:51:48.838036+0000","last_undegraded":"2024-04-25T22:51:48.838036+0000","last_fullsized":"2024-04-25T22:51:48.838036+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:32.854624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-25T22:51:48.945123+0000","last_change":"2024-04-25T22:51:47.764288+0000","last_active":"2024-04-25T22:51:48.945123+0000","last_peered":"2024-04-25T22:51:48.945123+0000","last_clean":"2024-04-25T22:51:48.945123+0000","last_became_active":"2024-04-25T22:51:47.763961+0000","last_became_peered":"2024-04-25T22:51:47.763961+0000","last_unstale":"2024-04-25T22:51:48.945123+0000","last_undegraded":"2024-04-25T22:51:48.945123+0000","last_fullsized":"2024-04-25T22:51:48.945123+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:03:07.164842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738371,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":692224,"data_stored":618152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27120,"kb_used_data":96,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344720,"statfs":{"total":96636764160,"available":96608993280,"internally_reserved":0,"allocated":98304,"data_stored":27784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738371,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36580,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335260,"statfs":{"total":96636764160,"available":96599306240,"internally_reserved":0,"allocated":692224,"data_stored":618152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:51:56.433 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:51:56.732 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:51:56.733 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-25T22:51:56.743 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-04-25T22:51:55.926796+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":6,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":95804,"kb_used_data":1448,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":283019716,"statfs":{"total":289910292480,"available":289812189184,"internally_reserved":0,"allocated":1482752,"data_stored":1264088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.926135"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":208,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-25T22:51:48.957416+0000","last_change":"2024-04-25T22:51:47.764624+0000","last_active":"2024-04-25T22:51:48.957416+0000","last_peered":"2024-04-25T22:51:48.957416+0000","last_clean":"2024-04-25T22:51:48.957416+0000","last_became_active":"2024-04-25T22:51:47.764176+0000","last_became_peered":"2024-04-25T22:51:47.764176+0000","last_unstale":"2024-04-25T22:51:48.957416+0000","last_undegraded":"2024-04-25T22:51:48.957416+0000","last_fullsized":"2024-04-25T22:51:48.957416+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:59:39.005489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-25T22:51:48.945130+0000","last_change":"2024-04-25T22:51:47.768368+0000","last_active":"2024-04-25T22:51:48.945130+0000","last_peered":"2024-04-25T22:51:48.945130+0000","last_clean":"2024-04-25T22:51:48.945130+0000","last_became_active":"2024-04-25T22:51:47.768003+0000","last_became_peered":"2024-04-25T22:51:47.768003+0000","last_unstale":"2024-04-25T22:51:48.945130+0000","last_undegraded":"2024-04-25T22:51:48.945130+0000","last_fullsized":"2024-04-25T22:51:48.945130+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:10:00.098072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-25T22:51:48.945067+0000","last_change":"2024-04-25T22:51:47.764591+0000","last_active":"2024-04-25T22:51:48.945067+0000","last_peered":"2024-04-25T22:51:48.945067+0000","last_clean":"2024-04-25T22:51:48.945067+0000","last_became_active":"2024-04-25T22:51:47.764229+0000","last_became_peered":"2024-04-25T22:51:47.764229+0000","last_unstale":"2024-04-25T22:51:48.945067+0000","last_undegraded":"2024-04-25T22:51:48.945067+0000","last_fullsized":"2024-04-25T22:51:48.945067+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:32.854624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-25T22:51:48.837975+0000","last_change":"2024-04-25T22:51:47.762564+0000","last_active":"2024-04-25T22:51:48.837975+0000","last_peered":"2024-04-25T22:51:48.837975+0000","last_clean":"2024-04-25T22:51:48.837975+0000","last_became_active":"2024-04-25T22:51:47.762218+0000","last_became_peered":"2024-04-25T22:51:47.762218+0000","last_unstale":"2024-04-25T22:51:48.837975+0000","last_undegraded":"2024-04-25T22:51:48.837975+0000","last_fullsized":"2024-04-25T22:51:48.837975+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:09:06.117740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-25T22:51:48.945130+0000","last_change":"2024-04-25T22:51:47.768269+0000","last_active":"2024-04-25T22:51:48.945130+0000","last_peered":"2024-04-25T22:51:48.945130+0000","last_clean":"2024-04-25T22:51:48.945130+0000","last_became_active":"2024-04-25T22:51:47.767991+0000","last_became_peered":"2024-04-25T22:51:47.767991+0000","last_unstale":"2024-04-25T22:51:48.945130+0000","last_undegraded":"2024-04-25T22:51:48.945130+0000","last_fullsized":"2024-04-25T22:51:48.945130+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:01:54.134289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-25T22:51:48.837976+0000","last_change":"2024-04-25T22:51:47.761131+0000","last_active":"2024-04-25T22:51:48.837976+0000","last_peered":"2024-04-25T22:51:48.837976+0000","last_clean":"2024-04-25T22:51:48.837976+0000","last_became_active":"2024-04-25T22:51:47.760894+0000","last_became_peered":"2024-04-25T22:51:47.760894+0000","last_unstale":"2024-04-25T22:51:48.837976+0000","last_undegraded":"2024-04-25T22:51:48.837976+0000","last_fullsized":"2024-04-25T22:51:48.837976+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:38:28.554024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-25T22:51:48.837767+0000","last_change":"2024-04-25T22:51:47.765532+0000","last_active":"2024-04-25T22:51:48.837767+0000","last_peered":"2024-04-25T22:51:48.837767+0000","last_clean":"2024-04-25T22:51:48.837767+0000","last_became_active":"2024-04-25T22:51:47.765247+0000","last_became_peered":"2024-04-25T22:51:47.765247+0000","last_unstale":"2024-04-25T22:51:48.837767+0000","last_undegraded":"2024-04-25T22:51:48.837767+0000","last_fullsized":"2024-04-25T22:51:48.837767+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:55:05.342938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-25T22:51:48.838036+0000","last_change":"2024-04-25T22:51:47.762468+0000","last_active":"2024-04-25T22:51:48.838036+0000","last_peered":"2024-04-25T22:51:48.838036+0000","last_clean":"2024-04-25T22:51:48.838036+0000","last_became_active":"2024-04-25T22:51:47.762199+0000","last_became_peered":"2024-04-25T22:51:47.762199+0000","last_unstale":"2024-04-25T22:51:48.838036+0000","last_undegraded":"2024-04-25T22:51:48.838036+0000","last_fullsized":"2024-04-25T22:51:48.838036+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:32.854624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-25T22:51:48.945123+0000","last_change":"2024-04-25T22:51:47.764288+0000","last_active":"2024-04-25T22:51:48.945123+0000","last_peered":"2024-04-25T22:51:48.945123+0000","last_clean":"2024-04-25T22:51:48.945123+0000","last_became_active":"2024-04-25T22:51:47.763961+0000","last_became_peered":"2024-04-25T22:51:47.763961+0000","last_unstale":"2024-04-25T22:51:48.945123+0000","last_undegraded":"2024-04-25T22:51:48.945123+0000","last_fullsized":"2024-04-25T22:51:48.945123+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:03:07.164842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738371,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":692224,"data_stored":618152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27120,"kb_used_data":96,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344720,"statfs":{"total":96636764160,"available":96608993280,"internally_reserved":0,"allocated":98304,"data_stored":27784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738371,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36580,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335260,"statfs":{"total":96636764160,"available":96599306240,"internally_reserved":0,"allocated":692224,"data_stored":618152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:51:56.747 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3f is not active+clean 2024-04-25T22:51:56.748 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.748 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3e is not active+clean 2024-04-25T22:51:56.748 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.748 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3d is not active+clean 2024-04-25T22:51:56.748 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.748 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3c is not active+clean 2024-04-25T22:51:56.748 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.748 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3b is not active+clean 2024-04-25T22:51:56.748 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.749 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3a is not active+clean 2024-04-25T22:51:56.749 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.749 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.39 is not active+clean 2024-04-25T22:51:56.749 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.749 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.38 is not active+clean 2024-04-25T22:51:56.749 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.749 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.37 is not active+clean 2024-04-25T22:51:56.749 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.749 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.36 is not active+clean 2024-04-25T22:51:56.749 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.749 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.35 is not active+clean 2024-04-25T22:51:56.750 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.750 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.34 is not active+clean 2024-04-25T22:51:56.750 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.750 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.33 is not active+clean 2024-04-25T22:51:56.750 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.750 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.32 is not active+clean 2024-04-25T22:51:56.750 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.750 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.31 is not active+clean 2024-04-25T22:51:56.750 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.751 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.30 is not active+clean 2024-04-25T22:51:56.751 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.751 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2f is not active+clean 2024-04-25T22:51:56.751 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.751 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2e is not active+clean 2024-04-25T22:51:56.751 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.751 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2d is not active+clean 2024-04-25T22:51:56.751 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.751 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2c is not active+clean 2024-04-25T22:51:56.751 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.751 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2b is not active+clean 2024-04-25T22:51:56.751 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.752 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2a is not active+clean 2024-04-25T22:51:56.752 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.752 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.29 is not active+clean 2024-04-25T22:51:56.752 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.752 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.28 is not active+clean 2024-04-25T22:51:56.752 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.752 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.27 is not active+clean 2024-04-25T22:51:56.752 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.752 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.26 is not active+clean 2024-04-25T22:51:56.752 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.753 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.25 is not active+clean 2024-04-25T22:51:56.753 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.753 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.24 is not active+clean 2024-04-25T22:51:56.753 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.753 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.23 is not active+clean 2024-04-25T22:51:56.753 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.753 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.22 is not active+clean 2024-04-25T22:51:56.753 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.753 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.21 is not active+clean 2024-04-25T22:51:56.753 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.753 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.20 is not active+clean 2024-04-25T22:51:56.754 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.754 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2024-04-25T22:51:56.754 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.754 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2024-04-25T22:51:56.754 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:50.996034+0000', 'last_change': '2024-04-25T22:51:50.996034+0000', 'last_active': '2024-04-25T22:51:50.996034+0000', 'last_peered': '2024-04-25T22:51:50.996034+0000', 'last_clean': '2024-04-25T22:51:50.996034+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:50.996034+0000', 'last_undegraded': '2024-04-25T22:51:50.996034+0000', 'last_fullsized': '2024-04-25T22:51:50.996034+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.754 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2024-04-25T22:51:56.754 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.754 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2024-04-25T22:51:56.754 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:50.996034+0000', 'last_change': '2024-04-25T22:51:50.996034+0000', 'last_active': '2024-04-25T22:51:50.996034+0000', 'last_peered': '2024-04-25T22:51:50.996034+0000', 'last_clean': '2024-04-25T22:51:50.996034+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:50.996034+0000', 'last_undegraded': '2024-04-25T22:51:50.996034+0000', 'last_fullsized': '2024-04-25T22:51:50.996034+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.754 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2024-04-25T22:51:56.755 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.755 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2024-04-25T22:51:56.755 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:50.996034+0000', 'last_change': '2024-04-25T22:51:50.996034+0000', 'last_active': '2024-04-25T22:51:50.996034+0000', 'last_peered': '2024-04-25T22:51:50.996034+0000', 'last_clean': '2024-04-25T22:51:50.996034+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:50.996034+0000', 'last_undegraded': '2024-04-25T22:51:50.996034+0000', 'last_fullsized': '2024-04-25T22:51:50.996034+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.755 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2024-04-25T22:51:56.755 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.755 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2024-04-25T22:51:56.755 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:50.996034+0000', 'last_change': '2024-04-25T22:51:50.996034+0000', 'last_active': '2024-04-25T22:51:50.996034+0000', 'last_peered': '2024-04-25T22:51:50.996034+0000', 'last_clean': '2024-04-25T22:51:50.996034+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:50.996034+0000', 'last_undegraded': '2024-04-25T22:51:50.996034+0000', 'last_fullsized': '2024-04-25T22:51:50.996034+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.755 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2024-04-25T22:51:56.755 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:50.996034+0000', 'last_change': '2024-04-25T22:51:50.996034+0000', 'last_active': '2024-04-25T22:51:50.996034+0000', 'last_peered': '2024-04-25T22:51:50.996034+0000', 'last_clean': '2024-04-25T22:51:50.996034+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:50.996034+0000', 'last_undegraded': '2024-04-25T22:51:50.996034+0000', 'last_fullsized': '2024-04-25T22:51:50.996034+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.755 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2024-04-25T22:51:56.755 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.756 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2024-04-25T22:51:56.756 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:50.996034+0000', 'last_change': '2024-04-25T22:51:50.996034+0000', 'last_active': '2024-04-25T22:51:50.996034+0000', 'last_peered': '2024-04-25T22:51:50.996034+0000', 'last_clean': '2024-04-25T22:51:50.996034+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:50.996034+0000', 'last_undegraded': '2024-04-25T22:51:50.996034+0000', 'last_fullsized': '2024-04-25T22:51:50.996034+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.756 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2024-04-25T22:51:56.756 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.756 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2024-04-25T22:51:56.756 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:50.996034+0000', 'last_change': '2024-04-25T22:51:50.996034+0000', 'last_active': '2024-04-25T22:51:50.996034+0000', 'last_peered': '2024-04-25T22:51:50.996034+0000', 'last_clean': '2024-04-25T22:51:50.996034+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:50.996034+0000', 'last_undegraded': '2024-04-25T22:51:50.996034+0000', 'last_fullsized': '2024-04-25T22:51:50.996034+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.756 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2024-04-25T22:51:56.756 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.756 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2024-04-25T22:51:56.756 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:50.996034+0000', 'last_change': '2024-04-25T22:51:50.996034+0000', 'last_active': '2024-04-25T22:51:50.996034+0000', 'last_peered': '2024-04-25T22:51:50.996034+0000', 'last_clean': '2024-04-25T22:51:50.996034+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:50.996034+0000', 'last_undegraded': '2024-04-25T22:51:50.996034+0000', 'last_fullsized': '2024-04-25T22:51:50.996034+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.756 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2024-04-25T22:51:56.756 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.757 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2024-04-25T22:51:56.757 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:50.996034+0000', 'last_change': '2024-04-25T22:51:50.996034+0000', 'last_active': '2024-04-25T22:51:50.996034+0000', 'last_peered': '2024-04-25T22:51:50.996034+0000', 'last_clean': '2024-04-25T22:51:50.996034+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:50.996034+0000', 'last_undegraded': '2024-04-25T22:51:50.996034+0000', 'last_fullsized': '2024-04-25T22:51:50.996034+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.757 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2024-04-25T22:51:56.757 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.757 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2024-04-25T22:51:56.757 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:50.996034+0000', 'last_change': '2024-04-25T22:51:50.996034+0000', 'last_active': '2024-04-25T22:51:50.996034+0000', 'last_peered': '2024-04-25T22:51:50.996034+0000', 'last_clean': '2024-04-25T22:51:50.996034+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:50.996034+0000', 'last_undegraded': '2024-04-25T22:51:50.996034+0000', 'last_fullsized': '2024-04-25T22:51:50.996034+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.757 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2024-04-25T22:51:56.757 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.757 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2024-04-25T22:51:56.757 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:50.996034+0000', 'last_change': '2024-04-25T22:51:50.996034+0000', 'last_active': '2024-04-25T22:51:50.996034+0000', 'last_peered': '2024-04-25T22:51:50.996034+0000', 'last_clean': '2024-04-25T22:51:50.996034+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:50.996034+0000', 'last_undegraded': '2024-04-25T22:51:50.996034+0000', 'last_fullsized': '2024-04-25T22:51:50.996034+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.757 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2024-04-25T22:51:56.758 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.758 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2024-04-25T22:51:56.758 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:50.996034+0000', 'last_change': '2024-04-25T22:51:50.996034+0000', 'last_active': '2024-04-25T22:51:50.996034+0000', 'last_peered': '2024-04-25T22:51:50.996034+0000', 'last_clean': '2024-04-25T22:51:50.996034+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:50.996034+0000', 'last_undegraded': '2024-04-25T22:51:50.996034+0000', 'last_fullsized': '2024-04-25T22:51:50.996034+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.758 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2024-04-25T22:51:56.758 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.758 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2024-04-25T22:51:56.758 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:50.996034+0000', 'last_change': '2024-04-25T22:51:50.996034+0000', 'last_active': '2024-04-25T22:51:50.996034+0000', 'last_peered': '2024-04-25T22:51:50.996034+0000', 'last_clean': '2024-04-25T22:51:50.996034+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:50.996034+0000', 'last_undegraded': '2024-04-25T22:51:50.996034+0000', 'last_fullsized': '2024-04-25T22:51:50.996034+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.758 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2024-04-25T22:51:56.758 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.758 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2024-04-25T22:51:56.758 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:50.996034+0000', 'last_change': '2024-04-25T22:51:50.996034+0000', 'last_active': '2024-04-25T22:51:50.996034+0000', 'last_peered': '2024-04-25T22:51:50.996034+0000', 'last_clean': '2024-04-25T22:51:50.996034+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:50.996034+0000', 'last_undegraded': '2024-04-25T22:51:50.996034+0000', 'last_fullsized': '2024-04-25T22:51:50.996034+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.759 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2024-04-25T22:51:56.759 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.759 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2024-04-25T22:51:56.759 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:50.996034+0000', 'last_change': '2024-04-25T22:51:50.996034+0000', 'last_active': '2024-04-25T22:51:50.996034+0000', 'last_peered': '2024-04-25T22:51:50.996034+0000', 'last_clean': '2024-04-25T22:51:50.996034+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:50.996034+0000', 'last_undegraded': '2024-04-25T22:51:50.996034+0000', 'last_fullsized': '2024-04-25T22:51:50.996034+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.759 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2024-04-25T22:51:56.759 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.759 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2024-04-25T22:51:56.759 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:50.996034+0000', 'last_change': '2024-04-25T22:51:50.996034+0000', 'last_active': '2024-04-25T22:51:50.996034+0000', 'last_peered': '2024-04-25T22:51:50.996034+0000', 'last_clean': '2024-04-25T22:51:50.996034+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:50.996034+0000', 'last_undegraded': '2024-04-25T22:51:50.996034+0000', 'last_fullsized': '2024-04-25T22:51:50.996034+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.759 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2024-04-25T22:51:56.759 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.760 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2024-04-25T22:51:56.760 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:50.996034+0000', 'last_change': '2024-04-25T22:51:50.996034+0000', 'last_active': '2024-04-25T22:51:50.996034+0000', 'last_peered': '2024-04-25T22:51:50.996034+0000', 'last_clean': '2024-04-25T22:51:50.996034+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:50.996034+0000', 'last_undegraded': '2024-04-25T22:51:50.996034+0000', 'last_fullsized': '2024-04-25T22:51:50.996034+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.760 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2024-04-25T22:51:56.760 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.760 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2024-04-25T22:51:56.760 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:50.996034+0000', 'last_change': '2024-04-25T22:51:50.996034+0000', 'last_active': '2024-04-25T22:51:50.996034+0000', 'last_peered': '2024-04-25T22:51:50.996034+0000', 'last_clean': '2024-04-25T22:51:50.996034+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:50.996034+0000', 'last_undegraded': '2024-04-25T22:51:50.996034+0000', 'last_fullsized': '2024-04-25T22:51:50.996034+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.760 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2024-04-25T22:51:56.760 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.760 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2024-04-25T22:51:56.760 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:50.996034+0000', 'last_change': '2024-04-25T22:51:50.996034+0000', 'last_active': '2024-04-25T22:51:50.996034+0000', 'last_peered': '2024-04-25T22:51:50.996034+0000', 'last_clean': '2024-04-25T22:51:50.996034+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:50.996034+0000', 'last_undegraded': '2024-04-25T22:51:50.996034+0000', 'last_fullsized': '2024-04-25T22:51:50.996034+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.760 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2024-04-25T22:51:56.760 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.761 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2024-04-25T22:51:56.761 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:50.996034+0000', 'last_change': '2024-04-25T22:51:50.996034+0000', 'last_active': '2024-04-25T22:51:50.996034+0000', 'last_peered': '2024-04-25T22:51:50.996034+0000', 'last_clean': '2024-04-25T22:51:50.996034+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:50.996034+0000', 'last_undegraded': '2024-04-25T22:51:50.996034+0000', 'last_fullsized': '2024-04-25T22:51:50.996034+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.761 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2024-04-25T22:51:56.761 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.761 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2024-04-25T22:51:56.761 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.761 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2024-04-25T22:51:56.761 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:50.996034+0000', 'last_change': '2024-04-25T22:51:50.996034+0000', 'last_active': '2024-04-25T22:51:50.996034+0000', 'last_peered': '2024-04-25T22:51:50.996034+0000', 'last_clean': '2024-04-25T22:51:50.996034+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:50.996034+0000', 'last_undegraded': '2024-04-25T22:51:50.996034+0000', 'last_fullsized': '2024-04-25T22:51:50.996034+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.761 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2024-04-25T22:51:56.761 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.761 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2024-04-25T22:51:56.762 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:50.996034+0000', 'last_change': '2024-04-25T22:51:50.996034+0000', 'last_active': '2024-04-25T22:51:50.996034+0000', 'last_peered': '2024-04-25T22:51:50.996034+0000', 'last_clean': '2024-04-25T22:51:50.996034+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:50.996034+0000', 'last_undegraded': '2024-04-25T22:51:50.996034+0000', 'last_fullsized': '2024-04-25T22:51:50.996034+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.762 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2024-04-25T22:51:56.762 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:50.996034+0000', 'last_change': '2024-04-25T22:51:50.996034+0000', 'last_active': '2024-04-25T22:51:50.996034+0000', 'last_peered': '2024-04-25T22:51:50.996034+0000', 'last_clean': '2024-04-25T22:51:50.996034+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:50.996034+0000', 'last_undegraded': '2024-04-25T22:51:50.996034+0000', 'last_fullsized': '2024-04-25T22:51:50.996034+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.762 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2024-04-25T22:51:56.762 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.762 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2024-04-25T22:51:56.762 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:50.996034+0000', 'last_change': '2024-04-25T22:51:50.996034+0000', 'last_active': '2024-04-25T22:51:50.996034+0000', 'last_peered': '2024-04-25T22:51:50.996034+0000', 'last_clean': '2024-04-25T22:51:50.996034+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:50.996034+0000', 'last_undegraded': '2024-04-25T22:51:50.996034+0000', 'last_fullsized': '2024-04-25T22:51:50.996034+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.762 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2024-04-25T22:51:56.762 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.762 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2024-04-25T22:51:56.763 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.763 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2024-04-25T22:51:56.763 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:50.996034+0000', 'last_change': '2024-04-25T22:51:50.996034+0000', 'last_active': '2024-04-25T22:51:50.996034+0000', 'last_peered': '2024-04-25T22:51:50.996034+0000', 'last_clean': '2024-04-25T22:51:50.996034+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:50.996034+0000', 'last_undegraded': '2024-04-25T22:51:50.996034+0000', 'last_fullsized': '2024-04-25T22:51:50.996034+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.763 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2024-04-25T22:51:56.763 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.763 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2024-04-25T22:51:56.763 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:50.996034+0000', 'last_change': '2024-04-25T22:51:50.996034+0000', 'last_active': '2024-04-25T22:51:50.996034+0000', 'last_peered': '2024-04-25T22:51:50.996034+0000', 'last_clean': '2024-04-25T22:51:50.996034+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:50.996034+0000', 'last_undegraded': '2024-04-25T22:51:50.996034+0000', 'last_fullsized': '2024-04-25T22:51:50.996034+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.763 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2024-04-25T22:51:56.763 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.763 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2024-04-25T22:51:56.763 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:50.996034+0000', 'last_change': '2024-04-25T22:51:50.996034+0000', 'last_active': '2024-04-25T22:51:50.996034+0000', 'last_peered': '2024-04-25T22:51:50.996034+0000', 'last_clean': '2024-04-25T22:51:50.996034+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:50.996034+0000', 'last_undegraded': '2024-04-25T22:51:50.996034+0000', 'last_fullsized': '2024-04-25T22:51:50.996034+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.764 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2024-04-25T22:51:56.764 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.764 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2024-04-25T22:51:56.764 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:50.996034+0000', 'last_change': '2024-04-25T22:51:50.996034+0000', 'last_active': '2024-04-25T22:51:50.996034+0000', 'last_peered': '2024-04-25T22:51:50.996034+0000', 'last_clean': '2024-04-25T22:51:50.996034+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:50.996034+0000', 'last_undegraded': '2024-04-25T22:51:50.996034+0000', 'last_fullsized': '2024-04-25T22:51:50.996034+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.764 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2024-04-25T22:51:56.764 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.764 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2024-04-25T22:51:56.764 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:50.996034+0000', 'last_change': '2024-04-25T22:51:50.996034+0000', 'last_active': '2024-04-25T22:51:50.996034+0000', 'last_peered': '2024-04-25T22:51:50.996034+0000', 'last_clean': '2024-04-25T22:51:50.996034+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:50.996034+0000', 'last_undegraded': '2024-04-25T22:51:50.996034+0000', 'last_fullsized': '2024-04-25T22:51:50.996034+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.764 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2024-04-25T22:51:56.764 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.765 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2024-04-25T22:51:56.765 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:50.996034+0000', 'last_change': '2024-04-25T22:51:50.996034+0000', 'last_active': '2024-04-25T22:51:50.996034+0000', 'last_peered': '2024-04-25T22:51:50.996034+0000', 'last_clean': '2024-04-25T22:51:50.996034+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:50.996034+0000', 'last_undegraded': '2024-04-25T22:51:50.996034+0000', 'last_fullsized': '2024-04-25T22:51:50.996034+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.765 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2024-04-25T22:51:56.765 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.765 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2024-04-25T22:51:56.765 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:50.996034+0000', 'last_change': '2024-04-25T22:51:50.996034+0000', 'last_active': '2024-04-25T22:51:50.996034+0000', 'last_peered': '2024-04-25T22:51:50.996034+0000', 'last_clean': '2024-04-25T22:51:50.996034+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:50.996034+0000', 'last_undegraded': '2024-04-25T22:51:50.996034+0000', 'last_fullsized': '2024-04-25T22:51:50.996034+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.765 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2024-04-25T22:51:56.765 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:52.000495+0000', 'last_change': '2024-04-25T22:51:52.000495+0000', 'last_active': '2024-04-25T22:51:52.000495+0000', 'last_peered': '2024-04-25T22:51:52.000495+0000', 'last_clean': '2024-04-25T22:51:52.000495+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:52.000495+0000', 'last_undegraded': '2024-04-25T22:51:52.000495+0000', 'last_fullsized': '2024-04-25T22:51:52.000495+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:52.000495+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.765 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2024-04-25T22:51:56.765 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T22:51:50.996034+0000', 'last_change': '2024-04-25T22:51:50.996034+0000', 'last_active': '2024-04-25T22:51:50.996034+0000', 'last_peered': '2024-04-25T22:51:50.996034+0000', 'last_clean': '2024-04-25T22:51:50.996034+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T22:51:50.996034+0000', 'last_undegraded': '2024-04-25T22:51:50.996034+0000', 'last_fullsized': '2024-04-25T22:51:50.996034+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'last_clean_scrub_stamp': '2024-04-25T22:51:50.996034+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T22:51:56.766 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T22:51:57.150 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:51:57.151 INFO:teuthology.orchestra.run.smithi052.stdout:{"fsid":"5355b70e-3f7d-4bce-8676-89cee61d2089","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":19,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":15,"num_osds":3,"num_up_osds":3,"osd_up_since":1714085505,"num_in_osds":3,"osd_in_since":1714085498,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":96},{"state_name":"active+clean","count":9}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":98103296,"bytes_avail":289812189184,"bytes_total":289910292480,"unknown_pgs_ratio":0.91428571939468384},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4193}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-04-25T22:51:37.689711+0000","services":{}},"progress_events":{}} 2024-04-25T22:51:57.163 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T22:51:57.164 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:51:57.463 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:51:57.464 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-25T22:51:57.474 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-04-25T22:51:55.926796+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":6,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":95804,"kb_used_data":1448,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":283019716,"statfs":{"total":289910292480,"available":289812189184,"internally_reserved":0,"allocated":1482752,"data_stored":1264088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.926135"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":208,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-25T22:51:48.957416+0000","last_change":"2024-04-25T22:51:47.764624+0000","last_active":"2024-04-25T22:51:48.957416+0000","last_peered":"2024-04-25T22:51:48.957416+0000","last_clean":"2024-04-25T22:51:48.957416+0000","last_became_active":"2024-04-25T22:51:47.764176+0000","last_became_peered":"2024-04-25T22:51:47.764176+0000","last_unstale":"2024-04-25T22:51:48.957416+0000","last_undegraded":"2024-04-25T22:51:48.957416+0000","last_fullsized":"2024-04-25T22:51:48.957416+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:59:39.005489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-25T22:51:48.945130+0000","last_change":"2024-04-25T22:51:47.768368+0000","last_active":"2024-04-25T22:51:48.945130+0000","last_peered":"2024-04-25T22:51:48.945130+0000","last_clean":"2024-04-25T22:51:48.945130+0000","last_became_active":"2024-04-25T22:51:47.768003+0000","last_became_peered":"2024-04-25T22:51:47.768003+0000","last_unstale":"2024-04-25T22:51:48.945130+0000","last_undegraded":"2024-04-25T22:51:48.945130+0000","last_fullsized":"2024-04-25T22:51:48.945130+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:10:00.098072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-25T22:51:48.945067+0000","last_change":"2024-04-25T22:51:47.764591+0000","last_active":"2024-04-25T22:51:48.945067+0000","last_peered":"2024-04-25T22:51:48.945067+0000","last_clean":"2024-04-25T22:51:48.945067+0000","last_became_active":"2024-04-25T22:51:47.764229+0000","last_became_peered":"2024-04-25T22:51:47.764229+0000","last_unstale":"2024-04-25T22:51:48.945067+0000","last_undegraded":"2024-04-25T22:51:48.945067+0000","last_fullsized":"2024-04-25T22:51:48.945067+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:32.854624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-25T22:51:48.837975+0000","last_change":"2024-04-25T22:51:47.762564+0000","last_active":"2024-04-25T22:51:48.837975+0000","last_peered":"2024-04-25T22:51:48.837975+0000","last_clean":"2024-04-25T22:51:48.837975+0000","last_became_active":"2024-04-25T22:51:47.762218+0000","last_became_peered":"2024-04-25T22:51:47.762218+0000","last_unstale":"2024-04-25T22:51:48.837975+0000","last_undegraded":"2024-04-25T22:51:48.837975+0000","last_fullsized":"2024-04-25T22:51:48.837975+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:09:06.117740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-25T22:51:48.945130+0000","last_change":"2024-04-25T22:51:47.768269+0000","last_active":"2024-04-25T22:51:48.945130+0000","last_peered":"2024-04-25T22:51:48.945130+0000","last_clean":"2024-04-25T22:51:48.945130+0000","last_became_active":"2024-04-25T22:51:47.767991+0000","last_became_peered":"2024-04-25T22:51:47.767991+0000","last_unstale":"2024-04-25T22:51:48.945130+0000","last_undegraded":"2024-04-25T22:51:48.945130+0000","last_fullsized":"2024-04-25T22:51:48.945130+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:01:54.134289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-25T22:51:48.837976+0000","last_change":"2024-04-25T22:51:47.761131+0000","last_active":"2024-04-25T22:51:48.837976+0000","last_peered":"2024-04-25T22:51:48.837976+0000","last_clean":"2024-04-25T22:51:48.837976+0000","last_became_active":"2024-04-25T22:51:47.760894+0000","last_became_peered":"2024-04-25T22:51:47.760894+0000","last_unstale":"2024-04-25T22:51:48.837976+0000","last_undegraded":"2024-04-25T22:51:48.837976+0000","last_fullsized":"2024-04-25T22:51:48.837976+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:38:28.554024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-25T22:51:48.837767+0000","last_change":"2024-04-25T22:51:47.765532+0000","last_active":"2024-04-25T22:51:48.837767+0000","last_peered":"2024-04-25T22:51:48.837767+0000","last_clean":"2024-04-25T22:51:48.837767+0000","last_became_active":"2024-04-25T22:51:47.765247+0000","last_became_peered":"2024-04-25T22:51:47.765247+0000","last_unstale":"2024-04-25T22:51:48.837767+0000","last_undegraded":"2024-04-25T22:51:48.837767+0000","last_fullsized":"2024-04-25T22:51:48.837767+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:55:05.342938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-25T22:51:48.838036+0000","last_change":"2024-04-25T22:51:47.762468+0000","last_active":"2024-04-25T22:51:48.838036+0000","last_peered":"2024-04-25T22:51:48.838036+0000","last_clean":"2024-04-25T22:51:48.838036+0000","last_became_active":"2024-04-25T22:51:47.762199+0000","last_became_peered":"2024-04-25T22:51:47.762199+0000","last_unstale":"2024-04-25T22:51:48.838036+0000","last_undegraded":"2024-04-25T22:51:48.838036+0000","last_fullsized":"2024-04-25T22:51:48.838036+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:32.854624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-25T22:51:48.945123+0000","last_change":"2024-04-25T22:51:47.764288+0000","last_active":"2024-04-25T22:51:48.945123+0000","last_peered":"2024-04-25T22:51:48.945123+0000","last_clean":"2024-04-25T22:51:48.945123+0000","last_became_active":"2024-04-25T22:51:47.763961+0000","last_became_peered":"2024-04-25T22:51:47.763961+0000","last_unstale":"2024-04-25T22:51:48.945123+0000","last_undegraded":"2024-04-25T22:51:48.945123+0000","last_fullsized":"2024-04-25T22:51:48.945123+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:03:07.164842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:52.000495+0000","last_change":"2024-04-25T22:51:52.000495+0000","last_active":"2024-04-25T22:51:52.000495+0000","last_peered":"2024-04-25T22:51:52.000495+0000","last_clean":"2024-04-25T22:51:52.000495+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:52.000495+0000","last_undegraded":"2024-04-25T22:51:52.000495+0000","last_fullsized":"2024-04-25T22:51:52.000495+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T22:51:50.996034+0000","last_change":"2024-04-25T22:51:50.996034+0000","last_active":"2024-04-25T22:51:50.996034+0000","last_peered":"2024-04-25T22:51:50.996034+0000","last_clean":"2024-04-25T22:51:50.996034+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T22:51:50.996034+0000","last_undegraded":"2024-04-25T22:51:50.996034+0000","last_fullsized":"2024-04-25T22:51:50.996034+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738371,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":692224,"data_stored":618152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27120,"kb_used_data":96,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344720,"statfs":{"total":96636764160,"available":96608993280,"internally_reserved":0,"allocated":98304,"data_stored":27784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738371,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36580,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335260,"statfs":{"total":96636764160,"available":96599306240,"internally_reserved":0,"allocated":692224,"data_stored":618152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:51:57.863 INFO:tasks.ceph.mds.a.smithi052.stderr:2024-04-25T22:51:57.863+0000 7fdab0f18640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T22:52:00.479 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:52:00.791 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:52:00.793 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-25T22:52:00.803 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-04-25T22:51:59.927489+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":137,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":95156,"kb_used_data":1608,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":283020364,"statfs":{"total":289910292480,"available":289812852736,"internally_reserved":0,"allocated":1646592,"data_stored":1323805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.921357"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053235+0000","last_change":"2024-04-25T22:51:53.026259+0000","last_active":"2024-04-25T22:51:54.053235+0000","last_peered":"2024-04-25T22:51:54.053235+0000","last_clean":"2024-04-25T22:51:54.053235+0000","last_became_active":"2024-04-25T22:51:53.025647+0000","last_became_peered":"2024-04-25T22:51:53.025647+0000","last_unstale":"2024-04-25T22:51:54.053235+0000","last_undegraded":"2024-04-25T22:51:54.053235+0000","last_fullsized":"2024-04-25T22:51:54.053235+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:44:59.401139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052785+0000","last_change":"2024-04-25T22:51:53.026052+0000","last_active":"2024-04-25T22:51:54.052785+0000","last_peered":"2024-04-25T22:51:54.052785+0000","last_clean":"2024-04-25T22:51:54.052785+0000","last_became_active":"2024-04-25T22:51:53.025562+0000","last_became_peered":"2024-04-25T22:51:53.025562+0000","last_unstale":"2024-04-25T22:51:54.052785+0000","last_undegraded":"2024-04-25T22:51:54.052785+0000","last_fullsized":"2024-04-25T22:51:54.052785+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:06:02.072481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018038+0000","last_change":"2024-04-25T22:51:53.025605+0000","last_active":"2024-04-25T22:51:54.018038+0000","last_peered":"2024-04-25T22:51:54.018038+0000","last_clean":"2024-04-25T22:51:54.018038+0000","last_became_active":"2024-04-25T22:51:53.024929+0000","last_became_peered":"2024-04-25T22:51:53.024929+0000","last_unstale":"2024-04-25T22:51:54.018038+0000","last_undegraded":"2024-04-25T22:51:54.018038+0000","last_fullsized":"2024-04-25T22:51:54.018038+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:12:08.770479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018037+0000","last_change":"2024-04-25T22:51:53.019862+0000","last_active":"2024-04-25T22:51:54.018037+0000","last_peered":"2024-04-25T22:51:54.018037+0000","last_clean":"2024-04-25T22:51:54.018037+0000","last_became_active":"2024-04-25T22:51:53.018814+0000","last_became_peered":"2024-04-25T22:51:53.018814+0000","last_unstale":"2024-04-25T22:51:54.018037+0000","last_undegraded":"2024-04-25T22:51:54.018037+0000","last_fullsized":"2024-04-25T22:51:54.018037+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:22.231993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052571+0000","last_change":"2024-04-25T22:51:53.024641+0000","last_active":"2024-04-25T22:51:54.052571+0000","last_peered":"2024-04-25T22:51:54.052571+0000","last_clean":"2024-04-25T22:51:54.052571+0000","last_became_active":"2024-04-25T22:51:53.024240+0000","last_became_peered":"2024-04-25T22:51:53.024240+0000","last_unstale":"2024-04-25T22:51:54.052571+0000","last_undegraded":"2024-04-25T22:51:54.052571+0000","last_fullsized":"2024-04-25T22:51:54.052571+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:37:13.419317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017491+0000","last_change":"2024-04-25T22:51:53.017733+0000","last_active":"2024-04-25T22:51:54.017491+0000","last_peered":"2024-04-25T22:51:54.017491+0000","last_clean":"2024-04-25T22:51:54.017491+0000","last_became_active":"2024-04-25T22:51:53.016903+0000","last_became_peered":"2024-04-25T22:51:53.016903+0000","last_unstale":"2024-04-25T22:51:54.017491+0000","last_undegraded":"2024-04-25T22:51:54.017491+0000","last_fullsized":"2024-04-25T22:51:54.017491+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:06:02.072481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017578+0000","last_change":"2024-04-25T22:51:53.016102+0000","last_active":"2024-04-25T22:51:54.017578+0000","last_peered":"2024-04-25T22:51:54.017578+0000","last_clean":"2024-04-25T22:51:54.017578+0000","last_became_active":"2024-04-25T22:51:53.015662+0000","last_became_peered":"2024-04-25T22:51:53.015662+0000","last_unstale":"2024-04-25T22:51:54.017578+0000","last_undegraded":"2024-04-25T22:51:54.017578+0000","last_fullsized":"2024-04-25T22:51:54.017578+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:21:52.771650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017247+0000","last_change":"2024-04-25T22:51:53.021907+0000","last_active":"2024-04-25T22:51:54.017247+0000","last_peered":"2024-04-25T22:51:54.017247+0000","last_clean":"2024-04-25T22:51:54.017247+0000","last_became_active":"2024-04-25T22:51:53.019092+0000","last_became_peered":"2024-04-25T22:51:53.019092+0000","last_unstale":"2024-04-25T22:51:54.017247+0000","last_undegraded":"2024-04-25T22:51:54.017247+0000","last_fullsized":"2024-04-25T22:51:54.017247+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:55:27.934567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017941+0000","last_change":"2024-04-25T22:51:53.023004+0000","last_active":"2024-04-25T22:51:54.017941+0000","last_peered":"2024-04-25T22:51:54.017941+0000","last_clean":"2024-04-25T22:51:54.017941+0000","last_became_active":"2024-04-25T22:51:53.021541+0000","last_became_peered":"2024-04-25T22:51:53.021541+0000","last_unstale":"2024-04-25T22:51:54.017941+0000","last_undegraded":"2024-04-25T22:51:54.017941+0000","last_fullsized":"2024-04-25T22:51:54.017941+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:21:52.771650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052904+0000","last_change":"2024-04-25T22:51:53.024967+0000","last_active":"2024-04-25T22:51:54.052904+0000","last_peered":"2024-04-25T22:51:54.052904+0000","last_clean":"2024-04-25T22:51:54.052904+0000","last_became_active":"2024-04-25T22:51:53.024605+0000","last_became_peered":"2024-04-25T22:51:53.024605+0000","last_unstale":"2024-04-25T22:51:54.052904+0000","last_undegraded":"2024-04-25T22:51:54.052904+0000","last_fullsized":"2024-04-25T22:51:54.052904+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:21:52.771650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018442+0000","last_change":"2024-04-25T22:51:53.016889+0000","last_active":"2024-04-25T22:51:54.018442+0000","last_peered":"2024-04-25T22:51:54.018442+0000","last_clean":"2024-04-25T22:51:54.018442+0000","last_became_active":"2024-04-25T22:51:53.016121+0000","last_became_peered":"2024-04-25T22:51:53.016121+0000","last_unstale":"2024-04-25T22:51:54.018442+0000","last_undegraded":"2024-04-25T22:51:54.018442+0000","last_fullsized":"2024-04-25T22:51:54.018442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:11:52.428780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052755+0000","last_change":"2024-04-25T22:51:53.028006+0000","last_active":"2024-04-25T22:51:54.052755+0000","last_peered":"2024-04-25T22:51:54.052755+0000","last_clean":"2024-04-25T22:51:54.052755+0000","last_became_active":"2024-04-25T22:51:53.027363+0000","last_became_peered":"2024-04-25T22:51:53.027363+0000","last_unstale":"2024-04-25T22:51:54.052755+0000","last_undegraded":"2024-04-25T22:51:54.052755+0000","last_fullsized":"2024-04-25T22:51:54.052755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:32.923620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052272+0000","last_change":"2024-04-25T22:51:53.024407+0000","last_active":"2024-04-25T22:51:54.052272+0000","last_peered":"2024-04-25T22:51:54.052272+0000","last_clean":"2024-04-25T22:51:54.052272+0000","last_became_active":"2024-04-25T22:51:53.024079+0000","last_became_peered":"2024-04-25T22:51:53.024079+0000","last_unstale":"2024-04-25T22:51:54.052272+0000","last_undegraded":"2024-04-25T22:51:54.052272+0000","last_fullsized":"2024-04-25T22:51:54.052272+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:40:41.536510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018150+0000","last_change":"2024-04-25T22:51:53.022367+0000","last_active":"2024-04-25T22:51:54.018150+0000","last_peered":"2024-04-25T22:51:54.018150+0000","last_clean":"2024-04-25T22:51:54.018150+0000","last_became_active":"2024-04-25T22:51:53.021902+0000","last_became_peered":"2024-04-25T22:51:53.021902+0000","last_unstale":"2024-04-25T22:51:54.018150+0000","last_undegraded":"2024-04-25T22:51:54.018150+0000","last_fullsized":"2024-04-25T22:51:54.018150+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:44:59.401139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017718+0000","last_change":"2024-04-25T22:51:53.022016+0000","last_active":"2024-04-25T22:51:54.017718+0000","last_peered":"2024-04-25T22:51:54.017718+0000","last_clean":"2024-04-25T22:51:54.017718+0000","last_became_active":"2024-04-25T22:51:53.021666+0000","last_became_peered":"2024-04-25T22:51:53.021666+0000","last_unstale":"2024-04-25T22:51:54.017718+0000","last_undegraded":"2024-04-25T22:51:54.017718+0000","last_fullsized":"2024-04-25T22:51:54.017718+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:28:42.903045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017270+0000","last_change":"2024-04-25T22:51:53.021442+0000","last_active":"2024-04-25T22:51:54.017270+0000","last_peered":"2024-04-25T22:51:54.017270+0000","last_clean":"2024-04-25T22:51:54.017270+0000","last_became_active":"2024-04-25T22:51:53.019251+0000","last_became_peered":"2024-04-25T22:51:53.019251+0000","last_unstale":"2024-04-25T22:51:54.017270+0000","last_undegraded":"2024-04-25T22:51:54.017270+0000","last_fullsized":"2024-04-25T22:51:54.017270+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:18:31.139968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018458+0000","last_change":"2024-04-25T22:51:53.023571+0000","last_active":"2024-04-25T22:51:54.018458+0000","last_peered":"2024-04-25T22:51:54.018458+0000","last_clean":"2024-04-25T22:51:54.018458+0000","last_became_active":"2024-04-25T22:51:53.022774+0000","last_became_peered":"2024-04-25T22:51:53.022774+0000","last_unstale":"2024-04-25T22:51:54.018458+0000","last_undegraded":"2024-04-25T22:51:54.018458+0000","last_fullsized":"2024-04-25T22:51:54.018458+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:41.205051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053209+0000","last_change":"2024-04-25T22:51:53.026365+0000","last_active":"2024-04-25T22:51:54.053209+0000","last_peered":"2024-04-25T22:51:54.053209+0000","last_clean":"2024-04-25T22:51:54.053209+0000","last_became_active":"2024-04-25T22:51:53.025610+0000","last_became_peered":"2024-04-25T22:51:53.025610+0000","last_unstale":"2024-04-25T22:51:54.053209+0000","last_undegraded":"2024-04-25T22:51:54.053209+0000","last_fullsized":"2024-04-25T22:51:54.053209+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:22.231993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017934+0000","last_change":"2024-04-25T22:51:53.020704+0000","last_active":"2024-04-25T22:51:54.017934+0000","last_peered":"2024-04-25T22:51:54.017934+0000","last_clean":"2024-04-25T22:51:54.017934+0000","last_became_active":"2024-04-25T22:51:53.020333+0000","last_became_peered":"2024-04-25T22:51:53.020333+0000","last_unstale":"2024-04-25T22:51:54.017934+0000","last_undegraded":"2024-04-25T22:51:54.017934+0000","last_fullsized":"2024-04-25T22:51:54.017934+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:06:02.072481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018256+0000","last_change":"2024-04-25T22:51:53.019606+0000","last_active":"2024-04-25T22:51:54.018256+0000","last_peered":"2024-04-25T22:51:54.018256+0000","last_clean":"2024-04-25T22:51:54.018256+0000","last_became_active":"2024-04-25T22:51:53.018789+0000","last_became_peered":"2024-04-25T22:51:53.018789+0000","last_unstale":"2024-04-25T22:51:54.018256+0000","last_undegraded":"2024-04-25T22:51:54.018256+0000","last_fullsized":"2024-04-25T22:51:54.018256+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:43:07.741691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018361+0000","last_change":"2024-04-25T22:51:53.018086+0000","last_active":"2024-04-25T22:51:54.018361+0000","last_peered":"2024-04-25T22:51:54.018361+0000","last_clean":"2024-04-25T22:51:54.018361+0000","last_became_active":"2024-04-25T22:51:53.016966+0000","last_became_peered":"2024-04-25T22:51:53.016966+0000","last_unstale":"2024-04-25T22:51:54.018361+0000","last_undegraded":"2024-04-25T22:51:54.018361+0000","last_fullsized":"2024-04-25T22:51:54.018361+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:25:33.516171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052152+0000","last_change":"2024-04-25T22:51:53.026746+0000","last_active":"2024-04-25T22:51:54.052152+0000","last_peered":"2024-04-25T22:51:54.052152+0000","last_clean":"2024-04-25T22:51:54.052152+0000","last_became_active":"2024-04-25T22:51:53.025938+0000","last_became_peered":"2024-04-25T22:51:53.025938+0000","last_unstale":"2024-04-25T22:51:54.052152+0000","last_undegraded":"2024-04-25T22:51:54.052152+0000","last_fullsized":"2024-04-25T22:51:54.052152+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:38:03.428258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.016918+0000","last_change":"2024-04-25T22:51:53.016829+0000","last_active":"2024-04-25T22:51:54.016918+0000","last_peered":"2024-04-25T22:51:54.016918+0000","last_clean":"2024-04-25T22:51:54.016918+0000","last_became_active":"2024-04-25T22:51:53.016497+0000","last_became_peered":"2024-04-25T22:51:53.016497+0000","last_unstale":"2024-04-25T22:51:54.016918+0000","last_undegraded":"2024-04-25T22:51:54.016918+0000","last_fullsized":"2024-04-25T22:51:54.016918+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:11:09.179564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.051948+0000","last_change":"2024-04-25T22:51:53.025164+0000","last_active":"2024-04-25T22:51:54.051948+0000","last_peered":"2024-04-25T22:51:54.051948+0000","last_clean":"2024-04-25T22:51:54.051948+0000","last_became_active":"2024-04-25T22:51:53.024781+0000","last_became_peered":"2024-04-25T22:51:53.024781+0000","last_unstale":"2024-04-25T22:51:54.051948+0000","last_undegraded":"2024-04-25T22:51:54.051948+0000","last_fullsized":"2024-04-25T22:51:54.051948+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:04:31.763523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053277+0000","last_change":"2024-04-25T22:51:53.028155+0000","last_active":"2024-04-25T22:51:54.053277+0000","last_peered":"2024-04-25T22:51:54.053277+0000","last_clean":"2024-04-25T22:51:54.053277+0000","last_became_active":"2024-04-25T22:51:53.027867+0000","last_became_peered":"2024-04-25T22:51:53.027867+0000","last_unstale":"2024-04-25T22:51:54.053277+0000","last_undegraded":"2024-04-25T22:51:54.053277+0000","last_fullsized":"2024-04-25T22:51:54.053277+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:43:47.453569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018121+0000","last_change":"2024-04-25T22:51:53.022959+0000","last_active":"2024-04-25T22:51:54.018121+0000","last_peered":"2024-04-25T22:51:54.018121+0000","last_clean":"2024-04-25T22:51:54.018121+0000","last_became_active":"2024-04-25T22:51:53.022318+0000","last_became_peered":"2024-04-25T22:51:53.022318+0000","last_unstale":"2024-04-25T22:51:54.018121+0000","last_undegraded":"2024-04-25T22:51:54.018121+0000","last_fullsized":"2024-04-25T22:51:54.018121+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:58:11.470631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018639+0000","last_change":"2024-04-25T22:51:53.022893+0000","last_active":"2024-04-25T22:51:54.018639+0000","last_peered":"2024-04-25T22:51:54.018639+0000","last_clean":"2024-04-25T22:51:54.018639+0000","last_became_active":"2024-04-25T22:51:53.022407+0000","last_became_peered":"2024-04-25T22:51:53.022407+0000","last_unstale":"2024-04-25T22:51:54.018639+0000","last_undegraded":"2024-04-25T22:51:54.018639+0000","last_fullsized":"2024-04-25T22:51:54.018639+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:08:44.404718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053002+0000","last_change":"2024-04-25T22:51:53.028447+0000","last_active":"2024-04-25T22:51:54.053002+0000","last_peered":"2024-04-25T22:51:54.053002+0000","last_clean":"2024-04-25T22:51:54.053002+0000","last_became_active":"2024-04-25T22:51:53.027852+0000","last_became_peered":"2024-04-25T22:51:53.027852+0000","last_unstale":"2024-04-25T22:51:54.053002+0000","last_undegraded":"2024-04-25T22:51:54.053002+0000","last_fullsized":"2024-04-25T22:51:54.053002+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:16.187194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017554+0000","last_change":"2024-04-25T22:51:53.019840+0000","last_active":"2024-04-25T22:51:54.017554+0000","last_peered":"2024-04-25T22:51:54.017554+0000","last_clean":"2024-04-25T22:51:54.017554+0000","last_became_active":"2024-04-25T22:51:53.019419+0000","last_became_peered":"2024-04-25T22:51:53.019419+0000","last_unstale":"2024-04-25T22:51:54.017554+0000","last_undegraded":"2024-04-25T22:51:54.017554+0000","last_fullsized":"2024-04-25T22:51:54.017554+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:32.923620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052550+0000","last_change":"2024-04-25T22:51:53.026997+0000","last_active":"2024-04-25T22:51:54.052550+0000","last_peered":"2024-04-25T22:51:54.052550+0000","last_clean":"2024-04-25T22:51:54.052550+0000","last_became_active":"2024-04-25T22:51:53.026379+0000","last_became_peered":"2024-04-25T22:51:53.026379+0000","last_unstale":"2024-04-25T22:51:54.052550+0000","last_undegraded":"2024-04-25T22:51:54.052550+0000","last_fullsized":"2024-04-25T22:51:54.052550+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:33:24.700106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017074+0000","last_change":"2024-04-25T22:51:53.019642+0000","last_active":"2024-04-25T22:51:54.017074+0000","last_peered":"2024-04-25T22:51:54.017074+0000","last_clean":"2024-04-25T22:51:54.017074+0000","last_became_active":"2024-04-25T22:51:53.019197+0000","last_became_peered":"2024-04-25T22:51:53.019197+0000","last_unstale":"2024-04-25T22:51:54.017074+0000","last_undegraded":"2024-04-25T22:51:54.017074+0000","last_fullsized":"2024-04-25T22:51:54.017074+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:12:00.793718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017428+0000","last_change":"2024-04-25T22:51:53.020857+0000","last_active":"2024-04-25T22:51:54.017428+0000","last_peered":"2024-04-25T22:51:54.017428+0000","last_clean":"2024-04-25T22:51:54.017428+0000","last_became_active":"2024-04-25T22:51:53.018340+0000","last_became_peered":"2024-04-25T22:51:53.018340+0000","last_unstale":"2024-04-25T22:51:54.017428+0000","last_undegraded":"2024-04-25T22:51:54.017428+0000","last_fullsized":"2024-04-25T22:51:54.017428+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:32.923620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053001+0000","last_change":"2024-04-25T22:51:53.025101+0000","last_active":"2024-04-25T22:51:54.053001+0000","last_peered":"2024-04-25T22:51:54.053001+0000","last_clean":"2024-04-25T22:51:54.053001+0000","last_became_active":"2024-04-25T22:51:53.024643+0000","last_became_peered":"2024-04-25T22:51:53.024643+0000","last_unstale":"2024-04-25T22:51:54.053001+0000","last_undegraded":"2024-04-25T22:51:54.053001+0000","last_fullsized":"2024-04-25T22:51:54.053001+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:58:11.470631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018622+0000","last_change":"2024-04-25T22:51:52.017181+0000","last_active":"2024-04-25T22:51:54.018622+0000","last_peered":"2024-04-25T22:51:54.018622+0000","last_clean":"2024-04-25T22:51:54.018622+0000","last_became_active":"2024-04-25T22:51:52.016682+0000","last_became_peered":"2024-04-25T22:51:52.016682+0000","last_unstale":"2024-04-25T22:51:54.018622+0000","last_undegraded":"2024-04-25T22:51:54.018622+0000","last_fullsized":"2024-04-25T22:51:54.018622+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:18:00.975479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053150+0000","last_change":"2024-04-25T22:51:53.026414+0000","last_active":"2024-04-25T22:51:54.053150+0000","last_peered":"2024-04-25T22:51:54.053150+0000","last_clean":"2024-04-25T22:51:54.053150+0000","last_became_active":"2024-04-25T22:51:53.025591+0000","last_became_peered":"2024-04-25T22:51:53.025591+0000","last_unstale":"2024-04-25T22:51:54.053150+0000","last_undegraded":"2024-04-25T22:51:54.053150+0000","last_fullsized":"2024-04-25T22:51:54.053150+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:12:08.770479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017399+0000","last_change":"2024-04-25T22:51:52.019690+0000","last_active":"2024-04-25T22:51:54.017399+0000","last_peered":"2024-04-25T22:51:54.017399+0000","last_clean":"2024-04-25T22:51:54.017399+0000","last_became_active":"2024-04-25T22:51:52.018818+0000","last_became_peered":"2024-04-25T22:51:52.018818+0000","last_unstale":"2024-04-25T22:51:54.017399+0000","last_undegraded":"2024-04-25T22:51:54.017399+0000","last_fullsized":"2024-04-25T22:51:54.017399+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:25:48.361495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018267+0000","last_change":"2024-04-25T22:51:53.023197+0000","last_active":"2024-04-25T22:51:54.018267+0000","last_peered":"2024-04-25T22:51:54.018267+0000","last_clean":"2024-04-25T22:51:54.018267+0000","last_became_active":"2024-04-25T22:51:53.022627+0000","last_became_peered":"2024-04-25T22:51:53.022627+0000","last_unstale":"2024-04-25T22:51:54.018267+0000","last_undegraded":"2024-04-25T22:51:54.018267+0000","last_fullsized":"2024-04-25T22:51:54.018267+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:44:59.401139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052236+0000","last_change":"2024-04-25T22:51:52.018646+0000","last_active":"2024-04-25T22:51:54.052236+0000","last_peered":"2024-04-25T22:51:54.052236+0000","last_clean":"2024-04-25T22:51:54.052236+0000","last_became_active":"2024-04-25T22:51:52.018313+0000","last_became_peered":"2024-04-25T22:51:52.018313+0000","last_unstale":"2024-04-25T22:51:54.052236+0000","last_undegraded":"2024-04-25T22:51:54.052236+0000","last_fullsized":"2024-04-25T22:51:54.052236+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:00:21.688745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018104+0000","last_change":"2024-04-25T22:51:53.022419+0000","last_active":"2024-04-25T22:51:54.018104+0000","last_peered":"2024-04-25T22:51:54.018104+0000","last_clean":"2024-04-25T22:51:54.018104+0000","last_became_active":"2024-04-25T22:51:53.021405+0000","last_became_peered":"2024-04-25T22:51:53.021405+0000","last_unstale":"2024-04-25T22:51:54.018104+0000","last_undegraded":"2024-04-25T22:51:54.018104+0000","last_fullsized":"2024-04-25T22:51:54.018104+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:28:42.903045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":22,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017441+0000","last_change":"2024-04-25T22:51:52.021510+0000","last_active":"2024-04-25T22:51:54.017441+0000","last_peered":"2024-04-25T22:51:54.017441+0000","last_clean":"2024-04-25T22:51:54.017441+0000","last_became_active":"2024-04-25T22:51:52.021145+0000","last_became_peered":"2024-04-25T22:51:52.021145+0000","last_unstale":"2024-04-25T22:51:54.017441+0000","last_undegraded":"2024-04-25T22:51:54.017441+0000","last_fullsized":"2024-04-25T22:51:54.017441+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:05.110747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018420+0000","last_change":"2024-04-25T22:51:52.021355+0000","last_active":"2024-04-25T22:51:54.018420+0000","last_peered":"2024-04-25T22:51:54.018420+0000","last_clean":"2024-04-25T22:51:54.018420+0000","last_became_active":"2024-04-25T22:51:52.020860+0000","last_became_peered":"2024-04-25T22:51:52.020860+0000","last_unstale":"2024-04-25T22:51:54.018420+0000","last_undegraded":"2024-04-25T22:51:54.018420+0000","last_fullsized":"2024-04-25T22:51:54.018420+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:55.235787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.051967+0000","last_change":"2024-04-25T22:51:53.029390+0000","last_active":"2024-04-25T22:51:54.051967+0000","last_peered":"2024-04-25T22:51:54.051967+0000","last_clean":"2024-04-25T22:51:54.051967+0000","last_became_active":"2024-04-25T22:51:53.029157+0000","last_became_peered":"2024-04-25T22:51:53.029157+0000","last_unstale":"2024-04-25T22:51:54.051967+0000","last_undegraded":"2024-04-25T22:51:54.051967+0000","last_fullsized":"2024-04-25T22:51:54.051967+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:51:43.808994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053167+0000","last_change":"2024-04-25T22:51:52.018856+0000","last_active":"2024-04-25T22:51:54.053167+0000","last_peered":"2024-04-25T22:51:54.053167+0000","last_clean":"2024-04-25T22:51:54.053167+0000","last_became_active":"2024-04-25T22:51:52.018390+0000","last_became_peered":"2024-04-25T22:51:52.018390+0000","last_unstale":"2024-04-25T22:51:54.053167+0000","last_undegraded":"2024-04-25T22:51:54.053167+0000","last_fullsized":"2024-04-25T22:51:54.053167+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:42:54.430484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052143+0000","last_change":"2024-04-25T22:51:53.024599+0000","last_active":"2024-04-25T22:51:54.052143+0000","last_peered":"2024-04-25T22:51:54.052143+0000","last_clean":"2024-04-25T22:51:54.052143+0000","last_became_active":"2024-04-25T22:51:53.024155+0000","last_became_peered":"2024-04-25T22:51:53.024155+0000","last_unstale":"2024-04-25T22:51:54.052143+0000","last_undegraded":"2024-04-25T22:51:54.052143+0000","last_fullsized":"2024-04-25T22:51:54.052143+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:09:52.869451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018756+0000","last_change":"2024-04-25T22:51:52.019724+0000","last_active":"2024-04-25T22:51:54.018756+0000","last_peered":"2024-04-25T22:51:54.018756+0000","last_clean":"2024-04-25T22:51:54.018756+0000","last_became_active":"2024-04-25T22:51:52.019167+0000","last_became_peered":"2024-04-25T22:51:52.019167+0000","last_unstale":"2024-04-25T22:51:54.018756+0000","last_undegraded":"2024-04-25T22:51:54.018756+0000","last_fullsized":"2024-04-25T22:51:54.018756+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:03:14.826593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017804+0000","last_change":"2024-04-25T22:51:53.017327+0000","last_active":"2024-04-25T22:51:54.017804+0000","last_peered":"2024-04-25T22:51:54.017804+0000","last_clean":"2024-04-25T22:51:54.017804+0000","last_became_active":"2024-04-25T22:51:53.015987+0000","last_became_peered":"2024-04-25T22:51:53.015987+0000","last_unstale":"2024-04-25T22:51:54.017804+0000","last_undegraded":"2024-04-25T22:51:54.017804+0000","last_fullsized":"2024-04-25T22:51:54.017804+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:16.602188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018741+0000","last_change":"2024-04-25T22:51:52.016151+0000","last_active":"2024-04-25T22:51:54.018741+0000","last_peered":"2024-04-25T22:51:54.018741+0000","last_clean":"2024-04-25T22:51:54.018741+0000","last_became_active":"2024-04-25T22:51:52.015741+0000","last_became_peered":"2024-04-25T22:51:52.015741+0000","last_unstale":"2024-04-25T22:51:54.018741+0000","last_undegraded":"2024-04-25T22:51:54.018741+0000","last_fullsized":"2024-04-25T22:51:54.018741+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:02:25.133948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018157+0000","last_change":"2024-04-25T22:51:53.021208+0000","last_active":"2024-04-25T22:51:54.018157+0000","last_peered":"2024-04-25T22:51:54.018157+0000","last_clean":"2024-04-25T22:51:54.018157+0000","last_became_active":"2024-04-25T22:51:53.020752+0000","last_became_peered":"2024-04-25T22:51:53.020752+0000","last_unstale":"2024-04-25T22:51:54.018157+0000","last_undegraded":"2024-04-25T22:51:54.018157+0000","last_fullsized":"2024-04-25T22:51:54.018157+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:16.602188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017996+0000","last_change":"2024-04-25T22:51:52.018716+0000","last_active":"2024-04-25T22:51:54.017996+0000","last_peered":"2024-04-25T22:51:54.017996+0000","last_clean":"2024-04-25T22:51:54.017996+0000","last_became_active":"2024-04-25T22:51:52.018140+0000","last_became_peered":"2024-04-25T22:51:52.018140+0000","last_unstale":"2024-04-25T22:51:54.017996+0000","last_undegraded":"2024-04-25T22:51:54.017996+0000","last_fullsized":"2024-04-25T22:51:54.017996+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:02:25.133948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018609+0000","last_change":"2024-04-25T22:51:53.019508+0000","last_active":"2024-04-25T22:51:54.018609+0000","last_peered":"2024-04-25T22:51:54.018609+0000","last_clean":"2024-04-25T22:51:54.018609+0000","last_became_active":"2024-04-25T22:51:53.016749+0000","last_became_peered":"2024-04-25T22:51:53.016749+0000","last_unstale":"2024-04-25T22:51:54.018609+0000","last_undegraded":"2024-04-25T22:51:54.018609+0000","last_fullsized":"2024-04-25T22:51:54.018609+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:25.110416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018342+0000","last_change":"2024-04-25T22:51:52.022474+0000","last_active":"2024-04-25T22:51:54.018342+0000","last_peered":"2024-04-25T22:51:54.018342+0000","last_clean":"2024-04-25T22:51:54.018342+0000","last_became_active":"2024-04-25T22:51:52.022141+0000","last_became_peered":"2024-04-25T22:51:52.022141+0000","last_unstale":"2024-04-25T22:51:54.018342+0000","last_undegraded":"2024-04-25T22:51:54.018342+0000","last_fullsized":"2024-04-25T22:51:54.018342+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:17:10.500338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018670+0000","last_change":"2024-04-25T22:51:53.023929+0000","last_active":"2024-04-25T22:51:54.018670+0000","last_peered":"2024-04-25T22:51:54.018670+0000","last_clean":"2024-04-25T22:51:54.018670+0000","last_became_active":"2024-04-25T22:51:53.023405+0000","last_became_peered":"2024-04-25T22:51:53.023405+0000","last_unstale":"2024-04-25T22:51:54.018670+0000","last_undegraded":"2024-04-25T22:51:54.018670+0000","last_fullsized":"2024-04-25T22:51:54.018670+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:35:35.419823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052331+0000","last_change":"2024-04-25T22:51:52.018970+0000","last_active":"2024-04-25T22:51:54.052331+0000","last_peered":"2024-04-25T22:51:54.052331+0000","last_clean":"2024-04-25T22:51:54.052331+0000","last_became_active":"2024-04-25T22:51:52.018439+0000","last_became_peered":"2024-04-25T22:51:52.018439+0000","last_unstale":"2024-04-25T22:51:54.052331+0000","last_undegraded":"2024-04-25T22:51:54.052331+0000","last_fullsized":"2024-04-25T22:51:54.052331+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:24:31.748243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018219+0000","last_change":"2024-04-25T22:51:53.020574+0000","last_active":"2024-04-25T22:51:54.018219+0000","last_peered":"2024-04-25T22:51:54.018219+0000","last_clean":"2024-04-25T22:51:54.018219+0000","last_became_active":"2024-04-25T22:51:53.019978+0000","last_became_peered":"2024-04-25T22:51:53.019978+0000","last_unstale":"2024-04-25T22:51:54.018219+0000","last_undegraded":"2024-04-25T22:51:54.018219+0000","last_fullsized":"2024-04-25T22:51:54.018219+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:41.205051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052156+0000","last_change":"2024-04-25T22:51:52.017743+0000","last_active":"2024-04-25T22:51:54.052156+0000","last_peered":"2024-04-25T22:51:54.052156+0000","last_clean":"2024-04-25T22:51:54.052156+0000","last_became_active":"2024-04-25T22:51:52.016659+0000","last_became_peered":"2024-04-25T22:51:52.016659+0000","last_unstale":"2024-04-25T22:51:54.052156+0000","last_undegraded":"2024-04-25T22:51:54.052156+0000","last_fullsized":"2024-04-25T22:51:54.052156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:49:07.912197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018170+0000","last_change":"2024-04-25T22:51:53.023278+0000","last_active":"2024-04-25T22:51:54.018170+0000","last_peered":"2024-04-25T22:51:54.018170+0000","last_clean":"2024-04-25T22:51:54.018170+0000","last_became_active":"2024-04-25T22:51:53.021948+0000","last_became_peered":"2024-04-25T22:51:53.021948+0000","last_unstale":"2024-04-25T22:51:54.018170+0000","last_undegraded":"2024-04-25T22:51:54.018170+0000","last_fullsized":"2024-04-25T22:51:54.018170+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:22.231993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":216,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017807+0000","last_change":"2024-04-25T22:51:47.764624+0000","last_active":"2024-04-25T22:51:54.017807+0000","last_peered":"2024-04-25T22:51:54.017807+0000","last_clean":"2024-04-25T22:51:54.017807+0000","last_became_active":"2024-04-25T22:51:47.764176+0000","last_became_peered":"2024-04-25T22:51:47.764176+0000","last_unstale":"2024-04-25T22:51:54.017807+0000","last_undegraded":"2024-04-25T22:51:54.017807+0000","last_fullsized":"2024-04-25T22:51:54.017807+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:59:39.005489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018697+0000","last_change":"2024-04-25T22:51:47.768368+0000","last_active":"2024-04-25T22:51:54.018697+0000","last_peered":"2024-04-25T22:51:54.018697+0000","last_clean":"2024-04-25T22:51:54.018697+0000","last_became_active":"2024-04-25T22:51:47.768003+0000","last_became_peered":"2024-04-25T22:51:47.768003+0000","last_unstale":"2024-04-25T22:51:54.018697+0000","last_undegraded":"2024-04-25T22:51:54.018697+0000","last_fullsized":"2024-04-25T22:51:54.018697+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:10:00.098072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017829+0000","last_change":"2024-04-25T22:51:52.014376+0000","last_active":"2024-04-25T22:51:54.017829+0000","last_peered":"2024-04-25T22:51:54.017829+0000","last_clean":"2024-04-25T22:51:54.017829+0000","last_became_active":"2024-04-25T22:51:52.013816+0000","last_became_peered":"2024-04-25T22:51:52.013816+0000","last_unstale":"2024-04-25T22:51:54.017829+0000","last_undegraded":"2024-04-25T22:51:54.017829+0000","last_fullsized":"2024-04-25T22:51:54.017829+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:18.136883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018819+0000","last_change":"2024-04-25T22:51:53.024106+0000","last_active":"2024-04-25T22:51:54.018819+0000","last_peered":"2024-04-25T22:51:54.018819+0000","last_clean":"2024-04-25T22:51:54.018819+0000","last_became_active":"2024-04-25T22:51:53.023497+0000","last_became_peered":"2024-04-25T22:51:53.023497+0000","last_unstale":"2024-04-25T22:51:54.018819+0000","last_undegraded":"2024-04-25T22:51:54.018819+0000","last_fullsized":"2024-04-25T22:51:54.018819+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:52:16.918935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017591+0000","last_change":"2024-04-25T22:51:47.764591+0000","last_active":"2024-04-25T22:51:54.017591+0000","last_peered":"2024-04-25T22:51:54.017591+0000","last_clean":"2024-04-25T22:51:54.017591+0000","last_became_active":"2024-04-25T22:51:47.764229+0000","last_became_peered":"2024-04-25T22:51:47.764229+0000","last_unstale":"2024-04-25T22:51:54.017591+0000","last_undegraded":"2024-04-25T22:51:54.017591+0000","last_fullsized":"2024-04-25T22:51:54.017591+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:32.854624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017358+0000","last_change":"2024-04-25T22:51:52.017918+0000","last_active":"2024-04-25T22:51:54.017358+0000","last_peered":"2024-04-25T22:51:54.017358+0000","last_clean":"2024-04-25T22:51:54.017358+0000","last_became_active":"2024-04-25T22:51:52.017541+0000","last_became_peered":"2024-04-25T22:51:52.017541+0000","last_unstale":"2024-04-25T22:51:54.017358+0000","last_undegraded":"2024-04-25T22:51:54.017358+0000","last_fullsized":"2024-04-25T22:51:54.017358+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:17:10.500338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052996+0000","last_change":"2024-04-25T22:51:53.026971+0000","last_active":"2024-04-25T22:51:54.052996+0000","last_peered":"2024-04-25T22:51:54.052996+0000","last_clean":"2024-04-25T22:51:54.052996+0000","last_became_active":"2024-04-25T22:51:53.026355+0000","last_became_peered":"2024-04-25T22:51:53.026355+0000","last_unstale":"2024-04-25T22:51:54.052996+0000","last_undegraded":"2024-04-25T22:51:54.052996+0000","last_fullsized":"2024-04-25T22:51:54.052996+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:16.602188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017440+0000","last_change":"2024-04-25T22:51:47.762564+0000","last_active":"2024-04-25T22:51:54.017440+0000","last_peered":"2024-04-25T22:51:54.017440+0000","last_clean":"2024-04-25T22:51:54.017440+0000","last_became_active":"2024-04-25T22:51:47.762218+0000","last_became_peered":"2024-04-25T22:51:47.762218+0000","last_unstale":"2024-04-25T22:51:54.017440+0000","last_undegraded":"2024-04-25T22:51:54.017440+0000","last_fullsized":"2024-04-25T22:51:54.017440+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:09:06.117740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052192+0000","last_change":"2024-04-25T22:51:52.018873+0000","last_active":"2024-04-25T22:51:54.052192+0000","last_peered":"2024-04-25T22:51:54.052192+0000","last_clean":"2024-04-25T22:51:54.052192+0000","last_became_active":"2024-04-25T22:51:52.018300+0000","last_became_peered":"2024-04-25T22:51:52.018300+0000","last_unstale":"2024-04-25T22:51:54.052192+0000","last_undegraded":"2024-04-25T22:51:54.052192+0000","last_fullsized":"2024-04-25T22:51:54.052192+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:25:22.660789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018295+0000","last_change":"2024-04-25T22:51:53.023461+0000","last_active":"2024-04-25T22:51:54.018295+0000","last_peered":"2024-04-25T22:51:54.018295+0000","last_clean":"2024-04-25T22:51:54.018295+0000","last_became_active":"2024-04-25T22:51:53.022017+0000","last_became_peered":"2024-04-25T22:51:53.022017+0000","last_unstale":"2024-04-25T22:51:54.018295+0000","last_undegraded":"2024-04-25T22:51:54.018295+0000","last_fullsized":"2024-04-25T22:51:54.018295+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:43:47.453569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018255+0000","last_change":"2024-04-25T22:51:47.768269+0000","last_active":"2024-04-25T22:51:54.018255+0000","last_peered":"2024-04-25T22:51:54.018255+0000","last_clean":"2024-04-25T22:51:54.018255+0000","last_became_active":"2024-04-25T22:51:47.767991+0000","last_became_peered":"2024-04-25T22:51:47.767991+0000","last_unstale":"2024-04-25T22:51:54.018255+0000","last_undegraded":"2024-04-25T22:51:54.018255+0000","last_fullsized":"2024-04-25T22:51:54.018255+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:01:54.134289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018678+0000","last_change":"2024-04-25T22:51:52.021220+0000","last_active":"2024-04-25T22:51:54.018678+0000","last_peered":"2024-04-25T22:51:54.018678+0000","last_clean":"2024-04-25T22:51:54.018678+0000","last_became_active":"2024-04-25T22:51:52.020833+0000","last_became_peered":"2024-04-25T22:51:52.020833+0000","last_unstale":"2024-04-25T22:51:54.018678+0000","last_undegraded":"2024-04-25T22:51:54.018678+0000","last_fullsized":"2024-04-25T22:51:54.018678+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:12.627716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018128+0000","last_change":"2024-04-25T22:51:53.020666+0000","last_active":"2024-04-25T22:51:54.018128+0000","last_peered":"2024-04-25T22:51:54.018128+0000","last_clean":"2024-04-25T22:51:54.018128+0000","last_became_active":"2024-04-25T22:51:53.020212+0000","last_became_peered":"2024-04-25T22:51:53.020212+0000","last_unstale":"2024-04-25T22:51:54.018128+0000","last_undegraded":"2024-04-25T22:51:54.018128+0000","last_fullsized":"2024-04-25T22:51:54.018128+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:12:08.770479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018823+0000","last_change":"2024-04-25T22:51:52.016362+0000","last_active":"2024-04-25T22:51:54.018823+0000","last_peered":"2024-04-25T22:51:54.018823+0000","last_clean":"2024-04-25T22:51:54.018823+0000","last_became_active":"2024-04-25T22:51:52.015409+0000","last_became_peered":"2024-04-25T22:51:52.015409+0000","last_unstale":"2024-04-25T22:51:54.018823+0000","last_undegraded":"2024-04-25T22:51:54.018823+0000","last_fullsized":"2024-04-25T22:51:54.018823+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:21:19.563620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018072+0000","last_change":"2024-04-25T22:51:47.761131+0000","last_active":"2024-04-25T22:51:54.018072+0000","last_peered":"2024-04-25T22:51:54.018072+0000","last_clean":"2024-04-25T22:51:54.018072+0000","last_became_active":"2024-04-25T22:51:47.760894+0000","last_became_peered":"2024-04-25T22:51:47.760894+0000","last_unstale":"2024-04-25T22:51:54.018072+0000","last_undegraded":"2024-04-25T22:51:54.018072+0000","last_fullsized":"2024-04-25T22:51:54.018072+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:38:28.554024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052447+0000","last_change":"2024-04-25T22:51:53.026321+0000","last_active":"2024-04-25T22:51:54.052447+0000","last_peered":"2024-04-25T22:51:54.052447+0000","last_clean":"2024-04-25T22:51:54.052447+0000","last_became_active":"2024-04-25T22:51:53.025824+0000","last_became_peered":"2024-04-25T22:51:53.025824+0000","last_unstale":"2024-04-25T22:51:54.052447+0000","last_undegraded":"2024-04-25T22:51:54.052447+0000","last_fullsized":"2024-04-25T22:51:54.052447+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:12:00.793718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017995+0000","last_change":"2024-04-25T22:51:52.015638+0000","last_active":"2024-04-25T22:51:54.017995+0000","last_peered":"2024-04-25T22:51:54.017995+0000","last_clean":"2024-04-25T22:51:54.017995+0000","last_became_active":"2024-04-25T22:51:52.014858+0000","last_became_peered":"2024-04-25T22:51:52.014858+0000","last_unstale":"2024-04-25T22:51:54.017995+0000","last_undegraded":"2024-04-25T22:51:54.017995+0000","last_fullsized":"2024-04-25T22:51:54.017995+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:44:34.159650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053349+0000","last_change":"2024-04-25T22:51:47.765532+0000","last_active":"2024-04-25T22:51:54.053349+0000","last_peered":"2024-04-25T22:51:54.053349+0000","last_clean":"2024-04-25T22:51:54.053349+0000","last_became_active":"2024-04-25T22:51:47.765247+0000","last_became_peered":"2024-04-25T22:51:47.765247+0000","last_unstale":"2024-04-25T22:51:54.053349+0000","last_undegraded":"2024-04-25T22:51:54.053349+0000","last_fullsized":"2024-04-25T22:51:54.053349+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:55:05.342938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052632+0000","last_change":"2024-04-25T22:51:53.027051+0000","last_active":"2024-04-25T22:51:54.052632+0000","last_peered":"2024-04-25T22:51:54.052632+0000","last_clean":"2024-04-25T22:51:54.052632+0000","last_became_active":"2024-04-25T22:51:53.026458+0000","last_became_peered":"2024-04-25T22:51:53.026458+0000","last_unstale":"2024-04-25T22:51:54.052632+0000","last_undegraded":"2024-04-25T22:51:54.052632+0000","last_fullsized":"2024-04-25T22:51:54.052632+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:11:09.179564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018550+0000","last_change":"2024-04-25T22:51:52.015635+0000","last_active":"2024-04-25T22:51:54.018550+0000","last_peered":"2024-04-25T22:51:54.018550+0000","last_clean":"2024-04-25T22:51:54.018550+0000","last_became_active":"2024-04-25T22:51:52.014778+0000","last_became_peered":"2024-04-25T22:51:52.014778+0000","last_unstale":"2024-04-25T22:51:54.018550+0000","last_undegraded":"2024-04-25T22:51:54.018550+0000","last_fullsized":"2024-04-25T22:51:54.018550+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:21:19.563620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018314+0000","last_change":"2024-04-25T22:51:47.762468+0000","last_active":"2024-04-25T22:51:54.018314+0000","last_peered":"2024-04-25T22:51:54.018314+0000","last_clean":"2024-04-25T22:51:54.018314+0000","last_became_active":"2024-04-25T22:51:47.762199+0000","last_became_peered":"2024-04-25T22:51:47.762199+0000","last_unstale":"2024-04-25T22:51:54.018314+0000","last_undegraded":"2024-04-25T22:51:54.018314+0000","last_fullsized":"2024-04-25T22:51:54.018314+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:32.854624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017184+0000","last_change":"2024-04-25T22:51:53.023317+0000","last_active":"2024-04-25T22:51:54.017184+0000","last_peered":"2024-04-25T22:51:54.017184+0000","last_clean":"2024-04-25T22:51:54.017184+0000","last_became_active":"2024-04-25T22:51:53.022756+0000","last_became_peered":"2024-04-25T22:51:53.022756+0000","last_unstale":"2024-04-25T22:51:54.017184+0000","last_undegraded":"2024-04-25T22:51:54.017184+0000","last_fullsized":"2024-04-25T22:51:54.017184+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:37:13.419317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:55.011718+0000","last_change":"2024-04-25T22:51:52.017845+0000","last_active":"2024-04-25T22:51:55.011718+0000","last_peered":"2024-04-25T22:51:55.011718+0000","last_clean":"2024-04-25T22:51:55.011718+0000","last_became_active":"2024-04-25T22:51:52.017521+0000","last_became_peered":"2024-04-25T22:51:52.017521+0000","last_unstale":"2024-04-25T22:51:55.011718+0000","last_undegraded":"2024-04-25T22:51:55.011718+0000","last_fullsized":"2024-04-25T22:51:55.011718+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:18:00.975479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018392+0000","last_change":"2024-04-25T22:51:47.764288+0000","last_active":"2024-04-25T22:51:54.018392+0000","last_peered":"2024-04-25T22:51:54.018392+0000","last_clean":"2024-04-25T22:51:54.018392+0000","last_became_active":"2024-04-25T22:51:47.763961+0000","last_became_peered":"2024-04-25T22:51:47.763961+0000","last_unstale":"2024-04-25T22:51:54.018392+0000","last_undegraded":"2024-04-25T22:51:54.018392+0000","last_fullsized":"2024-04-25T22:51:54.018392+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:03:07.164842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052084+0000","last_change":"2024-04-25T22:51:53.026925+0000","last_active":"2024-04-25T22:51:54.052084+0000","last_peered":"2024-04-25T22:51:54.052084+0000","last_clean":"2024-04-25T22:51:54.052084+0000","last_became_active":"2024-04-25T22:51:53.026419+0000","last_became_peered":"2024-04-25T22:51:53.026419+0000","last_unstale":"2024-04-25T22:51:54.052084+0000","last_undegraded":"2024-04-25T22:51:54.052084+0000","last_fullsized":"2024-04-25T22:51:54.052084+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:49:38.102060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018559+0000","last_change":"2024-04-25T22:51:53.022222+0000","last_active":"2024-04-25T22:51:54.018559+0000","last_peered":"2024-04-25T22:51:54.018559+0000","last_clean":"2024-04-25T22:51:54.018559+0000","last_became_active":"2024-04-25T22:51:53.021687+0000","last_became_peered":"2024-04-25T22:51:53.021687+0000","last_unstale":"2024-04-25T22:51:54.018559+0000","last_undegraded":"2024-04-25T22:51:54.018559+0000","last_fullsized":"2024-04-25T22:51:54.018559+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:35:06.234402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018650+0000","last_change":"2024-04-25T22:51:52.019928+0000","last_active":"2024-04-25T22:51:54.018650+0000","last_peered":"2024-04-25T22:51:54.018650+0000","last_clean":"2024-04-25T22:51:54.018650+0000","last_became_active":"2024-04-25T22:51:52.019264+0000","last_became_peered":"2024-04-25T22:51:52.019264+0000","last_unstale":"2024-04-25T22:51:54.018650+0000","last_undegraded":"2024-04-25T22:51:54.018650+0000","last_fullsized":"2024-04-25T22:51:54.018650+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:18.136883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017393+0000","last_change":"2024-04-25T22:51:53.020652+0000","last_active":"2024-04-25T22:51:54.017393+0000","last_peered":"2024-04-25T22:51:54.017393+0000","last_clean":"2024-04-25T22:51:54.017393+0000","last_became_active":"2024-04-25T22:51:53.020129+0000","last_became_peered":"2024-04-25T22:51:53.020129+0000","last_unstale":"2024-04-25T22:51:54.017393+0000","last_undegraded":"2024-04-25T22:51:54.017393+0000","last_fullsized":"2024-04-25T22:51:54.017393+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:18:31.139968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053289+0000","last_change":"2024-04-25T22:51:52.018977+0000","last_active":"2024-04-25T22:51:54.053289+0000","last_peered":"2024-04-25T22:51:54.053289+0000","last_clean":"2024-04-25T22:51:54.053289+0000","last_became_active":"2024-04-25T22:51:52.018519+0000","last_became_peered":"2024-04-25T22:51:52.018519+0000","last_unstale":"2024-04-25T22:51:54.053289+0000","last_undegraded":"2024-04-25T22:51:54.053289+0000","last_fullsized":"2024-04-25T22:51:54.053289+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:53:07.306148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018416+0000","last_change":"2024-04-25T22:51:52.022177+0000","last_active":"2024-04-25T22:51:54.018416+0000","last_peered":"2024-04-25T22:51:54.018416+0000","last_clean":"2024-04-25T22:51:54.018416+0000","last_became_active":"2024-04-25T22:51:52.021882+0000","last_became_peered":"2024-04-25T22:51:52.021882+0000","last_unstale":"2024-04-25T22:51:54.018416+0000","last_undegraded":"2024-04-25T22:51:54.018416+0000","last_fullsized":"2024-04-25T22:51:54.018416+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:44:34.159650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017107+0000","last_change":"2024-04-25T22:51:53.022499+0000","last_active":"2024-04-25T22:51:54.017107+0000","last_peered":"2024-04-25T22:51:54.017107+0000","last_clean":"2024-04-25T22:51:54.017107+0000","last_became_active":"2024-04-25T22:51:53.022018+0000","last_became_peered":"2024-04-25T22:51:53.022018+0000","last_unstale":"2024-04-25T22:51:54.017107+0000","last_undegraded":"2024-04-25T22:51:54.017107+0000","last_fullsized":"2024-04-25T22:51:54.017107+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:33:24.700106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018441+0000","last_change":"2024-04-25T22:51:52.019673+0000","last_active":"2024-04-25T22:51:54.018441+0000","last_peered":"2024-04-25T22:51:54.018441+0000","last_clean":"2024-04-25T22:51:54.018441+0000","last_became_active":"2024-04-25T22:51:52.018877+0000","last_became_peered":"2024-04-25T22:51:52.018877+0000","last_unstale":"2024-04-25T22:51:54.018441+0000","last_undegraded":"2024-04-25T22:51:54.018441+0000","last_fullsized":"2024-04-25T22:51:54.018441+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:05.110747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017316+0000","last_change":"2024-04-25T22:51:53.020927+0000","last_active":"2024-04-25T22:51:54.017316+0000","last_peered":"2024-04-25T22:51:54.017316+0000","last_clean":"2024-04-25T22:51:54.017316+0000","last_became_active":"2024-04-25T22:51:53.020366+0000","last_became_peered":"2024-04-25T22:51:53.020366+0000","last_unstale":"2024-04-25T22:51:54.017316+0000","last_undegraded":"2024-04-25T22:51:54.017316+0000","last_fullsized":"2024-04-25T22:51:54.017316+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:55:27.934567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053387+0000","last_change":"2024-04-25T22:51:53.029210+0000","last_active":"2024-04-25T22:51:54.053387+0000","last_peered":"2024-04-25T22:51:54.053387+0000","last_clean":"2024-04-25T22:51:54.053387+0000","last_became_active":"2024-04-25T22:51:53.028635+0000","last_became_peered":"2024-04-25T22:51:53.028635+0000","last_unstale":"2024-04-25T22:51:54.053387+0000","last_undegraded":"2024-04-25T22:51:54.053387+0000","last_fullsized":"2024-04-25T22:51:54.053387+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:41.205051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017373+0000","last_change":"2024-04-25T22:51:52.014897+0000","last_active":"2024-04-25T22:51:54.017373+0000","last_peered":"2024-04-25T22:51:54.017373+0000","last_clean":"2024-04-25T22:51:54.017373+0000","last_became_active":"2024-04-25T22:51:52.014344+0000","last_became_peered":"2024-04-25T22:51:52.014344+0000","last_unstale":"2024-04-25T22:51:54.017373+0000","last_undegraded":"2024-04-25T22:51:54.017373+0000","last_fullsized":"2024-04-25T22:51:54.017373+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:55.235787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018063+0000","last_change":"2024-04-25T22:51:53.022920+0000","last_active":"2024-04-25T22:51:54.018063+0000","last_peered":"2024-04-25T22:51:54.018063+0000","last_clean":"2024-04-25T22:51:54.018063+0000","last_became_active":"2024-04-25T22:51:53.022190+0000","last_became_peered":"2024-04-25T22:51:53.022190+0000","last_unstale":"2024-04-25T22:51:54.018063+0000","last_undegraded":"2024-04-25T22:51:54.018063+0000","last_fullsized":"2024-04-25T22:51:54.018063+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:16.187194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017261+0000","last_change":"2024-04-25T22:51:52.018371+0000","last_active":"2024-04-25T22:51:54.017261+0000","last_peered":"2024-04-25T22:51:54.017261+0000","last_clean":"2024-04-25T22:51:54.017261+0000","last_became_active":"2024-04-25T22:51:52.018027+0000","last_became_peered":"2024-04-25T22:51:52.018027+0000","last_unstale":"2024-04-25T22:51:54.017261+0000","last_undegraded":"2024-04-25T22:51:54.017261+0000","last_fullsized":"2024-04-25T22:51:54.017261+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:36:57.435877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052965+0000","last_change":"2024-04-25T22:51:53.028084+0000","last_active":"2024-04-25T22:51:54.052965+0000","last_peered":"2024-04-25T22:51:54.052965+0000","last_clean":"2024-04-25T22:51:54.052965+0000","last_became_active":"2024-04-25T22:51:53.027541+0000","last_became_peered":"2024-04-25T22:51:53.027541+0000","last_unstale":"2024-04-25T22:51:54.052965+0000","last_undegraded":"2024-04-25T22:51:54.052965+0000","last_fullsized":"2024-04-25T22:51:54.052965+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:28:42.903045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052565+0000","last_change":"2024-04-25T22:51:52.017006+0000","last_active":"2024-04-25T22:51:54.052565+0000","last_peered":"2024-04-25T22:51:54.052565+0000","last_clean":"2024-04-25T22:51:54.052565+0000","last_became_active":"2024-04-25T22:51:52.016667+0000","last_became_peered":"2024-04-25T22:51:52.016667+0000","last_unstale":"2024-04-25T22:51:54.052565+0000","last_undegraded":"2024-04-25T22:51:54.052565+0000","last_fullsized":"2024-04-25T22:51:54.052565+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:24:51.210288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052731+0000","last_change":"2024-04-25T22:51:53.024685+0000","last_active":"2024-04-25T22:51:54.052731+0000","last_peered":"2024-04-25T22:51:54.052731+0000","last_clean":"2024-04-25T22:51:54.052731+0000","last_became_active":"2024-04-25T22:51:53.024304+0000","last_became_peered":"2024-04-25T22:51:53.024304+0000","last_unstale":"2024-04-25T22:51:54.052731+0000","last_undegraded":"2024-04-25T22:51:54.052731+0000","last_fullsized":"2024-04-25T22:51:54.052731+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:18:31.139968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052731+0000","last_change":"2024-04-25T22:51:52.018973+0000","last_active":"2024-04-25T22:51:54.052731+0000","last_peered":"2024-04-25T22:51:54.052731+0000","last_clean":"2024-04-25T22:51:54.052731+0000","last_became_active":"2024-04-25T22:51:52.018503+0000","last_became_peered":"2024-04-25T22:51:52.018503+0000","last_unstale":"2024-04-25T22:51:54.052731+0000","last_undegraded":"2024-04-25T22:51:54.052731+0000","last_fullsized":"2024-04-25T22:51:54.052731+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:07:38.783124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017918+0000","last_change":"2024-04-25T22:51:53.018063+0000","last_active":"2024-04-25T22:51:54.017918+0000","last_peered":"2024-04-25T22:51:54.017918+0000","last_clean":"2024-04-25T22:51:54.017918+0000","last_became_active":"2024-04-25T22:51:53.016779+0000","last_became_peered":"2024-04-25T22:51:53.016779+0000","last_unstale":"2024-04-25T22:51:54.017918+0000","last_undegraded":"2024-04-25T22:51:54.017918+0000","last_fullsized":"2024-04-25T22:51:54.017918+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:58:11.470631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018527+0000","last_change":"2024-04-25T22:51:52.022209+0000","last_active":"2024-04-25T22:51:54.018527+0000","last_peered":"2024-04-25T22:51:54.018527+0000","last_clean":"2024-04-25T22:51:54.018527+0000","last_became_active":"2024-04-25T22:51:52.021868+0000","last_became_peered":"2024-04-25T22:51:52.021868+0000","last_unstale":"2024-04-25T22:51:54.018527+0000","last_undegraded":"2024-04-25T22:51:54.018527+0000","last_fullsized":"2024-04-25T22:51:54.018527+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:36:57.435877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018070+0000","last_change":"2024-04-25T22:51:53.017222+0000","last_active":"2024-04-25T22:51:54.018070+0000","last_peered":"2024-04-25T22:51:54.018070+0000","last_clean":"2024-04-25T22:51:54.018070+0000","last_became_active":"2024-04-25T22:51:53.015717+0000","last_became_peered":"2024-04-25T22:51:53.015717+0000","last_unstale":"2024-04-25T22:51:54.018070+0000","last_undegraded":"2024-04-25T22:51:54.018070+0000","last_fullsized":"2024-04-25T22:51:54.018070+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:43:47.453569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053098+0000","last_change":"2024-04-25T22:51:52.019032+0000","last_active":"2024-04-25T22:51:54.053098+0000","last_peered":"2024-04-25T22:51:54.053098+0000","last_clean":"2024-04-25T22:51:54.053098+0000","last_became_active":"2024-04-25T22:51:52.018547+0000","last_became_peered":"2024-04-25T22:51:52.018547+0000","last_unstale":"2024-04-25T22:51:54.053098+0000","last_undegraded":"2024-04-25T22:51:54.053098+0000","last_fullsized":"2024-04-25T22:51:54.053098+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:10:00.056491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052619+0000","last_change":"2024-04-25T22:51:53.024597+0000","last_active":"2024-04-25T22:51:54.052619+0000","last_peered":"2024-04-25T22:51:54.052619+0000","last_clean":"2024-04-25T22:51:54.052619+0000","last_became_active":"2024-04-25T22:51:53.024256+0000","last_became_peered":"2024-04-25T22:51:53.024256+0000","last_unstale":"2024-04-25T22:51:54.052619+0000","last_undegraded":"2024-04-25T22:51:54.052619+0000","last_fullsized":"2024-04-25T22:51:54.052619+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:55:27.934567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018241+0000","last_change":"2024-04-25T22:51:52.015581+0000","last_active":"2024-04-25T22:51:54.018241+0000","last_peered":"2024-04-25T22:51:54.018241+0000","last_clean":"2024-04-25T22:51:54.018241+0000","last_became_active":"2024-04-25T22:51:52.014530+0000","last_became_peered":"2024-04-25T22:51:52.014530+0000","last_unstale":"2024-04-25T22:51:54.018241+0000","last_undegraded":"2024-04-25T22:51:54.018241+0000","last_fullsized":"2024-04-25T22:51:54.018241+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:12.627716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017722+0000","last_change":"2024-04-25T22:51:53.020744+0000","last_active":"2024-04-25T22:51:54.017722+0000","last_peered":"2024-04-25T22:51:54.017722+0000","last_clean":"2024-04-25T22:51:54.017722+0000","last_became_active":"2024-04-25T22:51:53.018283+0000","last_became_peered":"2024-04-25T22:51:53.018283+0000","last_unstale":"2024-04-25T22:51:54.017722+0000","last_undegraded":"2024-04-25T22:51:54.017722+0000","last_fullsized":"2024-04-25T22:51:54.017722+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:16.187194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018313+0000","last_change":"2024-04-25T22:51:52.019730+0000","last_active":"2024-04-25T22:51:54.018313+0000","last_peered":"2024-04-25T22:51:54.018313+0000","last_clean":"2024-04-25T22:51:54.018313+0000","last_became_active":"2024-04-25T22:51:52.018987+0000","last_became_peered":"2024-04-25T22:51:52.018987+0000","last_unstale":"2024-04-25T22:51:54.018313+0000","last_undegraded":"2024-04-25T22:51:54.018313+0000","last_fullsized":"2024-04-25T22:51:54.018313+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:03:14.826593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31916,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339924,"statfs":{"total":96636764160,"available":96604082176,"internally_reserved":0,"allocated":749568,"data_stored":638245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":139264,"data_stored":46699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36084,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335756,"statfs":{"total":96636764160,"available":96599814144,"internally_reserved":0,"allocated":757760,"data_stored":638861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:52:00.807 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T22:52:00.807 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-25T22:52:00.808 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-25T22:52:00.808 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-25T22:52:00.808 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-25T22:52:01.196 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:52:01.207 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":5,"flags":0,"active_gid":4099,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":3078087080},{"type":"v1","addr":"172.21.15.52:6801","nonce":3078087080}]},"active_addr":"172.21.15.52:6801/3078087080","active_change":"2024-04-25T22:51:41.920239+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4114,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.52:0","nonce":1046957988}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.52:0","nonce":1775818619}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.52:0","nonce":954759876}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.52:0","nonce":3205919298}]}]} 2024-04-25T22:52:01.213 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-25T22:52:01.213 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-25T22:52:01.214 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:52:01.508 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:52:01.508 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":15,"fsid":"5355b70e-3f7d-4bce-8676-89cee61d2089","created":"2024-04-25T22:51:37.688525+0000","modified":"2024-04-25T22:51:54.011012+0000","last_up_change":"2024-04-25T22:51:45.753740+0000","last_in_change":"2024-04-25T22:51:38.491924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:51:45.966439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:51:46.128416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:51:50.648525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:51:51.351497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b785a86a-6391-4a0d-8aec-c2016380832e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6801","nonce":3666753097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6803","nonce":3666753097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6807","nonce":3666753097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6805","nonce":3666753097}]},"public_addr":"172.21.15.110:6801/3666753097","cluster_addr":"172.21.15.110:6803/3666753097","heartbeat_back_addr":"172.21.15.110:6807/3666753097","heartbeat_front_addr":"172.21.15.110:6805/3666753097","state":["exists","up"]},{"osd":1,"uuid":"088b4733-ccbd-41a6-8a31-8d811169c28a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":479301362},{"type":"v1","addr":"172.21.15.164:6801","nonce":479301362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":479301362},{"type":"v1","addr":"172.21.15.164:6803","nonce":479301362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":479301362},{"type":"v1","addr":"172.21.15.164:6807","nonce":479301362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":479301362},{"type":"v1","addr":"172.21.15.164:6805","nonce":479301362}]},"public_addr":"172.21.15.164:6801/479301362","cluster_addr":"172.21.15.164:6803/479301362","heartbeat_back_addr":"172.21.15.164:6807/479301362","heartbeat_front_addr":"172.21.15.164:6805/479301362","state":["exists","up"]},{"osd":2,"uuid":"6a6aad8c-22ac-45c0-baf9-928314e7fef9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6801","nonce":349040881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6803","nonce":349040881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6807","nonce":349040881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6805","nonce":349040881}]},"public_addr":"172.21.15.191:6801/349040881","cluster_addr":"172.21.15.191:6803/349040881","heartbeat_back_addr":"172.21.15.191:6807/349040881","heartbeat_front_addr":"172.21.15.191:6805/349040881","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:51:43.531709+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:51:43.589701+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:51:43.566226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:52:01.521 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-25T22:52:01.522 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:52:01.821 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:52:01.822 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":15,"fsid":"5355b70e-3f7d-4bce-8676-89cee61d2089","created":"2024-04-25T22:51:37.688525+0000","modified":"2024-04-25T22:51:54.011012+0000","last_up_change":"2024-04-25T22:51:45.753740+0000","last_in_change":"2024-04-25T22:51:38.491924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:51:45.966439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:51:46.128416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:51:50.648525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:51:51.351497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b785a86a-6391-4a0d-8aec-c2016380832e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6801","nonce":3666753097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6803","nonce":3666753097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6807","nonce":3666753097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6805","nonce":3666753097}]},"public_addr":"172.21.15.110:6801/3666753097","cluster_addr":"172.21.15.110:6803/3666753097","heartbeat_back_addr":"172.21.15.110:6807/3666753097","heartbeat_front_addr":"172.21.15.110:6805/3666753097","state":["exists","up"]},{"osd":1,"uuid":"088b4733-ccbd-41a6-8a31-8d811169c28a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":479301362},{"type":"v1","addr":"172.21.15.164:6801","nonce":479301362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":479301362},{"type":"v1","addr":"172.21.15.164:6803","nonce":479301362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":479301362},{"type":"v1","addr":"172.21.15.164:6807","nonce":479301362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":479301362},{"type":"v1","addr":"172.21.15.164:6805","nonce":479301362}]},"public_addr":"172.21.15.164:6801/479301362","cluster_addr":"172.21.15.164:6803/479301362","heartbeat_back_addr":"172.21.15.164:6807/479301362","heartbeat_front_addr":"172.21.15.164:6805/479301362","state":["exists","up"]},{"osd":2,"uuid":"6a6aad8c-22ac-45c0-baf9-928314e7fef9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6801","nonce":349040881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6803","nonce":349040881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6807","nonce":349040881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6805","nonce":349040881}]},"public_addr":"172.21.15.191:6801/349040881","cluster_addr":"172.21.15.191:6803/349040881","heartbeat_back_addr":"172.21.15.191:6807/349040881","heartbeat_front_addr":"172.21.15.191:6805/349040881","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:51:43.531709+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:51:43.589701+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:51:43.566226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:52:01.835 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-25T22:52:01.836 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-25T22:52:01.836 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-25T22:52:01.978 INFO:teuthology.orchestra.run.smithi052.stdout:34359738374 2024-04-25T22:52:01.978 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T22:52:01.999 INFO:teuthology.orchestra.run.smithi052.stdout:34359738374 2024-04-25T22:52:02.000 INFO:teuthology.orchestra.run.smithi052.stdout:34359738374 2024-04-25T22:52:02.001 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T22:52:02.001 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T22:52:02.297 INFO:teuthology.orchestra.run.smithi052.stdout:34359738373 2024-04-25T22:52:02.311 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738373 for osd.1 2024-04-25T22:52:02.360 INFO:teuthology.orchestra.run.smithi052.stdout:34359738373 2024-04-25T22:52:02.366 INFO:teuthology.orchestra.run.smithi052.stdout:34359738373 2024-04-25T22:52:02.373 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738373 for osd.2 2024-04-25T22:52:02.379 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738373 for osd.0 2024-04-25T22:52:03.312 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T22:52:03.374 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T22:52:03.380 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T22:52:03.639 INFO:teuthology.orchestra.run.smithi052.stdout:34359738373 2024-04-25T22:52:03.652 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738373 for osd.1 2024-04-25T22:52:03.688 INFO:teuthology.orchestra.run.smithi052.stdout:34359738373 2024-04-25T22:52:03.701 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738373 for osd.2 2024-04-25T22:52:03.725 INFO:teuthology.orchestra.run.smithi052.stdout:34359738373 2024-04-25T22:52:03.738 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738373 for osd.0 2024-04-25T22:52:04.653 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T22:52:04.702 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T22:52:04.739 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T22:52:04.982 INFO:teuthology.orchestra.run.smithi052.stdout:34359738374 2024-04-25T22:52:04.995 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738374 for osd.1 2024-04-25T22:52:04.995 DEBUG:teuthology.parallel:result is None 2024-04-25T22:52:05.017 INFO:teuthology.orchestra.run.smithi052.stdout:34359738374 2024-04-25T22:52:05.031 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738374 for osd.2 2024-04-25T22:52:05.031 DEBUG:teuthology.parallel:result is None 2024-04-25T22:52:05.058 INFO:teuthology.orchestra.run.smithi052.stdout:34359738374 2024-04-25T22:52:05.071 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738374 for osd.0 2024-04-25T22:52:05.071 DEBUG:teuthology.parallel:result is None 2024-04-25T22:52:05.071 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T22:52:05.071 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:52:05.413 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:52:05.415 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-25T22:52:05.424 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-04-25T22:52:03.928188+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":95156,"kb_used_data":1608,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":283020364,"statfs":{"total":289910292480,"available":289812852736,"internally_reserved":0,"allocated":1646592,"data_stored":1323805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001642"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053235+0000","last_change":"2024-04-25T22:51:53.026259+0000","last_active":"2024-04-25T22:51:54.053235+0000","last_peered":"2024-04-25T22:51:54.053235+0000","last_clean":"2024-04-25T22:51:54.053235+0000","last_became_active":"2024-04-25T22:51:53.025647+0000","last_became_peered":"2024-04-25T22:51:53.025647+0000","last_unstale":"2024-04-25T22:51:54.053235+0000","last_undegraded":"2024-04-25T22:51:54.053235+0000","last_fullsized":"2024-04-25T22:51:54.053235+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:44:59.401139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052785+0000","last_change":"2024-04-25T22:51:53.026052+0000","last_active":"2024-04-25T22:51:54.052785+0000","last_peered":"2024-04-25T22:51:54.052785+0000","last_clean":"2024-04-25T22:51:54.052785+0000","last_became_active":"2024-04-25T22:51:53.025562+0000","last_became_peered":"2024-04-25T22:51:53.025562+0000","last_unstale":"2024-04-25T22:51:54.052785+0000","last_undegraded":"2024-04-25T22:51:54.052785+0000","last_fullsized":"2024-04-25T22:51:54.052785+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:06:02.072481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018038+0000","last_change":"2024-04-25T22:51:53.025605+0000","last_active":"2024-04-25T22:51:54.018038+0000","last_peered":"2024-04-25T22:51:54.018038+0000","last_clean":"2024-04-25T22:51:54.018038+0000","last_became_active":"2024-04-25T22:51:53.024929+0000","last_became_peered":"2024-04-25T22:51:53.024929+0000","last_unstale":"2024-04-25T22:51:54.018038+0000","last_undegraded":"2024-04-25T22:51:54.018038+0000","last_fullsized":"2024-04-25T22:51:54.018038+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:12:08.770479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018037+0000","last_change":"2024-04-25T22:51:53.019862+0000","last_active":"2024-04-25T22:51:54.018037+0000","last_peered":"2024-04-25T22:51:54.018037+0000","last_clean":"2024-04-25T22:51:54.018037+0000","last_became_active":"2024-04-25T22:51:53.018814+0000","last_became_peered":"2024-04-25T22:51:53.018814+0000","last_unstale":"2024-04-25T22:51:54.018037+0000","last_undegraded":"2024-04-25T22:51:54.018037+0000","last_fullsized":"2024-04-25T22:51:54.018037+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:22.231993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052571+0000","last_change":"2024-04-25T22:51:53.024641+0000","last_active":"2024-04-25T22:51:54.052571+0000","last_peered":"2024-04-25T22:51:54.052571+0000","last_clean":"2024-04-25T22:51:54.052571+0000","last_became_active":"2024-04-25T22:51:53.024240+0000","last_became_peered":"2024-04-25T22:51:53.024240+0000","last_unstale":"2024-04-25T22:51:54.052571+0000","last_undegraded":"2024-04-25T22:51:54.052571+0000","last_fullsized":"2024-04-25T22:51:54.052571+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:37:13.419317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017491+0000","last_change":"2024-04-25T22:51:53.017733+0000","last_active":"2024-04-25T22:51:54.017491+0000","last_peered":"2024-04-25T22:51:54.017491+0000","last_clean":"2024-04-25T22:51:54.017491+0000","last_became_active":"2024-04-25T22:51:53.016903+0000","last_became_peered":"2024-04-25T22:51:53.016903+0000","last_unstale":"2024-04-25T22:51:54.017491+0000","last_undegraded":"2024-04-25T22:51:54.017491+0000","last_fullsized":"2024-04-25T22:51:54.017491+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:06:02.072481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017578+0000","last_change":"2024-04-25T22:51:53.016102+0000","last_active":"2024-04-25T22:51:54.017578+0000","last_peered":"2024-04-25T22:51:54.017578+0000","last_clean":"2024-04-25T22:51:54.017578+0000","last_became_active":"2024-04-25T22:51:53.015662+0000","last_became_peered":"2024-04-25T22:51:53.015662+0000","last_unstale":"2024-04-25T22:51:54.017578+0000","last_undegraded":"2024-04-25T22:51:54.017578+0000","last_fullsized":"2024-04-25T22:51:54.017578+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:21:52.771650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017247+0000","last_change":"2024-04-25T22:51:53.021907+0000","last_active":"2024-04-25T22:51:54.017247+0000","last_peered":"2024-04-25T22:51:54.017247+0000","last_clean":"2024-04-25T22:51:54.017247+0000","last_became_active":"2024-04-25T22:51:53.019092+0000","last_became_peered":"2024-04-25T22:51:53.019092+0000","last_unstale":"2024-04-25T22:51:54.017247+0000","last_undegraded":"2024-04-25T22:51:54.017247+0000","last_fullsized":"2024-04-25T22:51:54.017247+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:55:27.934567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017941+0000","last_change":"2024-04-25T22:51:53.023004+0000","last_active":"2024-04-25T22:51:54.017941+0000","last_peered":"2024-04-25T22:51:54.017941+0000","last_clean":"2024-04-25T22:51:54.017941+0000","last_became_active":"2024-04-25T22:51:53.021541+0000","last_became_peered":"2024-04-25T22:51:53.021541+0000","last_unstale":"2024-04-25T22:51:54.017941+0000","last_undegraded":"2024-04-25T22:51:54.017941+0000","last_fullsized":"2024-04-25T22:51:54.017941+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:21:52.771650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052904+0000","last_change":"2024-04-25T22:51:53.024967+0000","last_active":"2024-04-25T22:51:54.052904+0000","last_peered":"2024-04-25T22:51:54.052904+0000","last_clean":"2024-04-25T22:51:54.052904+0000","last_became_active":"2024-04-25T22:51:53.024605+0000","last_became_peered":"2024-04-25T22:51:53.024605+0000","last_unstale":"2024-04-25T22:51:54.052904+0000","last_undegraded":"2024-04-25T22:51:54.052904+0000","last_fullsized":"2024-04-25T22:51:54.052904+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:21:52.771650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018442+0000","last_change":"2024-04-25T22:51:53.016889+0000","last_active":"2024-04-25T22:51:54.018442+0000","last_peered":"2024-04-25T22:51:54.018442+0000","last_clean":"2024-04-25T22:51:54.018442+0000","last_became_active":"2024-04-25T22:51:53.016121+0000","last_became_peered":"2024-04-25T22:51:53.016121+0000","last_unstale":"2024-04-25T22:51:54.018442+0000","last_undegraded":"2024-04-25T22:51:54.018442+0000","last_fullsized":"2024-04-25T22:51:54.018442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:11:52.428780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052755+0000","last_change":"2024-04-25T22:51:53.028006+0000","last_active":"2024-04-25T22:51:54.052755+0000","last_peered":"2024-04-25T22:51:54.052755+0000","last_clean":"2024-04-25T22:51:54.052755+0000","last_became_active":"2024-04-25T22:51:53.027363+0000","last_became_peered":"2024-04-25T22:51:53.027363+0000","last_unstale":"2024-04-25T22:51:54.052755+0000","last_undegraded":"2024-04-25T22:51:54.052755+0000","last_fullsized":"2024-04-25T22:51:54.052755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:32.923620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052272+0000","last_change":"2024-04-25T22:51:53.024407+0000","last_active":"2024-04-25T22:51:54.052272+0000","last_peered":"2024-04-25T22:51:54.052272+0000","last_clean":"2024-04-25T22:51:54.052272+0000","last_became_active":"2024-04-25T22:51:53.024079+0000","last_became_peered":"2024-04-25T22:51:53.024079+0000","last_unstale":"2024-04-25T22:51:54.052272+0000","last_undegraded":"2024-04-25T22:51:54.052272+0000","last_fullsized":"2024-04-25T22:51:54.052272+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:40:41.536510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018150+0000","last_change":"2024-04-25T22:51:53.022367+0000","last_active":"2024-04-25T22:51:54.018150+0000","last_peered":"2024-04-25T22:51:54.018150+0000","last_clean":"2024-04-25T22:51:54.018150+0000","last_became_active":"2024-04-25T22:51:53.021902+0000","last_became_peered":"2024-04-25T22:51:53.021902+0000","last_unstale":"2024-04-25T22:51:54.018150+0000","last_undegraded":"2024-04-25T22:51:54.018150+0000","last_fullsized":"2024-04-25T22:51:54.018150+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:44:59.401139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017718+0000","last_change":"2024-04-25T22:51:53.022016+0000","last_active":"2024-04-25T22:51:54.017718+0000","last_peered":"2024-04-25T22:51:54.017718+0000","last_clean":"2024-04-25T22:51:54.017718+0000","last_became_active":"2024-04-25T22:51:53.021666+0000","last_became_peered":"2024-04-25T22:51:53.021666+0000","last_unstale":"2024-04-25T22:51:54.017718+0000","last_undegraded":"2024-04-25T22:51:54.017718+0000","last_fullsized":"2024-04-25T22:51:54.017718+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:28:42.903045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017270+0000","last_change":"2024-04-25T22:51:53.021442+0000","last_active":"2024-04-25T22:51:54.017270+0000","last_peered":"2024-04-25T22:51:54.017270+0000","last_clean":"2024-04-25T22:51:54.017270+0000","last_became_active":"2024-04-25T22:51:53.019251+0000","last_became_peered":"2024-04-25T22:51:53.019251+0000","last_unstale":"2024-04-25T22:51:54.017270+0000","last_undegraded":"2024-04-25T22:51:54.017270+0000","last_fullsized":"2024-04-25T22:51:54.017270+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:18:31.139968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018458+0000","last_change":"2024-04-25T22:51:53.023571+0000","last_active":"2024-04-25T22:51:54.018458+0000","last_peered":"2024-04-25T22:51:54.018458+0000","last_clean":"2024-04-25T22:51:54.018458+0000","last_became_active":"2024-04-25T22:51:53.022774+0000","last_became_peered":"2024-04-25T22:51:53.022774+0000","last_unstale":"2024-04-25T22:51:54.018458+0000","last_undegraded":"2024-04-25T22:51:54.018458+0000","last_fullsized":"2024-04-25T22:51:54.018458+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:41.205051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053209+0000","last_change":"2024-04-25T22:51:53.026365+0000","last_active":"2024-04-25T22:51:54.053209+0000","last_peered":"2024-04-25T22:51:54.053209+0000","last_clean":"2024-04-25T22:51:54.053209+0000","last_became_active":"2024-04-25T22:51:53.025610+0000","last_became_peered":"2024-04-25T22:51:53.025610+0000","last_unstale":"2024-04-25T22:51:54.053209+0000","last_undegraded":"2024-04-25T22:51:54.053209+0000","last_fullsized":"2024-04-25T22:51:54.053209+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:22.231993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017934+0000","last_change":"2024-04-25T22:51:53.020704+0000","last_active":"2024-04-25T22:51:54.017934+0000","last_peered":"2024-04-25T22:51:54.017934+0000","last_clean":"2024-04-25T22:51:54.017934+0000","last_became_active":"2024-04-25T22:51:53.020333+0000","last_became_peered":"2024-04-25T22:51:53.020333+0000","last_unstale":"2024-04-25T22:51:54.017934+0000","last_undegraded":"2024-04-25T22:51:54.017934+0000","last_fullsized":"2024-04-25T22:51:54.017934+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:06:02.072481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018256+0000","last_change":"2024-04-25T22:51:53.019606+0000","last_active":"2024-04-25T22:51:54.018256+0000","last_peered":"2024-04-25T22:51:54.018256+0000","last_clean":"2024-04-25T22:51:54.018256+0000","last_became_active":"2024-04-25T22:51:53.018789+0000","last_became_peered":"2024-04-25T22:51:53.018789+0000","last_unstale":"2024-04-25T22:51:54.018256+0000","last_undegraded":"2024-04-25T22:51:54.018256+0000","last_fullsized":"2024-04-25T22:51:54.018256+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:43:07.741691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018361+0000","last_change":"2024-04-25T22:51:53.018086+0000","last_active":"2024-04-25T22:51:54.018361+0000","last_peered":"2024-04-25T22:51:54.018361+0000","last_clean":"2024-04-25T22:51:54.018361+0000","last_became_active":"2024-04-25T22:51:53.016966+0000","last_became_peered":"2024-04-25T22:51:53.016966+0000","last_unstale":"2024-04-25T22:51:54.018361+0000","last_undegraded":"2024-04-25T22:51:54.018361+0000","last_fullsized":"2024-04-25T22:51:54.018361+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:25:33.516171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052152+0000","last_change":"2024-04-25T22:51:53.026746+0000","last_active":"2024-04-25T22:51:54.052152+0000","last_peered":"2024-04-25T22:51:54.052152+0000","last_clean":"2024-04-25T22:51:54.052152+0000","last_became_active":"2024-04-25T22:51:53.025938+0000","last_became_peered":"2024-04-25T22:51:53.025938+0000","last_unstale":"2024-04-25T22:51:54.052152+0000","last_undegraded":"2024-04-25T22:51:54.052152+0000","last_fullsized":"2024-04-25T22:51:54.052152+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:38:03.428258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.016918+0000","last_change":"2024-04-25T22:51:53.016829+0000","last_active":"2024-04-25T22:51:54.016918+0000","last_peered":"2024-04-25T22:51:54.016918+0000","last_clean":"2024-04-25T22:51:54.016918+0000","last_became_active":"2024-04-25T22:51:53.016497+0000","last_became_peered":"2024-04-25T22:51:53.016497+0000","last_unstale":"2024-04-25T22:51:54.016918+0000","last_undegraded":"2024-04-25T22:51:54.016918+0000","last_fullsized":"2024-04-25T22:51:54.016918+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:11:09.179564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.051948+0000","last_change":"2024-04-25T22:51:53.025164+0000","last_active":"2024-04-25T22:51:54.051948+0000","last_peered":"2024-04-25T22:51:54.051948+0000","last_clean":"2024-04-25T22:51:54.051948+0000","last_became_active":"2024-04-25T22:51:53.024781+0000","last_became_peered":"2024-04-25T22:51:53.024781+0000","last_unstale":"2024-04-25T22:51:54.051948+0000","last_undegraded":"2024-04-25T22:51:54.051948+0000","last_fullsized":"2024-04-25T22:51:54.051948+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:04:31.763523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053277+0000","last_change":"2024-04-25T22:51:53.028155+0000","last_active":"2024-04-25T22:51:54.053277+0000","last_peered":"2024-04-25T22:51:54.053277+0000","last_clean":"2024-04-25T22:51:54.053277+0000","last_became_active":"2024-04-25T22:51:53.027867+0000","last_became_peered":"2024-04-25T22:51:53.027867+0000","last_unstale":"2024-04-25T22:51:54.053277+0000","last_undegraded":"2024-04-25T22:51:54.053277+0000","last_fullsized":"2024-04-25T22:51:54.053277+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:43:47.453569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018121+0000","last_change":"2024-04-25T22:51:53.022959+0000","last_active":"2024-04-25T22:51:54.018121+0000","last_peered":"2024-04-25T22:51:54.018121+0000","last_clean":"2024-04-25T22:51:54.018121+0000","last_became_active":"2024-04-25T22:51:53.022318+0000","last_became_peered":"2024-04-25T22:51:53.022318+0000","last_unstale":"2024-04-25T22:51:54.018121+0000","last_undegraded":"2024-04-25T22:51:54.018121+0000","last_fullsized":"2024-04-25T22:51:54.018121+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:58:11.470631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018639+0000","last_change":"2024-04-25T22:51:53.022893+0000","last_active":"2024-04-25T22:51:54.018639+0000","last_peered":"2024-04-25T22:51:54.018639+0000","last_clean":"2024-04-25T22:51:54.018639+0000","last_became_active":"2024-04-25T22:51:53.022407+0000","last_became_peered":"2024-04-25T22:51:53.022407+0000","last_unstale":"2024-04-25T22:51:54.018639+0000","last_undegraded":"2024-04-25T22:51:54.018639+0000","last_fullsized":"2024-04-25T22:51:54.018639+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:08:44.404718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053002+0000","last_change":"2024-04-25T22:51:53.028447+0000","last_active":"2024-04-25T22:51:54.053002+0000","last_peered":"2024-04-25T22:51:54.053002+0000","last_clean":"2024-04-25T22:51:54.053002+0000","last_became_active":"2024-04-25T22:51:53.027852+0000","last_became_peered":"2024-04-25T22:51:53.027852+0000","last_unstale":"2024-04-25T22:51:54.053002+0000","last_undegraded":"2024-04-25T22:51:54.053002+0000","last_fullsized":"2024-04-25T22:51:54.053002+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:16.187194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017554+0000","last_change":"2024-04-25T22:51:53.019840+0000","last_active":"2024-04-25T22:51:54.017554+0000","last_peered":"2024-04-25T22:51:54.017554+0000","last_clean":"2024-04-25T22:51:54.017554+0000","last_became_active":"2024-04-25T22:51:53.019419+0000","last_became_peered":"2024-04-25T22:51:53.019419+0000","last_unstale":"2024-04-25T22:51:54.017554+0000","last_undegraded":"2024-04-25T22:51:54.017554+0000","last_fullsized":"2024-04-25T22:51:54.017554+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:32.923620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052550+0000","last_change":"2024-04-25T22:51:53.026997+0000","last_active":"2024-04-25T22:51:54.052550+0000","last_peered":"2024-04-25T22:51:54.052550+0000","last_clean":"2024-04-25T22:51:54.052550+0000","last_became_active":"2024-04-25T22:51:53.026379+0000","last_became_peered":"2024-04-25T22:51:53.026379+0000","last_unstale":"2024-04-25T22:51:54.052550+0000","last_undegraded":"2024-04-25T22:51:54.052550+0000","last_fullsized":"2024-04-25T22:51:54.052550+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:33:24.700106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017074+0000","last_change":"2024-04-25T22:51:53.019642+0000","last_active":"2024-04-25T22:51:54.017074+0000","last_peered":"2024-04-25T22:51:54.017074+0000","last_clean":"2024-04-25T22:51:54.017074+0000","last_became_active":"2024-04-25T22:51:53.019197+0000","last_became_peered":"2024-04-25T22:51:53.019197+0000","last_unstale":"2024-04-25T22:51:54.017074+0000","last_undegraded":"2024-04-25T22:51:54.017074+0000","last_fullsized":"2024-04-25T22:51:54.017074+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:12:00.793718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017428+0000","last_change":"2024-04-25T22:51:53.020857+0000","last_active":"2024-04-25T22:51:54.017428+0000","last_peered":"2024-04-25T22:51:54.017428+0000","last_clean":"2024-04-25T22:51:54.017428+0000","last_became_active":"2024-04-25T22:51:53.018340+0000","last_became_peered":"2024-04-25T22:51:53.018340+0000","last_unstale":"2024-04-25T22:51:54.017428+0000","last_undegraded":"2024-04-25T22:51:54.017428+0000","last_fullsized":"2024-04-25T22:51:54.017428+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:32.923620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053001+0000","last_change":"2024-04-25T22:51:53.025101+0000","last_active":"2024-04-25T22:51:54.053001+0000","last_peered":"2024-04-25T22:51:54.053001+0000","last_clean":"2024-04-25T22:51:54.053001+0000","last_became_active":"2024-04-25T22:51:53.024643+0000","last_became_peered":"2024-04-25T22:51:53.024643+0000","last_unstale":"2024-04-25T22:51:54.053001+0000","last_undegraded":"2024-04-25T22:51:54.053001+0000","last_fullsized":"2024-04-25T22:51:54.053001+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:58:11.470631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018622+0000","last_change":"2024-04-25T22:51:52.017181+0000","last_active":"2024-04-25T22:51:54.018622+0000","last_peered":"2024-04-25T22:51:54.018622+0000","last_clean":"2024-04-25T22:51:54.018622+0000","last_became_active":"2024-04-25T22:51:52.016682+0000","last_became_peered":"2024-04-25T22:51:52.016682+0000","last_unstale":"2024-04-25T22:51:54.018622+0000","last_undegraded":"2024-04-25T22:51:54.018622+0000","last_fullsized":"2024-04-25T22:51:54.018622+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:18:00.975479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053150+0000","last_change":"2024-04-25T22:51:53.026414+0000","last_active":"2024-04-25T22:51:54.053150+0000","last_peered":"2024-04-25T22:51:54.053150+0000","last_clean":"2024-04-25T22:51:54.053150+0000","last_became_active":"2024-04-25T22:51:53.025591+0000","last_became_peered":"2024-04-25T22:51:53.025591+0000","last_unstale":"2024-04-25T22:51:54.053150+0000","last_undegraded":"2024-04-25T22:51:54.053150+0000","last_fullsized":"2024-04-25T22:51:54.053150+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:12:08.770479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017399+0000","last_change":"2024-04-25T22:51:52.019690+0000","last_active":"2024-04-25T22:51:54.017399+0000","last_peered":"2024-04-25T22:51:54.017399+0000","last_clean":"2024-04-25T22:51:54.017399+0000","last_became_active":"2024-04-25T22:51:52.018818+0000","last_became_peered":"2024-04-25T22:51:52.018818+0000","last_unstale":"2024-04-25T22:51:54.017399+0000","last_undegraded":"2024-04-25T22:51:54.017399+0000","last_fullsized":"2024-04-25T22:51:54.017399+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:25:48.361495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018267+0000","last_change":"2024-04-25T22:51:53.023197+0000","last_active":"2024-04-25T22:51:54.018267+0000","last_peered":"2024-04-25T22:51:54.018267+0000","last_clean":"2024-04-25T22:51:54.018267+0000","last_became_active":"2024-04-25T22:51:53.022627+0000","last_became_peered":"2024-04-25T22:51:53.022627+0000","last_unstale":"2024-04-25T22:51:54.018267+0000","last_undegraded":"2024-04-25T22:51:54.018267+0000","last_fullsized":"2024-04-25T22:51:54.018267+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:44:59.401139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052236+0000","last_change":"2024-04-25T22:51:52.018646+0000","last_active":"2024-04-25T22:51:54.052236+0000","last_peered":"2024-04-25T22:51:54.052236+0000","last_clean":"2024-04-25T22:51:54.052236+0000","last_became_active":"2024-04-25T22:51:52.018313+0000","last_became_peered":"2024-04-25T22:51:52.018313+0000","last_unstale":"2024-04-25T22:51:54.052236+0000","last_undegraded":"2024-04-25T22:51:54.052236+0000","last_fullsized":"2024-04-25T22:51:54.052236+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:00:21.688745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018104+0000","last_change":"2024-04-25T22:51:53.022419+0000","last_active":"2024-04-25T22:51:54.018104+0000","last_peered":"2024-04-25T22:51:54.018104+0000","last_clean":"2024-04-25T22:51:54.018104+0000","last_became_active":"2024-04-25T22:51:53.021405+0000","last_became_peered":"2024-04-25T22:51:53.021405+0000","last_unstale":"2024-04-25T22:51:54.018104+0000","last_undegraded":"2024-04-25T22:51:54.018104+0000","last_fullsized":"2024-04-25T22:51:54.018104+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:28:42.903045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":22,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017441+0000","last_change":"2024-04-25T22:51:52.021510+0000","last_active":"2024-04-25T22:51:54.017441+0000","last_peered":"2024-04-25T22:51:54.017441+0000","last_clean":"2024-04-25T22:51:54.017441+0000","last_became_active":"2024-04-25T22:51:52.021145+0000","last_became_peered":"2024-04-25T22:51:52.021145+0000","last_unstale":"2024-04-25T22:51:54.017441+0000","last_undegraded":"2024-04-25T22:51:54.017441+0000","last_fullsized":"2024-04-25T22:51:54.017441+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:05.110747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018420+0000","last_change":"2024-04-25T22:51:52.021355+0000","last_active":"2024-04-25T22:51:54.018420+0000","last_peered":"2024-04-25T22:51:54.018420+0000","last_clean":"2024-04-25T22:51:54.018420+0000","last_became_active":"2024-04-25T22:51:52.020860+0000","last_became_peered":"2024-04-25T22:51:52.020860+0000","last_unstale":"2024-04-25T22:51:54.018420+0000","last_undegraded":"2024-04-25T22:51:54.018420+0000","last_fullsized":"2024-04-25T22:51:54.018420+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:55.235787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.051967+0000","last_change":"2024-04-25T22:51:53.029390+0000","last_active":"2024-04-25T22:51:54.051967+0000","last_peered":"2024-04-25T22:51:54.051967+0000","last_clean":"2024-04-25T22:51:54.051967+0000","last_became_active":"2024-04-25T22:51:53.029157+0000","last_became_peered":"2024-04-25T22:51:53.029157+0000","last_unstale":"2024-04-25T22:51:54.051967+0000","last_undegraded":"2024-04-25T22:51:54.051967+0000","last_fullsized":"2024-04-25T22:51:54.051967+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:51:43.808994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053167+0000","last_change":"2024-04-25T22:51:52.018856+0000","last_active":"2024-04-25T22:51:54.053167+0000","last_peered":"2024-04-25T22:51:54.053167+0000","last_clean":"2024-04-25T22:51:54.053167+0000","last_became_active":"2024-04-25T22:51:52.018390+0000","last_became_peered":"2024-04-25T22:51:52.018390+0000","last_unstale":"2024-04-25T22:51:54.053167+0000","last_undegraded":"2024-04-25T22:51:54.053167+0000","last_fullsized":"2024-04-25T22:51:54.053167+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:42:54.430484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052143+0000","last_change":"2024-04-25T22:51:53.024599+0000","last_active":"2024-04-25T22:51:54.052143+0000","last_peered":"2024-04-25T22:51:54.052143+0000","last_clean":"2024-04-25T22:51:54.052143+0000","last_became_active":"2024-04-25T22:51:53.024155+0000","last_became_peered":"2024-04-25T22:51:53.024155+0000","last_unstale":"2024-04-25T22:51:54.052143+0000","last_undegraded":"2024-04-25T22:51:54.052143+0000","last_fullsized":"2024-04-25T22:51:54.052143+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:09:52.869451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018756+0000","last_change":"2024-04-25T22:51:52.019724+0000","last_active":"2024-04-25T22:51:54.018756+0000","last_peered":"2024-04-25T22:51:54.018756+0000","last_clean":"2024-04-25T22:51:54.018756+0000","last_became_active":"2024-04-25T22:51:52.019167+0000","last_became_peered":"2024-04-25T22:51:52.019167+0000","last_unstale":"2024-04-25T22:51:54.018756+0000","last_undegraded":"2024-04-25T22:51:54.018756+0000","last_fullsized":"2024-04-25T22:51:54.018756+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:03:14.826593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017804+0000","last_change":"2024-04-25T22:51:53.017327+0000","last_active":"2024-04-25T22:51:54.017804+0000","last_peered":"2024-04-25T22:51:54.017804+0000","last_clean":"2024-04-25T22:51:54.017804+0000","last_became_active":"2024-04-25T22:51:53.015987+0000","last_became_peered":"2024-04-25T22:51:53.015987+0000","last_unstale":"2024-04-25T22:51:54.017804+0000","last_undegraded":"2024-04-25T22:51:54.017804+0000","last_fullsized":"2024-04-25T22:51:54.017804+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:16.602188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018741+0000","last_change":"2024-04-25T22:51:52.016151+0000","last_active":"2024-04-25T22:51:54.018741+0000","last_peered":"2024-04-25T22:51:54.018741+0000","last_clean":"2024-04-25T22:51:54.018741+0000","last_became_active":"2024-04-25T22:51:52.015741+0000","last_became_peered":"2024-04-25T22:51:52.015741+0000","last_unstale":"2024-04-25T22:51:54.018741+0000","last_undegraded":"2024-04-25T22:51:54.018741+0000","last_fullsized":"2024-04-25T22:51:54.018741+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:02:25.133948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018157+0000","last_change":"2024-04-25T22:51:53.021208+0000","last_active":"2024-04-25T22:51:54.018157+0000","last_peered":"2024-04-25T22:51:54.018157+0000","last_clean":"2024-04-25T22:51:54.018157+0000","last_became_active":"2024-04-25T22:51:53.020752+0000","last_became_peered":"2024-04-25T22:51:53.020752+0000","last_unstale":"2024-04-25T22:51:54.018157+0000","last_undegraded":"2024-04-25T22:51:54.018157+0000","last_fullsized":"2024-04-25T22:51:54.018157+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:16.602188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017996+0000","last_change":"2024-04-25T22:51:52.018716+0000","last_active":"2024-04-25T22:51:54.017996+0000","last_peered":"2024-04-25T22:51:54.017996+0000","last_clean":"2024-04-25T22:51:54.017996+0000","last_became_active":"2024-04-25T22:51:52.018140+0000","last_became_peered":"2024-04-25T22:51:52.018140+0000","last_unstale":"2024-04-25T22:51:54.017996+0000","last_undegraded":"2024-04-25T22:51:54.017996+0000","last_fullsized":"2024-04-25T22:51:54.017996+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:02:25.133948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018609+0000","last_change":"2024-04-25T22:51:53.019508+0000","last_active":"2024-04-25T22:51:54.018609+0000","last_peered":"2024-04-25T22:51:54.018609+0000","last_clean":"2024-04-25T22:51:54.018609+0000","last_became_active":"2024-04-25T22:51:53.016749+0000","last_became_peered":"2024-04-25T22:51:53.016749+0000","last_unstale":"2024-04-25T22:51:54.018609+0000","last_undegraded":"2024-04-25T22:51:54.018609+0000","last_fullsized":"2024-04-25T22:51:54.018609+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:25.110416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018342+0000","last_change":"2024-04-25T22:51:52.022474+0000","last_active":"2024-04-25T22:51:54.018342+0000","last_peered":"2024-04-25T22:51:54.018342+0000","last_clean":"2024-04-25T22:51:54.018342+0000","last_became_active":"2024-04-25T22:51:52.022141+0000","last_became_peered":"2024-04-25T22:51:52.022141+0000","last_unstale":"2024-04-25T22:51:54.018342+0000","last_undegraded":"2024-04-25T22:51:54.018342+0000","last_fullsized":"2024-04-25T22:51:54.018342+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:17:10.500338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018670+0000","last_change":"2024-04-25T22:51:53.023929+0000","last_active":"2024-04-25T22:51:54.018670+0000","last_peered":"2024-04-25T22:51:54.018670+0000","last_clean":"2024-04-25T22:51:54.018670+0000","last_became_active":"2024-04-25T22:51:53.023405+0000","last_became_peered":"2024-04-25T22:51:53.023405+0000","last_unstale":"2024-04-25T22:51:54.018670+0000","last_undegraded":"2024-04-25T22:51:54.018670+0000","last_fullsized":"2024-04-25T22:51:54.018670+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:35:35.419823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052331+0000","last_change":"2024-04-25T22:51:52.018970+0000","last_active":"2024-04-25T22:51:54.052331+0000","last_peered":"2024-04-25T22:51:54.052331+0000","last_clean":"2024-04-25T22:51:54.052331+0000","last_became_active":"2024-04-25T22:51:52.018439+0000","last_became_peered":"2024-04-25T22:51:52.018439+0000","last_unstale":"2024-04-25T22:51:54.052331+0000","last_undegraded":"2024-04-25T22:51:54.052331+0000","last_fullsized":"2024-04-25T22:51:54.052331+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:24:31.748243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018219+0000","last_change":"2024-04-25T22:51:53.020574+0000","last_active":"2024-04-25T22:51:54.018219+0000","last_peered":"2024-04-25T22:51:54.018219+0000","last_clean":"2024-04-25T22:51:54.018219+0000","last_became_active":"2024-04-25T22:51:53.019978+0000","last_became_peered":"2024-04-25T22:51:53.019978+0000","last_unstale":"2024-04-25T22:51:54.018219+0000","last_undegraded":"2024-04-25T22:51:54.018219+0000","last_fullsized":"2024-04-25T22:51:54.018219+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:41.205051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052156+0000","last_change":"2024-04-25T22:51:52.017743+0000","last_active":"2024-04-25T22:51:54.052156+0000","last_peered":"2024-04-25T22:51:54.052156+0000","last_clean":"2024-04-25T22:51:54.052156+0000","last_became_active":"2024-04-25T22:51:52.016659+0000","last_became_peered":"2024-04-25T22:51:52.016659+0000","last_unstale":"2024-04-25T22:51:54.052156+0000","last_undegraded":"2024-04-25T22:51:54.052156+0000","last_fullsized":"2024-04-25T22:51:54.052156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:49:07.912197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018170+0000","last_change":"2024-04-25T22:51:53.023278+0000","last_active":"2024-04-25T22:51:54.018170+0000","last_peered":"2024-04-25T22:51:54.018170+0000","last_clean":"2024-04-25T22:51:54.018170+0000","last_became_active":"2024-04-25T22:51:53.021948+0000","last_became_peered":"2024-04-25T22:51:53.021948+0000","last_unstale":"2024-04-25T22:51:54.018170+0000","last_undegraded":"2024-04-25T22:51:54.018170+0000","last_fullsized":"2024-04-25T22:51:54.018170+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:22.231993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":216,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017807+0000","last_change":"2024-04-25T22:51:47.764624+0000","last_active":"2024-04-25T22:51:54.017807+0000","last_peered":"2024-04-25T22:51:54.017807+0000","last_clean":"2024-04-25T22:51:54.017807+0000","last_became_active":"2024-04-25T22:51:47.764176+0000","last_became_peered":"2024-04-25T22:51:47.764176+0000","last_unstale":"2024-04-25T22:51:54.017807+0000","last_undegraded":"2024-04-25T22:51:54.017807+0000","last_fullsized":"2024-04-25T22:51:54.017807+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:59:39.005489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018697+0000","last_change":"2024-04-25T22:51:47.768368+0000","last_active":"2024-04-25T22:51:54.018697+0000","last_peered":"2024-04-25T22:51:54.018697+0000","last_clean":"2024-04-25T22:51:54.018697+0000","last_became_active":"2024-04-25T22:51:47.768003+0000","last_became_peered":"2024-04-25T22:51:47.768003+0000","last_unstale":"2024-04-25T22:51:54.018697+0000","last_undegraded":"2024-04-25T22:51:54.018697+0000","last_fullsized":"2024-04-25T22:51:54.018697+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:10:00.098072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017829+0000","last_change":"2024-04-25T22:51:52.014376+0000","last_active":"2024-04-25T22:51:54.017829+0000","last_peered":"2024-04-25T22:51:54.017829+0000","last_clean":"2024-04-25T22:51:54.017829+0000","last_became_active":"2024-04-25T22:51:52.013816+0000","last_became_peered":"2024-04-25T22:51:52.013816+0000","last_unstale":"2024-04-25T22:51:54.017829+0000","last_undegraded":"2024-04-25T22:51:54.017829+0000","last_fullsized":"2024-04-25T22:51:54.017829+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:18.136883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018819+0000","last_change":"2024-04-25T22:51:53.024106+0000","last_active":"2024-04-25T22:51:54.018819+0000","last_peered":"2024-04-25T22:51:54.018819+0000","last_clean":"2024-04-25T22:51:54.018819+0000","last_became_active":"2024-04-25T22:51:53.023497+0000","last_became_peered":"2024-04-25T22:51:53.023497+0000","last_unstale":"2024-04-25T22:51:54.018819+0000","last_undegraded":"2024-04-25T22:51:54.018819+0000","last_fullsized":"2024-04-25T22:51:54.018819+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:52:16.918935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017591+0000","last_change":"2024-04-25T22:51:47.764591+0000","last_active":"2024-04-25T22:51:54.017591+0000","last_peered":"2024-04-25T22:51:54.017591+0000","last_clean":"2024-04-25T22:51:54.017591+0000","last_became_active":"2024-04-25T22:51:47.764229+0000","last_became_peered":"2024-04-25T22:51:47.764229+0000","last_unstale":"2024-04-25T22:51:54.017591+0000","last_undegraded":"2024-04-25T22:51:54.017591+0000","last_fullsized":"2024-04-25T22:51:54.017591+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:32.854624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017358+0000","last_change":"2024-04-25T22:51:52.017918+0000","last_active":"2024-04-25T22:51:54.017358+0000","last_peered":"2024-04-25T22:51:54.017358+0000","last_clean":"2024-04-25T22:51:54.017358+0000","last_became_active":"2024-04-25T22:51:52.017541+0000","last_became_peered":"2024-04-25T22:51:52.017541+0000","last_unstale":"2024-04-25T22:51:54.017358+0000","last_undegraded":"2024-04-25T22:51:54.017358+0000","last_fullsized":"2024-04-25T22:51:54.017358+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:17:10.500338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052996+0000","last_change":"2024-04-25T22:51:53.026971+0000","last_active":"2024-04-25T22:51:54.052996+0000","last_peered":"2024-04-25T22:51:54.052996+0000","last_clean":"2024-04-25T22:51:54.052996+0000","last_became_active":"2024-04-25T22:51:53.026355+0000","last_became_peered":"2024-04-25T22:51:53.026355+0000","last_unstale":"2024-04-25T22:51:54.052996+0000","last_undegraded":"2024-04-25T22:51:54.052996+0000","last_fullsized":"2024-04-25T22:51:54.052996+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:16.602188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017440+0000","last_change":"2024-04-25T22:51:47.762564+0000","last_active":"2024-04-25T22:51:54.017440+0000","last_peered":"2024-04-25T22:51:54.017440+0000","last_clean":"2024-04-25T22:51:54.017440+0000","last_became_active":"2024-04-25T22:51:47.762218+0000","last_became_peered":"2024-04-25T22:51:47.762218+0000","last_unstale":"2024-04-25T22:51:54.017440+0000","last_undegraded":"2024-04-25T22:51:54.017440+0000","last_fullsized":"2024-04-25T22:51:54.017440+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:09:06.117740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052192+0000","last_change":"2024-04-25T22:51:52.018873+0000","last_active":"2024-04-25T22:51:54.052192+0000","last_peered":"2024-04-25T22:51:54.052192+0000","last_clean":"2024-04-25T22:51:54.052192+0000","last_became_active":"2024-04-25T22:51:52.018300+0000","last_became_peered":"2024-04-25T22:51:52.018300+0000","last_unstale":"2024-04-25T22:51:54.052192+0000","last_undegraded":"2024-04-25T22:51:54.052192+0000","last_fullsized":"2024-04-25T22:51:54.052192+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:25:22.660789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018295+0000","last_change":"2024-04-25T22:51:53.023461+0000","last_active":"2024-04-25T22:51:54.018295+0000","last_peered":"2024-04-25T22:51:54.018295+0000","last_clean":"2024-04-25T22:51:54.018295+0000","last_became_active":"2024-04-25T22:51:53.022017+0000","last_became_peered":"2024-04-25T22:51:53.022017+0000","last_unstale":"2024-04-25T22:51:54.018295+0000","last_undegraded":"2024-04-25T22:51:54.018295+0000","last_fullsized":"2024-04-25T22:51:54.018295+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:43:47.453569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018255+0000","last_change":"2024-04-25T22:51:47.768269+0000","last_active":"2024-04-25T22:51:54.018255+0000","last_peered":"2024-04-25T22:51:54.018255+0000","last_clean":"2024-04-25T22:51:54.018255+0000","last_became_active":"2024-04-25T22:51:47.767991+0000","last_became_peered":"2024-04-25T22:51:47.767991+0000","last_unstale":"2024-04-25T22:51:54.018255+0000","last_undegraded":"2024-04-25T22:51:54.018255+0000","last_fullsized":"2024-04-25T22:51:54.018255+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:01:54.134289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018678+0000","last_change":"2024-04-25T22:51:52.021220+0000","last_active":"2024-04-25T22:51:54.018678+0000","last_peered":"2024-04-25T22:51:54.018678+0000","last_clean":"2024-04-25T22:51:54.018678+0000","last_became_active":"2024-04-25T22:51:52.020833+0000","last_became_peered":"2024-04-25T22:51:52.020833+0000","last_unstale":"2024-04-25T22:51:54.018678+0000","last_undegraded":"2024-04-25T22:51:54.018678+0000","last_fullsized":"2024-04-25T22:51:54.018678+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:12.627716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018128+0000","last_change":"2024-04-25T22:51:53.020666+0000","last_active":"2024-04-25T22:51:54.018128+0000","last_peered":"2024-04-25T22:51:54.018128+0000","last_clean":"2024-04-25T22:51:54.018128+0000","last_became_active":"2024-04-25T22:51:53.020212+0000","last_became_peered":"2024-04-25T22:51:53.020212+0000","last_unstale":"2024-04-25T22:51:54.018128+0000","last_undegraded":"2024-04-25T22:51:54.018128+0000","last_fullsized":"2024-04-25T22:51:54.018128+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:12:08.770479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018823+0000","last_change":"2024-04-25T22:51:52.016362+0000","last_active":"2024-04-25T22:51:54.018823+0000","last_peered":"2024-04-25T22:51:54.018823+0000","last_clean":"2024-04-25T22:51:54.018823+0000","last_became_active":"2024-04-25T22:51:52.015409+0000","last_became_peered":"2024-04-25T22:51:52.015409+0000","last_unstale":"2024-04-25T22:51:54.018823+0000","last_undegraded":"2024-04-25T22:51:54.018823+0000","last_fullsized":"2024-04-25T22:51:54.018823+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:21:19.563620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018072+0000","last_change":"2024-04-25T22:51:47.761131+0000","last_active":"2024-04-25T22:51:54.018072+0000","last_peered":"2024-04-25T22:51:54.018072+0000","last_clean":"2024-04-25T22:51:54.018072+0000","last_became_active":"2024-04-25T22:51:47.760894+0000","last_became_peered":"2024-04-25T22:51:47.760894+0000","last_unstale":"2024-04-25T22:51:54.018072+0000","last_undegraded":"2024-04-25T22:51:54.018072+0000","last_fullsized":"2024-04-25T22:51:54.018072+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:38:28.554024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052447+0000","last_change":"2024-04-25T22:51:53.026321+0000","last_active":"2024-04-25T22:51:54.052447+0000","last_peered":"2024-04-25T22:51:54.052447+0000","last_clean":"2024-04-25T22:51:54.052447+0000","last_became_active":"2024-04-25T22:51:53.025824+0000","last_became_peered":"2024-04-25T22:51:53.025824+0000","last_unstale":"2024-04-25T22:51:54.052447+0000","last_undegraded":"2024-04-25T22:51:54.052447+0000","last_fullsized":"2024-04-25T22:51:54.052447+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:12:00.793718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017995+0000","last_change":"2024-04-25T22:51:52.015638+0000","last_active":"2024-04-25T22:51:54.017995+0000","last_peered":"2024-04-25T22:51:54.017995+0000","last_clean":"2024-04-25T22:51:54.017995+0000","last_became_active":"2024-04-25T22:51:52.014858+0000","last_became_peered":"2024-04-25T22:51:52.014858+0000","last_unstale":"2024-04-25T22:51:54.017995+0000","last_undegraded":"2024-04-25T22:51:54.017995+0000","last_fullsized":"2024-04-25T22:51:54.017995+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:44:34.159650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053349+0000","last_change":"2024-04-25T22:51:47.765532+0000","last_active":"2024-04-25T22:51:54.053349+0000","last_peered":"2024-04-25T22:51:54.053349+0000","last_clean":"2024-04-25T22:51:54.053349+0000","last_became_active":"2024-04-25T22:51:47.765247+0000","last_became_peered":"2024-04-25T22:51:47.765247+0000","last_unstale":"2024-04-25T22:51:54.053349+0000","last_undegraded":"2024-04-25T22:51:54.053349+0000","last_fullsized":"2024-04-25T22:51:54.053349+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:55:05.342938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052632+0000","last_change":"2024-04-25T22:51:53.027051+0000","last_active":"2024-04-25T22:51:54.052632+0000","last_peered":"2024-04-25T22:51:54.052632+0000","last_clean":"2024-04-25T22:51:54.052632+0000","last_became_active":"2024-04-25T22:51:53.026458+0000","last_became_peered":"2024-04-25T22:51:53.026458+0000","last_unstale":"2024-04-25T22:51:54.052632+0000","last_undegraded":"2024-04-25T22:51:54.052632+0000","last_fullsized":"2024-04-25T22:51:54.052632+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:11:09.179564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018550+0000","last_change":"2024-04-25T22:51:52.015635+0000","last_active":"2024-04-25T22:51:54.018550+0000","last_peered":"2024-04-25T22:51:54.018550+0000","last_clean":"2024-04-25T22:51:54.018550+0000","last_became_active":"2024-04-25T22:51:52.014778+0000","last_became_peered":"2024-04-25T22:51:52.014778+0000","last_unstale":"2024-04-25T22:51:54.018550+0000","last_undegraded":"2024-04-25T22:51:54.018550+0000","last_fullsized":"2024-04-25T22:51:54.018550+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:21:19.563620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018314+0000","last_change":"2024-04-25T22:51:47.762468+0000","last_active":"2024-04-25T22:51:54.018314+0000","last_peered":"2024-04-25T22:51:54.018314+0000","last_clean":"2024-04-25T22:51:54.018314+0000","last_became_active":"2024-04-25T22:51:47.762199+0000","last_became_peered":"2024-04-25T22:51:47.762199+0000","last_unstale":"2024-04-25T22:51:54.018314+0000","last_undegraded":"2024-04-25T22:51:54.018314+0000","last_fullsized":"2024-04-25T22:51:54.018314+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:32.854624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017184+0000","last_change":"2024-04-25T22:51:53.023317+0000","last_active":"2024-04-25T22:51:54.017184+0000","last_peered":"2024-04-25T22:51:54.017184+0000","last_clean":"2024-04-25T22:51:54.017184+0000","last_became_active":"2024-04-25T22:51:53.022756+0000","last_became_peered":"2024-04-25T22:51:53.022756+0000","last_unstale":"2024-04-25T22:51:54.017184+0000","last_undegraded":"2024-04-25T22:51:54.017184+0000","last_fullsized":"2024-04-25T22:51:54.017184+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:37:13.419317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:55.011718+0000","last_change":"2024-04-25T22:51:52.017845+0000","last_active":"2024-04-25T22:51:55.011718+0000","last_peered":"2024-04-25T22:51:55.011718+0000","last_clean":"2024-04-25T22:51:55.011718+0000","last_became_active":"2024-04-25T22:51:52.017521+0000","last_became_peered":"2024-04-25T22:51:52.017521+0000","last_unstale":"2024-04-25T22:51:55.011718+0000","last_undegraded":"2024-04-25T22:51:55.011718+0000","last_fullsized":"2024-04-25T22:51:55.011718+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:18:00.975479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018392+0000","last_change":"2024-04-25T22:51:47.764288+0000","last_active":"2024-04-25T22:51:54.018392+0000","last_peered":"2024-04-25T22:51:54.018392+0000","last_clean":"2024-04-25T22:51:54.018392+0000","last_became_active":"2024-04-25T22:51:47.763961+0000","last_became_peered":"2024-04-25T22:51:47.763961+0000","last_unstale":"2024-04-25T22:51:54.018392+0000","last_undegraded":"2024-04-25T22:51:54.018392+0000","last_fullsized":"2024-04-25T22:51:54.018392+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:03:07.164842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052084+0000","last_change":"2024-04-25T22:51:53.026925+0000","last_active":"2024-04-25T22:51:54.052084+0000","last_peered":"2024-04-25T22:51:54.052084+0000","last_clean":"2024-04-25T22:51:54.052084+0000","last_became_active":"2024-04-25T22:51:53.026419+0000","last_became_peered":"2024-04-25T22:51:53.026419+0000","last_unstale":"2024-04-25T22:51:54.052084+0000","last_undegraded":"2024-04-25T22:51:54.052084+0000","last_fullsized":"2024-04-25T22:51:54.052084+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:49:38.102060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018559+0000","last_change":"2024-04-25T22:51:53.022222+0000","last_active":"2024-04-25T22:51:54.018559+0000","last_peered":"2024-04-25T22:51:54.018559+0000","last_clean":"2024-04-25T22:51:54.018559+0000","last_became_active":"2024-04-25T22:51:53.021687+0000","last_became_peered":"2024-04-25T22:51:53.021687+0000","last_unstale":"2024-04-25T22:51:54.018559+0000","last_undegraded":"2024-04-25T22:51:54.018559+0000","last_fullsized":"2024-04-25T22:51:54.018559+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:35:06.234402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018650+0000","last_change":"2024-04-25T22:51:52.019928+0000","last_active":"2024-04-25T22:51:54.018650+0000","last_peered":"2024-04-25T22:51:54.018650+0000","last_clean":"2024-04-25T22:51:54.018650+0000","last_became_active":"2024-04-25T22:51:52.019264+0000","last_became_peered":"2024-04-25T22:51:52.019264+0000","last_unstale":"2024-04-25T22:51:54.018650+0000","last_undegraded":"2024-04-25T22:51:54.018650+0000","last_fullsized":"2024-04-25T22:51:54.018650+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:18.136883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017393+0000","last_change":"2024-04-25T22:51:53.020652+0000","last_active":"2024-04-25T22:51:54.017393+0000","last_peered":"2024-04-25T22:51:54.017393+0000","last_clean":"2024-04-25T22:51:54.017393+0000","last_became_active":"2024-04-25T22:51:53.020129+0000","last_became_peered":"2024-04-25T22:51:53.020129+0000","last_unstale":"2024-04-25T22:51:54.017393+0000","last_undegraded":"2024-04-25T22:51:54.017393+0000","last_fullsized":"2024-04-25T22:51:54.017393+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:18:31.139968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053289+0000","last_change":"2024-04-25T22:51:52.018977+0000","last_active":"2024-04-25T22:51:54.053289+0000","last_peered":"2024-04-25T22:51:54.053289+0000","last_clean":"2024-04-25T22:51:54.053289+0000","last_became_active":"2024-04-25T22:51:52.018519+0000","last_became_peered":"2024-04-25T22:51:52.018519+0000","last_unstale":"2024-04-25T22:51:54.053289+0000","last_undegraded":"2024-04-25T22:51:54.053289+0000","last_fullsized":"2024-04-25T22:51:54.053289+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:53:07.306148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018416+0000","last_change":"2024-04-25T22:51:52.022177+0000","last_active":"2024-04-25T22:51:54.018416+0000","last_peered":"2024-04-25T22:51:54.018416+0000","last_clean":"2024-04-25T22:51:54.018416+0000","last_became_active":"2024-04-25T22:51:52.021882+0000","last_became_peered":"2024-04-25T22:51:52.021882+0000","last_unstale":"2024-04-25T22:51:54.018416+0000","last_undegraded":"2024-04-25T22:51:54.018416+0000","last_fullsized":"2024-04-25T22:51:54.018416+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:44:34.159650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017107+0000","last_change":"2024-04-25T22:51:53.022499+0000","last_active":"2024-04-25T22:51:54.017107+0000","last_peered":"2024-04-25T22:51:54.017107+0000","last_clean":"2024-04-25T22:51:54.017107+0000","last_became_active":"2024-04-25T22:51:53.022018+0000","last_became_peered":"2024-04-25T22:51:53.022018+0000","last_unstale":"2024-04-25T22:51:54.017107+0000","last_undegraded":"2024-04-25T22:51:54.017107+0000","last_fullsized":"2024-04-25T22:51:54.017107+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:33:24.700106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018441+0000","last_change":"2024-04-25T22:51:52.019673+0000","last_active":"2024-04-25T22:51:54.018441+0000","last_peered":"2024-04-25T22:51:54.018441+0000","last_clean":"2024-04-25T22:51:54.018441+0000","last_became_active":"2024-04-25T22:51:52.018877+0000","last_became_peered":"2024-04-25T22:51:52.018877+0000","last_unstale":"2024-04-25T22:51:54.018441+0000","last_undegraded":"2024-04-25T22:51:54.018441+0000","last_fullsized":"2024-04-25T22:51:54.018441+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:05.110747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017316+0000","last_change":"2024-04-25T22:51:53.020927+0000","last_active":"2024-04-25T22:51:54.017316+0000","last_peered":"2024-04-25T22:51:54.017316+0000","last_clean":"2024-04-25T22:51:54.017316+0000","last_became_active":"2024-04-25T22:51:53.020366+0000","last_became_peered":"2024-04-25T22:51:53.020366+0000","last_unstale":"2024-04-25T22:51:54.017316+0000","last_undegraded":"2024-04-25T22:51:54.017316+0000","last_fullsized":"2024-04-25T22:51:54.017316+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:55:27.934567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053387+0000","last_change":"2024-04-25T22:51:53.029210+0000","last_active":"2024-04-25T22:51:54.053387+0000","last_peered":"2024-04-25T22:51:54.053387+0000","last_clean":"2024-04-25T22:51:54.053387+0000","last_became_active":"2024-04-25T22:51:53.028635+0000","last_became_peered":"2024-04-25T22:51:53.028635+0000","last_unstale":"2024-04-25T22:51:54.053387+0000","last_undegraded":"2024-04-25T22:51:54.053387+0000","last_fullsized":"2024-04-25T22:51:54.053387+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:41.205051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017373+0000","last_change":"2024-04-25T22:51:52.014897+0000","last_active":"2024-04-25T22:51:54.017373+0000","last_peered":"2024-04-25T22:51:54.017373+0000","last_clean":"2024-04-25T22:51:54.017373+0000","last_became_active":"2024-04-25T22:51:52.014344+0000","last_became_peered":"2024-04-25T22:51:52.014344+0000","last_unstale":"2024-04-25T22:51:54.017373+0000","last_undegraded":"2024-04-25T22:51:54.017373+0000","last_fullsized":"2024-04-25T22:51:54.017373+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:55.235787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018063+0000","last_change":"2024-04-25T22:51:53.022920+0000","last_active":"2024-04-25T22:51:54.018063+0000","last_peered":"2024-04-25T22:51:54.018063+0000","last_clean":"2024-04-25T22:51:54.018063+0000","last_became_active":"2024-04-25T22:51:53.022190+0000","last_became_peered":"2024-04-25T22:51:53.022190+0000","last_unstale":"2024-04-25T22:51:54.018063+0000","last_undegraded":"2024-04-25T22:51:54.018063+0000","last_fullsized":"2024-04-25T22:51:54.018063+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:16.187194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017261+0000","last_change":"2024-04-25T22:51:52.018371+0000","last_active":"2024-04-25T22:51:54.017261+0000","last_peered":"2024-04-25T22:51:54.017261+0000","last_clean":"2024-04-25T22:51:54.017261+0000","last_became_active":"2024-04-25T22:51:52.018027+0000","last_became_peered":"2024-04-25T22:51:52.018027+0000","last_unstale":"2024-04-25T22:51:54.017261+0000","last_undegraded":"2024-04-25T22:51:54.017261+0000","last_fullsized":"2024-04-25T22:51:54.017261+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:36:57.435877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052965+0000","last_change":"2024-04-25T22:51:53.028084+0000","last_active":"2024-04-25T22:51:54.052965+0000","last_peered":"2024-04-25T22:51:54.052965+0000","last_clean":"2024-04-25T22:51:54.052965+0000","last_became_active":"2024-04-25T22:51:53.027541+0000","last_became_peered":"2024-04-25T22:51:53.027541+0000","last_unstale":"2024-04-25T22:51:54.052965+0000","last_undegraded":"2024-04-25T22:51:54.052965+0000","last_fullsized":"2024-04-25T22:51:54.052965+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:28:42.903045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052565+0000","last_change":"2024-04-25T22:51:52.017006+0000","last_active":"2024-04-25T22:51:54.052565+0000","last_peered":"2024-04-25T22:51:54.052565+0000","last_clean":"2024-04-25T22:51:54.052565+0000","last_became_active":"2024-04-25T22:51:52.016667+0000","last_became_peered":"2024-04-25T22:51:52.016667+0000","last_unstale":"2024-04-25T22:51:54.052565+0000","last_undegraded":"2024-04-25T22:51:54.052565+0000","last_fullsized":"2024-04-25T22:51:54.052565+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:24:51.210288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052731+0000","last_change":"2024-04-25T22:51:53.024685+0000","last_active":"2024-04-25T22:51:54.052731+0000","last_peered":"2024-04-25T22:51:54.052731+0000","last_clean":"2024-04-25T22:51:54.052731+0000","last_became_active":"2024-04-25T22:51:53.024304+0000","last_became_peered":"2024-04-25T22:51:53.024304+0000","last_unstale":"2024-04-25T22:51:54.052731+0000","last_undegraded":"2024-04-25T22:51:54.052731+0000","last_fullsized":"2024-04-25T22:51:54.052731+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:18:31.139968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052731+0000","last_change":"2024-04-25T22:51:52.018973+0000","last_active":"2024-04-25T22:51:54.052731+0000","last_peered":"2024-04-25T22:51:54.052731+0000","last_clean":"2024-04-25T22:51:54.052731+0000","last_became_active":"2024-04-25T22:51:52.018503+0000","last_became_peered":"2024-04-25T22:51:52.018503+0000","last_unstale":"2024-04-25T22:51:54.052731+0000","last_undegraded":"2024-04-25T22:51:54.052731+0000","last_fullsized":"2024-04-25T22:51:54.052731+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:07:38.783124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017918+0000","last_change":"2024-04-25T22:51:53.018063+0000","last_active":"2024-04-25T22:51:54.017918+0000","last_peered":"2024-04-25T22:51:54.017918+0000","last_clean":"2024-04-25T22:51:54.017918+0000","last_became_active":"2024-04-25T22:51:53.016779+0000","last_became_peered":"2024-04-25T22:51:53.016779+0000","last_unstale":"2024-04-25T22:51:54.017918+0000","last_undegraded":"2024-04-25T22:51:54.017918+0000","last_fullsized":"2024-04-25T22:51:54.017918+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:58:11.470631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018527+0000","last_change":"2024-04-25T22:51:52.022209+0000","last_active":"2024-04-25T22:51:54.018527+0000","last_peered":"2024-04-25T22:51:54.018527+0000","last_clean":"2024-04-25T22:51:54.018527+0000","last_became_active":"2024-04-25T22:51:52.021868+0000","last_became_peered":"2024-04-25T22:51:52.021868+0000","last_unstale":"2024-04-25T22:51:54.018527+0000","last_undegraded":"2024-04-25T22:51:54.018527+0000","last_fullsized":"2024-04-25T22:51:54.018527+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:36:57.435877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018070+0000","last_change":"2024-04-25T22:51:53.017222+0000","last_active":"2024-04-25T22:51:54.018070+0000","last_peered":"2024-04-25T22:51:54.018070+0000","last_clean":"2024-04-25T22:51:54.018070+0000","last_became_active":"2024-04-25T22:51:53.015717+0000","last_became_peered":"2024-04-25T22:51:53.015717+0000","last_unstale":"2024-04-25T22:51:54.018070+0000","last_undegraded":"2024-04-25T22:51:54.018070+0000","last_fullsized":"2024-04-25T22:51:54.018070+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:43:47.453569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053098+0000","last_change":"2024-04-25T22:51:52.019032+0000","last_active":"2024-04-25T22:51:54.053098+0000","last_peered":"2024-04-25T22:51:54.053098+0000","last_clean":"2024-04-25T22:51:54.053098+0000","last_became_active":"2024-04-25T22:51:52.018547+0000","last_became_peered":"2024-04-25T22:51:52.018547+0000","last_unstale":"2024-04-25T22:51:54.053098+0000","last_undegraded":"2024-04-25T22:51:54.053098+0000","last_fullsized":"2024-04-25T22:51:54.053098+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:10:00.056491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052619+0000","last_change":"2024-04-25T22:51:53.024597+0000","last_active":"2024-04-25T22:51:54.052619+0000","last_peered":"2024-04-25T22:51:54.052619+0000","last_clean":"2024-04-25T22:51:54.052619+0000","last_became_active":"2024-04-25T22:51:53.024256+0000","last_became_peered":"2024-04-25T22:51:53.024256+0000","last_unstale":"2024-04-25T22:51:54.052619+0000","last_undegraded":"2024-04-25T22:51:54.052619+0000","last_fullsized":"2024-04-25T22:51:54.052619+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:55:27.934567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018241+0000","last_change":"2024-04-25T22:51:52.015581+0000","last_active":"2024-04-25T22:51:54.018241+0000","last_peered":"2024-04-25T22:51:54.018241+0000","last_clean":"2024-04-25T22:51:54.018241+0000","last_became_active":"2024-04-25T22:51:52.014530+0000","last_became_peered":"2024-04-25T22:51:52.014530+0000","last_unstale":"2024-04-25T22:51:54.018241+0000","last_undegraded":"2024-04-25T22:51:54.018241+0000","last_fullsized":"2024-04-25T22:51:54.018241+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:12.627716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017722+0000","last_change":"2024-04-25T22:51:53.020744+0000","last_active":"2024-04-25T22:51:54.017722+0000","last_peered":"2024-04-25T22:51:54.017722+0000","last_clean":"2024-04-25T22:51:54.017722+0000","last_became_active":"2024-04-25T22:51:53.018283+0000","last_became_peered":"2024-04-25T22:51:53.018283+0000","last_unstale":"2024-04-25T22:51:54.017722+0000","last_undegraded":"2024-04-25T22:51:54.017722+0000","last_fullsized":"2024-04-25T22:51:54.017722+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:16.187194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018313+0000","last_change":"2024-04-25T22:51:52.019730+0000","last_active":"2024-04-25T22:51:54.018313+0000","last_peered":"2024-04-25T22:51:54.018313+0000","last_clean":"2024-04-25T22:51:54.018313+0000","last_became_active":"2024-04-25T22:51:52.018987+0000","last_became_peered":"2024-04-25T22:51:52.018987+0000","last_unstale":"2024-04-25T22:51:54.018313+0000","last_undegraded":"2024-04-25T22:51:54.018313+0000","last_fullsized":"2024-04-25T22:51:54.018313+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:03:14.826593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31916,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339924,"statfs":{"total":96636764160,"available":96604082176,"internally_reserved":0,"allocated":749568,"data_stored":638245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":139264,"data_stored":46699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36084,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335756,"statfs":{"total":96636764160,"available":96599814144,"internally_reserved":0,"allocated":757760,"data_stored":638861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:52:05.428 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:52:05.763 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:52:05.764 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-25T22:52:05.774 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-04-25T22:52:03.928188+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":95156,"kb_used_data":1608,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":283020364,"statfs":{"total":289910292480,"available":289812852736,"internally_reserved":0,"allocated":1646592,"data_stored":1323805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001642"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053235+0000","last_change":"2024-04-25T22:51:53.026259+0000","last_active":"2024-04-25T22:51:54.053235+0000","last_peered":"2024-04-25T22:51:54.053235+0000","last_clean":"2024-04-25T22:51:54.053235+0000","last_became_active":"2024-04-25T22:51:53.025647+0000","last_became_peered":"2024-04-25T22:51:53.025647+0000","last_unstale":"2024-04-25T22:51:54.053235+0000","last_undegraded":"2024-04-25T22:51:54.053235+0000","last_fullsized":"2024-04-25T22:51:54.053235+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:44:59.401139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052785+0000","last_change":"2024-04-25T22:51:53.026052+0000","last_active":"2024-04-25T22:51:54.052785+0000","last_peered":"2024-04-25T22:51:54.052785+0000","last_clean":"2024-04-25T22:51:54.052785+0000","last_became_active":"2024-04-25T22:51:53.025562+0000","last_became_peered":"2024-04-25T22:51:53.025562+0000","last_unstale":"2024-04-25T22:51:54.052785+0000","last_undegraded":"2024-04-25T22:51:54.052785+0000","last_fullsized":"2024-04-25T22:51:54.052785+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:06:02.072481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018038+0000","last_change":"2024-04-25T22:51:53.025605+0000","last_active":"2024-04-25T22:51:54.018038+0000","last_peered":"2024-04-25T22:51:54.018038+0000","last_clean":"2024-04-25T22:51:54.018038+0000","last_became_active":"2024-04-25T22:51:53.024929+0000","last_became_peered":"2024-04-25T22:51:53.024929+0000","last_unstale":"2024-04-25T22:51:54.018038+0000","last_undegraded":"2024-04-25T22:51:54.018038+0000","last_fullsized":"2024-04-25T22:51:54.018038+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:12:08.770479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018037+0000","last_change":"2024-04-25T22:51:53.019862+0000","last_active":"2024-04-25T22:51:54.018037+0000","last_peered":"2024-04-25T22:51:54.018037+0000","last_clean":"2024-04-25T22:51:54.018037+0000","last_became_active":"2024-04-25T22:51:53.018814+0000","last_became_peered":"2024-04-25T22:51:53.018814+0000","last_unstale":"2024-04-25T22:51:54.018037+0000","last_undegraded":"2024-04-25T22:51:54.018037+0000","last_fullsized":"2024-04-25T22:51:54.018037+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:22.231993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052571+0000","last_change":"2024-04-25T22:51:53.024641+0000","last_active":"2024-04-25T22:51:54.052571+0000","last_peered":"2024-04-25T22:51:54.052571+0000","last_clean":"2024-04-25T22:51:54.052571+0000","last_became_active":"2024-04-25T22:51:53.024240+0000","last_became_peered":"2024-04-25T22:51:53.024240+0000","last_unstale":"2024-04-25T22:51:54.052571+0000","last_undegraded":"2024-04-25T22:51:54.052571+0000","last_fullsized":"2024-04-25T22:51:54.052571+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:37:13.419317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017491+0000","last_change":"2024-04-25T22:51:53.017733+0000","last_active":"2024-04-25T22:51:54.017491+0000","last_peered":"2024-04-25T22:51:54.017491+0000","last_clean":"2024-04-25T22:51:54.017491+0000","last_became_active":"2024-04-25T22:51:53.016903+0000","last_became_peered":"2024-04-25T22:51:53.016903+0000","last_unstale":"2024-04-25T22:51:54.017491+0000","last_undegraded":"2024-04-25T22:51:54.017491+0000","last_fullsized":"2024-04-25T22:51:54.017491+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:06:02.072481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017578+0000","last_change":"2024-04-25T22:51:53.016102+0000","last_active":"2024-04-25T22:51:54.017578+0000","last_peered":"2024-04-25T22:51:54.017578+0000","last_clean":"2024-04-25T22:51:54.017578+0000","last_became_active":"2024-04-25T22:51:53.015662+0000","last_became_peered":"2024-04-25T22:51:53.015662+0000","last_unstale":"2024-04-25T22:51:54.017578+0000","last_undegraded":"2024-04-25T22:51:54.017578+0000","last_fullsized":"2024-04-25T22:51:54.017578+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:21:52.771650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017247+0000","last_change":"2024-04-25T22:51:53.021907+0000","last_active":"2024-04-25T22:51:54.017247+0000","last_peered":"2024-04-25T22:51:54.017247+0000","last_clean":"2024-04-25T22:51:54.017247+0000","last_became_active":"2024-04-25T22:51:53.019092+0000","last_became_peered":"2024-04-25T22:51:53.019092+0000","last_unstale":"2024-04-25T22:51:54.017247+0000","last_undegraded":"2024-04-25T22:51:54.017247+0000","last_fullsized":"2024-04-25T22:51:54.017247+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:55:27.934567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017941+0000","last_change":"2024-04-25T22:51:53.023004+0000","last_active":"2024-04-25T22:51:54.017941+0000","last_peered":"2024-04-25T22:51:54.017941+0000","last_clean":"2024-04-25T22:51:54.017941+0000","last_became_active":"2024-04-25T22:51:53.021541+0000","last_became_peered":"2024-04-25T22:51:53.021541+0000","last_unstale":"2024-04-25T22:51:54.017941+0000","last_undegraded":"2024-04-25T22:51:54.017941+0000","last_fullsized":"2024-04-25T22:51:54.017941+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:21:52.771650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052904+0000","last_change":"2024-04-25T22:51:53.024967+0000","last_active":"2024-04-25T22:51:54.052904+0000","last_peered":"2024-04-25T22:51:54.052904+0000","last_clean":"2024-04-25T22:51:54.052904+0000","last_became_active":"2024-04-25T22:51:53.024605+0000","last_became_peered":"2024-04-25T22:51:53.024605+0000","last_unstale":"2024-04-25T22:51:54.052904+0000","last_undegraded":"2024-04-25T22:51:54.052904+0000","last_fullsized":"2024-04-25T22:51:54.052904+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:21:52.771650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018442+0000","last_change":"2024-04-25T22:51:53.016889+0000","last_active":"2024-04-25T22:51:54.018442+0000","last_peered":"2024-04-25T22:51:54.018442+0000","last_clean":"2024-04-25T22:51:54.018442+0000","last_became_active":"2024-04-25T22:51:53.016121+0000","last_became_peered":"2024-04-25T22:51:53.016121+0000","last_unstale":"2024-04-25T22:51:54.018442+0000","last_undegraded":"2024-04-25T22:51:54.018442+0000","last_fullsized":"2024-04-25T22:51:54.018442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:11:52.428780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052755+0000","last_change":"2024-04-25T22:51:53.028006+0000","last_active":"2024-04-25T22:51:54.052755+0000","last_peered":"2024-04-25T22:51:54.052755+0000","last_clean":"2024-04-25T22:51:54.052755+0000","last_became_active":"2024-04-25T22:51:53.027363+0000","last_became_peered":"2024-04-25T22:51:53.027363+0000","last_unstale":"2024-04-25T22:51:54.052755+0000","last_undegraded":"2024-04-25T22:51:54.052755+0000","last_fullsized":"2024-04-25T22:51:54.052755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:32.923620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052272+0000","last_change":"2024-04-25T22:51:53.024407+0000","last_active":"2024-04-25T22:51:54.052272+0000","last_peered":"2024-04-25T22:51:54.052272+0000","last_clean":"2024-04-25T22:51:54.052272+0000","last_became_active":"2024-04-25T22:51:53.024079+0000","last_became_peered":"2024-04-25T22:51:53.024079+0000","last_unstale":"2024-04-25T22:51:54.052272+0000","last_undegraded":"2024-04-25T22:51:54.052272+0000","last_fullsized":"2024-04-25T22:51:54.052272+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:40:41.536510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018150+0000","last_change":"2024-04-25T22:51:53.022367+0000","last_active":"2024-04-25T22:51:54.018150+0000","last_peered":"2024-04-25T22:51:54.018150+0000","last_clean":"2024-04-25T22:51:54.018150+0000","last_became_active":"2024-04-25T22:51:53.021902+0000","last_became_peered":"2024-04-25T22:51:53.021902+0000","last_unstale":"2024-04-25T22:51:54.018150+0000","last_undegraded":"2024-04-25T22:51:54.018150+0000","last_fullsized":"2024-04-25T22:51:54.018150+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:44:59.401139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017718+0000","last_change":"2024-04-25T22:51:53.022016+0000","last_active":"2024-04-25T22:51:54.017718+0000","last_peered":"2024-04-25T22:51:54.017718+0000","last_clean":"2024-04-25T22:51:54.017718+0000","last_became_active":"2024-04-25T22:51:53.021666+0000","last_became_peered":"2024-04-25T22:51:53.021666+0000","last_unstale":"2024-04-25T22:51:54.017718+0000","last_undegraded":"2024-04-25T22:51:54.017718+0000","last_fullsized":"2024-04-25T22:51:54.017718+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:28:42.903045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017270+0000","last_change":"2024-04-25T22:51:53.021442+0000","last_active":"2024-04-25T22:51:54.017270+0000","last_peered":"2024-04-25T22:51:54.017270+0000","last_clean":"2024-04-25T22:51:54.017270+0000","last_became_active":"2024-04-25T22:51:53.019251+0000","last_became_peered":"2024-04-25T22:51:53.019251+0000","last_unstale":"2024-04-25T22:51:54.017270+0000","last_undegraded":"2024-04-25T22:51:54.017270+0000","last_fullsized":"2024-04-25T22:51:54.017270+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:18:31.139968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018458+0000","last_change":"2024-04-25T22:51:53.023571+0000","last_active":"2024-04-25T22:51:54.018458+0000","last_peered":"2024-04-25T22:51:54.018458+0000","last_clean":"2024-04-25T22:51:54.018458+0000","last_became_active":"2024-04-25T22:51:53.022774+0000","last_became_peered":"2024-04-25T22:51:53.022774+0000","last_unstale":"2024-04-25T22:51:54.018458+0000","last_undegraded":"2024-04-25T22:51:54.018458+0000","last_fullsized":"2024-04-25T22:51:54.018458+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:41.205051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053209+0000","last_change":"2024-04-25T22:51:53.026365+0000","last_active":"2024-04-25T22:51:54.053209+0000","last_peered":"2024-04-25T22:51:54.053209+0000","last_clean":"2024-04-25T22:51:54.053209+0000","last_became_active":"2024-04-25T22:51:53.025610+0000","last_became_peered":"2024-04-25T22:51:53.025610+0000","last_unstale":"2024-04-25T22:51:54.053209+0000","last_undegraded":"2024-04-25T22:51:54.053209+0000","last_fullsized":"2024-04-25T22:51:54.053209+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:22.231993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017934+0000","last_change":"2024-04-25T22:51:53.020704+0000","last_active":"2024-04-25T22:51:54.017934+0000","last_peered":"2024-04-25T22:51:54.017934+0000","last_clean":"2024-04-25T22:51:54.017934+0000","last_became_active":"2024-04-25T22:51:53.020333+0000","last_became_peered":"2024-04-25T22:51:53.020333+0000","last_unstale":"2024-04-25T22:51:54.017934+0000","last_undegraded":"2024-04-25T22:51:54.017934+0000","last_fullsized":"2024-04-25T22:51:54.017934+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:06:02.072481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018256+0000","last_change":"2024-04-25T22:51:53.019606+0000","last_active":"2024-04-25T22:51:54.018256+0000","last_peered":"2024-04-25T22:51:54.018256+0000","last_clean":"2024-04-25T22:51:54.018256+0000","last_became_active":"2024-04-25T22:51:53.018789+0000","last_became_peered":"2024-04-25T22:51:53.018789+0000","last_unstale":"2024-04-25T22:51:54.018256+0000","last_undegraded":"2024-04-25T22:51:54.018256+0000","last_fullsized":"2024-04-25T22:51:54.018256+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:43:07.741691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018361+0000","last_change":"2024-04-25T22:51:53.018086+0000","last_active":"2024-04-25T22:51:54.018361+0000","last_peered":"2024-04-25T22:51:54.018361+0000","last_clean":"2024-04-25T22:51:54.018361+0000","last_became_active":"2024-04-25T22:51:53.016966+0000","last_became_peered":"2024-04-25T22:51:53.016966+0000","last_unstale":"2024-04-25T22:51:54.018361+0000","last_undegraded":"2024-04-25T22:51:54.018361+0000","last_fullsized":"2024-04-25T22:51:54.018361+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:25:33.516171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052152+0000","last_change":"2024-04-25T22:51:53.026746+0000","last_active":"2024-04-25T22:51:54.052152+0000","last_peered":"2024-04-25T22:51:54.052152+0000","last_clean":"2024-04-25T22:51:54.052152+0000","last_became_active":"2024-04-25T22:51:53.025938+0000","last_became_peered":"2024-04-25T22:51:53.025938+0000","last_unstale":"2024-04-25T22:51:54.052152+0000","last_undegraded":"2024-04-25T22:51:54.052152+0000","last_fullsized":"2024-04-25T22:51:54.052152+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:38:03.428258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.016918+0000","last_change":"2024-04-25T22:51:53.016829+0000","last_active":"2024-04-25T22:51:54.016918+0000","last_peered":"2024-04-25T22:51:54.016918+0000","last_clean":"2024-04-25T22:51:54.016918+0000","last_became_active":"2024-04-25T22:51:53.016497+0000","last_became_peered":"2024-04-25T22:51:53.016497+0000","last_unstale":"2024-04-25T22:51:54.016918+0000","last_undegraded":"2024-04-25T22:51:54.016918+0000","last_fullsized":"2024-04-25T22:51:54.016918+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:11:09.179564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.051948+0000","last_change":"2024-04-25T22:51:53.025164+0000","last_active":"2024-04-25T22:51:54.051948+0000","last_peered":"2024-04-25T22:51:54.051948+0000","last_clean":"2024-04-25T22:51:54.051948+0000","last_became_active":"2024-04-25T22:51:53.024781+0000","last_became_peered":"2024-04-25T22:51:53.024781+0000","last_unstale":"2024-04-25T22:51:54.051948+0000","last_undegraded":"2024-04-25T22:51:54.051948+0000","last_fullsized":"2024-04-25T22:51:54.051948+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:04:31.763523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053277+0000","last_change":"2024-04-25T22:51:53.028155+0000","last_active":"2024-04-25T22:51:54.053277+0000","last_peered":"2024-04-25T22:51:54.053277+0000","last_clean":"2024-04-25T22:51:54.053277+0000","last_became_active":"2024-04-25T22:51:53.027867+0000","last_became_peered":"2024-04-25T22:51:53.027867+0000","last_unstale":"2024-04-25T22:51:54.053277+0000","last_undegraded":"2024-04-25T22:51:54.053277+0000","last_fullsized":"2024-04-25T22:51:54.053277+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:43:47.453569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018121+0000","last_change":"2024-04-25T22:51:53.022959+0000","last_active":"2024-04-25T22:51:54.018121+0000","last_peered":"2024-04-25T22:51:54.018121+0000","last_clean":"2024-04-25T22:51:54.018121+0000","last_became_active":"2024-04-25T22:51:53.022318+0000","last_became_peered":"2024-04-25T22:51:53.022318+0000","last_unstale":"2024-04-25T22:51:54.018121+0000","last_undegraded":"2024-04-25T22:51:54.018121+0000","last_fullsized":"2024-04-25T22:51:54.018121+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:58:11.470631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018639+0000","last_change":"2024-04-25T22:51:53.022893+0000","last_active":"2024-04-25T22:51:54.018639+0000","last_peered":"2024-04-25T22:51:54.018639+0000","last_clean":"2024-04-25T22:51:54.018639+0000","last_became_active":"2024-04-25T22:51:53.022407+0000","last_became_peered":"2024-04-25T22:51:53.022407+0000","last_unstale":"2024-04-25T22:51:54.018639+0000","last_undegraded":"2024-04-25T22:51:54.018639+0000","last_fullsized":"2024-04-25T22:51:54.018639+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:08:44.404718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053002+0000","last_change":"2024-04-25T22:51:53.028447+0000","last_active":"2024-04-25T22:51:54.053002+0000","last_peered":"2024-04-25T22:51:54.053002+0000","last_clean":"2024-04-25T22:51:54.053002+0000","last_became_active":"2024-04-25T22:51:53.027852+0000","last_became_peered":"2024-04-25T22:51:53.027852+0000","last_unstale":"2024-04-25T22:51:54.053002+0000","last_undegraded":"2024-04-25T22:51:54.053002+0000","last_fullsized":"2024-04-25T22:51:54.053002+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:16.187194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017554+0000","last_change":"2024-04-25T22:51:53.019840+0000","last_active":"2024-04-25T22:51:54.017554+0000","last_peered":"2024-04-25T22:51:54.017554+0000","last_clean":"2024-04-25T22:51:54.017554+0000","last_became_active":"2024-04-25T22:51:53.019419+0000","last_became_peered":"2024-04-25T22:51:53.019419+0000","last_unstale":"2024-04-25T22:51:54.017554+0000","last_undegraded":"2024-04-25T22:51:54.017554+0000","last_fullsized":"2024-04-25T22:51:54.017554+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:32.923620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052550+0000","last_change":"2024-04-25T22:51:53.026997+0000","last_active":"2024-04-25T22:51:54.052550+0000","last_peered":"2024-04-25T22:51:54.052550+0000","last_clean":"2024-04-25T22:51:54.052550+0000","last_became_active":"2024-04-25T22:51:53.026379+0000","last_became_peered":"2024-04-25T22:51:53.026379+0000","last_unstale":"2024-04-25T22:51:54.052550+0000","last_undegraded":"2024-04-25T22:51:54.052550+0000","last_fullsized":"2024-04-25T22:51:54.052550+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:33:24.700106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017074+0000","last_change":"2024-04-25T22:51:53.019642+0000","last_active":"2024-04-25T22:51:54.017074+0000","last_peered":"2024-04-25T22:51:54.017074+0000","last_clean":"2024-04-25T22:51:54.017074+0000","last_became_active":"2024-04-25T22:51:53.019197+0000","last_became_peered":"2024-04-25T22:51:53.019197+0000","last_unstale":"2024-04-25T22:51:54.017074+0000","last_undegraded":"2024-04-25T22:51:54.017074+0000","last_fullsized":"2024-04-25T22:51:54.017074+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:12:00.793718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017428+0000","last_change":"2024-04-25T22:51:53.020857+0000","last_active":"2024-04-25T22:51:54.017428+0000","last_peered":"2024-04-25T22:51:54.017428+0000","last_clean":"2024-04-25T22:51:54.017428+0000","last_became_active":"2024-04-25T22:51:53.018340+0000","last_became_peered":"2024-04-25T22:51:53.018340+0000","last_unstale":"2024-04-25T22:51:54.017428+0000","last_undegraded":"2024-04-25T22:51:54.017428+0000","last_fullsized":"2024-04-25T22:51:54.017428+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:32.923620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053001+0000","last_change":"2024-04-25T22:51:53.025101+0000","last_active":"2024-04-25T22:51:54.053001+0000","last_peered":"2024-04-25T22:51:54.053001+0000","last_clean":"2024-04-25T22:51:54.053001+0000","last_became_active":"2024-04-25T22:51:53.024643+0000","last_became_peered":"2024-04-25T22:51:53.024643+0000","last_unstale":"2024-04-25T22:51:54.053001+0000","last_undegraded":"2024-04-25T22:51:54.053001+0000","last_fullsized":"2024-04-25T22:51:54.053001+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:58:11.470631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018622+0000","last_change":"2024-04-25T22:51:52.017181+0000","last_active":"2024-04-25T22:51:54.018622+0000","last_peered":"2024-04-25T22:51:54.018622+0000","last_clean":"2024-04-25T22:51:54.018622+0000","last_became_active":"2024-04-25T22:51:52.016682+0000","last_became_peered":"2024-04-25T22:51:52.016682+0000","last_unstale":"2024-04-25T22:51:54.018622+0000","last_undegraded":"2024-04-25T22:51:54.018622+0000","last_fullsized":"2024-04-25T22:51:54.018622+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:18:00.975479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053150+0000","last_change":"2024-04-25T22:51:53.026414+0000","last_active":"2024-04-25T22:51:54.053150+0000","last_peered":"2024-04-25T22:51:54.053150+0000","last_clean":"2024-04-25T22:51:54.053150+0000","last_became_active":"2024-04-25T22:51:53.025591+0000","last_became_peered":"2024-04-25T22:51:53.025591+0000","last_unstale":"2024-04-25T22:51:54.053150+0000","last_undegraded":"2024-04-25T22:51:54.053150+0000","last_fullsized":"2024-04-25T22:51:54.053150+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:12:08.770479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017399+0000","last_change":"2024-04-25T22:51:52.019690+0000","last_active":"2024-04-25T22:51:54.017399+0000","last_peered":"2024-04-25T22:51:54.017399+0000","last_clean":"2024-04-25T22:51:54.017399+0000","last_became_active":"2024-04-25T22:51:52.018818+0000","last_became_peered":"2024-04-25T22:51:52.018818+0000","last_unstale":"2024-04-25T22:51:54.017399+0000","last_undegraded":"2024-04-25T22:51:54.017399+0000","last_fullsized":"2024-04-25T22:51:54.017399+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:25:48.361495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018267+0000","last_change":"2024-04-25T22:51:53.023197+0000","last_active":"2024-04-25T22:51:54.018267+0000","last_peered":"2024-04-25T22:51:54.018267+0000","last_clean":"2024-04-25T22:51:54.018267+0000","last_became_active":"2024-04-25T22:51:53.022627+0000","last_became_peered":"2024-04-25T22:51:53.022627+0000","last_unstale":"2024-04-25T22:51:54.018267+0000","last_undegraded":"2024-04-25T22:51:54.018267+0000","last_fullsized":"2024-04-25T22:51:54.018267+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:44:59.401139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052236+0000","last_change":"2024-04-25T22:51:52.018646+0000","last_active":"2024-04-25T22:51:54.052236+0000","last_peered":"2024-04-25T22:51:54.052236+0000","last_clean":"2024-04-25T22:51:54.052236+0000","last_became_active":"2024-04-25T22:51:52.018313+0000","last_became_peered":"2024-04-25T22:51:52.018313+0000","last_unstale":"2024-04-25T22:51:54.052236+0000","last_undegraded":"2024-04-25T22:51:54.052236+0000","last_fullsized":"2024-04-25T22:51:54.052236+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:00:21.688745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018104+0000","last_change":"2024-04-25T22:51:53.022419+0000","last_active":"2024-04-25T22:51:54.018104+0000","last_peered":"2024-04-25T22:51:54.018104+0000","last_clean":"2024-04-25T22:51:54.018104+0000","last_became_active":"2024-04-25T22:51:53.021405+0000","last_became_peered":"2024-04-25T22:51:53.021405+0000","last_unstale":"2024-04-25T22:51:54.018104+0000","last_undegraded":"2024-04-25T22:51:54.018104+0000","last_fullsized":"2024-04-25T22:51:54.018104+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:28:42.903045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":22,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017441+0000","last_change":"2024-04-25T22:51:52.021510+0000","last_active":"2024-04-25T22:51:54.017441+0000","last_peered":"2024-04-25T22:51:54.017441+0000","last_clean":"2024-04-25T22:51:54.017441+0000","last_became_active":"2024-04-25T22:51:52.021145+0000","last_became_peered":"2024-04-25T22:51:52.021145+0000","last_unstale":"2024-04-25T22:51:54.017441+0000","last_undegraded":"2024-04-25T22:51:54.017441+0000","last_fullsized":"2024-04-25T22:51:54.017441+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:05.110747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018420+0000","last_change":"2024-04-25T22:51:52.021355+0000","last_active":"2024-04-25T22:51:54.018420+0000","last_peered":"2024-04-25T22:51:54.018420+0000","last_clean":"2024-04-25T22:51:54.018420+0000","last_became_active":"2024-04-25T22:51:52.020860+0000","last_became_peered":"2024-04-25T22:51:52.020860+0000","last_unstale":"2024-04-25T22:51:54.018420+0000","last_undegraded":"2024-04-25T22:51:54.018420+0000","last_fullsized":"2024-04-25T22:51:54.018420+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:55.235787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.051967+0000","last_change":"2024-04-25T22:51:53.029390+0000","last_active":"2024-04-25T22:51:54.051967+0000","last_peered":"2024-04-25T22:51:54.051967+0000","last_clean":"2024-04-25T22:51:54.051967+0000","last_became_active":"2024-04-25T22:51:53.029157+0000","last_became_peered":"2024-04-25T22:51:53.029157+0000","last_unstale":"2024-04-25T22:51:54.051967+0000","last_undegraded":"2024-04-25T22:51:54.051967+0000","last_fullsized":"2024-04-25T22:51:54.051967+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:51:43.808994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053167+0000","last_change":"2024-04-25T22:51:52.018856+0000","last_active":"2024-04-25T22:51:54.053167+0000","last_peered":"2024-04-25T22:51:54.053167+0000","last_clean":"2024-04-25T22:51:54.053167+0000","last_became_active":"2024-04-25T22:51:52.018390+0000","last_became_peered":"2024-04-25T22:51:52.018390+0000","last_unstale":"2024-04-25T22:51:54.053167+0000","last_undegraded":"2024-04-25T22:51:54.053167+0000","last_fullsized":"2024-04-25T22:51:54.053167+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:42:54.430484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052143+0000","last_change":"2024-04-25T22:51:53.024599+0000","last_active":"2024-04-25T22:51:54.052143+0000","last_peered":"2024-04-25T22:51:54.052143+0000","last_clean":"2024-04-25T22:51:54.052143+0000","last_became_active":"2024-04-25T22:51:53.024155+0000","last_became_peered":"2024-04-25T22:51:53.024155+0000","last_unstale":"2024-04-25T22:51:54.052143+0000","last_undegraded":"2024-04-25T22:51:54.052143+0000","last_fullsized":"2024-04-25T22:51:54.052143+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:09:52.869451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018756+0000","last_change":"2024-04-25T22:51:52.019724+0000","last_active":"2024-04-25T22:51:54.018756+0000","last_peered":"2024-04-25T22:51:54.018756+0000","last_clean":"2024-04-25T22:51:54.018756+0000","last_became_active":"2024-04-25T22:51:52.019167+0000","last_became_peered":"2024-04-25T22:51:52.019167+0000","last_unstale":"2024-04-25T22:51:54.018756+0000","last_undegraded":"2024-04-25T22:51:54.018756+0000","last_fullsized":"2024-04-25T22:51:54.018756+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:03:14.826593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017804+0000","last_change":"2024-04-25T22:51:53.017327+0000","last_active":"2024-04-25T22:51:54.017804+0000","last_peered":"2024-04-25T22:51:54.017804+0000","last_clean":"2024-04-25T22:51:54.017804+0000","last_became_active":"2024-04-25T22:51:53.015987+0000","last_became_peered":"2024-04-25T22:51:53.015987+0000","last_unstale":"2024-04-25T22:51:54.017804+0000","last_undegraded":"2024-04-25T22:51:54.017804+0000","last_fullsized":"2024-04-25T22:51:54.017804+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:16.602188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018741+0000","last_change":"2024-04-25T22:51:52.016151+0000","last_active":"2024-04-25T22:51:54.018741+0000","last_peered":"2024-04-25T22:51:54.018741+0000","last_clean":"2024-04-25T22:51:54.018741+0000","last_became_active":"2024-04-25T22:51:52.015741+0000","last_became_peered":"2024-04-25T22:51:52.015741+0000","last_unstale":"2024-04-25T22:51:54.018741+0000","last_undegraded":"2024-04-25T22:51:54.018741+0000","last_fullsized":"2024-04-25T22:51:54.018741+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:02:25.133948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018157+0000","last_change":"2024-04-25T22:51:53.021208+0000","last_active":"2024-04-25T22:51:54.018157+0000","last_peered":"2024-04-25T22:51:54.018157+0000","last_clean":"2024-04-25T22:51:54.018157+0000","last_became_active":"2024-04-25T22:51:53.020752+0000","last_became_peered":"2024-04-25T22:51:53.020752+0000","last_unstale":"2024-04-25T22:51:54.018157+0000","last_undegraded":"2024-04-25T22:51:54.018157+0000","last_fullsized":"2024-04-25T22:51:54.018157+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:16.602188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017996+0000","last_change":"2024-04-25T22:51:52.018716+0000","last_active":"2024-04-25T22:51:54.017996+0000","last_peered":"2024-04-25T22:51:54.017996+0000","last_clean":"2024-04-25T22:51:54.017996+0000","last_became_active":"2024-04-25T22:51:52.018140+0000","last_became_peered":"2024-04-25T22:51:52.018140+0000","last_unstale":"2024-04-25T22:51:54.017996+0000","last_undegraded":"2024-04-25T22:51:54.017996+0000","last_fullsized":"2024-04-25T22:51:54.017996+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:02:25.133948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018609+0000","last_change":"2024-04-25T22:51:53.019508+0000","last_active":"2024-04-25T22:51:54.018609+0000","last_peered":"2024-04-25T22:51:54.018609+0000","last_clean":"2024-04-25T22:51:54.018609+0000","last_became_active":"2024-04-25T22:51:53.016749+0000","last_became_peered":"2024-04-25T22:51:53.016749+0000","last_unstale":"2024-04-25T22:51:54.018609+0000","last_undegraded":"2024-04-25T22:51:54.018609+0000","last_fullsized":"2024-04-25T22:51:54.018609+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:25.110416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018342+0000","last_change":"2024-04-25T22:51:52.022474+0000","last_active":"2024-04-25T22:51:54.018342+0000","last_peered":"2024-04-25T22:51:54.018342+0000","last_clean":"2024-04-25T22:51:54.018342+0000","last_became_active":"2024-04-25T22:51:52.022141+0000","last_became_peered":"2024-04-25T22:51:52.022141+0000","last_unstale":"2024-04-25T22:51:54.018342+0000","last_undegraded":"2024-04-25T22:51:54.018342+0000","last_fullsized":"2024-04-25T22:51:54.018342+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:17:10.500338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018670+0000","last_change":"2024-04-25T22:51:53.023929+0000","last_active":"2024-04-25T22:51:54.018670+0000","last_peered":"2024-04-25T22:51:54.018670+0000","last_clean":"2024-04-25T22:51:54.018670+0000","last_became_active":"2024-04-25T22:51:53.023405+0000","last_became_peered":"2024-04-25T22:51:53.023405+0000","last_unstale":"2024-04-25T22:51:54.018670+0000","last_undegraded":"2024-04-25T22:51:54.018670+0000","last_fullsized":"2024-04-25T22:51:54.018670+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:35:35.419823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052331+0000","last_change":"2024-04-25T22:51:52.018970+0000","last_active":"2024-04-25T22:51:54.052331+0000","last_peered":"2024-04-25T22:51:54.052331+0000","last_clean":"2024-04-25T22:51:54.052331+0000","last_became_active":"2024-04-25T22:51:52.018439+0000","last_became_peered":"2024-04-25T22:51:52.018439+0000","last_unstale":"2024-04-25T22:51:54.052331+0000","last_undegraded":"2024-04-25T22:51:54.052331+0000","last_fullsized":"2024-04-25T22:51:54.052331+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:24:31.748243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018219+0000","last_change":"2024-04-25T22:51:53.020574+0000","last_active":"2024-04-25T22:51:54.018219+0000","last_peered":"2024-04-25T22:51:54.018219+0000","last_clean":"2024-04-25T22:51:54.018219+0000","last_became_active":"2024-04-25T22:51:53.019978+0000","last_became_peered":"2024-04-25T22:51:53.019978+0000","last_unstale":"2024-04-25T22:51:54.018219+0000","last_undegraded":"2024-04-25T22:51:54.018219+0000","last_fullsized":"2024-04-25T22:51:54.018219+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:41.205051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052156+0000","last_change":"2024-04-25T22:51:52.017743+0000","last_active":"2024-04-25T22:51:54.052156+0000","last_peered":"2024-04-25T22:51:54.052156+0000","last_clean":"2024-04-25T22:51:54.052156+0000","last_became_active":"2024-04-25T22:51:52.016659+0000","last_became_peered":"2024-04-25T22:51:52.016659+0000","last_unstale":"2024-04-25T22:51:54.052156+0000","last_undegraded":"2024-04-25T22:51:54.052156+0000","last_fullsized":"2024-04-25T22:51:54.052156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:49:07.912197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018170+0000","last_change":"2024-04-25T22:51:53.023278+0000","last_active":"2024-04-25T22:51:54.018170+0000","last_peered":"2024-04-25T22:51:54.018170+0000","last_clean":"2024-04-25T22:51:54.018170+0000","last_became_active":"2024-04-25T22:51:53.021948+0000","last_became_peered":"2024-04-25T22:51:53.021948+0000","last_unstale":"2024-04-25T22:51:54.018170+0000","last_undegraded":"2024-04-25T22:51:54.018170+0000","last_fullsized":"2024-04-25T22:51:54.018170+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:22.231993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":216,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017807+0000","last_change":"2024-04-25T22:51:47.764624+0000","last_active":"2024-04-25T22:51:54.017807+0000","last_peered":"2024-04-25T22:51:54.017807+0000","last_clean":"2024-04-25T22:51:54.017807+0000","last_became_active":"2024-04-25T22:51:47.764176+0000","last_became_peered":"2024-04-25T22:51:47.764176+0000","last_unstale":"2024-04-25T22:51:54.017807+0000","last_undegraded":"2024-04-25T22:51:54.017807+0000","last_fullsized":"2024-04-25T22:51:54.017807+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:59:39.005489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018697+0000","last_change":"2024-04-25T22:51:47.768368+0000","last_active":"2024-04-25T22:51:54.018697+0000","last_peered":"2024-04-25T22:51:54.018697+0000","last_clean":"2024-04-25T22:51:54.018697+0000","last_became_active":"2024-04-25T22:51:47.768003+0000","last_became_peered":"2024-04-25T22:51:47.768003+0000","last_unstale":"2024-04-25T22:51:54.018697+0000","last_undegraded":"2024-04-25T22:51:54.018697+0000","last_fullsized":"2024-04-25T22:51:54.018697+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:10:00.098072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017829+0000","last_change":"2024-04-25T22:51:52.014376+0000","last_active":"2024-04-25T22:51:54.017829+0000","last_peered":"2024-04-25T22:51:54.017829+0000","last_clean":"2024-04-25T22:51:54.017829+0000","last_became_active":"2024-04-25T22:51:52.013816+0000","last_became_peered":"2024-04-25T22:51:52.013816+0000","last_unstale":"2024-04-25T22:51:54.017829+0000","last_undegraded":"2024-04-25T22:51:54.017829+0000","last_fullsized":"2024-04-25T22:51:54.017829+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:18.136883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018819+0000","last_change":"2024-04-25T22:51:53.024106+0000","last_active":"2024-04-25T22:51:54.018819+0000","last_peered":"2024-04-25T22:51:54.018819+0000","last_clean":"2024-04-25T22:51:54.018819+0000","last_became_active":"2024-04-25T22:51:53.023497+0000","last_became_peered":"2024-04-25T22:51:53.023497+0000","last_unstale":"2024-04-25T22:51:54.018819+0000","last_undegraded":"2024-04-25T22:51:54.018819+0000","last_fullsized":"2024-04-25T22:51:54.018819+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:52:16.918935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017591+0000","last_change":"2024-04-25T22:51:47.764591+0000","last_active":"2024-04-25T22:51:54.017591+0000","last_peered":"2024-04-25T22:51:54.017591+0000","last_clean":"2024-04-25T22:51:54.017591+0000","last_became_active":"2024-04-25T22:51:47.764229+0000","last_became_peered":"2024-04-25T22:51:47.764229+0000","last_unstale":"2024-04-25T22:51:54.017591+0000","last_undegraded":"2024-04-25T22:51:54.017591+0000","last_fullsized":"2024-04-25T22:51:54.017591+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:32.854624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017358+0000","last_change":"2024-04-25T22:51:52.017918+0000","last_active":"2024-04-25T22:51:54.017358+0000","last_peered":"2024-04-25T22:51:54.017358+0000","last_clean":"2024-04-25T22:51:54.017358+0000","last_became_active":"2024-04-25T22:51:52.017541+0000","last_became_peered":"2024-04-25T22:51:52.017541+0000","last_unstale":"2024-04-25T22:51:54.017358+0000","last_undegraded":"2024-04-25T22:51:54.017358+0000","last_fullsized":"2024-04-25T22:51:54.017358+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:17:10.500338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052996+0000","last_change":"2024-04-25T22:51:53.026971+0000","last_active":"2024-04-25T22:51:54.052996+0000","last_peered":"2024-04-25T22:51:54.052996+0000","last_clean":"2024-04-25T22:51:54.052996+0000","last_became_active":"2024-04-25T22:51:53.026355+0000","last_became_peered":"2024-04-25T22:51:53.026355+0000","last_unstale":"2024-04-25T22:51:54.052996+0000","last_undegraded":"2024-04-25T22:51:54.052996+0000","last_fullsized":"2024-04-25T22:51:54.052996+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:16.602188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017440+0000","last_change":"2024-04-25T22:51:47.762564+0000","last_active":"2024-04-25T22:51:54.017440+0000","last_peered":"2024-04-25T22:51:54.017440+0000","last_clean":"2024-04-25T22:51:54.017440+0000","last_became_active":"2024-04-25T22:51:47.762218+0000","last_became_peered":"2024-04-25T22:51:47.762218+0000","last_unstale":"2024-04-25T22:51:54.017440+0000","last_undegraded":"2024-04-25T22:51:54.017440+0000","last_fullsized":"2024-04-25T22:51:54.017440+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:09:06.117740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052192+0000","last_change":"2024-04-25T22:51:52.018873+0000","last_active":"2024-04-25T22:51:54.052192+0000","last_peered":"2024-04-25T22:51:54.052192+0000","last_clean":"2024-04-25T22:51:54.052192+0000","last_became_active":"2024-04-25T22:51:52.018300+0000","last_became_peered":"2024-04-25T22:51:52.018300+0000","last_unstale":"2024-04-25T22:51:54.052192+0000","last_undegraded":"2024-04-25T22:51:54.052192+0000","last_fullsized":"2024-04-25T22:51:54.052192+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:25:22.660789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018295+0000","last_change":"2024-04-25T22:51:53.023461+0000","last_active":"2024-04-25T22:51:54.018295+0000","last_peered":"2024-04-25T22:51:54.018295+0000","last_clean":"2024-04-25T22:51:54.018295+0000","last_became_active":"2024-04-25T22:51:53.022017+0000","last_became_peered":"2024-04-25T22:51:53.022017+0000","last_unstale":"2024-04-25T22:51:54.018295+0000","last_undegraded":"2024-04-25T22:51:54.018295+0000","last_fullsized":"2024-04-25T22:51:54.018295+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:43:47.453569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018255+0000","last_change":"2024-04-25T22:51:47.768269+0000","last_active":"2024-04-25T22:51:54.018255+0000","last_peered":"2024-04-25T22:51:54.018255+0000","last_clean":"2024-04-25T22:51:54.018255+0000","last_became_active":"2024-04-25T22:51:47.767991+0000","last_became_peered":"2024-04-25T22:51:47.767991+0000","last_unstale":"2024-04-25T22:51:54.018255+0000","last_undegraded":"2024-04-25T22:51:54.018255+0000","last_fullsized":"2024-04-25T22:51:54.018255+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:01:54.134289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018678+0000","last_change":"2024-04-25T22:51:52.021220+0000","last_active":"2024-04-25T22:51:54.018678+0000","last_peered":"2024-04-25T22:51:54.018678+0000","last_clean":"2024-04-25T22:51:54.018678+0000","last_became_active":"2024-04-25T22:51:52.020833+0000","last_became_peered":"2024-04-25T22:51:52.020833+0000","last_unstale":"2024-04-25T22:51:54.018678+0000","last_undegraded":"2024-04-25T22:51:54.018678+0000","last_fullsized":"2024-04-25T22:51:54.018678+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:12.627716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018128+0000","last_change":"2024-04-25T22:51:53.020666+0000","last_active":"2024-04-25T22:51:54.018128+0000","last_peered":"2024-04-25T22:51:54.018128+0000","last_clean":"2024-04-25T22:51:54.018128+0000","last_became_active":"2024-04-25T22:51:53.020212+0000","last_became_peered":"2024-04-25T22:51:53.020212+0000","last_unstale":"2024-04-25T22:51:54.018128+0000","last_undegraded":"2024-04-25T22:51:54.018128+0000","last_fullsized":"2024-04-25T22:51:54.018128+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:12:08.770479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018823+0000","last_change":"2024-04-25T22:51:52.016362+0000","last_active":"2024-04-25T22:51:54.018823+0000","last_peered":"2024-04-25T22:51:54.018823+0000","last_clean":"2024-04-25T22:51:54.018823+0000","last_became_active":"2024-04-25T22:51:52.015409+0000","last_became_peered":"2024-04-25T22:51:52.015409+0000","last_unstale":"2024-04-25T22:51:54.018823+0000","last_undegraded":"2024-04-25T22:51:54.018823+0000","last_fullsized":"2024-04-25T22:51:54.018823+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:21:19.563620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018072+0000","last_change":"2024-04-25T22:51:47.761131+0000","last_active":"2024-04-25T22:51:54.018072+0000","last_peered":"2024-04-25T22:51:54.018072+0000","last_clean":"2024-04-25T22:51:54.018072+0000","last_became_active":"2024-04-25T22:51:47.760894+0000","last_became_peered":"2024-04-25T22:51:47.760894+0000","last_unstale":"2024-04-25T22:51:54.018072+0000","last_undegraded":"2024-04-25T22:51:54.018072+0000","last_fullsized":"2024-04-25T22:51:54.018072+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:38:28.554024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052447+0000","last_change":"2024-04-25T22:51:53.026321+0000","last_active":"2024-04-25T22:51:54.052447+0000","last_peered":"2024-04-25T22:51:54.052447+0000","last_clean":"2024-04-25T22:51:54.052447+0000","last_became_active":"2024-04-25T22:51:53.025824+0000","last_became_peered":"2024-04-25T22:51:53.025824+0000","last_unstale":"2024-04-25T22:51:54.052447+0000","last_undegraded":"2024-04-25T22:51:54.052447+0000","last_fullsized":"2024-04-25T22:51:54.052447+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:12:00.793718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017995+0000","last_change":"2024-04-25T22:51:52.015638+0000","last_active":"2024-04-25T22:51:54.017995+0000","last_peered":"2024-04-25T22:51:54.017995+0000","last_clean":"2024-04-25T22:51:54.017995+0000","last_became_active":"2024-04-25T22:51:52.014858+0000","last_became_peered":"2024-04-25T22:51:52.014858+0000","last_unstale":"2024-04-25T22:51:54.017995+0000","last_undegraded":"2024-04-25T22:51:54.017995+0000","last_fullsized":"2024-04-25T22:51:54.017995+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:44:34.159650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053349+0000","last_change":"2024-04-25T22:51:47.765532+0000","last_active":"2024-04-25T22:51:54.053349+0000","last_peered":"2024-04-25T22:51:54.053349+0000","last_clean":"2024-04-25T22:51:54.053349+0000","last_became_active":"2024-04-25T22:51:47.765247+0000","last_became_peered":"2024-04-25T22:51:47.765247+0000","last_unstale":"2024-04-25T22:51:54.053349+0000","last_undegraded":"2024-04-25T22:51:54.053349+0000","last_fullsized":"2024-04-25T22:51:54.053349+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:55:05.342938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052632+0000","last_change":"2024-04-25T22:51:53.027051+0000","last_active":"2024-04-25T22:51:54.052632+0000","last_peered":"2024-04-25T22:51:54.052632+0000","last_clean":"2024-04-25T22:51:54.052632+0000","last_became_active":"2024-04-25T22:51:53.026458+0000","last_became_peered":"2024-04-25T22:51:53.026458+0000","last_unstale":"2024-04-25T22:51:54.052632+0000","last_undegraded":"2024-04-25T22:51:54.052632+0000","last_fullsized":"2024-04-25T22:51:54.052632+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:11:09.179564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018550+0000","last_change":"2024-04-25T22:51:52.015635+0000","last_active":"2024-04-25T22:51:54.018550+0000","last_peered":"2024-04-25T22:51:54.018550+0000","last_clean":"2024-04-25T22:51:54.018550+0000","last_became_active":"2024-04-25T22:51:52.014778+0000","last_became_peered":"2024-04-25T22:51:52.014778+0000","last_unstale":"2024-04-25T22:51:54.018550+0000","last_undegraded":"2024-04-25T22:51:54.018550+0000","last_fullsized":"2024-04-25T22:51:54.018550+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:21:19.563620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018314+0000","last_change":"2024-04-25T22:51:47.762468+0000","last_active":"2024-04-25T22:51:54.018314+0000","last_peered":"2024-04-25T22:51:54.018314+0000","last_clean":"2024-04-25T22:51:54.018314+0000","last_became_active":"2024-04-25T22:51:47.762199+0000","last_became_peered":"2024-04-25T22:51:47.762199+0000","last_unstale":"2024-04-25T22:51:54.018314+0000","last_undegraded":"2024-04-25T22:51:54.018314+0000","last_fullsized":"2024-04-25T22:51:54.018314+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:32.854624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017184+0000","last_change":"2024-04-25T22:51:53.023317+0000","last_active":"2024-04-25T22:51:54.017184+0000","last_peered":"2024-04-25T22:51:54.017184+0000","last_clean":"2024-04-25T22:51:54.017184+0000","last_became_active":"2024-04-25T22:51:53.022756+0000","last_became_peered":"2024-04-25T22:51:53.022756+0000","last_unstale":"2024-04-25T22:51:54.017184+0000","last_undegraded":"2024-04-25T22:51:54.017184+0000","last_fullsized":"2024-04-25T22:51:54.017184+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:37:13.419317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:55.011718+0000","last_change":"2024-04-25T22:51:52.017845+0000","last_active":"2024-04-25T22:51:55.011718+0000","last_peered":"2024-04-25T22:51:55.011718+0000","last_clean":"2024-04-25T22:51:55.011718+0000","last_became_active":"2024-04-25T22:51:52.017521+0000","last_became_peered":"2024-04-25T22:51:52.017521+0000","last_unstale":"2024-04-25T22:51:55.011718+0000","last_undegraded":"2024-04-25T22:51:55.011718+0000","last_fullsized":"2024-04-25T22:51:55.011718+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:18:00.975479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018392+0000","last_change":"2024-04-25T22:51:47.764288+0000","last_active":"2024-04-25T22:51:54.018392+0000","last_peered":"2024-04-25T22:51:54.018392+0000","last_clean":"2024-04-25T22:51:54.018392+0000","last_became_active":"2024-04-25T22:51:47.763961+0000","last_became_peered":"2024-04-25T22:51:47.763961+0000","last_unstale":"2024-04-25T22:51:54.018392+0000","last_undegraded":"2024-04-25T22:51:54.018392+0000","last_fullsized":"2024-04-25T22:51:54.018392+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:03:07.164842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052084+0000","last_change":"2024-04-25T22:51:53.026925+0000","last_active":"2024-04-25T22:51:54.052084+0000","last_peered":"2024-04-25T22:51:54.052084+0000","last_clean":"2024-04-25T22:51:54.052084+0000","last_became_active":"2024-04-25T22:51:53.026419+0000","last_became_peered":"2024-04-25T22:51:53.026419+0000","last_unstale":"2024-04-25T22:51:54.052084+0000","last_undegraded":"2024-04-25T22:51:54.052084+0000","last_fullsized":"2024-04-25T22:51:54.052084+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:49:38.102060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018559+0000","last_change":"2024-04-25T22:51:53.022222+0000","last_active":"2024-04-25T22:51:54.018559+0000","last_peered":"2024-04-25T22:51:54.018559+0000","last_clean":"2024-04-25T22:51:54.018559+0000","last_became_active":"2024-04-25T22:51:53.021687+0000","last_became_peered":"2024-04-25T22:51:53.021687+0000","last_unstale":"2024-04-25T22:51:54.018559+0000","last_undegraded":"2024-04-25T22:51:54.018559+0000","last_fullsized":"2024-04-25T22:51:54.018559+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:35:06.234402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018650+0000","last_change":"2024-04-25T22:51:52.019928+0000","last_active":"2024-04-25T22:51:54.018650+0000","last_peered":"2024-04-25T22:51:54.018650+0000","last_clean":"2024-04-25T22:51:54.018650+0000","last_became_active":"2024-04-25T22:51:52.019264+0000","last_became_peered":"2024-04-25T22:51:52.019264+0000","last_unstale":"2024-04-25T22:51:54.018650+0000","last_undegraded":"2024-04-25T22:51:54.018650+0000","last_fullsized":"2024-04-25T22:51:54.018650+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:18.136883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017393+0000","last_change":"2024-04-25T22:51:53.020652+0000","last_active":"2024-04-25T22:51:54.017393+0000","last_peered":"2024-04-25T22:51:54.017393+0000","last_clean":"2024-04-25T22:51:54.017393+0000","last_became_active":"2024-04-25T22:51:53.020129+0000","last_became_peered":"2024-04-25T22:51:53.020129+0000","last_unstale":"2024-04-25T22:51:54.017393+0000","last_undegraded":"2024-04-25T22:51:54.017393+0000","last_fullsized":"2024-04-25T22:51:54.017393+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:18:31.139968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053289+0000","last_change":"2024-04-25T22:51:52.018977+0000","last_active":"2024-04-25T22:51:54.053289+0000","last_peered":"2024-04-25T22:51:54.053289+0000","last_clean":"2024-04-25T22:51:54.053289+0000","last_became_active":"2024-04-25T22:51:52.018519+0000","last_became_peered":"2024-04-25T22:51:52.018519+0000","last_unstale":"2024-04-25T22:51:54.053289+0000","last_undegraded":"2024-04-25T22:51:54.053289+0000","last_fullsized":"2024-04-25T22:51:54.053289+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:53:07.306148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018416+0000","last_change":"2024-04-25T22:51:52.022177+0000","last_active":"2024-04-25T22:51:54.018416+0000","last_peered":"2024-04-25T22:51:54.018416+0000","last_clean":"2024-04-25T22:51:54.018416+0000","last_became_active":"2024-04-25T22:51:52.021882+0000","last_became_peered":"2024-04-25T22:51:52.021882+0000","last_unstale":"2024-04-25T22:51:54.018416+0000","last_undegraded":"2024-04-25T22:51:54.018416+0000","last_fullsized":"2024-04-25T22:51:54.018416+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:44:34.159650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017107+0000","last_change":"2024-04-25T22:51:53.022499+0000","last_active":"2024-04-25T22:51:54.017107+0000","last_peered":"2024-04-25T22:51:54.017107+0000","last_clean":"2024-04-25T22:51:54.017107+0000","last_became_active":"2024-04-25T22:51:53.022018+0000","last_became_peered":"2024-04-25T22:51:53.022018+0000","last_unstale":"2024-04-25T22:51:54.017107+0000","last_undegraded":"2024-04-25T22:51:54.017107+0000","last_fullsized":"2024-04-25T22:51:54.017107+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:33:24.700106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018441+0000","last_change":"2024-04-25T22:51:52.019673+0000","last_active":"2024-04-25T22:51:54.018441+0000","last_peered":"2024-04-25T22:51:54.018441+0000","last_clean":"2024-04-25T22:51:54.018441+0000","last_became_active":"2024-04-25T22:51:52.018877+0000","last_became_peered":"2024-04-25T22:51:52.018877+0000","last_unstale":"2024-04-25T22:51:54.018441+0000","last_undegraded":"2024-04-25T22:51:54.018441+0000","last_fullsized":"2024-04-25T22:51:54.018441+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:05.110747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017316+0000","last_change":"2024-04-25T22:51:53.020927+0000","last_active":"2024-04-25T22:51:54.017316+0000","last_peered":"2024-04-25T22:51:54.017316+0000","last_clean":"2024-04-25T22:51:54.017316+0000","last_became_active":"2024-04-25T22:51:53.020366+0000","last_became_peered":"2024-04-25T22:51:53.020366+0000","last_unstale":"2024-04-25T22:51:54.017316+0000","last_undegraded":"2024-04-25T22:51:54.017316+0000","last_fullsized":"2024-04-25T22:51:54.017316+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:55:27.934567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053387+0000","last_change":"2024-04-25T22:51:53.029210+0000","last_active":"2024-04-25T22:51:54.053387+0000","last_peered":"2024-04-25T22:51:54.053387+0000","last_clean":"2024-04-25T22:51:54.053387+0000","last_became_active":"2024-04-25T22:51:53.028635+0000","last_became_peered":"2024-04-25T22:51:53.028635+0000","last_unstale":"2024-04-25T22:51:54.053387+0000","last_undegraded":"2024-04-25T22:51:54.053387+0000","last_fullsized":"2024-04-25T22:51:54.053387+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:41.205051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017373+0000","last_change":"2024-04-25T22:51:52.014897+0000","last_active":"2024-04-25T22:51:54.017373+0000","last_peered":"2024-04-25T22:51:54.017373+0000","last_clean":"2024-04-25T22:51:54.017373+0000","last_became_active":"2024-04-25T22:51:52.014344+0000","last_became_peered":"2024-04-25T22:51:52.014344+0000","last_unstale":"2024-04-25T22:51:54.017373+0000","last_undegraded":"2024-04-25T22:51:54.017373+0000","last_fullsized":"2024-04-25T22:51:54.017373+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:55.235787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018063+0000","last_change":"2024-04-25T22:51:53.022920+0000","last_active":"2024-04-25T22:51:54.018063+0000","last_peered":"2024-04-25T22:51:54.018063+0000","last_clean":"2024-04-25T22:51:54.018063+0000","last_became_active":"2024-04-25T22:51:53.022190+0000","last_became_peered":"2024-04-25T22:51:53.022190+0000","last_unstale":"2024-04-25T22:51:54.018063+0000","last_undegraded":"2024-04-25T22:51:54.018063+0000","last_fullsized":"2024-04-25T22:51:54.018063+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:16.187194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017261+0000","last_change":"2024-04-25T22:51:52.018371+0000","last_active":"2024-04-25T22:51:54.017261+0000","last_peered":"2024-04-25T22:51:54.017261+0000","last_clean":"2024-04-25T22:51:54.017261+0000","last_became_active":"2024-04-25T22:51:52.018027+0000","last_became_peered":"2024-04-25T22:51:52.018027+0000","last_unstale":"2024-04-25T22:51:54.017261+0000","last_undegraded":"2024-04-25T22:51:54.017261+0000","last_fullsized":"2024-04-25T22:51:54.017261+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:36:57.435877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052965+0000","last_change":"2024-04-25T22:51:53.028084+0000","last_active":"2024-04-25T22:51:54.052965+0000","last_peered":"2024-04-25T22:51:54.052965+0000","last_clean":"2024-04-25T22:51:54.052965+0000","last_became_active":"2024-04-25T22:51:53.027541+0000","last_became_peered":"2024-04-25T22:51:53.027541+0000","last_unstale":"2024-04-25T22:51:54.052965+0000","last_undegraded":"2024-04-25T22:51:54.052965+0000","last_fullsized":"2024-04-25T22:51:54.052965+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:28:42.903045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052565+0000","last_change":"2024-04-25T22:51:52.017006+0000","last_active":"2024-04-25T22:51:54.052565+0000","last_peered":"2024-04-25T22:51:54.052565+0000","last_clean":"2024-04-25T22:51:54.052565+0000","last_became_active":"2024-04-25T22:51:52.016667+0000","last_became_peered":"2024-04-25T22:51:52.016667+0000","last_unstale":"2024-04-25T22:51:54.052565+0000","last_undegraded":"2024-04-25T22:51:54.052565+0000","last_fullsized":"2024-04-25T22:51:54.052565+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:24:51.210288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052731+0000","last_change":"2024-04-25T22:51:53.024685+0000","last_active":"2024-04-25T22:51:54.052731+0000","last_peered":"2024-04-25T22:51:54.052731+0000","last_clean":"2024-04-25T22:51:54.052731+0000","last_became_active":"2024-04-25T22:51:53.024304+0000","last_became_peered":"2024-04-25T22:51:53.024304+0000","last_unstale":"2024-04-25T22:51:54.052731+0000","last_undegraded":"2024-04-25T22:51:54.052731+0000","last_fullsized":"2024-04-25T22:51:54.052731+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:18:31.139968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052731+0000","last_change":"2024-04-25T22:51:52.018973+0000","last_active":"2024-04-25T22:51:54.052731+0000","last_peered":"2024-04-25T22:51:54.052731+0000","last_clean":"2024-04-25T22:51:54.052731+0000","last_became_active":"2024-04-25T22:51:52.018503+0000","last_became_peered":"2024-04-25T22:51:52.018503+0000","last_unstale":"2024-04-25T22:51:54.052731+0000","last_undegraded":"2024-04-25T22:51:54.052731+0000","last_fullsized":"2024-04-25T22:51:54.052731+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:07:38.783124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017918+0000","last_change":"2024-04-25T22:51:53.018063+0000","last_active":"2024-04-25T22:51:54.017918+0000","last_peered":"2024-04-25T22:51:54.017918+0000","last_clean":"2024-04-25T22:51:54.017918+0000","last_became_active":"2024-04-25T22:51:53.016779+0000","last_became_peered":"2024-04-25T22:51:53.016779+0000","last_unstale":"2024-04-25T22:51:54.017918+0000","last_undegraded":"2024-04-25T22:51:54.017918+0000","last_fullsized":"2024-04-25T22:51:54.017918+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:58:11.470631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018527+0000","last_change":"2024-04-25T22:51:52.022209+0000","last_active":"2024-04-25T22:51:54.018527+0000","last_peered":"2024-04-25T22:51:54.018527+0000","last_clean":"2024-04-25T22:51:54.018527+0000","last_became_active":"2024-04-25T22:51:52.021868+0000","last_became_peered":"2024-04-25T22:51:52.021868+0000","last_unstale":"2024-04-25T22:51:54.018527+0000","last_undegraded":"2024-04-25T22:51:54.018527+0000","last_fullsized":"2024-04-25T22:51:54.018527+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:36:57.435877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018070+0000","last_change":"2024-04-25T22:51:53.017222+0000","last_active":"2024-04-25T22:51:54.018070+0000","last_peered":"2024-04-25T22:51:54.018070+0000","last_clean":"2024-04-25T22:51:54.018070+0000","last_became_active":"2024-04-25T22:51:53.015717+0000","last_became_peered":"2024-04-25T22:51:53.015717+0000","last_unstale":"2024-04-25T22:51:54.018070+0000","last_undegraded":"2024-04-25T22:51:54.018070+0000","last_fullsized":"2024-04-25T22:51:54.018070+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:43:47.453569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053098+0000","last_change":"2024-04-25T22:51:52.019032+0000","last_active":"2024-04-25T22:51:54.053098+0000","last_peered":"2024-04-25T22:51:54.053098+0000","last_clean":"2024-04-25T22:51:54.053098+0000","last_became_active":"2024-04-25T22:51:52.018547+0000","last_became_peered":"2024-04-25T22:51:52.018547+0000","last_unstale":"2024-04-25T22:51:54.053098+0000","last_undegraded":"2024-04-25T22:51:54.053098+0000","last_fullsized":"2024-04-25T22:51:54.053098+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:10:00.056491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052619+0000","last_change":"2024-04-25T22:51:53.024597+0000","last_active":"2024-04-25T22:51:54.052619+0000","last_peered":"2024-04-25T22:51:54.052619+0000","last_clean":"2024-04-25T22:51:54.052619+0000","last_became_active":"2024-04-25T22:51:53.024256+0000","last_became_peered":"2024-04-25T22:51:53.024256+0000","last_unstale":"2024-04-25T22:51:54.052619+0000","last_undegraded":"2024-04-25T22:51:54.052619+0000","last_fullsized":"2024-04-25T22:51:54.052619+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:55:27.934567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018241+0000","last_change":"2024-04-25T22:51:52.015581+0000","last_active":"2024-04-25T22:51:54.018241+0000","last_peered":"2024-04-25T22:51:54.018241+0000","last_clean":"2024-04-25T22:51:54.018241+0000","last_became_active":"2024-04-25T22:51:52.014530+0000","last_became_peered":"2024-04-25T22:51:52.014530+0000","last_unstale":"2024-04-25T22:51:54.018241+0000","last_undegraded":"2024-04-25T22:51:54.018241+0000","last_fullsized":"2024-04-25T22:51:54.018241+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:12.627716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017722+0000","last_change":"2024-04-25T22:51:53.020744+0000","last_active":"2024-04-25T22:51:54.017722+0000","last_peered":"2024-04-25T22:51:54.017722+0000","last_clean":"2024-04-25T22:51:54.017722+0000","last_became_active":"2024-04-25T22:51:53.018283+0000","last_became_peered":"2024-04-25T22:51:53.018283+0000","last_unstale":"2024-04-25T22:51:54.017722+0000","last_undegraded":"2024-04-25T22:51:54.017722+0000","last_fullsized":"2024-04-25T22:51:54.017722+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:16.187194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018313+0000","last_change":"2024-04-25T22:51:52.019730+0000","last_active":"2024-04-25T22:51:54.018313+0000","last_peered":"2024-04-25T22:51:54.018313+0000","last_clean":"2024-04-25T22:51:54.018313+0000","last_became_active":"2024-04-25T22:51:52.018987+0000","last_became_peered":"2024-04-25T22:51:52.018987+0000","last_unstale":"2024-04-25T22:51:54.018313+0000","last_undegraded":"2024-04-25T22:51:54.018313+0000","last_fullsized":"2024-04-25T22:51:54.018313+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:03:14.826593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31916,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339924,"statfs":{"total":96636764160,"available":96604082176,"internally_reserved":0,"allocated":749568,"data_stored":638245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":139264,"data_stored":46699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36084,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335756,"statfs":{"total":96636764160,"available":96599814144,"internally_reserved":0,"allocated":757760,"data_stored":638861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:52:05.778 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T22:52:05.778 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-25T22:52:05.778 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-25T22:52:05.778 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T22:52:06.147 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:52:06.148 INFO:teuthology.orchestra.run.smithi052.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T22:52:06.161 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-25T22:52:06.161 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:52:06.455 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:52:06.455 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":15,"fsid":"5355b70e-3f7d-4bce-8676-89cee61d2089","created":"2024-04-25T22:51:37.688525+0000","modified":"2024-04-25T22:51:54.011012+0000","last_up_change":"2024-04-25T22:51:45.753740+0000","last_in_change":"2024-04-25T22:51:38.491924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:51:45.966439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:51:46.128416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:51:50.648525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:51:51.351497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b785a86a-6391-4a0d-8aec-c2016380832e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6801","nonce":3666753097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6803","nonce":3666753097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6807","nonce":3666753097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6805","nonce":3666753097}]},"public_addr":"172.21.15.110:6801/3666753097","cluster_addr":"172.21.15.110:6803/3666753097","heartbeat_back_addr":"172.21.15.110:6807/3666753097","heartbeat_front_addr":"172.21.15.110:6805/3666753097","state":["exists","up"]},{"osd":1,"uuid":"088b4733-ccbd-41a6-8a31-8d811169c28a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":479301362},{"type":"v1","addr":"172.21.15.164:6801","nonce":479301362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":479301362},{"type":"v1","addr":"172.21.15.164:6803","nonce":479301362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":479301362},{"type":"v1","addr":"172.21.15.164:6807","nonce":479301362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":479301362},{"type":"v1","addr":"172.21.15.164:6805","nonce":479301362}]},"public_addr":"172.21.15.164:6801/479301362","cluster_addr":"172.21.15.164:6803/479301362","heartbeat_back_addr":"172.21.15.164:6807/479301362","heartbeat_front_addr":"172.21.15.164:6805/479301362","state":["exists","up"]},{"osd":2,"uuid":"6a6aad8c-22ac-45c0-baf9-928314e7fef9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6801","nonce":349040881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6803","nonce":349040881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6807","nonce":349040881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6805","nonce":349040881}]},"public_addr":"172.21.15.191:6801/349040881","cluster_addr":"172.21.15.191:6803/349040881","heartbeat_back_addr":"172.21.15.191:6807/349040881","heartbeat_front_addr":"172.21.15.191:6805/349040881","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:51:43.531709+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:51:43.589701+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:51:43.566226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:52:06.468 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T22:51:45.966439+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T22:51:46.128416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T22:51:50.648525+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T22:51:51.351497+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T22:52:06.469 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T22:52:06.764 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2024-04-25T22:52:06.777 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T22:52:07.073 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2024-04-25T22:52:07.086 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T22:52:07.384 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 32 2024-04-25T22:52:07.397 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T22:52:07.695 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2024-04-25T22:52:07.708 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T22:52:08.039 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:52:08.039 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T22:51:52.369470+0000","modified":"2024-04-25T22:51:54.363680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4193":{"gid":4193,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6803/4196269333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":4196269333},{"type":"v1","addr":"172.21.15.52:6803","nonce":4196269333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4193,"qdb_cluster":[4193]},"id":1}]} 2024-04-25T22:52:08.040 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 5 2024-04-25T22:52:08.054 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:52:08.351 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:52:08.352 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":15,"fsid":"5355b70e-3f7d-4bce-8676-89cee61d2089","created":"2024-04-25T22:51:37.688525+0000","modified":"2024-04-25T22:51:54.011012+0000","last_up_change":"2024-04-25T22:51:45.753740+0000","last_in_change":"2024-04-25T22:51:38.491924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:51:45.966439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:51:46.128416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:51:50.648525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:51:51.351497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b785a86a-6391-4a0d-8aec-c2016380832e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6801","nonce":3666753097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6803","nonce":3666753097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6807","nonce":3666753097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6805","nonce":3666753097}]},"public_addr":"172.21.15.110:6801/3666753097","cluster_addr":"172.21.15.110:6803/3666753097","heartbeat_back_addr":"172.21.15.110:6807/3666753097","heartbeat_front_addr":"172.21.15.110:6805/3666753097","state":["exists","up"]},{"osd":1,"uuid":"088b4733-ccbd-41a6-8a31-8d811169c28a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":479301362},{"type":"v1","addr":"172.21.15.164:6801","nonce":479301362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":479301362},{"type":"v1","addr":"172.21.15.164:6803","nonce":479301362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":479301362},{"type":"v1","addr":"172.21.15.164:6807","nonce":479301362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":479301362},{"type":"v1","addr":"172.21.15.164:6805","nonce":479301362}]},"public_addr":"172.21.15.164:6801/479301362","cluster_addr":"172.21.15.164:6803/479301362","heartbeat_back_addr":"172.21.15.164:6807/479301362","heartbeat_front_addr":"172.21.15.164:6805/479301362","state":["exists","up"]},{"osd":2,"uuid":"6a6aad8c-22ac-45c0-baf9-928314e7fef9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6801","nonce":349040881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6803","nonce":349040881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6807","nonce":349040881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6805","nonce":349040881}]},"public_addr":"172.21.15.191:6801/349040881","cluster_addr":"172.21.15.191:6803/349040881","heartbeat_back_addr":"172.21.15.191:6807/349040881","heartbeat_front_addr":"172.21.15.191:6805/349040881","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:51:43.531709+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:51:43.589701+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:51:43.566226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:52:08.365 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T22:51:45.966439+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T22:51:46.128416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T22:51:50.648525+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T22:51:51.351497+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T22:52:08.365 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T22:52:08.660 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2024-04-25T22:52:08.673 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T22:52:08.968 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2024-04-25T22:52:08.982 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T22:52:09.282 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 32 2024-04-25T22:52:09.295 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T22:52:09.591 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2024-04-25T22:52:09.604 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T22:52:09.942 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:52:09.942 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T22:51:52.369470+0000","modified":"2024-04-25T22:51:54.363680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4193":{"gid":4193,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6803/4196269333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":4196269333},{"type":"v1","addr":"172.21.15.52:6803","nonce":4196269333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4193,"qdb_cluster":[4193]},"id":1}]} 2024-04-25T22:52:09.942 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 5 2024-04-25T22:52:09.955 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:52:10.252 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:52:10.252 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":15,"fsid":"5355b70e-3f7d-4bce-8676-89cee61d2089","created":"2024-04-25T22:51:37.688525+0000","modified":"2024-04-25T22:51:54.011012+0000","last_up_change":"2024-04-25T22:51:45.753740+0000","last_in_change":"2024-04-25T22:51:38.491924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:51:45.966439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:51:46.128416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:51:50.648525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:51:51.351497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b785a86a-6391-4a0d-8aec-c2016380832e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6801","nonce":3666753097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6803","nonce":3666753097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6807","nonce":3666753097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6805","nonce":3666753097}]},"public_addr":"172.21.15.110:6801/3666753097","cluster_addr":"172.21.15.110:6803/3666753097","heartbeat_back_addr":"172.21.15.110:6807/3666753097","heartbeat_front_addr":"172.21.15.110:6805/3666753097","state":["exists","up"]},{"osd":1,"uuid":"088b4733-ccbd-41a6-8a31-8d811169c28a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":479301362},{"type":"v1","addr":"172.21.15.164:6801","nonce":479301362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":479301362},{"type":"v1","addr":"172.21.15.164:6803","nonce":479301362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":479301362},{"type":"v1","addr":"172.21.15.164:6807","nonce":479301362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":479301362},{"type":"v1","addr":"172.21.15.164:6805","nonce":479301362}]},"public_addr":"172.21.15.164:6801/479301362","cluster_addr":"172.21.15.164:6803/479301362","heartbeat_back_addr":"172.21.15.164:6807/479301362","heartbeat_front_addr":"172.21.15.164:6805/479301362","state":["exists","up"]},{"osd":2,"uuid":"6a6aad8c-22ac-45c0-baf9-928314e7fef9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6801","nonce":349040881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6803","nonce":349040881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6807","nonce":349040881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6805","nonce":349040881}]},"public_addr":"172.21.15.191:6801/349040881","cluster_addr":"172.21.15.191:6803/349040881","heartbeat_back_addr":"172.21.15.191:6807/349040881","heartbeat_front_addr":"172.21.15.191:6805/349040881","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:51:43.531709+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:51:43.589701+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:51:43.566226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:52:10.265 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T22:52:10.594 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:52:10.594 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T22:51:52.369470+0000","modified":"2024-04-25T22:51:54.363680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4193":{"gid":4193,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6803/4196269333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":4196269333},{"type":"v1","addr":"172.21.15.52:6803","nonce":4196269333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4193,"qdb_cluster":[4193]},"id":1}]} 2024-04-25T22:52:10.594 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 5 2024-04-25T22:52:10.708 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T22:51:52.369470+0000', 'modified': '2024-04-25T22:51:54.363680+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4193}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4193': {'gid': 4193, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.52:6803/4196269333', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6802', 'nonce': 4196269333}, {'type': 'v1', 'addr': '172.21.15.52:6803', 'nonce': 4196269333}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4193, 'qdb_cluster': [4193]} 2024-04-25T22:52:10.708 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T22:52:10.708 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T22:52:10.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T22:52:10.821+0000 7f0fea7fc640 0 client.4641 ms_handle_reset on v2:172.21.15.52:6802/4196269333 2024-04-25T22:52:10.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T22:52:10.844+0000 7f0fea7fc640 0 client.4647 ms_handle_reset on v2:172.21.15.52:6802/4196269333 2024-04-25T22:52:10.845 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-04-25T22:52:10.845 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "5355b70e-3f7d-4bce-8676-89cee61d2089", 2024-04-25T22:52:10.845 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 0, 2024-04-25T22:52:10.845 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 4193, 2024-04-25T22:52:10.846 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2024-04-25T22:52:10.846 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2024-04-25T22:52:10.846 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs", 2024-04-25T22:52:10.846 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 17.838181683999998, 2024-04-25T22:52:10.846 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 5, 2024-04-25T22:52:10.846 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 15, 2024-04-25T22:52:10.846 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 15, 2024-04-25T22:52:10.846 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 22.991579210000001 2024-04-25T22:52:10.846 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-04-25T22:52:10.857 INFO:teuthology.run_tasks:Running task thrashosds... 2024-04-25T22:52:10.867 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-04-25T22:52:10.867 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED'], 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'b22e2ebdeb24376882b7bda2a7329c8cccc2276a'}} 2024-04-25T22:52:10.868 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-04-25T22:52:10.868 INFO:tasks.thrashosds:Doing preliminary sync to avoid collateral damage... 2024-04-25T22:52:10.868 DEBUG:teuthology.orchestra.run.smithi052:> sync 2024-04-25T22:52:11.008 DEBUG:teuthology.orchestra.run.smithi110:> sync 2024-04-25T22:52:11.130 DEBUG:teuthology.orchestra.run.smithi164:> sync 2024-04-25T22:52:11.264 DEBUG:teuthology.orchestra.run.smithi191:> sync 2024-04-25T22:52:11.372 DEBUG:tasks.thrashosds:checking console status of smithi052 2024-04-25T22:52:11.372 DEBUG:teuthology.orchestra.console.smithi052:Waiting for login prompt 2024-04-25T22:52:11.372 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi052 2024-04-25T22:52:11.479 DEBUG:teuthology.orchestra.console.smithi052:expect before: [Enter `^Ec?' for help] 2024-04-25T22:52:11.479 DEBUG:teuthology.orchestra.console.smithi052:expect after: smithi052 login: 2024-04-25T22:52:11.531 DEBUG:teuthology.orchestra.console.smithi052:console disconnect output: [Enter `^Ec?' for help] smithi052 login: [disconnect] 2024-04-25T22:52:11.633 DEBUG:tasks.thrashosds:checking console status of smithi110 2024-04-25T22:52:11.633 DEBUG:teuthology.orchestra.console.smithi110:Waiting for login prompt 2024-04-25T22:52:11.633 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi110 2024-04-25T22:52:11.747 DEBUG:teuthology.orchestra.console.smithi110:expect before: [Enter `^Ec?' for help] 2024-04-25T22:52:11.747 DEBUG:teuthology.orchestra.console.smithi110:expect after: smithi110 login: 2024-04-25T22:52:11.800 DEBUG:teuthology.orchestra.console.smithi110:console disconnect output: [Enter `^Ec?' for help] smithi110 login: [disconnect] 2024-04-25T22:52:11.902 DEBUG:tasks.thrashosds:checking console status of smithi164 2024-04-25T22:52:11.902 DEBUG:teuthology.orchestra.console.smithi164:Waiting for login prompt 2024-04-25T22:52:11.902 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi164 2024-04-25T22:52:12.059 DEBUG:teuthology.orchestra.console.smithi164:expect before: [Enter `^Ec?' for help] 2024-04-25T22:52:12.060 DEBUG:teuthology.orchestra.console.smithi164:expect after: smithi164 login: 2024-04-25T22:52:12.111 DEBUG:teuthology.orchestra.console.smithi164:console disconnect output: [Enter `^Ec?' for help] smithi164 login: [disconnect] 2024-04-25T22:52:12.212 DEBUG:tasks.thrashosds:checking console status of smithi191 2024-04-25T22:52:12.212 DEBUG:teuthology.orchestra.console.smithi191:Waiting for login prompt 2024-04-25T22:52:12.212 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi191 2024-04-25T22:52:12.344 DEBUG:teuthology.orchestra.console.smithi191:expect before: [Enter `^Ec?' for help] 2024-04-25T22:52:12.344 DEBUG:teuthology.orchestra.console.smithi191:expect after: smithi191 login: 2024-04-25T22:52:12.396 DEBUG:teuthology.orchestra.console.smithi191:console disconnect output: [Enter `^Ec?' for help] smithi191 login: [disconnect] 2024-04-25T22:52:12.498 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-04-25T22:52:12.826 INFO:tasks.thrashosds:Beginning thrashosds... 2024-04-25T22:52:12.826 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T22:52:12.826 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:52:13.128 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:52:13.130 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-25T22:52:13.139 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-04-25T22:52:11.929490+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":95156,"kb_used_data":1608,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":283020364,"statfs":{"total":289910292480,"available":289812852736,"internally_reserved":0,"allocated":1646592,"data_stored":1323805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002001"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053235+0000","last_change":"2024-04-25T22:51:53.026259+0000","last_active":"2024-04-25T22:51:54.053235+0000","last_peered":"2024-04-25T22:51:54.053235+0000","last_clean":"2024-04-25T22:51:54.053235+0000","last_became_active":"2024-04-25T22:51:53.025647+0000","last_became_peered":"2024-04-25T22:51:53.025647+0000","last_unstale":"2024-04-25T22:51:54.053235+0000","last_undegraded":"2024-04-25T22:51:54.053235+0000","last_fullsized":"2024-04-25T22:51:54.053235+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:44:59.401139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052785+0000","last_change":"2024-04-25T22:51:53.026052+0000","last_active":"2024-04-25T22:51:54.052785+0000","last_peered":"2024-04-25T22:51:54.052785+0000","last_clean":"2024-04-25T22:51:54.052785+0000","last_became_active":"2024-04-25T22:51:53.025562+0000","last_became_peered":"2024-04-25T22:51:53.025562+0000","last_unstale":"2024-04-25T22:51:54.052785+0000","last_undegraded":"2024-04-25T22:51:54.052785+0000","last_fullsized":"2024-04-25T22:51:54.052785+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:06:02.072481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018038+0000","last_change":"2024-04-25T22:51:53.025605+0000","last_active":"2024-04-25T22:51:54.018038+0000","last_peered":"2024-04-25T22:51:54.018038+0000","last_clean":"2024-04-25T22:51:54.018038+0000","last_became_active":"2024-04-25T22:51:53.024929+0000","last_became_peered":"2024-04-25T22:51:53.024929+0000","last_unstale":"2024-04-25T22:51:54.018038+0000","last_undegraded":"2024-04-25T22:51:54.018038+0000","last_fullsized":"2024-04-25T22:51:54.018038+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:12:08.770479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018037+0000","last_change":"2024-04-25T22:51:53.019862+0000","last_active":"2024-04-25T22:51:54.018037+0000","last_peered":"2024-04-25T22:51:54.018037+0000","last_clean":"2024-04-25T22:51:54.018037+0000","last_became_active":"2024-04-25T22:51:53.018814+0000","last_became_peered":"2024-04-25T22:51:53.018814+0000","last_unstale":"2024-04-25T22:51:54.018037+0000","last_undegraded":"2024-04-25T22:51:54.018037+0000","last_fullsized":"2024-04-25T22:51:54.018037+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:22.231993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052571+0000","last_change":"2024-04-25T22:51:53.024641+0000","last_active":"2024-04-25T22:51:54.052571+0000","last_peered":"2024-04-25T22:51:54.052571+0000","last_clean":"2024-04-25T22:51:54.052571+0000","last_became_active":"2024-04-25T22:51:53.024240+0000","last_became_peered":"2024-04-25T22:51:53.024240+0000","last_unstale":"2024-04-25T22:51:54.052571+0000","last_undegraded":"2024-04-25T22:51:54.052571+0000","last_fullsized":"2024-04-25T22:51:54.052571+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:37:13.419317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017491+0000","last_change":"2024-04-25T22:51:53.017733+0000","last_active":"2024-04-25T22:51:54.017491+0000","last_peered":"2024-04-25T22:51:54.017491+0000","last_clean":"2024-04-25T22:51:54.017491+0000","last_became_active":"2024-04-25T22:51:53.016903+0000","last_became_peered":"2024-04-25T22:51:53.016903+0000","last_unstale":"2024-04-25T22:51:54.017491+0000","last_undegraded":"2024-04-25T22:51:54.017491+0000","last_fullsized":"2024-04-25T22:51:54.017491+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:06:02.072481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017578+0000","last_change":"2024-04-25T22:51:53.016102+0000","last_active":"2024-04-25T22:51:54.017578+0000","last_peered":"2024-04-25T22:51:54.017578+0000","last_clean":"2024-04-25T22:51:54.017578+0000","last_became_active":"2024-04-25T22:51:53.015662+0000","last_became_peered":"2024-04-25T22:51:53.015662+0000","last_unstale":"2024-04-25T22:51:54.017578+0000","last_undegraded":"2024-04-25T22:51:54.017578+0000","last_fullsized":"2024-04-25T22:51:54.017578+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:21:52.771650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017247+0000","last_change":"2024-04-25T22:51:53.021907+0000","last_active":"2024-04-25T22:51:54.017247+0000","last_peered":"2024-04-25T22:51:54.017247+0000","last_clean":"2024-04-25T22:51:54.017247+0000","last_became_active":"2024-04-25T22:51:53.019092+0000","last_became_peered":"2024-04-25T22:51:53.019092+0000","last_unstale":"2024-04-25T22:51:54.017247+0000","last_undegraded":"2024-04-25T22:51:54.017247+0000","last_fullsized":"2024-04-25T22:51:54.017247+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:55:27.934567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017941+0000","last_change":"2024-04-25T22:51:53.023004+0000","last_active":"2024-04-25T22:51:54.017941+0000","last_peered":"2024-04-25T22:51:54.017941+0000","last_clean":"2024-04-25T22:51:54.017941+0000","last_became_active":"2024-04-25T22:51:53.021541+0000","last_became_peered":"2024-04-25T22:51:53.021541+0000","last_unstale":"2024-04-25T22:51:54.017941+0000","last_undegraded":"2024-04-25T22:51:54.017941+0000","last_fullsized":"2024-04-25T22:51:54.017941+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:21:52.771650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052904+0000","last_change":"2024-04-25T22:51:53.024967+0000","last_active":"2024-04-25T22:51:54.052904+0000","last_peered":"2024-04-25T22:51:54.052904+0000","last_clean":"2024-04-25T22:51:54.052904+0000","last_became_active":"2024-04-25T22:51:53.024605+0000","last_became_peered":"2024-04-25T22:51:53.024605+0000","last_unstale":"2024-04-25T22:51:54.052904+0000","last_undegraded":"2024-04-25T22:51:54.052904+0000","last_fullsized":"2024-04-25T22:51:54.052904+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:21:52.771650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018442+0000","last_change":"2024-04-25T22:51:53.016889+0000","last_active":"2024-04-25T22:51:54.018442+0000","last_peered":"2024-04-25T22:51:54.018442+0000","last_clean":"2024-04-25T22:51:54.018442+0000","last_became_active":"2024-04-25T22:51:53.016121+0000","last_became_peered":"2024-04-25T22:51:53.016121+0000","last_unstale":"2024-04-25T22:51:54.018442+0000","last_undegraded":"2024-04-25T22:51:54.018442+0000","last_fullsized":"2024-04-25T22:51:54.018442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:11:52.428780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052755+0000","last_change":"2024-04-25T22:51:53.028006+0000","last_active":"2024-04-25T22:51:54.052755+0000","last_peered":"2024-04-25T22:51:54.052755+0000","last_clean":"2024-04-25T22:51:54.052755+0000","last_became_active":"2024-04-25T22:51:53.027363+0000","last_became_peered":"2024-04-25T22:51:53.027363+0000","last_unstale":"2024-04-25T22:51:54.052755+0000","last_undegraded":"2024-04-25T22:51:54.052755+0000","last_fullsized":"2024-04-25T22:51:54.052755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:32.923620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052272+0000","last_change":"2024-04-25T22:51:53.024407+0000","last_active":"2024-04-25T22:51:54.052272+0000","last_peered":"2024-04-25T22:51:54.052272+0000","last_clean":"2024-04-25T22:51:54.052272+0000","last_became_active":"2024-04-25T22:51:53.024079+0000","last_became_peered":"2024-04-25T22:51:53.024079+0000","last_unstale":"2024-04-25T22:51:54.052272+0000","last_undegraded":"2024-04-25T22:51:54.052272+0000","last_fullsized":"2024-04-25T22:51:54.052272+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:40:41.536510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018150+0000","last_change":"2024-04-25T22:51:53.022367+0000","last_active":"2024-04-25T22:51:54.018150+0000","last_peered":"2024-04-25T22:51:54.018150+0000","last_clean":"2024-04-25T22:51:54.018150+0000","last_became_active":"2024-04-25T22:51:53.021902+0000","last_became_peered":"2024-04-25T22:51:53.021902+0000","last_unstale":"2024-04-25T22:51:54.018150+0000","last_undegraded":"2024-04-25T22:51:54.018150+0000","last_fullsized":"2024-04-25T22:51:54.018150+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:44:59.401139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017718+0000","last_change":"2024-04-25T22:51:53.022016+0000","last_active":"2024-04-25T22:51:54.017718+0000","last_peered":"2024-04-25T22:51:54.017718+0000","last_clean":"2024-04-25T22:51:54.017718+0000","last_became_active":"2024-04-25T22:51:53.021666+0000","last_became_peered":"2024-04-25T22:51:53.021666+0000","last_unstale":"2024-04-25T22:51:54.017718+0000","last_undegraded":"2024-04-25T22:51:54.017718+0000","last_fullsized":"2024-04-25T22:51:54.017718+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:28:42.903045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017270+0000","last_change":"2024-04-25T22:51:53.021442+0000","last_active":"2024-04-25T22:51:54.017270+0000","last_peered":"2024-04-25T22:51:54.017270+0000","last_clean":"2024-04-25T22:51:54.017270+0000","last_became_active":"2024-04-25T22:51:53.019251+0000","last_became_peered":"2024-04-25T22:51:53.019251+0000","last_unstale":"2024-04-25T22:51:54.017270+0000","last_undegraded":"2024-04-25T22:51:54.017270+0000","last_fullsized":"2024-04-25T22:51:54.017270+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:18:31.139968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018458+0000","last_change":"2024-04-25T22:51:53.023571+0000","last_active":"2024-04-25T22:51:54.018458+0000","last_peered":"2024-04-25T22:51:54.018458+0000","last_clean":"2024-04-25T22:51:54.018458+0000","last_became_active":"2024-04-25T22:51:53.022774+0000","last_became_peered":"2024-04-25T22:51:53.022774+0000","last_unstale":"2024-04-25T22:51:54.018458+0000","last_undegraded":"2024-04-25T22:51:54.018458+0000","last_fullsized":"2024-04-25T22:51:54.018458+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:41.205051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053209+0000","last_change":"2024-04-25T22:51:53.026365+0000","last_active":"2024-04-25T22:51:54.053209+0000","last_peered":"2024-04-25T22:51:54.053209+0000","last_clean":"2024-04-25T22:51:54.053209+0000","last_became_active":"2024-04-25T22:51:53.025610+0000","last_became_peered":"2024-04-25T22:51:53.025610+0000","last_unstale":"2024-04-25T22:51:54.053209+0000","last_undegraded":"2024-04-25T22:51:54.053209+0000","last_fullsized":"2024-04-25T22:51:54.053209+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:22.231993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017934+0000","last_change":"2024-04-25T22:51:53.020704+0000","last_active":"2024-04-25T22:51:54.017934+0000","last_peered":"2024-04-25T22:51:54.017934+0000","last_clean":"2024-04-25T22:51:54.017934+0000","last_became_active":"2024-04-25T22:51:53.020333+0000","last_became_peered":"2024-04-25T22:51:53.020333+0000","last_unstale":"2024-04-25T22:51:54.017934+0000","last_undegraded":"2024-04-25T22:51:54.017934+0000","last_fullsized":"2024-04-25T22:51:54.017934+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:06:02.072481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018256+0000","last_change":"2024-04-25T22:51:53.019606+0000","last_active":"2024-04-25T22:51:54.018256+0000","last_peered":"2024-04-25T22:51:54.018256+0000","last_clean":"2024-04-25T22:51:54.018256+0000","last_became_active":"2024-04-25T22:51:53.018789+0000","last_became_peered":"2024-04-25T22:51:53.018789+0000","last_unstale":"2024-04-25T22:51:54.018256+0000","last_undegraded":"2024-04-25T22:51:54.018256+0000","last_fullsized":"2024-04-25T22:51:54.018256+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:43:07.741691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018361+0000","last_change":"2024-04-25T22:51:53.018086+0000","last_active":"2024-04-25T22:51:54.018361+0000","last_peered":"2024-04-25T22:51:54.018361+0000","last_clean":"2024-04-25T22:51:54.018361+0000","last_became_active":"2024-04-25T22:51:53.016966+0000","last_became_peered":"2024-04-25T22:51:53.016966+0000","last_unstale":"2024-04-25T22:51:54.018361+0000","last_undegraded":"2024-04-25T22:51:54.018361+0000","last_fullsized":"2024-04-25T22:51:54.018361+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:25:33.516171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052152+0000","last_change":"2024-04-25T22:51:53.026746+0000","last_active":"2024-04-25T22:51:54.052152+0000","last_peered":"2024-04-25T22:51:54.052152+0000","last_clean":"2024-04-25T22:51:54.052152+0000","last_became_active":"2024-04-25T22:51:53.025938+0000","last_became_peered":"2024-04-25T22:51:53.025938+0000","last_unstale":"2024-04-25T22:51:54.052152+0000","last_undegraded":"2024-04-25T22:51:54.052152+0000","last_fullsized":"2024-04-25T22:51:54.052152+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:38:03.428258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.016918+0000","last_change":"2024-04-25T22:51:53.016829+0000","last_active":"2024-04-25T22:51:54.016918+0000","last_peered":"2024-04-25T22:51:54.016918+0000","last_clean":"2024-04-25T22:51:54.016918+0000","last_became_active":"2024-04-25T22:51:53.016497+0000","last_became_peered":"2024-04-25T22:51:53.016497+0000","last_unstale":"2024-04-25T22:51:54.016918+0000","last_undegraded":"2024-04-25T22:51:54.016918+0000","last_fullsized":"2024-04-25T22:51:54.016918+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:11:09.179564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.051948+0000","last_change":"2024-04-25T22:51:53.025164+0000","last_active":"2024-04-25T22:51:54.051948+0000","last_peered":"2024-04-25T22:51:54.051948+0000","last_clean":"2024-04-25T22:51:54.051948+0000","last_became_active":"2024-04-25T22:51:53.024781+0000","last_became_peered":"2024-04-25T22:51:53.024781+0000","last_unstale":"2024-04-25T22:51:54.051948+0000","last_undegraded":"2024-04-25T22:51:54.051948+0000","last_fullsized":"2024-04-25T22:51:54.051948+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:04:31.763523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053277+0000","last_change":"2024-04-25T22:51:53.028155+0000","last_active":"2024-04-25T22:51:54.053277+0000","last_peered":"2024-04-25T22:51:54.053277+0000","last_clean":"2024-04-25T22:51:54.053277+0000","last_became_active":"2024-04-25T22:51:53.027867+0000","last_became_peered":"2024-04-25T22:51:53.027867+0000","last_unstale":"2024-04-25T22:51:54.053277+0000","last_undegraded":"2024-04-25T22:51:54.053277+0000","last_fullsized":"2024-04-25T22:51:54.053277+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:43:47.453569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018121+0000","last_change":"2024-04-25T22:51:53.022959+0000","last_active":"2024-04-25T22:51:54.018121+0000","last_peered":"2024-04-25T22:51:54.018121+0000","last_clean":"2024-04-25T22:51:54.018121+0000","last_became_active":"2024-04-25T22:51:53.022318+0000","last_became_peered":"2024-04-25T22:51:53.022318+0000","last_unstale":"2024-04-25T22:51:54.018121+0000","last_undegraded":"2024-04-25T22:51:54.018121+0000","last_fullsized":"2024-04-25T22:51:54.018121+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:58:11.470631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018639+0000","last_change":"2024-04-25T22:51:53.022893+0000","last_active":"2024-04-25T22:51:54.018639+0000","last_peered":"2024-04-25T22:51:54.018639+0000","last_clean":"2024-04-25T22:51:54.018639+0000","last_became_active":"2024-04-25T22:51:53.022407+0000","last_became_peered":"2024-04-25T22:51:53.022407+0000","last_unstale":"2024-04-25T22:51:54.018639+0000","last_undegraded":"2024-04-25T22:51:54.018639+0000","last_fullsized":"2024-04-25T22:51:54.018639+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:08:44.404718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053002+0000","last_change":"2024-04-25T22:51:53.028447+0000","last_active":"2024-04-25T22:51:54.053002+0000","last_peered":"2024-04-25T22:51:54.053002+0000","last_clean":"2024-04-25T22:51:54.053002+0000","last_became_active":"2024-04-25T22:51:53.027852+0000","last_became_peered":"2024-04-25T22:51:53.027852+0000","last_unstale":"2024-04-25T22:51:54.053002+0000","last_undegraded":"2024-04-25T22:51:54.053002+0000","last_fullsized":"2024-04-25T22:51:54.053002+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:16.187194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017554+0000","last_change":"2024-04-25T22:51:53.019840+0000","last_active":"2024-04-25T22:51:54.017554+0000","last_peered":"2024-04-25T22:51:54.017554+0000","last_clean":"2024-04-25T22:51:54.017554+0000","last_became_active":"2024-04-25T22:51:53.019419+0000","last_became_peered":"2024-04-25T22:51:53.019419+0000","last_unstale":"2024-04-25T22:51:54.017554+0000","last_undegraded":"2024-04-25T22:51:54.017554+0000","last_fullsized":"2024-04-25T22:51:54.017554+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:32.923620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052550+0000","last_change":"2024-04-25T22:51:53.026997+0000","last_active":"2024-04-25T22:51:54.052550+0000","last_peered":"2024-04-25T22:51:54.052550+0000","last_clean":"2024-04-25T22:51:54.052550+0000","last_became_active":"2024-04-25T22:51:53.026379+0000","last_became_peered":"2024-04-25T22:51:53.026379+0000","last_unstale":"2024-04-25T22:51:54.052550+0000","last_undegraded":"2024-04-25T22:51:54.052550+0000","last_fullsized":"2024-04-25T22:51:54.052550+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:33:24.700106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017074+0000","last_change":"2024-04-25T22:51:53.019642+0000","last_active":"2024-04-25T22:51:54.017074+0000","last_peered":"2024-04-25T22:51:54.017074+0000","last_clean":"2024-04-25T22:51:54.017074+0000","last_became_active":"2024-04-25T22:51:53.019197+0000","last_became_peered":"2024-04-25T22:51:53.019197+0000","last_unstale":"2024-04-25T22:51:54.017074+0000","last_undegraded":"2024-04-25T22:51:54.017074+0000","last_fullsized":"2024-04-25T22:51:54.017074+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:12:00.793718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017428+0000","last_change":"2024-04-25T22:51:53.020857+0000","last_active":"2024-04-25T22:51:54.017428+0000","last_peered":"2024-04-25T22:51:54.017428+0000","last_clean":"2024-04-25T22:51:54.017428+0000","last_became_active":"2024-04-25T22:51:53.018340+0000","last_became_peered":"2024-04-25T22:51:53.018340+0000","last_unstale":"2024-04-25T22:51:54.017428+0000","last_undegraded":"2024-04-25T22:51:54.017428+0000","last_fullsized":"2024-04-25T22:51:54.017428+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:32.923620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053001+0000","last_change":"2024-04-25T22:51:53.025101+0000","last_active":"2024-04-25T22:51:54.053001+0000","last_peered":"2024-04-25T22:51:54.053001+0000","last_clean":"2024-04-25T22:51:54.053001+0000","last_became_active":"2024-04-25T22:51:53.024643+0000","last_became_peered":"2024-04-25T22:51:53.024643+0000","last_unstale":"2024-04-25T22:51:54.053001+0000","last_undegraded":"2024-04-25T22:51:54.053001+0000","last_fullsized":"2024-04-25T22:51:54.053001+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:58:11.470631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018622+0000","last_change":"2024-04-25T22:51:52.017181+0000","last_active":"2024-04-25T22:51:54.018622+0000","last_peered":"2024-04-25T22:51:54.018622+0000","last_clean":"2024-04-25T22:51:54.018622+0000","last_became_active":"2024-04-25T22:51:52.016682+0000","last_became_peered":"2024-04-25T22:51:52.016682+0000","last_unstale":"2024-04-25T22:51:54.018622+0000","last_undegraded":"2024-04-25T22:51:54.018622+0000","last_fullsized":"2024-04-25T22:51:54.018622+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:18:00.975479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053150+0000","last_change":"2024-04-25T22:51:53.026414+0000","last_active":"2024-04-25T22:51:54.053150+0000","last_peered":"2024-04-25T22:51:54.053150+0000","last_clean":"2024-04-25T22:51:54.053150+0000","last_became_active":"2024-04-25T22:51:53.025591+0000","last_became_peered":"2024-04-25T22:51:53.025591+0000","last_unstale":"2024-04-25T22:51:54.053150+0000","last_undegraded":"2024-04-25T22:51:54.053150+0000","last_fullsized":"2024-04-25T22:51:54.053150+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:12:08.770479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017399+0000","last_change":"2024-04-25T22:51:52.019690+0000","last_active":"2024-04-25T22:51:54.017399+0000","last_peered":"2024-04-25T22:51:54.017399+0000","last_clean":"2024-04-25T22:51:54.017399+0000","last_became_active":"2024-04-25T22:51:52.018818+0000","last_became_peered":"2024-04-25T22:51:52.018818+0000","last_unstale":"2024-04-25T22:51:54.017399+0000","last_undegraded":"2024-04-25T22:51:54.017399+0000","last_fullsized":"2024-04-25T22:51:54.017399+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:25:48.361495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018267+0000","last_change":"2024-04-25T22:51:53.023197+0000","last_active":"2024-04-25T22:51:54.018267+0000","last_peered":"2024-04-25T22:51:54.018267+0000","last_clean":"2024-04-25T22:51:54.018267+0000","last_became_active":"2024-04-25T22:51:53.022627+0000","last_became_peered":"2024-04-25T22:51:53.022627+0000","last_unstale":"2024-04-25T22:51:54.018267+0000","last_undegraded":"2024-04-25T22:51:54.018267+0000","last_fullsized":"2024-04-25T22:51:54.018267+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:44:59.401139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052236+0000","last_change":"2024-04-25T22:51:52.018646+0000","last_active":"2024-04-25T22:51:54.052236+0000","last_peered":"2024-04-25T22:51:54.052236+0000","last_clean":"2024-04-25T22:51:54.052236+0000","last_became_active":"2024-04-25T22:51:52.018313+0000","last_became_peered":"2024-04-25T22:51:52.018313+0000","last_unstale":"2024-04-25T22:51:54.052236+0000","last_undegraded":"2024-04-25T22:51:54.052236+0000","last_fullsized":"2024-04-25T22:51:54.052236+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:00:21.688745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018104+0000","last_change":"2024-04-25T22:51:53.022419+0000","last_active":"2024-04-25T22:51:54.018104+0000","last_peered":"2024-04-25T22:51:54.018104+0000","last_clean":"2024-04-25T22:51:54.018104+0000","last_became_active":"2024-04-25T22:51:53.021405+0000","last_became_peered":"2024-04-25T22:51:53.021405+0000","last_unstale":"2024-04-25T22:51:54.018104+0000","last_undegraded":"2024-04-25T22:51:54.018104+0000","last_fullsized":"2024-04-25T22:51:54.018104+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:28:42.903045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":22,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017441+0000","last_change":"2024-04-25T22:51:52.021510+0000","last_active":"2024-04-25T22:51:54.017441+0000","last_peered":"2024-04-25T22:51:54.017441+0000","last_clean":"2024-04-25T22:51:54.017441+0000","last_became_active":"2024-04-25T22:51:52.021145+0000","last_became_peered":"2024-04-25T22:51:52.021145+0000","last_unstale":"2024-04-25T22:51:54.017441+0000","last_undegraded":"2024-04-25T22:51:54.017441+0000","last_fullsized":"2024-04-25T22:51:54.017441+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:05.110747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018420+0000","last_change":"2024-04-25T22:51:52.021355+0000","last_active":"2024-04-25T22:51:54.018420+0000","last_peered":"2024-04-25T22:51:54.018420+0000","last_clean":"2024-04-25T22:51:54.018420+0000","last_became_active":"2024-04-25T22:51:52.020860+0000","last_became_peered":"2024-04-25T22:51:52.020860+0000","last_unstale":"2024-04-25T22:51:54.018420+0000","last_undegraded":"2024-04-25T22:51:54.018420+0000","last_fullsized":"2024-04-25T22:51:54.018420+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:55.235787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.051967+0000","last_change":"2024-04-25T22:51:53.029390+0000","last_active":"2024-04-25T22:51:54.051967+0000","last_peered":"2024-04-25T22:51:54.051967+0000","last_clean":"2024-04-25T22:51:54.051967+0000","last_became_active":"2024-04-25T22:51:53.029157+0000","last_became_peered":"2024-04-25T22:51:53.029157+0000","last_unstale":"2024-04-25T22:51:54.051967+0000","last_undegraded":"2024-04-25T22:51:54.051967+0000","last_fullsized":"2024-04-25T22:51:54.051967+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:51:43.808994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053167+0000","last_change":"2024-04-25T22:51:52.018856+0000","last_active":"2024-04-25T22:51:54.053167+0000","last_peered":"2024-04-25T22:51:54.053167+0000","last_clean":"2024-04-25T22:51:54.053167+0000","last_became_active":"2024-04-25T22:51:52.018390+0000","last_became_peered":"2024-04-25T22:51:52.018390+0000","last_unstale":"2024-04-25T22:51:54.053167+0000","last_undegraded":"2024-04-25T22:51:54.053167+0000","last_fullsized":"2024-04-25T22:51:54.053167+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:42:54.430484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052143+0000","last_change":"2024-04-25T22:51:53.024599+0000","last_active":"2024-04-25T22:51:54.052143+0000","last_peered":"2024-04-25T22:51:54.052143+0000","last_clean":"2024-04-25T22:51:54.052143+0000","last_became_active":"2024-04-25T22:51:53.024155+0000","last_became_peered":"2024-04-25T22:51:53.024155+0000","last_unstale":"2024-04-25T22:51:54.052143+0000","last_undegraded":"2024-04-25T22:51:54.052143+0000","last_fullsized":"2024-04-25T22:51:54.052143+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:09:52.869451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018756+0000","last_change":"2024-04-25T22:51:52.019724+0000","last_active":"2024-04-25T22:51:54.018756+0000","last_peered":"2024-04-25T22:51:54.018756+0000","last_clean":"2024-04-25T22:51:54.018756+0000","last_became_active":"2024-04-25T22:51:52.019167+0000","last_became_peered":"2024-04-25T22:51:52.019167+0000","last_unstale":"2024-04-25T22:51:54.018756+0000","last_undegraded":"2024-04-25T22:51:54.018756+0000","last_fullsized":"2024-04-25T22:51:54.018756+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:03:14.826593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017804+0000","last_change":"2024-04-25T22:51:53.017327+0000","last_active":"2024-04-25T22:51:54.017804+0000","last_peered":"2024-04-25T22:51:54.017804+0000","last_clean":"2024-04-25T22:51:54.017804+0000","last_became_active":"2024-04-25T22:51:53.015987+0000","last_became_peered":"2024-04-25T22:51:53.015987+0000","last_unstale":"2024-04-25T22:51:54.017804+0000","last_undegraded":"2024-04-25T22:51:54.017804+0000","last_fullsized":"2024-04-25T22:51:54.017804+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:16.602188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018741+0000","last_change":"2024-04-25T22:51:52.016151+0000","last_active":"2024-04-25T22:51:54.018741+0000","last_peered":"2024-04-25T22:51:54.018741+0000","last_clean":"2024-04-25T22:51:54.018741+0000","last_became_active":"2024-04-25T22:51:52.015741+0000","last_became_peered":"2024-04-25T22:51:52.015741+0000","last_unstale":"2024-04-25T22:51:54.018741+0000","last_undegraded":"2024-04-25T22:51:54.018741+0000","last_fullsized":"2024-04-25T22:51:54.018741+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:02:25.133948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018157+0000","last_change":"2024-04-25T22:51:53.021208+0000","last_active":"2024-04-25T22:51:54.018157+0000","last_peered":"2024-04-25T22:51:54.018157+0000","last_clean":"2024-04-25T22:51:54.018157+0000","last_became_active":"2024-04-25T22:51:53.020752+0000","last_became_peered":"2024-04-25T22:51:53.020752+0000","last_unstale":"2024-04-25T22:51:54.018157+0000","last_undegraded":"2024-04-25T22:51:54.018157+0000","last_fullsized":"2024-04-25T22:51:54.018157+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:16.602188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017996+0000","last_change":"2024-04-25T22:51:52.018716+0000","last_active":"2024-04-25T22:51:54.017996+0000","last_peered":"2024-04-25T22:51:54.017996+0000","last_clean":"2024-04-25T22:51:54.017996+0000","last_became_active":"2024-04-25T22:51:52.018140+0000","last_became_peered":"2024-04-25T22:51:52.018140+0000","last_unstale":"2024-04-25T22:51:54.017996+0000","last_undegraded":"2024-04-25T22:51:54.017996+0000","last_fullsized":"2024-04-25T22:51:54.017996+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:02:25.133948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018609+0000","last_change":"2024-04-25T22:51:53.019508+0000","last_active":"2024-04-25T22:51:54.018609+0000","last_peered":"2024-04-25T22:51:54.018609+0000","last_clean":"2024-04-25T22:51:54.018609+0000","last_became_active":"2024-04-25T22:51:53.016749+0000","last_became_peered":"2024-04-25T22:51:53.016749+0000","last_unstale":"2024-04-25T22:51:54.018609+0000","last_undegraded":"2024-04-25T22:51:54.018609+0000","last_fullsized":"2024-04-25T22:51:54.018609+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:25.110416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018342+0000","last_change":"2024-04-25T22:51:52.022474+0000","last_active":"2024-04-25T22:51:54.018342+0000","last_peered":"2024-04-25T22:51:54.018342+0000","last_clean":"2024-04-25T22:51:54.018342+0000","last_became_active":"2024-04-25T22:51:52.022141+0000","last_became_peered":"2024-04-25T22:51:52.022141+0000","last_unstale":"2024-04-25T22:51:54.018342+0000","last_undegraded":"2024-04-25T22:51:54.018342+0000","last_fullsized":"2024-04-25T22:51:54.018342+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:17:10.500338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018670+0000","last_change":"2024-04-25T22:51:53.023929+0000","last_active":"2024-04-25T22:51:54.018670+0000","last_peered":"2024-04-25T22:51:54.018670+0000","last_clean":"2024-04-25T22:51:54.018670+0000","last_became_active":"2024-04-25T22:51:53.023405+0000","last_became_peered":"2024-04-25T22:51:53.023405+0000","last_unstale":"2024-04-25T22:51:54.018670+0000","last_undegraded":"2024-04-25T22:51:54.018670+0000","last_fullsized":"2024-04-25T22:51:54.018670+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:35:35.419823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052331+0000","last_change":"2024-04-25T22:51:52.018970+0000","last_active":"2024-04-25T22:51:54.052331+0000","last_peered":"2024-04-25T22:51:54.052331+0000","last_clean":"2024-04-25T22:51:54.052331+0000","last_became_active":"2024-04-25T22:51:52.018439+0000","last_became_peered":"2024-04-25T22:51:52.018439+0000","last_unstale":"2024-04-25T22:51:54.052331+0000","last_undegraded":"2024-04-25T22:51:54.052331+0000","last_fullsized":"2024-04-25T22:51:54.052331+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:24:31.748243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018219+0000","last_change":"2024-04-25T22:51:53.020574+0000","last_active":"2024-04-25T22:51:54.018219+0000","last_peered":"2024-04-25T22:51:54.018219+0000","last_clean":"2024-04-25T22:51:54.018219+0000","last_became_active":"2024-04-25T22:51:53.019978+0000","last_became_peered":"2024-04-25T22:51:53.019978+0000","last_unstale":"2024-04-25T22:51:54.018219+0000","last_undegraded":"2024-04-25T22:51:54.018219+0000","last_fullsized":"2024-04-25T22:51:54.018219+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:41.205051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052156+0000","last_change":"2024-04-25T22:51:52.017743+0000","last_active":"2024-04-25T22:51:54.052156+0000","last_peered":"2024-04-25T22:51:54.052156+0000","last_clean":"2024-04-25T22:51:54.052156+0000","last_became_active":"2024-04-25T22:51:52.016659+0000","last_became_peered":"2024-04-25T22:51:52.016659+0000","last_unstale":"2024-04-25T22:51:54.052156+0000","last_undegraded":"2024-04-25T22:51:54.052156+0000","last_fullsized":"2024-04-25T22:51:54.052156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:49:07.912197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018170+0000","last_change":"2024-04-25T22:51:53.023278+0000","last_active":"2024-04-25T22:51:54.018170+0000","last_peered":"2024-04-25T22:51:54.018170+0000","last_clean":"2024-04-25T22:51:54.018170+0000","last_became_active":"2024-04-25T22:51:53.021948+0000","last_became_peered":"2024-04-25T22:51:53.021948+0000","last_unstale":"2024-04-25T22:51:54.018170+0000","last_undegraded":"2024-04-25T22:51:54.018170+0000","last_fullsized":"2024-04-25T22:51:54.018170+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:22.231993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":216,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017807+0000","last_change":"2024-04-25T22:51:47.764624+0000","last_active":"2024-04-25T22:51:54.017807+0000","last_peered":"2024-04-25T22:51:54.017807+0000","last_clean":"2024-04-25T22:51:54.017807+0000","last_became_active":"2024-04-25T22:51:47.764176+0000","last_became_peered":"2024-04-25T22:51:47.764176+0000","last_unstale":"2024-04-25T22:51:54.017807+0000","last_undegraded":"2024-04-25T22:51:54.017807+0000","last_fullsized":"2024-04-25T22:51:54.017807+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:59:39.005489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018697+0000","last_change":"2024-04-25T22:51:47.768368+0000","last_active":"2024-04-25T22:51:54.018697+0000","last_peered":"2024-04-25T22:51:54.018697+0000","last_clean":"2024-04-25T22:51:54.018697+0000","last_became_active":"2024-04-25T22:51:47.768003+0000","last_became_peered":"2024-04-25T22:51:47.768003+0000","last_unstale":"2024-04-25T22:51:54.018697+0000","last_undegraded":"2024-04-25T22:51:54.018697+0000","last_fullsized":"2024-04-25T22:51:54.018697+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:10:00.098072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017829+0000","last_change":"2024-04-25T22:51:52.014376+0000","last_active":"2024-04-25T22:51:54.017829+0000","last_peered":"2024-04-25T22:51:54.017829+0000","last_clean":"2024-04-25T22:51:54.017829+0000","last_became_active":"2024-04-25T22:51:52.013816+0000","last_became_peered":"2024-04-25T22:51:52.013816+0000","last_unstale":"2024-04-25T22:51:54.017829+0000","last_undegraded":"2024-04-25T22:51:54.017829+0000","last_fullsized":"2024-04-25T22:51:54.017829+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:18.136883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018819+0000","last_change":"2024-04-25T22:51:53.024106+0000","last_active":"2024-04-25T22:51:54.018819+0000","last_peered":"2024-04-25T22:51:54.018819+0000","last_clean":"2024-04-25T22:51:54.018819+0000","last_became_active":"2024-04-25T22:51:53.023497+0000","last_became_peered":"2024-04-25T22:51:53.023497+0000","last_unstale":"2024-04-25T22:51:54.018819+0000","last_undegraded":"2024-04-25T22:51:54.018819+0000","last_fullsized":"2024-04-25T22:51:54.018819+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:52:16.918935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017591+0000","last_change":"2024-04-25T22:51:47.764591+0000","last_active":"2024-04-25T22:51:54.017591+0000","last_peered":"2024-04-25T22:51:54.017591+0000","last_clean":"2024-04-25T22:51:54.017591+0000","last_became_active":"2024-04-25T22:51:47.764229+0000","last_became_peered":"2024-04-25T22:51:47.764229+0000","last_unstale":"2024-04-25T22:51:54.017591+0000","last_undegraded":"2024-04-25T22:51:54.017591+0000","last_fullsized":"2024-04-25T22:51:54.017591+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:32.854624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017358+0000","last_change":"2024-04-25T22:51:52.017918+0000","last_active":"2024-04-25T22:51:54.017358+0000","last_peered":"2024-04-25T22:51:54.017358+0000","last_clean":"2024-04-25T22:51:54.017358+0000","last_became_active":"2024-04-25T22:51:52.017541+0000","last_became_peered":"2024-04-25T22:51:52.017541+0000","last_unstale":"2024-04-25T22:51:54.017358+0000","last_undegraded":"2024-04-25T22:51:54.017358+0000","last_fullsized":"2024-04-25T22:51:54.017358+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:17:10.500338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052996+0000","last_change":"2024-04-25T22:51:53.026971+0000","last_active":"2024-04-25T22:51:54.052996+0000","last_peered":"2024-04-25T22:51:54.052996+0000","last_clean":"2024-04-25T22:51:54.052996+0000","last_became_active":"2024-04-25T22:51:53.026355+0000","last_became_peered":"2024-04-25T22:51:53.026355+0000","last_unstale":"2024-04-25T22:51:54.052996+0000","last_undegraded":"2024-04-25T22:51:54.052996+0000","last_fullsized":"2024-04-25T22:51:54.052996+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:16.602188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017440+0000","last_change":"2024-04-25T22:51:47.762564+0000","last_active":"2024-04-25T22:51:54.017440+0000","last_peered":"2024-04-25T22:51:54.017440+0000","last_clean":"2024-04-25T22:51:54.017440+0000","last_became_active":"2024-04-25T22:51:47.762218+0000","last_became_peered":"2024-04-25T22:51:47.762218+0000","last_unstale":"2024-04-25T22:51:54.017440+0000","last_undegraded":"2024-04-25T22:51:54.017440+0000","last_fullsized":"2024-04-25T22:51:54.017440+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:09:06.117740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052192+0000","last_change":"2024-04-25T22:51:52.018873+0000","last_active":"2024-04-25T22:51:54.052192+0000","last_peered":"2024-04-25T22:51:54.052192+0000","last_clean":"2024-04-25T22:51:54.052192+0000","last_became_active":"2024-04-25T22:51:52.018300+0000","last_became_peered":"2024-04-25T22:51:52.018300+0000","last_unstale":"2024-04-25T22:51:54.052192+0000","last_undegraded":"2024-04-25T22:51:54.052192+0000","last_fullsized":"2024-04-25T22:51:54.052192+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:25:22.660789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018295+0000","last_change":"2024-04-25T22:51:53.023461+0000","last_active":"2024-04-25T22:51:54.018295+0000","last_peered":"2024-04-25T22:51:54.018295+0000","last_clean":"2024-04-25T22:51:54.018295+0000","last_became_active":"2024-04-25T22:51:53.022017+0000","last_became_peered":"2024-04-25T22:51:53.022017+0000","last_unstale":"2024-04-25T22:51:54.018295+0000","last_undegraded":"2024-04-25T22:51:54.018295+0000","last_fullsized":"2024-04-25T22:51:54.018295+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:43:47.453569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018255+0000","last_change":"2024-04-25T22:51:47.768269+0000","last_active":"2024-04-25T22:51:54.018255+0000","last_peered":"2024-04-25T22:51:54.018255+0000","last_clean":"2024-04-25T22:51:54.018255+0000","last_became_active":"2024-04-25T22:51:47.767991+0000","last_became_peered":"2024-04-25T22:51:47.767991+0000","last_unstale":"2024-04-25T22:51:54.018255+0000","last_undegraded":"2024-04-25T22:51:54.018255+0000","last_fullsized":"2024-04-25T22:51:54.018255+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:01:54.134289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018678+0000","last_change":"2024-04-25T22:51:52.021220+0000","last_active":"2024-04-25T22:51:54.018678+0000","last_peered":"2024-04-25T22:51:54.018678+0000","last_clean":"2024-04-25T22:51:54.018678+0000","last_became_active":"2024-04-25T22:51:52.020833+0000","last_became_peered":"2024-04-25T22:51:52.020833+0000","last_unstale":"2024-04-25T22:51:54.018678+0000","last_undegraded":"2024-04-25T22:51:54.018678+0000","last_fullsized":"2024-04-25T22:51:54.018678+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:12.627716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018128+0000","last_change":"2024-04-25T22:51:53.020666+0000","last_active":"2024-04-25T22:51:54.018128+0000","last_peered":"2024-04-25T22:51:54.018128+0000","last_clean":"2024-04-25T22:51:54.018128+0000","last_became_active":"2024-04-25T22:51:53.020212+0000","last_became_peered":"2024-04-25T22:51:53.020212+0000","last_unstale":"2024-04-25T22:51:54.018128+0000","last_undegraded":"2024-04-25T22:51:54.018128+0000","last_fullsized":"2024-04-25T22:51:54.018128+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:12:08.770479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018823+0000","last_change":"2024-04-25T22:51:52.016362+0000","last_active":"2024-04-25T22:51:54.018823+0000","last_peered":"2024-04-25T22:51:54.018823+0000","last_clean":"2024-04-25T22:51:54.018823+0000","last_became_active":"2024-04-25T22:51:52.015409+0000","last_became_peered":"2024-04-25T22:51:52.015409+0000","last_unstale":"2024-04-25T22:51:54.018823+0000","last_undegraded":"2024-04-25T22:51:54.018823+0000","last_fullsized":"2024-04-25T22:51:54.018823+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:21:19.563620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018072+0000","last_change":"2024-04-25T22:51:47.761131+0000","last_active":"2024-04-25T22:51:54.018072+0000","last_peered":"2024-04-25T22:51:54.018072+0000","last_clean":"2024-04-25T22:51:54.018072+0000","last_became_active":"2024-04-25T22:51:47.760894+0000","last_became_peered":"2024-04-25T22:51:47.760894+0000","last_unstale":"2024-04-25T22:51:54.018072+0000","last_undegraded":"2024-04-25T22:51:54.018072+0000","last_fullsized":"2024-04-25T22:51:54.018072+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:38:28.554024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052447+0000","last_change":"2024-04-25T22:51:53.026321+0000","last_active":"2024-04-25T22:51:54.052447+0000","last_peered":"2024-04-25T22:51:54.052447+0000","last_clean":"2024-04-25T22:51:54.052447+0000","last_became_active":"2024-04-25T22:51:53.025824+0000","last_became_peered":"2024-04-25T22:51:53.025824+0000","last_unstale":"2024-04-25T22:51:54.052447+0000","last_undegraded":"2024-04-25T22:51:54.052447+0000","last_fullsized":"2024-04-25T22:51:54.052447+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:12:00.793718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017995+0000","last_change":"2024-04-25T22:51:52.015638+0000","last_active":"2024-04-25T22:51:54.017995+0000","last_peered":"2024-04-25T22:51:54.017995+0000","last_clean":"2024-04-25T22:51:54.017995+0000","last_became_active":"2024-04-25T22:51:52.014858+0000","last_became_peered":"2024-04-25T22:51:52.014858+0000","last_unstale":"2024-04-25T22:51:54.017995+0000","last_undegraded":"2024-04-25T22:51:54.017995+0000","last_fullsized":"2024-04-25T22:51:54.017995+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:44:34.159650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053349+0000","last_change":"2024-04-25T22:51:47.765532+0000","last_active":"2024-04-25T22:51:54.053349+0000","last_peered":"2024-04-25T22:51:54.053349+0000","last_clean":"2024-04-25T22:51:54.053349+0000","last_became_active":"2024-04-25T22:51:47.765247+0000","last_became_peered":"2024-04-25T22:51:47.765247+0000","last_unstale":"2024-04-25T22:51:54.053349+0000","last_undegraded":"2024-04-25T22:51:54.053349+0000","last_fullsized":"2024-04-25T22:51:54.053349+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:55:05.342938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052632+0000","last_change":"2024-04-25T22:51:53.027051+0000","last_active":"2024-04-25T22:51:54.052632+0000","last_peered":"2024-04-25T22:51:54.052632+0000","last_clean":"2024-04-25T22:51:54.052632+0000","last_became_active":"2024-04-25T22:51:53.026458+0000","last_became_peered":"2024-04-25T22:51:53.026458+0000","last_unstale":"2024-04-25T22:51:54.052632+0000","last_undegraded":"2024-04-25T22:51:54.052632+0000","last_fullsized":"2024-04-25T22:51:54.052632+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:11:09.179564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018550+0000","last_change":"2024-04-25T22:51:52.015635+0000","last_active":"2024-04-25T22:51:54.018550+0000","last_peered":"2024-04-25T22:51:54.018550+0000","last_clean":"2024-04-25T22:51:54.018550+0000","last_became_active":"2024-04-25T22:51:52.014778+0000","last_became_peered":"2024-04-25T22:51:52.014778+0000","last_unstale":"2024-04-25T22:51:54.018550+0000","last_undegraded":"2024-04-25T22:51:54.018550+0000","last_fullsized":"2024-04-25T22:51:54.018550+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:21:19.563620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018314+0000","last_change":"2024-04-25T22:51:47.762468+0000","last_active":"2024-04-25T22:51:54.018314+0000","last_peered":"2024-04-25T22:51:54.018314+0000","last_clean":"2024-04-25T22:51:54.018314+0000","last_became_active":"2024-04-25T22:51:47.762199+0000","last_became_peered":"2024-04-25T22:51:47.762199+0000","last_unstale":"2024-04-25T22:51:54.018314+0000","last_undegraded":"2024-04-25T22:51:54.018314+0000","last_fullsized":"2024-04-25T22:51:54.018314+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:32.854624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017184+0000","last_change":"2024-04-25T22:51:53.023317+0000","last_active":"2024-04-25T22:51:54.017184+0000","last_peered":"2024-04-25T22:51:54.017184+0000","last_clean":"2024-04-25T22:51:54.017184+0000","last_became_active":"2024-04-25T22:51:53.022756+0000","last_became_peered":"2024-04-25T22:51:53.022756+0000","last_unstale":"2024-04-25T22:51:54.017184+0000","last_undegraded":"2024-04-25T22:51:54.017184+0000","last_fullsized":"2024-04-25T22:51:54.017184+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:37:13.419317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:55.011718+0000","last_change":"2024-04-25T22:51:52.017845+0000","last_active":"2024-04-25T22:51:55.011718+0000","last_peered":"2024-04-25T22:51:55.011718+0000","last_clean":"2024-04-25T22:51:55.011718+0000","last_became_active":"2024-04-25T22:51:52.017521+0000","last_became_peered":"2024-04-25T22:51:52.017521+0000","last_unstale":"2024-04-25T22:51:55.011718+0000","last_undegraded":"2024-04-25T22:51:55.011718+0000","last_fullsized":"2024-04-25T22:51:55.011718+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:18:00.975479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018392+0000","last_change":"2024-04-25T22:51:47.764288+0000","last_active":"2024-04-25T22:51:54.018392+0000","last_peered":"2024-04-25T22:51:54.018392+0000","last_clean":"2024-04-25T22:51:54.018392+0000","last_became_active":"2024-04-25T22:51:47.763961+0000","last_became_peered":"2024-04-25T22:51:47.763961+0000","last_unstale":"2024-04-25T22:51:54.018392+0000","last_undegraded":"2024-04-25T22:51:54.018392+0000","last_fullsized":"2024-04-25T22:51:54.018392+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:03:07.164842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052084+0000","last_change":"2024-04-25T22:51:53.026925+0000","last_active":"2024-04-25T22:51:54.052084+0000","last_peered":"2024-04-25T22:51:54.052084+0000","last_clean":"2024-04-25T22:51:54.052084+0000","last_became_active":"2024-04-25T22:51:53.026419+0000","last_became_peered":"2024-04-25T22:51:53.026419+0000","last_unstale":"2024-04-25T22:51:54.052084+0000","last_undegraded":"2024-04-25T22:51:54.052084+0000","last_fullsized":"2024-04-25T22:51:54.052084+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:49:38.102060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018559+0000","last_change":"2024-04-25T22:51:53.022222+0000","last_active":"2024-04-25T22:51:54.018559+0000","last_peered":"2024-04-25T22:51:54.018559+0000","last_clean":"2024-04-25T22:51:54.018559+0000","last_became_active":"2024-04-25T22:51:53.021687+0000","last_became_peered":"2024-04-25T22:51:53.021687+0000","last_unstale":"2024-04-25T22:51:54.018559+0000","last_undegraded":"2024-04-25T22:51:54.018559+0000","last_fullsized":"2024-04-25T22:51:54.018559+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:35:06.234402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018650+0000","last_change":"2024-04-25T22:51:52.019928+0000","last_active":"2024-04-25T22:51:54.018650+0000","last_peered":"2024-04-25T22:51:54.018650+0000","last_clean":"2024-04-25T22:51:54.018650+0000","last_became_active":"2024-04-25T22:51:52.019264+0000","last_became_peered":"2024-04-25T22:51:52.019264+0000","last_unstale":"2024-04-25T22:51:54.018650+0000","last_undegraded":"2024-04-25T22:51:54.018650+0000","last_fullsized":"2024-04-25T22:51:54.018650+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:18.136883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017393+0000","last_change":"2024-04-25T22:51:53.020652+0000","last_active":"2024-04-25T22:51:54.017393+0000","last_peered":"2024-04-25T22:51:54.017393+0000","last_clean":"2024-04-25T22:51:54.017393+0000","last_became_active":"2024-04-25T22:51:53.020129+0000","last_became_peered":"2024-04-25T22:51:53.020129+0000","last_unstale":"2024-04-25T22:51:54.017393+0000","last_undegraded":"2024-04-25T22:51:54.017393+0000","last_fullsized":"2024-04-25T22:51:54.017393+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:18:31.139968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053289+0000","last_change":"2024-04-25T22:51:52.018977+0000","last_active":"2024-04-25T22:51:54.053289+0000","last_peered":"2024-04-25T22:51:54.053289+0000","last_clean":"2024-04-25T22:51:54.053289+0000","last_became_active":"2024-04-25T22:51:52.018519+0000","last_became_peered":"2024-04-25T22:51:52.018519+0000","last_unstale":"2024-04-25T22:51:54.053289+0000","last_undegraded":"2024-04-25T22:51:54.053289+0000","last_fullsized":"2024-04-25T22:51:54.053289+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:53:07.306148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018416+0000","last_change":"2024-04-25T22:51:52.022177+0000","last_active":"2024-04-25T22:51:54.018416+0000","last_peered":"2024-04-25T22:51:54.018416+0000","last_clean":"2024-04-25T22:51:54.018416+0000","last_became_active":"2024-04-25T22:51:52.021882+0000","last_became_peered":"2024-04-25T22:51:52.021882+0000","last_unstale":"2024-04-25T22:51:54.018416+0000","last_undegraded":"2024-04-25T22:51:54.018416+0000","last_fullsized":"2024-04-25T22:51:54.018416+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:44:34.159650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017107+0000","last_change":"2024-04-25T22:51:53.022499+0000","last_active":"2024-04-25T22:51:54.017107+0000","last_peered":"2024-04-25T22:51:54.017107+0000","last_clean":"2024-04-25T22:51:54.017107+0000","last_became_active":"2024-04-25T22:51:53.022018+0000","last_became_peered":"2024-04-25T22:51:53.022018+0000","last_unstale":"2024-04-25T22:51:54.017107+0000","last_undegraded":"2024-04-25T22:51:54.017107+0000","last_fullsized":"2024-04-25T22:51:54.017107+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:33:24.700106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018441+0000","last_change":"2024-04-25T22:51:52.019673+0000","last_active":"2024-04-25T22:51:54.018441+0000","last_peered":"2024-04-25T22:51:54.018441+0000","last_clean":"2024-04-25T22:51:54.018441+0000","last_became_active":"2024-04-25T22:51:52.018877+0000","last_became_peered":"2024-04-25T22:51:52.018877+0000","last_unstale":"2024-04-25T22:51:54.018441+0000","last_undegraded":"2024-04-25T22:51:54.018441+0000","last_fullsized":"2024-04-25T22:51:54.018441+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:05.110747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017316+0000","last_change":"2024-04-25T22:51:53.020927+0000","last_active":"2024-04-25T22:51:54.017316+0000","last_peered":"2024-04-25T22:51:54.017316+0000","last_clean":"2024-04-25T22:51:54.017316+0000","last_became_active":"2024-04-25T22:51:53.020366+0000","last_became_peered":"2024-04-25T22:51:53.020366+0000","last_unstale":"2024-04-25T22:51:54.017316+0000","last_undegraded":"2024-04-25T22:51:54.017316+0000","last_fullsized":"2024-04-25T22:51:54.017316+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:55:27.934567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053387+0000","last_change":"2024-04-25T22:51:53.029210+0000","last_active":"2024-04-25T22:51:54.053387+0000","last_peered":"2024-04-25T22:51:54.053387+0000","last_clean":"2024-04-25T22:51:54.053387+0000","last_became_active":"2024-04-25T22:51:53.028635+0000","last_became_peered":"2024-04-25T22:51:53.028635+0000","last_unstale":"2024-04-25T22:51:54.053387+0000","last_undegraded":"2024-04-25T22:51:54.053387+0000","last_fullsized":"2024-04-25T22:51:54.053387+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:41.205051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017373+0000","last_change":"2024-04-25T22:51:52.014897+0000","last_active":"2024-04-25T22:51:54.017373+0000","last_peered":"2024-04-25T22:51:54.017373+0000","last_clean":"2024-04-25T22:51:54.017373+0000","last_became_active":"2024-04-25T22:51:52.014344+0000","last_became_peered":"2024-04-25T22:51:52.014344+0000","last_unstale":"2024-04-25T22:51:54.017373+0000","last_undegraded":"2024-04-25T22:51:54.017373+0000","last_fullsized":"2024-04-25T22:51:54.017373+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:55.235787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018063+0000","last_change":"2024-04-25T22:51:53.022920+0000","last_active":"2024-04-25T22:51:54.018063+0000","last_peered":"2024-04-25T22:51:54.018063+0000","last_clean":"2024-04-25T22:51:54.018063+0000","last_became_active":"2024-04-25T22:51:53.022190+0000","last_became_peered":"2024-04-25T22:51:53.022190+0000","last_unstale":"2024-04-25T22:51:54.018063+0000","last_undegraded":"2024-04-25T22:51:54.018063+0000","last_fullsized":"2024-04-25T22:51:54.018063+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:16.187194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017261+0000","last_change":"2024-04-25T22:51:52.018371+0000","last_active":"2024-04-25T22:51:54.017261+0000","last_peered":"2024-04-25T22:51:54.017261+0000","last_clean":"2024-04-25T22:51:54.017261+0000","last_became_active":"2024-04-25T22:51:52.018027+0000","last_became_peered":"2024-04-25T22:51:52.018027+0000","last_unstale":"2024-04-25T22:51:54.017261+0000","last_undegraded":"2024-04-25T22:51:54.017261+0000","last_fullsized":"2024-04-25T22:51:54.017261+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:36:57.435877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052965+0000","last_change":"2024-04-25T22:51:53.028084+0000","last_active":"2024-04-25T22:51:54.052965+0000","last_peered":"2024-04-25T22:51:54.052965+0000","last_clean":"2024-04-25T22:51:54.052965+0000","last_became_active":"2024-04-25T22:51:53.027541+0000","last_became_peered":"2024-04-25T22:51:53.027541+0000","last_unstale":"2024-04-25T22:51:54.052965+0000","last_undegraded":"2024-04-25T22:51:54.052965+0000","last_fullsized":"2024-04-25T22:51:54.052965+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:28:42.903045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052565+0000","last_change":"2024-04-25T22:51:52.017006+0000","last_active":"2024-04-25T22:51:54.052565+0000","last_peered":"2024-04-25T22:51:54.052565+0000","last_clean":"2024-04-25T22:51:54.052565+0000","last_became_active":"2024-04-25T22:51:52.016667+0000","last_became_peered":"2024-04-25T22:51:52.016667+0000","last_unstale":"2024-04-25T22:51:54.052565+0000","last_undegraded":"2024-04-25T22:51:54.052565+0000","last_fullsized":"2024-04-25T22:51:54.052565+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:24:51.210288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052731+0000","last_change":"2024-04-25T22:51:53.024685+0000","last_active":"2024-04-25T22:51:54.052731+0000","last_peered":"2024-04-25T22:51:54.052731+0000","last_clean":"2024-04-25T22:51:54.052731+0000","last_became_active":"2024-04-25T22:51:53.024304+0000","last_became_peered":"2024-04-25T22:51:53.024304+0000","last_unstale":"2024-04-25T22:51:54.052731+0000","last_undegraded":"2024-04-25T22:51:54.052731+0000","last_fullsized":"2024-04-25T22:51:54.052731+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:18:31.139968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052731+0000","last_change":"2024-04-25T22:51:52.018973+0000","last_active":"2024-04-25T22:51:54.052731+0000","last_peered":"2024-04-25T22:51:54.052731+0000","last_clean":"2024-04-25T22:51:54.052731+0000","last_became_active":"2024-04-25T22:51:52.018503+0000","last_became_peered":"2024-04-25T22:51:52.018503+0000","last_unstale":"2024-04-25T22:51:54.052731+0000","last_undegraded":"2024-04-25T22:51:54.052731+0000","last_fullsized":"2024-04-25T22:51:54.052731+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:07:38.783124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017918+0000","last_change":"2024-04-25T22:51:53.018063+0000","last_active":"2024-04-25T22:51:54.017918+0000","last_peered":"2024-04-25T22:51:54.017918+0000","last_clean":"2024-04-25T22:51:54.017918+0000","last_became_active":"2024-04-25T22:51:53.016779+0000","last_became_peered":"2024-04-25T22:51:53.016779+0000","last_unstale":"2024-04-25T22:51:54.017918+0000","last_undegraded":"2024-04-25T22:51:54.017918+0000","last_fullsized":"2024-04-25T22:51:54.017918+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:58:11.470631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018527+0000","last_change":"2024-04-25T22:51:52.022209+0000","last_active":"2024-04-25T22:51:54.018527+0000","last_peered":"2024-04-25T22:51:54.018527+0000","last_clean":"2024-04-25T22:51:54.018527+0000","last_became_active":"2024-04-25T22:51:52.021868+0000","last_became_peered":"2024-04-25T22:51:52.021868+0000","last_unstale":"2024-04-25T22:51:54.018527+0000","last_undegraded":"2024-04-25T22:51:54.018527+0000","last_fullsized":"2024-04-25T22:51:54.018527+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:36:57.435877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018070+0000","last_change":"2024-04-25T22:51:53.017222+0000","last_active":"2024-04-25T22:51:54.018070+0000","last_peered":"2024-04-25T22:51:54.018070+0000","last_clean":"2024-04-25T22:51:54.018070+0000","last_became_active":"2024-04-25T22:51:53.015717+0000","last_became_peered":"2024-04-25T22:51:53.015717+0000","last_unstale":"2024-04-25T22:51:54.018070+0000","last_undegraded":"2024-04-25T22:51:54.018070+0000","last_fullsized":"2024-04-25T22:51:54.018070+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:43:47.453569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053098+0000","last_change":"2024-04-25T22:51:52.019032+0000","last_active":"2024-04-25T22:51:54.053098+0000","last_peered":"2024-04-25T22:51:54.053098+0000","last_clean":"2024-04-25T22:51:54.053098+0000","last_became_active":"2024-04-25T22:51:52.018547+0000","last_became_peered":"2024-04-25T22:51:52.018547+0000","last_unstale":"2024-04-25T22:51:54.053098+0000","last_undegraded":"2024-04-25T22:51:54.053098+0000","last_fullsized":"2024-04-25T22:51:54.053098+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:10:00.056491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052619+0000","last_change":"2024-04-25T22:51:53.024597+0000","last_active":"2024-04-25T22:51:54.052619+0000","last_peered":"2024-04-25T22:51:54.052619+0000","last_clean":"2024-04-25T22:51:54.052619+0000","last_became_active":"2024-04-25T22:51:53.024256+0000","last_became_peered":"2024-04-25T22:51:53.024256+0000","last_unstale":"2024-04-25T22:51:54.052619+0000","last_undegraded":"2024-04-25T22:51:54.052619+0000","last_fullsized":"2024-04-25T22:51:54.052619+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:55:27.934567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018241+0000","last_change":"2024-04-25T22:51:52.015581+0000","last_active":"2024-04-25T22:51:54.018241+0000","last_peered":"2024-04-25T22:51:54.018241+0000","last_clean":"2024-04-25T22:51:54.018241+0000","last_became_active":"2024-04-25T22:51:52.014530+0000","last_became_peered":"2024-04-25T22:51:52.014530+0000","last_unstale":"2024-04-25T22:51:54.018241+0000","last_undegraded":"2024-04-25T22:51:54.018241+0000","last_fullsized":"2024-04-25T22:51:54.018241+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:12.627716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017722+0000","last_change":"2024-04-25T22:51:53.020744+0000","last_active":"2024-04-25T22:51:54.017722+0000","last_peered":"2024-04-25T22:51:54.017722+0000","last_clean":"2024-04-25T22:51:54.017722+0000","last_became_active":"2024-04-25T22:51:53.018283+0000","last_became_peered":"2024-04-25T22:51:53.018283+0000","last_unstale":"2024-04-25T22:51:54.017722+0000","last_undegraded":"2024-04-25T22:51:54.017722+0000","last_fullsized":"2024-04-25T22:51:54.017722+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:16.187194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018313+0000","last_change":"2024-04-25T22:51:52.019730+0000","last_active":"2024-04-25T22:51:54.018313+0000","last_peered":"2024-04-25T22:51:54.018313+0000","last_clean":"2024-04-25T22:51:54.018313+0000","last_became_active":"2024-04-25T22:51:52.018987+0000","last_became_peered":"2024-04-25T22:51:52.018987+0000","last_unstale":"2024-04-25T22:51:54.018313+0000","last_undegraded":"2024-04-25T22:51:54.018313+0000","last_fullsized":"2024-04-25T22:51:54.018313+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:03:14.826593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738376,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31916,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339924,"statfs":{"total":96636764160,"available":96604082176,"internally_reserved":0,"allocated":749568,"data_stored":638245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738376,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":139264,"data_stored":46699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738376,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36084,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335756,"statfs":{"total":96636764160,"available":96599814144,"internally_reserved":0,"allocated":757760,"data_stored":638861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:52:13.143 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:52:13.480 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:52:13.482 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-25T22:52:13.492 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-04-25T22:52:11.929490+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":95156,"kb_used_data":1608,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":283020364,"statfs":{"total":289910292480,"available":289812852736,"internally_reserved":0,"allocated":1646592,"data_stored":1323805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002001"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053235+0000","last_change":"2024-04-25T22:51:53.026259+0000","last_active":"2024-04-25T22:51:54.053235+0000","last_peered":"2024-04-25T22:51:54.053235+0000","last_clean":"2024-04-25T22:51:54.053235+0000","last_became_active":"2024-04-25T22:51:53.025647+0000","last_became_peered":"2024-04-25T22:51:53.025647+0000","last_unstale":"2024-04-25T22:51:54.053235+0000","last_undegraded":"2024-04-25T22:51:54.053235+0000","last_fullsized":"2024-04-25T22:51:54.053235+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:44:59.401139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052785+0000","last_change":"2024-04-25T22:51:53.026052+0000","last_active":"2024-04-25T22:51:54.052785+0000","last_peered":"2024-04-25T22:51:54.052785+0000","last_clean":"2024-04-25T22:51:54.052785+0000","last_became_active":"2024-04-25T22:51:53.025562+0000","last_became_peered":"2024-04-25T22:51:53.025562+0000","last_unstale":"2024-04-25T22:51:54.052785+0000","last_undegraded":"2024-04-25T22:51:54.052785+0000","last_fullsized":"2024-04-25T22:51:54.052785+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:06:02.072481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018038+0000","last_change":"2024-04-25T22:51:53.025605+0000","last_active":"2024-04-25T22:51:54.018038+0000","last_peered":"2024-04-25T22:51:54.018038+0000","last_clean":"2024-04-25T22:51:54.018038+0000","last_became_active":"2024-04-25T22:51:53.024929+0000","last_became_peered":"2024-04-25T22:51:53.024929+0000","last_unstale":"2024-04-25T22:51:54.018038+0000","last_undegraded":"2024-04-25T22:51:54.018038+0000","last_fullsized":"2024-04-25T22:51:54.018038+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:12:08.770479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018037+0000","last_change":"2024-04-25T22:51:53.019862+0000","last_active":"2024-04-25T22:51:54.018037+0000","last_peered":"2024-04-25T22:51:54.018037+0000","last_clean":"2024-04-25T22:51:54.018037+0000","last_became_active":"2024-04-25T22:51:53.018814+0000","last_became_peered":"2024-04-25T22:51:53.018814+0000","last_unstale":"2024-04-25T22:51:54.018037+0000","last_undegraded":"2024-04-25T22:51:54.018037+0000","last_fullsized":"2024-04-25T22:51:54.018037+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:22.231993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052571+0000","last_change":"2024-04-25T22:51:53.024641+0000","last_active":"2024-04-25T22:51:54.052571+0000","last_peered":"2024-04-25T22:51:54.052571+0000","last_clean":"2024-04-25T22:51:54.052571+0000","last_became_active":"2024-04-25T22:51:53.024240+0000","last_became_peered":"2024-04-25T22:51:53.024240+0000","last_unstale":"2024-04-25T22:51:54.052571+0000","last_undegraded":"2024-04-25T22:51:54.052571+0000","last_fullsized":"2024-04-25T22:51:54.052571+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:37:13.419317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017491+0000","last_change":"2024-04-25T22:51:53.017733+0000","last_active":"2024-04-25T22:51:54.017491+0000","last_peered":"2024-04-25T22:51:54.017491+0000","last_clean":"2024-04-25T22:51:54.017491+0000","last_became_active":"2024-04-25T22:51:53.016903+0000","last_became_peered":"2024-04-25T22:51:53.016903+0000","last_unstale":"2024-04-25T22:51:54.017491+0000","last_undegraded":"2024-04-25T22:51:54.017491+0000","last_fullsized":"2024-04-25T22:51:54.017491+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:06:02.072481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017578+0000","last_change":"2024-04-25T22:51:53.016102+0000","last_active":"2024-04-25T22:51:54.017578+0000","last_peered":"2024-04-25T22:51:54.017578+0000","last_clean":"2024-04-25T22:51:54.017578+0000","last_became_active":"2024-04-25T22:51:53.015662+0000","last_became_peered":"2024-04-25T22:51:53.015662+0000","last_unstale":"2024-04-25T22:51:54.017578+0000","last_undegraded":"2024-04-25T22:51:54.017578+0000","last_fullsized":"2024-04-25T22:51:54.017578+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:21:52.771650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017247+0000","last_change":"2024-04-25T22:51:53.021907+0000","last_active":"2024-04-25T22:51:54.017247+0000","last_peered":"2024-04-25T22:51:54.017247+0000","last_clean":"2024-04-25T22:51:54.017247+0000","last_became_active":"2024-04-25T22:51:53.019092+0000","last_became_peered":"2024-04-25T22:51:53.019092+0000","last_unstale":"2024-04-25T22:51:54.017247+0000","last_undegraded":"2024-04-25T22:51:54.017247+0000","last_fullsized":"2024-04-25T22:51:54.017247+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:55:27.934567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017941+0000","last_change":"2024-04-25T22:51:53.023004+0000","last_active":"2024-04-25T22:51:54.017941+0000","last_peered":"2024-04-25T22:51:54.017941+0000","last_clean":"2024-04-25T22:51:54.017941+0000","last_became_active":"2024-04-25T22:51:53.021541+0000","last_became_peered":"2024-04-25T22:51:53.021541+0000","last_unstale":"2024-04-25T22:51:54.017941+0000","last_undegraded":"2024-04-25T22:51:54.017941+0000","last_fullsized":"2024-04-25T22:51:54.017941+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:21:52.771650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052904+0000","last_change":"2024-04-25T22:51:53.024967+0000","last_active":"2024-04-25T22:51:54.052904+0000","last_peered":"2024-04-25T22:51:54.052904+0000","last_clean":"2024-04-25T22:51:54.052904+0000","last_became_active":"2024-04-25T22:51:53.024605+0000","last_became_peered":"2024-04-25T22:51:53.024605+0000","last_unstale":"2024-04-25T22:51:54.052904+0000","last_undegraded":"2024-04-25T22:51:54.052904+0000","last_fullsized":"2024-04-25T22:51:54.052904+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:21:52.771650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018442+0000","last_change":"2024-04-25T22:51:53.016889+0000","last_active":"2024-04-25T22:51:54.018442+0000","last_peered":"2024-04-25T22:51:54.018442+0000","last_clean":"2024-04-25T22:51:54.018442+0000","last_became_active":"2024-04-25T22:51:53.016121+0000","last_became_peered":"2024-04-25T22:51:53.016121+0000","last_unstale":"2024-04-25T22:51:54.018442+0000","last_undegraded":"2024-04-25T22:51:54.018442+0000","last_fullsized":"2024-04-25T22:51:54.018442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:11:52.428780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052755+0000","last_change":"2024-04-25T22:51:53.028006+0000","last_active":"2024-04-25T22:51:54.052755+0000","last_peered":"2024-04-25T22:51:54.052755+0000","last_clean":"2024-04-25T22:51:54.052755+0000","last_became_active":"2024-04-25T22:51:53.027363+0000","last_became_peered":"2024-04-25T22:51:53.027363+0000","last_unstale":"2024-04-25T22:51:54.052755+0000","last_undegraded":"2024-04-25T22:51:54.052755+0000","last_fullsized":"2024-04-25T22:51:54.052755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:32.923620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052272+0000","last_change":"2024-04-25T22:51:53.024407+0000","last_active":"2024-04-25T22:51:54.052272+0000","last_peered":"2024-04-25T22:51:54.052272+0000","last_clean":"2024-04-25T22:51:54.052272+0000","last_became_active":"2024-04-25T22:51:53.024079+0000","last_became_peered":"2024-04-25T22:51:53.024079+0000","last_unstale":"2024-04-25T22:51:54.052272+0000","last_undegraded":"2024-04-25T22:51:54.052272+0000","last_fullsized":"2024-04-25T22:51:54.052272+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:40:41.536510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018150+0000","last_change":"2024-04-25T22:51:53.022367+0000","last_active":"2024-04-25T22:51:54.018150+0000","last_peered":"2024-04-25T22:51:54.018150+0000","last_clean":"2024-04-25T22:51:54.018150+0000","last_became_active":"2024-04-25T22:51:53.021902+0000","last_became_peered":"2024-04-25T22:51:53.021902+0000","last_unstale":"2024-04-25T22:51:54.018150+0000","last_undegraded":"2024-04-25T22:51:54.018150+0000","last_fullsized":"2024-04-25T22:51:54.018150+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:44:59.401139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017718+0000","last_change":"2024-04-25T22:51:53.022016+0000","last_active":"2024-04-25T22:51:54.017718+0000","last_peered":"2024-04-25T22:51:54.017718+0000","last_clean":"2024-04-25T22:51:54.017718+0000","last_became_active":"2024-04-25T22:51:53.021666+0000","last_became_peered":"2024-04-25T22:51:53.021666+0000","last_unstale":"2024-04-25T22:51:54.017718+0000","last_undegraded":"2024-04-25T22:51:54.017718+0000","last_fullsized":"2024-04-25T22:51:54.017718+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:28:42.903045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017270+0000","last_change":"2024-04-25T22:51:53.021442+0000","last_active":"2024-04-25T22:51:54.017270+0000","last_peered":"2024-04-25T22:51:54.017270+0000","last_clean":"2024-04-25T22:51:54.017270+0000","last_became_active":"2024-04-25T22:51:53.019251+0000","last_became_peered":"2024-04-25T22:51:53.019251+0000","last_unstale":"2024-04-25T22:51:54.017270+0000","last_undegraded":"2024-04-25T22:51:54.017270+0000","last_fullsized":"2024-04-25T22:51:54.017270+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:18:31.139968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018458+0000","last_change":"2024-04-25T22:51:53.023571+0000","last_active":"2024-04-25T22:51:54.018458+0000","last_peered":"2024-04-25T22:51:54.018458+0000","last_clean":"2024-04-25T22:51:54.018458+0000","last_became_active":"2024-04-25T22:51:53.022774+0000","last_became_peered":"2024-04-25T22:51:53.022774+0000","last_unstale":"2024-04-25T22:51:54.018458+0000","last_undegraded":"2024-04-25T22:51:54.018458+0000","last_fullsized":"2024-04-25T22:51:54.018458+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:41.205051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053209+0000","last_change":"2024-04-25T22:51:53.026365+0000","last_active":"2024-04-25T22:51:54.053209+0000","last_peered":"2024-04-25T22:51:54.053209+0000","last_clean":"2024-04-25T22:51:54.053209+0000","last_became_active":"2024-04-25T22:51:53.025610+0000","last_became_peered":"2024-04-25T22:51:53.025610+0000","last_unstale":"2024-04-25T22:51:54.053209+0000","last_undegraded":"2024-04-25T22:51:54.053209+0000","last_fullsized":"2024-04-25T22:51:54.053209+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:22.231993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017934+0000","last_change":"2024-04-25T22:51:53.020704+0000","last_active":"2024-04-25T22:51:54.017934+0000","last_peered":"2024-04-25T22:51:54.017934+0000","last_clean":"2024-04-25T22:51:54.017934+0000","last_became_active":"2024-04-25T22:51:53.020333+0000","last_became_peered":"2024-04-25T22:51:53.020333+0000","last_unstale":"2024-04-25T22:51:54.017934+0000","last_undegraded":"2024-04-25T22:51:54.017934+0000","last_fullsized":"2024-04-25T22:51:54.017934+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:06:02.072481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018256+0000","last_change":"2024-04-25T22:51:53.019606+0000","last_active":"2024-04-25T22:51:54.018256+0000","last_peered":"2024-04-25T22:51:54.018256+0000","last_clean":"2024-04-25T22:51:54.018256+0000","last_became_active":"2024-04-25T22:51:53.018789+0000","last_became_peered":"2024-04-25T22:51:53.018789+0000","last_unstale":"2024-04-25T22:51:54.018256+0000","last_undegraded":"2024-04-25T22:51:54.018256+0000","last_fullsized":"2024-04-25T22:51:54.018256+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:43:07.741691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018361+0000","last_change":"2024-04-25T22:51:53.018086+0000","last_active":"2024-04-25T22:51:54.018361+0000","last_peered":"2024-04-25T22:51:54.018361+0000","last_clean":"2024-04-25T22:51:54.018361+0000","last_became_active":"2024-04-25T22:51:53.016966+0000","last_became_peered":"2024-04-25T22:51:53.016966+0000","last_unstale":"2024-04-25T22:51:54.018361+0000","last_undegraded":"2024-04-25T22:51:54.018361+0000","last_fullsized":"2024-04-25T22:51:54.018361+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:25:33.516171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052152+0000","last_change":"2024-04-25T22:51:53.026746+0000","last_active":"2024-04-25T22:51:54.052152+0000","last_peered":"2024-04-25T22:51:54.052152+0000","last_clean":"2024-04-25T22:51:54.052152+0000","last_became_active":"2024-04-25T22:51:53.025938+0000","last_became_peered":"2024-04-25T22:51:53.025938+0000","last_unstale":"2024-04-25T22:51:54.052152+0000","last_undegraded":"2024-04-25T22:51:54.052152+0000","last_fullsized":"2024-04-25T22:51:54.052152+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:38:03.428258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.016918+0000","last_change":"2024-04-25T22:51:53.016829+0000","last_active":"2024-04-25T22:51:54.016918+0000","last_peered":"2024-04-25T22:51:54.016918+0000","last_clean":"2024-04-25T22:51:54.016918+0000","last_became_active":"2024-04-25T22:51:53.016497+0000","last_became_peered":"2024-04-25T22:51:53.016497+0000","last_unstale":"2024-04-25T22:51:54.016918+0000","last_undegraded":"2024-04-25T22:51:54.016918+0000","last_fullsized":"2024-04-25T22:51:54.016918+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:11:09.179564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.051948+0000","last_change":"2024-04-25T22:51:53.025164+0000","last_active":"2024-04-25T22:51:54.051948+0000","last_peered":"2024-04-25T22:51:54.051948+0000","last_clean":"2024-04-25T22:51:54.051948+0000","last_became_active":"2024-04-25T22:51:53.024781+0000","last_became_peered":"2024-04-25T22:51:53.024781+0000","last_unstale":"2024-04-25T22:51:54.051948+0000","last_undegraded":"2024-04-25T22:51:54.051948+0000","last_fullsized":"2024-04-25T22:51:54.051948+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:04:31.763523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053277+0000","last_change":"2024-04-25T22:51:53.028155+0000","last_active":"2024-04-25T22:51:54.053277+0000","last_peered":"2024-04-25T22:51:54.053277+0000","last_clean":"2024-04-25T22:51:54.053277+0000","last_became_active":"2024-04-25T22:51:53.027867+0000","last_became_peered":"2024-04-25T22:51:53.027867+0000","last_unstale":"2024-04-25T22:51:54.053277+0000","last_undegraded":"2024-04-25T22:51:54.053277+0000","last_fullsized":"2024-04-25T22:51:54.053277+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:43:47.453569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018121+0000","last_change":"2024-04-25T22:51:53.022959+0000","last_active":"2024-04-25T22:51:54.018121+0000","last_peered":"2024-04-25T22:51:54.018121+0000","last_clean":"2024-04-25T22:51:54.018121+0000","last_became_active":"2024-04-25T22:51:53.022318+0000","last_became_peered":"2024-04-25T22:51:53.022318+0000","last_unstale":"2024-04-25T22:51:54.018121+0000","last_undegraded":"2024-04-25T22:51:54.018121+0000","last_fullsized":"2024-04-25T22:51:54.018121+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:58:11.470631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018639+0000","last_change":"2024-04-25T22:51:53.022893+0000","last_active":"2024-04-25T22:51:54.018639+0000","last_peered":"2024-04-25T22:51:54.018639+0000","last_clean":"2024-04-25T22:51:54.018639+0000","last_became_active":"2024-04-25T22:51:53.022407+0000","last_became_peered":"2024-04-25T22:51:53.022407+0000","last_unstale":"2024-04-25T22:51:54.018639+0000","last_undegraded":"2024-04-25T22:51:54.018639+0000","last_fullsized":"2024-04-25T22:51:54.018639+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:08:44.404718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053002+0000","last_change":"2024-04-25T22:51:53.028447+0000","last_active":"2024-04-25T22:51:54.053002+0000","last_peered":"2024-04-25T22:51:54.053002+0000","last_clean":"2024-04-25T22:51:54.053002+0000","last_became_active":"2024-04-25T22:51:53.027852+0000","last_became_peered":"2024-04-25T22:51:53.027852+0000","last_unstale":"2024-04-25T22:51:54.053002+0000","last_undegraded":"2024-04-25T22:51:54.053002+0000","last_fullsized":"2024-04-25T22:51:54.053002+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:16.187194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017554+0000","last_change":"2024-04-25T22:51:53.019840+0000","last_active":"2024-04-25T22:51:54.017554+0000","last_peered":"2024-04-25T22:51:54.017554+0000","last_clean":"2024-04-25T22:51:54.017554+0000","last_became_active":"2024-04-25T22:51:53.019419+0000","last_became_peered":"2024-04-25T22:51:53.019419+0000","last_unstale":"2024-04-25T22:51:54.017554+0000","last_undegraded":"2024-04-25T22:51:54.017554+0000","last_fullsized":"2024-04-25T22:51:54.017554+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:32.923620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052550+0000","last_change":"2024-04-25T22:51:53.026997+0000","last_active":"2024-04-25T22:51:54.052550+0000","last_peered":"2024-04-25T22:51:54.052550+0000","last_clean":"2024-04-25T22:51:54.052550+0000","last_became_active":"2024-04-25T22:51:53.026379+0000","last_became_peered":"2024-04-25T22:51:53.026379+0000","last_unstale":"2024-04-25T22:51:54.052550+0000","last_undegraded":"2024-04-25T22:51:54.052550+0000","last_fullsized":"2024-04-25T22:51:54.052550+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:33:24.700106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017074+0000","last_change":"2024-04-25T22:51:53.019642+0000","last_active":"2024-04-25T22:51:54.017074+0000","last_peered":"2024-04-25T22:51:54.017074+0000","last_clean":"2024-04-25T22:51:54.017074+0000","last_became_active":"2024-04-25T22:51:53.019197+0000","last_became_peered":"2024-04-25T22:51:53.019197+0000","last_unstale":"2024-04-25T22:51:54.017074+0000","last_undegraded":"2024-04-25T22:51:54.017074+0000","last_fullsized":"2024-04-25T22:51:54.017074+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:12:00.793718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017428+0000","last_change":"2024-04-25T22:51:53.020857+0000","last_active":"2024-04-25T22:51:54.017428+0000","last_peered":"2024-04-25T22:51:54.017428+0000","last_clean":"2024-04-25T22:51:54.017428+0000","last_became_active":"2024-04-25T22:51:53.018340+0000","last_became_peered":"2024-04-25T22:51:53.018340+0000","last_unstale":"2024-04-25T22:51:54.017428+0000","last_undegraded":"2024-04-25T22:51:54.017428+0000","last_fullsized":"2024-04-25T22:51:54.017428+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:32.923620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053001+0000","last_change":"2024-04-25T22:51:53.025101+0000","last_active":"2024-04-25T22:51:54.053001+0000","last_peered":"2024-04-25T22:51:54.053001+0000","last_clean":"2024-04-25T22:51:54.053001+0000","last_became_active":"2024-04-25T22:51:53.024643+0000","last_became_peered":"2024-04-25T22:51:53.024643+0000","last_unstale":"2024-04-25T22:51:54.053001+0000","last_undegraded":"2024-04-25T22:51:54.053001+0000","last_fullsized":"2024-04-25T22:51:54.053001+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:58:11.470631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018622+0000","last_change":"2024-04-25T22:51:52.017181+0000","last_active":"2024-04-25T22:51:54.018622+0000","last_peered":"2024-04-25T22:51:54.018622+0000","last_clean":"2024-04-25T22:51:54.018622+0000","last_became_active":"2024-04-25T22:51:52.016682+0000","last_became_peered":"2024-04-25T22:51:52.016682+0000","last_unstale":"2024-04-25T22:51:54.018622+0000","last_undegraded":"2024-04-25T22:51:54.018622+0000","last_fullsized":"2024-04-25T22:51:54.018622+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:18:00.975479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053150+0000","last_change":"2024-04-25T22:51:53.026414+0000","last_active":"2024-04-25T22:51:54.053150+0000","last_peered":"2024-04-25T22:51:54.053150+0000","last_clean":"2024-04-25T22:51:54.053150+0000","last_became_active":"2024-04-25T22:51:53.025591+0000","last_became_peered":"2024-04-25T22:51:53.025591+0000","last_unstale":"2024-04-25T22:51:54.053150+0000","last_undegraded":"2024-04-25T22:51:54.053150+0000","last_fullsized":"2024-04-25T22:51:54.053150+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:12:08.770479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017399+0000","last_change":"2024-04-25T22:51:52.019690+0000","last_active":"2024-04-25T22:51:54.017399+0000","last_peered":"2024-04-25T22:51:54.017399+0000","last_clean":"2024-04-25T22:51:54.017399+0000","last_became_active":"2024-04-25T22:51:52.018818+0000","last_became_peered":"2024-04-25T22:51:52.018818+0000","last_unstale":"2024-04-25T22:51:54.017399+0000","last_undegraded":"2024-04-25T22:51:54.017399+0000","last_fullsized":"2024-04-25T22:51:54.017399+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:25:48.361495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018267+0000","last_change":"2024-04-25T22:51:53.023197+0000","last_active":"2024-04-25T22:51:54.018267+0000","last_peered":"2024-04-25T22:51:54.018267+0000","last_clean":"2024-04-25T22:51:54.018267+0000","last_became_active":"2024-04-25T22:51:53.022627+0000","last_became_peered":"2024-04-25T22:51:53.022627+0000","last_unstale":"2024-04-25T22:51:54.018267+0000","last_undegraded":"2024-04-25T22:51:54.018267+0000","last_fullsized":"2024-04-25T22:51:54.018267+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:44:59.401139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052236+0000","last_change":"2024-04-25T22:51:52.018646+0000","last_active":"2024-04-25T22:51:54.052236+0000","last_peered":"2024-04-25T22:51:54.052236+0000","last_clean":"2024-04-25T22:51:54.052236+0000","last_became_active":"2024-04-25T22:51:52.018313+0000","last_became_peered":"2024-04-25T22:51:52.018313+0000","last_unstale":"2024-04-25T22:51:54.052236+0000","last_undegraded":"2024-04-25T22:51:54.052236+0000","last_fullsized":"2024-04-25T22:51:54.052236+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:00:21.688745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018104+0000","last_change":"2024-04-25T22:51:53.022419+0000","last_active":"2024-04-25T22:51:54.018104+0000","last_peered":"2024-04-25T22:51:54.018104+0000","last_clean":"2024-04-25T22:51:54.018104+0000","last_became_active":"2024-04-25T22:51:53.021405+0000","last_became_peered":"2024-04-25T22:51:53.021405+0000","last_unstale":"2024-04-25T22:51:54.018104+0000","last_undegraded":"2024-04-25T22:51:54.018104+0000","last_fullsized":"2024-04-25T22:51:54.018104+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:28:42.903045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":22,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017441+0000","last_change":"2024-04-25T22:51:52.021510+0000","last_active":"2024-04-25T22:51:54.017441+0000","last_peered":"2024-04-25T22:51:54.017441+0000","last_clean":"2024-04-25T22:51:54.017441+0000","last_became_active":"2024-04-25T22:51:52.021145+0000","last_became_peered":"2024-04-25T22:51:52.021145+0000","last_unstale":"2024-04-25T22:51:54.017441+0000","last_undegraded":"2024-04-25T22:51:54.017441+0000","last_fullsized":"2024-04-25T22:51:54.017441+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:05.110747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018420+0000","last_change":"2024-04-25T22:51:52.021355+0000","last_active":"2024-04-25T22:51:54.018420+0000","last_peered":"2024-04-25T22:51:54.018420+0000","last_clean":"2024-04-25T22:51:54.018420+0000","last_became_active":"2024-04-25T22:51:52.020860+0000","last_became_peered":"2024-04-25T22:51:52.020860+0000","last_unstale":"2024-04-25T22:51:54.018420+0000","last_undegraded":"2024-04-25T22:51:54.018420+0000","last_fullsized":"2024-04-25T22:51:54.018420+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:55.235787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.051967+0000","last_change":"2024-04-25T22:51:53.029390+0000","last_active":"2024-04-25T22:51:54.051967+0000","last_peered":"2024-04-25T22:51:54.051967+0000","last_clean":"2024-04-25T22:51:54.051967+0000","last_became_active":"2024-04-25T22:51:53.029157+0000","last_became_peered":"2024-04-25T22:51:53.029157+0000","last_unstale":"2024-04-25T22:51:54.051967+0000","last_undegraded":"2024-04-25T22:51:54.051967+0000","last_fullsized":"2024-04-25T22:51:54.051967+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:51:43.808994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053167+0000","last_change":"2024-04-25T22:51:52.018856+0000","last_active":"2024-04-25T22:51:54.053167+0000","last_peered":"2024-04-25T22:51:54.053167+0000","last_clean":"2024-04-25T22:51:54.053167+0000","last_became_active":"2024-04-25T22:51:52.018390+0000","last_became_peered":"2024-04-25T22:51:52.018390+0000","last_unstale":"2024-04-25T22:51:54.053167+0000","last_undegraded":"2024-04-25T22:51:54.053167+0000","last_fullsized":"2024-04-25T22:51:54.053167+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:42:54.430484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052143+0000","last_change":"2024-04-25T22:51:53.024599+0000","last_active":"2024-04-25T22:51:54.052143+0000","last_peered":"2024-04-25T22:51:54.052143+0000","last_clean":"2024-04-25T22:51:54.052143+0000","last_became_active":"2024-04-25T22:51:53.024155+0000","last_became_peered":"2024-04-25T22:51:53.024155+0000","last_unstale":"2024-04-25T22:51:54.052143+0000","last_undegraded":"2024-04-25T22:51:54.052143+0000","last_fullsized":"2024-04-25T22:51:54.052143+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:09:52.869451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018756+0000","last_change":"2024-04-25T22:51:52.019724+0000","last_active":"2024-04-25T22:51:54.018756+0000","last_peered":"2024-04-25T22:51:54.018756+0000","last_clean":"2024-04-25T22:51:54.018756+0000","last_became_active":"2024-04-25T22:51:52.019167+0000","last_became_peered":"2024-04-25T22:51:52.019167+0000","last_unstale":"2024-04-25T22:51:54.018756+0000","last_undegraded":"2024-04-25T22:51:54.018756+0000","last_fullsized":"2024-04-25T22:51:54.018756+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:03:14.826593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017804+0000","last_change":"2024-04-25T22:51:53.017327+0000","last_active":"2024-04-25T22:51:54.017804+0000","last_peered":"2024-04-25T22:51:54.017804+0000","last_clean":"2024-04-25T22:51:54.017804+0000","last_became_active":"2024-04-25T22:51:53.015987+0000","last_became_peered":"2024-04-25T22:51:53.015987+0000","last_unstale":"2024-04-25T22:51:54.017804+0000","last_undegraded":"2024-04-25T22:51:54.017804+0000","last_fullsized":"2024-04-25T22:51:54.017804+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:16.602188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018741+0000","last_change":"2024-04-25T22:51:52.016151+0000","last_active":"2024-04-25T22:51:54.018741+0000","last_peered":"2024-04-25T22:51:54.018741+0000","last_clean":"2024-04-25T22:51:54.018741+0000","last_became_active":"2024-04-25T22:51:52.015741+0000","last_became_peered":"2024-04-25T22:51:52.015741+0000","last_unstale":"2024-04-25T22:51:54.018741+0000","last_undegraded":"2024-04-25T22:51:54.018741+0000","last_fullsized":"2024-04-25T22:51:54.018741+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:02:25.133948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018157+0000","last_change":"2024-04-25T22:51:53.021208+0000","last_active":"2024-04-25T22:51:54.018157+0000","last_peered":"2024-04-25T22:51:54.018157+0000","last_clean":"2024-04-25T22:51:54.018157+0000","last_became_active":"2024-04-25T22:51:53.020752+0000","last_became_peered":"2024-04-25T22:51:53.020752+0000","last_unstale":"2024-04-25T22:51:54.018157+0000","last_undegraded":"2024-04-25T22:51:54.018157+0000","last_fullsized":"2024-04-25T22:51:54.018157+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:16.602188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017996+0000","last_change":"2024-04-25T22:51:52.018716+0000","last_active":"2024-04-25T22:51:54.017996+0000","last_peered":"2024-04-25T22:51:54.017996+0000","last_clean":"2024-04-25T22:51:54.017996+0000","last_became_active":"2024-04-25T22:51:52.018140+0000","last_became_peered":"2024-04-25T22:51:52.018140+0000","last_unstale":"2024-04-25T22:51:54.017996+0000","last_undegraded":"2024-04-25T22:51:54.017996+0000","last_fullsized":"2024-04-25T22:51:54.017996+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:02:25.133948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018609+0000","last_change":"2024-04-25T22:51:53.019508+0000","last_active":"2024-04-25T22:51:54.018609+0000","last_peered":"2024-04-25T22:51:54.018609+0000","last_clean":"2024-04-25T22:51:54.018609+0000","last_became_active":"2024-04-25T22:51:53.016749+0000","last_became_peered":"2024-04-25T22:51:53.016749+0000","last_unstale":"2024-04-25T22:51:54.018609+0000","last_undegraded":"2024-04-25T22:51:54.018609+0000","last_fullsized":"2024-04-25T22:51:54.018609+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:52:25.110416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018342+0000","last_change":"2024-04-25T22:51:52.022474+0000","last_active":"2024-04-25T22:51:54.018342+0000","last_peered":"2024-04-25T22:51:54.018342+0000","last_clean":"2024-04-25T22:51:54.018342+0000","last_became_active":"2024-04-25T22:51:52.022141+0000","last_became_peered":"2024-04-25T22:51:52.022141+0000","last_unstale":"2024-04-25T22:51:54.018342+0000","last_undegraded":"2024-04-25T22:51:54.018342+0000","last_fullsized":"2024-04-25T22:51:54.018342+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:17:10.500338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018670+0000","last_change":"2024-04-25T22:51:53.023929+0000","last_active":"2024-04-25T22:51:54.018670+0000","last_peered":"2024-04-25T22:51:54.018670+0000","last_clean":"2024-04-25T22:51:54.018670+0000","last_became_active":"2024-04-25T22:51:53.023405+0000","last_became_peered":"2024-04-25T22:51:53.023405+0000","last_unstale":"2024-04-25T22:51:54.018670+0000","last_undegraded":"2024-04-25T22:51:54.018670+0000","last_fullsized":"2024-04-25T22:51:54.018670+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:35:35.419823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052331+0000","last_change":"2024-04-25T22:51:52.018970+0000","last_active":"2024-04-25T22:51:54.052331+0000","last_peered":"2024-04-25T22:51:54.052331+0000","last_clean":"2024-04-25T22:51:54.052331+0000","last_became_active":"2024-04-25T22:51:52.018439+0000","last_became_peered":"2024-04-25T22:51:52.018439+0000","last_unstale":"2024-04-25T22:51:54.052331+0000","last_undegraded":"2024-04-25T22:51:54.052331+0000","last_fullsized":"2024-04-25T22:51:54.052331+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:24:31.748243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018219+0000","last_change":"2024-04-25T22:51:53.020574+0000","last_active":"2024-04-25T22:51:54.018219+0000","last_peered":"2024-04-25T22:51:54.018219+0000","last_clean":"2024-04-25T22:51:54.018219+0000","last_became_active":"2024-04-25T22:51:53.019978+0000","last_became_peered":"2024-04-25T22:51:53.019978+0000","last_unstale":"2024-04-25T22:51:54.018219+0000","last_undegraded":"2024-04-25T22:51:54.018219+0000","last_fullsized":"2024-04-25T22:51:54.018219+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:41.205051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052156+0000","last_change":"2024-04-25T22:51:52.017743+0000","last_active":"2024-04-25T22:51:54.052156+0000","last_peered":"2024-04-25T22:51:54.052156+0000","last_clean":"2024-04-25T22:51:54.052156+0000","last_became_active":"2024-04-25T22:51:52.016659+0000","last_became_peered":"2024-04-25T22:51:52.016659+0000","last_unstale":"2024-04-25T22:51:54.052156+0000","last_undegraded":"2024-04-25T22:51:54.052156+0000","last_fullsized":"2024-04-25T22:51:54.052156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:49:07.912197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018170+0000","last_change":"2024-04-25T22:51:53.023278+0000","last_active":"2024-04-25T22:51:54.018170+0000","last_peered":"2024-04-25T22:51:54.018170+0000","last_clean":"2024-04-25T22:51:54.018170+0000","last_became_active":"2024-04-25T22:51:53.021948+0000","last_became_peered":"2024-04-25T22:51:53.021948+0000","last_unstale":"2024-04-25T22:51:54.018170+0000","last_undegraded":"2024-04-25T22:51:54.018170+0000","last_fullsized":"2024-04-25T22:51:54.018170+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:31:22.231993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":216,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017807+0000","last_change":"2024-04-25T22:51:47.764624+0000","last_active":"2024-04-25T22:51:54.017807+0000","last_peered":"2024-04-25T22:51:54.017807+0000","last_clean":"2024-04-25T22:51:54.017807+0000","last_became_active":"2024-04-25T22:51:47.764176+0000","last_became_peered":"2024-04-25T22:51:47.764176+0000","last_unstale":"2024-04-25T22:51:54.017807+0000","last_undegraded":"2024-04-25T22:51:54.017807+0000","last_fullsized":"2024-04-25T22:51:54.017807+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:59:39.005489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018697+0000","last_change":"2024-04-25T22:51:47.768368+0000","last_active":"2024-04-25T22:51:54.018697+0000","last_peered":"2024-04-25T22:51:54.018697+0000","last_clean":"2024-04-25T22:51:54.018697+0000","last_became_active":"2024-04-25T22:51:47.768003+0000","last_became_peered":"2024-04-25T22:51:47.768003+0000","last_unstale":"2024-04-25T22:51:54.018697+0000","last_undegraded":"2024-04-25T22:51:54.018697+0000","last_fullsized":"2024-04-25T22:51:54.018697+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:10:00.098072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017829+0000","last_change":"2024-04-25T22:51:52.014376+0000","last_active":"2024-04-25T22:51:54.017829+0000","last_peered":"2024-04-25T22:51:54.017829+0000","last_clean":"2024-04-25T22:51:54.017829+0000","last_became_active":"2024-04-25T22:51:52.013816+0000","last_became_peered":"2024-04-25T22:51:52.013816+0000","last_unstale":"2024-04-25T22:51:54.017829+0000","last_undegraded":"2024-04-25T22:51:54.017829+0000","last_fullsized":"2024-04-25T22:51:54.017829+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:18.136883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018819+0000","last_change":"2024-04-25T22:51:53.024106+0000","last_active":"2024-04-25T22:51:54.018819+0000","last_peered":"2024-04-25T22:51:54.018819+0000","last_clean":"2024-04-25T22:51:54.018819+0000","last_became_active":"2024-04-25T22:51:53.023497+0000","last_became_peered":"2024-04-25T22:51:53.023497+0000","last_unstale":"2024-04-25T22:51:54.018819+0000","last_undegraded":"2024-04-25T22:51:54.018819+0000","last_fullsized":"2024-04-25T22:51:54.018819+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:52:16.918935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017591+0000","last_change":"2024-04-25T22:51:47.764591+0000","last_active":"2024-04-25T22:51:54.017591+0000","last_peered":"2024-04-25T22:51:54.017591+0000","last_clean":"2024-04-25T22:51:54.017591+0000","last_became_active":"2024-04-25T22:51:47.764229+0000","last_became_peered":"2024-04-25T22:51:47.764229+0000","last_unstale":"2024-04-25T22:51:54.017591+0000","last_undegraded":"2024-04-25T22:51:54.017591+0000","last_fullsized":"2024-04-25T22:51:54.017591+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:32.854624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017358+0000","last_change":"2024-04-25T22:51:52.017918+0000","last_active":"2024-04-25T22:51:54.017358+0000","last_peered":"2024-04-25T22:51:54.017358+0000","last_clean":"2024-04-25T22:51:54.017358+0000","last_became_active":"2024-04-25T22:51:52.017541+0000","last_became_peered":"2024-04-25T22:51:52.017541+0000","last_unstale":"2024-04-25T22:51:54.017358+0000","last_undegraded":"2024-04-25T22:51:54.017358+0000","last_fullsized":"2024-04-25T22:51:54.017358+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:17:10.500338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052996+0000","last_change":"2024-04-25T22:51:53.026971+0000","last_active":"2024-04-25T22:51:54.052996+0000","last_peered":"2024-04-25T22:51:54.052996+0000","last_clean":"2024-04-25T22:51:54.052996+0000","last_became_active":"2024-04-25T22:51:53.026355+0000","last_became_peered":"2024-04-25T22:51:53.026355+0000","last_unstale":"2024-04-25T22:51:54.052996+0000","last_undegraded":"2024-04-25T22:51:54.052996+0000","last_fullsized":"2024-04-25T22:51:54.052996+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:16.602188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017440+0000","last_change":"2024-04-25T22:51:47.762564+0000","last_active":"2024-04-25T22:51:54.017440+0000","last_peered":"2024-04-25T22:51:54.017440+0000","last_clean":"2024-04-25T22:51:54.017440+0000","last_became_active":"2024-04-25T22:51:47.762218+0000","last_became_peered":"2024-04-25T22:51:47.762218+0000","last_unstale":"2024-04-25T22:51:54.017440+0000","last_undegraded":"2024-04-25T22:51:54.017440+0000","last_fullsized":"2024-04-25T22:51:54.017440+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:09:06.117740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052192+0000","last_change":"2024-04-25T22:51:52.018873+0000","last_active":"2024-04-25T22:51:54.052192+0000","last_peered":"2024-04-25T22:51:54.052192+0000","last_clean":"2024-04-25T22:51:54.052192+0000","last_became_active":"2024-04-25T22:51:52.018300+0000","last_became_peered":"2024-04-25T22:51:52.018300+0000","last_unstale":"2024-04-25T22:51:54.052192+0000","last_undegraded":"2024-04-25T22:51:54.052192+0000","last_fullsized":"2024-04-25T22:51:54.052192+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:25:22.660789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018295+0000","last_change":"2024-04-25T22:51:53.023461+0000","last_active":"2024-04-25T22:51:54.018295+0000","last_peered":"2024-04-25T22:51:54.018295+0000","last_clean":"2024-04-25T22:51:54.018295+0000","last_became_active":"2024-04-25T22:51:53.022017+0000","last_became_peered":"2024-04-25T22:51:53.022017+0000","last_unstale":"2024-04-25T22:51:54.018295+0000","last_undegraded":"2024-04-25T22:51:54.018295+0000","last_fullsized":"2024-04-25T22:51:54.018295+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:43:47.453569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018255+0000","last_change":"2024-04-25T22:51:47.768269+0000","last_active":"2024-04-25T22:51:54.018255+0000","last_peered":"2024-04-25T22:51:54.018255+0000","last_clean":"2024-04-25T22:51:54.018255+0000","last_became_active":"2024-04-25T22:51:47.767991+0000","last_became_peered":"2024-04-25T22:51:47.767991+0000","last_unstale":"2024-04-25T22:51:54.018255+0000","last_undegraded":"2024-04-25T22:51:54.018255+0000","last_fullsized":"2024-04-25T22:51:54.018255+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:01:54.134289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018678+0000","last_change":"2024-04-25T22:51:52.021220+0000","last_active":"2024-04-25T22:51:54.018678+0000","last_peered":"2024-04-25T22:51:54.018678+0000","last_clean":"2024-04-25T22:51:54.018678+0000","last_became_active":"2024-04-25T22:51:52.020833+0000","last_became_peered":"2024-04-25T22:51:52.020833+0000","last_unstale":"2024-04-25T22:51:54.018678+0000","last_undegraded":"2024-04-25T22:51:54.018678+0000","last_fullsized":"2024-04-25T22:51:54.018678+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:12.627716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018128+0000","last_change":"2024-04-25T22:51:53.020666+0000","last_active":"2024-04-25T22:51:54.018128+0000","last_peered":"2024-04-25T22:51:54.018128+0000","last_clean":"2024-04-25T22:51:54.018128+0000","last_became_active":"2024-04-25T22:51:53.020212+0000","last_became_peered":"2024-04-25T22:51:53.020212+0000","last_unstale":"2024-04-25T22:51:54.018128+0000","last_undegraded":"2024-04-25T22:51:54.018128+0000","last_fullsized":"2024-04-25T22:51:54.018128+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:12:08.770479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018823+0000","last_change":"2024-04-25T22:51:52.016362+0000","last_active":"2024-04-25T22:51:54.018823+0000","last_peered":"2024-04-25T22:51:54.018823+0000","last_clean":"2024-04-25T22:51:54.018823+0000","last_became_active":"2024-04-25T22:51:52.015409+0000","last_became_peered":"2024-04-25T22:51:52.015409+0000","last_unstale":"2024-04-25T22:51:54.018823+0000","last_undegraded":"2024-04-25T22:51:54.018823+0000","last_fullsized":"2024-04-25T22:51:54.018823+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:21:19.563620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018072+0000","last_change":"2024-04-25T22:51:47.761131+0000","last_active":"2024-04-25T22:51:54.018072+0000","last_peered":"2024-04-25T22:51:54.018072+0000","last_clean":"2024-04-25T22:51:54.018072+0000","last_became_active":"2024-04-25T22:51:47.760894+0000","last_became_peered":"2024-04-25T22:51:47.760894+0000","last_unstale":"2024-04-25T22:51:54.018072+0000","last_undegraded":"2024-04-25T22:51:54.018072+0000","last_fullsized":"2024-04-25T22:51:54.018072+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:38:28.554024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052447+0000","last_change":"2024-04-25T22:51:53.026321+0000","last_active":"2024-04-25T22:51:54.052447+0000","last_peered":"2024-04-25T22:51:54.052447+0000","last_clean":"2024-04-25T22:51:54.052447+0000","last_became_active":"2024-04-25T22:51:53.025824+0000","last_became_peered":"2024-04-25T22:51:53.025824+0000","last_unstale":"2024-04-25T22:51:54.052447+0000","last_undegraded":"2024-04-25T22:51:54.052447+0000","last_fullsized":"2024-04-25T22:51:54.052447+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:12:00.793718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017995+0000","last_change":"2024-04-25T22:51:52.015638+0000","last_active":"2024-04-25T22:51:54.017995+0000","last_peered":"2024-04-25T22:51:54.017995+0000","last_clean":"2024-04-25T22:51:54.017995+0000","last_became_active":"2024-04-25T22:51:52.014858+0000","last_became_peered":"2024-04-25T22:51:52.014858+0000","last_unstale":"2024-04-25T22:51:54.017995+0000","last_undegraded":"2024-04-25T22:51:54.017995+0000","last_fullsized":"2024-04-25T22:51:54.017995+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:44:34.159650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053349+0000","last_change":"2024-04-25T22:51:47.765532+0000","last_active":"2024-04-25T22:51:54.053349+0000","last_peered":"2024-04-25T22:51:54.053349+0000","last_clean":"2024-04-25T22:51:54.053349+0000","last_became_active":"2024-04-25T22:51:47.765247+0000","last_became_peered":"2024-04-25T22:51:47.765247+0000","last_unstale":"2024-04-25T22:51:54.053349+0000","last_undegraded":"2024-04-25T22:51:54.053349+0000","last_fullsized":"2024-04-25T22:51:54.053349+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:55:05.342938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052632+0000","last_change":"2024-04-25T22:51:53.027051+0000","last_active":"2024-04-25T22:51:54.052632+0000","last_peered":"2024-04-25T22:51:54.052632+0000","last_clean":"2024-04-25T22:51:54.052632+0000","last_became_active":"2024-04-25T22:51:53.026458+0000","last_became_peered":"2024-04-25T22:51:53.026458+0000","last_unstale":"2024-04-25T22:51:54.052632+0000","last_undegraded":"2024-04-25T22:51:54.052632+0000","last_fullsized":"2024-04-25T22:51:54.052632+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:11:09.179564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018550+0000","last_change":"2024-04-25T22:51:52.015635+0000","last_active":"2024-04-25T22:51:54.018550+0000","last_peered":"2024-04-25T22:51:54.018550+0000","last_clean":"2024-04-25T22:51:54.018550+0000","last_became_active":"2024-04-25T22:51:52.014778+0000","last_became_peered":"2024-04-25T22:51:52.014778+0000","last_unstale":"2024-04-25T22:51:54.018550+0000","last_undegraded":"2024-04-25T22:51:54.018550+0000","last_fullsized":"2024-04-25T22:51:54.018550+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:21:19.563620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018314+0000","last_change":"2024-04-25T22:51:47.762468+0000","last_active":"2024-04-25T22:51:54.018314+0000","last_peered":"2024-04-25T22:51:54.018314+0000","last_clean":"2024-04-25T22:51:54.018314+0000","last_became_active":"2024-04-25T22:51:47.762199+0000","last_became_peered":"2024-04-25T22:51:47.762199+0000","last_unstale":"2024-04-25T22:51:54.018314+0000","last_undegraded":"2024-04-25T22:51:54.018314+0000","last_fullsized":"2024-04-25T22:51:54.018314+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:32.854624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017184+0000","last_change":"2024-04-25T22:51:53.023317+0000","last_active":"2024-04-25T22:51:54.017184+0000","last_peered":"2024-04-25T22:51:54.017184+0000","last_clean":"2024-04-25T22:51:54.017184+0000","last_became_active":"2024-04-25T22:51:53.022756+0000","last_became_peered":"2024-04-25T22:51:53.022756+0000","last_unstale":"2024-04-25T22:51:54.017184+0000","last_undegraded":"2024-04-25T22:51:54.017184+0000","last_fullsized":"2024-04-25T22:51:54.017184+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:37:13.419317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:55.011718+0000","last_change":"2024-04-25T22:51:52.017845+0000","last_active":"2024-04-25T22:51:55.011718+0000","last_peered":"2024-04-25T22:51:55.011718+0000","last_clean":"2024-04-25T22:51:55.011718+0000","last_became_active":"2024-04-25T22:51:52.017521+0000","last_became_peered":"2024-04-25T22:51:52.017521+0000","last_unstale":"2024-04-25T22:51:55.011718+0000","last_undegraded":"2024-04-25T22:51:55.011718+0000","last_fullsized":"2024-04-25T22:51:55.011718+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:18:00.975479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018392+0000","last_change":"2024-04-25T22:51:47.764288+0000","last_active":"2024-04-25T22:51:54.018392+0000","last_peered":"2024-04-25T22:51:54.018392+0000","last_clean":"2024-04-25T22:51:54.018392+0000","last_became_active":"2024-04-25T22:51:47.763961+0000","last_became_peered":"2024-04-25T22:51:47.763961+0000","last_unstale":"2024-04-25T22:51:54.018392+0000","last_undegraded":"2024-04-25T22:51:54.018392+0000","last_fullsized":"2024-04-25T22:51:54.018392+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:03:07.164842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052084+0000","last_change":"2024-04-25T22:51:53.026925+0000","last_active":"2024-04-25T22:51:54.052084+0000","last_peered":"2024-04-25T22:51:54.052084+0000","last_clean":"2024-04-25T22:51:54.052084+0000","last_became_active":"2024-04-25T22:51:53.026419+0000","last_became_peered":"2024-04-25T22:51:53.026419+0000","last_unstale":"2024-04-25T22:51:54.052084+0000","last_undegraded":"2024-04-25T22:51:54.052084+0000","last_fullsized":"2024-04-25T22:51:54.052084+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:49:38.102060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018559+0000","last_change":"2024-04-25T22:51:53.022222+0000","last_active":"2024-04-25T22:51:54.018559+0000","last_peered":"2024-04-25T22:51:54.018559+0000","last_clean":"2024-04-25T22:51:54.018559+0000","last_became_active":"2024-04-25T22:51:53.021687+0000","last_became_peered":"2024-04-25T22:51:53.021687+0000","last_unstale":"2024-04-25T22:51:54.018559+0000","last_undegraded":"2024-04-25T22:51:54.018559+0000","last_fullsized":"2024-04-25T22:51:54.018559+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:35:06.234402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018650+0000","last_change":"2024-04-25T22:51:52.019928+0000","last_active":"2024-04-25T22:51:54.018650+0000","last_peered":"2024-04-25T22:51:54.018650+0000","last_clean":"2024-04-25T22:51:54.018650+0000","last_became_active":"2024-04-25T22:51:52.019264+0000","last_became_peered":"2024-04-25T22:51:52.019264+0000","last_unstale":"2024-04-25T22:51:54.018650+0000","last_undegraded":"2024-04-25T22:51:54.018650+0000","last_fullsized":"2024-04-25T22:51:54.018650+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:18.136883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017393+0000","last_change":"2024-04-25T22:51:53.020652+0000","last_active":"2024-04-25T22:51:54.017393+0000","last_peered":"2024-04-25T22:51:54.017393+0000","last_clean":"2024-04-25T22:51:54.017393+0000","last_became_active":"2024-04-25T22:51:53.020129+0000","last_became_peered":"2024-04-25T22:51:53.020129+0000","last_unstale":"2024-04-25T22:51:54.017393+0000","last_undegraded":"2024-04-25T22:51:54.017393+0000","last_fullsized":"2024-04-25T22:51:54.017393+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:18:31.139968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053289+0000","last_change":"2024-04-25T22:51:52.018977+0000","last_active":"2024-04-25T22:51:54.053289+0000","last_peered":"2024-04-25T22:51:54.053289+0000","last_clean":"2024-04-25T22:51:54.053289+0000","last_became_active":"2024-04-25T22:51:52.018519+0000","last_became_peered":"2024-04-25T22:51:52.018519+0000","last_unstale":"2024-04-25T22:51:54.053289+0000","last_undegraded":"2024-04-25T22:51:54.053289+0000","last_fullsized":"2024-04-25T22:51:54.053289+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:53:07.306148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018416+0000","last_change":"2024-04-25T22:51:52.022177+0000","last_active":"2024-04-25T22:51:54.018416+0000","last_peered":"2024-04-25T22:51:54.018416+0000","last_clean":"2024-04-25T22:51:54.018416+0000","last_became_active":"2024-04-25T22:51:52.021882+0000","last_became_peered":"2024-04-25T22:51:52.021882+0000","last_unstale":"2024-04-25T22:51:54.018416+0000","last_undegraded":"2024-04-25T22:51:54.018416+0000","last_fullsized":"2024-04-25T22:51:54.018416+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:44:34.159650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017107+0000","last_change":"2024-04-25T22:51:53.022499+0000","last_active":"2024-04-25T22:51:54.017107+0000","last_peered":"2024-04-25T22:51:54.017107+0000","last_clean":"2024-04-25T22:51:54.017107+0000","last_became_active":"2024-04-25T22:51:53.022018+0000","last_became_peered":"2024-04-25T22:51:53.022018+0000","last_unstale":"2024-04-25T22:51:54.017107+0000","last_undegraded":"2024-04-25T22:51:54.017107+0000","last_fullsized":"2024-04-25T22:51:54.017107+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:33:24.700106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018441+0000","last_change":"2024-04-25T22:51:52.019673+0000","last_active":"2024-04-25T22:51:54.018441+0000","last_peered":"2024-04-25T22:51:54.018441+0000","last_clean":"2024-04-25T22:51:54.018441+0000","last_became_active":"2024-04-25T22:51:52.018877+0000","last_became_peered":"2024-04-25T22:51:52.018877+0000","last_unstale":"2024-04-25T22:51:54.018441+0000","last_undegraded":"2024-04-25T22:51:54.018441+0000","last_fullsized":"2024-04-25T22:51:54.018441+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:05.110747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017316+0000","last_change":"2024-04-25T22:51:53.020927+0000","last_active":"2024-04-25T22:51:54.017316+0000","last_peered":"2024-04-25T22:51:54.017316+0000","last_clean":"2024-04-25T22:51:54.017316+0000","last_became_active":"2024-04-25T22:51:53.020366+0000","last_became_peered":"2024-04-25T22:51:53.020366+0000","last_unstale":"2024-04-25T22:51:54.017316+0000","last_undegraded":"2024-04-25T22:51:54.017316+0000","last_fullsized":"2024-04-25T22:51:54.017316+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:55:27.934567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053387+0000","last_change":"2024-04-25T22:51:53.029210+0000","last_active":"2024-04-25T22:51:54.053387+0000","last_peered":"2024-04-25T22:51:54.053387+0000","last_clean":"2024-04-25T22:51:54.053387+0000","last_became_active":"2024-04-25T22:51:53.028635+0000","last_became_peered":"2024-04-25T22:51:53.028635+0000","last_unstale":"2024-04-25T22:51:54.053387+0000","last_undegraded":"2024-04-25T22:51:54.053387+0000","last_fullsized":"2024-04-25T22:51:54.053387+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:41.205051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017373+0000","last_change":"2024-04-25T22:51:52.014897+0000","last_active":"2024-04-25T22:51:54.017373+0000","last_peered":"2024-04-25T22:51:54.017373+0000","last_clean":"2024-04-25T22:51:54.017373+0000","last_became_active":"2024-04-25T22:51:52.014344+0000","last_became_peered":"2024-04-25T22:51:52.014344+0000","last_unstale":"2024-04-25T22:51:54.017373+0000","last_undegraded":"2024-04-25T22:51:54.017373+0000","last_fullsized":"2024-04-25T22:51:54.017373+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:55.235787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018063+0000","last_change":"2024-04-25T22:51:53.022920+0000","last_active":"2024-04-25T22:51:54.018063+0000","last_peered":"2024-04-25T22:51:54.018063+0000","last_clean":"2024-04-25T22:51:54.018063+0000","last_became_active":"2024-04-25T22:51:53.022190+0000","last_became_peered":"2024-04-25T22:51:53.022190+0000","last_unstale":"2024-04-25T22:51:54.018063+0000","last_undegraded":"2024-04-25T22:51:54.018063+0000","last_fullsized":"2024-04-25T22:51:54.018063+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:16.187194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017261+0000","last_change":"2024-04-25T22:51:52.018371+0000","last_active":"2024-04-25T22:51:54.017261+0000","last_peered":"2024-04-25T22:51:54.017261+0000","last_clean":"2024-04-25T22:51:54.017261+0000","last_became_active":"2024-04-25T22:51:52.018027+0000","last_became_peered":"2024-04-25T22:51:52.018027+0000","last_unstale":"2024-04-25T22:51:54.017261+0000","last_undegraded":"2024-04-25T22:51:54.017261+0000","last_fullsized":"2024-04-25T22:51:54.017261+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:36:57.435877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052965+0000","last_change":"2024-04-25T22:51:53.028084+0000","last_active":"2024-04-25T22:51:54.052965+0000","last_peered":"2024-04-25T22:51:54.052965+0000","last_clean":"2024-04-25T22:51:54.052965+0000","last_became_active":"2024-04-25T22:51:53.027541+0000","last_became_peered":"2024-04-25T22:51:53.027541+0000","last_unstale":"2024-04-25T22:51:54.052965+0000","last_undegraded":"2024-04-25T22:51:54.052965+0000","last_fullsized":"2024-04-25T22:51:54.052965+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:28:42.903045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052565+0000","last_change":"2024-04-25T22:51:52.017006+0000","last_active":"2024-04-25T22:51:54.052565+0000","last_peered":"2024-04-25T22:51:54.052565+0000","last_clean":"2024-04-25T22:51:54.052565+0000","last_became_active":"2024-04-25T22:51:52.016667+0000","last_became_peered":"2024-04-25T22:51:52.016667+0000","last_unstale":"2024-04-25T22:51:54.052565+0000","last_undegraded":"2024-04-25T22:51:54.052565+0000","last_fullsized":"2024-04-25T22:51:54.052565+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:24:51.210288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052731+0000","last_change":"2024-04-25T22:51:53.024685+0000","last_active":"2024-04-25T22:51:54.052731+0000","last_peered":"2024-04-25T22:51:54.052731+0000","last_clean":"2024-04-25T22:51:54.052731+0000","last_became_active":"2024-04-25T22:51:53.024304+0000","last_became_peered":"2024-04-25T22:51:53.024304+0000","last_unstale":"2024-04-25T22:51:54.052731+0000","last_undegraded":"2024-04-25T22:51:54.052731+0000","last_fullsized":"2024-04-25T22:51:54.052731+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:18:31.139968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052731+0000","last_change":"2024-04-25T22:51:52.018973+0000","last_active":"2024-04-25T22:51:54.052731+0000","last_peered":"2024-04-25T22:51:54.052731+0000","last_clean":"2024-04-25T22:51:54.052731+0000","last_became_active":"2024-04-25T22:51:52.018503+0000","last_became_peered":"2024-04-25T22:51:52.018503+0000","last_unstale":"2024-04-25T22:51:54.052731+0000","last_undegraded":"2024-04-25T22:51:54.052731+0000","last_fullsized":"2024-04-25T22:51:54.052731+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:07:38.783124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017918+0000","last_change":"2024-04-25T22:51:53.018063+0000","last_active":"2024-04-25T22:51:54.017918+0000","last_peered":"2024-04-25T22:51:54.017918+0000","last_clean":"2024-04-25T22:51:54.017918+0000","last_became_active":"2024-04-25T22:51:53.016779+0000","last_became_peered":"2024-04-25T22:51:53.016779+0000","last_unstale":"2024-04-25T22:51:54.017918+0000","last_undegraded":"2024-04-25T22:51:54.017918+0000","last_fullsized":"2024-04-25T22:51:54.017918+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:58:11.470631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018527+0000","last_change":"2024-04-25T22:51:52.022209+0000","last_active":"2024-04-25T22:51:54.018527+0000","last_peered":"2024-04-25T22:51:54.018527+0000","last_clean":"2024-04-25T22:51:54.018527+0000","last_became_active":"2024-04-25T22:51:52.021868+0000","last_became_peered":"2024-04-25T22:51:52.021868+0000","last_unstale":"2024-04-25T22:51:54.018527+0000","last_undegraded":"2024-04-25T22:51:54.018527+0000","last_fullsized":"2024-04-25T22:51:54.018527+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:36:57.435877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018070+0000","last_change":"2024-04-25T22:51:53.017222+0000","last_active":"2024-04-25T22:51:54.018070+0000","last_peered":"2024-04-25T22:51:54.018070+0000","last_clean":"2024-04-25T22:51:54.018070+0000","last_became_active":"2024-04-25T22:51:53.015717+0000","last_became_peered":"2024-04-25T22:51:53.015717+0000","last_unstale":"2024-04-25T22:51:54.018070+0000","last_undegraded":"2024-04-25T22:51:54.018070+0000","last_fullsized":"2024-04-25T22:51:54.018070+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:43:47.453569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.053098+0000","last_change":"2024-04-25T22:51:52.019032+0000","last_active":"2024-04-25T22:51:54.053098+0000","last_peered":"2024-04-25T22:51:54.053098+0000","last_clean":"2024-04-25T22:51:54.053098+0000","last_became_active":"2024-04-25T22:51:52.018547+0000","last_became_peered":"2024-04-25T22:51:52.018547+0000","last_unstale":"2024-04-25T22:51:54.053098+0000","last_undegraded":"2024-04-25T22:51:54.053098+0000","last_fullsized":"2024-04-25T22:51:54.053098+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:10:00.056491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.052619+0000","last_change":"2024-04-25T22:51:53.024597+0000","last_active":"2024-04-25T22:51:54.052619+0000","last_peered":"2024-04-25T22:51:54.052619+0000","last_clean":"2024-04-25T22:51:54.052619+0000","last_became_active":"2024-04-25T22:51:53.024256+0000","last_became_peered":"2024-04-25T22:51:53.024256+0000","last_unstale":"2024-04-25T22:51:54.052619+0000","last_undegraded":"2024-04-25T22:51:54.052619+0000","last_fullsized":"2024-04-25T22:51:54.052619+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:55:27.934567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018241+0000","last_change":"2024-04-25T22:51:52.015581+0000","last_active":"2024-04-25T22:51:54.018241+0000","last_peered":"2024-04-25T22:51:54.018241+0000","last_clean":"2024-04-25T22:51:54.018241+0000","last_became_active":"2024-04-25T22:51:52.014530+0000","last_became_peered":"2024-04-25T22:51:52.014530+0000","last_unstale":"2024-04-25T22:51:54.018241+0000","last_undegraded":"2024-04-25T22:51:54.018241+0000","last_fullsized":"2024-04-25T22:51:54.018241+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:55:12.627716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.017722+0000","last_change":"2024-04-25T22:51:53.020744+0000","last_active":"2024-04-25T22:51:54.017722+0000","last_peered":"2024-04-25T22:51:54.017722+0000","last_clean":"2024-04-25T22:51:54.017722+0000","last_became_active":"2024-04-25T22:51:53.018283+0000","last_became_peered":"2024-04-25T22:51:53.018283+0000","last_unstale":"2024-04-25T22:51:54.017722+0000","last_undegraded":"2024-04-25T22:51:54.017722+0000","last_fullsized":"2024-04-25T22:51:54.017722+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:16.187194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T22:51:54.018313+0000","last_change":"2024-04-25T22:51:52.019730+0000","last_active":"2024-04-25T22:51:54.018313+0000","last_peered":"2024-04-25T22:51:54.018313+0000","last_clean":"2024-04-25T22:51:54.018313+0000","last_became_active":"2024-04-25T22:51:52.018987+0000","last_became_peered":"2024-04-25T22:51:52.018987+0000","last_unstale":"2024-04-25T22:51:54.018313+0000","last_undegraded":"2024-04-25T22:51:54.018313+0000","last_fullsized":"2024-04-25T22:51:54.018313+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:03:14.826593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738376,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31916,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339924,"statfs":{"total":96636764160,"available":96604082176,"internally_reserved":0,"allocated":749568,"data_stored":638245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738376,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":139264,"data_stored":46699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738376,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36084,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335756,"statfs":{"total":96636764160,"available":96599814144,"internally_reserved":0,"allocated":757760,"data_stored":638861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:52:13.496 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T22:52:13.496 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-04-25T22:52:13.827 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 15 2024-04-25T22:52:13.828 INFO:teuthology.orchestra.run.smithi052.stdout:fsid 5355b70e-3f7d-4bce-8676-89cee61d2089 2024-04-25T22:52:13.828 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-04-25T22:51:37.688525+0000 2024-04-25T22:52:13.828 INFO:teuthology.orchestra.run.smithi052.stdout:modified 2024-04-25T22:51:54.011012+0000 2024-04-25T22:52:13.828 INFO:teuthology.orchestra.run.smithi052.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-04-25T22:52:13.828 INFO:teuthology.orchestra.run.smithi052.stdout:crush_version 4 2024-04-25T22:52:13.828 INFO:teuthology.orchestra.run.smithi052.stdout:full_ratio 0.95 2024-04-25T22:52:13.828 INFO:teuthology.orchestra.run.smithi052.stdout:backfillfull_ratio 0.9 2024-04-25T22:52:13.828 INFO:teuthology.orchestra.run.smithi052.stdout:nearfull_ratio 0.85 2024-04-25T22:52:13.828 INFO:teuthology.orchestra.run.smithi052.stdout:require_min_compat_client luminous 2024-04-25T22:52:13.828 INFO:teuthology.orchestra.run.smithi052.stdout:min_compat_client jewel 2024-04-25T22:52:13.828 INFO:teuthology.orchestra.run.smithi052.stdout:require_osd_release squid 2024-04-25T22:52:13.828 INFO:teuthology.orchestra.run.smithi052.stdout:stretch_mode_enabled false 2024-04-25T22:52:13.828 INFO:teuthology.orchestra.run.smithi052.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 11 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 2.99 2024-04-25T22:52:13.829 INFO:teuthology.orchestra.run.smithi052.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 11 flags hashpspool stripe_width 0 application rbd read_balance_score 1.50 2024-04-25T22:52:13.829 INFO:teuthology.orchestra.run.smithi052.stdout:pool 3 'cephfs_metadata' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 14 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.13 2024-04-25T22:52:13.829 INFO:teuthology.orchestra.run.smithi052.stdout:pool 4 'cephfs_data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 15 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.13 2024-04-25T22:52:13.829 INFO:teuthology.orchestra.run.smithi052.stdout:max_osd 3 2024-04-25T22:52:13.829 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 up in weight 1 up_from 8 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:172.21.15.110:6800/3666753097,v1:172.21.15.110:6801/3666753097] [v2:172.21.15.110:6802/3666753097,v1:172.21.15.110:6803/3666753097] exists,up b785a86a-6391-4a0d-8aec-c2016380832e 2024-04-25T22:52:13.829 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 up in weight 1 up_from 8 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:172.21.15.164:6800/479301362,v1:172.21.15.164:6801/479301362] [v2:172.21.15.164:6802/479301362,v1:172.21.15.164:6803/479301362] exists,up 088b4733-ccbd-41a6-8a31-8d811169c28a 2024-04-25T22:52:13.829 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 up in weight 1 up_from 8 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:172.21.15.191:6800/349040881,v1:172.21.15.191:6801/349040881] [v2:172.21.15.191:6802/349040881,v1:172.21.15.191:6803/349040881] exists,up 6a6aad8c-22ac-45c0-baf9-928314e7fef9 2024-04-25T22:52:13.840 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 8 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:172.21.15.110:6800/3666753097,v1:172.21.15.110:6801/3666753097] [v2:172.21.15.110:6802/3666753097,v1:172.21.15.110:6803/3666753097] exists,up b785a86a-6391-4a0d-8aec-c2016380832e', 'osd.1 up in weight 1 up_from 8 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:172.21.15.164:6800/479301362,v1:172.21.15.164:6801/479301362] [v2:172.21.15.164:6802/479301362,v1:172.21.15.164:6803/479301362] exists,up 088b4733-ccbd-41a6-8a31-8d811169c28a', 'osd.2 up in weight 1 up_from 8 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:172.21.15.191:6800/349040881,v1:172.21.15.191:6801/349040881] [v2:172.21.15.191:6802/349040881,v1:172.21.15.191:6803/349040881] exists,up 6a6aad8c-22ac-45c0-baf9-928314e7fef9'] 2024-04-25T22:52:13.841 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-04-25T22:52:13.942 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-04-25T22:52:13.942 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "mon.a", 2024-04-25T22:52:13.943 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster": "ceph", 2024-04-25T22:52:13.943 INFO:teuthology.orchestra.run.smithi052.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-04-25T22:52:13.943 INFO:teuthology.orchestra.run.smithi052.stdout: "admin_socket_mode": "", 2024-04-25T22:52:13.943 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-04-25T22:52:13.943 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_client_required": "cephx, none", 2024-04-25T22:52:13.943 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_cluster_required": "cephx", 2024-04-25T22:52:13.943 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_debug": "true", 2024-04-25T22:52:13.943 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-04-25T22:52:13.943 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-04-25T22:52:13.943 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_service_required": "cephx", 2024-04-25T22:52:13.943 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_service_ticket_ttl": "240.000000", 2024-04-25T22:52:13.943 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_supported": "cephx", 2024-04-25T22:52:13.943 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_aio": "true", 2024-04-25T22:52:13.944 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_aio_max_queue_depth": "1024", 2024-04-25T22:52:13.944 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_aio_poll_ms": "250", 2024-04-25T22:52:13.944 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_aio_reap_max": "16", 2024-04-25T22:52:13.944 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_async_discard": "false", 2024-04-25T22:52:13.944 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_block_size": "4096", 2024-04-25T22:52:13.944 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_debug_aio": "false", 2024-04-25T22:52:13.944 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-04-25T22:52:13.944 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-04-25T22:52:13.944 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_debug_inflight_ios": "false", 2024-04-25T22:52:13.944 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_enable_discard": "false", 2024-04-25T22:52:13.944 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_flock_retry": "3", 2024-04-25T22:52:13.944 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_flock_retry_interval": "0.100000", 2024-04-25T22:52:13.944 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_inject_crash": "0", 2024-04-25T22:52:13.945 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_inject_crash_flush_delay": "2", 2024-04-25T22:52:13.945 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_ioring": "false", 2024-04-25T22:52:13.945 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_ioring_hipri": "false", 2024-04-25T22:52:13.945 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_ioring_sqthread_poll": "false", 2024-04-25T22:52:13.945 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-04-25T22:52:13.945 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_read_buffer_alignment": "4096", 2024-04-25T22:52:13.945 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-04-25T22:52:13.945 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_type": "", 2024-04-25T22:52:13.945 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_alloc_size": "1048576", 2024-04-25T22:52:13.945 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_allocator": "hybrid", 2024-04-25T22:52:13.945 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_buffered_io": "true", 2024-04-25T22:52:13.945 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_check_for_zeros": "false", 2024-04-25T22:52:13.945 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_check_volume_selector_often": "false", 2024-04-25T22:52:13.946 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-04-25T22:52:13.946 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_compact_log_sync": "false", 2024-04-25T22:52:13.946 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-04-25T22:52:13.946 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-04-25T22:52:13.946 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_log_compact_min_size": "16777216", 2024-04-25T22:52:13.946 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_log_replay_check_allocations": "true", 2024-04-25T22:52:13.946 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_max_log_runway": "4194304", 2024-04-25T22:52:13.946 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_max_prefetch": "1048576", 2024-04-25T22:52:13.946 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_min_flush_size": "524288", 2024-04-25T22:52:13.946 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_min_log_runway": "1048576", 2024-04-25T22:52:13.946 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_replay_recovery": "false", 2024-04-25T22:52:13.946 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-04-25T22:52:13.946 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_shared_alloc_size": "65536", 2024-04-25T22:52:13.947 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_sync_write": "false", 2024-04-25T22:52:13.947 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-04-25T22:52:13.947 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-04-25T22:52:13.947 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-04-25T22:52:13.947 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_allocation_from_file": "true", 2024-04-25T22:52:13.947 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_allocator": "hybrid", 2024-04-25T22:52:13.947 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-04-25T22:52:13.947 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-04-25T22:52:13.947 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-04-25T22:52:13.947 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-04-25T22:52:13.947 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-04-25T22:52:13.947 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-04-25T22:52:13.947 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_blobid_prealloc": "10240", 2024-04-25T22:52:13.947 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_block_create": "true", 2024-04-25T22:52:13.948 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_block_db_create": "false", 2024-04-25T22:52:13.948 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_block_db_path": "", 2024-04-25T22:52:13.948 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_block_db_size": "0", 2024-04-25T22:52:13.948 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_block_path": "", 2024-04-25T22:52:13.948 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_block_preallocate_file": "false", 2024-04-25T22:52:13.948 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_block_size": "107374182400", 2024-04-25T22:52:13.948 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_block_wal_create": "false", 2024-04-25T22:52:13.948 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_block_wal_path": "", 2024-04-25T22:52:13.948 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_block_wal_size": "100663296", 2024-04-25T22:52:13.948 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_bluefs": "true", 2024-04-25T22:52:13.948 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-04-25T22:52:13.948 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_bluefs_env_mirror": "false", 2024-04-25T22:52:13.948 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-04-25T22:52:13.949 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-04-25T22:52:13.949 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-04-25T22:52:13.949 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-04-25T22:52:13.949 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-04-25T22:52:13.949 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-04-25T22:52:13.949 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_autotune": "true", 2024-04-25T22:52:13.949 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-04-25T22:52:13.949 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-04-25T22:52:13.949 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-04-25T22:52:13.949 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-04-25T22:52:13.949 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_size": "0", 2024-04-25T22:52:13.949 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-04-25T22:52:13.949 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-04-25T22:52:13.949 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-04-25T22:52:13.950 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-04-25T22:52:13.950 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_type": "2q", 2024-04-25T22:52:13.950 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-04-25T22:52:13.950 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_clone_cow": "true", 2024-04-25T22:52:13.950 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_compression_algorithm": "snappy", 2024-04-25T22:52:13.950 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_compression_max_blob_size": "0", 2024-04-25T22:52:13.950 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-04-25T22:52:13.950 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-04-25T22:52:13.950 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_compression_min_blob_size": "0", 2024-04-25T22:52:13.950 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-04-25T22:52:13.950 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-04-25T22:52:13.950 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_compression_mode": "none", 2024-04-25T22:52:13.951 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-04-25T22:52:13.951 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_csum_type": "crc32c", 2024-04-25T22:52:13.951 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_enforce_settings": "default", 2024-04-25T22:52:13.951 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_freelist": "false", 2024-04-25T22:52:13.951 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_fsck_abort": "false", 2024-04-25T22:52:13.951 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-04-25T22:52:13.951 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-04-25T22:52:13.951 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_inject_read_err": "false", 2024-04-25T22:52:13.951 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_legacy_omap": "false", 2024-04-25T22:52:13.951 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-04-25T22:52:13.951 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-04-25T22:52:13.951 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-04-25T22:52:13.951 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-04-25T22:52:13.951 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_prefill": "0.000000", 2024-04-25T22:52:13.952 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-04-25T22:52:13.952 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-04-25T22:52:13.952 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-04-25T22:52:13.952 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_small_allocations": "0", 2024-04-25T22:52:13.952 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-04-25T22:52:13.952 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_default_buffered_read": "true", 2024-04-25T22:52:13.952 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_default_buffered_write": "false", 2024-04-25T22:52:13.952 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_deferred_batch_ops": "0", 2024-04-25T22:52:13.952 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-04-25T22:52:13.952 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-04-25T22:52:13.952 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_elastic_shared_blobs": "true", 2024-04-25T22:52:13.952 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-04-25T22:52:13.952 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-04-25T22:52:13.952 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-04-25T22:52:13.953 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-04-25T22:52:13.953 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-04-25T22:52:13.953 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fail_eio": "false", 2024-04-25T22:52:13.953 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-04-25T22:52:13.953 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-04-25T22:52:13.953 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-04-25T22:52:13.953 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-04-25T22:52:13.953 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_on_mkfs": "true", 2024-04-25T22:52:13.953 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-04-25T22:52:13.953 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_on_mount": "false", 2024-04-25T22:52:13.953 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-04-25T22:52:13.953 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_on_umount": "false", 2024-04-25T22:52:13.953 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-04-25T22:52:13.954 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-04-25T22:52:13.954 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-04-25T22:52:13.954 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-04-25T22:52:13.954 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-04-25T22:52:13.954 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-04-25T22:52:13.954 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-04-25T22:52:13.954 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-04-25T22:52:13.954 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_ignore_data_csum": "false", 2024-04-25T22:52:13.954 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-04-25T22:52:13.954 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_kvbackend": "rocksdb", 2024-04-25T22:52:13.954 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-04-25T22:52:13.954 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-04-25T22:52:13.954 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_log_op_age": "5.000000", 2024-04-25T22:52:13.955 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_max_alloc_size": "0", 2024-04-25T22:52:13.955 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_max_blob_size": "0", 2024-04-25T22:52:13.955 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-04-25T22:52:13.955 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-04-25T22:52:13.955 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_max_defer_interval": "3.000000", 2024-04-25T22:52:13.955 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_max_deferred_txc": "32", 2024-04-25T22:52:13.955 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_min_alloc_size": "0", 2024-04-25T22:52:13.955 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-04-25T22:52:13.955 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-04-25T22:52:13.955 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_nid_prealloc": "1024", 2024-04-25T22:52:13.955 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_prefer_deferred_size": "0", 2024-04-25T22:52:13.955 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-04-25T22:52:13.955 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-04-25T22:52:13.956 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_qfsck_on_mount": "true", 2024-04-25T22:52:13.956 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_retry_disk_reads": "3", 2024-04-25T22:52:13.956 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_rocksdb_cf": "true", 2024-04-25T22:52:13.956 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-04-25T22:52:13.956 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-04-25T22:52:13.956 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_rocksdb_options_annex": "", 2024-04-25T22:52:13.956 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_spdk_coremask": "0x1", 2024-04-25T22:52:13.956 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_spdk_io_sleep": "5", 2024-04-25T22:52:13.956 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_spdk_max_io_completion": "0", 2024-04-25T22:52:13.956 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_spdk_mem": "512", 2024-04-25T22:52:13.956 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_sync_submit_transaction": "false", 2024-04-25T22:52:13.956 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_throttle_bytes": "67108864", 2024-04-25T22:52:13.956 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_throttle_cost_per_io": "0", 2024-04-25T22:52:13.956 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-04-25T22:52:13.957 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-04-25T22:52:13.957 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-04-25T22:52:13.957 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-04-25T22:52:13.957 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_tracing": "false", 2024-04-25T22:52:13.957 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-04-25T22:52:13.957 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-04-25T22:52:13.957 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_volume_selection_reserved": "0", 2024-04-25T22:52:13.957 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-04-25T22:52:13.957 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-04-25T22:52:13.957 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-04-25T22:52:13.957 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-04-25T22:52:13.957 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-04-25T22:52:13.957 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-04-25T22:52:13.958 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_zero_block_detection": "false", 2024-04-25T22:52:13.958 INFO:teuthology.orchestra.run.smithi052.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-04-25T22:52:13.958 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs_mirror_action_update_interval": "2", 2024-04-25T22:52:13.958 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-04-25T22:52:13.958 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-04-25T22:52:13.958 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-04-25T22:52:13.958 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-04-25T22:52:13.958 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs_mirror_mount_timeout": "10", 2024-04-25T22:52:13.958 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-04-25T22:52:13.958 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-04-25T22:52:13.958 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-04-25T22:52:13.958 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-04-25T22:52:13.958 INFO:teuthology.orchestra.run.smithi052.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-04-25T22:52:13.959 INFO:teuthology.orchestra.run.smithi052.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-04-25T22:52:13.959 INFO:teuthology.orchestra.run.smithi052.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-04-25T22:52:13.959 INFO:teuthology.orchestra.run.smithi052.stdout: "cephx_cluster_require_signatures": "false", 2024-04-25T22:52:13.959 INFO:teuthology.orchestra.run.smithi052.stdout: "cephx_cluster_require_version": "2", 2024-04-25T22:52:13.959 INFO:teuthology.orchestra.run.smithi052.stdout: "cephx_require_signatures": "false", 2024-04-25T22:52:13.959 INFO:teuthology.orchestra.run.smithi052.stdout: "cephx_require_version": "2", 2024-04-25T22:52:13.959 INFO:teuthology.orchestra.run.smithi052.stdout: "cephx_service_require_signatures": "false", 2024-04-25T22:52:13.959 INFO:teuthology.orchestra.run.smithi052.stdout: "cephx_service_require_version": "2", 2024-04-25T22:52:13.959 INFO:teuthology.orchestra.run.smithi052.stdout: "cephx_sign_messages": "true", 2024-04-25T22:52:13.959 INFO:teuthology.orchestra.run.smithi052.stdout: "chdir": "", 2024-04-25T22:52:13.959 INFO:teuthology.orchestra.run.smithi052.stdout: "client_acl_type": "", 2024-04-25T22:52:13.959 INFO:teuthology.orchestra.run.smithi052.stdout: "client_asio_thread_count": "2", 2024-04-25T22:52:13.959 INFO:teuthology.orchestra.run.smithi052.stdout: "client_cache_mid": "0.750000", 2024-04-25T22:52:13.959 INFO:teuthology.orchestra.run.smithi052.stdout: "client_cache_size": "16384", 2024-04-25T22:52:13.960 INFO:teuthology.orchestra.run.smithi052.stdout: "client_caps_release_delay": "5", 2024-04-25T22:52:13.960 INFO:teuthology.orchestra.run.smithi052.stdout: "client_check_pool_perm": "true", 2024-04-25T22:52:13.960 INFO:teuthology.orchestra.run.smithi052.stdout: "client_collect_and_send_global_metrics": "false", 2024-04-25T22:52:13.960 INFO:teuthology.orchestra.run.smithi052.stdout: "client_debug_force_sync_read": "false", 2024-04-25T22:52:13.960 INFO:teuthology.orchestra.run.smithi052.stdout: "client_debug_getattr_caps": "false", 2024-04-25T22:52:13.960 INFO:teuthology.orchestra.run.smithi052.stdout: "client_debug_inject_tick_delay": "0", 2024-04-25T22:52:13.960 INFO:teuthology.orchestra.run.smithi052.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-04-25T22:52:13.960 INFO:teuthology.orchestra.run.smithi052.stdout: "client_die_on_failed_remount": "false", 2024-04-25T22:52:13.960 INFO:teuthology.orchestra.run.smithi052.stdout: "client_dirsize_rbytes": "true", 2024-04-25T22:52:13.960 INFO:teuthology.orchestra.run.smithi052.stdout: "client_force_lazyio": "false", 2024-04-25T22:52:13.960 INFO:teuthology.orchestra.run.smithi052.stdout: "client_fs": "", 2024-04-25T22:52:13.960 INFO:teuthology.orchestra.run.smithi052.stdout: "client_inject_fixed_oldest_tid": "false", 2024-04-25T22:52:13.960 INFO:teuthology.orchestra.run.smithi052.stdout: "client_inject_release_failure": "false", 2024-04-25T22:52:13.960 INFO:teuthology.orchestra.run.smithi052.stdout: "client_max_inline_size": "4096", 2024-04-25T22:52:13.961 INFO:teuthology.orchestra.run.smithi052.stdout: "client_max_retries_on_remount_failure": "5", 2024-04-25T22:52:13.961 INFO:teuthology.orchestra.run.smithi052.stdout: "client_mds_namespace": "", 2024-04-25T22:52:13.961 INFO:teuthology.orchestra.run.smithi052.stdout: "client_metadata": "", 2024-04-25T22:52:13.961 INFO:teuthology.orchestra.run.smithi052.stdout: "client_mount_gid": "-1", 2024-04-25T22:52:13.961 INFO:teuthology.orchestra.run.smithi052.stdout: "client_mount_timeout": "300", 2024-04-25T22:52:13.961 INFO:teuthology.orchestra.run.smithi052.stdout: "client_mount_uid": "-1", 2024-04-25T22:52:13.961 INFO:teuthology.orchestra.run.smithi052.stdout: "client_mountpoint": "/", 2024-04-25T22:52:13.961 INFO:teuthology.orchestra.run.smithi052.stdout: "client_notify_timeout": "10", 2024-04-25T22:52:13.961 INFO:teuthology.orchestra.run.smithi052.stdout: "client_oc": "true", 2024-04-25T22:52:13.961 INFO:teuthology.orchestra.run.smithi052.stdout: "client_oc_max_dirty": "104857600", 2024-04-25T22:52:13.961 INFO:teuthology.orchestra.run.smithi052.stdout: "client_oc_max_dirty_age": "5.000000", 2024-04-25T22:52:13.961 INFO:teuthology.orchestra.run.smithi052.stdout: "client_oc_max_objects": "1000", 2024-04-25T22:52:13.961 INFO:teuthology.orchestra.run.smithi052.stdout: "client_oc_size": "209715200", 2024-04-25T22:52:13.961 INFO:teuthology.orchestra.run.smithi052.stdout: "client_oc_target_dirty": "8388608", 2024-04-25T22:52:13.962 INFO:teuthology.orchestra.run.smithi052.stdout: "client_permissions": "true", 2024-04-25T22:52:13.962 INFO:teuthology.orchestra.run.smithi052.stdout: "client_quota": "true", 2024-04-25T22:52:13.962 INFO:teuthology.orchestra.run.smithi052.stdout: "client_quota_df": "true", 2024-04-25T22:52:13.962 INFO:teuthology.orchestra.run.smithi052.stdout: "client_readahead_max_bytes": "0", 2024-04-25T22:52:13.962 INFO:teuthology.orchestra.run.smithi052.stdout: "client_readahead_max_periods": "4", 2024-04-25T22:52:13.962 INFO:teuthology.orchestra.run.smithi052.stdout: "client_readahead_min": "131072", 2024-04-25T22:52:13.962 INFO:teuthology.orchestra.run.smithi052.stdout: "client_reconnect_stale": "false", 2024-04-25T22:52:13.962 INFO:teuthology.orchestra.run.smithi052.stdout: "client_shutdown_timeout": "30", 2024-04-25T22:52:13.962 INFO:teuthology.orchestra.run.smithi052.stdout: "client_snapdir": ".snap", 2024-04-25T22:52:13.962 INFO:teuthology.orchestra.run.smithi052.stdout: "client_tick_interval": "1", 2024-04-25T22:52:13.962 INFO:teuthology.orchestra.run.smithi052.stdout: "client_trace": "", 2024-04-25T22:52:13.962 INFO:teuthology.orchestra.run.smithi052.stdout: "client_try_dentry_invalidate": "false", 2024-04-25T22:52:13.962 INFO:teuthology.orchestra.run.smithi052.stdout: "client_use_faked_inos": "false", 2024-04-25T22:52:13.962 INFO:teuthology.orchestra.run.smithi052.stdout: "client_use_random_mds": "false", 2024-04-25T22:52:13.963 INFO:teuthology.orchestra.run.smithi052.stdout: "clog_to_graylog": "false", 2024-04-25T22:52:13.963 INFO:teuthology.orchestra.run.smithi052.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-04-25T22:52:13.963 INFO:teuthology.orchestra.run.smithi052.stdout: "clog_to_graylog_port": "12201", 2024-04-25T22:52:13.963 INFO:teuthology.orchestra.run.smithi052.stdout: "clog_to_monitors": "default=true", 2024-04-25T22:52:13.963 INFO:teuthology.orchestra.run.smithi052.stdout: "clog_to_syslog": "false", 2024-04-25T22:52:13.963 INFO:teuthology.orchestra.run.smithi052.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-04-25T22:52:13.963 INFO:teuthology.orchestra.run.smithi052.stdout: "clog_to_syslog_level": "info", 2024-04-25T22:52:13.963 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addr": "-", 2024-04-25T22:52:13.963 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_network": "", 2024-04-25T22:52:13.963 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_network_interface": "", 2024-04-25T22:52:13.963 INFO:teuthology.orchestra.run.smithi052.stdout: "compressor_zlib_isal": "false", 2024-04-25T22:52:13.963 INFO:teuthology.orchestra.run.smithi052.stdout: "compressor_zlib_level": "5", 2024-04-25T22:52:13.963 INFO:teuthology.orchestra.run.smithi052.stdout: "compressor_zlib_winsize": "-15", 2024-04-25T22:52:13.963 INFO:teuthology.orchestra.run.smithi052.stdout: "compressor_zstd_level": "1", 2024-04-25T22:52:13.964 INFO:teuthology.orchestra.run.smithi052.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-04-25T22:52:13.964 INFO:teuthology.orchestra.run.smithi052.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-04-25T22:52:13.964 INFO:teuthology.orchestra.run.smithi052.stdout: "crimson_alien_op_num_threads": "6", 2024-04-25T22:52:13.964 INFO:teuthology.orchestra.run.smithi052.stdout: "crimson_alien_thread_cpu_cores": "", 2024-04-25T22:52:13.964 INFO:teuthology.orchestra.run.smithi052.stdout: "crimson_osd_obc_lru_size": "512", 2024-04-25T22:52:13.964 INFO:teuthology.orchestra.run.smithi052.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-04-25T22:52:13.964 INFO:teuthology.orchestra.run.smithi052.stdout: "crimson_seastar_cpu_cores": "", 2024-04-25T22:52:13.964 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_location": "", 2024-04-25T22:52:13.964 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_location_hook": "", 2024-04-25T22:52:13.964 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_location_hook_timeout": "10", 2024-04-25T22:52:13.964 INFO:teuthology.orchestra.run.smithi052.stdout: "daemonize": "false", 2024-04-25T22:52:13.964 INFO:teuthology.orchestra.run.smithi052.stdout: "daos_pool": "tank", 2024-04-25T22:52:13.964 INFO:teuthology.orchestra.run.smithi052.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-04-25T22:52:13.964 INFO:teuthology.orchestra.run.smithi052.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-04-25T22:52:13.965 INFO:teuthology.orchestra.run.smithi052.stdout: "dbstore_db_name_prefix": "dbstore", 2024-04-25T22:52:13.965 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_alienstore": "0/5", 2024-04-25T22:52:13.965 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_allow_any_pool_priority": "false", 2024-04-25T22:52:13.965 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_asok": "1/5", 2024-04-25T22:52:13.965 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_asok_assert_abort": "false", 2024-04-25T22:52:13.965 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_asserts_on_shutdown": "true", 2024-04-25T22:52:13.965 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_auth": "20/20", 2024-04-25T22:52:13.965 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_bdev": "1/3", 2024-04-25T22:52:13.965 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_bluefs": "1/5", 2024-04-25T22:52:13.965 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_bluestore": "1/5", 2024-04-25T22:52:13.965 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_buffer": "0/1", 2024-04-25T22:52:13.965 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_ceph_exporter": "1/5", 2024-04-25T22:52:13.965 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_cephfs_mirror": "0/5", 2024-04-25T22:52:13.965 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_cephsqlite": "0/5", 2024-04-25T22:52:13.966 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_client": "0/5", 2024-04-25T22:52:13.966 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_compressor": "1/5", 2024-04-25T22:52:13.966 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_context": "0/1", 2024-04-25T22:52:13.966 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_crimson_interrupt": "0/5", 2024-04-25T22:52:13.966 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_crush": "1/1", 2024-04-25T22:52:13.966 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_crypto": "1/5", 2024-04-25T22:52:13.966 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_cyanstore": "0/5", 2024-04-25T22:52:13.966 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_deliberately_leak_memory": "false", 2024-04-25T22:52:13.966 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_disable_randomized_ping": "false", 2024-04-25T22:52:13.966 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_dpdk": "1/5", 2024-04-25T22:52:13.966 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_eventtrace": "1/5", 2024-04-25T22:52:13.966 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_filer": "0/1", 2024-04-25T22:52:13.966 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_filestore": "1/3", 2024-04-25T22:52:13.967 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_finisher": "1/1", 2024-04-25T22:52:13.967 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_fuse": "1/5", 2024-04-25T22:52:13.967 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_heartbeat_testing_span": "0", 2024-04-25T22:52:13.967 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_heartbeatmap": "1/5", 2024-04-25T22:52:13.967 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_immutable_obj_cache": "0/5", 2024-04-25T22:52:13.967 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_javaclient": "1/5", 2024-04-25T22:52:13.967 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_journal": "1/3", 2024-04-25T22:52:13.967 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_journaler": "0/5", 2024-04-25T22:52:13.967 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_kstore": "1/5", 2024-04-25T22:52:13.967 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_lockdep": "0/1", 2024-04-25T22:52:13.967 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_mclock": "1/5", 2024-04-25T22:52:13.967 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_mds": "1/5", 2024-04-25T22:52:13.967 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_mds_balancer": "1/5", 2024-04-25T22:52:13.967 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_mds_locker": "1/5", 2024-04-25T22:52:13.968 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_mds_log": "1/5", 2024-04-25T22:52:13.968 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_mds_log_expire": "1/5", 2024-04-25T22:52:13.968 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_mds_migrator": "1/5", 2024-04-25T22:52:13.968 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_mds_quiesce": "3/5", 2024-04-25T22:52:13.968 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_memstore": "1/5", 2024-04-25T22:52:13.968 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_mgr": "2/5", 2024-04-25T22:52:13.968 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_mgrc": "1/5", 2024-04-25T22:52:13.968 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_mon": "20/20", 2024-04-25T22:52:13.968 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_monc": "0/10", 2024-04-25T22:52:13.968 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_ms": "1/1", 2024-04-25T22:52:13.968 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_none": "0/5", 2024-04-25T22:52:13.968 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_objclass": "0/5", 2024-04-25T22:52:13.968 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_objectcacher": "0/5", 2024-04-25T22:52:13.968 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_objecter": "0/1", 2024-04-25T22:52:13.969 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_optracker": "0/5", 2024-04-25T22:52:13.969 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_osd": "1/5", 2024-04-25T22:52:13.969 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_paxos": "20/20", 2024-04-25T22:52:13.969 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_perfcounter": "1/5", 2024-04-25T22:52:13.969 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_prioritycache": "1/5", 2024-04-25T22:52:13.969 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_rados": "0/5", 2024-04-25T22:52:13.969 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_rbd": "0/5", 2024-04-25T22:52:13.969 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_rbd_mirror": "0/5", 2024-04-25T22:52:13.969 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_rbd_pwl": "0/5", 2024-04-25T22:52:13.969 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_rbd_replay": "0/5", 2024-04-25T22:52:13.969 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_refs": "0/0", 2024-04-25T22:52:13.969 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_reserver": "1/1", 2024-04-25T22:52:13.969 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_rgw": "1/5", 2024-04-25T22:52:13.969 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_rgw_access": "1/5", 2024-04-25T22:52:13.970 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_rgw_datacache": "1/5", 2024-04-25T22:52:13.970 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_rgw_dbstore": "1/5", 2024-04-25T22:52:13.970 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_rgw_flight": "1/5", 2024-04-25T22:52:13.970 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_rgw_lifecycle": "1/5", 2024-04-25T22:52:13.970 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_rgw_sync": "1/5", 2024-04-25T22:52:13.970 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_rocksdb": "4/5", 2024-04-25T22:52:13.970 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore": "0/5", 2024-04-25T22:52:13.970 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore_backref": "0/5", 2024-04-25T22:52:13.970 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore_cache": "0/5", 2024-04-25T22:52:13.970 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore_cleaner": "0/5", 2024-04-25T22:52:13.970 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore_device": "0/5", 2024-04-25T22:52:13.970 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore_epm": "0/5", 2024-04-25T22:52:13.970 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-04-25T22:52:13.971 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore_journal": "0/5", 2024-04-25T22:52:13.971 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore_lba": "0/5", 2024-04-25T22:52:13.971 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore_odata": "0/5", 2024-04-25T22:52:13.971 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore_omap": "0/5", 2024-04-25T22:52:13.971 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore_onode": "0/5", 2024-04-25T22:52:13.971 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore_t": "0/5", 2024-04-25T22:52:13.971 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore_tm": "0/5", 2024-04-25T22:52:13.971 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_striper": "0/1", 2024-04-25T22:52:13.971 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_test": "0/5", 2024-04-25T22:52:13.971 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_throttle": "1/1", 2024-04-25T22:52:13.971 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_timer": "0/1", 2024-04-25T22:52:13.971 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_tp": "0/5", 2024-04-25T22:52:13.971 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_trace": "1/5", 2024-04-25T22:52:13.972 INFO:teuthology.orchestra.run.smithi052.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-04-25T22:52:13.972 INFO:teuthology.orchestra.run.smithi052.stdout: "device_failure_prediction_mode": "none", 2024-04-25T22:52:13.972 INFO:teuthology.orchestra.run.smithi052.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-04-25T22:52:13.972 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2024-04-25T22:52:13.972 INFO:teuthology.orchestra.run.smithi052.stdout: "err_to_graylog": "false", 2024-04-25T22:52:13.972 INFO:teuthology.orchestra.run.smithi052.stdout: "err_to_journald": "false", 2024-04-25T22:52:13.972 INFO:teuthology.orchestra.run.smithi052.stdout: "err_to_stderr": "true", 2024-04-25T22:52:13.972 INFO:teuthology.orchestra.run.smithi052.stdout: "err_to_syslog": "false", 2024-04-25T22:52:13.972 INFO:teuthology.orchestra.run.smithi052.stdout: "event_tracing": "false", 2024-04-25T22:52:13.972 INFO:teuthology.orchestra.run.smithi052.stdout: "exporter_addr": "0.0.0.0", 2024-04-25T22:52:13.972 INFO:teuthology.orchestra.run.smithi052.stdout: "exporter_http_port": "9926", 2024-04-25T22:52:13.972 INFO:teuthology.orchestra.run.smithi052.stdout: "exporter_prio_limit": "5", 2024-04-25T22:52:13.972 INFO:teuthology.orchestra.run.smithi052.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-04-25T22:52:13.973 INFO:teuthology.orchestra.run.smithi052.stdout: "exporter_sort_metrics": "true", 2024-04-25T22:52:13.973 INFO:teuthology.orchestra.run.smithi052.stdout: "exporter_stats_period": "5", 2024-04-25T22:52:13.973 INFO:teuthology.orchestra.run.smithi052.stdout: "fake_statfs_for_testing": "0", 2024-04-25T22:52:13.973 INFO:teuthology.orchestra.run.smithi052.stdout: "fatal_signal_handlers": "true", 2024-04-25T22:52:13.973 INFO:teuthology.orchestra.run.smithi052.stdout: "filer_max_purge_ops": "10", 2024-04-25T22:52:13.973 INFO:teuthology.orchestra.run.smithi052.stdout: "filer_max_truncate_ops": "128", 2024-04-25T22:52:13.973 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_apply_finisher_threads": "1", 2024-04-25T22:52:13.973 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_blackhole": "false", 2024-04-25T22:52:13.973 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_btrfs_clone_range": "true", 2024-04-25T22:52:13.973 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_btrfs_snap": "true", 2024-04-25T22:52:13.973 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_caller_concurrency": "10", 2024-04-25T22:52:13.973 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_collect_device_partition_information": "true", 2024-04-25T22:52:13.973 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_commit_timeout": "600.000000", 2024-04-25T22:52:13.973 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_debug_inject_read_err": "false", 2024-04-25T22:52:13.974 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_debug_omap_check": "false", 2024-04-25T22:52:13.974 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_debug_random_read_err": "0.000000", 2024-04-25T22:52:13.974 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_debug_verify_split": "false", 2024-04-25T22:52:13.974 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_dump_file": "", 2024-04-25T22:52:13.974 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-04-25T22:52:13.974 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-04-25T22:52:13.974 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_fadvise": "true", 2024-04-25T22:52:13.974 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_fail_eio": "true", 2024-04-25T22:52:13.974 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_fd_cache_shards": "16", 2024-04-25T22:52:13.974 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_fd_cache_size": "128", 2024-04-25T22:52:13.974 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_fiemap": "false", 2024-04-25T22:52:13.974 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_fiemap_threshold": "4096", 2024-04-25T22:52:13.974 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-04-25T22:52:13.975 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_index_retry_probability": "0.000000", 2024-04-25T22:52:13.975 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_inject_stall": "0", 2024-04-25T22:52:13.975 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_journal_parallel": "false", 2024-04-25T22:52:13.975 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_journal_trailing": "false", 2024-04-25T22:52:13.975 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_journal_writeahead": "false", 2024-04-25T22:52:13.975 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_kill_at": "0", 2024-04-25T22:52:13.975 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-04-25T22:52:13.975 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_inline_xattr_size": "0", 2024-04-25T22:52:13.975 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-04-25T22:52:13.975 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-04-25T22:52:13.975 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-04-25T22:52:13.975 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_inline_xattrs": "0", 2024-04-25T22:52:13.975 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-04-25T22:52:13.976 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_inline_xattrs_other": "2", 2024-04-25T22:52:13.976 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-04-25T22:52:13.976 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_sync_interval": "5.000000", 2024-04-25T22:52:13.976 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_xattr_value_size": "0", 2024-04-25T22:52:13.976 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-04-25T22:52:13.976 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-04-25T22:52:13.976 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-04-25T22:52:13.976 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_merge_threshold": "-10", 2024-04-25T22:52:13.976 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_min_sync_interval": "0.010000", 2024-04-25T22:52:13.976 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_odsync_write": "false", 2024-04-25T22:52:13.976 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_omap_backend": "rocksdb", 2024-04-25T22:52:13.976 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_omap_backend_path": "", 2024-04-25T22:52:13.976 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_omap_header_cache_size": "1024", 2024-04-25T22:52:13.976 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_ondisk_finisher_threads": "1", 2024-04-25T22:52:13.977 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-04-25T22:52:13.977 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_op_thread_timeout": "60", 2024-04-25T22:52:13.977 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_op_threads": "2", 2024-04-25T22:52:13.977 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_punch_hole": "false", 2024-04-25T22:52:13.977 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-04-25T22:52:13.977 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-04-25T22:52:13.977 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-04-25T22:52:13.977 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-04-25T22:52:13.977 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-04-25T22:52:13.977 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_queue_max_bytes": "104857600", 2024-04-25T22:52:13.977 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-04-25T22:52:13.977 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-04-25T22:52:13.977 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-04-25T22:52:13.978 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_queue_max_ops": "50", 2024-04-25T22:52:13.978 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-04-25T22:52:13.978 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_seek_data_hole": "false", 2024-04-25T22:52:13.978 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_sloppy_crc": "false", 2024-04-25T22:52:13.978 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-04-25T22:52:13.978 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_splice": "false", 2024-04-25T22:52:13.978 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_split_multiple": "2", 2024-04-25T22:52:13.978 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_split_rand_factor": "20", 2024-04-25T22:52:13.978 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_update_to": "1000", 2024-04-25T22:52:13.978 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-04-25T22:52:13.978 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-04-25T22:52:13.978 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-04-25T22:52:13.978 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-04-25T22:52:13.978 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-04-25T22:52:13.979 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-04-25T22:52:13.979 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_wbthrottle_enable": "true", 2024-04-25T22:52:13.979 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-04-25T22:52:13.979 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-04-25T22:52:13.979 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-04-25T22:52:13.979 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-04-25T22:52:13.979 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-04-25T22:52:13.979 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-04-25T22:52:13.979 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_xfs_extsize": "false", 2024-04-25T22:52:13.979 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_zfs_snap": "false", 2024-04-25T22:52:13.979 INFO:teuthology.orchestra.run.smithi052.stdout: "fio_dir": "/tmp/fio", 2024-04-25T22:52:13.979 INFO:teuthology.orchestra.run.smithi052.stdout: "fsid": "5355b70e-3f7d-4bce-8676-89cee61d2089", 2024-04-25T22:52:13.979 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_allow_other": "true", 2024-04-25T22:52:13.980 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_atomic_o_trunc": "true", 2024-04-25T22:52:13.980 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_big_writes": "true", 2024-04-25T22:52:13.980 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_debug": "false", 2024-04-25T22:52:13.980 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_default_permissions": "false", 2024-04-25T22:52:13.980 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_disable_pagecache": "false", 2024-04-25T22:52:13.980 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_max_write": "0", 2024-04-25T22:52:13.980 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_multithreaded": "true", 2024-04-25T22:52:13.980 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_require_active_mds": "true", 2024-04-25T22:52:13.980 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_set_user_groups": "true", 2024-04-25T22:52:13.980 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_splice_move": "true", 2024-04-25T22:52:13.980 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_splice_read": "true", 2024-04-25T22:52:13.980 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_splice_write": "true", 2024-04-25T22:52:13.980 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_syncfs_on_mksnap": "true", 2024-04-25T22:52:13.980 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_use_invalidate_cb": "true", 2024-04-25T22:52:13.981 INFO:teuthology.orchestra.run.smithi052.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-04-25T22:52:13.981 INFO:teuthology.orchestra.run.smithi052.stdout: "gss_target_name": "ceph", 2024-04-25T22:52:13.981 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_file": "", 2024-04-25T22:52:13.981 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_inject_failure": "0", 2024-04-25T22:52:13.981 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_interval": "5", 2024-04-25T22:52:13.981 INFO:teuthology.orchestra.run.smithi052.stdout: "host": "smithi052", 2024-04-25T22:52:13.981 INFO:teuthology.orchestra.run.smithi052.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-04-25T22:52:13.981 INFO:teuthology.orchestra.run.smithi052.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-04-25T22:52:13.981 INFO:teuthology.orchestra.run.smithi052.stdout: "immutable_object_cache_max_size": "1073741824", 2024-04-25T22:52:13.981 INFO:teuthology.orchestra.run.smithi052.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-04-25T22:52:13.981 INFO:teuthology.orchestra.run.smithi052.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-04-25T22:52:13.981 INFO:teuthology.orchestra.run.smithi052.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-04-25T22:52:13.981 INFO:teuthology.orchestra.run.smithi052.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-04-25T22:52:13.981 INFO:teuthology.orchestra.run.smithi052.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-04-25T22:52:13.982 INFO:teuthology.orchestra.run.smithi052.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-04-25T22:52:13.982 INFO:teuthology.orchestra.run.smithi052.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-04-25T22:52:13.982 INFO:teuthology.orchestra.run.smithi052.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-04-25T22:52:13.982 INFO:teuthology.orchestra.run.smithi052.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-04-25T22:52:13.982 INFO:teuthology.orchestra.run.smithi052.stdout: "immutable_object_cache_watermark": "0.900000", 2024-04-25T22:52:13.982 INFO:teuthology.orchestra.run.smithi052.stdout: "inject_early_sigterm": "false", 2024-04-25T22:52:13.982 INFO:teuthology.orchestra.run.smithi052.stdout: "jaeger_agent_port": "6799", 2024-04-25T22:52:13.982 INFO:teuthology.orchestra.run.smithi052.stdout: "jaeger_tracing_enable": "false", 2024-04-25T22:52:13.982 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_aio": "true", 2024-04-25T22:52:13.982 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_align_min_size": "65536", 2024-04-25T22:52:13.982 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_block_align": "true", 2024-04-25T22:52:13.982 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_block_size": "4096", 2024-04-25T22:52:13.982 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_dio": "true", 2024-04-25T22:52:13.983 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_discard": "false", 2024-04-25T22:52:13.983 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_force_aio": "false", 2024-04-25T22:52:13.983 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_ignore_corruption": "false", 2024-04-25T22:52:13.983 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_max_write_bytes": "10485760", 2024-04-25T22:52:13.983 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_max_write_entries": "100", 2024-04-25T22:52:13.983 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_replay_from": "0", 2024-04-25T22:52:13.983 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_throttle_high_multiple": "0.000000", 2024-04-25T22:52:13.983 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-04-25T22:52:13.983 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-04-25T22:52:13.983 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_throttle_max_multiple": "0.000000", 2024-04-25T22:52:13.983 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_write_header_frequency": "0", 2024-04-25T22:52:13.983 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_zero_on_create": "false", 2024-04-25T22:52:13.983 INFO:teuthology.orchestra.run.smithi052.stdout: "journaler_prefetch_periods": "10", 2024-04-25T22:52:13.983 INFO:teuthology.orchestra.run.smithi052.stdout: "journaler_prezero_periods": "5", 2024-04-25T22:52:13.984 INFO:teuthology.orchestra.run.smithi052.stdout: "journaler_write_head_interval": "15", 2024-04-25T22:52:13.984 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "", 2024-04-25T22:52:13.984 INFO:teuthology.orchestra.run.smithi052.stdout: "keyfile": "", 2024-04-25T22:52:13.984 INFO:teuthology.orchestra.run.smithi052.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-04-25T22:52:13.984 INFO:teuthology.orchestra.run.smithi052.stdout: "kstore_backend": "rocksdb", 2024-04-25T22:52:13.984 INFO:teuthology.orchestra.run.smithi052.stdout: "kstore_default_stripe_size": "65536", 2024-04-25T22:52:13.984 INFO:teuthology.orchestra.run.smithi052.stdout: "kstore_fsck_on_mount": "false", 2024-04-25T22:52:13.984 INFO:teuthology.orchestra.run.smithi052.stdout: "kstore_fsck_on_mount_deep": "true", 2024-04-25T22:52:13.984 INFO:teuthology.orchestra.run.smithi052.stdout: "kstore_max_bytes": "67108864", 2024-04-25T22:52:13.984 INFO:teuthology.orchestra.run.smithi052.stdout: "kstore_max_ops": "512", 2024-04-25T22:52:13.984 INFO:teuthology.orchestra.run.smithi052.stdout: "kstore_nid_prealloc": "1024", 2024-04-25T22:52:13.984 INFO:teuthology.orchestra.run.smithi052.stdout: "kstore_onode_map_size": "1024", 2024-04-25T22:52:13.984 INFO:teuthology.orchestra.run.smithi052.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-04-25T22:52:13.985 INFO:teuthology.orchestra.run.smithi052.stdout: "kstore_sync_submit_transaction": "false", 2024-04-25T22:52:13.985 INFO:teuthology.orchestra.run.smithi052.stdout: "kstore_sync_transaction": "false", 2024-04-25T22:52:13.985 INFO:teuthology.orchestra.run.smithi052.stdout: "librados_thread_count": "2", 2024-04-25T22:52:13.985 INFO:teuthology.orchestra.run.smithi052.stdout: "lockdep": "false", 2024-04-25T22:52:13.985 INFO:teuthology.orchestra.run.smithi052.stdout: "lockdep_force_backtrace": "false", 2024-04-25T22:52:13.985 INFO:teuthology.orchestra.run.smithi052.stdout: "log_coarse_timestamps": "true", 2024-04-25T22:52:13.985 INFO:teuthology.orchestra.run.smithi052.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-04-25T22:52:13.985 INFO:teuthology.orchestra.run.smithi052.stdout: "log_flush_on_exit": "false", 2024-04-25T22:52:13.985 INFO:teuthology.orchestra.run.smithi052.stdout: "log_graylog_host": "127.0.0.1", 2024-04-25T22:52:13.985 INFO:teuthology.orchestra.run.smithi052.stdout: "log_graylog_port": "12201", 2024-04-25T22:52:13.985 INFO:teuthology.orchestra.run.smithi052.stdout: "log_max_new": "1000", 2024-04-25T22:52:13.985 INFO:teuthology.orchestra.run.smithi052.stdout: "log_max_recent": "10000", 2024-04-25T22:52:13.985 INFO:teuthology.orchestra.run.smithi052.stdout: "log_stderr_prefix": "", 2024-04-25T22:52:13.985 INFO:teuthology.orchestra.run.smithi052.stdout: "log_stop_at_utilization": "0.970000", 2024-04-25T22:52:13.986 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": "true", 2024-04-25T22:52:13.986 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_graylog": "false", 2024-04-25T22:52:13.986 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_journald": "false", 2024-04-25T22:52:13.986 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_stderr": "false", 2024-04-25T22:52:13.986 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_syslog": "false", 2024-04-25T22:52:13.986 INFO:teuthology.orchestra.run.smithi052.stdout: "max_rotating_auth_attempts": "10", 2024-04-25T22:52:13.986 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-04-25T22:52:13.986 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_action_on_write_error": "1", 2024-04-25T22:52:13.986 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_alternate_name_max": "8192", 2024-04-25T22:52:13.986 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_asio_thread_count": "2", 2024-04-25T22:52:13.986 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_export_pin": "true", 2024-04-25T22:52:13.986 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_fragment_dirs": "true", 2024-04-25T22:52:13.986 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-04-25T22:52:13.987 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_fragment_interval": "5", 2024-04-25T22:52:13.987 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_fragment_size_max": "100000", 2024-04-25T22:52:13.987 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_idle_threshold": "0.000000", 2024-04-25T22:52:13.987 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_interval": "10", 2024-04-25T22:52:13.987 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_max": "-1", 2024-04-25T22:52:13.987 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_max_until": "-1", 2024-04-25T22:52:13.987 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_merge_size": "50", 2024-04-25T22:52:13.987 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_midchunk": "0.300000", 2024-04-25T22:52:13.987 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_min_rebalance": "0.100000", 2024-04-25T22:52:13.987 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_min_start": "0.200000", 2024-04-25T22:52:13.987 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_minchunk": "0.001000", 2024-04-25T22:52:13.987 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_mode": "0", 2024-04-25T22:52:13.987 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_need_max": "1.200000", 2024-04-25T22:52:13.987 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_need_min": "0.800000", 2024-04-25T22:52:13.988 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_overload_epochs": "2", 2024-04-25T22:52:13.988 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-04-25T22:52:13.988 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_sample_interval": "3.000000", 2024-04-25T22:52:13.988 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_split_bits": "3", 2024-04-25T22:52:13.988 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_split_rd": "25000.000000", 2024-04-25T22:52:13.988 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_split_size": "10000", 2024-04-25T22:52:13.988 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_split_wr": "10000.000000", 2024-04-25T22:52:13.988 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_target_decay": "10.000000", 2024-04-25T22:52:13.988 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-04-25T22:52:13.988 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_beacon_grace": "15.000000", 2024-04-25T22:52:13.988 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_beacon_interval": "4.000000", 2024-04-25T22:52:13.988 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_beacon_mon_down_grace": "60", 2024-04-25T22:52:13.988 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache_memory_limit": "4294967296", 2024-04-25T22:52:13.988 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache_mid": "0.700000", 2024-04-25T22:52:13.989 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-04-25T22:52:13.989 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache_quiesce_delay": "0", 2024-04-25T22:52:13.989 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache_quiesce_sleep": "200", 2024-04-25T22:52:13.989 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache_quiesce_splitauth": "true", 2024-04-25T22:52:13.989 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache_quiesce_threshold": "524288", 2024-04-25T22:52:13.989 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache_release_free_interval": "10", 2024-04-25T22:52:13.989 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache_reservation": "0.050000", 2024-04-25T22:52:13.989 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-04-25T22:52:13.989 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache_trim_interval": "1", 2024-04-25T22:52:13.989 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache_trim_threshold": "262144", 2024-04-25T22:52:13.989 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-04-25T22:52:13.989 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-04-25T22:52:13.989 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_client_delegate_inos_pct": "50", 2024-04-25T22:52:13.989 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_client_prealloc_inos": "1000", 2024-04-25T22:52:13.989 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-04-25T22:52:13.990 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_connect_bootstrapping": "false", 2024-04-25T22:52:13.990 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_damage_table_max_entries": "10000", 2024-04-25T22:52:13.990 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-04-25T22:52:13.990 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_debug_auth_pins": "false", 2024-04-25T22:52:13.990 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_debug_frag": "false", 2024-04-25T22:52:13.990 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_debug_scatterstat": "false", 2024-04-25T22:52:13.990 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_debug_subtrees": "false", 2024-04-25T22:52:13.990 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_decay_halflife": "5.000000", 2024-04-25T22:52:13.990 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_default_dir_hash": "2", 2024-04-25T22:52:13.990 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_defer_session_stale": "true", 2024-04-25T22:52:13.990 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_deny_all_reconnect": "false", 2024-04-25T22:52:13.990 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_dir_keys_per_op": "16384", 2024-04-25T22:52:13.990 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_dir_max_commit_size": "10", 2024-04-25T22:52:13.991 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_dir_max_entries": "0", 2024-04-25T22:52:13.991 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_dir_prefetch": "true", 2024-04-25T22:52:13.991 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_dirstat_min_interval": "1.000000", 2024-04-25T22:52:13.991 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_dump_cache_after_rejoin": "false", 2024-04-25T22:52:13.991 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_dump_cache_on_map": "false", 2024-04-25T22:52:13.991 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_dump_cache_threshold_file": "0", 2024-04-25T22:52:13.991 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-04-25T22:52:13.991 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_early_reply": "true", 2024-04-25T22:52:13.991 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_enable_op_tracker": "true", 2024-04-25T22:52:13.991 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_enforce_unique_name": "true", 2024-04-25T22:52:13.991 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_export_ephemeral_distributed": "true", 2024-04-25T22:52:13.991 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-04-25T22:52:13.991 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_export_ephemeral_random": "true", 2024-04-25T22:52:13.991 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-04-25T22:52:13.992 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-04-25T22:52:13.992 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_forward_all_requests_to_auth": "false", 2024-04-25T22:52:13.992 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-04-25T22:52:13.992 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-04-25T22:52:13.992 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-04-25T22:52:13.992 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-04-25T22:52:13.992 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_health_cache_threshold": "1.500000", 2024-04-25T22:52:13.992 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_health_summarize_threshold": "10", 2024-04-25T22:52:13.992 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_heartbeat_grace": "15.000000", 2024-04-25T22:52:13.992 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_heartbeat_reset_grace": "1000", 2024-04-25T22:52:13.992 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_inject_health_dummy": "false", 2024-04-25T22:52:13.992 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-04-25T22:52:13.992 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_inject_migrator_session_race": "false", 2024-04-25T22:52:13.993 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-04-25T22:52:13.993 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-04-25T22:52:13.993 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-04-25T22:52:13.993 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_join_fs": "", 2024-04-25T22:52:13.993 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_journal_format": "1", 2024-04-25T22:52:13.993 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_kill_create_at": "0", 2024-04-25T22:52:13.993 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_kill_export_at": "0", 2024-04-25T22:52:13.993 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_kill_import_at": "0", 2024-04-25T22:52:13.993 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_kill_journal_at": "0", 2024-04-25T22:52:13.993 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_kill_journal_expire_at": "0", 2024-04-25T22:52:13.993 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_kill_journal_replay_at": "0", 2024-04-25T22:52:13.993 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_kill_link_at": "0", 2024-04-25T22:52:13.993 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_kill_mdstable_at": "0", 2024-04-25T22:52:13.994 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_kill_openc_at": "0", 2024-04-25T22:52:13.994 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_kill_rename_at": "0", 2024-04-25T22:52:13.994 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_kill_shutdown_at": "0", 2024-04-25T22:52:13.994 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_kill_skip_replaying_inotable": "false", 2024-04-25T22:52:13.994 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log_event_large_threshold": "524288", 2024-04-25T22:52:13.994 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log_events_per_segment": "1024", 2024-04-25T22:52:13.994 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log_major_segment_event_ratio": "12", 2024-04-25T22:52:13.994 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log_max_events": "-1", 2024-04-25T22:52:13.994 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log_max_segments": "128", 2024-04-25T22:52:13.994 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log_pause": "false", 2024-04-25T22:52:13.994 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log_segment_size": "0", 2024-04-25T22:52:13.994 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log_skip_corrupt_events": "false", 2024-04-25T22:52:13.994 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log_skip_unbounded_events": "false", 2024-04-25T22:52:13.995 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-04-25T22:52:13.995 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log_trim_threshold": "128", 2024-04-25T22:52:13.995 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-04-25T22:52:13.995 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log_warn_factor": "2.000000", 2024-04-25T22:52:13.995 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_max_caps_per_client": "1048576", 2024-04-25T22:52:13.995 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_max_completed_flushes": "100000", 2024-04-25T22:52:13.995 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_max_completed_requests": "100000", 2024-04-25T22:52:13.995 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_max_export_size": "20971520", 2024-04-25T22:52:13.995 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_max_file_recover": "32", 2024-04-25T22:52:13.995 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_max_purge_files": "64", 2024-04-25T22:52:13.995 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_max_purge_ops": "8192", 2024-04-25T22:52:13.995 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-04-25T22:52:13.995 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-04-25T22:52:13.995 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_max_snaps_per_dir": "100", 2024-04-25T22:52:13.996 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_metrics_update_interval": "2", 2024-04-25T22:52:13.996 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_min_caps_per_client": "100", 2024-04-25T22:52:13.996 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_min_caps_working_set": "10000", 2024-04-25T22:52:13.996 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-04-25T22:52:13.996 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_numa_node": "-1", 2024-04-25T22:52:13.996 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-04-25T22:52:13.996 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_op_complaint_time": "30.000000", 2024-04-25T22:52:13.996 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_op_history_duration": "600", 2024-04-25T22:52:13.996 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_op_history_size": "20", 2024-04-25T22:52:13.996 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_op_history_slow_op_size": "20", 2024-04-25T22:52:13.996 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_op_history_slow_op_threshold": "10", 2024-04-25T22:52:13.996 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_op_log_threshold": "5", 2024-04-25T22:52:13.996 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_ping_grace": "15", 2024-04-25T22:52:13.996 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_ping_interval": "5", 2024-04-25T22:52:13.997 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-04-25T22:52:13.997 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-04-25T22:52:13.997 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_recall_max_caps": "30000", 2024-04-25T22:52:13.997 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-04-25T22:52:13.997 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_recall_max_decay_threshold": "131072", 2024-04-25T22:52:13.997 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-04-25T22:52:13.997 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_recall_warning_threshold": "262144", 2024-04-25T22:52:13.997 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_reconnect_timeout": "45.000000", 2024-04-25T22:52:13.997 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_replay_interval": "1.000000", 2024-04-25T22:52:13.997 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-04-25T22:52:13.997 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-04-25T22:52:13.997 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_root_ino_gid": "0", 2024-04-25T22:52:13.997 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_root_ino_uid": "0", 2024-04-25T22:52:13.997 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-04-25T22:52:13.998 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_session_blocklist_on_evict": "true", 2024-04-25T22:52:13.998 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_session_blocklist_on_timeout": "true", 2024-04-25T22:52:13.998 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-04-25T22:52:13.998 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-04-25T22:52:13.998 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-04-25T22:52:13.998 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-04-25T22:52:13.998 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-04-25T22:52:13.998 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_session_metadata_threshold": "16777216", 2024-04-25T22:52:13.998 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-04-25T22:52:13.998 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_shutdown_check": "0", 2024-04-25T22:52:13.998 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_skip_ino": "0", 2024-04-25T22:52:13.998 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_sleep_rank_change": "0.000000", 2024-04-25T22:52:13.998 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_snap_max_uid": "4294967294", 2024-04-25T22:52:13.998 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_snap_min_uid": "0", 2024-04-25T22:52:13.999 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_snap_rstat": "false", 2024-04-25T22:52:13.999 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_standby_replay_damaged": "false", 2024-04-25T22:52:13.999 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_symlink_recovery": "true", 2024-04-25T22:52:13.999 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_task_status_update_interval": "2.000000", 2024-04-25T22:52:13.999 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_thrash_exports": "0", 2024-04-25T22:52:13.999 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_thrash_fragments": "0", 2024-04-25T22:52:13.999 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_tick_interval": "5.000000", 2024-04-25T22:52:13.999 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_valgrind_exit": "false", 2024-04-25T22:52:13.999 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_verify_backtrace": "1", 2024-04-25T22:52:13.999 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_verify_scatter": "false", 2024-04-25T22:52:13.999 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_wipe_ino_prealloc": "false", 2024-04-25T22:52:13.999 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_wipe_sessions": "false", 2024-04-25T22:52:13.999 INFO:teuthology.orchestra.run.smithi052.stdout: "mempool_debug": "false", 2024-04-25T22:52:13.999 INFO:teuthology.orchestra.run.smithi052.stdout: "memstore_debug_omit_block_device_write": "false", 2024-04-25T22:52:14.000 INFO:teuthology.orchestra.run.smithi052.stdout: "memstore_device_bytes": "1073741824", 2024-04-25T22:52:14.000 INFO:teuthology.orchestra.run.smithi052.stdout: "memstore_page_set": "false", 2024-04-25T22:52:14.000 INFO:teuthology.orchestra.run.smithi052.stdout: "memstore_page_size": "65536", 2024-04-25T22:52:14.000 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_client_bytes": "134217728", 2024-04-25T22:52:14.000 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_client_messages": "512", 2024-04-25T22:52:14.000 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-04-25T22:52:14.000 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_connect_retry_interval": "1.000000", 2024-04-25T22:52:14.000 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-04-25T22:52:14.000 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-04-25T22:52:14.000 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_disabled_modules": "", 2024-04-25T22:52:14.000 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-04-25T22:52:14.000 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_max_pg_num_change": "128", 2024-04-25T22:52:14.000 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_mds_bytes": "134217728", 2024-04-25T22:52:14.001 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_mds_messages": "128", 2024-04-25T22:52:14.001 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-04-25T22:52:14.001 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_mon_bytes": "134217728", 2024-04-25T22:52:14.001 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_mon_messages": "128", 2024-04-25T22:52:14.001 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_osd_bytes": "536870912", 2024-04-25T22:52:14.001 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_osd_messages": "8192", 2024-04-25T22:52:14.001 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_pool": "true", 2024-04-25T22:52:14.001 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_service_beacon_grace": "60.000000", 2024-04-25T22:52:14.001 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_standby_modules": "true", 2024-04-25T22:52:14.001 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_stats_period": "5", 2024-04-25T22:52:14.001 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_stats_threshold": "5", 2024-04-25T22:52:14.001 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_tick_period": "2", 2024-04-25T22:52:14.001 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-04-25T22:52:14.002 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_accept_timeout_factor": "2.000000", 2024-04-25T22:52:14.002 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_allow_pool_delete": "true", 2024-04-25T22:52:14.002 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_allow_pool_size_one": "true", 2024-04-25T22:52:14.002 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_auth_validate_all_caps": "true", 2024-04-25T22:52:14.002 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-04-25T22:52:14.002 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-04-25T22:52:14.002 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_client_bytes": "104857600", 2024-04-25T22:52:14.002 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_client_directed_command_retry": "2", 2024-04-25T22:52:14.002 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_client_hunt_interval": "3.000000", 2024-04-25T22:52:14.002 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-04-25T22:52:14.002 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-04-25T22:52:14.002 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-04-25T22:52:14.002 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_client_hunt_parallel": "3", 2024-04-25T22:52:14.003 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_client_log_interval": "1.000000", 2024-04-25T22:52:14.003 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-04-25T22:52:14.003 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_client_ping_interval": "10.000000", 2024-04-25T22:52:14.003 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_client_ping_timeout": "30.000000", 2024-04-25T22:52:14.003 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_client_target_rank": "-1", 2024-04-25T22:52:14.003 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_clock_drift_allowed": "1.000000", 2024-04-25T22:52:14.003 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-04-25T22:52:14.003 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-04-25T22:52:14.003 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_cluster_log_file_level": "debug", 2024-04-25T22:52:14.003 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_cluster_log_to_file": "true", 2024-04-25T22:52:14.003 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_cluster_log_to_graylog": "false", 2024-04-25T22:52:14.003 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-04-25T22:52:14.003 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-04-25T22:52:14.003 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_cluster_log_to_journald": "false", 2024-04-25T22:52:14.004 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_cluster_log_to_stderr": "false", 2024-04-25T22:52:14.004 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-04-25T22:52:14.004 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-04-25T22:52:14.004 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-04-25T22:52:14.004 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_compact_on_bootstrap": "false", 2024-04-25T22:52:14.004 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_compact_on_start": "false", 2024-04-25T22:52:14.004 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_compact_on_trim": "true", 2024-04-25T22:52:14.004 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_con_tracker_persist_interval": "10", 2024-04-25T22:52:14.004 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_con_tracker_score_halflife": "43200", 2024-04-25T22:52:14.004 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_config_key_max_entry_size": "65536", 2024-04-25T22:52:14.004 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_cpu_threads": "4", 2024-04-25T22:52:14.004 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_crush_min_required_version": "hammer", 2024-04-25T22:52:14.004 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_daemon_bytes": "419430400", 2024-04-25T22:52:14.004 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-04-25T22:52:14.004 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_data_avail_crit": "5", 2024-04-25T22:52:14.004 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_data_avail_warn": "5", 2024-04-25T22:52:14.005 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_data_size_warn": "16106127360", 2024-04-25T22:52:14.005 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_debug_block_osdmap_trim": "false", 2024-04-25T22:52:14.005 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-04-25T22:52:14.005 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_debug_dump_json": "false", 2024-04-25T22:52:14.005 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-04-25T22:52:14.005 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_debug_dump_transactions": "false", 2024-04-25T22:52:14.005 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_debug_extra_checks": "false", 2024-04-25T22:52:14.005 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-04-25T22:52:14.005 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-04-25T22:52:14.005 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_debug_no_require_reef": "false", 2024-04-25T22:52:14.005 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_debug_no_require_squid": "false", 2024-04-25T22:52:14.005 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-04-25T22:52:14.005 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_delta_reset_interval": "10.000000", 2024-04-25T22:52:14.006 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_dns_srv_name": "ceph-mon", 2024-04-25T22:52:14.006 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_down_mkfs_grace": "120", 2024-04-25T22:52:14.006 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_down_uptime_grace": "60", 2024-04-25T22:52:14.006 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_election_default_strategy": "1", 2024-04-25T22:52:14.006 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_election_timeout": "5.000000", 2024-04-25T22:52:14.006 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-04-25T22:52:14.006 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_elector_ping_divisor": "2", 2024-04-25T22:52:14.006 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_elector_ping_timeout": "2.000000", 2024-04-25T22:52:14.006 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_enable_op_tracker": "true", 2024-04-25T22:52:14.006 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_fake_pool_delete": "false", 2024-04-25T22:52:14.006 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_force_quorum_join": "false", 2024-04-25T22:52:14.006 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_globalid_prealloc": "10000", 2024-04-25T22:52:14.006 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_health_detail_to_clog": "false", 2024-04-25T22:52:14.007 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_health_log_update_period": "5", 2024-04-25T22:52:14.007 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_health_max_detail": "50", 2024-04-25T22:52:14.007 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_health_to_clog": "true", 2024-04-25T22:52:14.007 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_health_to_clog_interval": "600", 2024-04-25T22:52:14.007 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-04-25T22:52:14.007 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_host": "172.21.15.52,[v2:172.21.15.52:3301,v1:172.21.15.52:6790],[v2:172.21.15.52:3302,v1:172.21.15.52:6791]", 2024-04-25T22:52:14.007 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_host_override": "", 2024-04-25T22:52:14.007 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_initial_members": "", 2024-04-25T22:52:14.007 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-04-25T22:52:14.007 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-04-25T22:52:14.007 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-04-25T22:52:14.007 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-04-25T22:52:14.007 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_keyvaluedb": "rocksdb", 2024-04-25T22:52:14.007 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_lease": "5.000000", 2024-04-25T22:52:14.008 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-04-25T22:52:14.008 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-04-25T22:52:14.008 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_log_full_interval": "50", 2024-04-25T22:52:14.008 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_log_max": "10000", 2024-04-25T22:52:14.008 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_log_max_summary": "50", 2024-04-25T22:52:14.008 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_max_log_entries_per_event": "4096", 2024-04-25T22:52:14.008 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_max_log_epochs": "500", 2024-04-25T22:52:14.008 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_max_mdsmap_epochs": "500", 2024-04-25T22:52:14.008 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_max_mgrmap_epochs": "500", 2024-04-25T22:52:14.008 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_max_osd": "10000", 2024-04-25T22:52:14.008 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_max_pg_per_osd": "10000", 2024-04-25T22:52:14.008 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_max_pool_pg_num": "65536", 2024-04-25T22:52:14.008 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-04-25T22:52:14.008 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-04-25T22:52:14.009 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_mds_force_trim_to": "0", 2024-04-25T22:52:14.009 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_mds_skip_sanity": "false", 2024-04-25T22:52:14.009 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_memory_autotune": "true", 2024-04-25T22:52:14.009 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_memory_target": "2147483648", 2024-04-25T22:52:14.009 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_mgr_beacon_grace": "30", 2024-04-25T22:52:14.009 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-04-25T22:52:14.009 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_mgr_digest_period": "5", 2024-04-25T22:52:14.009 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_mgr_inactive_grace": "60", 2024-04-25T22:52:14.009 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_mgr_mkfs_grace": "240", 2024-04-25T22:52:14.009 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-04-25T22:52:14.009 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_min_osdmap_epochs": "500", 2024-04-25T22:52:14.009 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_op_complaint_time": "30", 2024-04-25T22:52:14.009 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_op_history_duration": "600", 2024-04-25T22:52:14.010 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_op_history_size": "20", 2024-04-25T22:52:14.010 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_op_history_slow_op_size": "20", 2024-04-25T22:52:14.010 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_op_history_slow_op_threshold": "10", 2024-04-25T22:52:14.010 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_op_log_threshold": "5", 2024-04-25T22:52:14.010 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-04-25T22:52:14.010 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-04-25T22:52:14.010 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-04-25T22:52:14.010 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_auto_mark_in": "false", 2024-04-25T22:52:14.010 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_auto_mark_new_in": "true", 2024-04-25T22:52:14.010 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-04-25T22:52:14.010 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-04-25T22:52:14.010 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_cache_size": "500", 2024-04-25T22:52:14.010 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_cache_size_min": "134217728", 2024-04-25T22:52:14.010 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_crush_smoke_test": "true", 2024-04-25T22:52:14.011 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_destroyed_out_interval": "600", 2024-04-25T22:52:14.011 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_down_out_interval": "600", 2024-04-25T22:52:14.011 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-04-25T22:52:14.011 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-04-25T22:52:14.011 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_force_trim_to": "0", 2024-04-25T22:52:14.011 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_full_ratio": "0.950000", 2024-04-25T22:52:14.011 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-04-25T22:52:14.011 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_laggy_halflife": "3600", 2024-04-25T22:52:14.011 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_laggy_max_interval": "300", 2024-04-25T22:52:14.011 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_laggy_weight": "0.300000", 2024-04-25T22:52:14.011 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-04-25T22:52:14.011 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_max_creating_pgs": "1024", 2024-04-25T22:52:14.011 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_max_initial_pgs": "1024", 2024-04-25T22:52:14.011 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_min_down_reporters": "2", 2024-04-25T22:52:14.012 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-04-25T22:52:14.012 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-04-25T22:52:14.012 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-04-25T22:52:14.012 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_prime_pg_temp": "true", 2024-04-25T22:52:14.012 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-04-25T22:52:14.012 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-04-25T22:52:14.012 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_report_timeout": "900", 2024-04-25T22:52:14.012 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-04-25T22:52:14.012 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-04-25T22:52:14.012 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_warn_num_repaired": "10", 2024-04-25T22:52:14.012 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_warn_op_age": "32.000000", 2024-04-25T22:52:14.012 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-04-25T22:52:14.012 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osdmap_full_prune_interval": "10", 2024-04-25T22:52:14.012 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osdmap_full_prune_min": "10000", 2024-04-25T22:52:14.013 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-04-25T22:52:14.013 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-04-25T22:52:14.013 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_pg_stuck_threshold": "60", 2024-04-25T22:52:14.013 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-04-25T22:52:14.013 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_pg_warn_min_objects": "10000", 2024-04-25T22:52:14.013 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_pg_warn_min_per_osd": "0", 2024-04-25T22:52:14.013 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-04-25T22:52:14.013 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_pool_quota_crit_threshold": "0", 2024-04-25T22:52:14.013 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_pool_quota_warn_threshold": "0", 2024-04-25T22:52:14.013 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_probe_timeout": "2.000000", 2024-04-25T22:52:14.013 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_reweight_max_change": "0.050000", 2024-04-25T22:52:14.013 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_reweight_max_osds": "4", 2024-04-25T22:52:14.013 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-04-25T22:52:14.014 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-04-25T22:52:14.014 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-04-25T22:52:14.014 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-04-25T22:52:14.014 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-04-25T22:52:14.014 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_scrub_interval": "86400", 2024-04-25T22:52:14.014 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_scrub_max_keys": "100", 2024-04-25T22:52:14.014 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_scrub_timeout": "300", 2024-04-25T22:52:14.014 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_session_timeout": "300", 2024-04-25T22:52:14.014 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_smart_report_timeout": "5", 2024-04-25T22:52:14.014 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_stat_smooth_intervals": "6", 2024-04-25T22:52:14.014 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-04-25T22:52:14.014 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_stretch_pool_min_size": "2", 2024-04-25T22:52:14.014 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_stretch_pool_size": "4", 2024-04-25T22:52:14.015 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-04-25T22:52:14.015 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_subscribe_interval": "86400.000000", 2024-04-25T22:52:14.015 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_sync_debug": "false", 2024-04-25T22:52:14.015 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_sync_max_payload_keys": "2000", 2024-04-25T22:52:14.015 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_sync_max_payload_size": "1048576", 2024-04-25T22:52:14.015 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_sync_provider_kill_at": "0", 2024-04-25T22:52:14.015 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_sync_requester_kill_at": "0", 2024-04-25T22:52:14.015 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_sync_timeout": "60.000000", 2024-04-25T22:52:14.015 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_target_pg_per_osd": "100", 2024-04-25T22:52:14.015 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_tick_interval": "5", 2024-04-25T22:52:14.015 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_timecheck_interval": "300.000000", 2024-04-25T22:52:14.015 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-04-25T22:52:14.015 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_use_min_delay_socket": "false", 2024-04-25T22:52:14.015 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_older_version_delay": "604800", 2024-04-25T22:52:14.016 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-04-25T22:52:14.016 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-04-25T22:52:14.016 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-04-25T22:52:14.016 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_filestore_osds": "false", 2024-04-25T22:52:14.016 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-04-25T22:52:14.016 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-04-25T22:52:14.016 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-04-25T22:52:14.016 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_misplaced": "false", 2024-04-25T22:52:14.016 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-04-25T22:52:14.016 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_older_version": "true", 2024-04-25T22:52:14.016 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-04-25T22:52:14.016 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_pool_no_app": "true", 2024-04-25T22:52:14.016 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-04-25T22:52:14.016 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-04-25T22:52:14.017 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-04-25T22:52:14.017 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-04-25T22:52:14.017 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_too_few_osds": "false", 2024-04-25T22:52:14.017 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-04-25T22:52:14.017 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-04-25T22:52:14.017 INFO:teuthology.orchestra.run.smithi052.stdout: "monmap": "", 2024-04-25T22:52:14.017 INFO:teuthology.orchestra.run.smithi052.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-25T22:52:14.017 INFO:teuthology.orchestra.run.smithi052.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-04-25T22:52:14.017 INFO:teuthology.orchestra.run.smithi052.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-04-25T22:52:14.017 INFO:teuthology.orchestra.run.smithi052.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-25T22:52:14.017 INFO:teuthology.orchestra.run.smithi052.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-04-25T22:52:14.017 INFO:teuthology.orchestra.run.smithi052.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-04-25T22:52:14.017 INFO:teuthology.orchestra.run.smithi052.stdout: "motr_tracing_enabled": "false", 2024-04-25T22:52:14.017 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_op_threads": "3", 2024-04-25T22:52:14.018 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_buffer_size": "131072", 2024-04-25T22:52:14.018 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_cm": "false", 2024-04-25T22:52:14.018 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_device_name": "", 2024-04-25T22:52:14.018 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_dscp": "96", 2024-04-25T22:52:14.018 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-04-25T22:52:14.018 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_gid_idx": "0", 2024-04-25T22:52:14.018 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_local_gid": "", 2024-04-25T22:52:14.018 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_polling_us": "1000", 2024-04-25T22:52:14.018 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_port_num": "1", 2024-04-25T22:52:14.018 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-04-25T22:52:14.018 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-04-25T22:52:14.018 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_roce_ver": "1", 2024-04-25T22:52:14.018 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_send_buffers": "1024", 2024-04-25T22:52:14.019 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_sl": "3", 2024-04-25T22:52:14.019 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_support_srq": "true", 2024-04-25T22:52:14.019 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_type": "ib", 2024-04-25T22:52:14.019 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_reap_threshold": "5", 2024-04-25T22:52:14.019 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_bind_before_connect": "false", 2024-04-25T22:52:14.019 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_bind_ipv4": "true", 2024-04-25T22:52:14.019 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_bind_ipv6": "false", 2024-04-25T22:52:14.019 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_bind_msgr1": "true", 2024-04-25T22:52:14.019 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_bind_msgr2": "true", 2024-04-25T22:52:14.019 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_bind_port_max": "7568", 2024-04-25T22:52:14.019 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_bind_port_min": "6800", 2024-04-25T22:52:14.019 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_bind_prefer_ipv4": "false", 2024-04-25T22:52:14.019 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_bind_retry_count": "3", 2024-04-25T22:52:14.019 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_bind_retry_delay": "5", 2024-04-25T22:52:14.020 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_blackhole_client": "false", 2024-04-25T22:52:14.020 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_blackhole_mds": "false", 2024-04-25T22:52:14.020 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_blackhole_mgr": "false", 2024-04-25T22:52:14.020 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_blackhole_mon": "false", 2024-04-25T22:52:14.020 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_blackhole_osd": "false", 2024-04-25T22:52:14.020 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_client_mode": "crc secure", 2024-04-25T22:52:14.020 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_cluster_mode": "crc secure", 2024-04-25T22:52:14.020 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_cluster_type": "", 2024-04-25T22:52:14.020 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_compress_secure": "false", 2024-04-25T22:52:14.020 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_connection_idle_timeout": "900", 2024-04-25T22:52:14.020 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_connection_ready_timeout": "10", 2024-04-25T22:52:14.020 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_crc_data": "true", 2024-04-25T22:52:14.020 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_crc_header": "true", 2024-04-25T22:52:14.020 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_die_on_bad_msg": "false", 2024-04-25T22:52:14.021 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_die_on_bug": "true", 2024-04-25T22:52:14.021 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_die_on_old_message": "true", 2024-04-25T22:52:14.021 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_die_on_skipped_message": "false", 2024-04-25T22:52:14.021 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_die_on_unhandled_msg": "false", 2024-04-25T22:52:14.021 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-04-25T22:52:14.021 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_coremask": "0xF", 2024-04-25T22:52:14.021 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-04-25T22:52:14.021 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_devs_allowlist": "", 2024-04-25T22:52:14.021 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_enable_tso": "true", 2024-04-25T22:52:14.021 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-04-25T22:52:14.021 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-04-25T22:52:14.021 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_hugepages": "", 2024-04-25T22:52:14.021 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_hw_flow_control": "true", 2024-04-25T22:52:14.021 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-04-25T22:52:14.022 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_lro": "true", 2024-04-25T22:52:14.022 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_memory_channel": "4", 2024-04-25T22:52:14.022 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-04-25T22:52:14.022 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_pmd": "", 2024-04-25T22:52:14.022 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_port_id": "0", 2024-04-25T22:52:14.022 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-04-25T22:52:14.022 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dump_corrupt_message_level": "1", 2024-04-25T22:52:14.022 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dump_on_send": "false", 2024-04-25T22:52:14.022 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_initial_backoff": "0.200000", 2024-04-25T22:52:14.022 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_inject_delay_max": "1.000000", 2024-04-25T22:52:14.022 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_inject_delay_probability": "0.000000", 2024-04-25T22:52:14.022 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_inject_delay_type": "", 2024-04-25T22:52:14.022 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_inject_internal_delays": "0.000000", 2024-04-25T22:52:14.023 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_inject_network_congestion": "0", 2024-04-25T22:52:14.023 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_inject_socket_failures": "0", 2024-04-25T22:52:14.023 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_learn_addr_from_peer": "true", 2024-04-25T22:52:14.023 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_max_accept_failures": "4", 2024-04-25T22:52:14.023 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_max_backoff": "15.000000", 2024-04-25T22:52:14.023 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_mon_client_mode": "secure crc", 2024-04-25T22:52:14.023 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_mon_cluster_mode": "secure crc", 2024-04-25T22:52:14.023 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_mon_service_mode": "secure crc", 2024-04-25T22:52:14.023 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_osd_compress_min_size": "1024", 2024-04-25T22:52:14.023 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_osd_compress_mode": "none", 2024-04-25T22:52:14.023 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_osd_compression_algorithm": "snappy", 2024-04-25T22:52:14.023 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-04-25T22:52:14.023 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_pq_min_cost": "65536", 2024-04-25T22:52:14.023 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_public_type": "", 2024-04-25T22:52:14.024 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_service_mode": "crc secure", 2024-04-25T22:52:14.024 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_tcp_listen_backlog": "512", 2024-04-25T22:52:14.024 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_tcp_nodelay": "true", 2024-04-25T22:52:14.024 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-04-25T22:52:14.024 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_tcp_rcvbuf": "0", 2024-04-25T22:52:14.024 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_type": "async+posix", 2024-04-25T22:52:14.024 INFO:teuthology.orchestra.run.smithi052.stdout: "no_config_file": "false", 2024-04-25T22:52:14.024 INFO:teuthology.orchestra.run.smithi052.stdout: "objecter_completion_locks_per_session": "32", 2024-04-25T22:52:14.024 INFO:teuthology.orchestra.run.smithi052.stdout: "objecter_debug_inject_relock_delay": "false", 2024-04-25T22:52:14.024 INFO:teuthology.orchestra.run.smithi052.stdout: "objecter_inflight_op_bytes": "104857600", 2024-04-25T22:52:14.024 INFO:teuthology.orchestra.run.smithi052.stdout: "objecter_inflight_ops": "1024", 2024-04-25T22:52:14.024 INFO:teuthology.orchestra.run.smithi052.stdout: "objecter_inject_no_watch_ping": "false", 2024-04-25T22:52:14.024 INFO:teuthology.orchestra.run.smithi052.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-04-25T22:52:14.024 INFO:teuthology.orchestra.run.smithi052.stdout: "objecter_tick_interval": "5.000000", 2024-04-25T22:52:14.025 INFO:teuthology.orchestra.run.smithi052.stdout: "objecter_timeout": "10.000000", 2024-04-25T22:52:14.025 INFO:teuthology.orchestra.run.smithi052.stdout: "objectstore_blackhole": "false", 2024-04-25T22:52:14.025 INFO:teuthology.orchestra.run.smithi052.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-04-25T22:52:14.025 INFO:teuthology.orchestra.run.smithi052.stdout: "openssl_engine_opts": "", 2024-04-25T22:52:14.025 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_agent_delay_time": "5.000000", 2024-04-25T22:52:14.025 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_agent_hist_halflife": "1000", 2024-04-25T22:52:14.025 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_agent_max_low_ops": "2", 2024-04-25T22:52:14.025 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_agent_max_ops": "4", 2024-04-25T22:52:14.025 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-04-25T22:52:14.025 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_agent_quantize_effort": "0.100000", 2024-04-25T22:52:14.025 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_agent_slop": "0.020000", 2024-04-25T22:52:14.025 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-04-25T22:52:14.025 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_allow_recovery_below_min_size": "true", 2024-04-25T22:52:14.026 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_asio_thread_count": "2", 2024-04-25T22:52:14.026 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_async_recovery_min_cost": "100", 2024-04-25T22:52:14.026 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_auto_mark_unfound_lost": "false", 2024-04-25T22:52:14.026 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_backfill_retry_interval": "30.000000", 2024-04-25T22:52:14.026 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_backfill_scan_max": "512", 2024-04-25T22:52:14.026 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_backfill_scan_min": "64", 2024-04-25T22:52:14.026 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_backoff_on_degraded": "false", 2024-04-25T22:52:14.026 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_backoff_on_peering": "false", 2024-04-25T22:52:14.026 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_backoff_on_unfound": "true", 2024-04-25T22:52:14.026 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_beacon_report_interval": "300", 2024-04-25T22:52:14.026 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_bench_duration": "30", 2024-04-25T22:52:14.026 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-04-25T22:52:14.026 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_bench_max_block_size": "67108864", 2024-04-25T22:52:14.026 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_bench_small_size_max_iops": "100", 2024-04-25T22:52:14.027 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_blkin_trace_all": "false", 2024-04-25T22:52:14.027 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_blocked_scrub_grace_period": "120", 2024-04-25T22:52:14.027 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-04-25T22:52:14.027 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-04-25T22:52:14.027 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-04-25T22:52:14.027 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_check_for_log_corruption": "false", 2024-04-25T22:52:14.027 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-04-25T22:52:14.027 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-25T22:52:14.027 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2024-04-25T22:52:14.027 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-25T22:52:14.027 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_class_update_on_start": "true", 2024-04-25T22:52:14.027 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_client_message_cap": "256", 2024-04-25T22:52:14.027 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_client_message_size_cap": "524288000", 2024-04-25T22:52:14.027 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_client_op_priority": "63", 2024-04-25T22:52:14.028 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_client_watch_timeout": "30", 2024-04-25T22:52:14.028 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_command_max_records": "256", 2024-04-25T22:52:14.028 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_compact_on_start": "false", 2024-04-25T22:52:14.028 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-04-25T22:52:14.028 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_crush_chooseleaf_type": "0", 2024-04-25T22:52:14.028 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_crush_initial_weight": "-1.000000", 2024-04-25T22:52:14.028 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_crush_update_on_start": "true", 2024-04-25T22:52:14.028 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_crush_update_weight_set": "true", 2024-04-25T22:52:14.028 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-04-25T22:52:14.028 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-04-25T22:52:14.028 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-04-25T22:52:14.028 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_drop_ping_duration": "0", 2024-04-25T22:52:14.028 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-04-25T22:52:14.028 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_feed_pullee": "-1", 2024-04-25T22:52:14.029 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-04-25T22:52:14.029 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-04-25T22:52:14.029 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-04-25T22:52:14.029 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_misdirected_ops": "false", 2024-04-25T22:52:14.029 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_no_acting_change": "false", 2024-04-25T22:52:14.029 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_no_purge_strays": "false", 2024-04-25T22:52:14.029 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_op_order": "false", 2024-04-25T22:52:14.029 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_pg_log_writeout": "false", 2024-04-25T22:52:14.029 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_pretend_recovery_active": "false", 2024-04-25T22:52:14.029 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-04-25T22:52:14.029 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-04-25T22:52:14.029 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_shutdown": "false", 2024-04-25T22:52:14.029 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-04-25T22:52:14.030 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-04-25T22:52:14.030 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_trim_objects": "false", 2024-04-25T22:52:14.030 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_verify_cached_snaps": "false", 2024-04-25T22:52:14.030 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_verify_missing_on_start": "false", 2024-04-25T22:52:14.030 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_verify_snaps": "false", 2024-04-25T22:52:14.030 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-04-25T22:52:14.030 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-04-25T22:52:14.030 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_deep_scrub_keys": "1024", 2024-04-25T22:52:14.030 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-04-25T22:52:14.030 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-04-25T22:52:14.030 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-04-25T22:52:14.030 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_deep_scrub_stride": "524288", 2024-04-25T22:52:14.030 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-04-25T22:52:14.031 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_default_data_pool_replay_window": "5", 2024-04-25T22:52:14.031 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_default_notify_timeout": "30", 2024-04-25T22:52:14.031 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_delete_sleep": "0.000000", 2024-04-25T22:52:14.031 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-04-25T22:52:14.031 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-04-25T22:52:14.031 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-04-25T22:52:14.031 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_discard_disconnected_ops": "true", 2024-04-25T22:52:14.031 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_enable_op_tracker": "true", 2024-04-25T22:52:14.031 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-04-25T22:52:14.031 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_extblkdev_plugins": "vdo", 2024-04-25T22:52:14.031 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-04-25T22:52:14.031 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-04-25T22:52:14.031 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_fast_info": "true", 2024-04-25T22:52:14.031 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_fast_shutdown": "true", 2024-04-25T22:52:14.032 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-04-25T22:52:14.032 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_fast_shutdown_timeout": "15", 2024-04-25T22:52:14.032 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-04-25T22:52:14.032 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-04-25T22:52:14.032 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-04-25T22:52:14.032 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_function_tracing": "false", 2024-04-25T22:52:14.032 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_heartbeat_grace": "20", 2024-04-25T22:52:14.032 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_heartbeat_interval": "6", 2024-04-25T22:52:14.032 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-04-25T22:52:14.032 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_heartbeat_min_peers": "10", 2024-04-25T22:52:14.032 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_heartbeat_min_size": "2000", 2024-04-25T22:52:14.032 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_heartbeat_stale": "600", 2024-04-25T22:52:14.032 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-04-25T22:52:14.032 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_hit_set_max_size": "100000", 2024-04-25T22:52:14.033 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_hit_set_min_size": "1000", 2024-04-25T22:52:14.033 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-04-25T22:52:14.033 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-04-25T22:52:14.033 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-04-25T22:52:14.033 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-04-25T22:52:14.033 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-04-25T22:52:14.033 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_journal_flush_on_shutdown": "true", 2024-04-25T22:52:14.033 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_journal_size": "5120", 2024-04-25T22:52:14.033 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_kill_backfill_at": "0", 2024-04-25T22:52:14.033 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_loop_before_reset_tphandle": "64", 2024-04-25T22:52:14.033 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_map_cache_size": "50", 2024-04-25T22:52:14.033 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_map_dedup": "true", 2024-04-25T22:52:14.033 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_map_message_max": "40", 2024-04-25T22:52:14.034 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_map_message_max_bytes": "10485760", 2024-04-25T22:52:14.034 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_map_share_max_epochs": "40", 2024-04-25T22:52:14.034 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_attr_name_len": "100", 2024-04-25T22:52:14.034 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_attr_size": "0", 2024-04-25T22:52:14.034 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_backfills": "1", 2024-04-25T22:52:14.034 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_markdown_count": "5", 2024-04-25T22:52:14.034 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_markdown_period": "600", 2024-04-25T22:52:14.034 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_object_name_len": "2048", 2024-04-25T22:52:14.034 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_object_namespace_len": "256", 2024-04-25T22:52:14.034 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_object_size": "134217728", 2024-04-25T22:52:14.034 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-04-25T22:52:14.034 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_omap_entries_per_request": "1024", 2024-04-25T22:52:14.034 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_pg_blocked_by": "16", 2024-04-25T22:52:14.034 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_pg_log_entries": "10000", 2024-04-25T22:52:14.035 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-04-25T22:52:14.035 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_pgls": "1024", 2024-04-25T22:52:14.035 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_push_cost": "8388608", 2024-04-25T22:52:14.035 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_push_objects": "10", 2024-04-25T22:52:14.035 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_scrubs": "3", 2024-04-25T22:52:14.035 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-04-25T22:52:14.035 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_trimming_pgs": "2", 2024-04-25T22:52:14.035 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_write_op_reply_len": "64", 2024-04-25T22:52:14.035 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_write_size": "90", 2024-04-25T22:52:14.035 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-04-25T22:52:14.035 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-04-25T22:52:14.035 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-04-25T22:52:14.035 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-04-25T22:52:14.036 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-04-25T22:52:14.036 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-04-25T22:52:14.036 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-04-25T22:52:14.036 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_override_recovery_settings": "false", 2024-04-25T22:52:14.036 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_profile": "balanced", 2024-04-25T22:52:14.036 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-04-25T22:52:14.036 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-04-25T22:52:14.036 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-04-25T22:52:14.036 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-04-25T22:52:14.036 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-04-25T22:52:14.036 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-04-25T22:52:14.036 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-04-25T22:52:14.036 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-04-25T22:52:14.036 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-04-25T22:52:14.037 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-04-25T22:52:14.037 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_skip_benchmark": "false", 2024-04-25T22:52:14.037 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_memory_base": "805306368", 2024-04-25T22:52:14.037 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_memory_cache_min": "134217728", 2024-04-25T22:52:14.037 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-04-25T22:52:14.037 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-04-25T22:52:14.037 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_memory_target": "4294967296", 2024-04-25T22:52:14.037 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_memory_target_autotune": "false", 2024-04-25T22:52:14.037 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-04-25T22:52:14.037 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_min_pg_log_entries": "250", 2024-04-25T22:52:14.037 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_min_recovery_priority": "0", 2024-04-25T22:52:14.037 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mon_heartbeat_interval": "30", 2024-04-25T22:52:14.037 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-04-25T22:52:14.037 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mon_report_interval": "5", 2024-04-25T22:52:14.038 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mon_report_max_in_flight": "2", 2024-04-25T22:52:14.038 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-04-25T22:52:14.038 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_num_cache_shards": "32", 2024-04-25T22:52:14.038 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_num_op_tracker_shard": "32", 2024-04-25T22:52:14.038 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_numa_auto_affinity": "true", 2024-04-25T22:52:14.038 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_numa_node": "-1", 2024-04-25T22:52:14.038 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_numa_prefer_iface": "true", 2024-04-25T22:52:14.038 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-04-25T22:52:14.038 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_objecter_finishers": "1", 2024-04-25T22:52:14.038 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_objectstore": "bluestore", 2024-04-25T22:52:14.038 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_objectstore_fuse": "false", 2024-04-25T22:52:14.038 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_objectstore_tracing": "false", 2024-04-25T22:52:14.038 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_complaint_time": "30.000000", 2024-04-25T22:52:14.039 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_history_duration": "600", 2024-04-25T22:52:14.039 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_history_size": "20", 2024-04-25T22:52:14.039 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_history_slow_op_size": "20", 2024-04-25T22:52:14.039 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-04-25T22:52:14.039 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_log_threshold": "5", 2024-04-25T22:52:14.039 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_num_shards": "0", 2024-04-25T22:52:14.039 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_num_shards_hdd": "5", 2024-04-25T22:52:14.039 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_num_shards_ssd": "8", 2024-04-25T22:52:14.039 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_num_threads_per_shard": "0", 2024-04-25T22:52:14.039 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-04-25T22:52:14.039 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-04-25T22:52:14.039 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-04-25T22:52:14.039 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_pq_min_cost": "65536", 2024-04-25T22:52:14.039 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_queue": "mclock_scheduler", 2024-04-25T22:52:14.040 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_queue_cut_off": "high", 2024-04-25T22:52:14.040 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_thread_suicide_timeout": "150", 2024-04-25T22:52:14.040 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_thread_timeout": "15", 2024-04-25T22:52:14.040 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_open_classes_on_start": "true", 2024-04-25T22:52:14.040 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_os_flags": "0", 2024-04-25T22:52:14.040 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_peering_op_priority": "255", 2024-04-25T22:52:14.040 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pg_delete_cost": "1048576", 2024-04-25T22:52:14.040 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pg_delete_priority": "5", 2024-04-25T22:52:14.040 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-04-25T22:52:14.040 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-04-25T22:52:14.040 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pg_log_dups_tracked": "3000", 2024-04-25T22:52:14.040 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pg_log_trim_max": "10000", 2024-04-25T22:52:14.040 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pg_log_trim_min": "100", 2024-04-25T22:52:14.041 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-04-25T22:52:14.041 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pg_object_context_cache_count": "64", 2024-04-25T22:52:14.041 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-04-25T22:52:14.041 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-04-25T22:52:14.041 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-04-25T22:52:14.041 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-04-25T22:52:14.041 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-04-25T22:52:14.041 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-04-25T22:52:14.041 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-04-25T22:52:14.041 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-04-25T22:52:14.041 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_crimson": "false", 2024-04-25T22:52:14.041 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_crush_rule": "-1", 2024-04-25T22:52:14.041 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_ec_fast_read": "false", 2024-04-25T22:52:14.041 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-04-25T22:52:14.042 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_flag_bulk": "false", 2024-04-25T22:52:14.042 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-04-25T22:52:14.042 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_flag_nodelete": "false", 2024-04-25T22:52:14.042 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-04-25T22:52:14.042 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-04-25T22:52:14.042 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_flags": "0", 2024-04-25T22:52:14.042 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-04-25T22:52:14.042 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_min_size": "0", 2024-04-25T22:52:14.042 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-04-25T22:52:14.042 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_pg_num": "32", 2024-04-25T22:52:14.042 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_pgp_num": "0", 2024-04-25T22:52:14.042 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-04-25T22:52:14.042 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_read_ratio": "70", 2024-04-25T22:52:14.043 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_size": "2", 2024-04-25T22:52:14.043 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_type": "replicated", 2024-04-25T22:52:14.043 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-04-25T22:52:14.043 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_use_gmt_hitset": "true", 2024-04-25T22:52:14.043 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_push_per_object_cost": "1000", 2024-04-25T22:52:14.043 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_read_ec_check_for_errors": "false", 2024-04-25T22:52:14.043 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recover_clone_overlap": "true", 2024-04-25T22:52:14.043 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recover_clone_overlap_limit": "10", 2024-04-25T22:52:14.043 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_cost": "20971520", 2024-04-25T22:52:14.043 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_delay_start": "0.000000", 2024-04-25T22:52:14.043 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_max_active": "0", 2024-04-25T22:52:14.043 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_max_active_hdd": "3", 2024-04-25T22:52:14.045 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_max_active_ssd": "10", 2024-04-25T22:52:14.045 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_max_chunk": "8388608", 2024-04-25T22:52:14.045 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-04-25T22:52:14.045 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_max_single_start": "1", 2024-04-25T22:52:14.046 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_op_priority": "3", 2024-04-25T22:52:14.046 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_op_warn_multiple": "16", 2024-04-25T22:52:14.046 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_priority": "5", 2024-04-25T22:52:14.046 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_retry_interval": "30.000000", 2024-04-25T22:52:14.046 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_sleep": "0.000000", 2024-04-25T22:52:14.046 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-04-25T22:52:14.046 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-04-25T22:52:14.046 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-04-25T22:52:14.046 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_repair_during_recovery": "false", 2024-04-25T22:52:14.046 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_requested_scrub_priority": "120", 2024-04-25T22:52:14.046 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-04-25T22:52:14.046 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_rollback_to_cluster_snap": "", 2024-04-25T22:52:14.046 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_auto_repair": "false", 2024-04-25T22:52:14.047 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-04-25T22:52:14.047 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-04-25T22:52:14.047 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_begin_hour": "0", 2024-04-25T22:52:14.047 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_begin_week_day": "0", 2024-04-25T22:52:14.047 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_chunk_max": "25", 2024-04-25T22:52:14.047 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_chunk_min": "5", 2024-04-25T22:52:14.047 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_cost": "52428800", 2024-04-25T22:52:14.047 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_disable_reservation_queuing": "true", 2024-04-25T22:52:14.047 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_during_recovery": "false", 2024-04-25T22:52:14.047 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_end_hour": "0", 2024-04-25T22:52:14.047 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_end_week_day": "0", 2024-04-25T22:52:14.047 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_event_cost": "4096", 2024-04-25T22:52:14.047 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-04-25T22:52:14.047 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-04-25T22:52:14.048 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_invalid_stats": "true", 2024-04-25T22:52:14.048 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_load_threshold": "0.500000", 2024-04-25T22:52:14.048 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_max_interval": "604800.000000", 2024-04-25T22:52:14.048 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_max_preemptions": "5", 2024-04-25T22:52:14.048 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_min_interval": "86400.000000", 2024-04-25T22:52:14.048 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_priority": "5", 2024-04-25T22:52:14.048 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_reservation_timeout": "300000", 2024-04-25T22:52:14.048 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_sleep": "0.000000", 2024-04-25T22:52:14.048 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-04-25T22:52:14.048 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-04-25T22:52:14.048 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_shutdown_pgref_assert": "false", 2024-04-25T22:52:14.048 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_skip_data_digest": "false", 2024-04-25T22:52:14.048 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_smart_report_timeout": "5", 2024-04-25T22:52:14.048 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_snap_trim_cost": "1048576", 2024-04-25T22:52:14.049 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_snap_trim_priority": "5", 2024-04-25T22:52:14.049 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_snap_trim_sleep": "0.000000", 2024-04-25T22:52:14.049 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-04-25T22:52:14.049 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-04-25T22:52:14.049 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-04-25T22:52:14.049 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-04-25T22:52:14.049 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_stats_update_period_scrubbing": "15", 2024-04-25T22:52:14.049 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-04-25T22:52:14.049 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_target_transaction_size": "30", 2024-04-25T22:52:14.049 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-04-25T22:52:14.049 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-04-25T22:52:14.049 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-04-25T22:52:14.049 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-04-25T22:52:14.050 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-04-25T22:52:14.050 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-04-25T22:52:14.050 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-04-25T22:52:14.050 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_tier_default_cache_mode": "writeback", 2024-04-25T22:52:14.050 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-04-25T22:52:14.050 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-04-25T22:52:14.050 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_tracing": "false", 2024-04-25T22:52:14.050 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_use_stale_snap": "false", 2024-04-25T22:52:14.050 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-04-25T22:52:14.050 INFO:teuthology.orchestra.run.smithi052.stdout: "osdc_blkin_trace_all": "false", 2024-04-25T22:52:14.050 INFO:teuthology.orchestra.run.smithi052.stdout: "paxos_kill_at": "0", 2024-04-25T22:52:14.050 INFO:teuthology.orchestra.run.smithi052.stdout: "paxos_max_join_drift": "10", 2024-04-25T22:52:14.050 INFO:teuthology.orchestra.run.smithi052.stdout: "paxos_min": "500", 2024-04-25T22:52:14.051 INFO:teuthology.orchestra.run.smithi052.stdout: "paxos_min_wait": "0.050000", 2024-04-25T22:52:14.051 INFO:teuthology.orchestra.run.smithi052.stdout: "paxos_propose_interval": "1.000000", 2024-04-25T22:52:14.051 INFO:teuthology.orchestra.run.smithi052.stdout: "paxos_service_trim_max": "500", 2024-04-25T22:52:14.051 INFO:teuthology.orchestra.run.smithi052.stdout: "paxos_service_trim_max_multiplier": "20", 2024-04-25T22:52:14.051 INFO:teuthology.orchestra.run.smithi052.stdout: "paxos_service_trim_min": "250", 2024-04-25T22:52:14.051 INFO:teuthology.orchestra.run.smithi052.stdout: "paxos_stash_full_interval": "25", 2024-04-25T22:52:14.051 INFO:teuthology.orchestra.run.smithi052.stdout: "paxos_trim_max": "500", 2024-04-25T22:52:14.051 INFO:teuthology.orchestra.run.smithi052.stdout: "paxos_trim_min": "250", 2024-04-25T22:52:14.051 INFO:teuthology.orchestra.run.smithi052.stdout: "perf": "true", 2024-04-25T22:52:14.051 INFO:teuthology.orchestra.run.smithi052.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-04-25T22:52:14.051 INFO:teuthology.orchestra.run.smithi052.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-04-25T22:52:14.051 INFO:teuthology.orchestra.run.smithi052.stdout: "plugin_dir": "/usr/lib64/ceph", 2024-04-25T22:52:14.051 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addr": "-", 2024-04-25T22:52:14.051 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addrv": "", 2024-04-25T22:52:14.052 INFO:teuthology.orchestra.run.smithi052.stdout: "public_bind_addr": "-", 2024-04-25T22:52:14.052 INFO:teuthology.orchestra.run.smithi052.stdout: "public_network": "", 2024-04-25T22:52:14.052 INFO:teuthology.orchestra.run.smithi052.stdout: "public_network_interface": "", 2024-04-25T22:52:14.052 INFO:teuthology.orchestra.run.smithi052.stdout: "qat_compressor_enabled": "false", 2024-04-25T22:52:14.052 INFO:teuthology.orchestra.run.smithi052.stdout: "qat_compressor_session_max_number": "256", 2024-04-25T22:52:14.052 INFO:teuthology.orchestra.run.smithi052.stdout: "rados_mon_op_timeout": "0", 2024-04-25T22:52:14.052 INFO:teuthology.orchestra.run.smithi052.stdout: "rados_osd_op_timeout": "0", 2024-04-25T22:52:14.052 INFO:teuthology.orchestra.run.smithi052.stdout: "rados_tracing": "false", 2024-04-25T22:52:14.052 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_atime_update_interval": "60", 2024-04-25T22:52:14.052 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-04-25T22:52:14.052 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_balance_parent_reads": "false", 2024-04-25T22:52:14.052 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_balance_snap_reads": "false", 2024-04-25T22:52:14.052 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_blkin_trace_all": "false", 2024-04-25T22:52:14.052 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_blocklist_expire_seconds": "0", 2024-04-25T22:52:14.053 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_blocklist_on_break_lock": "true", 2024-04-25T22:52:14.053 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_cache": "true", 2024-04-25T22:52:14.053 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_cache_block_writes_upfront": "false", 2024-04-25T22:52:14.053 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_cache_max_dirty": "25165824", 2024-04-25T22:52:14.053 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-04-25T22:52:14.053 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_cache_max_dirty_object": "0", 2024-04-25T22:52:14.053 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_cache_policy": "writearound", 2024-04-25T22:52:14.053 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_cache_size": "33554432", 2024-04-25T22:52:14.053 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_cache_target_dirty": "16777216", 2024-04-25T22:52:14.053 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-04-25T22:52:14.053 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_clone_copy_on_read": "false", 2024-04-25T22:52:14.053 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_compression_hint": "none", 2024-04-25T22:52:14.053 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_concurrent_management_ops": "10", 2024-04-25T22:52:14.054 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-04-25T22:52:14.054 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_default_clone_format": "auto", 2024-04-25T22:52:14.054 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_default_data_pool": "", 2024-04-25T22:52:14.054 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_default_features": "61", 2024-04-25T22:52:14.054 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_default_format": "2", 2024-04-25T22:52:14.054 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_default_map_options": "", 2024-04-25T22:52:14.054 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_default_order": "22", 2024-04-25T22:52:14.054 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_default_pool": "rbd", 2024-04-25T22:52:14.054 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-04-25T22:52:14.054 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_default_stripe_count": "0", 2024-04-25T22:52:14.054 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_default_stripe_unit": "0", 2024-04-25T22:52:14.054 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_disable_zero_copy_writes": "true", 2024-04-25T22:52:14.054 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_discard_granularity_bytes": "65536", 2024-04-25T22:52:14.055 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-04-25T22:52:14.055 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_enable_alloc_hint": "true", 2024-04-25T22:52:14.055 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-04-25T22:52:14.055 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_io_scheduler": "simple", 2024-04-25T22:52:14.055 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-04-25T22:52:14.055 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_journal_commit_age": "5.000000", 2024-04-25T22:52:14.055 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-04-25T22:52:14.055 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-04-25T22:52:14.055 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-04-25T22:52:14.055 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-04-25T22:52:14.055 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_journal_object_flush_interval": "0", 2024-04-25T22:52:14.055 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-04-25T22:52:14.055 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-04-25T22:52:14.056 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_journal_order": "24", 2024-04-25T22:52:14.056 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_journal_pool": "", 2024-04-25T22:52:14.056 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_journal_splay_width": "4", 2024-04-25T22:52:14.056 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_localize_parent_reads": "false", 2024-04-25T22:52:14.056 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_localize_snap_reads": "false", 2024-04-25T22:52:14.056 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-04-25T22:52:14.056 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-04-25T22:52:14.056 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-04-25T22:52:14.056 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-04-25T22:52:14.056 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-04-25T22:52:14.056 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-04-25T22:52:14.056 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_image_policy_type": "simple", 2024-04-25T22:52:14.056 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-04-25T22:52:14.056 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-04-25T22:52:14.057 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-04-25T22:52:14.057 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-04-25T22:52:14.057 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-04-25T22:52:14.057 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-04-25T22:52:14.057 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-04-25T22:52:14.057 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_memory_autotune": "true", 2024-04-25T22:52:14.057 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_memory_base": "805306368", 2024-04-25T22:52:14.057 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-04-25T22:52:14.057 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-04-25T22:52:14.057 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-04-25T22:52:14.057 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-04-25T22:52:14.057 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_memory_target": "4294967296", 2024-04-25T22:52:14.057 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-04-25T22:52:14.058 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-04-25T22:52:14.058 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-04-25T22:52:14.058 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirroring_delete_delay": "0", 2024-04-25T22:52:14.058 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-04-25T22:52:14.058 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirroring_replay_delay": "0", 2024-04-25T22:52:14.058 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-04-25T22:52:14.058 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-04-25T22:52:14.058 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_move_to_trash_on_remove": "false", 2024-04-25T22:52:14.058 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-04-25T22:52:14.058 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mtime_update_interval": "60", 2024-04-25T22:52:14.058 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_non_blocking_aio": "true", 2024-04-25T22:52:14.058 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_op_thread_timeout": "60", 2024-04-25T22:52:14.058 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_op_threads": "1", 2024-04-25T22:52:14.058 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_parent_cache_enabled": "false", 2024-04-25T22:52:14.059 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_persistent_cache_mode": "disabled", 2024-04-25T22:52:14.059 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_persistent_cache_path": "/tmp", 2024-04-25T22:52:14.059 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_persistent_cache_size": "1073741824", 2024-04-25T22:52:14.059 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_plugins": "", 2024-04-25T22:52:14.059 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_bps_burst": "0", 2024-04-25T22:52:14.059 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-04-25T22:52:14.059 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_bps_limit": "0", 2024-04-25T22:52:14.059 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_exclude_ops": "0", 2024-04-25T22:52:14.059 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_iops_burst": "0", 2024-04-25T22:52:14.059 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-04-25T22:52:14.059 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_iops_limit": "0", 2024-04-25T22:52:14.059 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_read_bps_burst": "0", 2024-04-25T22:52:14.059 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-04-25T22:52:14.060 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_read_bps_limit": "0", 2024-04-25T22:52:14.060 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_read_iops_burst": "0", 2024-04-25T22:52:14.060 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-04-25T22:52:14.060 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_read_iops_limit": "0", 2024-04-25T22:52:14.060 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_schedule_tick_min": "50", 2024-04-25T22:52:14.060 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_write_bps_burst": "0", 2024-04-25T22:52:14.060 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-04-25T22:52:14.060 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_write_bps_limit": "0", 2024-04-25T22:52:14.060 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_write_iops_burst": "0", 2024-04-25T22:52:14.060 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-04-25T22:52:14.060 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_write_iops_limit": "0", 2024-04-25T22:52:14.060 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_quiesce_notification_attempts": "10", 2024-04-25T22:52:14.060 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_read_from_replica_policy": "default", 2024-04-25T22:52:14.061 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-04-25T22:52:14.061 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_readahead_max_bytes": "524288", 2024-04-25T22:52:14.061 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_readahead_trigger_requests": "10", 2024-04-25T22:52:14.061 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_request_timed_out_seconds": "30", 2024-04-25T22:52:14.061 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_skip_partial_discard": "true", 2024-04-25T22:52:14.061 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-04-25T22:52:14.061 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_tracing": "false", 2024-04-25T22:52:14.061 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_validate_names": "true", 2024-04-25T22:52:14.061 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_validate_pool": "true", 2024-04-25T22:52:14.061 INFO:teuthology.orchestra.run.smithi052.stdout: "restapi_base_url": "", 2024-04-25T22:52:14.061 INFO:teuthology.orchestra.run.smithi052.stdout: "restapi_log_level": "", 2024-04-25T22:52:14.061 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_acl_grants_max_num": "100", 2024-04-25T22:52:14.061 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_admin_entry": "admin", 2024-04-25T22:52:14.061 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-04-25T22:52:14.062 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_backend_store": "rados", 2024-04-25T22:52:14.062 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_barbican_url": "", 2024-04-25T22:52:14.062 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_beast_enable_async": "true", 2024-04-25T22:52:14.062 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_bucket_counters_cache": "false", 2024-04-25T22:52:14.062 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-04-25T22:52:14.062 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-04-25T22:52:14.062 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-04-25T22:52:14.062 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_bucket_index_max_aio": "128", 2024-04-25T22:52:14.062 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-04-25T22:52:14.062 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-04-25T22:52:14.062 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_bucket_quota_ttl": "600", 2024-04-25T22:52:14.062 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-04-25T22:52:14.063 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_cache_enabled": "true", 2024-04-25T22:52:14.063 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_cache_expiry_interval": "900", 2024-04-25T22:52:14.063 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_cache_lru_size": "10000", 2024-04-25T22:52:14.063 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_config_store": "rados", 2024-04-25T22:52:14.063 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_content_length_compat": "false", 2024-04-25T22:52:14.063 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_copy_obj_progress": "true", 2024-04-25T22:52:14.063 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-04-25T22:52:14.063 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_cors_rules_max_num": "100", 2024-04-25T22:52:14.063 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_cross_domain_policy": "", 2024-04-25T22:52:14.063 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_default_encryption_key": "", 2024-04-25T22:52:14.063 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_kmip_addr": "", 2024-04-25T22:52:14.063 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_kmip_ca_path": "", 2024-04-25T22:52:14.063 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_kmip_client_cert": "", 2024-04-25T22:52:14.063 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_kmip_client_key": "", 2024-04-25T22:52:14.064 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-04-25T22:52:14.064 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_kmip_password": "", 2024-04-25T22:52:14.064 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-04-25T22:52:14.064 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_kmip_username": "", 2024-04-25T22:52:14.064 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_require_ssl": "true", 2024-04-25T22:52:14.064 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-04-25T22:52:14.064 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-04-25T22:52:14.064 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-04-25T22:52:14.064 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-04-25T22:52:14.064 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-04-25T22:52:14.064 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-04-25T22:52:14.064 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-04-25T22:52:14.064 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-04-25T22:52:14.065 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-04-25T22:52:14.065 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-04-25T22:52:14.065 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-04-25T22:52:14.065 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-04-25T22:52:14.065 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-04-25T22:52:14.065 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-04-25T22:52:14.065 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_suppress_logs": "true", 2024-04-25T22:52:14.065 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_vault_addr": "", 2024-04-25T22:52:14.065 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_vault_auth": "token", 2024-04-25T22:52:14.065 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_vault_namespace": "", 2024-04-25T22:52:14.065 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_vault_prefix": "", 2024-04-25T22:52:14.065 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-04-25T22:52:14.065 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-04-25T22:52:14.065 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-04-25T22:52:14.066 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-04-25T22:52:14.066 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_vault_token_file": "", 2024-04-25T22:52:14.066 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-04-25T22:52:14.066 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_curl_buffersize": "524288", 2024-04-25T22:52:14.066 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_curl_low_speed_limit": "1024", 2024-04-25T22:52:14.066 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_curl_low_speed_time": "300", 2024-04-25T22:52:14.066 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_curl_tcp_keepalive": "0", 2024-04-25T22:52:14.066 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-04-25T22:52:14.066 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-04-25T22:52:14.066 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-04-25T22:52:14.066 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-04-25T22:52:14.066 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-04-25T22:52:14.067 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_d3n_l1_fadvise": "4", 2024-04-25T22:52:14.067 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-04-25T22:52:14.067 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-04-25T22:52:14.067 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-04-25T22:52:14.067 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_d4n_host": "127.0.0.1", 2024-04-25T22:52:14.067 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_d4n_port": "6379", 2024-04-25T22:52:14.067 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-04-25T22:52:14.067 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_data_log_changes_size": "1000", 2024-04-25T22:52:14.067 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_data_log_num_shards": "128", 2024-04-25T22:52:14.067 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-04-25T22:52:14.067 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_data_log_window": "30", 2024-04-25T22:52:14.067 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_data_notify_interval_msec": "0", 2024-04-25T22:52:14.067 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_data_sync_poll_interval": "20", 2024-04-25T22:52:14.067 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_data_sync_spawn_window": "20", 2024-04-25T22:52:14.068 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-04-25T22:52:14.068 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-04-25T22:52:14.068 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-04-25T22:52:14.068 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_default_data_log_backing": "fifo", 2024-04-25T22:52:14.068 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-04-25T22:52:14.068 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_default_region_info_oid": "default.region", 2024-04-25T22:52:14.068 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-04-25T22:52:14.068 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-04-25T22:52:14.068 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_defer_to_bucket_acls": "", 2024-04-25T22:52:14.068 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-04-25T22:52:14.068 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-04-25T22:52:14.068 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-04-25T22:52:14.068 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-04-25T22:52:14.069 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-04-25T22:52:14.069 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-04-25T22:52:14.069 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-04-25T22:52:14.069 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-04-25T22:52:14.069 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dmclock_data_res": "500.000000", 2024-04-25T22:52:14.069 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-04-25T22:52:14.069 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-04-25T22:52:14.069 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-04-25T22:52:14.069 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-04-25T22:52:14.069 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dns_name": "", 2024-04-25T22:52:14.069 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dns_s3website_name": "", 2024-04-25T22:52:14.069 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dynamic_resharding": "true", 2024-04-25T22:52:14.069 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-04-25T22:52:14.069 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_enable_gc_threads": "true", 2024-04-25T22:52:14.070 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_enable_lc_threads": "true", 2024-04-25T22:52:14.070 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_enable_ops_log": "false", 2024-04-25T22:52:14.070 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_enable_quota_threads": "true", 2024-04-25T22:52:14.070 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_enable_static_website": "false", 2024-04-25T22:52:14.070 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_enable_usage_log": "false", 2024-04-25T22:52:14.070 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_enforce_swift_acls": "true", 2024-04-25T22:52:14.070 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_exit_timeout_secs": "120", 2024-04-25T22:52:14.070 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_expose_bucket": "false", 2024-04-25T22:52:14.070 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_extended_http_attrs": "", 2024-04-25T22:52:14.070 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_filter": "none", 2024-04-25T22:52:14.070 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-04-25T22:52:14.070 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_frontends": "beast port=7480", 2024-04-25T22:52:14.070 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_gc_max_concurrent_io": "10", 2024-04-25T22:52:14.070 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_gc_max_deferred": "50", 2024-04-25T22:52:14.071 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-04-25T22:52:14.071 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_gc_max_objs": "32", 2024-04-25T22:52:14.071 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_gc_max_queue_size": "134213632", 2024-04-25T22:52:14.071 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_gc_max_trim_chunk": "16", 2024-04-25T22:52:14.071 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_gc_obj_min_wait": "7200", 2024-04-25T22:52:14.071 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_gc_processor_max_time": "3600", 2024-04-25T22:52:14.071 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_gc_processor_period": "3600", 2024-04-25T22:52:14.071 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-04-25T22:52:14.071 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_get_obj_window_size": "16777216", 2024-04-25T22:52:14.071 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_healthcheck_disabling_path": "", 2024-04-25T22:52:14.071 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_ignore_get_invalid_range": "false", 2024-04-25T22:52:14.071 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_init_timeout": "300", 2024-04-25T22:52:14.071 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-04-25T22:52:14.071 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-04-25T22:52:14.072 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_kafka_connection_idle": "300", 2024-04-25T22:52:14.072 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_kafka_message_timeout": "5000", 2024-04-25T22:52:14.072 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_kafka_sleep_timeout": "10", 2024-04-25T22:52:14.072 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-04-25T22:52:14.072 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-04-25T22:52:14.072 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-04-25T22:52:14.072 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_admin_domain": "", 2024-04-25T22:52:14.072 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_admin_password": "", 2024-04-25T22:52:14.072 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_admin_password_path": "", 2024-04-25T22:52:14.072 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_admin_project": "", 2024-04-25T22:52:14.072 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_admin_tenant": "", 2024-04-25T22:52:14.072 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_admin_token": "", 2024-04-25T22:52:14.072 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_admin_token_path": "", 2024-04-25T22:52:14.072 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_admin_user": "", 2024-04-25T22:52:14.073 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_api_version": "2", 2024-04-25T22:52:14.073 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_barbican_domain": "", 2024-04-25T22:52:14.073 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_barbican_password": "", 2024-04-25T22:52:14.073 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_barbican_project": "", 2024-04-25T22:52:14.073 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_barbican_tenant": "", 2024-04-25T22:52:14.073 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_barbican_user": "", 2024-04-25T22:52:14.073 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-04-25T22:52:14.073 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_implicit_tenants": "false", 2024-04-25T22:52:14.073 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-04-25T22:52:14.073 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_service_token_enabled": "false", 2024-04-25T22:52:14.073 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_token_cache_size": "10000", 2024-04-25T22:52:14.073 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_url": "", 2024-04-25T22:52:14.073 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_verify_ssl": "true", 2024-04-25T22:52:14.073 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_lc_debug_interval": "-1", 2024-04-25T22:52:14.074 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_lc_lock_max_time": "90", 2024-04-25T22:52:14.074 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_lc_max_objs": "32", 2024-04-25T22:52:14.074 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_lc_max_rules": "1000", 2024-04-25T22:52:14.074 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_lc_max_worker": "3", 2024-04-25T22:52:14.074 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_lc_max_wp_worker": "3", 2024-04-25T22:52:14.074 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_lc_thread_delay": "0", 2024-04-25T22:52:14.074 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-04-25T22:52:14.074 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_ldap_dnattr": "uid", 2024-04-25T22:52:14.074 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-04-25T22:52:14.074 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_ldap_searchfilter": "", 2024-04-25T22:52:14.074 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-04-25T22:52:14.074 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_ldap_uri": "", 2024-04-25T22:52:14.074 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-04-25T22:52:14.075 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-04-25T22:52:14.075 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-04-25T22:52:14.075 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_log_http_headers": "", 2024-04-25T22:52:14.075 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_log_nonexistent_bucket": "false", 2024-04-25T22:52:14.075 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-04-25T22:52:14.075 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_log_object_name_utc": "false", 2024-04-25T22:52:14.075 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-04-25T22:52:14.075 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-04-25T22:52:14.075 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_max_attr_name_len": "0", 2024-04-25T22:52:14.075 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_max_attr_size": "0", 2024-04-25T22:52:14.075 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_max_attrs_num_in_req": "0", 2024-04-25T22:52:14.075 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_max_chunk_size": "4194304", 2024-04-25T22:52:14.076 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_max_concurrent_requests": "1024", 2024-04-25T22:52:14.076 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-04-25T22:52:14.076 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_max_dynamic_shards": "1999", 2024-04-25T22:52:14.076 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_max_listing_results": "1000", 2024-04-25T22:52:14.076 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_max_notify_retries": "10", 2024-04-25T22:52:14.076 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_max_objs_per_shard": "100000", 2024-04-25T22:52:14.076 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_max_put_param_size": "1048576", 2024-04-25T22:52:14.076 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_max_put_size": "5368709120", 2024-04-25T22:52:14.076 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_max_slo_entries": "1000", 2024-04-25T22:52:14.076 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_md_log_max_shards": "64", 2024-04-25T22:52:14.076 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_md_notify_interval_msec": "200", 2024-04-25T22:52:14.076 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_meta_sync_poll_interval": "20", 2024-04-25T22:52:14.076 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_meta_sync_spawn_window": "20", 2024-04-25T22:52:14.076 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-04-25T22:52:14.077 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_mp_lock_max_time": "600", 2024-04-25T22:52:14.077 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-04-25T22:52:14.077 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_multipart_min_part_size": "5242880", 2024-04-25T22:52:14.077 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-04-25T22:52:14.077 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-04-25T22:52:14.077 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_nfs_fhcache_size": "2017", 2024-04-25T22:52:14.077 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-04-25T22:52:14.077 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-04-25T22:52:14.077 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_nfs_lru_lanes": "5", 2024-04-25T22:52:14.077 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_nfs_max_gc": "300", 2024-04-25T22:52:14.077 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-04-25T22:52:14.077 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_nfs_run_gc_threads": "false", 2024-04-25T22:52:14.077 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_nfs_run_lc_threads": "false", 2024-04-25T22:52:14.077 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_nfs_run_quota_threads": "false", 2024-04-25T22:52:14.078 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_nfs_run_sync_thread": "false", 2024-04-25T22:52:14.078 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-04-25T22:52:14.078 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-04-25T22:52:14.078 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_num_async_rados_threads": "32", 2024-04-25T22:52:14.078 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_num_control_oids": "8", 2024-04-25T22:52:14.078 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_numa_node": "-1", 2024-04-25T22:52:14.078 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_obj_stripe_size": "4194304", 2024-04-25T22:52:14.078 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-04-25T22:52:14.078 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_objexp_chunk_size": "100", 2024-04-25T22:52:14.078 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_objexp_gc_interval": "600", 2024-04-25T22:52:14.078 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_objexp_hints_num_shards": "127", 2024-04-25T22:52:14.078 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-04-25T22:52:14.078 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-04-25T22:52:14.079 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_op_thread_timeout": "600", 2024-04-25T22:52:14.079 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_op_tracing": "false", 2024-04-25T22:52:14.079 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_opa_token": "", 2024-04-25T22:52:14.079 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_opa_url": "", 2024-04-25T22:52:14.079 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_opa_verify_ssl": "true", 2024-04-25T22:52:14.079 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-04-25T22:52:14.079 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-04-25T22:52:14.079 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_ops_log_rados": "false", 2024-04-25T22:52:14.079 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_ops_log_socket_path": "", 2024-04-25T22:52:14.079 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-04-25T22:52:14.079 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-04-25T22:52:14.079 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-04-25T22:52:14.079 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_period_push_interval": "2.000000", 2024-04-25T22:52:14.080 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_period_push_interval_max": "30.000000", 2024-04-25T22:52:14.080 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_period_root_pool": ".rgw.root", 2024-04-25T22:52:14.080 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-04-25T22:52:14.080 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-04-25T22:52:14.080 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_posix_cache_lanes": "3", 2024-04-25T22:52:14.080 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-04-25T22:52:14.080 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_posix_cache_max_buckets": "100", 2024-04-25T22:52:14.080 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_posix_cache_partitions": "3", 2024-04-25T22:52:14.080 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-04-25T22:52:14.080 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_print_continue": "true", 2024-04-25T22:52:14.080 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_print_prohibited_content_length": "false", 2024-04-25T22:52:14.080 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-04-25T22:52:14.080 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-04-25T22:52:14.080 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-04-25T22:52:14.081 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-04-25T22:52:14.081 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_rados_tracing": "false", 2024-04-25T22:52:14.081 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_realm": "", 2024-04-25T22:52:14.081 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_realm_id": "", 2024-04-25T22:52:14.081 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-04-25T22:52:14.081 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_region": "", 2024-04-25T22:52:14.081 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_region_root_pool": ".rgw.root", 2024-04-25T22:52:14.081 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_relaxed_region_enforcement": "false", 2024-04-25T22:52:14.081 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-04-25T22:52:14.081 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-04-25T22:52:14.081 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_request_uri": "", 2024-04-25T22:52:14.081 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_reshard_batch_size": "64", 2024-04-25T22:52:14.081 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-04-25T22:52:14.081 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_reshard_max_aio": "128", 2024-04-25T22:52:14.082 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_reshard_num_logs": "16", 2024-04-25T22:52:14.082 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_reshard_thread_interval": "600", 2024-04-25T22:52:14.082 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_resolve_cname": "false", 2024-04-25T22:52:14.082 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_rest_getusage_op_compat": "false", 2024-04-25T22:52:14.082 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_run_sync_thread": "true", 2024-04-25T22:52:14.082 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-04-25T22:52:14.082 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-04-25T22:52:14.082 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_s3_auth_use_keystone": "false", 2024-04-25T22:52:14.082 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_s3_auth_use_ldap": "false", 2024-04-25T22:52:14.082 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_s3_auth_use_rados": "true", 2024-04-25T22:52:14.082 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_s3_auth_use_sts": "false", 2024-04-25T22:52:14.082 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-04-25T22:52:14.082 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_s3_success_create_obj_status": "0", 2024-04-25T22:52:14.083 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-04-25T22:52:14.083 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_scheduler_type": "throttler", 2024-04-25T22:52:14.083 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_script_uri": "", 2024-04-25T22:52:14.083 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_service_provider_name": "", 2024-04-25T22:52:14.083 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-04-25T22:52:14.083 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sts_client_id": "", 2024-04-25T22:52:14.083 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sts_client_secret": "", 2024-04-25T22:52:14.083 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sts_entry": "sts", 2024-04-25T22:52:14.083 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sts_key": "sts", 2024-04-25T22:52:14.083 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sts_max_session_duration": "43200", 2024-04-25T22:52:14.083 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sts_min_session_duration": "900", 2024-04-25T22:52:14.083 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sts_token_introspection_url": "", 2024-04-25T22:52:14.083 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_swift_account_in_url": "false", 2024-04-25T22:52:14.083 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_swift_auth_entry": "auth", 2024-04-25T22:52:14.084 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_swift_auth_url": "", 2024-04-25T22:52:14.084 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_swift_custom_header": "", 2024-04-25T22:52:14.084 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_swift_enforce_content_length": "false", 2024-04-25T22:52:14.084 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_swift_need_stats": "true", 2024-04-25T22:52:14.084 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_swift_tenant_name": "", 2024-04-25T22:52:14.084 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_swift_token_expiration": "86400", 2024-04-25T22:52:14.084 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_swift_url": "", 2024-04-25T22:52:14.084 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_swift_url_prefix": "swift", 2024-04-25T22:52:14.084 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_swift_versioning_enabled": "false", 2024-04-25T22:52:14.084 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-04-25T22:52:14.084 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-04-25T22:52:14.084 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sync_lease_period": "120", 2024-04-25T22:52:14.084 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-04-25T22:52:14.084 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sync_log_trim_interval": "1200", 2024-04-25T22:52:14.085 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-04-25T22:52:14.085 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-04-25T22:52:14.085 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-04-25T22:52:14.085 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sync_obj_etag_verify": "false", 2024-04-25T22:52:14.085 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sync_trace_history_size": "4096", 2024-04-25T22:52:14.085 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-04-25T22:52:14.085 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-04-25T22:52:14.085 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_thread_pool_size": "512", 2024-04-25T22:52:14.085 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_topic_persistency_max_retries": "0", 2024-04-25T22:52:14.085 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-04-25T22:52:14.085 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-04-25T22:52:14.085 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_topic_require_publish_policy": "false", 2024-04-25T22:52:14.085 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_torrent_comment": "", 2024-04-25T22:52:14.086 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_torrent_createby": "", 2024-04-25T22:52:14.086 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_torrent_encoding": "", 2024-04-25T22:52:14.086 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_torrent_flag": "false", 2024-04-25T22:52:14.086 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_torrent_max_size": "5368709120", 2024-04-25T22:52:14.086 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_torrent_origin": "", 2024-04-25T22:52:14.086 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_torrent_sha_unit": "524288", 2024-04-25T22:52:14.086 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_torrent_tracker": "", 2024-04-25T22:52:14.086 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_trust_forwarded_https": "false", 2024-04-25T22:52:14.086 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-04-25T22:52:14.086 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_usage_log_tick_interval": "30", 2024-04-25T22:52:14.086 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_usage_max_shards": "32", 2024-04-25T22:52:14.086 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_usage_max_user_shards": "1", 2024-04-25T22:52:14.086 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_use_opa_authz": "false", 2024-04-25T22:52:14.086 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_user_counters_cache": "false", 2024-04-25T22:52:14.087 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_user_counters_cache_size": "10000", 2024-04-25T22:52:14.087 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-04-25T22:52:14.087 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_user_default_quota_max_size": "-1", 2024-04-25T22:52:14.087 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_user_max_buckets": "1000", 2024-04-25T22:52:14.087 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_user_policies_max_num": "100", 2024-04-25T22:52:14.087 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-04-25T22:52:14.087 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-04-25T22:52:14.087 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_user_quota_sync_interval": "86400", 2024-04-25T22:52:14.087 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-04-25T22:52:14.087 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_user_unique_email": "true", 2024-04-25T22:52:14.087 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_verify_ssl": "true", 2024-04-25T22:52:14.087 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_website_routing_rules_max_num": "50", 2024-04-25T22:52:14.087 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_zone": "", 2024-04-25T22:52:14.088 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_zone_id": "", 2024-04-25T22:52:14.088 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-04-25T22:52:14.088 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_zonegroup": "", 2024-04-25T22:52:14.088 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_zonegroup_id": "", 2024-04-25T22:52:14.088 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-04-25T22:52:14.088 INFO:teuthology.orchestra.run.smithi052.stdout: "rgwlc_auto_session_clear": "true", 2024-04-25T22:52:14.088 INFO:teuthology.orchestra.run.smithi052.stdout: "rgwlc_skip_bucket_step": "false", 2024-04-25T22:52:14.088 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_block_size": "4096", 2024-04-25T22:52:14.088 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-04-25T22:52:14.088 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-04-25T22:52:14.088 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-04-25T22:52:14.088 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-04-25T22:52:14.088 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_cache_shard_bits": "4", 2024-04-25T22:52:14.088 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_cache_size": "536870912", 2024-04-25T22:52:14.089 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_cache_type": "binned_lru", 2024-04-25T22:52:14.089 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-04-25T22:52:14.089 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-04-25T22:52:14.089 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-04-25T22:52:14.089 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_collect_compaction_stats": "false", 2024-04-25T22:52:14.089 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_collect_extended_stats": "false", 2024-04-25T22:52:14.089 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_collect_memory_stats": "false", 2024-04-25T22:52:14.089 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-04-25T22:52:14.089 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_index_type": "binary_search", 2024-04-25T22:52:14.089 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_log_to_ceph_log": "true", 2024-04-25T22:52:14.089 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_metadata_block_size": "4096", 2024-04-25T22:52:14.089 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_partition_filters": "false", 2024-04-25T22:52:14.089 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_perf": "false", 2024-04-25T22:52:14.089 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-04-25T22:52:14.090 INFO:teuthology.orchestra.run.smithi052.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-04-25T22:52:14.090 INFO:teuthology.orchestra.run.smithi052.stdout: "rotating_keys_renewal_timeout": "10", 2024-04-25T22:52:14.090 INFO:teuthology.orchestra.run.smithi052.stdout: "run_dir": "/var/run/ceph", 2024-04-25T22:52:14.090 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_block_create": "true", 2024-04-25T22:52:14.090 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_cache_lru_size": "67108864", 2024-04-25T22:52:14.090 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_cbjournal_size": "5368709120", 2024-04-25T22:52:14.090 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_data_delta_based_overwrite": "0", 2024-04-25T22:52:14.090 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_default_max_object_size": "16777216", 2024-04-25T22:52:14.090 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-04-25T22:52:14.090 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_device_size": "53687091200", 2024-04-25T22:52:14.090 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_journal_batch_capacity": "16", 2024-04-25T22:52:14.090 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-04-25T22:52:14.090 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-04-25T22:52:14.091 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_journal_iodepth_limit": "5", 2024-04-25T22:52:14.091 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_main_device_type": "SSD", 2024-04-25T22:52:14.091 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_max_concurrent_transactions": "8", 2024-04-25T22:52:14.091 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-04-25T22:52:14.091 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-04-25T22:52:14.091 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-04-25T22:52:14.091 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-04-25T22:52:14.091 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_segment_size": "67108864", 2024-04-25T22:52:14.091 INFO:teuthology.orchestra.run.smithi052.stdout: "set_keepcaps": "false", 2024-04-25T22:52:14.091 INFO:teuthology.orchestra.run.smithi052.stdout: "setgroup": "", 2024-04-25T22:52:14.091 INFO:teuthology.orchestra.run.smithi052.stdout: "setuser": "", 2024-04-25T22:52:14.091 INFO:teuthology.orchestra.run.smithi052.stdout: "setuser_match_path": "", 2024-04-25T22:52:14.091 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_misplaced_ratio": "0.050000", 2024-04-25T22:52:14.091 INFO:teuthology.orchestra.run.smithi052.stdout: "thp": "false", 2024-04-25T22:52:14.091 INFO:teuthology.orchestra.run.smithi052.stdout: "threadpool_default_timeout": "60", 2024-04-25T22:52:14.092 INFO:teuthology.orchestra.run.smithi052.stdout: "threadpool_empty_queue_max_wait": "2", 2024-04-25T22:52:14.092 INFO:teuthology.orchestra.run.smithi052.stdout: "throttler_perf_counter": "true" 2024-04-25T22:52:14.092 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-04-25T22:52:14.094 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-04-25T22:52:14.210 INFO:teuthology.orchestra.run.smithi052.stdout:mon.a: {} 2024-04-25T22:52:14.210 INFO:teuthology.orchestra.run.smithi052.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-25T22:52:14.219 INFO:teuthology.orchestra.run.smithi052.stdout:mon.b: {} 2024-04-25T22:52:14.219 INFO:teuthology.orchestra.run.smithi052.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-25T22:52:14.228 INFO:teuthology.orchestra.run.smithi052.stdout:mon.c: {} 2024-04-25T22:52:14.228 INFO:teuthology.orchestra.run.smithi052.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-25T22:52:14.239 INFO:tasks.thrashosds.thrasher:Unable to test ceph-objectstore-tool, powercycle testing 2024-04-25T22:52:14.239 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-25T22:52:14.268 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-25T22:52:14.269 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-04-25T22:52:14.269 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-25T22:52:14.269 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T22:52:14.269 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T22:52:14.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:52:14.269 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2024-04-25T22:52:14.270 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-04-25T22:52:14.270 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-25T22:52:14.270 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-25T22:52:14.270 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-04-25T22:52:14.270 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-25T22:52:14.271 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-04-25T22:52:14.271 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-04-25T22:52:14.271 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:52:14.271 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-04-25T22:52:14.272 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:52:14.272 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-04-25T22:52:14.272 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-25T22:52:14.274 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:14.271+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:14.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:52:14.289 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link delete ceph-brx 2024-04-25T22:52:14.355 INFO:teuthology.orchestra.run.smithi052.stderr:Cannot find device "ceph-brx" 2024-04-25T22:52:14.356 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T22:52:14.357 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-25T22:52:14.357 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T22:52:14.373 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:14.372+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:14.389 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:14.390 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:52:14.390 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-04-25T22:52:14.390 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:14.399 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:52:14.403 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-25T22:52:14.403 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:52:14.440 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-25T22:52:14.440 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:52:14.459 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-25T22:52:14.459 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:52:14.482 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:14.482+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:14.542 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:14.542 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:14.551 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:52:14.575 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:14.575+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:14.581 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:52:14.581 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-04-25T22:52:14.581 INFO:teuthology.orchestra.run.smithi052.stdout: "epoch": 15, 2024-04-25T22:52:14.582 INFO:teuthology.orchestra.run.smithi052.stdout: "fsid": "5355b70e-3f7d-4bce-8676-89cee61d2089", 2024-04-25T22:52:14.582 INFO:teuthology.orchestra.run.smithi052.stdout: "created": "2024-04-25T22:51:37.688525+0000", 2024-04-25T22:52:14.582 INFO:teuthology.orchestra.run.smithi052.stdout: "modified": "2024-04-25T22:51:54.011012+0000", 2024-04-25T22:52:14.582 INFO:teuthology.orchestra.run.smithi052.stdout: "last_up_change": "2024-04-25T22:51:45.753740+0000", 2024-04-25T22:52:14.582 INFO:teuthology.orchestra.run.smithi052.stdout: "last_in_change": "2024-04-25T22:51:38.491924+0000", 2024-04-25T22:52:14.582 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-25T22:52:14.582 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_num": 5799936, 2024-04-25T22:52:14.582 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_set": [ 2024-04-25T22:52:14.582 INFO:teuthology.orchestra.run.smithi052.stdout: "pglog_hardlimit", 2024-04-25T22:52:14.583 INFO:teuthology.orchestra.run.smithi052.stdout: "purged_snapdirs", 2024-04-25T22:52:14.583 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_deletes", 2024-04-25T22:52:14.583 INFO:teuthology.orchestra.run.smithi052.stdout: "sortbitwise" 2024-04-25T22:52:14.583 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-04-25T22:52:14.583 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_version": 4, 2024-04-25T22:52:14.583 INFO:teuthology.orchestra.run.smithi052.stdout: "full_ratio": 0.94999998807907104, 2024-04-25T22:52:14.583 INFO:teuthology.orchestra.run.smithi052.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-25T22:52:14.583 INFO:teuthology.orchestra.run.smithi052.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-25T22:52:14.583 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_snapshot": "", 2024-04-25T22:52:14.584 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_max": 4, 2024-04-25T22:52:14.584 INFO:teuthology.orchestra.run.smithi052.stdout: "max_osd": 3, 2024-04-25T22:52:14.584 INFO:teuthology.orchestra.run.smithi052.stdout: "require_min_compat_client": "luminous", 2024-04-25T22:52:14.584 INFO:teuthology.orchestra.run.smithi052.stdout: "min_compat_client": "jewel", 2024-04-25T22:52:14.584 INFO:teuthology.orchestra.run.smithi052.stdout: "require_osd_release": "squid", 2024-04-25T22:52:14.584 INFO:teuthology.orchestra.run.smithi052.stdout: "allow_crimson": false, 2024-04-25T22:52:14.584 INFO:teuthology.orchestra.run.smithi052.stdout: "pools": [ 2024-04-25T22:52:14.584 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-25T22:52:14.584 INFO:teuthology.orchestra.run.smithi052.stdout: "pool": 1, 2024-04-25T22:52:14.584 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_name": ".mgr", 2024-04-25T22:52:14.584 INFO:teuthology.orchestra.run.smithi052.stdout: "create_time": "2024-04-25T22:51:45.966439+0000", 2024-04-25T22:52:14.584 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-04-25T22:52:14.584 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_names": "hashpspool", 2024-04-25T22:52:14.584 INFO:teuthology.orchestra.run.smithi052.stdout: "type": 1, 2024-04-25T22:52:14.585 INFO:teuthology.orchestra.run.smithi052.stdout: "size": 2, 2024-04-25T22:52:14.585 INFO:teuthology.orchestra.run.smithi052.stdout: "min_size": 1, 2024-04-25T22:52:14.585 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_rule": 0, 2024-04-25T22:52:14.585 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_count": 0, 2024-04-25T22:52:14.585 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_target": 0, 2024-04-25T22:52:14.585 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_barrier": 0, 2024-04-25T22:52:14.585 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-25T22:52:14.585 INFO:teuthology.orchestra.run.smithi052.stdout: "object_hash": 2, 2024-04-25T22:52:14.585 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_mode": "off", 2024-04-25T22:52:14.585 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num": 1, 2024-04-25T22:52:14.585 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num": 1, 2024-04-25T22:52:14.585 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num_target": 1, 2024-04-25T22:52:14.585 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_target": 1, 2024-04-25T22:52:14.585 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_pending": 1, 2024-04-25T22:52:14.586 INFO:teuthology.orchestra.run.smithi052.stdout: "last_pg_merge_meta": { 2024-04-25T22:52:14.586 INFO:teuthology.orchestra.run.smithi052.stdout: "source_pgid": "0.0", 2024-04-25T22:52:14.586 INFO:teuthology.orchestra.run.smithi052.stdout: "ready_epoch": 0, 2024-04-25T22:52:14.586 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_started": 0, 2024-04-25T22:52:14.586 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_clean": 0, 2024-04-25T22:52:14.586 INFO:teuthology.orchestra.run.smithi052.stdout: "source_version": "0'0", 2024-04-25T22:52:14.586 INFO:teuthology.orchestra.run.smithi052.stdout: "target_version": "0'0" 2024-04-25T22:52:14.586 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T22:52:14.586 INFO:teuthology.orchestra.run.smithi052.stdout: "last_change": "11", 2024-04-25T22:52:14.586 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend": "0", 2024-04-25T22:52:14.586 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-25T22:52:14.587 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_preluminous": "0", 2024-04-25T22:52:14.587 INFO:teuthology.orchestra.run.smithi052.stdout: "auid": 0, 2024-04-25T22:52:14.587 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_mode": "selfmanaged", 2024-04-25T22:52:14.587 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_seq": 0, 2024-04-25T22:52:14.587 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_epoch": 0, 2024-04-25T22:52:14.587 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_snaps": [], 2024-04-25T22:52:14.587 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps": "[]", 2024-04-25T22:52:14.587 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_bytes": 0, 2024-04-25T22:52:14.587 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_objects": 0, 2024-04-25T22:52:14.587 INFO:teuthology.orchestra.run.smithi052.stdout: "tiers": [], 2024-04-25T22:52:14.587 INFO:teuthology.orchestra.run.smithi052.stdout: "tier_of": -1, 2024-04-25T22:52:14.588 INFO:teuthology.orchestra.run.smithi052.stdout: "read_tier": -1, 2024-04-25T22:52:14.588 INFO:teuthology.orchestra.run.smithi052.stdout: "write_tier": -1, 2024-04-25T22:52:14.588 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_mode": "none", 2024-04-25T22:52:14.588 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_bytes": 0, 2024-04-25T22:52:14.588 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_objects": 0, 2024-04-25T22:52:14.588 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-25T22:52:14.588 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-25T22:52:14.588 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-25T22:52:14.588 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_flush_age": 0, 2024-04-25T22:52:14.588 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_evict_age": 0, 2024-04-25T22:52:14.588 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profile": "", 2024-04-25T22:52:14.588 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_params": { 2024-04-25T22:52:14.588 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "none" 2024-04-25T22:52:14.588 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T22:52:14.589 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_period": 0, 2024-04-25T22:52:14.589 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_count": 0, 2024-04-25T22:52:14.589 INFO:teuthology.orchestra.run.smithi052.stdout: "use_gmt_hitset": true, 2024-04-25T22:52:14.589 INFO:teuthology.orchestra.run.smithi052.stdout: "min_read_recency_for_promote": 0, 2024-04-25T22:52:14.589 INFO:teuthology.orchestra.run.smithi052.stdout: "min_write_recency_for_promote": 0, 2024-04-25T22:52:14.589 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_grade_decay_rate": 0, 2024-04-25T22:52:14.589 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_search_last_n": 0, 2024-04-25T22:52:14.589 INFO:teuthology.orchestra.run.smithi052.stdout: "grade_table": [], 2024-04-25T22:52:14.589 INFO:teuthology.orchestra.run.smithi052.stdout: "stripe_width": 0, 2024-04-25T22:52:14.589 INFO:teuthology.orchestra.run.smithi052.stdout: "expected_num_objects": 0, 2024-04-25T22:52:14.589 INFO:teuthology.orchestra.run.smithi052.stdout: "fast_read": false, 2024-04-25T22:52:14.589 INFO:teuthology.orchestra.run.smithi052.stdout: "options": { 2024-04-25T22:52:14.589 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_max": 32, 2024-04-25T22:52:14.589 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_min": 1 2024-04-25T22:52:14.590 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T22:52:14.590 INFO:teuthology.orchestra.run.smithi052.stdout: "application_metadata": { 2024-04-25T22:52:14.590 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": {} 2024-04-25T22:52:14.590 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T22:52:14.590 INFO:teuthology.orchestra.run.smithi052.stdout: "read_balance": { 2024-04-25T22:52:14.590 INFO:teuthology.orchestra.run.smithi052.stdout: "score_type": "Fair distribution", 2024-04-25T22:52:14.590 INFO:teuthology.orchestra.run.smithi052.stdout: "score_acting": 2.9900000095367432, 2024-04-25T22:52:14.590 INFO:teuthology.orchestra.run.smithi052.stdout: "score_stable": 2.9900000095367432, 2024-04-25T22:52:14.590 INFO:teuthology.orchestra.run.smithi052.stdout: "optimal_score": 0.67000001668930054, 2024-04-25T22:52:14.590 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_acting": 2, 2024-04-25T22:52:14.590 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_stable": 2, 2024-04-25T22:52:14.590 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity_weighted": 1, 2024-04-25T22:52:14.590 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity": 1, 2024-04-25T22:52:14.590 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity_weighted": 1 2024-04-25T22:52:14.591 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-25T22:52:14.591 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T22:52:14.591 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-25T22:52:14.591 INFO:teuthology.orchestra.run.smithi052.stdout: "pool": 2, 2024-04-25T22:52:14.591 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_name": "rbd", 2024-04-25T22:52:14.591 INFO:teuthology.orchestra.run.smithi052.stdout: "create_time": "2024-04-25T22:51:46.128416+0000", 2024-04-25T22:52:14.591 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-04-25T22:52:14.591 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_names": "hashpspool", 2024-04-25T22:52:14.591 INFO:teuthology.orchestra.run.smithi052.stdout: "type": 1, 2024-04-25T22:52:14.591 INFO:teuthology.orchestra.run.smithi052.stdout: "size": 2, 2024-04-25T22:52:14.591 INFO:teuthology.orchestra.run.smithi052.stdout: "min_size": 1, 2024-04-25T22:52:14.591 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_rule": 0, 2024-04-25T22:52:14.591 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_count": 0, 2024-04-25T22:52:14.592 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_target": 0, 2024-04-25T22:52:14.592 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_barrier": 0, 2024-04-25T22:52:14.592 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-25T22:52:14.592 INFO:teuthology.orchestra.run.smithi052.stdout: "object_hash": 2, 2024-04-25T22:52:14.592 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_mode": "off", 2024-04-25T22:52:14.592 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num": 8, 2024-04-25T22:52:14.592 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num": 8, 2024-04-25T22:52:14.592 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num_target": 8, 2024-04-25T22:52:14.592 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_target": 8, 2024-04-25T22:52:14.592 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_pending": 8, 2024-04-25T22:52:14.592 INFO:teuthology.orchestra.run.smithi052.stdout: "last_pg_merge_meta": { 2024-04-25T22:52:14.592 INFO:teuthology.orchestra.run.smithi052.stdout: "source_pgid": "0.0", 2024-04-25T22:52:14.592 INFO:teuthology.orchestra.run.smithi052.stdout: "ready_epoch": 0, 2024-04-25T22:52:14.592 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_started": 0, 2024-04-25T22:52:14.593 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_clean": 0, 2024-04-25T22:52:14.593 INFO:teuthology.orchestra.run.smithi052.stdout: "source_version": "0'0", 2024-04-25T22:52:14.593 INFO:teuthology.orchestra.run.smithi052.stdout: "target_version": "0'0" 2024-04-25T22:52:14.593 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T22:52:14.593 INFO:teuthology.orchestra.run.smithi052.stdout: "last_change": "11", 2024-04-25T22:52:14.593 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend": "0", 2024-04-25T22:52:14.593 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-25T22:52:14.593 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_preluminous": "0", 2024-04-25T22:52:14.593 INFO:teuthology.orchestra.run.smithi052.stdout: "auid": 0, 2024-04-25T22:52:14.593 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_mode": "selfmanaged", 2024-04-25T22:52:14.593 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_seq": 0, 2024-04-25T22:52:14.593 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_epoch": 0, 2024-04-25T22:52:14.593 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_snaps": [], 2024-04-25T22:52:14.593 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps": "[]", 2024-04-25T22:52:14.594 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_bytes": 0, 2024-04-25T22:52:14.594 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_objects": 0, 2024-04-25T22:52:14.594 INFO:teuthology.orchestra.run.smithi052.stdout: "tiers": [], 2024-04-25T22:52:14.594 INFO:teuthology.orchestra.run.smithi052.stdout: "tier_of": -1, 2024-04-25T22:52:14.594 INFO:teuthology.orchestra.run.smithi052.stdout: "read_tier": -1, 2024-04-25T22:52:14.594 INFO:teuthology.orchestra.run.smithi052.stdout: "write_tier": -1, 2024-04-25T22:52:14.594 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_mode": "none", 2024-04-25T22:52:14.594 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_bytes": 0, 2024-04-25T22:52:14.594 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_objects": 0, 2024-04-25T22:52:14.594 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-25T22:52:14.594 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-25T22:52:14.594 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-25T22:52:14.594 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_flush_age": 0, 2024-04-25T22:52:14.594 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_evict_age": 0, 2024-04-25T22:52:14.595 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profile": "", 2024-04-25T22:52:14.595 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_params": { 2024-04-25T22:52:14.595 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "none" 2024-04-25T22:52:14.595 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T22:52:14.595 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_period": 0, 2024-04-25T22:52:14.595 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_count": 0, 2024-04-25T22:52:14.595 INFO:teuthology.orchestra.run.smithi052.stdout: "use_gmt_hitset": true, 2024-04-25T22:52:14.595 INFO:teuthology.orchestra.run.smithi052.stdout: "min_read_recency_for_promote": 0, 2024-04-25T22:52:14.595 INFO:teuthology.orchestra.run.smithi052.stdout: "min_write_recency_for_promote": 0, 2024-04-25T22:52:14.595 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_grade_decay_rate": 0, 2024-04-25T22:52:14.595 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_search_last_n": 0, 2024-04-25T22:52:14.595 INFO:teuthology.orchestra.run.smithi052.stdout: "grade_table": [], 2024-04-25T22:52:14.595 INFO:teuthology.orchestra.run.smithi052.stdout: "stripe_width": 0, 2024-04-25T22:52:14.595 INFO:teuthology.orchestra.run.smithi052.stdout: "expected_num_objects": 0, 2024-04-25T22:52:14.596 INFO:teuthology.orchestra.run.smithi052.stdout: "fast_read": false, 2024-04-25T22:52:14.596 INFO:teuthology.orchestra.run.smithi052.stdout: "options": {}, 2024-04-25T22:52:14.596 INFO:teuthology.orchestra.run.smithi052.stdout: "application_metadata": { 2024-04-25T22:52:14.596 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd": {} 2024-04-25T22:52:14.596 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T22:52:14.596 INFO:teuthology.orchestra.run.smithi052.stdout: "read_balance": { 2024-04-25T22:52:14.596 INFO:teuthology.orchestra.run.smithi052.stdout: "score_type": "Fair distribution", 2024-04-25T22:52:14.596 INFO:teuthology.orchestra.run.smithi052.stdout: "score_acting": 1.5, 2024-04-25T22:52:14.596 INFO:teuthology.orchestra.run.smithi052.stdout: "score_stable": 1.5, 2024-04-25T22:52:14.596 INFO:teuthology.orchestra.run.smithi052.stdout: "optimal_score": 1, 2024-04-25T22:52:14.596 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_acting": 1.5, 2024-04-25T22:52:14.596 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_stable": 1.5, 2024-04-25T22:52:14.596 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity_weighted": 1, 2024-04-25T22:52:14.596 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity": 1, 2024-04-25T22:52:14.597 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity_weighted": 1 2024-04-25T22:52:14.597 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-25T22:52:14.597 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T22:52:14.597 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-25T22:52:14.597 INFO:teuthology.orchestra.run.smithi052.stdout: "pool": 3, 2024-04-25T22:52:14.597 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_name": "cephfs_metadata", 2024-04-25T22:52:14.597 INFO:teuthology.orchestra.run.smithi052.stdout: "create_time": "2024-04-25T22:51:50.648525+0000", 2024-04-25T22:52:14.597 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-04-25T22:52:14.597 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_names": "hashpspool", 2024-04-25T22:52:14.597 INFO:teuthology.orchestra.run.smithi052.stdout: "type": 1, 2024-04-25T22:52:14.597 INFO:teuthology.orchestra.run.smithi052.stdout: "size": 2, 2024-04-25T22:52:14.597 INFO:teuthology.orchestra.run.smithi052.stdout: "min_size": 1, 2024-04-25T22:52:14.597 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_rule": 0, 2024-04-25T22:52:14.597 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_count": 0, 2024-04-25T22:52:14.598 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_target": 0, 2024-04-25T22:52:14.598 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_barrier": 0, 2024-04-25T22:52:14.598 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-25T22:52:14.598 INFO:teuthology.orchestra.run.smithi052.stdout: "object_hash": 2, 2024-04-25T22:52:14.598 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_mode": "off", 2024-04-25T22:52:14.598 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num": 32, 2024-04-25T22:52:14.598 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num": 32, 2024-04-25T22:52:14.598 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num_target": 32, 2024-04-25T22:52:14.598 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_target": 32, 2024-04-25T22:52:14.598 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_pending": 32, 2024-04-25T22:52:14.598 INFO:teuthology.orchestra.run.smithi052.stdout: "last_pg_merge_meta": { 2024-04-25T22:52:14.598 INFO:teuthology.orchestra.run.smithi052.stdout: "source_pgid": "0.0", 2024-04-25T22:52:14.598 INFO:teuthology.orchestra.run.smithi052.stdout: "ready_epoch": 0, 2024-04-25T22:52:14.598 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_started": 0, 2024-04-25T22:52:14.599 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_clean": 0, 2024-04-25T22:52:14.599 INFO:teuthology.orchestra.run.smithi052.stdout: "source_version": "0'0", 2024-04-25T22:52:14.599 INFO:teuthology.orchestra.run.smithi052.stdout: "target_version": "0'0" 2024-04-25T22:52:14.599 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T22:52:14.599 INFO:teuthology.orchestra.run.smithi052.stdout: "last_change": "14", 2024-04-25T22:52:14.599 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend": "0", 2024-04-25T22:52:14.599 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-25T22:52:14.599 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_preluminous": "0", 2024-04-25T22:52:14.599 INFO:teuthology.orchestra.run.smithi052.stdout: "auid": 0, 2024-04-25T22:52:14.599 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_mode": "selfmanaged", 2024-04-25T22:52:14.599 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_seq": 0, 2024-04-25T22:52:14.599 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_epoch": 0, 2024-04-25T22:52:14.599 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_snaps": [], 2024-04-25T22:52:14.600 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps": "[]", 2024-04-25T22:52:14.600 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_bytes": 0, 2024-04-25T22:52:14.600 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_objects": 0, 2024-04-25T22:52:14.600 INFO:teuthology.orchestra.run.smithi052.stdout: "tiers": [], 2024-04-25T22:52:14.600 INFO:teuthology.orchestra.run.smithi052.stdout: "tier_of": -1, 2024-04-25T22:52:14.600 INFO:teuthology.orchestra.run.smithi052.stdout: "read_tier": -1, 2024-04-25T22:52:14.600 INFO:teuthology.orchestra.run.smithi052.stdout: "write_tier": -1, 2024-04-25T22:52:14.600 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_mode": "none", 2024-04-25T22:52:14.600 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_bytes": 0, 2024-04-25T22:52:14.600 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_objects": 0, 2024-04-25T22:52:14.600 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-25T22:52:14.600 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-25T22:52:14.600 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-25T22:52:14.601 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_flush_age": 0, 2024-04-25T22:52:14.601 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_evict_age": 0, 2024-04-25T22:52:14.601 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profile": "", 2024-04-25T22:52:14.601 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_params": { 2024-04-25T22:52:14.601 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "none" 2024-04-25T22:52:14.601 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T22:52:14.601 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_period": 0, 2024-04-25T22:52:14.601 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_count": 0, 2024-04-25T22:52:14.601 INFO:teuthology.orchestra.run.smithi052.stdout: "use_gmt_hitset": true, 2024-04-25T22:52:14.601 INFO:teuthology.orchestra.run.smithi052.stdout: "min_read_recency_for_promote": 0, 2024-04-25T22:52:14.601 INFO:teuthology.orchestra.run.smithi052.stdout: "min_write_recency_for_promote": 0, 2024-04-25T22:52:14.601 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_grade_decay_rate": 0, 2024-04-25T22:52:14.601 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_search_last_n": 0, 2024-04-25T22:52:14.601 INFO:teuthology.orchestra.run.smithi052.stdout: "grade_table": [], 2024-04-25T22:52:14.602 INFO:teuthology.orchestra.run.smithi052.stdout: "stripe_width": 0, 2024-04-25T22:52:14.602 INFO:teuthology.orchestra.run.smithi052.stdout: "expected_num_objects": 0, 2024-04-25T22:52:14.602 INFO:teuthology.orchestra.run.smithi052.stdout: "fast_read": false, 2024-04-25T22:52:14.602 INFO:teuthology.orchestra.run.smithi052.stdout: "options": { 2024-04-25T22:52:14.602 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_bias": 4, 2024-04-25T22:52:14.602 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_min": 16, 2024-04-25T22:52:14.602 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_priority": 5 2024-04-25T22:52:14.602 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T22:52:14.602 INFO:teuthology.orchestra.run.smithi052.stdout: "application_metadata": { 2024-04-25T22:52:14.602 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs": { 2024-04-25T22:52:14.602 INFO:teuthology.orchestra.run.smithi052.stdout: "metadata": "cephfs" 2024-04-25T22:52:14.602 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-25T22:52:14.602 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T22:52:14.603 INFO:teuthology.orchestra.run.smithi052.stdout: "read_balance": { 2024-04-25T22:52:14.603 INFO:teuthology.orchestra.run.smithi052.stdout: "score_type": "Fair distribution", 2024-04-25T22:52:14.603 INFO:teuthology.orchestra.run.smithi052.stdout: "score_acting": 1.1299999952316284, 2024-04-25T22:52:14.603 INFO:teuthology.orchestra.run.smithi052.stdout: "score_stable": 1.1299999952316284, 2024-04-25T22:52:14.603 INFO:teuthology.orchestra.run.smithi052.stdout: "optimal_score": 1, 2024-04-25T22:52:14.603 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-25T22:52:14.603 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-25T22:52:14.603 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity_weighted": 1, 2024-04-25T22:52:14.603 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity": 1, 2024-04-25T22:52:14.603 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity_weighted": 1 2024-04-25T22:52:14.603 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-25T22:52:14.603 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T22:52:14.603 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-25T22:52:14.603 INFO:teuthology.orchestra.run.smithi052.stdout: "pool": 4, 2024-04-25T22:52:14.603 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_name": "cephfs_data", 2024-04-25T22:52:14.604 INFO:teuthology.orchestra.run.smithi052.stdout: "create_time": "2024-04-25T22:51:51.351497+0000", 2024-04-25T22:52:14.604 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-04-25T22:52:14.604 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_names": "hashpspool", 2024-04-25T22:52:14.604 INFO:teuthology.orchestra.run.smithi052.stdout: "type": 1, 2024-04-25T22:52:14.604 INFO:teuthology.orchestra.run.smithi052.stdout: "size": 2, 2024-04-25T22:52:14.604 INFO:teuthology.orchestra.run.smithi052.stdout: "min_size": 1, 2024-04-25T22:52:14.604 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_rule": 0, 2024-04-25T22:52:14.604 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_count": 0, 2024-04-25T22:52:14.604 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_target": 0, 2024-04-25T22:52:14.604 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_barrier": 0, 2024-04-25T22:52:14.604 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-25T22:52:14.604 INFO:teuthology.orchestra.run.smithi052.stdout: "object_hash": 2, 2024-04-25T22:52:14.604 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_mode": "off", 2024-04-25T22:52:14.604 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num": 64, 2024-04-25T22:52:14.605 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num": 64, 2024-04-25T22:52:14.605 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num_target": 64, 2024-04-25T22:52:14.605 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_target": 64, 2024-04-25T22:52:14.605 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_pending": 64, 2024-04-25T22:52:14.605 INFO:teuthology.orchestra.run.smithi052.stdout: "last_pg_merge_meta": { 2024-04-25T22:52:14.605 INFO:teuthology.orchestra.run.smithi052.stdout: "source_pgid": "0.0", 2024-04-25T22:52:14.605 INFO:teuthology.orchestra.run.smithi052.stdout: "ready_epoch": 0, 2024-04-25T22:52:14.605 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_started": 0, 2024-04-25T22:52:14.605 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_clean": 0, 2024-04-25T22:52:14.605 INFO:teuthology.orchestra.run.smithi052.stdout: "source_version": "0'0", 2024-04-25T22:52:14.605 INFO:teuthology.orchestra.run.smithi052.stdout: "target_version": "0'0" 2024-04-25T22:52:14.605 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T22:52:14.605 INFO:teuthology.orchestra.run.smithi052.stdout: "last_change": "15", 2024-04-25T22:52:14.606 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend": "0", 2024-04-25T22:52:14.606 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-25T22:52:14.606 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_preluminous": "0", 2024-04-25T22:52:14.606 INFO:teuthology.orchestra.run.smithi052.stdout: "auid": 0, 2024-04-25T22:52:14.606 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_mode": "selfmanaged", 2024-04-25T22:52:14.606 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_seq": 0, 2024-04-25T22:52:14.606 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_epoch": 0, 2024-04-25T22:52:14.606 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_snaps": [], 2024-04-25T22:52:14.606 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps": "[]", 2024-04-25T22:52:14.606 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_bytes": 0, 2024-04-25T22:52:14.606 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_objects": 0, 2024-04-25T22:52:14.606 INFO:teuthology.orchestra.run.smithi052.stdout: "tiers": [], 2024-04-25T22:52:14.606 INFO:teuthology.orchestra.run.smithi052.stdout: "tier_of": -1, 2024-04-25T22:52:14.606 INFO:teuthology.orchestra.run.smithi052.stdout: "read_tier": -1, 2024-04-25T22:52:14.607 INFO:teuthology.orchestra.run.smithi052.stdout: "write_tier": -1, 2024-04-25T22:52:14.607 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_mode": "none", 2024-04-25T22:52:14.607 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_bytes": 0, 2024-04-25T22:52:14.607 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_objects": 0, 2024-04-25T22:52:14.607 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-25T22:52:14.607 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-25T22:52:14.607 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-25T22:52:14.607 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_flush_age": 0, 2024-04-25T22:52:14.607 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_evict_age": 0, 2024-04-25T22:52:14.607 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profile": "", 2024-04-25T22:52:14.607 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_params": { 2024-04-25T22:52:14.607 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "none" 2024-04-25T22:52:14.607 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T22:52:14.607 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_period": 0, 2024-04-25T22:52:14.608 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_count": 0, 2024-04-25T22:52:14.608 INFO:teuthology.orchestra.run.smithi052.stdout: "use_gmt_hitset": true, 2024-04-25T22:52:14.608 INFO:teuthology.orchestra.run.smithi052.stdout: "min_read_recency_for_promote": 0, 2024-04-25T22:52:14.608 INFO:teuthology.orchestra.run.smithi052.stdout: "min_write_recency_for_promote": 0, 2024-04-25T22:52:14.608 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_grade_decay_rate": 0, 2024-04-25T22:52:14.608 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_search_last_n": 0, 2024-04-25T22:52:14.608 INFO:teuthology.orchestra.run.smithi052.stdout: "grade_table": [], 2024-04-25T22:52:14.608 INFO:teuthology.orchestra.run.smithi052.stdout: "stripe_width": 0, 2024-04-25T22:52:14.608 INFO:teuthology.orchestra.run.smithi052.stdout: "expected_num_objects": 0, 2024-04-25T22:52:14.608 INFO:teuthology.orchestra.run.smithi052.stdout: "fast_read": false, 2024-04-25T22:52:14.608 INFO:teuthology.orchestra.run.smithi052.stdout: "options": { 2024-04-25T22:52:14.608 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_min": 64, 2024-04-25T22:52:14.608 INFO:teuthology.orchestra.run.smithi052.stdout: "target_size_ratio": 0.89999997615814209 2024-04-25T22:52:14.608 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T22:52:14.609 INFO:teuthology.orchestra.run.smithi052.stdout: "application_metadata": { 2024-04-25T22:52:14.609 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs": { 2024-04-25T22:52:14.609 INFO:teuthology.orchestra.run.smithi052.stdout: "data": "cephfs" 2024-04-25T22:52:14.609 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-25T22:52:14.609 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T22:52:14.609 INFO:teuthology.orchestra.run.smithi052.stdout: "read_balance": { 2024-04-25T22:52:14.609 INFO:teuthology.orchestra.run.smithi052.stdout: "score_type": "Fair distribution", 2024-04-25T22:52:14.609 INFO:teuthology.orchestra.run.smithi052.stdout: "score_acting": 1.1299999952316284, 2024-04-25T22:52:14.609 INFO:teuthology.orchestra.run.smithi052.stdout: "score_stable": 1.1299999952316284, 2024-04-25T22:52:14.609 INFO:teuthology.orchestra.run.smithi052.stdout: "optimal_score": 1, 2024-04-25T22:52:14.609 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-25T22:52:14.609 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-25T22:52:14.609 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity_weighted": 1, 2024-04-25T22:52:14.609 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity": 1, 2024-04-25T22:52:14.610 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity_weighted": 1 2024-04-25T22:52:14.610 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-25T22:52:14.610 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-25T22:52:14.610 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-04-25T22:52:14.610 INFO:teuthology.orchestra.run.smithi052.stdout: "osds": [ 2024-04-25T22:52:14.610 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-25T22:52:14.610 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 0, 2024-04-25T22:52:14.610 INFO:teuthology.orchestra.run.smithi052.stdout: "uuid": "b785a86a-6391-4a0d-8aec-c2016380832e", 2024-04-25T22:52:14.610 INFO:teuthology.orchestra.run.smithi052.stdout: "up": 1, 2024-04-25T22:52:14.610 INFO:teuthology.orchestra.run.smithi052.stdout: "in": 1, 2024-04-25T22:52:14.610 INFO:teuthology.orchestra.run.smithi052.stdout: "weight": 1, 2024-04-25T22:52:14.610 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity": 1, 2024-04-25T22:52:14.610 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_begin": 0, 2024-04-25T22:52:14.611 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_end": 0, 2024-04-25T22:52:14.611 INFO:teuthology.orchestra.run.smithi052.stdout: "up_from": 8, 2024-04-25T22:52:14.611 INFO:teuthology.orchestra.run.smithi052.stdout: "up_thru": 13, 2024-04-25T22:52:14.611 INFO:teuthology.orchestra.run.smithi052.stdout: "down_at": 0, 2024-04-25T22:52:14.611 INFO:teuthology.orchestra.run.smithi052.stdout: "lost_at": 0, 2024-04-25T22:52:14.611 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addrs": { 2024-04-25T22:52:14.611 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-25T22:52:14.611 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-25T22:52:14.611 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-25T22:52:14.611 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.110:6800", 2024-04-25T22:52:14.611 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3666753097 2024-04-25T22:52:14.611 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T22:52:14.611 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-25T22:52:14.611 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-25T22:52:14.611 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.110:6801", 2024-04-25T22:52:14.612 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3666753097 2024-04-25T22:52:14.612 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-25T22:52:14.612 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-25T22:52:14.612 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T22:52:14.612 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addrs": { 2024-04-25T22:52:14.612 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-25T22:52:14.612 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-25T22:52:14.612 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-25T22:52:14.612 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.110:6802", 2024-04-25T22:52:14.612 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3666753097 2024-04-25T22:52:14.612 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T22:52:14.612 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-25T22:52:14.612 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-25T22:52:14.612 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.110:6803", 2024-04-25T22:52:14.612 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3666753097 2024-04-25T22:52:14.613 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-25T22:52:14.613 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-25T22:52:14.613 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T22:52:14.613 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addrs": { 2024-04-25T22:52:14.613 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-25T22:52:14.613 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-25T22:52:14.613 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-25T22:52:14.613 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.110:6806", 2024-04-25T22:52:14.613 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3666753097 2024-04-25T22:52:14.613 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T22:52:14.613 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-25T22:52:14.613 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-25T22:52:14.613 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.110:6807", 2024-04-25T22:52:14.613 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3666753097 2024-04-25T22:52:14.614 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-25T22:52:14.614 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-25T22:52:14.614 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T22:52:14.614 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addrs": { 2024-04-25T22:52:14.614 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-25T22:52:14.614 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-25T22:52:14.614 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-25T22:52:14.614 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.110:6804", 2024-04-25T22:52:14.614 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3666753097 2024-04-25T22:52:14.614 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T22:52:14.614 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-25T22:52:14.614 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-25T22:52:14.614 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.110:6805", 2024-04-25T22:52:14.615 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3666753097 2024-04-25T22:52:14.615 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-25T22:52:14.615 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-25T22:52:14.615 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T22:52:14.615 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addr": "172.21.15.110:6801/3666753097", 2024-04-25T22:52:14.615 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addr": "172.21.15.110:6803/3666753097", 2024-04-25T22:52:14.615 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addr": "172.21.15.110:6807/3666753097", 2024-04-25T22:52:14.615 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addr": "172.21.15.110:6805/3666753097", 2024-04-25T22:52:14.615 INFO:teuthology.orchestra.run.smithi052.stdout: "state": [ 2024-04-25T22:52:14.615 INFO:teuthology.orchestra.run.smithi052.stdout: "exists", 2024-04-25T22:52:14.615 INFO:teuthology.orchestra.run.smithi052.stdout: "up" 2024-04-25T22:52:14.615 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-25T22:52:14.615 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T22:52:14.615 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-25T22:52:14.615 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 1, 2024-04-25T22:52:14.616 INFO:teuthology.orchestra.run.smithi052.stdout: "uuid": "088b4733-ccbd-41a6-8a31-8d811169c28a", 2024-04-25T22:52:14.616 INFO:teuthology.orchestra.run.smithi052.stdout: "up": 1, 2024-04-25T22:52:14.616 INFO:teuthology.orchestra.run.smithi052.stdout: "in": 1, 2024-04-25T22:52:14.616 INFO:teuthology.orchestra.run.smithi052.stdout: "weight": 1, 2024-04-25T22:52:14.616 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity": 1, 2024-04-25T22:52:14.616 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_begin": 0, 2024-04-25T22:52:14.616 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_end": 0, 2024-04-25T22:52:14.616 INFO:teuthology.orchestra.run.smithi052.stdout: "up_from": 8, 2024-04-25T22:52:14.616 INFO:teuthology.orchestra.run.smithi052.stdout: "up_thru": 13, 2024-04-25T22:52:14.616 INFO:teuthology.orchestra.run.smithi052.stdout: "down_at": 0, 2024-04-25T22:52:14.616 INFO:teuthology.orchestra.run.smithi052.stdout: "lost_at": 0, 2024-04-25T22:52:14.616 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addrs": { 2024-04-25T22:52:14.616 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-25T22:52:14.616 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-25T22:52:14.617 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-25T22:52:14.617 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.164:6800", 2024-04-25T22:52:14.617 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 479301362 2024-04-25T22:52:14.617 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T22:52:14.617 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-25T22:52:14.617 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-25T22:52:14.617 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.164:6801", 2024-04-25T22:52:14.617 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 479301362 2024-04-25T22:52:14.617 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-25T22:52:14.617 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-25T22:52:14.617 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T22:52:14.617 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addrs": { 2024-04-25T22:52:14.617 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-25T22:52:14.617 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-25T22:52:14.618 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-25T22:52:14.618 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.164:6802", 2024-04-25T22:52:14.618 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 479301362 2024-04-25T22:52:14.618 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T22:52:14.618 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-25T22:52:14.618 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-25T22:52:14.618 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.164:6803", 2024-04-25T22:52:14.618 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 479301362 2024-04-25T22:52:14.618 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-25T22:52:14.618 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-25T22:52:14.618 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T22:52:14.618 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addrs": { 2024-04-25T22:52:14.618 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-25T22:52:14.619 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-25T22:52:14.619 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-25T22:52:14.619 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.164:6806", 2024-04-25T22:52:14.619 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 479301362 2024-04-25T22:52:14.619 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T22:52:14.619 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-25T22:52:14.619 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-25T22:52:14.619 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.164:6807", 2024-04-25T22:52:14.619 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 479301362 2024-04-25T22:52:14.619 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-25T22:52:14.619 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-25T22:52:14.619 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T22:52:14.619 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addrs": { 2024-04-25T22:52:14.619 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-25T22:52:14.620 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-25T22:52:14.620 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-25T22:52:14.620 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.164:6804", 2024-04-25T22:52:14.620 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 479301362 2024-04-25T22:52:14.620 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T22:52:14.620 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-25T22:52:14.620 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-25T22:52:14.620 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.164:6805", 2024-04-25T22:52:14.620 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 479301362 2024-04-25T22:52:14.620 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-25T22:52:14.620 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-25T22:52:14.620 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T22:52:14.620 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addr": "172.21.15.164:6801/479301362", 2024-04-25T22:52:14.621 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addr": "172.21.15.164:6803/479301362", 2024-04-25T22:52:14.621 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addr": "172.21.15.164:6807/479301362", 2024-04-25T22:52:14.621 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addr": "172.21.15.164:6805/479301362", 2024-04-25T22:52:14.621 INFO:teuthology.orchestra.run.smithi052.stdout: "state": [ 2024-04-25T22:52:14.621 INFO:teuthology.orchestra.run.smithi052.stdout: "exists", 2024-04-25T22:52:14.621 INFO:teuthology.orchestra.run.smithi052.stdout: "up" 2024-04-25T22:52:14.621 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-25T22:52:14.621 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T22:52:14.621 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-25T22:52:14.621 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 2, 2024-04-25T22:52:14.621 INFO:teuthology.orchestra.run.smithi052.stdout: "uuid": "6a6aad8c-22ac-45c0-baf9-928314e7fef9", 2024-04-25T22:52:14.621 INFO:teuthology.orchestra.run.smithi052.stdout: "up": 1, 2024-04-25T22:52:14.621 INFO:teuthology.orchestra.run.smithi052.stdout: "in": 1, 2024-04-25T22:52:14.621 INFO:teuthology.orchestra.run.smithi052.stdout: "weight": 1, 2024-04-25T22:52:14.622 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity": 1, 2024-04-25T22:52:14.622 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_begin": 0, 2024-04-25T22:52:14.622 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_end": 0, 2024-04-25T22:52:14.622 INFO:teuthology.orchestra.run.smithi052.stdout: "up_from": 8, 2024-04-25T22:52:14.622 INFO:teuthology.orchestra.run.smithi052.stdout: "up_thru": 13, 2024-04-25T22:52:14.622 INFO:teuthology.orchestra.run.smithi052.stdout: "down_at": 0, 2024-04-25T22:52:14.622 INFO:teuthology.orchestra.run.smithi052.stdout: "lost_at": 0, 2024-04-25T22:52:14.622 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addrs": { 2024-04-25T22:52:14.622 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-25T22:52:14.622 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-25T22:52:14.622 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-25T22:52:14.622 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.191:6800", 2024-04-25T22:52:14.622 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 349040881 2024-04-25T22:52:14.623 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T22:52:14.623 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-25T22:52:14.623 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-25T22:52:14.623 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.191:6801", 2024-04-25T22:52:14.623 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 349040881 2024-04-25T22:52:14.623 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-25T22:52:14.623 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-25T22:52:14.623 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T22:52:14.623 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addrs": { 2024-04-25T22:52:14.623 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-25T22:52:14.623 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-25T22:52:14.623 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-25T22:52:14.623 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.191:6802", 2024-04-25T22:52:14.623 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 349040881 2024-04-25T22:52:14.623 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T22:52:14.624 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-25T22:52:14.624 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-25T22:52:14.624 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.191:6803", 2024-04-25T22:52:14.624 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 349040881 2024-04-25T22:52:14.624 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-25T22:52:14.624 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-25T22:52:14.624 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T22:52:14.624 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addrs": { 2024-04-25T22:52:14.624 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-25T22:52:14.624 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-25T22:52:14.624 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-25T22:52:14.624 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.191:6806", 2024-04-25T22:52:14.624 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 349040881 2024-04-25T22:52:14.624 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T22:52:14.625 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-25T22:52:14.625 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-25T22:52:14.625 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.191:6807", 2024-04-25T22:52:14.625 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 349040881 2024-04-25T22:52:14.625 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-25T22:52:14.625 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-25T22:52:14.625 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T22:52:14.625 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addrs": { 2024-04-25T22:52:14.625 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-25T22:52:14.625 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-25T22:52:14.625 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-25T22:52:14.625 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.191:6804", 2024-04-25T22:52:14.625 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 349040881 2024-04-25T22:52:14.625 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T22:52:14.626 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-25T22:52:14.626 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-25T22:52:14.626 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.191:6805", 2024-04-25T22:52:14.626 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 349040881 2024-04-25T22:52:14.626 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-25T22:52:14.626 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-25T22:52:14.626 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T22:52:14.626 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addr": "172.21.15.191:6801/349040881", 2024-04-25T22:52:14.626 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addr": "172.21.15.191:6803/349040881", 2024-04-25T22:52:14.626 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addr": "172.21.15.191:6807/349040881", 2024-04-25T22:52:14.626 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addr": "172.21.15.191:6805/349040881", 2024-04-25T22:52:14.626 INFO:teuthology.orchestra.run.smithi052.stdout: "state": [ 2024-04-25T22:52:14.626 INFO:teuthology.orchestra.run.smithi052.stdout: "exists", 2024-04-25T22:52:14.627 INFO:teuthology.orchestra.run.smithi052.stdout: "up" 2024-04-25T22:52:14.627 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-25T22:52:14.627 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-25T22:52:14.627 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-04-25T22:52:14.627 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_xinfo": [ 2024-04-25T22:52:14.627 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-25T22:52:14.627 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 0, 2024-04-25T22:52:14.627 INFO:teuthology.orchestra.run.smithi052.stdout: "down_stamp": "0.000000", 2024-04-25T22:52:14.627 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_probability": 0, 2024-04-25T22:52:14.627 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_interval": 0, 2024-04-25T22:52:14.627 INFO:teuthology.orchestra.run.smithi052.stdout: "features": 4540701547738038271, 2024-04-25T22:52:14.627 INFO:teuthology.orchestra.run.smithi052.stdout: "old_weight": 0, 2024-04-25T22:52:14.627 INFO:teuthology.orchestra.run.smithi052.stdout: "last_purged_snaps_scrub": "2024-04-25T22:51:43.531709+0000", 2024-04-25T22:52:14.627 INFO:teuthology.orchestra.run.smithi052.stdout: "dead_epoch": 0 2024-04-25T22:52:14.628 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T22:52:14.628 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-25T22:52:14.628 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 1, 2024-04-25T22:52:14.628 INFO:teuthology.orchestra.run.smithi052.stdout: "down_stamp": "0.000000", 2024-04-25T22:52:14.628 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_probability": 0, 2024-04-25T22:52:14.628 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_interval": 0, 2024-04-25T22:52:14.628 INFO:teuthology.orchestra.run.smithi052.stdout: "features": 4540701547738038271, 2024-04-25T22:52:14.628 INFO:teuthology.orchestra.run.smithi052.stdout: "old_weight": 0, 2024-04-25T22:52:14.628 INFO:teuthology.orchestra.run.smithi052.stdout: "last_purged_snaps_scrub": "2024-04-25T22:51:43.589701+0000", 2024-04-25T22:52:14.628 INFO:teuthology.orchestra.run.smithi052.stdout: "dead_epoch": 0 2024-04-25T22:52:14.628 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T22:52:14.628 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-25T22:52:14.628 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 2, 2024-04-25T22:52:14.628 INFO:teuthology.orchestra.run.smithi052.stdout: "down_stamp": "0.000000", 2024-04-25T22:52:14.629 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_probability": 0, 2024-04-25T22:52:14.629 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_interval": 0, 2024-04-25T22:52:14.629 INFO:teuthology.orchestra.run.smithi052.stdout: "features": 4540701547738038271, 2024-04-25T22:52:14.629 INFO:teuthology.orchestra.run.smithi052.stdout: "old_weight": 0, 2024-04-25T22:52:14.629 INFO:teuthology.orchestra.run.smithi052.stdout: "last_purged_snaps_scrub": "2024-04-25T22:51:43.566226+0000", 2024-04-25T22:52:14.629 INFO:teuthology.orchestra.run.smithi052.stdout: "dead_epoch": 0 2024-04-25T22:52:14.629 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-25T22:52:14.629 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-04-25T22:52:14.629 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_upmap": [], 2024-04-25T22:52:14.629 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_upmap_items": [], 2024-04-25T22:52:14.629 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_upmap_primaries": [], 2024-04-25T22:52:14.629 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_temp": [], 2024-04-25T22:52:14.629 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_temp": [], 2024-04-25T22:52:14.629 INFO:teuthology.orchestra.run.smithi052.stdout: "blocklist": {}, 2024-04-25T22:52:14.630 INFO:teuthology.orchestra.run.smithi052.stdout: "range_blocklist": {}, 2024-04-25T22:52:14.630 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profiles": { 2024-04-25T22:52:14.630 INFO:teuthology.orchestra.run.smithi052.stdout: "default": { 2024-04-25T22:52:14.630 INFO:teuthology.orchestra.run.smithi052.stdout: "crush-failure-domain": "osd", 2024-04-25T22:52:14.630 INFO:teuthology.orchestra.run.smithi052.stdout: "k": "2", 2024-04-25T22:52:14.630 INFO:teuthology.orchestra.run.smithi052.stdout: "m": "1", 2024-04-25T22:52:14.630 INFO:teuthology.orchestra.run.smithi052.stdout: "plugin": "jerasure", 2024-04-25T22:52:14.630 INFO:teuthology.orchestra.run.smithi052.stdout: "technique": "reed_sol_van" 2024-04-25T22:52:14.630 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-25T22:52:14.630 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T22:52:14.630 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps_queue": [], 2024-04-25T22:52:14.630 INFO:teuthology.orchestra.run.smithi052.stdout: "new_removed_snaps": [], 2024-04-25T22:52:14.630 INFO:teuthology.orchestra.run.smithi052.stdout: "new_purged_snaps": [], 2024-04-25T22:52:14.630 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_node_flags": {}, 2024-04-25T22:52:14.631 INFO:teuthology.orchestra.run.smithi052.stdout: "device_class_flags": {}, 2024-04-25T22:52:14.631 INFO:teuthology.orchestra.run.smithi052.stdout: "stretch_mode": { 2024-04-25T22:52:14.631 INFO:teuthology.orchestra.run.smithi052.stdout: "stretch_mode_enabled": false, 2024-04-25T22:52:14.631 INFO:teuthology.orchestra.run.smithi052.stdout: "stretch_bucket_count": 0, 2024-04-25T22:52:14.631 INFO:teuthology.orchestra.run.smithi052.stdout: "degraded_stretch_mode": 0, 2024-04-25T22:52:14.631 INFO:teuthology.orchestra.run.smithi052.stdout: "recovering_stretch_mode": 0, 2024-04-25T22:52:14.631 INFO:teuthology.orchestra.run.smithi052.stdout: "stretch_mode_bucket": 0 2024-04-25T22:52:14.631 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-25T22:52:14.631 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-04-25T22:52:14.633 INFO:tasks.thrashosds.thrasher:j is {'epoch': 15, 'fsid': '5355b70e-3f7d-4bce-8676-89cee61d2089', 'created': '2024-04-25T22:51:37.688525+0000', 'modified': '2024-04-25T22:51:54.011012+0000', 'last_up_change': '2024-04-25T22:51:45.753740+0000', 'last_in_change': '2024-04-25T22:51:38.491924+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T22:51:45.966439+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T22:51:46.128416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T22:51:50.648525+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T22:51:51.351497+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'b785a86a-6391-4a0d-8aec-c2016380832e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 13, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6800', 'nonce': 3666753097}, {'type': 'v1', 'addr': '172.21.15.110:6801', 'nonce': 3666753097}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6802', 'nonce': 3666753097}, {'type': 'v1', 'addr': '172.21.15.110:6803', 'nonce': 3666753097}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6806', 'nonce': 3666753097}, {'type': 'v1', 'addr': '172.21.15.110:6807', 'nonce': 3666753097}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6804', 'nonce': 3666753097}, {'type': 'v1', 'addr': '172.21.15.110:6805', 'nonce': 3666753097}]}, 'public_addr': '172.21.15.110:6801/3666753097', 'cluster_addr': '172.21.15.110:6803/3666753097', 'heartbeat_back_addr': '172.21.15.110:6807/3666753097', 'heartbeat_front_addr': '172.21.15.110:6805/3666753097', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '088b4733-ccbd-41a6-8a31-8d811169c28a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 13, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6800', 'nonce': 479301362}, {'type': 'v1', 'addr': '172.21.15.164:6801', 'nonce': 479301362}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6802', 'nonce': 479301362}, {'type': 'v1', 'addr': '172.21.15.164:6803', 'nonce': 479301362}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6806', 'nonce': 479301362}, {'type': 'v1', 'addr': '172.21.15.164:6807', 'nonce': 479301362}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6804', 'nonce': 479301362}, {'type': 'v1', 'addr': '172.21.15.164:6805', 'nonce': 479301362}]}, 'public_addr': '172.21.15.164:6801/479301362', 'cluster_addr': '172.21.15.164:6803/479301362', 'heartbeat_back_addr': '172.21.15.164:6807/479301362', 'heartbeat_front_addr': '172.21.15.164:6805/479301362', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '6a6aad8c-22ac-45c0-baf9-928314e7fef9', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 13, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6800', 'nonce': 349040881}, {'type': 'v1', 'addr': '172.21.15.191:6801', 'nonce': 349040881}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6802', 'nonce': 349040881}, {'type': 'v1', 'addr': '172.21.15.191:6803', 'nonce': 349040881}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6806', 'nonce': 349040881}, {'type': 'v1', 'addr': '172.21.15.191:6807', 'nonce': 349040881}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6804', 'nonce': 349040881}, {'type': 'v1', 'addr': '172.21.15.191:6805', 'nonce': 349040881}]}, 'public_addr': '172.21.15.191:6801/349040881', 'cluster_addr': '172.21.15.191:6803/349040881', 'heartbeat_back_addr': '172.21.15.191:6807/349040881', 'heartbeat_front_addr': '172.21.15.191:6805/349040881', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-25T22:51:43.531709+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-25T22:51:43.589701+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-25T22:51:43.566226+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-25T22:52:14.633 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-04-25T22:52:14.676 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:14.676+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:14.734 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:14.734 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:14.737 INFO:teuthology.orchestra.run.smithi052.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T22:52:14.744 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:52:14.750 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T22:52:14.750 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T22:52:14.750 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi052.front.sepia.ceph.com 2024-04-25T22:52:14.750 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T22:52:14.750 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T22:52:14.750 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T22:52:14.750 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T22:52:14.751 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T22:52:14.751 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T22:52:14.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:52:14.751 DEBUG:teuthology.orchestra.run.smithi052:> ip addr 2024-04-25T22:52:14.766 INFO:teuthology.orchestra.run.smithi052.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T22:52:14.766 INFO:teuthology.orchestra.run.smithi052.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T22:52:14.766 INFO:teuthology.orchestra.run.smithi052.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T22:52:14.767 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-04-25T22:52:14.767 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 ::1/128 scope host 2024-04-25T22:52:14.767 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-04-25T22:52:14.767 INFO:teuthology.orchestra.run.smithi052.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T22:52:14.767 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d2 brd ff:ff:ff:ff:ff:ff 2024-04-25T22:52:14.767 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f0 2024-04-25T22:52:14.767 INFO:teuthology.orchestra.run.smithi052.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T22:52:14.767 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d3 brd ff:ff:ff:ff:ff:ff 2024-04-25T22:52:14.767 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f1 2024-04-25T22:52:14.767 INFO:teuthology.orchestra.run.smithi052.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T22:52:14.767 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:de brd ff:ff:ff:ff:ff:ff 2024-04-25T22:52:14.767 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f0 2024-04-25T22:52:14.767 INFO:teuthology.orchestra.run.smithi052.stdout: inet 172.21.15.52/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T22:52:14.768 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft 42733sec preferred_lft 42733sec 2024-04-25T22:52:14.768 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::ec4:7aff:febd:15de/64 scope link noprefixroute 2024-04-25T22:52:14.768 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-04-25T22:52:14.768 INFO:teuthology.orchestra.run.smithi052.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T22:52:14.768 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:df brd ff:ff:ff:ff:ff:ff 2024-04-25T22:52:14.768 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f1 2024-04-25T22:52:14.768 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T22:52:14.769 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T22:52:14.769 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-04-25T22:52:14.769 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link add name ceph-brx type bridge 2024-04-25T22:52:14.769 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip addr flush dev ceph-brx 2024-04-25T22:52:14.769 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set ceph-brx up 2024-04-25T22:52:14.769 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T22:52:14.769 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-04-25T22:52:14.777 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:14.776+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:14.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T22:52:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T22:52:14.859 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:14.860 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:14.871 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:52:14.878 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:14.878+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:14.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T22:52:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T22:52:14.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:52:14.950 DEBUG:teuthology.orchestra.run.smithi052:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T22:52:14.973 INFO:teuthology.orchestra.run.smithi052.stdout:1 2024-04-25T22:52:14.974 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:14.974 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:14.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:52:14.975 DEBUG:teuthology.orchestra.run.smithi052:> route 2024-04-25T22:52:14.978 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:14.977+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:14.983 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:52:15.054 INFO:teuthology.orchestra.run.smithi052.stdout:Kernel IP routing table 2024-04-25T22:52:15.054 INFO:teuthology.orchestra.run.smithi052.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T22:52:15.054 INFO:teuthology.orchestra.run.smithi052.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T22:52:15.055 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T22:52:15.055 INFO:teuthology.orchestra.run.smithi052.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T22:52:15.055 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T22:52:15.055 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-04-25T22:52:15.055 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T22:52:15.055 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T22:52:15.055 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T22:52:15.055 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-04-25T22:52:15.062 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is set 2024-04-25T22:52:15.078 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:15.077+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:15.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T22:52:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T22:52:15.127 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:15.127 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:15.137 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:52:15.181 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:15.181+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:15.251 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:15.251 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:15.260 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:52:15.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T22:52:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T22:52:15.280 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:15.280+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:15.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:52:15.284 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2024-04-25T22:52:15.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:52:15.340 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list-id 2024-04-25T22:52:15.381 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:15.381+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:15.395 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T22:52:15.395 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-04-25T22:52:15.395 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T22:52:15.395 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-25T22:52:15.396 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-04-25T22:52:15.403 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:15.403 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:15.412 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:52:15.483 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:15.482+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:15.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T22:52:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T22:52:15.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T22:52:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T22:52:15.512 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-25T22:52:15.513 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T22:52:15.513 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-04-25T22:52:15.513 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-25T22:52:15.513 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T22:52:15.513 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-25T22:52:15.513 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-25T22:52:15.513 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-25T22:52:15.513 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-04-25T22:52:15.514 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:15.514 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:15.523 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:52:15.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T22:52:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T22:52:15.583 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:15.583+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:15.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T22:52:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T22:52:15.631 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:15.631 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:15.636 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T22:52:15.636 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-04-25T22:52:15.636 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set brx.0 up 2024-04-25T22:52:15.636 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T22:52:15.636 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-04-25T22:52:15.640 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:52:15.684 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:15.684+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:15.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T22:52:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T22:52:15.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T22:52:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T22:52:15.713 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-25T22:52:15.713 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T22:52:15.713 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T22:52:15.738 INFO:teuthology.orchestra.run.smithi052.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T22:52:15.738 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T22:52:15.738 DEBUG:teuthology.orchestra.run.smithi052:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T22:52:15.741 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:15.741 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:15.750 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:52:15.785 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:15.785+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:15.793 DEBUG:teuthology.orchestra.run.smithi052:> sudo modprobe fuse 2024-04-25T22:52:15.854 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:15.854 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:15.859 DEBUG:teuthology.orchestra.run.smithi052:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T22:52:15.863 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:52:15.886 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:15.885+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:15.915 INFO:teuthology.orchestra.run.smithi052.stdout:/proc 2024-04-25T22:52:15.916 INFO:teuthology.orchestra.run.smithi052.stdout:/sys 2024-04-25T22:52:15.916 INFO:teuthology.orchestra.run.smithi052.stdout:/dev 2024-04-25T22:52:15.916 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/security 2024-04-25T22:52:15.916 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/shm 2024-04-25T22:52:15.916 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/pts 2024-04-25T22:52:15.916 INFO:teuthology.orchestra.run.smithi052.stdout:/run 2024-04-25T22:52:15.916 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/cgroup 2024-04-25T22:52:15.916 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/pstore 2024-04-25T22:52:15.916 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/bpf 2024-04-25T22:52:15.916 INFO:teuthology.orchestra.run.smithi052.stdout:/ 2024-04-25T22:52:15.916 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/selinux 2024-04-25T22:52:15.916 INFO:teuthology.orchestra.run.smithi052.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T22:52:15.916 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/mqueue 2024-04-25T22:52:15.917 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/hugepages 2024-04-25T22:52:15.917 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/debug 2024-04-25T22:52:15.917 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/tracing 2024-04-25T22:52:15.917 INFO:teuthology.orchestra.run.smithi052.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T22:52:15.917 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/config 2024-04-25T22:52:15.917 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/fuse/connections 2024-04-25T22:52:15.917 INFO:teuthology.orchestra.run.smithi052.stdout:/run/credentials/systemd-sysctl.service 2024-04-25T22:52:15.917 INFO:teuthology.orchestra.run.smithi052.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-25T22:52:15.917 INFO:teuthology.orchestra.run.smithi052.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-25T22:52:15.917 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T22:52:15.917 INFO:teuthology.orchestra.run.smithi052.stdout:/run/user/1000 2024-04-25T22:52:15.917 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph 2024-04-25T22:52:15.917 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns 2024-04-25T22:52:15.918 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T22:52:15.918 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T22:52:15.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:52:15.918 DEBUG:teuthology.orchestra.run.smithi052:> ls /sys/fs/fuse/connections 2024-04-25T22:52:15.972 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-25T22:52:15.972 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-25T22:52:15.972 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:15.973 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:15.982 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:52:15.987 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:15.986+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:16.016 DEBUG:teuthology.orchestra.run.smithi052:> sudo modprobe fuse 2024-04-25T22:52:16.040 DEBUG:teuthology.orchestra.run.smithi052:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T22:52:16.086 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:16.086 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:16.087 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:16.087+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:16.095 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:52:16.096 INFO:teuthology.orchestra.run.smithi052.stdout:/proc 2024-04-25T22:52:16.096 INFO:teuthology.orchestra.run.smithi052.stdout:/sys 2024-04-25T22:52:16.096 INFO:teuthology.orchestra.run.smithi052.stdout:/dev 2024-04-25T22:52:16.096 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/security 2024-04-25T22:52:16.096 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/shm 2024-04-25T22:52:16.096 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/pts 2024-04-25T22:52:16.097 INFO:teuthology.orchestra.run.smithi052.stdout:/run 2024-04-25T22:52:16.097 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/cgroup 2024-04-25T22:52:16.097 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/pstore 2024-04-25T22:52:16.097 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/bpf 2024-04-25T22:52:16.097 INFO:teuthology.orchestra.run.smithi052.stdout:/ 2024-04-25T22:52:16.097 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/selinux 2024-04-25T22:52:16.097 INFO:teuthology.orchestra.run.smithi052.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T22:52:16.097 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/mqueue 2024-04-25T22:52:16.097 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/hugepages 2024-04-25T22:52:16.097 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/debug 2024-04-25T22:52:16.097 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/tracing 2024-04-25T22:52:16.097 INFO:teuthology.orchestra.run.smithi052.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T22:52:16.097 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/config 2024-04-25T22:52:16.097 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/fuse/connections 2024-04-25T22:52:16.098 INFO:teuthology.orchestra.run.smithi052.stdout:/run/credentials/systemd-sysctl.service 2024-04-25T22:52:16.098 INFO:teuthology.orchestra.run.smithi052.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-25T22:52:16.098 INFO:teuthology.orchestra.run.smithi052.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-25T22:52:16.098 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T22:52:16.098 INFO:teuthology.orchestra.run.smithi052.stdout:/run/user/1000 2024-04-25T22:52:16.098 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph 2024-04-25T22:52:16.098 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns 2024-04-25T22:52:16.098 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T22:52:16.098 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T22:52:16.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:52:16.098 DEBUG:teuthology.orchestra.run.smithi052:> ls /sys/fs/fuse/connections 2024-04-25T22:52:16.108 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi052.stderr:2024-04-25T22:52:16.107+0000 7fba2d0d2480 -1 init, newargv = 0x55fb395c25e0 newargc=15 2024-04-25T22:52:16.108 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi052.stderr:ceph-fuse[31785]: starting ceph client 2024-04-25T22:52:16.114 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi052.stderr:ceph-fuse[31785]: starting fuse 2024-04-25T22:52:16.123 INFO:teuthology.orchestra.run.smithi052.stdout:43 2024-04-25T22:52:16.123 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-04-25T22:52:16.123 DEBUG:teuthology.orchestra.run.smithi052:> sudo stdin-killer -- python3 -c ' 2024-04-25T22:52:16.123 DEBUG:teuthology.orchestra.run.smithi052:> import glob 2024-04-25T22:52:16.124 DEBUG:teuthology.orchestra.run.smithi052:> import re 2024-04-25T22:52:16.124 DEBUG:teuthology.orchestra.run.smithi052:> import os 2024-04-25T22:52:16.124 DEBUG:teuthology.orchestra.run.smithi052:> import subprocess 2024-04-25T22:52:16.124 DEBUG:teuthology.orchestra.run.smithi052:> 2024-04-25T22:52:16.124 DEBUG:teuthology.orchestra.run.smithi052:> def _find_admin_socket(client_name): 2024-04-25T22:52:16.124 DEBUG:teuthology.orchestra.run.smithi052:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-25T22:52:16.124 DEBUG:teuthology.orchestra.run.smithi052:> files = glob.glob(asok_path) 2024-04-25T22:52:16.124 DEBUG:teuthology.orchestra.run.smithi052:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-25T22:52:16.124 DEBUG:teuthology.orchestra.run.smithi052:> 2024-04-25T22:52:16.124 DEBUG:teuthology.orchestra.run.smithi052:> # Given a non-glob path, it better be there 2024-04-25T22:52:16.124 DEBUG:teuthology.orchestra.run.smithi052:> if "*" not in asok_path: 2024-04-25T22:52:16.124 DEBUG:teuthology.orchestra.run.smithi052:> assert(len(files) == 1) 2024-04-25T22:52:16.124 DEBUG:teuthology.orchestra.run.smithi052:> return files[0] 2024-04-25T22:52:16.124 DEBUG:teuthology.orchestra.run.smithi052:> 2024-04-25T22:52:16.125 DEBUG:teuthology.orchestra.run.smithi052:> for f in files: 2024-04-25T22:52:16.125 DEBUG:teuthology.orchestra.run.smithi052:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-25T22:52:16.125 DEBUG:teuthology.orchestra.run.smithi052:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-25T22:52:16.125 DEBUG:teuthology.orchestra.run.smithi052:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-25T22:52:16.125 DEBUG:teuthology.orchestra.run.smithi052:> contents = proc_f.read() 2024-04-25T22:52:16.125 DEBUG:teuthology.orchestra.run.smithi052:> if mountpoint in contents: 2024-04-25T22:52:16.125 DEBUG:teuthology.orchestra.run.smithi052:> return f 2024-04-25T22:52:16.125 DEBUG:teuthology.orchestra.run.smithi052:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-25T22:52:16.125 DEBUG:teuthology.orchestra.run.smithi052:> 2024-04-25T22:52:16.125 DEBUG:teuthology.orchestra.run.smithi052:> print(_find_admin_socket("client.0")) 2024-04-25T22:52:16.125 DEBUG:teuthology.orchestra.run.smithi052:> ' 2024-04-25T22:52:16.187 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:16.187+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:16.238 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:16.239 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:16.242 INFO:teuthology.orchestra.run.smithi052.stdout:/var/run/ceph/ceph-client.0.31785.asok 2024-04-25T22:52:16.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-25T22:52:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T22:52:16.248 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:52:16.253 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.31785.asok 2024-04-25T22:52:16.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:52:16.253 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.31785.asok status 2024-04-25T22:52:16.290 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:16.290+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:16.357 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:16.357 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:16.366 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:52:16.389 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-04-25T22:52:16.389 INFO:teuthology.orchestra.run.smithi052.stdout: "metadata": { 2024-04-25T22:52:16.389 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_sha1": "d2c45d977142e024a59b68a8f1dce8f0b9840551", 2024-04-25T22:52:16.389 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_version": "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)", 2024-04-25T22:52:16.389 INFO:teuthology.orchestra.run.smithi052.stdout: "entity_id": "0", 2024-04-25T22:52:16.390 INFO:teuthology.orchestra.run.smithi052.stdout: "hostname": "smithi052", 2024-04-25T22:52:16.390 INFO:teuthology.orchestra.run.smithi052.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-25T22:52:16.390 INFO:teuthology.orchestra.run.smithi052.stdout: "pid": "31785", 2024-04-25T22:52:16.390 INFO:teuthology.orchestra.run.smithi052.stdout: "root": "/" 2024-04-25T22:52:16.390 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T22:52:16.390 INFO:teuthology.orchestra.run.smithi052.stdout: "dentry_count": 0, 2024-04-25T22:52:16.390 INFO:teuthology.orchestra.run.smithi052.stdout: "dentry_pinned_count": 0, 2024-04-25T22:52:16.390 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 4734, 2024-04-25T22:52:16.390 INFO:teuthology.orchestra.run.smithi052.stdout: "inst": { 2024-04-25T22:52:16.390 INFO:teuthology.orchestra.run.smithi052.stdout: "name": { 2024-04-25T22:52:16.390 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "client", 2024-04-25T22:52:16.390 INFO:teuthology.orchestra.run.smithi052.stdout: "num": 4734 2024-04-25T22:52:16.390 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T22:52:16.391 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": { 2024-04-25T22:52:16.391 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-25T22:52:16.391 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "192.168.0.1:0", 2024-04-25T22:52:16.391 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 1876499807 2024-04-25T22:52:16.391 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-25T22:52:16.391 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T22:52:16.391 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": { 2024-04-25T22:52:16.391 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-25T22:52:16.391 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "192.168.0.1:0", 2024-04-25T22:52:16.391 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 1876499807 2024-04-25T22:52:16.391 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-25T22:52:16.391 INFO:teuthology.orchestra.run.smithi052.stdout: "inst_str": "client.4734 192.168.0.1:0/1876499807", 2024-04-25T22:52:16.391 INFO:teuthology.orchestra.run.smithi052.stdout: "addr_str": "192.168.0.1:0/1876499807", 2024-04-25T22:52:16.391 INFO:teuthology.orchestra.run.smithi052.stdout: "inode_count": 1, 2024-04-25T22:52:16.392 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_epoch": 5, 2024-04-25T22:52:16.392 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_epoch": 16, 2024-04-25T22:52:16.392 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_epoch_barrier": 0, 2024-04-25T22:52:16.392 INFO:teuthology.orchestra.run.smithi052.stdout: "blocklisted": false, 2024-04-25T22:52:16.392 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs" 2024-04-25T22:52:16.392 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-04-25T22:52:16.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:52:16.398 DEBUG:teuthology.orchestra.run.smithi052:> stat --file-system '--printf=%T 2024-04-25T22:52:16.398 DEBUG:teuthology.orchestra.run.smithi052:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-25T22:52:16.410 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:16.410+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:16.413 INFO:teuthology.orchestra.run.smithi052.stdout:fuseblk 2024-04-25T22:52:16.414 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-25T22:52:16.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:52:16.414 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T22:52:16.467 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:16.468 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:16.471 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:52:16.476 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:52:16.479 INFO:teuthology.run_tasks:Running task workunit... 2024-04-25T22:52:16.497 INFO:tasks.workunit:Pulling workunits from ref b22e2ebdeb24376882b7bda2a7329c8cccc2276a 2024-04-25T22:52:16.497 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-25T22:52:16.497 INFO:tasks.workunit:timeout=6h 2024-04-25T22:52:16.497 INFO:tasks.workunit:cleanup=True 2024-04-25T22:52:16.498 DEBUG:teuthology.orchestra.run.smithi052:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-25T22:52:16.518 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:16.518+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:16.535 INFO:teuthology.orchestra.run.smithi052.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-25T22:52:16.535 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-25T22:52:16.535 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 2bh/43d Inode: 1 Links: 2 2024-04-25T22:52:16.536 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T22:52:16.536 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:fusefs_t:s0 2024-04-25T22:52:16.536 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-25T22:52:16.536 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-04-25 22:51:53.008083894 +0000 2024-04-25T22:52:16.536 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-04-25 22:52:16.477572462 +0000 2024-04-25T22:52:16.536 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: - 2024-04-25T22:52:16.536 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-25T22:52:16.536 DEBUG:teuthology.orchestra.run.smithi052:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-25T22:52:16.600 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:16.600+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:16.604 DEBUG:teuthology.orchestra.run.smithi052:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout b22e2ebdeb24376882b7bda2a7329c8cccc2276a 2024-04-25T22:52:16.619 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:16.620 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:16.629 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:52:16.642 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-25T22:52:16.643 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:52:16.658 INFO:tasks.workunit.client.0.smithi052.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-25T22:52:16.661 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-25T22:52:16.661 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:52:16.679 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-25T22:52:16.679 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:52:16.701 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:16.700+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:16.735 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:16.735 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:52:16.735 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-04-25T22:52:16.735 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:16.744 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:52:16.802 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:16.801+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:16.921 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:16.921 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:52:16.922 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:52:16.922 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:52:16.922 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:16.922 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:52:16.922 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:16.921+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:17.021 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:17.021+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:17.067 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:17.067 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-04-25T22:52:17.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-04-25T22:52:17.068 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:52:17.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.068 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:17.068 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:17.068 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.100341735000001, 2024-04-25T22:52:17.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0103421, 2024-04-25T22:52:17.068 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:17.068 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:17.068 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:17.068 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:17.068 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:17.068 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:17.069 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 115 2024-04-25T22:52:17.069 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.069 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:17.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:17.069 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:17.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:17.069 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:17.069 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:17.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:17.069 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:17.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:17.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9500000000000002e-07 2024-04-25T22:52:17.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:17.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965108+0000", 2024-04-25T22:52:17.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9177999999999994e-05 2024-04-25T22:52:17.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:17.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965127+0000", 2024-04-25T22:52:17.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8868e-05 2024-04-25T22:52:17.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:17.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965133+0000", 2024-04-25T22:52:17.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8929999999999999e-06 2024-04-25T22:52:17.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:17.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.969991+0000", 2024-04-25T22:52:17.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048573849999999997 2024-04-25T22:52:17.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:17.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970072+0000", 2024-04-25T22:52:17.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0728000000000004e-05 2024-04-25T22:52:17.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:17.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970189+0000", 2024-04-25T22:52:17.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000117778 2024-04-25T22:52:17.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:17.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970946+0000", 2024-04-25T22:52:17.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00075704600000000004 2024-04-25T22:52:17.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:17.073 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975297+0000", 2024-04-25T22:52:17.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004350217 2024-04-25T22:52:17.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:17.073 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975343+0000", 2024-04-25T22:52:17.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6687999999999998e-05 2024-04-25T22:52:17.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:17.073 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975380+0000", 2024-04-25T22:52:17.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6724000000000003e-05 2024-04-25T22:52:17.073 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:17.073 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:17.074 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:17.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.074 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:17.074 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:17.074 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.100235703999999, 2024-04-25T22:52:17.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010304384, 2024-04-25T22:52:17.074 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:17.074 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:17.074 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:17.074 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:17.074 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:17.074 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:17.074 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 116 2024-04-25T22:52:17.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.075 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:17.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:17.075 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:17.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:17.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:17.075 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:17.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:17.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:17.076 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:17.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5799999999999999e-07 2024-04-25T22:52:17.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.076 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:17.076 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965154+0000", 2024-04-25T22:52:17.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0009e-05 2024-04-25T22:52:17.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.076 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:17.076 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965164+0000", 2024-04-25T22:52:17.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8490000000000001e-06 2024-04-25T22:52:17.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.077 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:17.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965169+0000", 2024-04-25T22:52:17.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0730000000000004e-06 2024-04-25T22:52:17.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.077 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:17.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970609+0000", 2024-04-25T22:52:17.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054397689999999997 2024-04-25T22:52:17.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.077 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:17.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970651+0000", 2024-04-25T22:52:17.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1873999999999999e-05 2024-04-25T22:52:17.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:17.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970723+0000", 2024-04-25T22:52:17.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2039999999999995e-05 2024-04-25T22:52:17.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:17.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971358+0000", 2024-04-25T22:52:17.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063489500000000001 2024-04-25T22:52:17.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:17.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975409+0000", 2024-04-25T22:52:17.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040506880000000002 2024-04-25T22:52:17.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:17.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975432+0000", 2024-04-25T22:52:17.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3315999999999998e-05 2024-04-25T22:52:17.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:17.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975448+0000", 2024-04-25T22:52:17.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6313000000000001e-05 2024-04-25T22:52:17.079 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:17.080 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:17.080 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:17.080 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.080 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.080 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:17.080 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:17.080 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.100201122000001, 2024-04-25T22:52:17.080 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010384338999999999, 2024-04-25T22:52:17.080 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:17.080 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:17.080 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:17.080 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:17.080 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:17.080 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:17.081 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-04-25T22:52:17.081 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.081 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:17.081 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.081 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:17.081 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:17.081 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:17.081 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.081 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.081 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:17.081 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:17.081 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:17.081 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.082 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.082 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:17.082 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:17.082 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3600000000000004e-07 2024-04-25T22:52:17.082 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.082 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.082 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:17.082 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965185+0000", 2024-04-25T22:52:17.082 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.117e-06 2024-04-25T22:52:17.082 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.082 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.082 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:17.082 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965192+0000", 2024-04-25T22:52:17.083 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3239999999999997e-06 2024-04-25T22:52:17.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.083 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.083 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:17.083 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965198+0000", 2024-04-25T22:52:17.083 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6370000000000004e-06 2024-04-25T22:52:17.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.083 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.083 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:17.083 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970973+0000", 2024-04-25T22:52:17.083 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057748239999999996 2024-04-25T22:52:17.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.083 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.083 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:17.084 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971049+0000", 2024-04-25T22:52:17.084 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6029e-05 2024-04-25T22:52:17.084 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.084 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:17.084 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971174+0000", 2024-04-25T22:52:17.084 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012462399999999999 2024-04-25T22:52:17.084 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.084 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:17.084 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971553+0000", 2024-04-25T22:52:17.084 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037896499999999999 2024-04-25T22:52:17.084 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.085 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:17.085 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975482+0000", 2024-04-25T22:52:17.085 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039297459999999996 2024-04-25T22:52:17.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.085 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.085 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:17.085 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975529+0000", 2024-04-25T22:52:17.085 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6387000000000002e-05 2024-04-25T22:52:17.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.085 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.085 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:17.085 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975563+0000", 2024-04-25T22:52:17.085 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4150000000000003e-05 2024-04-25T22:52:17.085 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:17.086 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:17.086 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:17.086 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.086 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.086 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:17.086 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:17.086 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.053154799000001, 2024-04-25T22:52:17.086 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012637705000000001, 2024-04-25T22:52:17.086 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:17.086 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:17.086 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:17.086 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:17.087 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.087 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:17.087 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:17.087 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:17.087 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.087 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.087 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:17.087 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:17.087 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:17.087 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.087 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.087 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:17.087 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012227+0000", 2024-04-25T22:52:17.087 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.863e-06 2024-04-25T22:52:17.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.088 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.088 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:17.088 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012236+0000", 2024-04-25T22:52:17.088 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1109999999999997e-06 2024-04-25T22:52:17.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.088 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.088 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:17.088 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012309+0000", 2024-04-25T22:52:17.088 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3242000000000001e-05 2024-04-25T22:52:17.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.088 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.088 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:17.088 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012324+0000", 2024-04-25T22:52:17.089 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4837e-05 2024-04-25T22:52:17.089 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.089 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.089 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:17.089 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015060+0000", 2024-04-25T22:52:17.089 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027363349999999999 2024-04-25T22:52:17.089 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.089 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.089 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:17.089 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015169+0000", 2024-04-25T22:52:17.089 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108372 2024-04-25T22:52:17.089 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.089 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.089 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:17.090 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015498+0000", 2024-04-25T22:52:17.090 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032949999999999999 2024-04-25T22:52:17.090 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.090 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.090 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:17.090 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021282+0000", 2024-04-25T22:52:17.090 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057836429999999998 2024-04-25T22:52:17.090 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.090 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.090 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:17.090 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024709+0000", 2024-04-25T22:52:17.090 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034271979999999998 2024-04-25T22:52:17.090 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.091 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.091 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:17.091 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024802+0000", 2024-04-25T22:52:17.091 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2960000000000004e-05 2024-04-25T22:52:17.091 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.091 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.091 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:17.091 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024863+0000", 2024-04-25T22:52:17.091 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0643999999999997e-05 2024-04-25T22:52:17.091 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:17.091 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:17.091 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:17.091 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.092 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.092 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:17.092 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:17.092 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.053031027999999, 2024-04-25T22:52:17.092 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012979447999999999, 2024-04-25T22:52:17.092 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:17.092 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:17.092 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:17.092 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:17.092 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.092 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:17.092 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:17.092 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:17.092 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.093 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.093 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:17.093 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:17.093 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:17.093 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.093 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.093 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:17.093 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:17.093 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:52:17.093 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.093 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.093 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:17.093 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012354+0000", 2024-04-25T22:52:17.093 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7740000000000004e-06 2024-04-25T22:52:17.094 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.094 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.094 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:17.094 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012365+0000", 2024-04-25T22:52:17.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.064e-05 2024-04-25T22:52:17.094 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.094 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.094 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:17.094 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012382+0000", 2024-04-25T22:52:17.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6999000000000001e-05 2024-04-25T22:52:17.094 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.094 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.094 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:17.094 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015958+0000", 2024-04-25T22:52:17.095 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035765699999999998 2024-04-25T22:52:17.095 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.095 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.095 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:17.095 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016037+0000", 2024-04-25T22:52:17.095 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8242000000000001e-05 2024-04-25T22:52:17.095 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.095 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.095 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:17.095 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016404+0000", 2024-04-25T22:52:17.095 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036784300000000002 2024-04-25T22:52:17.095 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.095 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.095 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:17.096 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021294+0000", 2024-04-25T22:52:17.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048890629999999999 2024-04-25T22:52:17.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.096 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:17.096 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024959+0000", 2024-04-25T22:52:17.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036651570000000001 2024-04-25T22:52:17.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.096 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:17.096 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025097+0000", 2024-04-25T22:52:17.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013788099999999999 2024-04-25T22:52:17.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.097 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:17.097 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025328+0000", 2024-04-25T22:52:17.097 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231492 2024-04-25T22:52:17.097 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:17.097 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:17.097 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:17.097 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.097 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:17.097 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:17.097 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.052943258999999, 2024-04-25T22:52:17.097 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013049827, 2024-04-25T22:52:17.097 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:17.097 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:17.097 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:17.098 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:17.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.098 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:17.098 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:17.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:17.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.098 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:17.098 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:17.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:17.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.098 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:17.099 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012437+0000", 2024-04-25T22:52:17.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-04-25T22:52:17.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.099 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:17.099 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012440+0000", 2024-04-25T22:52:17.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7609999999999999e-06 2024-04-25T22:52:17.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.099 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:17.099 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012449+0000", 2024-04-25T22:52:17.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.285e-06 2024-04-25T22:52:17.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.100 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:17.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012457+0000", 2024-04-25T22:52:17.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9510000000000006e-06 2024-04-25T22:52:17.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.100 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:17.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017106+0000", 2024-04-25T22:52:17.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046494220000000003 2024-04-25T22:52:17.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.100 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:17.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017223+0000", 2024-04-25T22:52:17.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116824 2024-04-25T22:52:17.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:17.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017345+0000", 2024-04-25T22:52:17.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122175 2024-04-25T22:52:17.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:17.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021299+0000", 2024-04-25T22:52:17.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039534879999999998 2024-04-25T22:52:17.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:17.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025398+0000", 2024-04-25T22:52:17.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040988960000000003 2024-04-25T22:52:17.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:17.102 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025439+0000", 2024-04-25T22:52:17.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0915999999999999e-05 2024-04-25T22:52:17.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:17.102 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025486+0000", 2024-04-25T22:52:17.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7534999999999998e-05 2024-04-25T22:52:17.102 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:17.102 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:17.102 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:17.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.103 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:17.103 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:17.103 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.052913107999998, 2024-04-25T22:52:17.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020988041999999998, 2024-04-25T22:52:17.103 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:17.105 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:17.105 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:17.105 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:17.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:17.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:17.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:17.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:17.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:17.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:17.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:17.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:17.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.99e-07 2024-04-25T22:52:17.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:17.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012470+0000", 2024-04-25T22:52:17.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2789999999999999e-06 2024-04-25T22:52:17.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:17.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012477+0000", 2024-04-25T22:52:17.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:52:17.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:17.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012500+0000", 2024-04-25T22:52:17.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2490999999999999e-05 2024-04-25T22:52:17.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.108 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:17.108 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021911+0000", 2024-04-25T22:52:17.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094114160000000006 2024-04-25T22:52:17.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.108 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:17.108 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022000+0000", 2024-04-25T22:52:17.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8601000000000001e-05 2024-04-25T22:52:17.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.108 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:17.108 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022359+0000", 2024-04-25T22:52:17.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035921999999999999 2024-04-25T22:52:17.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:17.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025541+0000", 2024-04-25T22:52:17.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031820619999999998 2024-04-25T22:52:17.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:17.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033375+0000", 2024-04-25T22:52:17.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078338379999999992 2024-04-25T22:52:17.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:17.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033415+0000", 2024-04-25T22:52:17.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9527000000000003e-05 2024-04-25T22:52:17.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:17.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033455+0000", 2024-04-25T22:52:17.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9932000000000003e-05 2024-04-25T22:52:17.110 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:17.110 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:17.110 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:17.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.110 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:17.110 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:17.110 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.052857915000001, 2024-04-25T22:52:17.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021043857999999999, 2024-04-25T22:52:17.111 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:17.111 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:17.111 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:17.111 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:17.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.111 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:17.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:17.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:17.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.111 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:17.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:17.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:17.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:17.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012523+0000", 2024-04-25T22:52:17.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.361e-06 2024-04-25T22:52:17.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:17.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012530+0000", 2024-04-25T22:52:17.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5440000000000004e-06 2024-04-25T22:52:17.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:17.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012541+0000", 2024-04-25T22:52:17.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1745e-05 2024-04-25T22:52:17.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.113 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:17.113 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012551+0000", 2024-04-25T22:52:17.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5789999999999993e-06 2024-04-25T22:52:17.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.113 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:17.113 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022709+0000", 2024-04-25T22:52:17.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010157685 2024-04-25T22:52:17.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.113 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:17.113 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022957+0000", 2024-04-25T22:52:17.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024824599999999998 2024-04-25T22:52:17.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:17.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023443+0000", 2024-04-25T22:52:17.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048578599999999999 2024-04-25T22:52:17.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:17.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025547+0000", 2024-04-25T22:52:17.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021044789999999998 2024-04-25T22:52:17.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:17.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033509+0000", 2024-04-25T22:52:17.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0079622180000000001 2024-04-25T22:52:17.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:17.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033542+0000", 2024-04-25T22:52:17.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3018000000000001e-05 2024-04-25T22:52:17.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:17.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033566+0000", 2024-04-25T22:52:17.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3197000000000002e-05 2024-04-25T22:52:17.115 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:17.116 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:17.116 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:17.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.116 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:17.116 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:17.116 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.052817950000001, 2024-04-25T22:52:17.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021122696, 2024-04-25T22:52:17.116 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:17.116 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:17.116 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:17.116 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:17.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:17.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:17.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:17.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.117 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:17.117 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:17.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:17.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.117 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:17.117 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:17.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:52:17.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.117 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:17.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012566+0000", 2024-04-25T22:52:17.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-04-25T22:52:17.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:17.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012619+0000", 2024-04-25T22:52:17.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2607e-05 2024-04-25T22:52:17.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:17.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012628+0000", 2024-04-25T22:52:17.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6500000000000008e-06 2024-04-25T22:52:17.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:17.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024024+0000", 2024-04-25T22:52:17.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011396007999999999 2024-04-25T22:52:17.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:17.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024198+0000", 2024-04-25T22:52:17.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000173215 2024-04-25T22:52:17.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:17.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024447+0000", 2024-04-25T22:52:17.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024898500000000002 2024-04-25T22:52:17.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:17.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026431+0000", 2024-04-25T22:52:17.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001984923 2024-04-25T22:52:17.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:17.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033608+0000", 2024-04-25T22:52:17.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071768459999999997 2024-04-25T22:52:17.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:17.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033646+0000", 2024-04-25T22:52:17.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299000000000003e-05 2024-04-25T22:52:17.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:17.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033684+0000", 2024-04-25T22:52:17.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8773000000000003e-05 2024-04-25T22:52:17.121 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:17.121 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:17.121 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:17.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.121 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:17.121 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:17.121 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.052729351, 2024-04-25T22:52:17.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021175381, 2024-04-25T22:52:17.121 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:17.121 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:17.122 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:17.122 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:17.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:17.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:17.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:17.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:17.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:17.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:17.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:17.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012651+0000", 2024-04-25T22:52:17.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:52:17.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:17.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012656+0000", 2024-04-25T22:52:17.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8899999999999998e-06 2024-04-25T22:52:17.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:17.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012666+0000", 2024-04-25T22:52:17.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0346999999999999e-05 2024-04-25T22:52:17.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:17.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012675+0000", 2024-04-25T22:52:17.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9930000000000001e-06 2024-04-25T22:52:17.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:17.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025661+0000", 2024-04-25T22:52:17.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01298531 2024-04-25T22:52:17.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:17.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025757+0000", 2024-04-25T22:52:17.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5822000000000005e-05 2024-04-25T22:52:17.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:17.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025907+0000", 2024-04-25T22:52:17.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015051499999999999 2024-04-25T22:52:17.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:17.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026435+0000", 2024-04-25T22:52:17.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052762200000000005 2024-04-25T22:52:17.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:17.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033732+0000", 2024-04-25T22:52:17.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072978419999999997 2024-04-25T22:52:17.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:17.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033787+0000", 2024-04-25T22:52:17.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4703999999999997e-05 2024-04-25T22:52:17.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:17.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033826+0000", 2024-04-25T22:52:17.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8458999999999999e-05 2024-04-25T22:52:17.126 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:17.126 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:17.126 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:17.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.127 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:17.127 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:17.127 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.052673937000002, 2024-04-25T22:52:17.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021244174000000001, 2024-04-25T22:52:17.127 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:17.127 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:17.127 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:17.127 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:17.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:17.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:17.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:17.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:17.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:17.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:17.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:17.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:17.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:52:17.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:17.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012712+0000", 2024-04-25T22:52:17.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.913e-06 2024-04-25T22:52:17.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:17.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012722+0000", 2024-04-25T22:52:17.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2879999999999998e-06 2024-04-25T22:52:17.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:17.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012727+0000", 2024-04-25T22:52:17.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8429999999999998e-06 2024-04-25T22:52:17.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:17.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026099+0000", 2024-04-25T22:52:17.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013371450999999999 2024-04-25T22:52:17.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:17.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026147+0000", 2024-04-25T22:52:17.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7837999999999998e-05 2024-04-25T22:52:17.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:17.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026254+0000", 2024-04-25T22:52:17.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107314 2024-04-25T22:52:17.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:17.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026686+0000", 2024-04-25T22:52:17.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000432428 2024-04-25T22:52:17.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:17.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033873+0000", 2024-04-25T22:52:17.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071864399999999997 2024-04-25T22:52:17.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:17.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033904+0000", 2024-04-25T22:52:17.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1321e-05 2024-04-25T22:52:17.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:17.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033950+0000", 2024-04-25T22:52:17.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5707999999999997e-05 2024-04-25T22:52:17.132 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:17.132 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:17.132 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:17.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.132 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:17.132 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:17.132 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.052643551999999, 2024-04-25T22:52:17.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01096505, 2024-04-25T22:52:17.132 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:17.132 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:17.132 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:17.132 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:17.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:17.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:17.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:17.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:17.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:17.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:17.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:17.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012737+0000", 2024-04-25T22:52:17.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:52:17.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:17.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012739+0000", 2024-04-25T22:52:17.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-04-25T22:52:17.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:17.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012743+0000", 2024-04-25T22:52:17.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3239999999999996e-06 2024-04-25T22:52:17.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:17.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012746+0000", 2024-04-25T22:52:17.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.129e-06 2024-04-25T22:52:17.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:17.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012796+0000", 2024-04-25T22:52:17.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9231999999999999e-05 2024-04-25T22:52:17.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:17.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012915+0000", 2024-04-25T22:52:17.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119021 2024-04-25T22:52:17.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:17.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013069+0000", 2024-04-25T22:52:17.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015463900000000001 2024-04-25T22:52:17.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:17.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019237+0000", 2024-04-25T22:52:17.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061680329999999998 2024-04-25T22:52:17.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:17.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023603+0000", 2024-04-25T22:52:17.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043655860000000003 2024-04-25T22:52:17.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:17.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023659+0000", 2024-04-25T22:52:17.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6484000000000003e-05 2024-04-25T22:52:17.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:17.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023701+0000", 2024-04-25T22:52:17.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1761999999999998e-05 2024-04-25T22:52:17.137 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:17.137 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:17.137 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:17.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.137 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:17.137 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:17.137 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.052618603999999, 2024-04-25T22:52:17.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011234429000000001, 2024-04-25T22:52:17.138 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:17.138 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:17.138 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:17.138 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:17.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:17.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:17.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:17.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:17.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:17.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:17.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.139 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:17.139 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012762+0000", 2024-04-25T22:52:17.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-04-25T22:52:17.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.139 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:17.139 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012765+0000", 2024-04-25T22:52:17.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2569999999999999e-06 2024-04-25T22:52:17.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.139 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:17.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012783+0000", 2024-04-25T22:52:17.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8431999999999999e-05 2024-04-25T22:52:17.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:17.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012799+0000", 2024-04-25T22:52:17.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5438999999999999e-05 2024-04-25T22:52:17.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:17.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013826+0000", 2024-04-25T22:52:17.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010275060000000001 2024-04-25T22:52:17.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:17.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013913+0000", 2024-04-25T22:52:17.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.708e-05 2024-04-25T22:52:17.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:17.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014098+0000", 2024-04-25T22:52:17.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018519399999999999 2024-04-25T22:52:17.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:17.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019684+0000", 2024-04-25T22:52:17.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055860079999999999 2024-04-25T22:52:17.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:17.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023876+0000", 2024-04-25T22:52:17.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041918800000000003 2024-04-25T22:52:17.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:17.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023957+0000", 2024-04-25T22:52:17.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1165e-05 2024-04-25T22:52:17.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:17.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023995+0000", 2024-04-25T22:52:17.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:52:17.143 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:17.143 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:17.143 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:17.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.143 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:17.143 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:17.143 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.052520824999998, 2024-04-25T22:52:17.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011131200000000001, 2024-04-25T22:52:17.143 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:17.143 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:17.143 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:17.143 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:17.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.143 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:17.144 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:17.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:17.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.144 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:17.144 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:17.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:17.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.144 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:17.144 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012860+0000", 2024-04-25T22:52:17.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3900000000000004e-07 2024-04-25T22:52:17.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:17.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012865+0000", 2024-04-25T22:52:17.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5609999999999998e-06 2024-04-25T22:52:17.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:17.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012895+0000", 2024-04-25T22:52:17.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9847000000000001e-05 2024-04-25T22:52:17.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:17.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012905+0000", 2024-04-25T22:52:17.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.03e-05 2024-04-25T22:52:17.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:17.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015020+0000", 2024-04-25T22:52:17.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021142940000000001 2024-04-25T22:52:17.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:17.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015182+0000", 2024-04-25T22:52:17.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016248099999999999 2024-04-25T22:52:17.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:52:17.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015357+0000", 2024-04-25T22:52:17.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017471000000000001 2024-04-25T22:52:17.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:17.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021021+0000", 2024-04-25T22:52:17.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056638340000000004 2024-04-25T22:52:17.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:17.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023712+0000", 2024-04-25T22:52:17.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026910380000000002 2024-04-25T22:52:17.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:17.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023763+0000", 2024-04-25T22:52:17.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1477999999999997e-05 2024-04-25T22:52:17.148 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.148 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:17.148 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023990+0000", 2024-04-25T22:52:17.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000226818 2024-04-25T22:52:17.148 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:17.148 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:17.148 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:17.148 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.148 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:17.148 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:17.148 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.052397728999999, 2024-04-25T22:52:17.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011705299000000001, 2024-04-25T22:52:17.149 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:17.149 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:17.149 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:17.149 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:17.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:17.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:17.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:17.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:17.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:17.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:17.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:17.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012983+0000", 2024-04-25T22:52:17.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:52:17.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:17.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012986+0000", 2024-04-25T22:52:17.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5700000000000001e-06 2024-04-25T22:52:17.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:17.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012993+0000", 2024-04-25T22:52:17.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8730000000000001e-06 2024-04-25T22:52:17.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:17.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013000+0000", 2024-04-25T22:52:17.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1890000000000001e-06 2024-04-25T22:52:17.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:17.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:52:17.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002147866 2024-04-25T22:52:17.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:17.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015351+0000", 2024-04-25T22:52:17.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020300799999999999 2024-04-25T22:52:17.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:17.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016260+0000", 2024-04-25T22:52:17.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00090926799999999997 2024-04-25T22:52:17.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:17.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022669+0000", 2024-04-25T22:52:17.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064082849999999997 2024-04-25T22:52:17.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:17.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024584+0000", 2024-04-25T22:52:17.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019151699999999999 2024-04-25T22:52:17.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:17.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024643+0000", 2024-04-25T22:52:17.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8888999999999998e-05 2024-04-25T22:52:17.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:17.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024687+0000", 2024-04-25T22:52:17.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4444999999999999e-05 2024-04-25T22:52:17.153 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:17.154 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:17.154 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:17.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.154 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:17.154 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:17.154 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.052370138000001, 2024-04-25T22:52:17.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011249699, 2024-04-25T22:52:17.154 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:17.154 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:17.154 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:17.154 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:17.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:17.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:17.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:17.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:17.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:17.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:17.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:17.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013010+0000", 2024-04-25T22:52:17.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2099999999999996e-07 2024-04-25T22:52:17.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:17.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013013+0000", 2024-04-25T22:52:17.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1310000000000002e-06 2024-04-25T22:52:17.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:17.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013020+0000", 2024-04-25T22:52:17.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3330000000000002e-06 2024-04-25T22:52:17.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:17.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013025+0000", 2024-04-25T22:52:17.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6760000000000004e-06 2024-04-25T22:52:17.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:17.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013163+0000", 2024-04-25T22:52:17.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013824599999999999 2024-04-25T22:52:17.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:17.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013504+0000", 2024-04-25T22:52:17.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034080299999999998 2024-04-25T22:52:17.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:17.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013613+0000", 2024-04-25T22:52:17.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108705 2024-04-25T22:52:17.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:17.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015831+0000", 2024-04-25T22:52:17.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002217672 2024-04-25T22:52:17.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:17.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024137+0000", 2024-04-25T22:52:17.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0083060489999999994 2024-04-25T22:52:17.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:17.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024218+0000", 2024-04-25T22:52:17.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1351000000000001e-05 2024-04-25T22:52:17.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:17.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024259+0000", 2024-04-25T22:52:17.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1112000000000002e-05 2024-04-25T22:52:17.159 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:17.159 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:17.159 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:17.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.159 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:17.159 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:17.159 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.052282412, 2024-04-25T22:52:17.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020379749999999999, 2024-04-25T22:52:17.160 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:17.160 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:17.160 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:17.160 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:17.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:17.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:17.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:17.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:17.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:17.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:17.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:17.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013098+0000", 2024-04-25T22:52:17.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:52:17.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:17.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013105+0000", 2024-04-25T22:52:17.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5969999999999997e-06 2024-04-25T22:52:17.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:17.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013190+0000", 2024-04-25T22:52:17.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5618999999999995e-05 2024-04-25T22:52:17.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:17.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013200+0000", 2024-04-25T22:52:17.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5859999999999994e-06 2024-04-25T22:52:17.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:17.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020265+0000", 2024-04-25T22:52:17.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070653349999999998 2024-04-25T22:52:17.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:17.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020454+0000", 2024-04-25T22:52:17.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189316 2024-04-25T22:52:17.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:17.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020586+0000", 2024-04-25T22:52:17.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013195700000000001 2024-04-25T22:52:17.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:17.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023822+0000", 2024-04-25T22:52:17.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032358529999999999 2024-04-25T22:52:17.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:17.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033409+0000", 2024-04-25T22:52:17.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095870520000000004 2024-04-25T22:52:17.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:17.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033447+0000", 2024-04-25T22:52:17.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7261999999999997e-05 2024-04-25T22:52:17.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:17.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033477+0000", 2024-04-25T22:52:17.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0389e-05 2024-04-25T22:52:17.164 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:17.165 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:17.165 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:17.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.165 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:17.165 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:17.165 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.052165905999999, 2024-04-25T22:52:17.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010857383999999999, 2024-04-25T22:52:17.165 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:17.165 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:17.165 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:17.165 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:17.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:17.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:17.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:17.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:17.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:17.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:17.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:17.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:17.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:52:17.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:17.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013218+0000", 2024-04-25T22:52:17.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8199999999999998e-06 2024-04-25T22:52:17.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:17.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013226+0000", 2024-04-25T22:52:17.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7649999999999993e-06 2024-04-25T22:52:17.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:17.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013259+0000", 2024-04-25T22:52:17.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2727e-05 2024-04-25T22:52:17.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:17.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014809+0000", 2024-04-25T22:52:17.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001550144 2024-04-25T22:52:17.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:17.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014958+0000", 2024-04-25T22:52:17.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014890300000000001 2024-04-25T22:52:17.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:52:17.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015087+0000", 2024-04-25T22:52:17.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012939200000000001 2024-04-25T22:52:17.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:17.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020212+0000", 2024-04-25T22:52:17.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051248939999999996 2024-04-25T22:52:17.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:17.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023699+0000", 2024-04-25T22:52:17.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034873289999999999 2024-04-25T22:52:17.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:17.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024014+0000", 2024-04-25T22:52:17.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031473999999999999 2024-04-25T22:52:17.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:17.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024071+0000", 2024-04-25T22:52:17.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7040000000000003e-05 2024-04-25T22:52:17.170 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:17.170 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:17.170 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:17.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.170 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:17.171 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:17.171 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.052111200999999, 2024-04-25T22:52:17.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012329677000000001, 2024-04-25T22:52:17.171 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:17.171 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:17.171 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:17.171 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:17.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:17.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:17.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:17.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:17.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:17.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:17.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:17.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013269+0000", 2024-04-25T22:52:17.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5000000000000002e-07 2024-04-25T22:52:17.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:17.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:52:17.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6909999999999999e-06 2024-04-25T22:52:17.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:17.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013284+0000", 2024-04-25T22:52:17.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0963e-05 2024-04-25T22:52:17.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:17.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013361+0000", 2024-04-25T22:52:17.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7379999999999994e-05 2024-04-25T22:52:17.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:17.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013448+0000", 2024-04-25T22:52:17.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6990000000000006e-05 2024-04-25T22:52:17.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:17.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013632+0000", 2024-04-25T22:52:17.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018396800000000001 2024-04-25T22:52:17.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:17.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013800+0000", 2024-04-25T22:52:17.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167467 2024-04-25T22:52:17.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:17.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.018570+0000", 2024-04-25T22:52:17.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047701460000000003 2024-04-25T22:52:17.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:17.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025507+0000", 2024-04-25T22:52:17.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069372039999999998 2024-04-25T22:52:17.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:17.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025562+0000", 2024-04-25T22:52:17.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4858999999999998e-05 2024-04-25T22:52:17.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:17.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025598+0000", 2024-04-25T22:52:17.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6259e-05 2024-04-25T22:52:17.176 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:17.176 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:17.176 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:17.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.176 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:17.176 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:17.176 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.051979328000002, 2024-04-25T22:52:17.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020176666999999999, 2024-04-25T22:52:17.176 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:17.176 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:17.176 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:52:17.176 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:17.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:17.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:17.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:17.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:17.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:17.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:17.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:17.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:52:17.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-04-25T22:52:17.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:17.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013405+0000", 2024-04-25T22:52:17.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0559999999999998e-06 2024-04-25T22:52:17.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:17.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013422+0000", 2024-04-25T22:52:17.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6770999999999999e-05 2024-04-25T22:52:17.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:17.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013431+0000", 2024-04-25T22:52:17.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5019999999999998e-06 2024-04-25T22:52:17.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:17.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021720+0000", 2024-04-25T22:52:17.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082884340000000008 2024-04-25T22:52:17.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:17.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022122+0000", 2024-04-25T22:52:17.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000401634 2024-04-25T22:52:17.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:17.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:17.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:17.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033577+0000", 2024-04-25T22:52:17.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011455435999999999 2024-04-25T22:52:17.180 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:17.180 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:17.180 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:17.180 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:17.180 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:17.180 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:17.180 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-25T22:52:17.182 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:17.182+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:17.183 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:52:17.283 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:17.282+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:17.295 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-25T22:52:17.296 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-25T22:52:17.296 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-25T22:52:17.296 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-25T22:52:17.305 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:52:17.384 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:17.383+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:17.407 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-25T22:52:17.408 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-25T22:52:17.408 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-25T22:52:17.408 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-25T22:52:17.408 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-25T22:52:17.416 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:52:17.485 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:17.484+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:17.561 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-25T22:52:17.561 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-25T22:52:17.561 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-25T22:52:17.561 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-25T22:52:17.561 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.561 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(mds.0.3:28 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:52:17.561 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.013845+0000", 2024-04-25T22:52:17.562 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 24.545370853000001, 2024-04-25T22:52:17.562 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002002658, 2024-04-25T22:52:17.562 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:17.562 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:17.562 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:17.562 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:17.562 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.562 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:17.562 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013845+0000", 2024-04-25T22:52:17.562 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:17.562 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.562 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.563 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:17.563 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013845+0000", 2024-04-25T22:52:17.563 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:17.563 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.563 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.563 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:17.563 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013845+0000", 2024-04-25T22:52:17.563 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6100000000000002e-07 2024-04-25T22:52:17.563 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.563 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.564 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:17.564 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013859+0000", 2024-04-25T22:52:17.564 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4045e-05 2024-04-25T22:52:17.564 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.564 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.564 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:17.564 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013883+0000", 2024-04-25T22:52:17.564 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4020999999999999e-05 2024-04-25T22:52:17.564 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.564 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.564 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:17.564 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013904+0000", 2024-04-25T22:52:17.564 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.084e-05 2024-04-25T22:52:17.565 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.565 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.565 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:17.565 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013953+0000", 2024-04-25T22:52:17.565 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8652000000000001e-05 2024-04-25T22:52:17.565 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.565 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.565 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:17.565 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013983+0000", 2024-04-25T22:52:17.565 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0083e-05 2024-04-25T22:52:17.565 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.565 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.565 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:17.565 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015809+0000", 2024-04-25T22:52:17.566 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001826708 2024-04-25T22:52:17.566 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.566 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.566 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:17.566 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015848+0000", 2024-04-25T22:52:17.566 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8047999999999999e-05 2024-04-25T22:52:17.566 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:17.566 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:17.566 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:17.566 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.566 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.566 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:17.566 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.014834+0000", 2024-04-25T22:52:17.567 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 24.544381258000001, 2024-04-25T22:52:17.567 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0082660119999999997, 2024-04-25T22:52:17.567 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:17.567 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:17.567 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:17.567 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:17.567 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.567 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:17.567 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014834+0000", 2024-04-25T22:52:17.567 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:17.567 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.567 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.567 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:17.568 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014834+0000", 2024-04-25T22:52:17.568 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:17.568 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.568 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.568 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:17.568 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014837+0000", 2024-04-25T22:52:17.568 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.774e-06 2024-04-25T22:52:17.568 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.568 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.568 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:17.568 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014844+0000", 2024-04-25T22:52:17.568 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.1629999999999999e-06 2024-04-25T22:52:17.568 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.568 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.569 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:17.569 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014853+0000", 2024-04-25T22:52:17.569 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0829999999999993e-06 2024-04-25T22:52:17.569 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.569 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.569 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:17.569 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014862+0000", 2024-04-25T22:52:17.569 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0239999999999997e-06 2024-04-25T22:52:17.569 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.569 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.569 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:17.569 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014926+0000", 2024-04-25T22:52:17.569 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4571000000000002e-05 2024-04-25T22:52:17.570 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.570 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.570 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:17.570 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015064+0000", 2024-04-25T22:52:17.570 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013788200000000001 2024-04-25T22:52:17.570 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.570 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.570 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:17.570 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015240+0000", 2024-04-25T22:52:17.570 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000175697 2024-04-25T22:52:17.570 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.570 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.570 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:17.570 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017382+0000", 2024-04-25T22:52:17.571 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021422920000000001 2024-04-25T22:52:17.571 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.571 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.571 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:17.571 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023016+0000", 2024-04-25T22:52:17.571 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00563446 2024-04-25T22:52:17.571 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.571 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.571 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:17.571 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023062+0000", 2024-04-25T22:52:17.571 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5667999999999997e-05 2024-04-25T22:52:17.571 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.571 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.571 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:17.572 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023100+0000", 2024-04-25T22:52:17.572 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8398000000000001e-05 2024-04-25T22:52:17.572 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:17.572 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:17.572 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:17.572 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.572 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.572 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:17.572 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.014883+0000", 2024-04-25T22:52:17.572 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 24.544333040000001, 2024-04-25T22:52:17.572 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0083115319999999999, 2024-04-25T22:52:17.572 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:17.572 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:17.572 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:17.573 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:17.573 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.573 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:17.573 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014883+0000", 2024-04-25T22:52:17.573 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:17.573 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.573 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.573 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:17.573 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014883+0000", 2024-04-25T22:52:17.573 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:17.573 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.573 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.573 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:17.574 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014883+0000", 2024-04-25T22:52:17.574 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1200000000000003e-07 2024-04-25T22:52:17.574 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.574 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.574 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:17.574 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014887+0000", 2024-04-25T22:52:17.574 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4249999999999998e-06 2024-04-25T22:52:17.574 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.574 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.574 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:17.574 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014892+0000", 2024-04-25T22:52:17.574 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1150000000000002e-06 2024-04-25T22:52:17.574 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.575 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.575 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:17.575 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014896+0000", 2024-04-25T22:52:17.575 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3030000000000001e-06 2024-04-25T22:52:17.575 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.575 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.575 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:17.575 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015597+0000", 2024-04-25T22:52:17.575 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00070106400000000005 2024-04-25T22:52:17.575 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.575 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.575 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:17.575 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015681+0000", 2024-04-25T22:52:17.576 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.3417000000000004e-05 2024-04-25T22:52:17.576 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.576 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.576 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:17.576 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015800+0000", 2024-04-25T22:52:17.576 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000119522 2024-04-25T22:52:17.576 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.576 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.576 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:17.576 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017389+0000", 2024-04-25T22:52:17.576 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0015889739999999999 2024-04-25T22:52:17.576 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.576 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.576 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:17.577 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023129+0000", 2024-04-25T22:52:17.577 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0057398420000000002 2024-04-25T22:52:17.577 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.577 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.577 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:17.577 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023161+0000", 2024-04-25T22:52:17.577 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2002999999999998e-05 2024-04-25T22:52:17.577 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.577 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.577 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:17.577 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023194+0000", 2024-04-25T22:52:17.577 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3355000000000002e-05 2024-04-25T22:52:17.577 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:17.578 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:17.578 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:17.578 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.578 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.578 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:17.578 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.014902+0000", 2024-04-25T22:52:17.578 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 24.544313395, 2024-04-25T22:52:17.578 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0078159460000000007, 2024-04-25T22:52:17.578 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:17.578 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:17.578 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:17.578 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:17.578 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.578 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:17.579 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014902+0000", 2024-04-25T22:52:17.579 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:17.579 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.579 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.579 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:17.579 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014902+0000", 2024-04-25T22:52:17.579 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:17.579 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.579 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.579 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:17.579 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014903+0000", 2024-04-25T22:52:17.579 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.65e-07 2024-04-25T22:52:17.579 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.580 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.580 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:17.580 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014910+0000", 2024-04-25T22:52:17.580 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7619999999999995e-06 2024-04-25T22:52:17.580 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.580 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.580 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:17.580 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014915+0000", 2024-04-25T22:52:17.580 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2660000000000003e-06 2024-04-25T22:52:17.580 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.580 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.580 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:17.580 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014918+0000", 2024-04-25T22:52:17.580 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.331e-06 2024-04-25T22:52:17.581 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.581 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.581 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:17.581 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015554+0000", 2024-04-25T22:52:17.581 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00063627599999999996 2024-04-25T22:52:17.581 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.581 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.581 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:17.581 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015685+0000", 2024-04-25T22:52:17.581 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013059399999999999 2024-04-25T22:52:17.581 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.581 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.581 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:17.581 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015820+0000", 2024-04-25T22:52:17.582 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013471499999999999 2024-04-25T22:52:17.582 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.582 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.582 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:17.582 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017394+0000", 2024-04-25T22:52:17.582 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0015747459999999999 2024-04-25T22:52:17.582 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.582 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.582 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:17.582 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022598+0000", 2024-04-25T22:52:17.582 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.005203811 2024-04-25T22:52:17.582 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.582 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.583 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:17.583 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022671+0000", 2024-04-25T22:52:17.583 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3042999999999998e-05 2024-04-25T22:52:17.583 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.583 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.583 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:17.583 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022718+0000", 2024-04-25T22:52:17.583 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7136999999999999e-05 2024-04-25T22:52:17.583 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:17.583 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:17.583 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:17.583 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.583 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.583 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:17.584 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.014933+0000", 2024-04-25T22:52:17.584 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 24.544283020999998, 2024-04-25T22:52:17.584 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079271519999999998, 2024-04-25T22:52:17.584 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:17.584 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:17.584 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:17.584 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:17.584 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.584 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:17.584 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014933+0000", 2024-04-25T22:52:17.584 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:17.584 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.584 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.585 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:17.585 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014933+0000", 2024-04-25T22:52:17.585 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:17.585 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.585 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.585 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:17.585 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014933+0000", 2024-04-25T22:52:17.585 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0999999999999999e-07 2024-04-25T22:52:17.585 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.585 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.585 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:17.585 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014937+0000", 2024-04-25T22:52:17.585 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6090000000000001e-06 2024-04-25T22:52:17.585 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.586 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.586 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:17.586 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014943+0000", 2024-04-25T22:52:17.586 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.7100000000000001e-06 2024-04-25T22:52:17.586 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.586 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.586 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:17.586 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014949+0000", 2024-04-25T22:52:17.586 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9410000000000004e-06 2024-04-25T22:52:17.586 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.586 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.586 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:17.586 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016135+0000", 2024-04-25T22:52:17.586 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0011854750000000001 2024-04-25T22:52:17.587 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.587 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.587 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:17.587 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016185+0000", 2024-04-25T22:52:17.587 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.9888000000000001e-05 2024-04-25T22:52:17.587 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.587 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.587 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:17.587 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016297+0000", 2024-04-25T22:52:17.587 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011231299999999999 2024-04-25T22:52:17.587 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.587 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.587 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:17.588 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017399+0000", 2024-04-25T22:52:17.588 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0011018149999999999 2024-04-25T22:52:17.588 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.588 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.588 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:17.588 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022764+0000", 2024-04-25T22:52:17.588 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0053649819999999999 2024-04-25T22:52:17.588 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.588 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.588 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:17.588 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022821+0000", 2024-04-25T22:52:17.588 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7655000000000003e-05 2024-04-25T22:52:17.588 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.589 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.589 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:17.589 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022860+0000", 2024-04-25T22:52:17.589 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8353999999999999e-05 2024-04-25T22:52:17.589 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:17.589 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:17.589 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:17.589 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.589 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.589 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:17.589 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.014957+0000", 2024-04-25T22:52:17.589 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 24.544259189999998, 2024-04-25T22:52:17.589 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0083856810000000007, 2024-04-25T22:52:17.589 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:17.590 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:17.590 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:17.590 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:17.590 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.590 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:17.590 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014957+0000", 2024-04-25T22:52:17.590 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:17.590 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.590 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.590 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:17.590 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014957+0000", 2024-04-25T22:52:17.590 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:17.590 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.591 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.591 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:17.591 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014957+0000", 2024-04-25T22:52:17.591 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:52:17.591 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.591 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.591 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:17.591 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014961+0000", 2024-04-25T22:52:17.591 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2309999999999998e-06 2024-04-25T22:52:17.591 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.591 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.591 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:17.591 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014969+0000", 2024-04-25T22:52:17.591 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2540000000000003e-06 2024-04-25T22:52:17.592 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.592 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.592 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:17.592 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014972+0000", 2024-04-25T22:52:17.592 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4580000000000002e-06 2024-04-25T22:52:17.592 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.592 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.592 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:17.592 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016130+0000", 2024-04-25T22:52:17.592 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001157812 2024-04-25T22:52:17.592 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.592 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.592 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:17.592 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016247+0000", 2024-04-25T22:52:17.593 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000117268 2024-04-25T22:52:17.593 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.593 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.593 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:17.593 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016381+0000", 2024-04-25T22:52:17.593 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013417999999999999 2024-04-25T22:52:17.593 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.593 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.593 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:17.593 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017946+0000", 2024-04-25T22:52:17.593 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001564817 2024-04-25T22:52:17.593 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.593 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.593 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:17.594 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023240+0000", 2024-04-25T22:52:17.594 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0052938289999999999 2024-04-25T22:52:17.594 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.594 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.594 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:17.594 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023295+0000", 2024-04-25T22:52:17.594 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4969999999999997e-05 2024-04-25T22:52:17.594 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.594 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.594 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:17.594 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023342+0000", 2024-04-25T22:52:17.594 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7126000000000002e-05 2024-04-25T22:52:17.594 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:17.594 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:17.595 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:17.595 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.595 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.595 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:17.595 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.014978+0000", 2024-04-25T22:52:17.595 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 24.544238071999999, 2024-04-25T22:52:17.595 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0074058609999999997, 2024-04-25T22:52:17.595 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:17.595 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:17.595 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:17.595 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:17.595 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.595 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:17.595 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014978+0000", 2024-04-25T22:52:17.596 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:17.596 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.596 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.596 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:17.596 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014978+0000", 2024-04-25T22:52:17.596 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:17.596 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.596 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.596 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:17.596 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014978+0000", 2024-04-25T22:52:17.596 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0600000000000001e-07 2024-04-25T22:52:17.596 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.596 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.596 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:17.597 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014980+0000", 2024-04-25T22:52:17.597 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3130000000000001e-06 2024-04-25T22:52:17.597 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.597 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.597 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:17.597 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014984+0000", 2024-04-25T22:52:17.597 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6689999999999999e-06 2024-04-25T22:52:17.597 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.597 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.597 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:17.597 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014987+0000", 2024-04-25T22:52:17.597 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0709999999999999e-06 2024-04-25T22:52:17.597 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.597 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.597 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:17.598 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015035+0000", 2024-04-25T22:52:17.598 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7737000000000001e-05 2024-04-25T22:52:17.598 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.598 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.598 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:17.598 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:52:17.598 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113053 2024-04-25T22:52:17.598 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.598 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.598 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:17.598 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015255+0000", 2024-04-25T22:52:17.598 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010735599999999999 2024-04-25T22:52:17.598 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.599 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.599 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:17.599 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016248+0000", 2024-04-25T22:52:17.599 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00099310200000000005 2024-04-25T22:52:17.599 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.599 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.599 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:17.599 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022282+0000", 2024-04-25T22:52:17.599 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060341769999999999 2024-04-25T22:52:17.599 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.599 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.599 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:17.599 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022341+0000", 2024-04-25T22:52:17.599 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8938999999999999e-05 2024-04-25T22:52:17.600 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.600 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.600 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:17.600 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022384+0000", 2024-04-25T22:52:17.600 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2138000000000002e-05 2024-04-25T22:52:17.600 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:17.600 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:17.600 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:17.600 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.600 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.600 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:17.601 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.014995+0000", 2024-04-25T22:52:17.601 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 24.544220329000002, 2024-04-25T22:52:17.601 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075678170000000001, 2024-04-25T22:52:17.601 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:17.601 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:17.601 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-25T22:52:17.601 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:17.601 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.601 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:17.601 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014995+0000", 2024-04-25T22:52:17.601 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:17.601 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.601 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.601 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:17.602 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014995+0000", 2024-04-25T22:52:17.602 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:17.602 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.602 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.602 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:17.602 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014996+0000", 2024-04-25T22:52:17.602 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7500000000000001e-07 2024-04-25T22:52:17.602 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.602 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.602 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:17.602 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014998+0000", 2024-04-25T22:52:17.602 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2330000000000001e-06 2024-04-25T22:52:17.602 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.602 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.603 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:17.603 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015002+0000", 2024-04-25T22:52:17.603 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9570000000000004e-06 2024-04-25T22:52:17.603 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.603 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.603 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:17.603 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015008+0000", 2024-04-25T22:52:17.603 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0340000000000002e-06 2024-04-25T22:52:17.603 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.603 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.603 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:17.603 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015476+0000", 2024-04-25T22:52:17.603 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00046806899999999999 2024-04-25T22:52:17.603 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.604 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.604 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:17.604 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015565+0000", 2024-04-25T22:52:17.604 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.9126e-05 2024-04-25T22:52:17.604 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.604 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.604 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:17.604 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022563+0000", 2024-04-25T22:52:17.604 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0069981230000000002 2024-04-25T22:52:17.604 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:17.604 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:17.604 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:17.604 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.604 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.605 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:17.605 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.015033+0000", 2024-04-25T22:52:17.605 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 24.544182275000001, 2024-04-25T22:52:17.605 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010204922999999999, 2024-04-25T22:52:17.605 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:17.605 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:17.605 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-25T22:52:17.605 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:17.605 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.605 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:17.605 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015033+0000", 2024-04-25T22:52:17.605 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:17.605 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.605 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.606 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:17.606 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015033+0000", 2024-04-25T22:52:17.606 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:17.606 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.606 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.606 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:17.606 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015036+0000", 2024-04-25T22:52:17.606 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9110000000000002e-06 2024-04-25T22:52:17.606 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.606 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.606 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:17.606 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015040+0000", 2024-04-25T22:52:17.606 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0570000000000003e-06 2024-04-25T22:52:17.606 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.607 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.607 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:17.607 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015050+0000", 2024-04-25T22:52:17.607 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1449999999999997e-06 2024-04-25T22:52:17.607 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.607 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.607 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:17.607 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015058+0000", 2024-04-25T22:52:17.607 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.3960000000000006e-06 2024-04-25T22:52:17.607 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.607 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.607 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:17.607 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016951+0000", 2024-04-25T22:52:17.607 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0018930150000000001 2024-04-25T22:52:17.608 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.608 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.608 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:17.608 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017101+0000", 2024-04-25T22:52:17.608 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00015004800000000001 2024-04-25T22:52:17.608 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.608 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.608 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:17.608 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.025238+0000", 2024-04-25T22:52:17.608 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0081373509999999993 2024-04-25T22:52:17.608 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:17.608 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:17.608 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:17.608 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.609 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.609 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:17.609 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.015069+0000", 2024-04-25T22:52:17.609 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 24.544146341000001, 2024-04-25T22:52:17.609 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0066281769999999999, 2024-04-25T22:52:17.609 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:17.609 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:17.609 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-25T22:52:17.609 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:17.609 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.609 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:17.609 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015069+0000", 2024-04-25T22:52:17.609 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:17.609 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.610 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.610 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:17.610 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015069+0000", 2024-04-25T22:52:17.610 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:17.610 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.610 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.610 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:17.610 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015070+0000", 2024-04-25T22:52:17.610 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8899999999999999e-07 2024-04-25T22:52:17.610 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.610 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.610 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:17.610 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015082+0000", 2024-04-25T22:52:17.610 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.164e-05 2024-04-25T22:52:17.611 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.611 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.611 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:17.611 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015093+0000", 2024-04-25T22:52:17.611 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1066e-05 2024-04-25T22:52:17.611 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.611 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.611 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:17.611 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015099+0000", 2024-04-25T22:52:17.611 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8619999999999999e-06 2024-04-25T22:52:17.611 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.611 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.611 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:17.611 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:52:17.612 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.9821000000000003e-05 2024-04-25T22:52:17.612 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.612 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.612 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:17.612 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015221+0000", 2024-04-25T22:52:17.612 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2868999999999996e-05 2024-04-25T22:52:17.612 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.612 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.612 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:17.612 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021698+0000", 2024-04-25T22:52:17.612 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064762300000000004 2024-04-25T22:52:17.612 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:17.612 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:17.612 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:17.613 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.613 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.613 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:52:17.613 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.016597+0000", 2024-04-25T22:52:17.613 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 24.542618698999998, 2024-04-25T22:52:17.613 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001422113, 2024-04-25T22:52:17.613 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:17.613 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:17.613 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:17.613 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:17.613 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.613 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:17.613 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016597+0000", 2024-04-25T22:52:17.613 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:17.614 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.614 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.614 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:17.614 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016597+0000", 2024-04-25T22:52:17.614 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:17.614 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.614 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.614 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:17.614 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016598+0000", 2024-04-25T22:52:17.614 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2900000000000004e-07 2024-04-25T22:52:17.614 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.614 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.614 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:17.614 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016616+0000", 2024-04-25T22:52:17.615 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8876e-05 2024-04-25T22:52:17.615 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.615 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.615 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:17.615 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016626+0000", 2024-04-25T22:52:17.615 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.8900000000000002e-06 2024-04-25T22:52:17.615 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.615 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.615 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:17.615 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016634+0000", 2024-04-25T22:52:17.615 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7060000000000004e-06 2024-04-25T22:52:17.615 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.615 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.615 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:17.616 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016706+0000", 2024-04-25T22:52:17.616 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2102999999999997e-05 2024-04-25T22:52:17.616 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.616 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.616 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:17.616 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016727+0000", 2024-04-25T22:52:17.616 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0687e-05 2024-04-25T22:52:17.616 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.616 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.616 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:17.616 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017972+0000", 2024-04-25T22:52:17.616 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0012454829999999999 2024-04-25T22:52:17.616 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.616 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.617 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:17.617 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.018019+0000", 2024-04-25T22:52:17.618 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6839000000000003e-05 2024-04-25T22:52:17.618 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:17.618 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:17.618 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:17.619 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.619 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.619 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-25T22:52:17.619 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.016652+0000", 2024-04-25T22:52:17.619 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 24.542564084999999, 2024-04-25T22:52:17.619 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004473599, 2024-04-25T22:52:17.619 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:17.619 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:17.619 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:17.619 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:17.619 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.620 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:17.620 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016652+0000", 2024-04-25T22:52:17.620 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:17.620 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.620 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.620 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:17.620 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016652+0000", 2024-04-25T22:52:17.620 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:17.620 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.620 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.620 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:17.621 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016652+0000", 2024-04-25T22:52:17.621 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1899999999999998e-07 2024-04-25T22:52:17.621 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.621 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.621 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:17.621 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016657+0000", 2024-04-25T22:52:17.621 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4680000000000003e-06 2024-04-25T22:52:17.621 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.621 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.621 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:17.621 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016664+0000", 2024-04-25T22:52:17.622 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8210000000000002e-06 2024-04-25T22:52:17.622 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.622 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.622 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:17.622 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016669+0000", 2024-04-25T22:52:17.622 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8520000000000003e-06 2024-04-25T22:52:17.622 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.622 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.622 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:17.622 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016779+0000", 2024-04-25T22:52:17.622 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000109444 2024-04-25T22:52:17.622 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.623 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.623 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:17.623 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016798+0000", 2024-04-25T22:52:17.623 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9799000000000001e-05 2024-04-25T22:52:17.623 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.623 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.623 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:17.623 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021086+0000", 2024-04-25T22:52:17.623 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042879889999999999 2024-04-25T22:52:17.623 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.623 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.623 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:17.624 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021125+0000", 2024-04-25T22:52:17.624 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8807000000000003e-05 2024-04-25T22:52:17.624 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:17.624 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:17.624 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:17.624 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.624 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.624 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-25T22:52:17.624 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.016733+0000", 2024-04-25T22:52:17.624 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 24.542483185999998, 2024-04-25T22:52:17.624 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004231612, 2024-04-25T22:52:17.624 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:17.625 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:17.625 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:17.625 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:17.625 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.625 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:17.625 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016733+0000", 2024-04-25T22:52:17.625 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:17.625 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.625 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.625 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:17.625 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016733+0000", 2024-04-25T22:52:17.625 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:17.625 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.626 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.626 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:17.626 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016733+0000", 2024-04-25T22:52:17.626 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2100000000000002e-07 2024-04-25T22:52:17.626 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.626 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.626 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:17.626 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016756+0000", 2024-04-25T22:52:17.626 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2886000000000001e-05 2024-04-25T22:52:17.626 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.626 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.626 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:17.627 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016765+0000", 2024-04-25T22:52:17.627 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.3610000000000007e-06 2024-04-25T22:52:17.627 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.627 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.627 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:17.627 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016771+0000", 2024-04-25T22:52:17.627 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0020000000000003e-06 2024-04-25T22:52:17.627 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.627 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.627 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:17.627 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017050+0000", 2024-04-25T22:52:17.627 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00027877199999999999 2024-04-25T22:52:17.628 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.628 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.628 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:17.628 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017067+0000", 2024-04-25T22:52:17.628 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7499e-05 2024-04-25T22:52:17.628 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.628 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.628 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:17.628 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.020921+0000", 2024-04-25T22:52:17.628 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003853123 2024-04-25T22:52:17.628 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.628 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.629 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:17.629 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.020964+0000", 2024-04-25T22:52:17.629 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3547999999999997e-05 2024-04-25T22:52:17.629 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:17.629 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:17.629 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:17.629 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.629 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.629 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 1 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:52:17.629 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.019562+0000", 2024-04-25T22:52:17.629 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 24.539654142, 2024-04-25T22:52:17.630 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0045866930000000002, 2024-04-25T22:52:17.630 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:17.630 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:17.630 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "reached pg", 2024-04-25T22:52:17.630 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:17.630 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.630 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:17.630 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.019562+0000", 2024-04-25T22:52:17.630 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:17.630 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.630 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.630 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:17.631 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.019562+0000", 2024-04-25T22:52:17.631 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:17.631 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.631 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.631 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:17.631 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.019562+0000", 2024-04-25T22:52:17.631 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0100000000000005e-07 2024-04-25T22:52:17.631 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.631 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.631 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:17.631 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.019570+0000", 2024-04-25T22:52:17.631 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5599999999999996e-06 2024-04-25T22:52:17.632 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.632 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.632 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:17.632 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.019586+0000", 2024-04-25T22:52:17.632 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6086000000000002e-05 2024-04-25T22:52:17.632 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.632 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.632 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:17.632 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.019600+0000", 2024-04-25T22:52:17.632 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3934000000000001e-05 2024-04-25T22:52:17.632 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.632 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.633 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:17.633 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.019889+0000", 2024-04-25T22:52:17.633 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00028888200000000002 2024-04-25T22:52:17.633 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.633 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.633 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:17.633 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.024148+0000", 2024-04-25T22:52:17.633 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042597299999999998 2024-04-25T22:52:17.633 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:17.633 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:17.633 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:17.633 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.633 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.634 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-25T22:52:17.634 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.021542+0000", 2024-04-25T22:52:17.634 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 24.537673888, 2024-04-25T22:52:17.634 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001339589, 2024-04-25T22:52:17.634 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:17.634 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:17.634 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-25T22:52:17.634 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:17.634 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.634 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:17.634 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021542+0000", 2024-04-25T22:52:17.634 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:17.635 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.635 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.635 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:17.635 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021542+0000", 2024-04-25T22:52:17.635 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:17.635 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.635 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.635 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:17.635 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021542+0000", 2024-04-25T22:52:17.635 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1600000000000002e-07 2024-04-25T22:52:17.635 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.635 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.636 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:17.636 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021545+0000", 2024-04-25T22:52:17.636 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.774e-06 2024-04-25T22:52:17.636 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.636 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.636 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:17.636 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021553+0000", 2024-04-25T22:52:17.636 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.2099999999999993e-06 2024-04-25T22:52:17.636 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.636 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.636 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:17.636 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021559+0000", 2024-04-25T22:52:17.636 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.1249999999999998e-06 2024-04-25T22:52:17.637 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.637 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.637 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:17.637 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022752+0000", 2024-04-25T22:52:17.637 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0011931120000000001 2024-04-25T22:52:17.637 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.637 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.637 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:17.638 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022759+0000", 2024-04-25T22:52:17.638 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4420000000000003e-06 2024-04-25T22:52:17.638 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.638 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.638 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:17.638 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022881+0000", 2024-04-25T22:52:17.638 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012250999999999999 2024-04-25T22:52:17.638 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:17.638 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:17.638 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:17.638 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.639 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.639 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e14/12 ondisk, result = 0)", 2024-04-25T22:52:17.639 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.021769+0000", 2024-04-25T22:52:17.639 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 24.537446624000001, 2024-04-25T22:52:17.639 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001336928, 2024-04-25T22:52:17.639 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:17.639 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:17.639 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-25T22:52:17.639 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:17.639 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.639 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:17.639 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021769+0000", 2024-04-25T22:52:17.640 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:17.640 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.640 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.640 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:17.640 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021769+0000", 2024-04-25T22:52:17.640 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:17.640 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.640 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.640 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:17.640 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021770+0000", 2024-04-25T22:52:17.640 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7700000000000005e-07 2024-04-25T22:52:17.640 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.641 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.641 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:17.641 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021773+0000", 2024-04-25T22:52:17.641 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5250000000000001e-06 2024-04-25T22:52:17.641 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.641 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.641 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:17.641 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021780+0000", 2024-04-25T22:52:17.641 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.187e-06 2024-04-25T22:52:17.641 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.641 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.641 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:17.641 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021796+0000", 2024-04-25T22:52:17.642 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5218000000000001e-05 2024-04-25T22:52:17.642 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.642 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.642 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:17.642 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023001+0000", 2024-04-25T22:52:17.642 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001205993 2024-04-25T22:52:17.642 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.642 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.642 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:17.642 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023009+0000", 2024-04-25T22:52:17.642 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9249999999999995e-06 2024-04-25T22:52:17.643 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.643 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.643 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:17.643 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023106+0000", 2024-04-25T22:52:17.643 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6602999999999996e-05 2024-04-25T22:52:17.643 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:17.643 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:17.643 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:17.643 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.643 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.643 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-25T22:52:17.643 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.021807+0000", 2024-04-25T22:52:17.643 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 24.537408233000001, 2024-04-25T22:52:17.644 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0013936809999999999, 2024-04-25T22:52:17.644 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:17.644 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:17.644 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-25T22:52:17.644 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:17.644 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.644 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:17.644 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021807+0000", 2024-04-25T22:52:17.644 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:17.644 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.644 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.644 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:17.645 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021807+0000", 2024-04-25T22:52:17.645 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:17.645 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.645 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.645 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:17.645 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021808+0000", 2024-04-25T22:52:17.645 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3200000000000001e-07 2024-04-25T22:52:17.645 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.645 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.645 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:17.645 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021811+0000", 2024-04-25T22:52:17.645 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5480000000000002e-06 2024-04-25T22:52:17.645 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.646 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.646 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:17.646 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021818+0000", 2024-04-25T22:52:17.646 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4450000000000001e-06 2024-04-25T22:52:17.646 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.646 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.646 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:17.646 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021823+0000", 2024-04-25T22:52:17.646 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.22e-06 2024-04-25T22:52:17.646 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.646 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.646 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:17.647 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023122+0000", 2024-04-25T22:52:17.647 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001298808 2024-04-25T22:52:17.647 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.647 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.647 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:17.647 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023126+0000", 2024-04-25T22:52:17.647 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9400000000000004e-06 2024-04-25T22:52:17.647 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.647 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.647 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:17.647 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023201+0000", 2024-04-25T22:52:17.647 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5388000000000004e-05 2024-04-25T22:52:17.648 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:17.648 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:17.648 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:17.648 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.648 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.648 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-25T22:52:17.648 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.022040+0000", 2024-04-25T22:52:17.648 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 24.537175820000002, 2024-04-25T22:52:17.648 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0013084100000000001, 2024-04-25T22:52:17.648 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:17.649 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:17.649 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-25T22:52:17.649 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:17.649 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.649 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:17.649 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022040+0000", 2024-04-25T22:52:17.649 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:17.649 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.649 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.649 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:17.649 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022040+0000", 2024-04-25T22:52:17.649 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:17.650 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.650 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.650 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:17.650 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022040+0000", 2024-04-25T22:52:17.650 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9999999999999999e-07 2024-04-25T22:52:17.650 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.650 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.650 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:17.650 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022043+0000", 2024-04-25T22:52:17.650 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.362e-06 2024-04-25T22:52:17.651 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.651 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.651 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:17.651 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022049+0000", 2024-04-25T22:52:17.651 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.947e-06 2024-04-25T22:52:17.651 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.651 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.651 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:17.651 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022055+0000", 2024-04-25T22:52:17.651 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.1909999999999997e-06 2024-04-25T22:52:17.651 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.651 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.651 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:17.652 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023227+0000", 2024-04-25T22:52:17.652 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0011720820000000001 2024-04-25T22:52:17.652 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.652 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.652 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:17.652 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023235+0000", 2024-04-25T22:52:17.652 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.2330000000000006e-06 2024-04-25T22:52:17.652 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.652 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.652 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:17.652 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023348+0000", 2024-04-25T22:52:17.653 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011329500000000001 2024-04-25T22:52:17.653 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:17.653 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:17.653 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:17.653 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.653 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.653 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-25T22:52:17.653 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:55.010264+0000", 2024-04-25T22:52:17.653 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 22.548952052000001, 2024-04-25T22:52:17.653 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001484476, 2024-04-25T22:52:17.653 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:17.653 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:17.654 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:17.654 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:17.654 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.654 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:17.654 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010264+0000", 2024-04-25T22:52:17.654 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:17.654 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.654 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.654 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:17.654 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010264+0000", 2024-04-25T22:52:17.654 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:17.655 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.655 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.655 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:17.655 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010265+0000", 2024-04-25T22:52:17.655 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5e-06 2024-04-25T22:52:17.655 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.655 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.655 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:17.655 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010272+0000", 2024-04-25T22:52:17.655 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0910000000000004e-06 2024-04-25T22:52:17.655 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.655 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.655 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:17.656 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010287+0000", 2024-04-25T22:52:17.656 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4644000000000001e-05 2024-04-25T22:52:17.656 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.656 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.656 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:17.656 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010296+0000", 2024-04-25T22:52:17.656 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2159999999999995e-06 2024-04-25T22:52:17.656 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.656 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.656 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:17.656 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010394+0000", 2024-04-25T22:52:17.656 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.8148999999999998e-05 2024-04-25T22:52:17.657 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.657 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.657 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:17.657 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010503+0000", 2024-04-25T22:52:17.657 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000108857 2024-04-25T22:52:17.657 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.657 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.657 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:17.657 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010592+0000", 2024-04-25T22:52:17.657 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.9083000000000001e-05 2024-04-25T22:52:17.657 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.657 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.658 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:17.658 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.011161+0000", 2024-04-25T22:52:17.658 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00056919800000000003 2024-04-25T22:52:17.658 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.658 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.658 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:17.658 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.011676+0000", 2024-04-25T22:52:17.658 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00051500999999999999 2024-04-25T22:52:17.658 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.658 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.658 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:17.659 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.011717+0000", 2024-04-25T22:52:17.659 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0262999999999997e-05 2024-04-25T22:52:17.659 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.659 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.659 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:17.659 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.011748+0000", 2024-04-25T22:52:17.659 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1464999999999998e-05 2024-04-25T22:52:17.659 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:17.659 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:17.659 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:17.659 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.659 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.660 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-25T22:52:17.660 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:52:17.012790+0000", 2024-04-25T22:52:17.660 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.54642620799999997, 2024-04-25T22:52:17.660 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001434444, 2024-04-25T22:52:17.660 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:17.660 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:17.660 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:17.660 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:17.660 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.660 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:17.660 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.012790+0000", 2024-04-25T22:52:17.661 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:17.661 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.661 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.661 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:17.661 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.012790+0000", 2024-04-25T22:52:17.661 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:17.661 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.661 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.661 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:17.661 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.012791+0000", 2024-04-25T22:52:17.661 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0699999999999999e-06 2024-04-25T22:52:17.661 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.662 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.662 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:17.662 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.012797+0000", 2024-04-25T22:52:17.662 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0519999999999998e-06 2024-04-25T22:52:17.662 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.662 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.662 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:17.662 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.012811+0000", 2024-04-25T22:52:17.662 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4287999999999999e-05 2024-04-25T22:52:17.662 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.662 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.662 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:17.663 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.012838+0000", 2024-04-25T22:52:17.663 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6727999999999999e-05 2024-04-25T22:52:17.663 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.663 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.663 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:17.663 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.012909+0000", 2024-04-25T22:52:17.663 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.1211000000000006e-05 2024-04-25T22:52:17.663 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.663 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.663 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:17.663 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.013015+0000", 2024-04-25T22:52:17.663 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010619 2024-04-25T22:52:17.663 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.664 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.664 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:17.664 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.013189+0000", 2024-04-25T22:52:17.664 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00017439199999999999 2024-04-25T22:52:17.664 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.664 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.664 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:17.664 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.013903+0000", 2024-04-25T22:52:17.664 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00071379099999999997 2024-04-25T22:52:17.664 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.664 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.664 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:17.665 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.014159+0000", 2024-04-25T22:52:17.665 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00025561699999999998 2024-04-25T22:52:17.665 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.665 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.665 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:17.665 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.014192+0000", 2024-04-25T22:52:17.665 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2941000000000002e-05 2024-04-25T22:52:17.665 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:17.665 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:17.665 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:17.665 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.014224+0000", 2024-04-25T22:52:17.666 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2163999999999999e-05 2024-04-25T22:52:17.666 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:17.666 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:17.666 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:17.666 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:17.666 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:17.666 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-25T22:52:17.668 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:52:17.668 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:17.667+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:17.768 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:17.768+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:17.781 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:17.781 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:52:17.781 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-25T22:52:17.782 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:17.791 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:52:17.869 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:17.868+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:17.893 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:17.894 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:52:17.894 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-25T22:52:17.894 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-25T22:52:17.894 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:17.902 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:52:17.970 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:17.969+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:18.007 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:18.007 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:52:18.007 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:52:18.007 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:52:18.007 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.008 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:52:18.008 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:52:18.008 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 30.038279452000001, 2024-04-25T22:52:18.008 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:52:18.008 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:18.008 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:18.008 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:18.008 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:18.008 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.008 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:18.008 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:52:18.008 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:18.009 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.009 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.009 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:18.009 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:52:18.009 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:18.009 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.009 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.009 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:18.009 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:52:18.009 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:52:18.009 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.009 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.009 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:18.009 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:52:18.010 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:52:18.010 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.010 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.010 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:18.010 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:52:18.010 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:52:18.010 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.010 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.010 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:18.010 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:52:18.010 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:52:18.010 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.010 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.011 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:18.011 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:52:18.011 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:52:18.011 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.011 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.011 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:18.011 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:52:18.011 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:52:18.011 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.011 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.011 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:18.011 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:52:18.012 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:52:18.012 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.012 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.012 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:18.012 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:52:18.012 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:52:18.012 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:18.012 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:18.012 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:18.012 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.012 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.012 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:110 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'72, mlcod=10'68)", 2024-04-25T22:52:18.012 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:18.012 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 30.037645452, 2024-04-25T22:52:18.013 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065316630000000001, 2024-04-25T22:52:18.013 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:18.013 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:18.013 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:18.013 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:18.013 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.013 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:18.013 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:18.013 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:18.013 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.013 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.013 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:18.013 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:18.013 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:18.014 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.014 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.014 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:18.014 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:18.014 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.58e-07 2024-04-25T22:52:18.014 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.014 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.014 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:18.014 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967811+0000", 2024-04-25T22:52:18.014 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.118e-06 2024-04-25T22:52:18.014 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.014 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.014 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:18.015 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967817+0000", 2024-04-25T22:52:18.015 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3709999999999996e-06 2024-04-25T22:52:18.015 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.015 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.015 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:18.015 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967820+0000", 2024-04-25T22:52:18.015 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2210000000000002e-06 2024-04-25T22:52:18.015 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.015 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.015 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:18.015 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967876+0000", 2024-04-25T22:52:18.015 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5507000000000002e-05 2024-04-25T22:52:18.015 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.015 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.016 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:18.016 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967893+0000", 2024-04-25T22:52:18.016 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7812000000000002e-05 2024-04-25T22:52:18.016 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.016 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.016 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:18.016 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974317+0000", 2024-04-25T22:52:18.016 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064237160000000003 2024-04-25T22:52:18.016 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.016 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.016 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:18.016 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:52:18.016 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.156e-05 2024-04-25T22:52:18.017 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:18.017 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:18.017 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:18.017 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.017 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.017 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'68)", 2024-04-25T22:52:18.017 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:18.017 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 30.037227939000001, 2024-04-25T22:52:18.017 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061292279999999996, 2024-04-25T22:52:18.017 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:18.017 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:18.017 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:18.017 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:18.018 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.018 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:18.018 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:18.018 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:18.018 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.018 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.018 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:18.018 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:18.018 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:18.018 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.018 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.018 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:18.018 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:18.018 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6300000000000001e-07 2024-04-25T22:52:18.019 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.019 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.019 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:18.019 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968228+0000", 2024-04-25T22:52:18.019 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6139999999999999e-06 2024-04-25T22:52:18.019 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.019 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.019 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:18.019 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968235+0000", 2024-04-25T22:52:18.019 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7020000000000001e-06 2024-04-25T22:52:18.019 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.019 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.019 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:18.020 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968238+0000", 2024-04-25T22:52:18.020 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0010000000000002e-06 2024-04-25T22:52:18.020 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.020 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.020 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:18.020 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968297+0000", 2024-04-25T22:52:18.020 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8424999999999997e-05 2024-04-25T22:52:18.020 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.020 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.020 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:18.020 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968316+0000", 2024-04-25T22:52:18.020 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8814999999999999e-05 2024-04-25T22:52:18.020 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.021 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.021 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:18.021 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:52:18.021 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060239439999999998 2024-04-25T22:52:18.021 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.021 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.021 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:18.021 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974354+0000", 2024-04-25T22:52:18.021 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4364e-05 2024-04-25T22:52:18.021 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:18.021 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:18.021 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:18.021 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.021 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.022 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'68)", 2024-04-25T22:52:18.022 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:18.022 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 30.036790936999999, 2024-04-25T22:52:18.022 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005948414, 2024-04-25T22:52:18.022 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:18.022 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:18.022 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:18.022 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:18.022 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.022 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:18.022 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:18.022 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:18.023 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.023 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.023 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:18.023 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:18.023 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:18.023 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.023 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.023 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:18.023 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:18.023 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6199999999999998e-07 2024-04-25T22:52:18.023 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.024 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.024 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:18.024 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968723+0000", 2024-04-25T22:52:18.024 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1148999999999993e-05 2024-04-25T22:52:18.024 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.024 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.024 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:18.024 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968730+0000", 2024-04-25T22:52:18.024 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1749999999999999e-06 2024-04-25T22:52:18.024 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.024 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.024 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:18.024 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968734+0000", 2024-04-25T22:52:18.025 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5200000000000002e-06 2024-04-25T22:52:18.025 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.025 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.025 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:18.025 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968771+0000", 2024-04-25T22:52:18.025 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6851999999999999e-05 2024-04-25T22:52:18.025 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.025 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.025 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:18.025 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968788+0000", 2024-04-25T22:52:18.025 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7027000000000001e-05 2024-04-25T22:52:18.025 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.025 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.025 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:18.026 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974589+0000", 2024-04-25T22:52:18.026 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058013320000000002 2024-04-25T22:52:18.026 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.026 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.026 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:18.026 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974610+0000", 2024-04-25T22:52:18.026 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0897e-05 2024-04-25T22:52:18.026 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:18.026 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:18.026 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:18.026 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.026 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.026 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'68)", 2024-04-25T22:52:18.027 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:18.027 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 30.036220926999999, 2024-04-25T22:52:18.027 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053935750000000003, 2024-04-25T22:52:18.027 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:18.027 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:18.027 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:18.027 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:18.027 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.027 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:18.027 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:18.027 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:18.027 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.027 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.028 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:18.028 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:18.028 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:18.028 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.028 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.028 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:18.028 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:18.028 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.03e-07 2024-04-25T22:52:18.028 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.028 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.028 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:18.028 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969235+0000", 2024-04-25T22:52:18.028 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2399999999999999e-06 2024-04-25T22:52:18.028 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.029 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.029 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:18.029 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969242+0000", 2024-04-25T22:52:18.029 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1269999999999997e-06 2024-04-25T22:52:18.029 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.029 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.029 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:18.029 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969246+0000", 2024-04-25T22:52:18.035 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3840000000000001e-06 2024-04-25T22:52:18.035 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.035 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.035 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:18.035 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969278+0000", 2024-04-25T22:52:18.035 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1868e-05 2024-04-25T22:52:18.035 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.035 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.035 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:18.036 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969295+0000", 2024-04-25T22:52:18.036 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7530999999999999e-05 2024-04-25T22:52:18.036 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.036 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.036 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:18.036 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974611+0000", 2024-04-25T22:52:18.036 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053160789999999996 2024-04-25T22:52:18.036 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.036 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.036 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:18.036 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974625+0000", 2024-04-25T22:52:18.036 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3943e-05 2024-04-25T22:52:18.036 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:18.036 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:18.037 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:18.037 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.037 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.037 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-25T22:52:18.037 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:18.037 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 29.842625019, 2024-04-25T22:52:18.037 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054952610000000004, 2024-04-25T22:52:18.037 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:18.037 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:18.037 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:18.037 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:18.037 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.037 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:18.037 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:18.037 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:18.038 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.038 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.038 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:18.038 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:18.038 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:18.038 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.038 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.038 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:18.038 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:18.038 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.68e-07 2024-04-25T22:52:18.038 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.038 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.038 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:18.038 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162898+0000", 2024-04-25T22:52:18.039 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9470999999999999e-05 2024-04-25T22:52:18.039 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.039 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.039 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:18.040 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162906+0000", 2024-04-25T22:52:18.040 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1580000000000005e-06 2024-04-25T22:52:18.040 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.040 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.040 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:18.040 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162911+0000", 2024-04-25T22:52:18.040 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4779999999999999e-06 2024-04-25T22:52:18.040 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.040 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.040 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:18.040 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162952+0000", 2024-04-25T22:52:18.040 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0629e-05 2024-04-25T22:52:18.040 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.041 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.041 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:18.041 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162968+0000", 2024-04-25T22:52:18.041 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6239000000000002e-05 2024-04-25T22:52:18.041 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.041 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.041 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:18.041 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168281+0000", 2024-04-25T22:52:18.041 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053132869999999999 2024-04-25T22:52:18.041 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.041 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.041 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:18.041 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168323+0000", 2024-04-25T22:52:18.041 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1430999999999997e-05 2024-04-25T22:52:18.042 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:18.042 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:18.042 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:18.042 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.042 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.042 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-04-25T22:52:18.042 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:18.042 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 29.412147656999998, 2024-04-25T22:52:18.042 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050872510000000001, 2024-04-25T22:52:18.042 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:18.042 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:18.042 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:18.042 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:18.043 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.043 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:18.043 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:18.043 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:18.043 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.043 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.043 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:18.043 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:18.043 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:18.043 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.043 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.043 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:18.043 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:18.044 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.72e-07 2024-04-25T22:52:18.044 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.044 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.044 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:18.044 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593381+0000", 2024-04-25T22:52:18.044 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5797000000000006e-05 2024-04-25T22:52:18.044 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.044 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.044 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:18.044 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593389+0000", 2024-04-25T22:52:18.044 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8480000000000001e-06 2024-04-25T22:52:18.044 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.044 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.044 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:18.045 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593393+0000", 2024-04-25T22:52:18.045 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4819999999999996e-06 2024-04-25T22:52:18.045 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.045 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.045 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:18.045 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593435+0000", 2024-04-25T22:52:18.045 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1600000000000002e-05 2024-04-25T22:52:18.045 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.045 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.045 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:18.045 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593454+0000", 2024-04-25T22:52:18.045 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8868e-05 2024-04-25T22:52:18.045 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.045 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.046 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:18.046 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598350+0000", 2024-04-25T22:52:18.046 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004895763 2024-04-25T22:52:18.046 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.046 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.046 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:18.046 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598392+0000", 2024-04-25T22:52:18.046 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2521000000000002e-05 2024-04-25T22:52:18.046 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:18.047 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:18.047 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:18.047 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.047 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.047 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:18.047 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:52:18.047 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 24.993783752999999, 2024-04-25T22:52:18.047 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:52:18.047 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:18.047 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:18.047 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:18.047 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:18.047 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.048 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:18.048 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:52:18.048 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:18.048 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.048 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.048 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:18.048 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:52:18.048 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:18.048 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.048 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.048 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:18.048 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:52:18.048 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:52:18.048 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.049 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.049 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:18.049 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:52:18.049 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:52:18.049 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.049 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.049 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:18.049 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:52:18.049 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:52:18.049 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.049 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.049 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:18.050 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:52:18.050 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:52:18.050 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.050 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.050 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:18.050 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:52:18.050 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:52:18.050 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.050 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.050 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:18.050 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:52:18.050 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:52:18.050 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.051 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.051 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:18.051 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:52:18.051 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:52:18.051 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.051 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.051 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:18.051 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:52:18.051 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:52:18.051 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.051 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.051 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:18.051 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:52:18.051 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:52:18.052 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.052 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.052 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:18.052 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:52:18.052 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:52:18.052 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.052 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.052 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:18.052 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:52:18.052 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:52:18.052 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:18.052 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:18.052 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:18.052 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.053 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.053 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:18.053 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:52:18.053 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 24.993109377, 2024-04-25T22:52:18.053 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:52:18.053 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:18.053 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:18.053 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:18.053 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:18.053 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.053 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:18.053 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:52:18.053 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:18.053 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.053 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.054 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:18.054 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:52:18.054 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:18.054 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.054 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.054 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:18.054 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:52:18.054 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:52:18.054 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.054 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.054 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:18.054 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:52:18.054 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:52:18.055 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.055 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.055 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:18.055 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:52:18.055 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:52:18.055 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.055 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.055 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:18.055 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:52:18.055 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:52:18.055 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.055 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.055 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:18.056 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:52:18.056 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:52:18.056 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.056 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.056 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:18.056 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:52:18.056 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:52:18.056 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.056 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.056 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:18.056 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:52:18.056 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:52:18.057 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.057 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.057 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:18.057 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:52:18.057 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:52:18.057 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.057 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.057 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:18.057 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:52:18.057 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:52:18.057 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.057 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.057 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:18.057 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:52:18.058 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:52:18.058 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.058 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.058 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:18.058 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:52:18.058 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:52:18.058 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:18.058 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:18.058 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:18.058 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.058 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.058 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:18.058 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:52:18.059 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 24.992600164999999, 2024-04-25T22:52:18.059 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:52:18.059 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:18.059 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:18.059 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:18.059 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:18.059 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.059 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:18.059 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:52:18.059 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:18.059 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.059 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.059 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:18.059 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:52:18.060 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:18.060 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.060 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.060 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:18.060 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:52:18.060 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:52:18.060 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.060 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.060 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:18.060 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:52:18.060 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:52:18.060 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.060 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.061 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:18.061 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:52:18.061 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:52:18.061 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.061 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.061 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:18.061 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:52:18.061 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:52:18.061 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.061 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.061 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:18.061 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:52:18.061 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:52:18.061 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.061 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.062 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:18.062 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:52:18.062 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:52:18.062 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.062 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.062 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:18.062 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:52:18.062 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:52:18.062 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.062 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.062 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:18.062 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:52:18.062 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:52:18.063 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.063 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.063 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:18.063 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:52:18.063 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:52:18.063 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.063 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.063 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:18.063 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:52:18.063 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:52:18.063 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.063 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.063 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:18.063 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:52:18.064 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:52:18.064 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:18.064 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:18.064 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:18.064 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.064 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.064 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:18.064 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:18.064 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 24.992186966999999, 2024-04-25T22:52:18.064 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:52:18.064 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:18.064 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:18.064 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:18.065 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:18.065 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.065 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:18.065 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:18.065 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:18.065 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.065 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.065 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:18.065 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:18.065 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:18.065 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.065 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.065 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:18.065 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:18.066 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:52:18.066 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.066 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.066 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:18.066 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:52:18.066 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:52:18.066 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.066 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.066 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:18.066 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:52:18.066 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:52:18.066 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.066 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.067 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:18.067 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:52:18.067 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:52:18.067 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.067 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.067 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:18.067 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:52:18.067 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:52:18.067 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.067 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.067 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:18.067 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:52:18.067 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:52:18.067 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.068 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.068 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:18.068 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:52:18.068 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:52:18.068 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.068 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.068 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:18.068 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:52:18.068 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:52:18.068 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.068 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.068 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:18.068 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:52:18.068 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:52:18.069 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.069 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.069 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:18.069 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:52:18.069 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:52:18.069 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.069 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.069 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:18.069 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:52:18.069 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:52:18.069 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:18.069 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:18.069 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:18.069 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.070 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.070 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:18.070 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:52:18.070 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 24.992136296999998, 2024-04-25T22:52:18.070 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:52:18.070 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:18.070 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:18.070 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:18.070 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:18.070 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.070 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:18.070 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:52:18.070 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:18.071 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.071 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.071 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:18.071 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:52:18.071 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:18.071 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.071 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.071 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:18.071 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:52:18.071 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:52:18.071 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.071 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.071 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:18.071 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:52:18.072 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:52:18.072 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.072 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.072 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:18.072 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:52:18.072 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:52:18.072 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.072 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.072 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:18.072 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:52:18.073 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:52:18.073 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.073 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.073 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:18.073 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:52:18.073 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:52:18.073 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.073 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.073 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:52:18.073 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:52:18.073 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:52:18.073 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.073 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.073 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:18.074 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:52:18.074 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:52:18.074 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.074 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.074 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:18.074 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:52:18.074 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:52:18.074 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.074 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.074 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:18.074 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:52:18.074 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:52:18.075 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.075 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.075 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:18.075 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:52:18.075 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:52:18.075 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.075 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.075 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:18.075 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:52:18.075 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:52:18.075 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.075 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.075 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:18.075 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:52:18.076 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:52:18.076 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.076 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.076 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:18.076 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:52:18.076 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:52:18.076 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:18.076 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:18.076 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:18.076 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.076 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.076 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:18.076 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:52:18.076 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 24.992099428, 2024-04-25T22:52:18.077 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:52:18.077 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:18.077 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:18.077 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:18.077 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:18.077 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.077 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:18.077 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:52:18.077 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:18.077 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.077 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.078 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:18.078 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:52:18.078 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:18.078 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.078 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.078 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:18.078 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:52:18.078 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:52:18.078 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.078 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.078 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:18.078 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:52:18.079 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:52:18.079 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.079 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.079 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:18.079 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:52:18.079 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:52:18.079 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.079 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.079 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:18.079 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:52:18.079 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:52:18.079 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.079 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.079 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:18.080 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:52:18.080 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:52:18.080 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.080 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.080 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:52:18.080 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:52:18.080 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:52:18.080 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.080 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.080 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:18.081 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:52:18.081 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:52:18.081 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.081 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.081 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:18.081 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:52:18.081 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:52:18.081 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.081 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.081 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:18.081 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:52:18.081 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:52:18.081 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.081 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.082 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:18.082 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:52:18.082 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:52:18.082 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.082 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.082 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:18.082 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:52:18.082 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:52:18.082 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.082 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.082 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:18.082 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:52:18.082 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:52:18.083 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.083 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.083 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:18.083 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:52:18.083 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:52:18.083 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:18.083 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:18.083 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:18.083 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.083 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.083 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:18.083 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:52:18.083 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 24.992074462000001, 2024-04-25T22:52:18.083 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:52:18.084 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:18.084 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:18.084 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:18.084 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:18.084 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.084 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:18.084 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:52:18.084 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:18.084 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.084 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.084 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:18.084 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:52:18.084 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:18.084 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.085 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.085 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:18.085 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:52:18.085 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:52:18.085 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.085 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.085 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:18.085 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:52:18.085 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:52:18.085 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.085 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.085 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:18.085 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:52:18.085 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:52:18.086 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.086 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.086 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:18.086 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:52:18.086 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:52:18.086 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.086 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.086 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:18.087 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:52:18.087 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:52:18.087 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.087 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.087 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:18.087 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:52:18.087 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:52:18.087 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.087 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.087 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:18.087 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:52:18.088 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:52:18.088 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.088 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.088 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:18.088 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:52:18.088 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:52:18.088 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.088 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.088 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:18.088 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:52:18.088 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:52:18.088 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.088 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.089 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:18.089 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:52:18.089 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:52:18.089 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.089 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.089 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:18.089 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:52:18.089 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:52:18.089 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:18.089 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:18.089 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:18.089 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.089 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.090 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:18.090 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:52:18.090 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 24.992038097999998, 2024-04-25T22:52:18.090 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:52:18.090 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:18.090 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:18.090 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:52:18.090 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:18.090 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.090 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:18.090 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:52:18.090 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:18.090 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.091 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.091 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:18.091 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:52:18.091 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:18.091 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.091 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.091 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:18.091 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:52:18.091 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:52:18.091 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.091 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.091 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:18.091 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:52:18.092 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:52:18.092 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.092 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.092 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:18.092 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:52:18.092 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:52:18.092 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.092 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.092 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:18.092 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:52:18.092 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:52:18.092 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.092 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.092 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:18.093 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:52:18.093 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:52:18.093 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.093 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.093 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:52:18.093 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:52:18.093 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:52:18.093 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.093 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.093 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:18.093 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:52:18.093 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:52:18.093 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.094 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.094 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:18.094 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:52:18.094 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:52:18.094 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.094 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.094 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:18.094 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:52:18.094 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:52:18.094 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:18.094 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:18.094 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:18.094 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.095 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.095 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:18.095 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:18.095 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 24.992007016999999, 2024-04-25T22:52:18.095 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:52:18.095 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:18.095 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:18.095 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:52:18.095 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:18.095 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.095 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:18.095 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:18.095 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:18.095 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.096 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.096 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:18.096 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:18.096 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:18.096 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.096 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.096 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:18.096 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:18.096 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:52:18.096 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.096 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.096 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:18.096 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:52:18.096 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:52:18.097 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.097 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.097 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:18.097 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:52:18.097 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:52:18.097 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.097 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.097 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:18.097 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:52:18.097 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:52:18.097 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.097 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.097 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:18.097 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:52:18.098 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:52:18.098 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.098 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.098 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:18.098 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:52:18.098 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:52:18.098 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.098 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.098 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:18.098 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:52:18.098 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:52:18.098 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:18.098 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:18.099 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:18.099 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.099 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.099 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:52:18.099 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:18.099 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 24.991566047999999, 2024-04-25T22:52:18.099 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064881979999999997, 2024-04-25T22:52:18.099 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:18.099 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:18.099 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:18.099 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:18.099 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.099 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:18.099 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:18.100 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:18.100 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.100 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.100 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:18.100 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:18.100 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:18.100 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.100 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.100 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:18.100 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:18.100 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2699999999999999e-07 2024-04-25T22:52:18.100 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.100 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.100 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:18.100 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013898+0000", 2024-04-25T22:52:18.101 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0796e-05 2024-04-25T22:52:18.101 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.101 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.101 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:18.101 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013907+0000", 2024-04-25T22:52:18.101 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5140000000000007e-06 2024-04-25T22:52:18.101 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.101 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.101 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:18.101 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013952+0000", 2024-04-25T22:52:18.101 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4134000000000001e-05 2024-04-25T22:52:18.101 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.101 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.101 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:18.102 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016812+0000", 2024-04-25T22:52:18.102 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028601059999999998 2024-04-25T22:52:18.102 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.102 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.102 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:18.102 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.017052+0000", 2024-04-25T22:52:18.102 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024056500000000001 2024-04-25T22:52:18.102 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.102 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.102 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:18.102 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020350+0000", 2024-04-25T22:52:18.102 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032978320000000001 2024-04-25T22:52:18.103 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.103 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.103 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:18.103 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020375+0000", 2024-04-25T22:52:18.103 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4624e-05 2024-04-25T22:52:18.103 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:18.103 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:18.103 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:18.103 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.103 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.103 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-25T22:52:18.103 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:18.103 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 24.978035601999999, 2024-04-25T22:52:18.103 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058583000000000003, 2024-04-25T22:52:18.104 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:18.104 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:18.104 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:18.104 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:18.104 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.104 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:18.104 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:18.104 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:18.104 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.104 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.104 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:18.104 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:18.104 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:18.104 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.105 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.105 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:18.105 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:18.105 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.41e-07 2024-04-25T22:52:18.105 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.105 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.105 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:18.105 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027428+0000", 2024-04-25T22:52:18.105 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.075e-05 2024-04-25T22:52:18.105 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.105 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.105 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:18.105 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027435+0000", 2024-04-25T22:52:18.105 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3610000000000003e-06 2024-04-25T22:52:18.106 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.106 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.106 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:18.106 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027442+0000", 2024-04-25T22:52:18.106 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0400000000000004e-06 2024-04-25T22:52:18.106 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.106 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.106 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:18.106 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028094+0000", 2024-04-25T22:52:18.106 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00065134800000000005 2024-04-25T22:52:18.106 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.106 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.106 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:18.106 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028107+0000", 2024-04-25T22:52:18.107 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3087e-05 2024-04-25T22:52:18.107 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.107 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.107 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:18.107 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033239+0000", 2024-04-25T22:52:18.107 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051319429999999999 2024-04-25T22:52:18.107 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.107 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.107 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:18.107 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033275+0000", 2024-04-25T22:52:18.107 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6430000000000002e-05 2024-04-25T22:52:18.107 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:18.107 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:18.107 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:18.108 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.108 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.108 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-25T22:52:18.108 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:18.108 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 24.977650765, 2024-04-25T22:52:18.108 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005413597, 2024-04-25T22:52:18.108 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:18.108 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:18.108 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:18.108 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:18.108 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.109 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:18.109 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:18.109 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:18.109 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.109 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.109 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:18.109 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:18.109 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:18.109 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.109 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.109 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:18.109 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:18.109 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3799999999999997e-07 2024-04-25T22:52:18.109 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.110 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.110 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:18.110 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027816+0000", 2024-04-25T22:52:18.110 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3230999999999999e-05 2024-04-25T22:52:18.110 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.110 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.110 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:18.110 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027823+0000", 2024-04-25T22:52:18.110 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9039999999999992e-06 2024-04-25T22:52:18.110 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.110 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.110 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:18.110 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027841+0000", 2024-04-25T22:52:18.110 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7651000000000001e-05 2024-04-25T22:52:18.111 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.111 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.111 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:18.111 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027904+0000", 2024-04-25T22:52:18.111 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3058000000000005e-05 2024-04-25T22:52:18.111 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.111 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.111 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:18.111 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027926+0000", 2024-04-25T22:52:18.111 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1450999999999998e-05 2024-04-25T22:52:18.111 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.111 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.111 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:18.111 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033177+0000", 2024-04-25T22:52:18.112 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052508909999999997 2024-04-25T22:52:18.112 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.112 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.112 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:18.112 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033215+0000", 2024-04-25T22:52:18.112 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8872999999999999e-05 2024-04-25T22:52:18.112 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:18.112 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:18.112 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:18.112 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.112 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.112 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 171 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:52:18.112 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:18.112 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 24.977593663, 2024-04-25T22:52:18.113 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054322240000000003, 2024-04-25T22:52:18.113 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:18.113 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:18.113 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "reached pg", 2024-04-25T22:52:18.113 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:18.113 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.113 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:18.113 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:18.113 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:18.113 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.113 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.113 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:18.113 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:18.113 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:18.114 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.114 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.114 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:18.114 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:18.114 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7500000000000001e-07 2024-04-25T22:52:18.114 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.114 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.114 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:18.114 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027868+0000", 2024-04-25T22:52:18.114 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5750000000000001e-06 2024-04-25T22:52:18.114 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.114 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.114 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:18.115 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027885+0000", 2024-04-25T22:52:18.115 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7272e-05 2024-04-25T22:52:18.115 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.115 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.115 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:18.115 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027900+0000", 2024-04-25T22:52:18.115 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.502e-05 2024-04-25T22:52:18.115 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.115 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.115 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:18.115 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028381+0000", 2024-04-25T22:52:18.115 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00048039399999999998 2024-04-25T22:52:18.115 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:18.115 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:18.115 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:18.116 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033291+0000", 2024-04-25T22:52:18.116 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049105879999999996 2024-04-25T22:52:18.116 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:18.116 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:18.116 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:18.116 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:18.116 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:18.116 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:18.118 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is set 2024-04-25T22:52:18.118 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:52:18.119 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:18.117+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:18.219 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:18.218+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:18.231 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:18.231 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:52:18.231 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-04-25T22:52:18.231 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:18.241 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:52:18.319 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:18.318+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:18.343 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:18.343 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:52:18.343 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:52:18.343 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:52:18.343 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:18.352 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:52:18.421 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:18.420+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:18.495 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:18.495 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-04-25T22:52:18.496 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-04-25T22:52:18.496 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:52:18.496 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.496 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:18.496 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:18.496 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 30.528478049, 2024-04-25T22:52:18.496 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0103421, 2024-04-25T22:52:18.496 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:18.496 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:18.496 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:18.496 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:18.496 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:18.496 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:18.496 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 115 2024-04-25T22:52:18.497 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.497 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:18.497 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.497 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:18.497 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:18.497 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:18.497 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.497 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.497 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:18.497 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:18.497 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:18.497 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.497 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.498 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:18.498 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:18.498 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9500000000000002e-07 2024-04-25T22:52:18.498 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.498 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.498 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:18.498 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965108+0000", 2024-04-25T22:52:18.498 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9177999999999994e-05 2024-04-25T22:52:18.498 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.498 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.498 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:18.498 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965127+0000", 2024-04-25T22:52:18.498 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8868e-05 2024-04-25T22:52:18.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.499 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.499 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:18.499 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965133+0000", 2024-04-25T22:52:18.499 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8929999999999999e-06 2024-04-25T22:52:18.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.499 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.499 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:18.499 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.969991+0000", 2024-04-25T22:52:18.499 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048573849999999997 2024-04-25T22:52:18.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.499 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.499 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:18.499 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970072+0000", 2024-04-25T22:52:18.500 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0728000000000004e-05 2024-04-25T22:52:18.500 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.500 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.500 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:18.500 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970189+0000", 2024-04-25T22:52:18.500 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000117778 2024-04-25T22:52:18.500 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.500 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.500 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:18.500 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970946+0000", 2024-04-25T22:52:18.501 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00075704600000000004 2024-04-25T22:52:18.501 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.501 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.501 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:18.501 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975297+0000", 2024-04-25T22:52:18.501 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004350217 2024-04-25T22:52:18.501 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.501 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.501 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:18.501 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975343+0000", 2024-04-25T22:52:18.501 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6687999999999998e-05 2024-04-25T22:52:18.501 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.501 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.502 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:18.502 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975380+0000", 2024-04-25T22:52:18.502 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6724000000000003e-05 2024-04-25T22:52:18.502 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:18.502 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:18.502 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:18.502 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.502 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.502 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:18.502 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:18.502 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 30.528372017999999, 2024-04-25T22:52:18.502 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010304384, 2024-04-25T22:52:18.503 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:18.503 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:18.503 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:18.503 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:18.503 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:18.503 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:18.503 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 116 2024-04-25T22:52:18.503 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.503 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:18.503 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.503 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:18.503 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:18.503 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:18.503 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.504 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.504 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:18.504 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:18.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:18.504 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.504 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.504 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:18.504 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:18.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5799999999999999e-07 2024-04-25T22:52:18.504 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.504 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.504 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:18.504 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965154+0000", 2024-04-25T22:52:18.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0009e-05 2024-04-25T22:52:18.505 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.505 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.505 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:18.505 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965164+0000", 2024-04-25T22:52:18.505 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8490000000000001e-06 2024-04-25T22:52:18.505 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.505 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.505 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:18.505 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965169+0000", 2024-04-25T22:52:18.505 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0730000000000004e-06 2024-04-25T22:52:18.505 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.505 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.505 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:18.506 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970609+0000", 2024-04-25T22:52:18.506 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054397689999999997 2024-04-25T22:52:18.506 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.506 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.506 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:18.506 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970651+0000", 2024-04-25T22:52:18.506 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1873999999999999e-05 2024-04-25T22:52:18.506 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.506 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.506 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:18.506 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970723+0000", 2024-04-25T22:52:18.506 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2039999999999995e-05 2024-04-25T22:52:18.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.507 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.507 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:18.507 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971358+0000", 2024-04-25T22:52:18.507 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063489500000000001 2024-04-25T22:52:18.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.507 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.507 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:18.507 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975409+0000", 2024-04-25T22:52:18.507 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040506880000000002 2024-04-25T22:52:18.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.507 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.508 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:18.508 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975432+0000", 2024-04-25T22:52:18.508 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3315999999999998e-05 2024-04-25T22:52:18.508 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.508 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.508 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:18.508 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975448+0000", 2024-04-25T22:52:18.508 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6313000000000001e-05 2024-04-25T22:52:18.508 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:18.508 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:18.508 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:18.508 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.508 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.509 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:18.509 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:18.509 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 30.528337436000001, 2024-04-25T22:52:18.509 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010384338999999999, 2024-04-25T22:52:18.509 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:18.509 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:18.509 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:18.509 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:18.509 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:18.509 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:18.509 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-04-25T22:52:18.509 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.509 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:18.510 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.510 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:18.510 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:18.510 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:18.510 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.510 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.510 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:18.510 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:18.510 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:18.510 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.511 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.511 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:18.511 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:18.511 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3600000000000004e-07 2024-04-25T22:52:18.511 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.511 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.511 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:18.511 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965185+0000", 2024-04-25T22:52:18.511 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.117e-06 2024-04-25T22:52:18.511 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.512 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.512 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:18.512 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965192+0000", 2024-04-25T22:52:18.512 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3239999999999997e-06 2024-04-25T22:52:18.512 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.512 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.512 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:18.512 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965198+0000", 2024-04-25T22:52:18.512 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6370000000000004e-06 2024-04-25T22:52:18.512 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.513 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:18.513 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970973+0000", 2024-04-25T22:52:18.513 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057748239999999996 2024-04-25T22:52:18.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.513 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:18.513 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971049+0000", 2024-04-25T22:52:18.513 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6029e-05 2024-04-25T22:52:18.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.513 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:18.513 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971174+0000", 2024-04-25T22:52:18.514 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012462399999999999 2024-04-25T22:52:18.514 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.514 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.514 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:18.514 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971553+0000", 2024-04-25T22:52:18.514 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037896499999999999 2024-04-25T22:52:18.514 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.514 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.514 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:18.514 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975482+0000", 2024-04-25T22:52:18.514 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039297459999999996 2024-04-25T22:52:18.514 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.514 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.515 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:18.515 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975529+0000", 2024-04-25T22:52:18.515 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6387000000000002e-05 2024-04-25T22:52:18.515 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.515 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.515 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:18.515 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975563+0000", 2024-04-25T22:52:18.515 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4150000000000003e-05 2024-04-25T22:52:18.515 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:18.515 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:18.515 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:18.515 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.515 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.515 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:18.516 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:18.516 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 25.481291113000001, 2024-04-25T22:52:18.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012637705000000001, 2024-04-25T22:52:18.516 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:18.516 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:18.516 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:18.516 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:18.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:18.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:18.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:18.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:18.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:18.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:18.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:18.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012227+0000", 2024-04-25T22:52:18.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.863e-06 2024-04-25T22:52:18.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:18.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012236+0000", 2024-04-25T22:52:18.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1109999999999997e-06 2024-04-25T22:52:18.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.518 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:18.518 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012309+0000", 2024-04-25T22:52:18.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3242000000000001e-05 2024-04-25T22:52:18.518 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.518 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:18.518 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012324+0000", 2024-04-25T22:52:18.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4837e-05 2024-04-25T22:52:18.518 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.518 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:18.518 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015060+0000", 2024-04-25T22:52:18.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027363349999999999 2024-04-25T22:52:18.519 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.519 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.519 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:18.519 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015169+0000", 2024-04-25T22:52:18.519 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108372 2024-04-25T22:52:18.519 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.519 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.519 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:18.519 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015498+0000", 2024-04-25T22:52:18.519 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032949999999999999 2024-04-25T22:52:18.519 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.519 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.519 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:18.519 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021282+0000", 2024-04-25T22:52:18.520 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057836429999999998 2024-04-25T22:52:18.520 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.520 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:18.520 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024709+0000", 2024-04-25T22:52:18.520 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034271979999999998 2024-04-25T22:52:18.520 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.520 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:18.520 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024802+0000", 2024-04-25T22:52:18.520 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2960000000000004e-05 2024-04-25T22:52:18.520 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.520 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:18.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024863+0000", 2024-04-25T22:52:18.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0643999999999997e-05 2024-04-25T22:52:18.521 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:18.521 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:18.521 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:18.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.521 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:18.521 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:18.521 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 25.481167341999999, 2024-04-25T22:52:18.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012979447999999999, 2024-04-25T22:52:18.521 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:18.521 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:18.521 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:18.522 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:18.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.522 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:18.522 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:18.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:18.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.522 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:18.522 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:18.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:18.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.522 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:18.523 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:18.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:52:18.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.523 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.523 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:18.523 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012354+0000", 2024-04-25T22:52:18.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7740000000000004e-06 2024-04-25T22:52:18.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.523 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.523 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:18.523 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012365+0000", 2024-04-25T22:52:18.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.064e-05 2024-04-25T22:52:18.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.523 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.523 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:18.524 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012382+0000", 2024-04-25T22:52:18.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6999000000000001e-05 2024-04-25T22:52:18.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.524 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:18.524 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015958+0000", 2024-04-25T22:52:18.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035765699999999998 2024-04-25T22:52:18.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.524 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:18.524 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016037+0000", 2024-04-25T22:52:18.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8242000000000001e-05 2024-04-25T22:52:18.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.524 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:18.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016404+0000", 2024-04-25T22:52:18.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036784300000000002 2024-04-25T22:52:18.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:18.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021294+0000", 2024-04-25T22:52:18.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048890629999999999 2024-04-25T22:52:18.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:18.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024959+0000", 2024-04-25T22:52:18.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036651570000000001 2024-04-25T22:52:18.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:18.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025097+0000", 2024-04-25T22:52:18.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013788099999999999 2024-04-25T22:52:18.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:18.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025328+0000", 2024-04-25T22:52:18.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231492 2024-04-25T22:52:18.526 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:18.526 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:18.526 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:18.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.526 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:18.526 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:18.526 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 25.481079572999999, 2024-04-25T22:52:18.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013049827, 2024-04-25T22:52:18.527 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:18.527 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:18.527 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:18.527 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:18.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.527 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:18.527 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:18.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:18.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.527 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:18.527 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:18.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:18.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.528 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:18.528 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012437+0000", 2024-04-25T22:52:18.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-04-25T22:52:18.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.528 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:18.528 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012440+0000", 2024-04-25T22:52:18.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7609999999999999e-06 2024-04-25T22:52:18.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.528 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:18.528 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012449+0000", 2024-04-25T22:52:18.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.285e-06 2024-04-25T22:52:18.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:18.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012457+0000", 2024-04-25T22:52:18.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9510000000000006e-06 2024-04-25T22:52:18.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:18.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017106+0000", 2024-04-25T22:52:18.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046494220000000003 2024-04-25T22:52:18.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:18.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017223+0000", 2024-04-25T22:52:18.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116824 2024-04-25T22:52:18.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:18.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017345+0000", 2024-04-25T22:52:18.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122175 2024-04-25T22:52:18.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:18.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021299+0000", 2024-04-25T22:52:18.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039534879999999998 2024-04-25T22:52:18.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:18.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025398+0000", 2024-04-25T22:52:18.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040988960000000003 2024-04-25T22:52:18.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:18.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025439+0000", 2024-04-25T22:52:18.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0915999999999999e-05 2024-04-25T22:52:18.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:18.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025486+0000", 2024-04-25T22:52:18.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7534999999999998e-05 2024-04-25T22:52:18.531 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:18.531 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:18.531 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:18.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.532 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.532 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:18.532 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:18.532 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 25.481049422000002, 2024-04-25T22:52:18.532 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020988041999999998, 2024-04-25T22:52:18.532 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:18.532 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:18.532 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:18.532 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:18.532 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.532 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:18.532 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:18.532 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:18.532 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.532 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.533 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:18.533 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:18.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:18.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.533 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:18.533 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:18.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.99e-07 2024-04-25T22:52:18.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.533 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:18.533 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012470+0000", 2024-04-25T22:52:18.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2789999999999999e-06 2024-04-25T22:52:18.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:18.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012477+0000", 2024-04-25T22:52:18.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:52:18.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:18.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012500+0000", 2024-04-25T22:52:18.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2490999999999999e-05 2024-04-25T22:52:18.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:18.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021911+0000", 2024-04-25T22:52:18.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094114160000000006 2024-04-25T22:52:18.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:18.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022000+0000", 2024-04-25T22:52:18.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8601000000000001e-05 2024-04-25T22:52:18.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:18.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022359+0000", 2024-04-25T22:52:18.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035921999999999999 2024-04-25T22:52:18.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:18.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025541+0000", 2024-04-25T22:52:18.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031820619999999998 2024-04-25T22:52:18.536 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.536 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:18.536 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033375+0000", 2024-04-25T22:52:18.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078338379999999992 2024-04-25T22:52:18.536 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.536 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:18.536 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033415+0000", 2024-04-25T22:52:18.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9527000000000003e-05 2024-04-25T22:52:18.536 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.536 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:18.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033455+0000", 2024-04-25T22:52:18.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9932000000000003e-05 2024-04-25T22:52:18.537 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:18.537 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:18.537 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:18.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.537 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:18.537 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:18.537 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 25.480994229, 2024-04-25T22:52:18.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021043857999999999, 2024-04-25T22:52:18.537 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:18.537 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:18.537 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:18.538 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:18.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.538 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:18.538 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:18.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:18.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.538 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:18.538 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:18.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:18.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.538 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:18.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012523+0000", 2024-04-25T22:52:18.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.361e-06 2024-04-25T22:52:18.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:18.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012530+0000", 2024-04-25T22:52:18.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5440000000000004e-06 2024-04-25T22:52:18.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:18.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012541+0000", 2024-04-25T22:52:18.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1745e-05 2024-04-25T22:52:18.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.541 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:18.541 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012551+0000", 2024-04-25T22:52:18.541 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5789999999999993e-06 2024-04-25T22:52:18.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.541 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.541 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:18.542 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022709+0000", 2024-04-25T22:52:18.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010157685 2024-04-25T22:52:18.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.542 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:18.542 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022957+0000", 2024-04-25T22:52:18.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024824599999999998 2024-04-25T22:52:18.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.542 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:18.542 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023443+0000", 2024-04-25T22:52:18.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048578599999999999 2024-04-25T22:52:18.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:18.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025547+0000", 2024-04-25T22:52:18.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021044789999999998 2024-04-25T22:52:18.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:18.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033509+0000", 2024-04-25T22:52:18.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0079622180000000001 2024-04-25T22:52:18.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:18.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033542+0000", 2024-04-25T22:52:18.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3018000000000001e-05 2024-04-25T22:52:18.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:18.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033566+0000", 2024-04-25T22:52:18.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3197000000000002e-05 2024-04-25T22:52:18.544 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:18.544 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:18.544 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:18.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.544 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:18.544 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:18.544 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 25.480954264000001, 2024-04-25T22:52:18.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021122696, 2024-04-25T22:52:18.544 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:18.545 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:18.545 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:18.545 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:18.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.545 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:18.545 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:18.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:18.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.545 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:18.545 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:18.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:18.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.546 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:18.546 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:18.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:52:18.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.546 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:18.546 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012566+0000", 2024-04-25T22:52:18.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-04-25T22:52:18.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.546 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:18.546 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012619+0000", 2024-04-25T22:52:18.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2607e-05 2024-04-25T22:52:18.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:18.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012628+0000", 2024-04-25T22:52:18.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6500000000000008e-06 2024-04-25T22:52:18.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:18.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024024+0000", 2024-04-25T22:52:18.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011396007999999999 2024-04-25T22:52:18.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:18.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024198+0000", 2024-04-25T22:52:18.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000173215 2024-04-25T22:52:18.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.548 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:18.548 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024447+0000", 2024-04-25T22:52:18.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024898500000000002 2024-04-25T22:52:18.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.548 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:18.548 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026431+0000", 2024-04-25T22:52:18.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001984923 2024-04-25T22:52:18.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.548 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:18.548 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033608+0000", 2024-04-25T22:52:18.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071768459999999997 2024-04-25T22:52:18.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:18.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033646+0000", 2024-04-25T22:52:18.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299000000000003e-05 2024-04-25T22:52:18.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:18.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033684+0000", 2024-04-25T22:52:18.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8773000000000003e-05 2024-04-25T22:52:18.549 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:18.549 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:18.549 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:18.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.549 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:18.549 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:18.550 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 25.480865665, 2024-04-25T22:52:18.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021175381, 2024-04-25T22:52:18.550 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:18.550 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:18.550 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:18.550 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:18.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:18.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:18.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:18.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:18.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:18.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:18.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:18.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012651+0000", 2024-04-25T22:52:18.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:52:18.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:18.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012656+0000", 2024-04-25T22:52:18.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8899999999999998e-06 2024-04-25T22:52:18.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:18.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012666+0000", 2024-04-25T22:52:18.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0346999999999999e-05 2024-04-25T22:52:18.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:18.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012675+0000", 2024-04-25T22:52:18.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9930000000000001e-06 2024-04-25T22:52:18.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:18.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025661+0000", 2024-04-25T22:52:18.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01298531 2024-04-25T22:52:18.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:18.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025757+0000", 2024-04-25T22:52:18.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5822000000000005e-05 2024-04-25T22:52:18.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:18.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025907+0000", 2024-04-25T22:52:18.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015051499999999999 2024-04-25T22:52:18.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:18.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026435+0000", 2024-04-25T22:52:18.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052762200000000005 2024-04-25T22:52:18.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:18.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033732+0000", 2024-04-25T22:52:18.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072978419999999997 2024-04-25T22:52:18.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:18.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033787+0000", 2024-04-25T22:52:18.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4703999999999997e-05 2024-04-25T22:52:18.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:18.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033826+0000", 2024-04-25T22:52:18.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8458999999999999e-05 2024-04-25T22:52:18.554 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:18.555 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:18.555 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:18.555 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.555 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:18.555 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:18.555 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 25.480810251000001, 2024-04-25T22:52:18.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021244174000000001, 2024-04-25T22:52:18.555 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:18.555 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:18.555 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:18.555 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:18.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.555 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:18.555 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:18.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:18.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:18.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:18.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:18.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:18.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:18.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:52:18.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:18.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012712+0000", 2024-04-25T22:52:18.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.913e-06 2024-04-25T22:52:18.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.557 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:18.557 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012722+0000", 2024-04-25T22:52:18.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2879999999999998e-06 2024-04-25T22:52:18.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.557 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:18.557 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012727+0000", 2024-04-25T22:52:18.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8429999999999998e-06 2024-04-25T22:52:18.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.557 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:18.558 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026099+0000", 2024-04-25T22:52:18.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013371450999999999 2024-04-25T22:52:18.558 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.558 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.558 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:18.558 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026147+0000", 2024-04-25T22:52:18.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7837999999999998e-05 2024-04-25T22:52:18.558 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.558 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.558 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:18.558 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026254+0000", 2024-04-25T22:52:18.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107314 2024-04-25T22:52:18.558 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.558 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.559 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:18.559 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026686+0000", 2024-04-25T22:52:18.559 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000432428 2024-04-25T22:52:18.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.559 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:18.559 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033873+0000", 2024-04-25T22:52:18.559 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071864399999999997 2024-04-25T22:52:18.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.560 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:18.560 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033904+0000", 2024-04-25T22:52:18.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1321e-05 2024-04-25T22:52:18.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.560 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.560 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:18.560 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033950+0000", 2024-04-25T22:52:18.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5707999999999997e-05 2024-04-25T22:52:18.560 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:18.560 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:18.560 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:18.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.560 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.560 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:18.560 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:18.561 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 25.480779865999999, 2024-04-25T22:52:18.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01096505, 2024-04-25T22:52:18.561 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:18.561 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:18.561 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:18.561 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:18.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:18.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:18.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:18.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:18.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:18.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:18.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.562 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.562 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:18.562 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012737+0000", 2024-04-25T22:52:18.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:52:18.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.562 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.562 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:18.562 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012739+0000", 2024-04-25T22:52:18.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-04-25T22:52:18.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.562 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.563 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:18.563 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012743+0000", 2024-04-25T22:52:18.563 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3239999999999996e-06 2024-04-25T22:52:18.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.563 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.563 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:18.563 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012746+0000", 2024-04-25T22:52:18.563 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.129e-06 2024-04-25T22:52:18.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.563 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.563 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:18.563 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012796+0000", 2024-04-25T22:52:18.563 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9231999999999999e-05 2024-04-25T22:52:18.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.563 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.564 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:18.564 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012915+0000", 2024-04-25T22:52:18.564 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119021 2024-04-25T22:52:18.564 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.564 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:18.564 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013069+0000", 2024-04-25T22:52:18.564 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015463900000000001 2024-04-25T22:52:18.564 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.564 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:18.564 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019237+0000", 2024-04-25T22:52:18.564 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061680329999999998 2024-04-25T22:52:18.564 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:18.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023603+0000", 2024-04-25T22:52:18.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043655860000000003 2024-04-25T22:52:18.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:18.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023659+0000", 2024-04-25T22:52:18.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6484000000000003e-05 2024-04-25T22:52:18.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:18.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023701+0000", 2024-04-25T22:52:18.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1761999999999998e-05 2024-04-25T22:52:18.566 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:18.566 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:18.566 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:18.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.566 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:18.566 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:18.566 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 25.480754917999999, 2024-04-25T22:52:18.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011234429000000001, 2024-04-25T22:52:18.566 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:18.566 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:18.566 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:18.566 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:18.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.567 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:18.567 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:18.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:18.567 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.567 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.567 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:18.567 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:18.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:18.567 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.567 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.567 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:18.567 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012762+0000", 2024-04-25T22:52:18.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-04-25T22:52:18.567 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.568 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:18.568 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012765+0000", 2024-04-25T22:52:18.568 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2569999999999999e-06 2024-04-25T22:52:18.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.568 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:18.568 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012783+0000", 2024-04-25T22:52:18.568 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8431999999999999e-05 2024-04-25T22:52:18.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.568 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:18.568 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012799+0000", 2024-04-25T22:52:18.568 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5438999999999999e-05 2024-04-25T22:52:18.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.569 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:18.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013826+0000", 2024-04-25T22:52:18.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010275060000000001 2024-04-25T22:52:18.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.569 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:18.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013913+0000", 2024-04-25T22:52:18.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.708e-05 2024-04-25T22:52:18.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.569 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:18.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014098+0000", 2024-04-25T22:52:18.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018519399999999999 2024-04-25T22:52:18.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:18.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019684+0000", 2024-04-25T22:52:18.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055860079999999999 2024-04-25T22:52:18.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:18.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023876+0000", 2024-04-25T22:52:18.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041918800000000003 2024-04-25T22:52:18.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:18.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023957+0000", 2024-04-25T22:52:18.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1165e-05 2024-04-25T22:52:18.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:18.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023995+0000", 2024-04-25T22:52:18.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:52:18.571 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:18.571 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:18.571 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:18.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.571 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:18.571 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:18.571 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 25.480657139000002, 2024-04-25T22:52:18.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011131200000000001, 2024-04-25T22:52:18.572 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:18.572 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:18.572 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:18.572 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:18.572 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.572 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:18.572 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:18.572 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:18.572 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.572 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.572 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:18.572 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:18.572 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:18.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:18.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012860+0000", 2024-04-25T22:52:18.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3900000000000004e-07 2024-04-25T22:52:18.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:18.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012865+0000", 2024-04-25T22:52:18.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5609999999999998e-06 2024-04-25T22:52:18.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:18.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012895+0000", 2024-04-25T22:52:18.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9847000000000001e-05 2024-04-25T22:52:18.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:18.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012905+0000", 2024-04-25T22:52:18.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.03e-05 2024-04-25T22:52:18.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:18.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015020+0000", 2024-04-25T22:52:18.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021142940000000001 2024-04-25T22:52:18.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:18.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015182+0000", 2024-04-25T22:52:18.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016248099999999999 2024-04-25T22:52:18.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:52:18.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015357+0000", 2024-04-25T22:52:18.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017471000000000001 2024-04-25T22:52:18.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:18.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021021+0000", 2024-04-25T22:52:18.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056638340000000004 2024-04-25T22:52:18.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.576 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:18.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023712+0000", 2024-04-25T22:52:18.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026910380000000002 2024-04-25T22:52:18.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.576 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:18.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023763+0000", 2024-04-25T22:52:18.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1477999999999997e-05 2024-04-25T22:52:18.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.576 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:18.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023990+0000", 2024-04-25T22:52:18.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000226818 2024-04-25T22:52:18.576 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:18.576 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:18.577 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:18.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.577 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:18.577 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:18.577 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 25.480534042999999, 2024-04-25T22:52:18.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011705299000000001, 2024-04-25T22:52:18.577 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:18.577 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:18.577 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:18.577 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:18.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:18.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:18.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:18.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:18.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:18.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:18.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:18.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012983+0000", 2024-04-25T22:52:18.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:52:18.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:18.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012986+0000", 2024-04-25T22:52:18.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5700000000000001e-06 2024-04-25T22:52:18.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:18.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012993+0000", 2024-04-25T22:52:18.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8730000000000001e-06 2024-04-25T22:52:18.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:18.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013000+0000", 2024-04-25T22:52:18.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1890000000000001e-06 2024-04-25T22:52:18.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.580 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:18.580 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:52:18.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002147866 2024-04-25T22:52:18.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.580 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:18.580 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015351+0000", 2024-04-25T22:52:18.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020300799999999999 2024-04-25T22:52:18.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.580 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:18.580 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016260+0000", 2024-04-25T22:52:18.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00090926799999999997 2024-04-25T22:52:18.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.581 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:18.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022669+0000", 2024-04-25T22:52:18.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064082849999999997 2024-04-25T22:52:18.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.581 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.581 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:18.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024584+0000", 2024-04-25T22:52:18.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019151699999999999 2024-04-25T22:52:18.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.581 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.581 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:18.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024643+0000", 2024-04-25T22:52:18.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8888999999999998e-05 2024-04-25T22:52:18.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:18.582 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024687+0000", 2024-04-25T22:52:18.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4444999999999999e-05 2024-04-25T22:52:18.582 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:18.582 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:18.582 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:18.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.582 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:18.582 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:18.582 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 25.480506452, 2024-04-25T22:52:18.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011249699, 2024-04-25T22:52:18.582 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:18.583 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:18.583 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:18.583 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:18.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:18.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:18.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:18.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:18.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:18.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:18.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:18.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013010+0000", 2024-04-25T22:52:18.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2099999999999996e-07 2024-04-25T22:52:18.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:18.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013013+0000", 2024-04-25T22:52:18.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1310000000000002e-06 2024-04-25T22:52:18.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:18.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013020+0000", 2024-04-25T22:52:18.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3330000000000002e-06 2024-04-25T22:52:18.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:18.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013025+0000", 2024-04-25T22:52:18.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6760000000000004e-06 2024-04-25T22:52:18.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:18.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013163+0000", 2024-04-25T22:52:18.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013824599999999999 2024-04-25T22:52:18.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:18.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013504+0000", 2024-04-25T22:52:18.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034080299999999998 2024-04-25T22:52:18.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:18.586 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013613+0000", 2024-04-25T22:52:18.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108705 2024-04-25T22:52:18.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.586 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:18.586 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015831+0000", 2024-04-25T22:52:18.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002217672 2024-04-25T22:52:18.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.586 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:18.586 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024137+0000", 2024-04-25T22:52:18.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0083060489999999994 2024-04-25T22:52:18.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.587 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:18.587 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024218+0000", 2024-04-25T22:52:18.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1351000000000001e-05 2024-04-25T22:52:18.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.587 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:18.587 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024259+0000", 2024-04-25T22:52:18.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1112000000000002e-05 2024-04-25T22:52:18.587 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:18.587 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:18.587 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:18.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.587 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:18.587 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:18.588 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 25.480418726, 2024-04-25T22:52:18.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020379749999999999, 2024-04-25T22:52:18.588 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:18.588 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:18.588 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:18.588 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:18.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:18.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:18.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:18.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:18.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:18.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:18.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:18.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013098+0000", 2024-04-25T22:52:18.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:52:18.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:18.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013105+0000", 2024-04-25T22:52:18.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5969999999999997e-06 2024-04-25T22:52:18.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:18.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013190+0000", 2024-04-25T22:52:18.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5618999999999995e-05 2024-04-25T22:52:18.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.590 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.590 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:18.590 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013200+0000", 2024-04-25T22:52:18.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5859999999999994e-06 2024-04-25T22:52:18.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.590 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.590 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:18.590 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020265+0000", 2024-04-25T22:52:18.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070653349999999998 2024-04-25T22:52:18.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.590 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.590 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:18.591 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020454+0000", 2024-04-25T22:52:18.591 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189316 2024-04-25T22:52:18.591 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.591 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.591 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:18.591 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020586+0000", 2024-04-25T22:52:18.591 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013195700000000001 2024-04-25T22:52:18.591 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.591 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.591 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:18.591 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023822+0000", 2024-04-25T22:52:18.591 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032358529999999999 2024-04-25T22:52:18.591 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.591 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.592 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:18.592 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033409+0000", 2024-04-25T22:52:18.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095870520000000004 2024-04-25T22:52:18.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.592 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.592 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:18.592 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033447+0000", 2024-04-25T22:52:18.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7261999999999997e-05 2024-04-25T22:52:18.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.592 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.592 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:18.592 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033477+0000", 2024-04-25T22:52:18.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0389e-05 2024-04-25T22:52:18.592 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:18.592 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:18.592 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:18.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.593 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:18.593 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:18.593 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 25.480302219999999, 2024-04-25T22:52:18.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010857383999999999, 2024-04-25T22:52:18.593 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:18.593 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:18.593 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:18.593 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:18.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.593 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:18.593 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:18.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:18.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:18.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:18.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:18.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:18.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:18.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:52:18.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:18.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013218+0000", 2024-04-25T22:52:18.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8199999999999998e-06 2024-04-25T22:52:18.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.595 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:18.595 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013226+0000", 2024-04-25T22:52:18.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7649999999999993e-06 2024-04-25T22:52:18.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.595 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:18.595 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013259+0000", 2024-04-25T22:52:18.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2727e-05 2024-04-25T22:52:18.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.595 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:18.595 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014809+0000", 2024-04-25T22:52:18.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001550144 2024-04-25T22:52:18.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:18.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014958+0000", 2024-04-25T22:52:18.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014890300000000001 2024-04-25T22:52:18.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:52:18.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015087+0000", 2024-04-25T22:52:18.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012939200000000001 2024-04-25T22:52:18.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:18.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020212+0000", 2024-04-25T22:52:18.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051248939999999996 2024-04-25T22:52:18.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:18.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023699+0000", 2024-04-25T22:52:18.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034873289999999999 2024-04-25T22:52:18.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:18.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024014+0000", 2024-04-25T22:52:18.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031473999999999999 2024-04-25T22:52:18.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:18.598 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024071+0000", 2024-04-25T22:52:18.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7040000000000003e-05 2024-04-25T22:52:18.598 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:18.598 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:18.598 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:18.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.598 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:18.598 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:18.598 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 25.480247514999999, 2024-04-25T22:52:18.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012329677000000001, 2024-04-25T22:52:18.598 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:18.598 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:18.598 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:18.599 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:18.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.599 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:18.599 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:18.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:18.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.599 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:18.599 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:18.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:18.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.599 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:18.599 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013269+0000", 2024-04-25T22:52:18.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5000000000000002e-07 2024-04-25T22:52:18.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:18.600 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:52:18.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6909999999999999e-06 2024-04-25T22:52:18.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:18.600 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013284+0000", 2024-04-25T22:52:18.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0963e-05 2024-04-25T22:52:18.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:18.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013361+0000", 2024-04-25T22:52:18.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7379999999999994e-05 2024-04-25T22:52:18.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:18.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013448+0000", 2024-04-25T22:52:18.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6990000000000006e-05 2024-04-25T22:52:18.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:18.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013632+0000", 2024-04-25T22:52:18.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018396800000000001 2024-04-25T22:52:18.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:18.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013800+0000", 2024-04-25T22:52:18.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167467 2024-04-25T22:52:18.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:18.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.018570+0000", 2024-04-25T22:52:18.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047701460000000003 2024-04-25T22:52:18.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:18.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025507+0000", 2024-04-25T22:52:18.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069372039999999998 2024-04-25T22:52:18.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:18.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025562+0000", 2024-04-25T22:52:18.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4858999999999998e-05 2024-04-25T22:52:18.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:18.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025598+0000", 2024-04-25T22:52:18.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6259e-05 2024-04-25T22:52:18.603 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:18.603 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:18.603 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:18.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.603 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:18.604 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:18.604 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 25.480115642000001, 2024-04-25T22:52:18.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020176666999999999, 2024-04-25T22:52:18.604 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:18.604 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:18.604 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:52:18.604 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:18.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:18.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:18.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:18.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:18.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:18.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:18.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:18.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:52:18.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-04-25T22:52:18.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:18.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013405+0000", 2024-04-25T22:52:18.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0559999999999998e-06 2024-04-25T22:52:18.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:18.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013422+0000", 2024-04-25T22:52:18.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6770999999999999e-05 2024-04-25T22:52:18.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:18.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013431+0000", 2024-04-25T22:52:18.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5019999999999998e-06 2024-04-25T22:52:18.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:18.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021720+0000", 2024-04-25T22:52:18.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082884340000000008 2024-04-25T22:52:18.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.607 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:18.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022122+0000", 2024-04-25T22:52:18.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000401634 2024-04-25T22:52:18.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:18.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:18.607 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:18.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033577+0000", 2024-04-25T22:52:18.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011455435999999999 2024-04-25T22:52:18.607 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:18.607 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:18.607 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:18.607 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:18.608 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:18.608 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:18.609 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:52:18.610 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:18.609+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:18.691 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:52:18.713 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:18.712+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:18.724 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-25T22:52:18.724 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-25T22:52:18.724 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-25T22:52:18.724 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-25T22:52:18.733 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:52:18.810 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:18.810+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:18.837 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-25T22:52:18.837 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-25T22:52:18.837 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-25T22:52:18.837 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-25T22:52:18.837 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-25T22:52:18.842 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-25T22:52:18.843 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:52:18.847 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:52:18.861 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-25T22:52:18.861 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:52:18.879 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-25T22:52:18.879 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:52:18.911 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:18.911+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:18.990 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:18.990 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:18.999 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:52:19.012 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:19.011+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:19.112 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:19.112+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:19.114 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:19.114 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:19.125 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:52:19.214 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:19.214+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:19.226 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:19.227 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:19.235 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:52:19.320 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:19.320+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:19.379 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:19.379 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:19.389 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:52:19.433 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:19.432+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:19.497 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:19.497 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:19.506 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:52:19.516 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:19.516+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:19.618 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:19.618+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:19.634 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-25T22:52:19.635 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-25T22:52:19.635 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2024-04-25T22:52:19.635 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-25T22:52:19.635 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-25T22:52:19.635 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2024-04-25T22:52:19.649 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:19.650 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:19.658 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:52:19.719 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:19.719+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:19.747 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-25T22:52:19.747 INFO:teuthology.orchestra.run.smithi164.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-25T22:52:19.747 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-25T22:52:19.759 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:19.759 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:19.770 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:52:19.840 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:19.840+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:19.899 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:19.899 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:19.908 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:52:19.921 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:19.921+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:20.022 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:20.021+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:20.051 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:20.051 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:20.060 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:52:20.119 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-25T22:52:20.123 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:20.122+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:20.162 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:20.162 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:20.172 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:52:20.223 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:20.223+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:20.284 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:20.284 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:20.295 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:52:20.324 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:20.324+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:20.398 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:20.398 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:20.408 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:52:20.425 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:20.425+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:20.511 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:20.511 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:20.520 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:52:20.525 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:20.525+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:20.626 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:20.626+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:20.628 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:20.629 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:20.638 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:52:20.727 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:20.726+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:20.739 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:20.740 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:20.748 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:52:20.828 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:20.828+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:20.890 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:20.890 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:20.890 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:52:20.899 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:52:20.929 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:20.929+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:21.006 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:21.006 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:21.015 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:52:21.019 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-25T22:52:21.020 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:52:21.030 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:21.030+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:21.038 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-25T22:52:21.038 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:52:21.057 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-25T22:52:21.057 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:52:21.077 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is unset 2024-04-25T22:52:21.118 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-25T22:52:21.118 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-25T22:52:21.118 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-25T22:52:21.118 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-25T22:52:21.119 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-25T22:52:21.128 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:52:21.130 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:21.130+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:21.232 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-25T22:52:21.232 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-25T22:52:21.232 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-25T22:52:21.232 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-25T22:52:21.232 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.232 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(mds.0.3:28 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:52:21.232 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.013845+0000", 2024-04-25T22:52:21.232 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 28.216639282999999, 2024-04-25T22:52:21.233 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002002658, 2024-04-25T22:52:21.233 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:21.233 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:21.233 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:21.233 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:21.233 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.233 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:21.233 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013845+0000", 2024-04-25T22:52:21.233 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:21.233 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.233 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.233 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:21.233 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013845+0000", 2024-04-25T22:52:21.234 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:21.234 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.234 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.234 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:21.234 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013845+0000", 2024-04-25T22:52:21.234 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6100000000000002e-07 2024-04-25T22:52:21.234 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.234 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.234 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:21.234 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013859+0000", 2024-04-25T22:52:21.234 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4045e-05 2024-04-25T22:52:21.234 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.234 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.234 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:21.235 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013883+0000", 2024-04-25T22:52:21.235 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4020999999999999e-05 2024-04-25T22:52:21.235 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.235 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.235 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:21.235 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013904+0000", 2024-04-25T22:52:21.235 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.084e-05 2024-04-25T22:52:21.235 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.235 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.235 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:21.235 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013953+0000", 2024-04-25T22:52:21.235 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8652000000000001e-05 2024-04-25T22:52:21.236 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.236 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.236 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:21.236 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013983+0000", 2024-04-25T22:52:21.236 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0083e-05 2024-04-25T22:52:21.236 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.236 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.236 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:21.236 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015809+0000", 2024-04-25T22:52:21.236 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001826708 2024-04-25T22:52:21.236 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.236 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.236 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:21.237 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015848+0000", 2024-04-25T22:52:21.237 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8047999999999999e-05 2024-04-25T22:52:21.237 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:21.237 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:21.237 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:21.237 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.237 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.237 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:21.237 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.014834+0000", 2024-04-25T22:52:21.237 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 28.215649687999999, 2024-04-25T22:52:21.237 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0082660119999999997, 2024-04-25T22:52:21.238 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:21.238 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:21.238 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:21.238 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:21.238 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.238 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:21.238 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014834+0000", 2024-04-25T22:52:21.238 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:21.238 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.238 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.238 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:21.238 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014834+0000", 2024-04-25T22:52:21.238 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:21.239 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.239 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.239 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:21.239 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014837+0000", 2024-04-25T22:52:21.239 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.774e-06 2024-04-25T22:52:21.239 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.239 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.239 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:21.239 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014844+0000", 2024-04-25T22:52:21.239 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.1629999999999999e-06 2024-04-25T22:52:21.239 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.239 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.239 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:21.239 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014853+0000", 2024-04-25T22:52:21.240 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0829999999999993e-06 2024-04-25T22:52:21.240 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.240 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.240 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:21.240 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014862+0000", 2024-04-25T22:52:21.240 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0239999999999997e-06 2024-04-25T22:52:21.240 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.240 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.240 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:21.240 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014926+0000", 2024-04-25T22:52:21.240 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4571000000000002e-05 2024-04-25T22:52:21.240 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.241 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.241 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:21.241 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015064+0000", 2024-04-25T22:52:21.241 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013788200000000001 2024-04-25T22:52:21.241 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.241 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.241 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:21.241 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015240+0000", 2024-04-25T22:52:21.241 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000175697 2024-04-25T22:52:21.241 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.241 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.241 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:21.241 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017382+0000", 2024-04-25T22:52:21.242 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021422920000000001 2024-04-25T22:52:21.242 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.242 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.242 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:21.242 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023016+0000", 2024-04-25T22:52:21.242 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00563446 2024-04-25T22:52:21.242 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.242 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.242 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:21.242 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023062+0000", 2024-04-25T22:52:21.242 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5667999999999997e-05 2024-04-25T22:52:21.242 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.242 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.243 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:21.243 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023100+0000", 2024-04-25T22:52:21.243 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8398000000000001e-05 2024-04-25T22:52:21.243 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:21.243 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:21.243 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:21.243 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.243 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.243 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:21.243 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.014883+0000", 2024-04-25T22:52:21.243 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 28.215601469999999, 2024-04-25T22:52:21.243 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0083115319999999999, 2024-04-25T22:52:21.243 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:21.243 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:21.244 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:21.244 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:21.244 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.244 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:21.244 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014883+0000", 2024-04-25T22:52:21.244 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:21.244 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.244 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.244 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:21.244 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014883+0000", 2024-04-25T22:52:21.244 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:21.244 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.245 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.245 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:21.245 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014883+0000", 2024-04-25T22:52:21.245 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1200000000000003e-07 2024-04-25T22:52:21.245 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.245 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.245 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:21.245 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014887+0000", 2024-04-25T22:52:21.245 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4249999999999998e-06 2024-04-25T22:52:21.245 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.245 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.245 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:21.245 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014892+0000", 2024-04-25T22:52:21.246 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1150000000000002e-06 2024-04-25T22:52:21.246 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.246 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.246 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:21.246 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014896+0000", 2024-04-25T22:52:21.246 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3030000000000001e-06 2024-04-25T22:52:21.246 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.246 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.246 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:21.246 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015597+0000", 2024-04-25T22:52:21.246 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00070106400000000005 2024-04-25T22:52:21.246 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.246 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.247 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:21.247 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015681+0000", 2024-04-25T22:52:21.247 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.3417000000000004e-05 2024-04-25T22:52:21.247 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.247 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.247 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:21.247 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015800+0000", 2024-04-25T22:52:21.247 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000119522 2024-04-25T22:52:21.247 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.247 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.247 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:21.247 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017389+0000", 2024-04-25T22:52:21.247 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0015889739999999999 2024-04-25T22:52:21.248 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.248 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.248 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:21.248 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023129+0000", 2024-04-25T22:52:21.248 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0057398420000000002 2024-04-25T22:52:21.248 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.248 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.248 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:21.248 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023161+0000", 2024-04-25T22:52:21.248 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2002999999999998e-05 2024-04-25T22:52:21.248 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.248 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.249 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:21.249 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023194+0000", 2024-04-25T22:52:21.249 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3355000000000002e-05 2024-04-25T22:52:21.249 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:21.249 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:21.249 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:21.249 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.249 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.249 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:21.249 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.014902+0000", 2024-04-25T22:52:21.249 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 28.215581825000001, 2024-04-25T22:52:21.250 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0078159460000000007, 2024-04-25T22:52:21.250 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:21.250 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:21.250 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:21.250 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:21.250 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.250 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:21.250 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014902+0000", 2024-04-25T22:52:21.250 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:21.250 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.251 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.251 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:21.251 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014902+0000", 2024-04-25T22:52:21.251 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:21.251 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.251 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.251 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:21.251 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014903+0000", 2024-04-25T22:52:21.251 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.65e-07 2024-04-25T22:52:21.251 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.251 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.251 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:21.252 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014910+0000", 2024-04-25T22:52:21.252 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7619999999999995e-06 2024-04-25T22:52:21.252 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.252 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.252 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:21.252 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014915+0000", 2024-04-25T22:52:21.252 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2660000000000003e-06 2024-04-25T22:52:21.252 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.252 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.252 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:21.252 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014918+0000", 2024-04-25T22:52:21.252 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.331e-06 2024-04-25T22:52:21.252 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.253 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.253 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:21.253 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015554+0000", 2024-04-25T22:52:21.253 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00063627599999999996 2024-04-25T22:52:21.253 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.253 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.253 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:21.253 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015685+0000", 2024-04-25T22:52:21.253 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013059399999999999 2024-04-25T22:52:21.253 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.253 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.253 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:21.253 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015820+0000", 2024-04-25T22:52:21.253 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013471499999999999 2024-04-25T22:52:21.254 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.254 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.254 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:21.254 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017394+0000", 2024-04-25T22:52:21.254 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0015747459999999999 2024-04-25T22:52:21.254 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.254 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.254 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:21.254 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022598+0000", 2024-04-25T22:52:21.254 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.005203811 2024-04-25T22:52:21.254 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.254 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.254 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:21.255 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022671+0000", 2024-04-25T22:52:21.255 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3042999999999998e-05 2024-04-25T22:52:21.255 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.255 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.255 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:21.255 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022718+0000", 2024-04-25T22:52:21.255 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7136999999999999e-05 2024-04-25T22:52:21.255 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:21.255 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:21.255 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:21.255 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.255 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.255 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:21.255 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.014933+0000", 2024-04-25T22:52:21.256 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 28.215551451, 2024-04-25T22:52:21.256 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079271519999999998, 2024-04-25T22:52:21.256 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:21.256 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:21.256 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:21.256 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:21.256 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.256 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:21.256 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014933+0000", 2024-04-25T22:52:21.256 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:21.256 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.256 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.256 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:21.256 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014933+0000", 2024-04-25T22:52:21.257 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:21.257 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.257 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.257 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:21.257 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014933+0000", 2024-04-25T22:52:21.257 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0999999999999999e-07 2024-04-25T22:52:21.257 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.257 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.257 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:21.257 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014937+0000", 2024-04-25T22:52:21.257 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6090000000000001e-06 2024-04-25T22:52:21.257 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.257 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.257 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:21.258 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014943+0000", 2024-04-25T22:52:21.258 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.7100000000000001e-06 2024-04-25T22:52:21.258 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.258 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.258 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:21.258 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014949+0000", 2024-04-25T22:52:21.258 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9410000000000004e-06 2024-04-25T22:52:21.258 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.258 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.258 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:21.258 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016135+0000", 2024-04-25T22:52:21.258 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0011854750000000001 2024-04-25T22:52:21.258 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.259 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.259 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:21.259 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016185+0000", 2024-04-25T22:52:21.259 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.9888000000000001e-05 2024-04-25T22:52:21.259 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.259 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.259 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:21.259 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016297+0000", 2024-04-25T22:52:21.259 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011231299999999999 2024-04-25T22:52:21.259 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.259 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.259 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:21.259 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017399+0000", 2024-04-25T22:52:21.260 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0011018149999999999 2024-04-25T22:52:21.260 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.260 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.260 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:21.260 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022764+0000", 2024-04-25T22:52:21.260 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0053649819999999999 2024-04-25T22:52:21.260 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.260 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.260 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:21.260 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022821+0000", 2024-04-25T22:52:21.260 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7655000000000003e-05 2024-04-25T22:52:21.260 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.260 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.260 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:21.261 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022860+0000", 2024-04-25T22:52:21.261 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8353999999999999e-05 2024-04-25T22:52:21.261 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:21.261 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:21.261 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:21.261 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.261 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.261 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:21.261 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.014957+0000", 2024-04-25T22:52:21.261 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 28.21552762, 2024-04-25T22:52:21.261 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0083856810000000007, 2024-04-25T22:52:21.261 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:21.261 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:21.261 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:21.262 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:21.262 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.262 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:21.262 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014957+0000", 2024-04-25T22:52:21.262 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:21.262 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.262 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.262 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:21.262 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014957+0000", 2024-04-25T22:52:21.262 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:21.263 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.263 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.263 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:21.263 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014957+0000", 2024-04-25T22:52:21.263 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:52:21.263 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.263 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.263 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:21.263 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014961+0000", 2024-04-25T22:52:21.263 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2309999999999998e-06 2024-04-25T22:52:21.263 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.263 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.264 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:21.264 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014969+0000", 2024-04-25T22:52:21.264 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2540000000000003e-06 2024-04-25T22:52:21.264 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.264 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.264 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:21.264 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014972+0000", 2024-04-25T22:52:21.264 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4580000000000002e-06 2024-04-25T22:52:21.264 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.264 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.264 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:21.264 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016130+0000", 2024-04-25T22:52:21.264 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001157812 2024-04-25T22:52:21.264 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.265 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.265 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:21.265 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016247+0000", 2024-04-25T22:52:21.265 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000117268 2024-04-25T22:52:21.265 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.265 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.265 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:21.265 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016381+0000", 2024-04-25T22:52:21.265 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013417999999999999 2024-04-25T22:52:21.265 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.265 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.265 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:21.265 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017946+0000", 2024-04-25T22:52:21.265 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001564817 2024-04-25T22:52:21.266 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.266 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.266 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:21.266 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023240+0000", 2024-04-25T22:52:21.266 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0052938289999999999 2024-04-25T22:52:21.266 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.266 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.266 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:21.266 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023295+0000", 2024-04-25T22:52:21.266 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4969999999999997e-05 2024-04-25T22:52:21.266 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.266 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.266 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:21.266 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023342+0000", 2024-04-25T22:52:21.267 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7126000000000002e-05 2024-04-25T22:52:21.267 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:21.267 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:21.267 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:21.267 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.267 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.267 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:21.267 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.014978+0000", 2024-04-25T22:52:21.267 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 28.215506502, 2024-04-25T22:52:21.267 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0074058609999999997, 2024-04-25T22:52:21.267 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:21.267 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:21.267 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:21.268 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:21.268 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.268 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:21.268 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014978+0000", 2024-04-25T22:52:21.268 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:21.268 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.268 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.268 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:21.268 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014978+0000", 2024-04-25T22:52:21.268 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:21.268 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.268 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.268 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:21.269 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014978+0000", 2024-04-25T22:52:21.269 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0600000000000001e-07 2024-04-25T22:52:21.269 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.269 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.269 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:21.269 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014980+0000", 2024-04-25T22:52:21.269 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3130000000000001e-06 2024-04-25T22:52:21.269 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.269 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.269 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:21.269 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014984+0000", 2024-04-25T22:52:21.269 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6689999999999999e-06 2024-04-25T22:52:21.269 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.270 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.270 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:21.270 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014987+0000", 2024-04-25T22:52:21.270 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0709999999999999e-06 2024-04-25T22:52:21.270 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.270 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.270 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:21.270 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015035+0000", 2024-04-25T22:52:21.270 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7737000000000001e-05 2024-04-25T22:52:21.270 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.270 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.270 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:21.271 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:52:21.271 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113053 2024-04-25T22:52:21.271 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.271 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.271 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:21.271 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015255+0000", 2024-04-25T22:52:21.271 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010735599999999999 2024-04-25T22:52:21.271 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.271 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.271 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:21.271 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016248+0000", 2024-04-25T22:52:21.271 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00099310200000000005 2024-04-25T22:52:21.271 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.272 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.272 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:21.272 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022282+0000", 2024-04-25T22:52:21.272 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060341769999999999 2024-04-25T22:52:21.272 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.272 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.272 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:21.272 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022341+0000", 2024-04-25T22:52:21.272 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8938999999999999e-05 2024-04-25T22:52:21.272 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.272 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.272 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:21.272 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022384+0000", 2024-04-25T22:52:21.273 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2138000000000002e-05 2024-04-25T22:52:21.273 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:21.273 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:21.273 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:21.273 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.273 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.273 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:21.273 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.014995+0000", 2024-04-25T22:52:21.273 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 28.215488758999999, 2024-04-25T22:52:21.273 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075678170000000001, 2024-04-25T22:52:21.273 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:21.273 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:21.273 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-25T22:52:21.273 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:21.274 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.274 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:21.274 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014995+0000", 2024-04-25T22:52:21.274 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:21.274 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.274 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.274 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:21.274 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014995+0000", 2024-04-25T22:52:21.274 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:21.274 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.274 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.274 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:21.274 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014996+0000", 2024-04-25T22:52:21.275 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7500000000000001e-07 2024-04-25T22:52:21.275 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.275 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.275 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:21.275 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014998+0000", 2024-04-25T22:52:21.275 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2330000000000001e-06 2024-04-25T22:52:21.275 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.275 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.275 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:21.275 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015002+0000", 2024-04-25T22:52:21.275 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9570000000000004e-06 2024-04-25T22:52:21.275 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.275 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.276 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:21.276 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015008+0000", 2024-04-25T22:52:21.276 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0340000000000002e-06 2024-04-25T22:52:21.276 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.276 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.276 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:21.276 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015476+0000", 2024-04-25T22:52:21.276 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00046806899999999999 2024-04-25T22:52:21.276 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.276 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.276 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:21.276 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015565+0000", 2024-04-25T22:52:21.276 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.9126e-05 2024-04-25T22:52:21.276 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.277 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.277 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:21.277 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022563+0000", 2024-04-25T22:52:21.277 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0069981230000000002 2024-04-25T22:52:21.277 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:21.277 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:21.277 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:21.277 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.277 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.277 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:21.277 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.015033+0000", 2024-04-25T22:52:21.277 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 28.215450704999999, 2024-04-25T22:52:21.277 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010204922999999999, 2024-04-25T22:52:21.278 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:21.278 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:21.278 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-25T22:52:21.278 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:21.278 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.278 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:21.278 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015033+0000", 2024-04-25T22:52:21.278 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:21.278 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.278 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.278 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:21.278 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015033+0000", 2024-04-25T22:52:21.278 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:21.279 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.279 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.279 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:21.279 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015036+0000", 2024-04-25T22:52:21.279 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9110000000000002e-06 2024-04-25T22:52:21.279 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.279 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.279 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:21.279 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015040+0000", 2024-04-25T22:52:21.279 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0570000000000003e-06 2024-04-25T22:52:21.279 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.279 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.279 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:21.280 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015050+0000", 2024-04-25T22:52:21.280 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1449999999999997e-06 2024-04-25T22:52:21.280 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.280 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.280 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:21.280 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015058+0000", 2024-04-25T22:52:21.280 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.3960000000000006e-06 2024-04-25T22:52:21.280 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.280 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.280 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:21.280 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016951+0000", 2024-04-25T22:52:21.280 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0018930150000000001 2024-04-25T22:52:21.280 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.281 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.281 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:21.281 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017101+0000", 2024-04-25T22:52:21.281 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00015004800000000001 2024-04-25T22:52:21.281 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.281 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.281 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:21.281 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.025238+0000", 2024-04-25T22:52:21.281 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0081373509999999993 2024-04-25T22:52:21.281 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:21.281 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:21.282 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:21.282 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.282 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.282 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:21.282 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.015069+0000", 2024-04-25T22:52:21.282 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 28.215414770999999, 2024-04-25T22:52:21.282 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0066281769999999999, 2024-04-25T22:52:21.282 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:21.282 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:21.282 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-25T22:52:21.282 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:21.282 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.283 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:21.283 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015069+0000", 2024-04-25T22:52:21.283 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:21.283 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.283 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.283 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:21.283 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015069+0000", 2024-04-25T22:52:21.283 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:21.283 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.283 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.283 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:21.283 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015070+0000", 2024-04-25T22:52:21.283 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8899999999999999e-07 2024-04-25T22:52:21.283 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.284 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.284 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:21.284 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015082+0000", 2024-04-25T22:52:21.284 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.164e-05 2024-04-25T22:52:21.284 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.284 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.284 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:21.284 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015093+0000", 2024-04-25T22:52:21.284 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1066e-05 2024-04-25T22:52:21.284 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.284 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.284 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:21.284 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015099+0000", 2024-04-25T22:52:21.284 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8619999999999999e-06 2024-04-25T22:52:21.285 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.285 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.285 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:21.285 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:52:21.285 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.9821000000000003e-05 2024-04-25T22:52:21.285 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.285 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.285 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:21.285 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015221+0000", 2024-04-25T22:52:21.285 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2868999999999996e-05 2024-04-25T22:52:21.285 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.285 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.285 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:21.285 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021698+0000", 2024-04-25T22:52:21.286 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064762300000000004 2024-04-25T22:52:21.286 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:21.286 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:21.286 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:21.286 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.286 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.286 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:52:21.286 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.016597+0000", 2024-04-25T22:52:21.286 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 28.213887129, 2024-04-25T22:52:21.286 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001422113, 2024-04-25T22:52:21.286 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:21.286 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:21.286 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:21.287 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:21.287 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.287 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:21.287 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016597+0000", 2024-04-25T22:52:21.287 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:21.287 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.287 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.287 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:21.287 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016597+0000", 2024-04-25T22:52:21.287 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:21.287 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.287 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.287 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:21.288 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016598+0000", 2024-04-25T22:52:21.288 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2900000000000004e-07 2024-04-25T22:52:21.288 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.288 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.288 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:21.289 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016616+0000", 2024-04-25T22:52:21.289 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8876e-05 2024-04-25T22:52:21.289 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.289 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.289 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:21.289 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016626+0000", 2024-04-25T22:52:21.289 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.8900000000000002e-06 2024-04-25T22:52:21.289 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.289 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.289 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:21.290 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016634+0000", 2024-04-25T22:52:21.290 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7060000000000004e-06 2024-04-25T22:52:21.290 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.290 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.290 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:21.290 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016706+0000", 2024-04-25T22:52:21.290 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2102999999999997e-05 2024-04-25T22:52:21.290 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.290 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.290 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:21.290 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016727+0000", 2024-04-25T22:52:21.290 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0687e-05 2024-04-25T22:52:21.290 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.291 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.291 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:21.291 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017972+0000", 2024-04-25T22:52:21.291 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0012454829999999999 2024-04-25T22:52:21.291 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.291 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.291 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:21.291 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.018019+0000", 2024-04-25T22:52:21.291 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6839000000000003e-05 2024-04-25T22:52:21.291 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:21.291 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:21.291 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:21.291 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.291 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.292 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-25T22:52:21.292 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.016652+0000", 2024-04-25T22:52:21.292 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 28.213832515, 2024-04-25T22:52:21.292 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004473599, 2024-04-25T22:52:21.292 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:21.292 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:21.292 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:21.292 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:21.292 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.292 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:21.292 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016652+0000", 2024-04-25T22:52:21.293 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:21.293 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.293 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.293 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:21.293 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016652+0000", 2024-04-25T22:52:21.293 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:21.293 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.293 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.293 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:21.293 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016652+0000", 2024-04-25T22:52:21.293 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1899999999999998e-07 2024-04-25T22:52:21.293 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.293 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.293 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:21.294 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016657+0000", 2024-04-25T22:52:21.294 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4680000000000003e-06 2024-04-25T22:52:21.294 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.294 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.294 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:21.294 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016664+0000", 2024-04-25T22:52:21.294 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8210000000000002e-06 2024-04-25T22:52:21.294 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.294 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.294 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:21.294 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016669+0000", 2024-04-25T22:52:21.294 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8520000000000003e-06 2024-04-25T22:52:21.294 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.295 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.295 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:21.295 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016779+0000", 2024-04-25T22:52:21.295 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000109444 2024-04-25T22:52:21.295 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.295 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.295 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:21.295 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016798+0000", 2024-04-25T22:52:21.295 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9799000000000001e-05 2024-04-25T22:52:21.295 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.295 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.295 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:21.295 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021086+0000", 2024-04-25T22:52:21.296 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042879889999999999 2024-04-25T22:52:21.296 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.296 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.296 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:21.296 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021125+0000", 2024-04-25T22:52:21.296 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8807000000000003e-05 2024-04-25T22:52:21.296 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:21.296 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:21.296 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:21.296 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.296 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.296 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-25T22:52:21.296 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.016733+0000", 2024-04-25T22:52:21.296 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 28.213751616, 2024-04-25T22:52:21.297 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004231612, 2024-04-25T22:52:21.297 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:21.297 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:21.297 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:21.297 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:21.297 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.297 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:21.297 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016733+0000", 2024-04-25T22:52:21.297 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:21.297 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.297 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.297 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:21.297 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016733+0000", 2024-04-25T22:52:21.297 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:21.298 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.298 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.298 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:21.298 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016733+0000", 2024-04-25T22:52:21.298 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2100000000000002e-07 2024-04-25T22:52:21.298 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.298 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.298 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:21.298 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016756+0000", 2024-04-25T22:52:21.298 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2886000000000001e-05 2024-04-25T22:52:21.298 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.298 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.298 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:21.299 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016765+0000", 2024-04-25T22:52:21.299 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.3610000000000007e-06 2024-04-25T22:52:21.299 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.299 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.299 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:21.299 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016771+0000", 2024-04-25T22:52:21.299 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0020000000000003e-06 2024-04-25T22:52:21.299 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.299 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.299 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:21.299 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017050+0000", 2024-04-25T22:52:21.299 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00027877199999999999 2024-04-25T22:52:21.299 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.299 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.300 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:21.300 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017067+0000", 2024-04-25T22:52:21.300 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7499e-05 2024-04-25T22:52:21.300 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.300 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.300 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:21.300 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.020921+0000", 2024-04-25T22:52:21.300 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003853123 2024-04-25T22:52:21.300 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.300 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.300 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:21.300 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.020964+0000", 2024-04-25T22:52:21.300 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3547999999999997e-05 2024-04-25T22:52:21.301 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:21.301 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:21.301 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:21.301 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.301 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.301 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 1 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:52:21.301 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.019562+0000", 2024-04-25T22:52:21.301 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 28.210922572000001, 2024-04-25T22:52:21.301 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0045866930000000002, 2024-04-25T22:52:21.301 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:21.301 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:21.301 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "reached pg", 2024-04-25T22:52:21.301 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:21.302 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.302 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:21.302 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.019562+0000", 2024-04-25T22:52:21.302 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:21.302 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.302 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.302 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:21.303 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.019562+0000", 2024-04-25T22:52:21.303 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:21.303 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.303 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.303 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:21.303 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.019562+0000", 2024-04-25T22:52:21.303 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0100000000000005e-07 2024-04-25T22:52:21.303 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.303 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.303 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:21.303 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.019570+0000", 2024-04-25T22:52:21.303 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5599999999999996e-06 2024-04-25T22:52:21.303 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.303 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.304 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:21.304 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.019586+0000", 2024-04-25T22:52:21.304 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6086000000000002e-05 2024-04-25T22:52:21.304 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.304 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.304 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:21.304 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.019600+0000", 2024-04-25T22:52:21.304 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3934000000000001e-05 2024-04-25T22:52:21.304 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.304 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.304 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:21.304 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.019889+0000", 2024-04-25T22:52:21.304 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00028888200000000002 2024-04-25T22:52:21.304 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.305 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.305 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:21.305 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.024148+0000", 2024-04-25T22:52:21.305 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042597299999999998 2024-04-25T22:52:21.305 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:21.305 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:21.305 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:21.305 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.305 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.305 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-25T22:52:21.305 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.021542+0000", 2024-04-25T22:52:21.305 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 28.208942317999998, 2024-04-25T22:52:21.305 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001339589, 2024-04-25T22:52:21.305 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:21.306 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:21.306 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-25T22:52:21.306 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:21.306 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.306 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:21.306 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021542+0000", 2024-04-25T22:52:21.306 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:21.306 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.306 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.306 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:21.306 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021542+0000", 2024-04-25T22:52:21.306 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:21.306 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.307 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.307 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:21.307 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021542+0000", 2024-04-25T22:52:21.307 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1600000000000002e-07 2024-04-25T22:52:21.307 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.307 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.307 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:21.307 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021545+0000", 2024-04-25T22:52:21.307 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.774e-06 2024-04-25T22:52:21.307 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.307 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.307 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:21.307 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021553+0000", 2024-04-25T22:52:21.308 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.2099999999999993e-06 2024-04-25T22:52:21.308 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.308 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.308 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:21.308 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021559+0000", 2024-04-25T22:52:21.308 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.1249999999999998e-06 2024-04-25T22:52:21.308 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.308 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.308 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:21.308 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022752+0000", 2024-04-25T22:52:21.308 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0011931120000000001 2024-04-25T22:52:21.308 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.308 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.308 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:21.309 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022759+0000", 2024-04-25T22:52:21.309 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4420000000000003e-06 2024-04-25T22:52:21.309 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.309 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.309 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:21.309 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022881+0000", 2024-04-25T22:52:21.309 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012250999999999999 2024-04-25T22:52:21.309 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:21.309 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:21.309 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:21.309 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.309 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.309 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e14/12 ondisk, result = 0)", 2024-04-25T22:52:21.309 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.021769+0000", 2024-04-25T22:52:21.310 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 28.208715053999999, 2024-04-25T22:52:21.310 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001336928, 2024-04-25T22:52:21.310 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:21.310 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:21.310 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-25T22:52:21.310 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:21.310 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.310 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:21.310 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021769+0000", 2024-04-25T22:52:21.310 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:21.310 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.310 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.310 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:21.310 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021769+0000", 2024-04-25T22:52:21.311 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:21.311 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.311 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.311 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:21.311 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021770+0000", 2024-04-25T22:52:21.311 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7700000000000005e-07 2024-04-25T22:52:21.311 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.311 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.311 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:21.311 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021773+0000", 2024-04-25T22:52:21.311 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5250000000000001e-06 2024-04-25T22:52:21.311 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.311 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.311 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:21.312 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021780+0000", 2024-04-25T22:52:21.312 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.187e-06 2024-04-25T22:52:21.312 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.312 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.312 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:21.312 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021796+0000", 2024-04-25T22:52:21.312 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5218000000000001e-05 2024-04-25T22:52:21.312 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.312 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.312 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:21.312 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023001+0000", 2024-04-25T22:52:21.312 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001205993 2024-04-25T22:52:21.312 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.312 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.313 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:21.313 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023009+0000", 2024-04-25T22:52:21.313 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9249999999999995e-06 2024-04-25T22:52:21.313 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.313 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.313 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:21.313 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023106+0000", 2024-04-25T22:52:21.313 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6602999999999996e-05 2024-04-25T22:52:21.313 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:21.313 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:21.313 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:21.313 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.313 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.313 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-25T22:52:21.314 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.021807+0000", 2024-04-25T22:52:21.314 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 28.208676662999999, 2024-04-25T22:52:21.314 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0013936809999999999, 2024-04-25T22:52:21.314 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:21.314 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:21.314 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-25T22:52:21.314 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:21.314 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.314 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:21.314 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021807+0000", 2024-04-25T22:52:21.314 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:21.314 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.314 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.314 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:21.315 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021807+0000", 2024-04-25T22:52:21.315 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:21.315 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.315 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.315 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:21.315 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021808+0000", 2024-04-25T22:52:21.315 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3200000000000001e-07 2024-04-25T22:52:21.315 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.315 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.315 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:21.315 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021811+0000", 2024-04-25T22:52:21.315 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5480000000000002e-06 2024-04-25T22:52:21.315 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.316 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.316 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:21.316 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021818+0000", 2024-04-25T22:52:21.316 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4450000000000001e-06 2024-04-25T22:52:21.316 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.316 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.316 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:21.316 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021823+0000", 2024-04-25T22:52:21.316 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.22e-06 2024-04-25T22:52:21.316 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.316 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.316 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:21.316 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023122+0000", 2024-04-25T22:52:21.317 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001298808 2024-04-25T22:52:21.317 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.317 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.317 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:21.317 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023126+0000", 2024-04-25T22:52:21.317 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9400000000000004e-06 2024-04-25T22:52:21.317 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.317 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.317 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:21.317 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023201+0000", 2024-04-25T22:52:21.317 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5388000000000004e-05 2024-04-25T22:52:21.317 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:21.318 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:21.318 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:21.318 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.318 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.318 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-25T22:52:21.318 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.022040+0000", 2024-04-25T22:52:21.318 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 28.208444249999999, 2024-04-25T22:52:21.318 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0013084100000000001, 2024-04-25T22:52:21.318 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:21.318 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:21.318 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-25T22:52:21.318 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:21.318 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.319 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:21.319 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022040+0000", 2024-04-25T22:52:21.319 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:21.319 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.319 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.319 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:21.319 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022040+0000", 2024-04-25T22:52:21.319 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:21.319 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.319 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.319 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:21.319 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022040+0000", 2024-04-25T22:52:21.320 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9999999999999999e-07 2024-04-25T22:52:21.320 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.320 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.320 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:21.320 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022043+0000", 2024-04-25T22:52:21.320 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.362e-06 2024-04-25T22:52:21.320 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.320 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.320 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:21.320 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022049+0000", 2024-04-25T22:52:21.320 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.947e-06 2024-04-25T22:52:21.321 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.321 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.321 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:21.321 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022055+0000", 2024-04-25T22:52:21.321 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.1909999999999997e-06 2024-04-25T22:52:21.321 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.321 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.321 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:21.321 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023227+0000", 2024-04-25T22:52:21.321 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0011720820000000001 2024-04-25T22:52:21.321 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.321 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.321 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:21.321 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023235+0000", 2024-04-25T22:52:21.322 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.2330000000000006e-06 2024-04-25T22:52:21.322 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.322 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.322 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:21.322 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023348+0000", 2024-04-25T22:52:21.322 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011329500000000001 2024-04-25T22:52:21.322 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:21.322 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:21.322 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:21.322 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.322 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.322 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-25T22:52:21.322 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:55.010264+0000", 2024-04-25T22:52:21.323 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 26.220220481999998, 2024-04-25T22:52:21.323 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001484476, 2024-04-25T22:52:21.323 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:21.323 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:21.323 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:21.323 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:21.323 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.323 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:21.323 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010264+0000", 2024-04-25T22:52:21.323 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:21.323 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.323 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.323 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:21.324 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010264+0000", 2024-04-25T22:52:21.324 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:21.324 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.324 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.324 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:21.324 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010265+0000", 2024-04-25T22:52:21.324 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5e-06 2024-04-25T22:52:21.324 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.324 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.324 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:21.324 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010272+0000", 2024-04-25T22:52:21.324 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0910000000000004e-06 2024-04-25T22:52:21.324 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.324 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.324 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:21.325 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010287+0000", 2024-04-25T22:52:21.325 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4644000000000001e-05 2024-04-25T22:52:21.325 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.325 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.325 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:21.325 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010296+0000", 2024-04-25T22:52:21.325 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2159999999999995e-06 2024-04-25T22:52:21.325 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.325 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.325 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:21.325 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010394+0000", 2024-04-25T22:52:21.325 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.8148999999999998e-05 2024-04-25T22:52:21.325 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.325 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.326 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:21.326 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010503+0000", 2024-04-25T22:52:21.326 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000108857 2024-04-25T22:52:21.326 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.326 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.326 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:21.326 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010592+0000", 2024-04-25T22:52:21.326 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.9083000000000001e-05 2024-04-25T22:52:21.326 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.326 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.326 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:21.326 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.011161+0000", 2024-04-25T22:52:21.326 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00056919800000000003 2024-04-25T22:52:21.327 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.327 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.327 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:21.327 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.011676+0000", 2024-04-25T22:52:21.327 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00051500999999999999 2024-04-25T22:52:21.327 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.327 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.327 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:21.327 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.011717+0000", 2024-04-25T22:52:21.327 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0262999999999997e-05 2024-04-25T22:52:21.327 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.327 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.327 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:21.327 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.011748+0000", 2024-04-25T22:52:21.327 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1464999999999998e-05 2024-04-25T22:52:21.328 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:21.328 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:21.328 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:21.328 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.328 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.328 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-25T22:52:21.328 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:52:17.012790+0000", 2024-04-25T22:52:21.328 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 4.2176946380000002, 2024-04-25T22:52:21.328 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001434444, 2024-04-25T22:52:21.328 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:21.328 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:21.328 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:21.328 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:21.329 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.329 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:21.329 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.012790+0000", 2024-04-25T22:52:21.329 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:21.329 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.329 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.329 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:21.329 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.012790+0000", 2024-04-25T22:52:21.329 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:21.329 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.329 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.329 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:21.329 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.012791+0000", 2024-04-25T22:52:21.329 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0699999999999999e-06 2024-04-25T22:52:21.330 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.330 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.330 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:21.330 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.012797+0000", 2024-04-25T22:52:21.330 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0519999999999998e-06 2024-04-25T22:52:21.330 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.330 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.330 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:21.330 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.012811+0000", 2024-04-25T22:52:21.330 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4287999999999999e-05 2024-04-25T22:52:21.330 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.330 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.330 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:21.330 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.012838+0000", 2024-04-25T22:52:21.331 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6727999999999999e-05 2024-04-25T22:52:21.331 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.331 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.331 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:21.331 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.012909+0000", 2024-04-25T22:52:21.331 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.1211000000000006e-05 2024-04-25T22:52:21.331 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.331 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.331 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:21.331 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.013015+0000", 2024-04-25T22:52:21.331 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010619 2024-04-25T22:52:21.331 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.331 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.331 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:21.332 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.013189+0000", 2024-04-25T22:52:21.332 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00017439199999999999 2024-04-25T22:52:21.332 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.332 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.332 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:21.332 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.013903+0000", 2024-04-25T22:52:21.332 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00071379099999999997 2024-04-25T22:52:21.332 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.332 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.332 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:21.332 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.014159+0000", 2024-04-25T22:52:21.332 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00025561699999999998 2024-04-25T22:52:21.332 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.332 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.332 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:21.333 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.014192+0000", 2024-04-25T22:52:21.333 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2941000000000002e-05 2024-04-25T22:52:21.333 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:21.333 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:21.333 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:21.333 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.014224+0000", 2024-04-25T22:52:21.333 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2163999999999999e-05 2024-04-25T22:52:21.333 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:21.333 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:21.333 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:21.333 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:21.333 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:21.333 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-25T22:52:21.335 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:21.230+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:21.335 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:52:21.336 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:21.334+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:21.435 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:21.435+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:21.447 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:21.447 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:52:21.447 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-25T22:52:21.447 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:21.456 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:52:21.536 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:21.536+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:21.557 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:21.558 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:52:21.558 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-25T22:52:21.558 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-25T22:52:21.558 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:21.566 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:52:21.637 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:21.637+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:21.670 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:21.670 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:52:21.671 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:52:21.671 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:52:21.671 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.671 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:52:21.671 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:52:21.671 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 33.701756719000002, 2024-04-25T22:52:21.671 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:52:21.671 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:21.671 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:21.671 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:21.671 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:21.671 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.671 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:21.672 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:52:21.672 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:21.672 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.672 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.672 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:21.672 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:52:21.672 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:21.672 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.672 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.672 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:21.672 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:52:21.672 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:52:21.672 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.673 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.673 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:21.673 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:52:21.673 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:52:21.673 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.673 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.673 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:21.673 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:52:21.673 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:52:21.673 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.673 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.673 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:21.673 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:52:21.674 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:52:21.674 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.674 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.674 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:21.674 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:52:21.674 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:52:21.674 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.674 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.674 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:21.674 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:52:21.674 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:52:21.674 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.674 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.674 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:21.675 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:52:21.675 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:52:21.675 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.675 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.675 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:21.675 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:52:21.675 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:52:21.675 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:21.675 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:21.675 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:21.675 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.675 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.675 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:110 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'72, mlcod=10'68)", 2024-04-25T22:52:21.676 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:21.676 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 33.701122718999997, 2024-04-25T22:52:21.676 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065316630000000001, 2024-04-25T22:52:21.676 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:21.676 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:21.676 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:21.676 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:21.676 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.676 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:21.676 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:21.676 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:21.676 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.676 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.677 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:21.677 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:21.677 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:21.677 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.677 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.677 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:21.677 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:21.677 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.58e-07 2024-04-25T22:52:21.677 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.677 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.677 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:21.677 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967811+0000", 2024-04-25T22:52:21.677 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.118e-06 2024-04-25T22:52:21.677 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.678 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.678 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:21.678 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967817+0000", 2024-04-25T22:52:21.678 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3709999999999996e-06 2024-04-25T22:52:21.678 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.678 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.678 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:21.678 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967820+0000", 2024-04-25T22:52:21.678 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2210000000000002e-06 2024-04-25T22:52:21.678 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.678 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.678 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:21.679 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967876+0000", 2024-04-25T22:52:21.679 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5507000000000002e-05 2024-04-25T22:52:21.679 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.679 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.679 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:21.679 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967893+0000", 2024-04-25T22:52:21.679 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7812000000000002e-05 2024-04-25T22:52:21.679 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.679 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.679 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:21.679 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974317+0000", 2024-04-25T22:52:21.679 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064237160000000003 2024-04-25T22:52:21.679 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.679 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.680 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:21.680 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:52:21.680 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.156e-05 2024-04-25T22:52:21.680 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:21.680 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:21.680 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:21.680 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.680 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.680 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'68)", 2024-04-25T22:52:21.680 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:21.680 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 33.700705206000002, 2024-04-25T22:52:21.680 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061292279999999996, 2024-04-25T22:52:21.680 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:21.681 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:21.681 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:21.681 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:21.681 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.681 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:21.681 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:21.681 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:21.681 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.681 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.681 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:21.681 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:21.681 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:21.681 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.681 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.681 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:21.682 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:21.682 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6300000000000001e-07 2024-04-25T22:52:21.682 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.682 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.682 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:21.682 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968228+0000", 2024-04-25T22:52:21.682 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6139999999999999e-06 2024-04-25T22:52:21.682 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.682 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.682 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:21.682 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968235+0000", 2024-04-25T22:52:21.682 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7020000000000001e-06 2024-04-25T22:52:21.682 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.683 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.683 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:21.683 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968238+0000", 2024-04-25T22:52:21.683 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0010000000000002e-06 2024-04-25T22:52:21.683 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.683 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.683 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:21.683 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968297+0000", 2024-04-25T22:52:21.683 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8424999999999997e-05 2024-04-25T22:52:21.683 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.683 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.683 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:21.683 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968316+0000", 2024-04-25T22:52:21.684 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8814999999999999e-05 2024-04-25T22:52:21.684 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.684 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.684 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:21.684 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:52:21.684 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060239439999999998 2024-04-25T22:52:21.684 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.684 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.684 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:21.684 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974354+0000", 2024-04-25T22:52:21.684 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4364e-05 2024-04-25T22:52:21.684 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:21.684 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:21.684 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:21.684 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.685 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.685 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'68)", 2024-04-25T22:52:21.685 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:21.685 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 33.700268203999997, 2024-04-25T22:52:21.685 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005948414, 2024-04-25T22:52:21.685 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:21.685 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:21.685 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:21.685 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:21.685 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.685 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:21.685 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:21.685 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:21.686 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.686 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.686 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:21.686 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:21.686 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:21.686 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.686 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.686 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:21.686 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:21.686 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6199999999999998e-07 2024-04-25T22:52:21.686 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.686 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.686 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:21.686 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968723+0000", 2024-04-25T22:52:21.687 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1148999999999993e-05 2024-04-25T22:52:21.687 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.687 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.687 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:21.687 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968730+0000", 2024-04-25T22:52:21.687 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1749999999999999e-06 2024-04-25T22:52:21.687 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.687 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.687 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:21.687 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968734+0000", 2024-04-25T22:52:21.687 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5200000000000002e-06 2024-04-25T22:52:21.687 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.687 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.687 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:21.688 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968771+0000", 2024-04-25T22:52:21.688 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6851999999999999e-05 2024-04-25T22:52:21.688 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.688 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.688 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:21.688 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968788+0000", 2024-04-25T22:52:21.688 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7027000000000001e-05 2024-04-25T22:52:21.688 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.688 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.688 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:21.688 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974589+0000", 2024-04-25T22:52:21.688 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058013320000000002 2024-04-25T22:52:21.688 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.688 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.689 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:21.689 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974610+0000", 2024-04-25T22:52:21.689 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0897e-05 2024-04-25T22:52:21.689 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:21.689 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:21.689 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:21.689 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.689 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.689 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'68)", 2024-04-25T22:52:21.689 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:21.689 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 33.699698194, 2024-04-25T22:52:21.689 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053935750000000003, 2024-04-25T22:52:21.689 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:21.690 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:21.690 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:21.690 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:21.690 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.690 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:21.690 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:21.690 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:21.690 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.690 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.690 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:21.690 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:21.690 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:21.690 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.691 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.691 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:21.691 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:21.691 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.03e-07 2024-04-25T22:52:21.691 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.691 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.691 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:21.691 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969235+0000", 2024-04-25T22:52:21.691 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2399999999999999e-06 2024-04-25T22:52:21.691 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.691 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.691 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:21.691 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969242+0000", 2024-04-25T22:52:21.691 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1269999999999997e-06 2024-04-25T22:52:21.692 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.692 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.692 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:21.692 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969246+0000", 2024-04-25T22:52:21.692 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3840000000000001e-06 2024-04-25T22:52:21.692 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.692 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.692 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:21.692 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969278+0000", 2024-04-25T22:52:21.692 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1868e-05 2024-04-25T22:52:21.692 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.692 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.692 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:21.693 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969295+0000", 2024-04-25T22:52:21.693 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7530999999999999e-05 2024-04-25T22:52:21.693 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.693 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.693 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:21.693 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974611+0000", 2024-04-25T22:52:21.693 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053160789999999996 2024-04-25T22:52:21.693 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.693 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.693 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:21.693 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974625+0000", 2024-04-25T22:52:21.693 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3943e-05 2024-04-25T22:52:21.693 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:21.693 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:21.694 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:21.694 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.694 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.694 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-25T22:52:21.694 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:21.694 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 33.506102286000001, 2024-04-25T22:52:21.694 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054952610000000004, 2024-04-25T22:52:21.694 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:21.694 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:21.694 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:21.694 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:21.694 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.694 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:21.695 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:21.695 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:21.695 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.695 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.695 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:21.695 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:21.695 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:21.695 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.695 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.695 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:21.695 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:21.695 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.68e-07 2024-04-25T22:52:21.695 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.695 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.696 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:21.696 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162898+0000", 2024-04-25T22:52:21.696 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9470999999999999e-05 2024-04-25T22:52:21.696 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.696 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.696 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:21.696 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162906+0000", 2024-04-25T22:52:21.696 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1580000000000005e-06 2024-04-25T22:52:21.696 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.696 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.696 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:21.696 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162911+0000", 2024-04-25T22:52:21.696 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4779999999999999e-06 2024-04-25T22:52:21.696 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.697 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.697 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:21.697 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162952+0000", 2024-04-25T22:52:21.697 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0629e-05 2024-04-25T22:52:21.697 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.697 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.697 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:21.697 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162968+0000", 2024-04-25T22:52:21.697 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6239000000000002e-05 2024-04-25T22:52:21.697 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.697 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.697 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:21.698 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168281+0000", 2024-04-25T22:52:21.698 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053132869999999999 2024-04-25T22:52:21.698 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.698 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.698 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:21.698 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168323+0000", 2024-04-25T22:52:21.698 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1430999999999997e-05 2024-04-25T22:52:21.698 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:21.698 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:21.698 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:21.698 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.698 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.698 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-04-25T22:52:21.698 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:21.699 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 33.075624924000003, 2024-04-25T22:52:21.699 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050872510000000001, 2024-04-25T22:52:21.699 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:21.699 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:21.699 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:21.699 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:21.699 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.699 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:21.699 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:21.699 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:21.699 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.699 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.700 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:21.700 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:21.700 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:21.700 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.700 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.700 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:21.700 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:21.700 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.72e-07 2024-04-25T22:52:21.700 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.700 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.700 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:21.700 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593381+0000", 2024-04-25T22:52:21.700 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5797000000000006e-05 2024-04-25T22:52:21.700 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.701 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.701 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:21.701 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593389+0000", 2024-04-25T22:52:21.701 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8480000000000001e-06 2024-04-25T22:52:21.701 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.701 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.701 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:21.701 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593393+0000", 2024-04-25T22:52:21.701 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4819999999999996e-06 2024-04-25T22:52:21.701 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.701 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.701 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:21.701 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593435+0000", 2024-04-25T22:52:21.701 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1600000000000002e-05 2024-04-25T22:52:21.701 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.702 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.702 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:21.702 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593454+0000", 2024-04-25T22:52:21.702 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8868e-05 2024-04-25T22:52:21.702 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.702 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.702 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:21.702 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598350+0000", 2024-04-25T22:52:21.702 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004895763 2024-04-25T22:52:21.702 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.702 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.702 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:21.702 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598392+0000", 2024-04-25T22:52:21.703 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2521000000000002e-05 2024-04-25T22:52:21.703 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:21.703 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:21.703 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:21.703 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.703 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.703 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:21.703 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:52:21.703 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 28.65726102, 2024-04-25T22:52:21.703 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:52:21.703 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:21.703 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:21.703 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:21.703 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:21.704 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.704 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:21.704 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:52:21.704 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:21.704 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.704 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.704 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:21.704 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:52:21.704 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:21.704 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.704 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.704 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:21.704 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:52:21.704 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:52:21.705 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.705 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.705 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:21.705 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:52:21.705 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:52:21.705 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.705 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.705 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:21.705 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:52:21.705 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:52:21.705 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.705 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.705 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:21.705 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:52:21.706 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:52:21.706 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.706 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.706 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:21.706 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:52:21.706 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:52:21.706 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.706 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.706 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:21.706 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:52:21.706 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:52:21.706 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.706 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.706 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:21.707 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:52:21.707 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:52:21.707 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.707 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.707 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:21.707 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:52:21.707 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:52:21.707 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.707 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.707 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:21.707 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:52:21.707 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:52:21.707 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.708 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.708 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:21.708 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:52:21.708 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:52:21.708 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.708 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.708 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:21.708 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:52:21.708 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:52:21.708 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:21.708 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:21.708 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:21.708 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.709 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.709 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:21.709 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:52:21.709 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 28.656586644000001, 2024-04-25T22:52:21.709 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:52:21.709 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:21.709 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:21.709 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:21.709 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:21.709 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.709 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:21.709 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:52:21.709 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:21.710 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.710 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.710 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:21.710 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:52:21.710 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:21.710 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.710 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.710 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:21.710 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:52:21.710 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:52:21.710 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.710 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.710 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:21.711 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:52:21.711 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:52:21.711 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.711 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.711 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:21.711 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:52:21.711 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:52:21.711 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.711 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.711 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:21.711 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:52:21.711 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:52:21.711 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.711 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.712 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:21.712 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:52:21.712 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:52:21.712 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.712 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.712 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:21.712 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:52:21.712 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:52:21.712 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.712 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.712 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:21.712 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:52:21.712 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:52:21.712 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.713 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.713 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:21.713 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:52:21.713 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:52:21.713 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.713 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.713 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:21.713 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:52:21.713 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:52:21.713 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.713 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.713 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:21.713 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:52:21.714 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:52:21.714 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.714 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.714 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:21.714 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:52:21.714 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:52:21.714 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:21.714 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:21.714 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:21.714 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.714 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.714 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:21.714 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:52:21.715 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 28.656077432, 2024-04-25T22:52:21.715 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:52:21.715 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:21.715 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:21.715 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:21.715 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:21.715 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.715 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:21.715 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:52:21.715 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:21.715 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.715 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.715 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:21.715 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:52:21.716 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:21.716 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.716 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.716 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:21.716 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:52:21.716 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:52:21.716 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.716 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.716 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:21.716 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:52:21.716 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:52:21.716 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.716 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.716 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:21.717 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:52:21.717 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:52:21.717 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.717 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.717 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:21.717 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:52:21.717 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:52:21.717 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.717 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.717 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:21.717 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:52:21.717 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:52:21.717 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.717 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.718 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:21.718 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:52:21.718 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:52:21.718 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.718 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.718 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:21.718 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:52:21.718 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:52:21.718 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.718 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.718 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:21.718 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:52:21.718 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:52:21.718 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.719 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.719 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:21.719 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:52:21.719 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:52:21.719 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.719 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.719 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:21.719 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:52:21.719 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:52:21.719 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.719 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.719 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:21.719 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:52:21.719 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:52:21.720 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:21.720 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:21.720 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:21.720 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.720 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.720 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:21.720 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:21.720 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 28.655664234, 2024-04-25T22:52:21.720 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:52:21.720 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:21.720 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:21.720 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:21.720 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:21.720 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.721 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:21.721 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:21.721 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:21.721 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.721 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.721 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:21.721 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:21.721 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:21.721 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.721 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.721 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:21.721 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:21.722 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:52:21.722 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.722 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.722 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:21.722 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:52:21.722 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:52:21.722 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.722 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.722 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:21.722 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:52:21.722 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:52:21.722 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.722 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.723 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:21.723 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:52:21.723 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:52:21.723 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.723 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.723 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:21.723 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:52:21.723 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:52:21.723 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.723 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.723 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:21.723 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:52:21.723 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:52:21.723 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.723 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.724 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:21.724 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:52:21.724 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:52:21.724 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.724 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.724 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:21.724 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:52:21.724 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:52:21.724 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.724 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.724 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:21.724 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:52:21.724 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:52:21.724 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.725 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.725 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:21.725 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:52:21.725 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:52:21.725 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.725 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.725 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:21.725 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:52:21.725 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:52:21.725 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:21.725 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:21.725 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:21.725 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.725 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.726 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:21.726 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:52:21.726 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 28.655613563999999, 2024-04-25T22:52:21.726 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:52:21.726 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:21.726 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:21.726 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:21.726 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:21.726 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.726 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:21.726 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:52:21.726 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:21.726 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.726 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.727 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:21.727 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:52:21.727 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:21.727 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.727 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.727 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:21.727 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:52:21.727 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:52:21.727 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.727 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.727 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:21.727 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:52:21.727 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:52:21.727 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.728 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.728 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:21.728 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:52:21.728 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:52:21.728 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.728 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.728 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:21.728 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:52:21.728 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:52:21.728 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.728 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.728 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:21.728 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:52:21.728 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:52:21.729 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.729 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.729 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:52:21.729 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:52:21.729 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:52:21.729 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.729 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.729 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:21.729 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:52:21.729 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:52:21.729 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.729 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.729 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:21.729 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:52:21.729 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:52:21.730 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.730 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.730 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:21.730 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:52:21.730 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:52:21.730 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.730 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.730 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:21.730 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:52:21.730 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:52:21.730 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.730 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.731 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:21.731 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:52:21.731 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:52:21.731 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.731 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.731 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:21.731 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:52:21.731 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:52:21.731 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.731 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.731 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:21.731 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:52:21.731 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:52:21.731 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:21.732 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:21.732 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:21.732 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.732 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.732 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:21.732 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:52:21.732 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 28.655576695000001, 2024-04-25T22:52:21.732 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:52:21.732 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:21.732 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:21.732 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:21.732 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:21.732 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.732 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:21.733 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:52:21.733 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:21.733 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.733 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.733 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:21.733 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:52:21.733 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:21.733 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.733 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.733 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:21.733 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:52:21.733 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:52:21.733 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.733 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.734 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:21.734 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:52:21.734 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:52:21.734 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.734 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.734 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:21.734 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:52:21.734 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:52:21.734 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.734 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.734 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:21.734 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:52:21.734 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:52:21.734 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.735 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.735 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:21.735 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:52:21.735 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:52:21.735 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.735 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.735 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:52:21.735 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:52:21.735 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:52:21.735 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.735 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.735 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:21.735 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:52:21.735 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:52:21.736 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.736 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.736 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:21.736 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:52:21.736 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:52:21.736 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.736 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.736 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:21.736 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:52:21.736 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:52:21.736 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.736 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.736 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:21.736 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:52:21.736 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:52:21.737 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.737 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.737 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:21.737 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:52:21.737 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:52:21.737 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.737 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.737 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:21.737 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:52:21.737 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:52:21.737 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.737 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.737 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:21.737 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:52:21.737 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:52:21.738 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:21.738 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:21.738 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:21.738 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.738 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.738 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:21.738 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:52:21.738 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 28.655551728999999, 2024-04-25T22:52:21.738 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:52:21.738 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:21.738 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:21.738 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:21.738 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:21.739 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.739 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:21.739 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:52:21.739 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:21.739 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.739 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.739 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:21.739 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:52:21.739 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:21.739 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.739 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.739 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:21.739 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:52:21.740 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:52:21.740 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.740 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.740 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:21.740 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:52:21.740 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:52:21.740 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.740 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.740 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:21.740 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:52:21.740 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:52:21.740 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.740 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.741 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:21.741 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:52:21.741 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:52:21.741 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.741 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.741 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:21.741 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:52:21.741 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:52:21.741 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.741 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.741 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:21.741 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:52:21.742 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:52:21.742 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.742 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.742 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:21.742 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:52:21.742 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:52:21.742 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.742 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.742 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:21.742 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:52:21.742 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:52:21.742 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.742 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.742 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:21.743 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:52:21.743 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:52:21.743 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.743 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.743 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:21.743 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:52:21.743 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:52:21.743 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.743 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.743 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:21.743 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:52:21.743 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:52:21.743 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:21.743 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:21.744 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:21.744 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.744 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.744 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:21.744 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:52:21.744 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 28.655515364999999, 2024-04-25T22:52:21.744 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:52:21.744 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:21.744 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:21.744 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:52:21.744 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:21.744 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.744 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:21.745 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:52:21.745 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:21.745 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.745 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.745 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:21.745 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:52:21.745 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:21.745 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.745 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.745 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:21.745 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:52:21.745 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:52:21.745 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.745 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.745 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:21.746 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:52:21.746 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:52:21.746 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.746 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.746 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:21.746 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:52:21.746 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:52:21.746 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.746 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.746 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:21.746 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:52:21.746 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:52:21.746 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.746 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.747 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:21.747 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:52:21.747 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:52:21.747 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.747 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.747 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:52:21.747 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:52:21.747 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:52:21.747 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.747 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.747 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:21.747 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:52:21.747 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:52:21.747 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.748 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.748 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:21.748 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:52:21.748 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:52:21.748 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.748 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.748 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:21.748 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:52:21.748 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:52:21.748 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:21.748 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:21.748 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:21.748 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.748 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.749 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:21.749 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:21.749 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 28.655484284, 2024-04-25T22:52:21.749 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:52:21.749 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:21.749 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:21.749 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:52:21.749 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:21.749 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.749 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:21.749 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:21.749 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:21.749 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.749 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.750 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:21.750 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:21.750 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:21.750 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.750 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.750 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:21.750 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:21.750 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:52:21.750 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.750 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.750 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:21.750 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:52:21.750 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:52:21.751 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.751 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.751 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:21.751 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:52:21.751 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:52:21.751 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.751 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.751 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:21.751 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:52:21.751 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:52:21.751 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.751 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.751 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:21.751 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:52:21.751 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:52:21.752 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.752 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.752 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:21.752 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:52:21.752 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:52:21.752 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.752 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.752 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:21.752 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:52:21.752 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:52:21.752 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:21.752 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:21.752 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:21.752 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.753 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.753 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:52:21.753 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:21.753 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 28.655043315, 2024-04-25T22:52:21.753 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064881979999999997, 2024-04-25T22:52:21.753 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:21.753 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:21.753 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:21.753 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:21.753 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.753 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:21.753 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:21.753 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:21.753 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.753 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.754 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:21.754 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:21.754 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:21.754 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.754 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.754 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:21.754 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:21.754 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2699999999999999e-07 2024-04-25T22:52:21.754 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.754 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.754 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:21.754 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013898+0000", 2024-04-25T22:52:21.754 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0796e-05 2024-04-25T22:52:21.754 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.755 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.755 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:21.755 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013907+0000", 2024-04-25T22:52:21.755 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5140000000000007e-06 2024-04-25T22:52:21.755 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.755 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.755 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:21.755 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013952+0000", 2024-04-25T22:52:21.755 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4134000000000001e-05 2024-04-25T22:52:21.755 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.755 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.755 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:21.755 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016812+0000", 2024-04-25T22:52:21.756 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028601059999999998 2024-04-25T22:52:21.756 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.756 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.756 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:21.756 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.017052+0000", 2024-04-25T22:52:21.756 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024056500000000001 2024-04-25T22:52:21.756 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.756 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.756 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:21.756 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020350+0000", 2024-04-25T22:52:21.756 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032978320000000001 2024-04-25T22:52:21.756 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.756 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.756 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:21.757 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020375+0000", 2024-04-25T22:52:21.757 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4624e-05 2024-04-25T22:52:21.757 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:21.757 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:21.757 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:21.757 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.757 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.757 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-25T22:52:21.757 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:21.757 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 28.641512869, 2024-04-25T22:52:21.757 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058583000000000003, 2024-04-25T22:52:21.757 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:21.757 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:21.757 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:21.758 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:21.758 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.758 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:21.758 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:21.758 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:21.758 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.758 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.758 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:21.758 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:21.758 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:21.758 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.758 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.759 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:21.759 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:21.759 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.41e-07 2024-04-25T22:52:21.759 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.759 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.759 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:21.759 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027428+0000", 2024-04-25T22:52:21.759 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.075e-05 2024-04-25T22:52:21.759 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.759 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.759 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:21.759 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027435+0000", 2024-04-25T22:52:21.759 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3610000000000003e-06 2024-04-25T22:52:21.759 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.760 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.760 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:21.760 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027442+0000", 2024-04-25T22:52:21.760 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0400000000000004e-06 2024-04-25T22:52:21.760 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.760 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.760 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:21.760 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028094+0000", 2024-04-25T22:52:21.760 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00065134800000000005 2024-04-25T22:52:21.760 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.760 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.760 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:21.760 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028107+0000", 2024-04-25T22:52:21.760 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3087e-05 2024-04-25T22:52:21.761 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.761 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.761 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:21.761 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033239+0000", 2024-04-25T22:52:21.761 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051319429999999999 2024-04-25T22:52:21.761 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.761 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.761 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:21.761 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033275+0000", 2024-04-25T22:52:21.761 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6430000000000002e-05 2024-04-25T22:52:21.761 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:21.762 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:21.762 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:21.762 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.762 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.762 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-25T22:52:21.762 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:21.762 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 28.641128032000001, 2024-04-25T22:52:21.762 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005413597, 2024-04-25T22:52:21.762 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:21.762 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:21.762 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:21.762 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:21.762 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.763 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:21.763 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:21.763 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:21.763 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.763 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.763 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:21.763 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:21.763 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:21.763 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.763 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.763 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:21.763 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:21.763 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3799999999999997e-07 2024-04-25T22:52:21.763 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.763 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.764 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:21.764 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027816+0000", 2024-04-25T22:52:21.764 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3230999999999999e-05 2024-04-25T22:52:21.764 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.764 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.764 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:21.764 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027823+0000", 2024-04-25T22:52:21.764 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9039999999999992e-06 2024-04-25T22:52:21.764 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.764 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.764 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:21.764 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027841+0000", 2024-04-25T22:52:21.764 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7651000000000001e-05 2024-04-25T22:52:21.764 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.765 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.765 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:21.765 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027904+0000", 2024-04-25T22:52:21.765 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3058000000000005e-05 2024-04-25T22:52:21.765 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.765 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.765 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:21.765 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027926+0000", 2024-04-25T22:52:21.765 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1450999999999998e-05 2024-04-25T22:52:21.765 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.765 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.765 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:21.765 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033177+0000", 2024-04-25T22:52:21.765 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052508909999999997 2024-04-25T22:52:21.766 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.766 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.766 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:21.766 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033215+0000", 2024-04-25T22:52:21.766 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8872999999999999e-05 2024-04-25T22:52:21.766 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:21.766 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:21.766 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:21.766 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.766 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.766 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 171 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:52:21.766 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:21.766 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 28.641070930000001, 2024-04-25T22:52:21.767 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054322240000000003, 2024-04-25T22:52:21.767 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:21.767 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:21.767 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "reached pg", 2024-04-25T22:52:21.767 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:21.767 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.767 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:21.767 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:21.767 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:21.767 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.767 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.767 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:21.767 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:21.767 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:21.768 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.768 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.768 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:21.768 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:21.768 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7500000000000001e-07 2024-04-25T22:52:21.768 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.768 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.768 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:21.768 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027868+0000", 2024-04-25T22:52:21.768 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5750000000000001e-06 2024-04-25T22:52:21.768 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.768 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.768 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:21.769 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027885+0000", 2024-04-25T22:52:21.769 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7272e-05 2024-04-25T22:52:21.769 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.769 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.769 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:21.769 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027900+0000", 2024-04-25T22:52:21.769 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.502e-05 2024-04-25T22:52:21.769 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.769 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.769 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:21.769 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028381+0000", 2024-04-25T22:52:21.769 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00048039399999999998 2024-04-25T22:52:21.769 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:21.770 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:21.770 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:21.770 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033291+0000", 2024-04-25T22:52:21.770 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049105879999999996 2024-04-25T22:52:21.770 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:21.770 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:21.770 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:21.770 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:21.770 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:21.770 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:21.772 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:21.771+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:21.772 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:52:21.872 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:21.872+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:21.882 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:21.883 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:52:21.883 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-04-25T22:52:21.883 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:21.891 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:52:21.973 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:21.972+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:21.993 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:21.993 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:52:21.993 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:52:21.993 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:52:21.993 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:22.003 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:52:22.073 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:22.073+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:22.147 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:22.147 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-04-25T22:52:22.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-04-25T22:52:22.147 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:52:22.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.147 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:22.147 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:22.147 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 34.179846452, 2024-04-25T22:52:22.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0103421, 2024-04-25T22:52:22.147 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:22.147 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:22.148 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:22.148 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:22.148 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:22.148 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:22.148 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 115 2024-04-25T22:52:22.148 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.148 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:22.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.148 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:22.148 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:22.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:22.148 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.148 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:22.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:22.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:22.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:22.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:22.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9500000000000002e-07 2024-04-25T22:52:22.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:22.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965108+0000", 2024-04-25T22:52:22.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9177999999999994e-05 2024-04-25T22:52:22.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:22.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965127+0000", 2024-04-25T22:52:22.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8868e-05 2024-04-25T22:52:22.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:22.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965133+0000", 2024-04-25T22:52:22.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8929999999999999e-06 2024-04-25T22:52:22.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:22.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.969991+0000", 2024-04-25T22:52:22.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048573849999999997 2024-04-25T22:52:22.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:22.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970072+0000", 2024-04-25T22:52:22.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0728000000000004e-05 2024-04-25T22:52:22.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:22.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970189+0000", 2024-04-25T22:52:22.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000117778 2024-04-25T22:52:22.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:22.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970946+0000", 2024-04-25T22:52:22.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00075704600000000004 2024-04-25T22:52:22.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:22.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975297+0000", 2024-04-25T22:52:22.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004350217 2024-04-25T22:52:22.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:22.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975343+0000", 2024-04-25T22:52:22.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6687999999999998e-05 2024-04-25T22:52:22.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:22.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975380+0000", 2024-04-25T22:52:22.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6724000000000003e-05 2024-04-25T22:52:22.153 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:22.153 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:22.153 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:22.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.153 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:22.153 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:22.153 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 34.179740420999998, 2024-04-25T22:52:22.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010304384, 2024-04-25T22:52:22.153 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:22.153 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:22.153 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:22.154 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:22.154 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:22.154 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:22.154 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 116 2024-04-25T22:52:22.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.154 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:22.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:22.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:22.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:22.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:22.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:22.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:22.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:22.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:22.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5799999999999999e-07 2024-04-25T22:52:22.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:22.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965154+0000", 2024-04-25T22:52:22.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0009e-05 2024-04-25T22:52:22.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:22.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965164+0000", 2024-04-25T22:52:22.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8490000000000001e-06 2024-04-25T22:52:22.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:22.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965169+0000", 2024-04-25T22:52:22.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0730000000000004e-06 2024-04-25T22:52:22.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:22.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970609+0000", 2024-04-25T22:52:22.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054397689999999997 2024-04-25T22:52:22.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:22.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970651+0000", 2024-04-25T22:52:22.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1873999999999999e-05 2024-04-25T22:52:22.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:22.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970723+0000", 2024-04-25T22:52:22.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2039999999999995e-05 2024-04-25T22:52:22.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:22.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971358+0000", 2024-04-25T22:52:22.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063489500000000001 2024-04-25T22:52:22.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:22.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975409+0000", 2024-04-25T22:52:22.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040506880000000002 2024-04-25T22:52:22.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:22.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975432+0000", 2024-04-25T22:52:22.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3315999999999998e-05 2024-04-25T22:52:22.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:22.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975448+0000", 2024-04-25T22:52:22.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6313000000000001e-05 2024-04-25T22:52:22.159 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:22.159 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:22.159 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:22.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.159 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:22.159 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:22.159 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 34.179705839, 2024-04-25T22:52:22.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010384338999999999, 2024-04-25T22:52:22.159 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:22.159 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:22.159 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:22.159 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:22.159 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:22.160 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:22.160 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-04-25T22:52:22.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.160 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:22.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:22.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:22.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:22.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:22.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:22.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:22.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:22.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:22.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3600000000000004e-07 2024-04-25T22:52:22.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:22.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965185+0000", 2024-04-25T22:52:22.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.117e-06 2024-04-25T22:52:22.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:22.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965192+0000", 2024-04-25T22:52:22.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3239999999999997e-06 2024-04-25T22:52:22.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:22.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965198+0000", 2024-04-25T22:52:22.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6370000000000004e-06 2024-04-25T22:52:22.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:22.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970973+0000", 2024-04-25T22:52:22.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057748239999999996 2024-04-25T22:52:22.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:22.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971049+0000", 2024-04-25T22:52:22.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6029e-05 2024-04-25T22:52:22.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:22.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971174+0000", 2024-04-25T22:52:22.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012462399999999999 2024-04-25T22:52:22.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:22.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971553+0000", 2024-04-25T22:52:22.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037896499999999999 2024-04-25T22:52:22.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:22.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975482+0000", 2024-04-25T22:52:22.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039297459999999996 2024-04-25T22:52:22.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:22.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975529+0000", 2024-04-25T22:52:22.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6387000000000002e-05 2024-04-25T22:52:22.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:22.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975563+0000", 2024-04-25T22:52:22.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4150000000000003e-05 2024-04-25T22:52:22.164 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:22.164 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:22.164 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:22.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.164 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:22.164 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:22.165 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.132659516, 2024-04-25T22:52:22.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012637705000000001, 2024-04-25T22:52:22.165 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:22.165 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:22.165 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:22.165 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:22.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:22.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:22.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:22.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:22.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:22.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:22.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:22.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012227+0000", 2024-04-25T22:52:22.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.863e-06 2024-04-25T22:52:22.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:22.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012236+0000", 2024-04-25T22:52:22.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1109999999999997e-06 2024-04-25T22:52:22.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:22.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012309+0000", 2024-04-25T22:52:22.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3242000000000001e-05 2024-04-25T22:52:22.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:22.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012324+0000", 2024-04-25T22:52:22.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4837e-05 2024-04-25T22:52:22.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:22.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015060+0000", 2024-04-25T22:52:22.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027363349999999999 2024-04-25T22:52:22.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:22.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015169+0000", 2024-04-25T22:52:22.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108372 2024-04-25T22:52:22.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:22.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015498+0000", 2024-04-25T22:52:22.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032949999999999999 2024-04-25T22:52:22.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:22.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021282+0000", 2024-04-25T22:52:22.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057836429999999998 2024-04-25T22:52:22.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:22.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024709+0000", 2024-04-25T22:52:22.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034271979999999998 2024-04-25T22:52:22.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:22.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024802+0000", 2024-04-25T22:52:22.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2960000000000004e-05 2024-04-25T22:52:22.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:22.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024863+0000", 2024-04-25T22:52:22.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0643999999999997e-05 2024-04-25T22:52:22.169 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:22.169 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:22.170 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:22.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.170 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:22.170 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:22.170 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.132535744999998, 2024-04-25T22:52:22.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012979447999999999, 2024-04-25T22:52:22.170 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:22.170 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:22.170 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:22.170 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:22.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:22.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:22.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:22.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:22.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:22.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:22.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:22.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:22.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:52:22.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:22.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012354+0000", 2024-04-25T22:52:22.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7740000000000004e-06 2024-04-25T22:52:22.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:22.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012365+0000", 2024-04-25T22:52:22.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.064e-05 2024-04-25T22:52:22.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:22.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012382+0000", 2024-04-25T22:52:22.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6999000000000001e-05 2024-04-25T22:52:22.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:22.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015958+0000", 2024-04-25T22:52:22.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035765699999999998 2024-04-25T22:52:22.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:22.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016037+0000", 2024-04-25T22:52:22.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8242000000000001e-05 2024-04-25T22:52:22.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:22.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016404+0000", 2024-04-25T22:52:22.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036784300000000002 2024-04-25T22:52:22.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:22.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021294+0000", 2024-04-25T22:52:22.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048890629999999999 2024-04-25T22:52:22.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:22.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024959+0000", 2024-04-25T22:52:22.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036651570000000001 2024-04-25T22:52:22.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:22.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025097+0000", 2024-04-25T22:52:22.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013788099999999999 2024-04-25T22:52:22.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:22.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025328+0000", 2024-04-25T22:52:22.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231492 2024-04-25T22:52:22.176 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:22.176 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:22.176 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:22.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.176 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:22.176 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:22.176 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.132447976000002, 2024-04-25T22:52:22.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013049827, 2024-04-25T22:52:22.176 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:22.176 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:22.176 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:22.176 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:22.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:22.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:22.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:22.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:22.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:22.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:22.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:22.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012437+0000", 2024-04-25T22:52:22.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-04-25T22:52:22.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:22.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012440+0000", 2024-04-25T22:52:22.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7609999999999999e-06 2024-04-25T22:52:22.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:22.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012449+0000", 2024-04-25T22:52:22.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.285e-06 2024-04-25T22:52:22.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:22.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012457+0000", 2024-04-25T22:52:22.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9510000000000006e-06 2024-04-25T22:52:22.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:22.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017106+0000", 2024-04-25T22:52:22.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046494220000000003 2024-04-25T22:52:22.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:22.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017223+0000", 2024-04-25T22:52:22.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116824 2024-04-25T22:52:22.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:22.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017345+0000", 2024-04-25T22:52:22.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122175 2024-04-25T22:52:22.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:22.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021299+0000", 2024-04-25T22:52:22.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039534879999999998 2024-04-25T22:52:22.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:22.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025398+0000", 2024-04-25T22:52:22.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040988960000000003 2024-04-25T22:52:22.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:22.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025439+0000", 2024-04-25T22:52:22.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0915999999999999e-05 2024-04-25T22:52:22.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:22.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025486+0000", 2024-04-25T22:52:22.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7534999999999998e-05 2024-04-25T22:52:22.181 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:22.181 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:22.181 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:22.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.181 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:22.182 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:22.182 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.132417825000001, 2024-04-25T22:52:22.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020988041999999998, 2024-04-25T22:52:22.182 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:22.182 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:22.182 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:22.182 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:22.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:22.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:22.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:22.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:22.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:22.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:22.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:22.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:22.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.99e-07 2024-04-25T22:52:22.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:22.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012470+0000", 2024-04-25T22:52:22.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2789999999999999e-06 2024-04-25T22:52:22.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:22.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012477+0000", 2024-04-25T22:52:22.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:52:22.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:22.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012500+0000", 2024-04-25T22:52:22.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2490999999999999e-05 2024-04-25T22:52:22.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:22.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021911+0000", 2024-04-25T22:52:22.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094114160000000006 2024-04-25T22:52:22.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:22.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022000+0000", 2024-04-25T22:52:22.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8601000000000001e-05 2024-04-25T22:52:22.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:22.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022359+0000", 2024-04-25T22:52:22.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035921999999999999 2024-04-25T22:52:22.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:22.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025541+0000", 2024-04-25T22:52:22.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031820619999999998 2024-04-25T22:52:22.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:22.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033375+0000", 2024-04-25T22:52:22.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078338379999999992 2024-04-25T22:52:22.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:22.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033415+0000", 2024-04-25T22:52:22.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9527000000000003e-05 2024-04-25T22:52:22.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:22.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033455+0000", 2024-04-25T22:52:22.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9932000000000003e-05 2024-04-25T22:52:22.187 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:22.187 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:22.187 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:22.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.187 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:22.187 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:22.187 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.132362632, 2024-04-25T22:52:22.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021043857999999999, 2024-04-25T22:52:22.187 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:22.187 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:22.187 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:22.187 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:22.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:22.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:22.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:22.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:22.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:22.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:22.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:22.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012523+0000", 2024-04-25T22:52:22.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.361e-06 2024-04-25T22:52:22.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:22.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012530+0000", 2024-04-25T22:52:22.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5440000000000004e-06 2024-04-25T22:52:22.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:22.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012541+0000", 2024-04-25T22:52:22.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1745e-05 2024-04-25T22:52:22.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:22.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012551+0000", 2024-04-25T22:52:22.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5789999999999993e-06 2024-04-25T22:52:22.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:22.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022709+0000", 2024-04-25T22:52:22.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010157685 2024-04-25T22:52:22.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:22.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022957+0000", 2024-04-25T22:52:22.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024824599999999998 2024-04-25T22:52:22.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:22.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023443+0000", 2024-04-25T22:52:22.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048578599999999999 2024-04-25T22:52:22.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:22.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025547+0000", 2024-04-25T22:52:22.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021044789999999998 2024-04-25T22:52:22.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:22.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033509+0000", 2024-04-25T22:52:22.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0079622180000000001 2024-04-25T22:52:22.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:22.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033542+0000", 2024-04-25T22:52:22.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3018000000000001e-05 2024-04-25T22:52:22.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:22.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033566+0000", 2024-04-25T22:52:22.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3197000000000002e-05 2024-04-25T22:52:22.192 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:22.192 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:22.193 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:22.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.193 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:22.193 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:22.193 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.132322667, 2024-04-25T22:52:22.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021122696, 2024-04-25T22:52:22.193 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:22.193 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:22.193 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:22.193 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:22.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.193 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:22.194 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:22.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:22.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.194 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:22.194 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:22.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:22.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.194 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:22.194 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:22.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:52:22.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:22.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012566+0000", 2024-04-25T22:52:22.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-04-25T22:52:22.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:22.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012619+0000", 2024-04-25T22:52:22.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2607e-05 2024-04-25T22:52:22.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:22.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012628+0000", 2024-04-25T22:52:22.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6500000000000008e-06 2024-04-25T22:52:22.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:22.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024024+0000", 2024-04-25T22:52:22.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011396007999999999 2024-04-25T22:52:22.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:22.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024198+0000", 2024-04-25T22:52:22.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000173215 2024-04-25T22:52:22.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:22.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024447+0000", 2024-04-25T22:52:22.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024898500000000002 2024-04-25T22:52:22.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:22.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026431+0000", 2024-04-25T22:52:22.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001984923 2024-04-25T22:52:22.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:22.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033608+0000", 2024-04-25T22:52:22.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071768459999999997 2024-04-25T22:52:22.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:22.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033646+0000", 2024-04-25T22:52:22.198 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299000000000003e-05 2024-04-25T22:52:22.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.198 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:22.198 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033684+0000", 2024-04-25T22:52:22.198 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8773000000000003e-05 2024-04-25T22:52:22.198 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:22.198 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:22.198 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:22.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.198 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:22.198 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:22.198 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.132234067999999, 2024-04-25T22:52:22.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021175381, 2024-04-25T22:52:22.199 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:22.199 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:22.199 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:22.199 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:22.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:22.199 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:22.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:22.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:22.199 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:22.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:22.200 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.200 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.200 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:22.200 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012651+0000", 2024-04-25T22:52:22.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:52:22.200 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.200 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.200 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:22.200 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012656+0000", 2024-04-25T22:52:22.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8899999999999998e-06 2024-04-25T22:52:22.200 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.200 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.200 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:22.201 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012666+0000", 2024-04-25T22:52:22.201 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0346999999999999e-05 2024-04-25T22:52:22.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:22.201 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012675+0000", 2024-04-25T22:52:22.201 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9930000000000001e-06 2024-04-25T22:52:22.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:22.201 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025661+0000", 2024-04-25T22:52:22.201 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01298531 2024-04-25T22:52:22.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:22.202 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025757+0000", 2024-04-25T22:52:22.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5822000000000005e-05 2024-04-25T22:52:22.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.202 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.202 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:22.202 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025907+0000", 2024-04-25T22:52:22.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015051499999999999 2024-04-25T22:52:22.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.202 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.202 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:22.202 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026435+0000", 2024-04-25T22:52:22.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052762200000000005 2024-04-25T22:52:22.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:22.203 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033732+0000", 2024-04-25T22:52:22.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072978419999999997 2024-04-25T22:52:22.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:22.203 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033787+0000", 2024-04-25T22:52:22.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4703999999999997e-05 2024-04-25T22:52:22.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:22.203 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033826+0000", 2024-04-25T22:52:22.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8458999999999999e-05 2024-04-25T22:52:22.203 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:22.204 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:22.204 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:22.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.204 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:22.204 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:22.204 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.132178654000001, 2024-04-25T22:52:22.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021244174000000001, 2024-04-25T22:52:22.204 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:22.204 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:22.204 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:22.204 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:22.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:22.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:22.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:22.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:22.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:22.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:22.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:22.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:22.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:52:22.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:22.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012712+0000", 2024-04-25T22:52:22.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.913e-06 2024-04-25T22:52:22.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:22.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012722+0000", 2024-04-25T22:52:22.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2879999999999998e-06 2024-04-25T22:52:22.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:22.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012727+0000", 2024-04-25T22:52:22.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8429999999999998e-06 2024-04-25T22:52:22.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.207 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:22.207 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026099+0000", 2024-04-25T22:52:22.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013371450999999999 2024-04-25T22:52:22.207 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.207 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:22.207 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026147+0000", 2024-04-25T22:52:22.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7837999999999998e-05 2024-04-25T22:52:22.207 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.207 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:22.207 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026254+0000", 2024-04-25T22:52:22.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107314 2024-04-25T22:52:22.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:22.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026686+0000", 2024-04-25T22:52:22.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000432428 2024-04-25T22:52:22.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:22.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033873+0000", 2024-04-25T22:52:22.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071864399999999997 2024-04-25T22:52:22.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:22.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033904+0000", 2024-04-25T22:52:22.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1321e-05 2024-04-25T22:52:22.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:22.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033950+0000", 2024-04-25T22:52:22.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5707999999999997e-05 2024-04-25T22:52:22.209 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:22.209 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:22.209 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:22.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.209 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:22.209 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:22.209 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.132148269000002, 2024-04-25T22:52:22.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01096505, 2024-04-25T22:52:22.210 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:22.210 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:22.210 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:22.210 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:22.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:22.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:22.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:22.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:22.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:22.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:22.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:22.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012737+0000", 2024-04-25T22:52:22.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:52:22.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:22.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012739+0000", 2024-04-25T22:52:22.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-04-25T22:52:22.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:22.212 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012743+0000", 2024-04-25T22:52:22.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3239999999999996e-06 2024-04-25T22:52:22.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:22.212 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012746+0000", 2024-04-25T22:52:22.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.129e-06 2024-04-25T22:52:22.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:22.212 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012796+0000", 2024-04-25T22:52:22.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9231999999999999e-05 2024-04-25T22:52:22.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.213 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:22.213 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012915+0000", 2024-04-25T22:52:22.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119021 2024-04-25T22:52:22.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.213 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:22.213 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013069+0000", 2024-04-25T22:52:22.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015463900000000001 2024-04-25T22:52:22.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.213 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:22.213 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019237+0000", 2024-04-25T22:52:22.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061680329999999998 2024-04-25T22:52:22.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:22.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023603+0000", 2024-04-25T22:52:22.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043655860000000003 2024-04-25T22:52:22.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:22.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023659+0000", 2024-04-25T22:52:22.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6484000000000003e-05 2024-04-25T22:52:22.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:22.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023701+0000", 2024-04-25T22:52:22.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1761999999999998e-05 2024-04-25T22:52:22.215 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:22.215 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:22.215 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:22.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.215 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:22.215 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:22.215 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.132123321000002, 2024-04-25T22:52:22.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011234429000000001, 2024-04-25T22:52:22.215 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:22.215 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:22.215 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:22.215 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:22.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:22.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:22.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:22.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:22.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:22.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:22.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:22.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012762+0000", 2024-04-25T22:52:22.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-04-25T22:52:22.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:22.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012765+0000", 2024-04-25T22:52:22.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2569999999999999e-06 2024-04-25T22:52:22.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:22.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012783+0000", 2024-04-25T22:52:22.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8431999999999999e-05 2024-04-25T22:52:22.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:22.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012799+0000", 2024-04-25T22:52:22.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5438999999999999e-05 2024-04-25T22:52:22.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:22.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013826+0000", 2024-04-25T22:52:22.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010275060000000001 2024-04-25T22:52:22.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:22.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013913+0000", 2024-04-25T22:52:22.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.708e-05 2024-04-25T22:52:22.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:22.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014098+0000", 2024-04-25T22:52:22.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018519399999999999 2024-04-25T22:52:22.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:22.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019684+0000", 2024-04-25T22:52:22.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055860079999999999 2024-04-25T22:52:22.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:22.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023876+0000", 2024-04-25T22:52:22.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041918800000000003 2024-04-25T22:52:22.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:22.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023957+0000", 2024-04-25T22:52:22.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1165e-05 2024-04-25T22:52:22.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:22.222 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023995+0000", 2024-04-25T22:52:22.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:52:22.222 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:22.222 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:22.222 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:22.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.222 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:22.222 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:22.222 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.132025542000001, 2024-04-25T22:52:22.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011131200000000001, 2024-04-25T22:52:22.222 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:22.223 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:22.223 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:22.223 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:22.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:22.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:22.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:22.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:22.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:22.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:22.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:22.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012860+0000", 2024-04-25T22:52:22.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3900000000000004e-07 2024-04-25T22:52:22.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:22.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012865+0000", 2024-04-25T22:52:22.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5609999999999998e-06 2024-04-25T22:52:22.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:22.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012895+0000", 2024-04-25T22:52:22.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9847000000000001e-05 2024-04-25T22:52:22.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:22.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012905+0000", 2024-04-25T22:52:22.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.03e-05 2024-04-25T22:52:22.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:22.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015020+0000", 2024-04-25T22:52:22.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021142940000000001 2024-04-25T22:52:22.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:22.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015182+0000", 2024-04-25T22:52:22.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016248099999999999 2024-04-25T22:52:22.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:52:22.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015357+0000", 2024-04-25T22:52:22.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017471000000000001 2024-04-25T22:52:22.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:22.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021021+0000", 2024-04-25T22:52:22.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056638340000000004 2024-04-25T22:52:22.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:22.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023712+0000", 2024-04-25T22:52:22.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026910380000000002 2024-04-25T22:52:22.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:22.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023763+0000", 2024-04-25T22:52:22.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1477999999999997e-05 2024-04-25T22:52:22.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:22.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023990+0000", 2024-04-25T22:52:22.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000226818 2024-04-25T22:52:22.227 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:22.227 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:22.227 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:22.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.228 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:22.228 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:22.228 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.131902446000002, 2024-04-25T22:52:22.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011705299000000001, 2024-04-25T22:52:22.228 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:22.228 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:22.228 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:22.228 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:22.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.228 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:22.228 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:22.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:22.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:22.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:22.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:22.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:22.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012983+0000", 2024-04-25T22:52:22.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:52:22.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:22.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012986+0000", 2024-04-25T22:52:22.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5700000000000001e-06 2024-04-25T22:52:22.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:22.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012993+0000", 2024-04-25T22:52:22.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8730000000000001e-06 2024-04-25T22:52:22.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:22.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013000+0000", 2024-04-25T22:52:22.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1890000000000001e-06 2024-04-25T22:52:22.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:22.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:52:22.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002147866 2024-04-25T22:52:22.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:22.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015351+0000", 2024-04-25T22:52:22.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020300799999999999 2024-04-25T22:52:22.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:22.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016260+0000", 2024-04-25T22:52:22.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00090926799999999997 2024-04-25T22:52:22.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:22.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022669+0000", 2024-04-25T22:52:22.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064082849999999997 2024-04-25T22:52:22.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:22.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024584+0000", 2024-04-25T22:52:22.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019151699999999999 2024-04-25T22:52:22.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:22.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024643+0000", 2024-04-25T22:52:22.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8888999999999998e-05 2024-04-25T22:52:22.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:22.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024687+0000", 2024-04-25T22:52:22.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4444999999999999e-05 2024-04-25T22:52:22.233 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:22.233 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:22.233 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:22.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.233 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:22.233 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:22.233 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.131874855, 2024-04-25T22:52:22.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011249699, 2024-04-25T22:52:22.233 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:22.233 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:22.233 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:22.233 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:22.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:22.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:22.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:22.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:22.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:22.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:22.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:22.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013010+0000", 2024-04-25T22:52:22.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2099999999999996e-07 2024-04-25T22:52:22.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:22.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013013+0000", 2024-04-25T22:52:22.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1310000000000002e-06 2024-04-25T22:52:22.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:22.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013020+0000", 2024-04-25T22:52:22.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3330000000000002e-06 2024-04-25T22:52:22.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:22.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013025+0000", 2024-04-25T22:52:22.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6760000000000004e-06 2024-04-25T22:52:22.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:22.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013163+0000", 2024-04-25T22:52:22.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013824599999999999 2024-04-25T22:52:22.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:22.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013504+0000", 2024-04-25T22:52:22.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034080299999999998 2024-04-25T22:52:22.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:22.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013613+0000", 2024-04-25T22:52:22.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108705 2024-04-25T22:52:22.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:22.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015831+0000", 2024-04-25T22:52:22.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002217672 2024-04-25T22:52:22.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:22.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024137+0000", 2024-04-25T22:52:22.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0083060489999999994 2024-04-25T22:52:22.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:22.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024218+0000", 2024-04-25T22:52:22.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1351000000000001e-05 2024-04-25T22:52:22.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:22.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024259+0000", 2024-04-25T22:52:22.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1112000000000002e-05 2024-04-25T22:52:22.238 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:22.238 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:22.238 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:22.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.238 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:22.238 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:22.239 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.131787128999999, 2024-04-25T22:52:22.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020379749999999999, 2024-04-25T22:52:22.239 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:22.239 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:22.239 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:22.239 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:22.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:22.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:22.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:22.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:22.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:22.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:22.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:22.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013098+0000", 2024-04-25T22:52:22.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:52:22.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:22.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013105+0000", 2024-04-25T22:52:22.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5969999999999997e-06 2024-04-25T22:52:22.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:22.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013190+0000", 2024-04-25T22:52:22.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5618999999999995e-05 2024-04-25T22:52:22.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:22.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013200+0000", 2024-04-25T22:52:22.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5859999999999994e-06 2024-04-25T22:52:22.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:22.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020265+0000", 2024-04-25T22:52:22.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070653349999999998 2024-04-25T22:52:22.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:22.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020454+0000", 2024-04-25T22:52:22.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189316 2024-04-25T22:52:22.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:22.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020586+0000", 2024-04-25T22:52:22.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013195700000000001 2024-04-25T22:52:22.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:22.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023822+0000", 2024-04-25T22:52:22.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032358529999999999 2024-04-25T22:52:22.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:22.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033409+0000", 2024-04-25T22:52:22.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095870520000000004 2024-04-25T22:52:22.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:22.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033447+0000", 2024-04-25T22:52:22.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7261999999999997e-05 2024-04-25T22:52:22.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:22.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033477+0000", 2024-04-25T22:52:22.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0389e-05 2024-04-25T22:52:22.243 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:22.244 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:22.244 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:22.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.244 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:22.244 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:22.244 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.131670623000002, 2024-04-25T22:52:22.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010857383999999999, 2024-04-25T22:52:22.244 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:22.244 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:22.244 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:22.244 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:22.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:22.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:22.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:22.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:22.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:22.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:22.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:22.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:22.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:52:22.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:22.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013218+0000", 2024-04-25T22:52:22.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8199999999999998e-06 2024-04-25T22:52:22.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:22.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013226+0000", 2024-04-25T22:52:22.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7649999999999993e-06 2024-04-25T22:52:22.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:22.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013259+0000", 2024-04-25T22:52:22.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2727e-05 2024-04-25T22:52:22.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.247 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:22.247 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014809+0000", 2024-04-25T22:52:22.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001550144 2024-04-25T22:52:22.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.247 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:22.247 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014958+0000", 2024-04-25T22:52:22.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014890300000000001 2024-04-25T22:52:22.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.247 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:52:22.247 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015087+0000", 2024-04-25T22:52:22.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012939200000000001 2024-04-25T22:52:22.248 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.248 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:22.248 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020212+0000", 2024-04-25T22:52:22.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051248939999999996 2024-04-25T22:52:22.248 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.248 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:22.248 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023699+0000", 2024-04-25T22:52:22.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034873289999999999 2024-04-25T22:52:22.248 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.248 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:22.248 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024014+0000", 2024-04-25T22:52:22.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031473999999999999 2024-04-25T22:52:22.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:22.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024071+0000", 2024-04-25T22:52:22.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7040000000000003e-05 2024-04-25T22:52:22.249 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:22.249 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:22.249 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:22.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.249 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:22.249 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:22.249 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.131615918000001, 2024-04-25T22:52:22.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012329677000000001, 2024-04-25T22:52:22.250 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:22.250 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:22.250 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:22.250 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:22.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:22.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:22.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:22.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:22.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:22.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:22.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:22.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013269+0000", 2024-04-25T22:52:22.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5000000000000002e-07 2024-04-25T22:52:22.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:22.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:52:22.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6909999999999999e-06 2024-04-25T22:52:22.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:22.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013284+0000", 2024-04-25T22:52:22.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0963e-05 2024-04-25T22:52:22.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.252 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:22.252 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013361+0000", 2024-04-25T22:52:22.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7379999999999994e-05 2024-04-25T22:52:22.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.252 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:22.252 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013448+0000", 2024-04-25T22:52:22.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6990000000000006e-05 2024-04-25T22:52:22.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.252 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:22.253 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013632+0000", 2024-04-25T22:52:22.253 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018396800000000001 2024-04-25T22:52:22.253 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.253 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.253 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:22.253 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013800+0000", 2024-04-25T22:52:22.253 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167467 2024-04-25T22:52:22.253 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.253 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.253 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:22.253 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.018570+0000", 2024-04-25T22:52:22.253 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047701460000000003 2024-04-25T22:52:22.253 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.253 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:22.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025507+0000", 2024-04-25T22:52:22.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069372039999999998 2024-04-25T22:52:22.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:22.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025562+0000", 2024-04-25T22:52:22.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4858999999999998e-05 2024-04-25T22:52:22.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:22.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025598+0000", 2024-04-25T22:52:22.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6259e-05 2024-04-25T22:52:22.254 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:22.255 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:22.255 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:22.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.255 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:22.255 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:22.255 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.131484045000001, 2024-04-25T22:52:22.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020176666999999999, 2024-04-25T22:52:22.255 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:22.255 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:22.255 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:52:22.255 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:22.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.256 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:22.256 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:22.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:22.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.256 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:22.256 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:22.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:22.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.256 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:22.256 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:52:22.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-04-25T22:52:22.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.257 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:22.257 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013405+0000", 2024-04-25T22:52:22.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0559999999999998e-06 2024-04-25T22:52:22.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.257 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:22.257 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013422+0000", 2024-04-25T22:52:22.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6770999999999999e-05 2024-04-25T22:52:22.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.257 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:22.257 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013431+0000", 2024-04-25T22:52:22.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5019999999999998e-06 2024-04-25T22:52:22.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:22.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021720+0000", 2024-04-25T22:52:22.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082884340000000008 2024-04-25T22:52:22.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:22.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022122+0000", 2024-04-25T22:52:22.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000401634 2024-04-25T22:52:22.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:22.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:22.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:22.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033577+0000", 2024-04-25T22:52:22.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011455435999999999 2024-04-25T22:52:22.259 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:22.259 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:22.259 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:22.259 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:22.259 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:22.259 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:22.261 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:52:22.261 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:22.260+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:22.361 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:22.361+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:22.375 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-25T22:52:22.375 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-25T22:52:22.375 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-25T22:52:22.375 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-25T22:52:22.384 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:52:22.463 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:22.462+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:22.486 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-25T22:52:22.486 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-25T22:52:22.486 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-25T22:52:22.486 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-25T22:52:22.486 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-25T22:52:22.495 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:52:22.564 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:22.564+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:22.599 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-25T22:52:22.599 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-25T22:52:22.599 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-25T22:52:22.599 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-25T22:52:22.599 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.599 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(mds.0.3:28 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:52:22.599 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.013845+0000", 2024-04-25T22:52:22.600 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.583624515, 2024-04-25T22:52:22.600 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002002658, 2024-04-25T22:52:22.600 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:22.600 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:22.600 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:22.600 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:22.600 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.600 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:22.600 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013845+0000", 2024-04-25T22:52:22.600 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:22.600 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.600 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.600 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:22.600 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013845+0000", 2024-04-25T22:52:22.601 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:22.601 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.601 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.601 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:22.601 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013845+0000", 2024-04-25T22:52:22.601 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6100000000000002e-07 2024-04-25T22:52:22.601 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.601 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.601 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:22.601 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013859+0000", 2024-04-25T22:52:22.601 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4045e-05 2024-04-25T22:52:22.601 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.601 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.601 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:22.602 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013883+0000", 2024-04-25T22:52:22.602 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4020999999999999e-05 2024-04-25T22:52:22.602 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.602 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.602 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:22.602 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013904+0000", 2024-04-25T22:52:22.602 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.084e-05 2024-04-25T22:52:22.602 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.602 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.602 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:22.602 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013953+0000", 2024-04-25T22:52:22.602 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8652000000000001e-05 2024-04-25T22:52:22.602 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.603 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.603 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:22.603 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013983+0000", 2024-04-25T22:52:22.603 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0083e-05 2024-04-25T22:52:22.603 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.603 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.603 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:22.603 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015809+0000", 2024-04-25T22:52:22.603 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001826708 2024-04-25T22:52:22.603 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.603 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.603 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:22.603 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015848+0000", 2024-04-25T22:52:22.603 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8047999999999999e-05 2024-04-25T22:52:22.603 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:22.604 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:22.604 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:22.604 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.604 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.604 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:22.604 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.014834+0000", 2024-04-25T22:52:22.604 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.58263492, 2024-04-25T22:52:22.604 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0082660119999999997, 2024-04-25T22:52:22.604 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:22.604 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:22.604 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:22.604 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:22.604 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.604 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:22.605 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014834+0000", 2024-04-25T22:52:22.605 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:22.605 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.605 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.605 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:22.605 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014834+0000", 2024-04-25T22:52:22.605 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:22.605 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.605 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.605 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:22.605 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014837+0000", 2024-04-25T22:52:22.605 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.774e-06 2024-04-25T22:52:22.605 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.605 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.606 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:22.606 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014844+0000", 2024-04-25T22:52:22.606 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.1629999999999999e-06 2024-04-25T22:52:22.606 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.606 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.606 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:22.606 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014853+0000", 2024-04-25T22:52:22.606 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0829999999999993e-06 2024-04-25T22:52:22.606 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.606 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.606 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:22.606 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014862+0000", 2024-04-25T22:52:22.606 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0239999999999997e-06 2024-04-25T22:52:22.607 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.607 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.607 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:22.607 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014926+0000", 2024-04-25T22:52:22.607 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4571000000000002e-05 2024-04-25T22:52:22.607 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.607 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.607 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:22.607 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015064+0000", 2024-04-25T22:52:22.607 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013788200000000001 2024-04-25T22:52:22.607 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.607 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.607 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:22.607 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015240+0000", 2024-04-25T22:52:22.607 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000175697 2024-04-25T22:52:22.608 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.608 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.608 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:22.608 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017382+0000", 2024-04-25T22:52:22.608 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021422920000000001 2024-04-25T22:52:22.608 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.608 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.608 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:22.608 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023016+0000", 2024-04-25T22:52:22.608 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00563446 2024-04-25T22:52:22.608 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.608 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.608 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:22.608 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023062+0000", 2024-04-25T22:52:22.608 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5667999999999997e-05 2024-04-25T22:52:22.609 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.609 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.609 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:22.609 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023100+0000", 2024-04-25T22:52:22.609 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8398000000000001e-05 2024-04-25T22:52:22.609 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:22.609 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:22.609 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:22.609 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.609 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.609 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:22.609 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.014883+0000", 2024-04-25T22:52:22.609 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.582586702, 2024-04-25T22:52:22.609 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0083115319999999999, 2024-04-25T22:52:22.609 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:22.610 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:22.610 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:22.610 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:22.610 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.610 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:22.610 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014883+0000", 2024-04-25T22:52:22.610 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:22.610 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.610 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.610 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:22.610 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014883+0000", 2024-04-25T22:52:22.610 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:22.610 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.611 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.611 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:22.611 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014883+0000", 2024-04-25T22:52:22.611 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1200000000000003e-07 2024-04-25T22:52:22.611 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.611 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.611 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:22.611 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014887+0000", 2024-04-25T22:52:22.611 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4249999999999998e-06 2024-04-25T22:52:22.611 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.611 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.611 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:22.611 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014892+0000", 2024-04-25T22:52:22.611 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1150000000000002e-06 2024-04-25T22:52:22.612 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.612 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.612 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:22.612 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014896+0000", 2024-04-25T22:52:22.612 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3030000000000001e-06 2024-04-25T22:52:22.612 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.612 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.612 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:22.612 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015597+0000", 2024-04-25T22:52:22.612 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00070106400000000005 2024-04-25T22:52:22.612 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.612 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.612 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:22.613 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015681+0000", 2024-04-25T22:52:22.613 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.3417000000000004e-05 2024-04-25T22:52:22.613 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.613 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.613 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:22.613 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015800+0000", 2024-04-25T22:52:22.613 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000119522 2024-04-25T22:52:22.613 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.613 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.613 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:22.613 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017389+0000", 2024-04-25T22:52:22.613 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0015889739999999999 2024-04-25T22:52:22.613 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.613 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.614 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:22.614 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023129+0000", 2024-04-25T22:52:22.614 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0057398420000000002 2024-04-25T22:52:22.614 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.614 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.614 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:22.614 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023161+0000", 2024-04-25T22:52:22.614 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2002999999999998e-05 2024-04-25T22:52:22.614 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.614 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.614 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:22.614 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023194+0000", 2024-04-25T22:52:22.614 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3355000000000002e-05 2024-04-25T22:52:22.615 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:22.615 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:22.615 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:22.615 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.615 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.615 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:22.615 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.014902+0000", 2024-04-25T22:52:22.615 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.582567056999999, 2024-04-25T22:52:22.615 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0078159460000000007, 2024-04-25T22:52:22.615 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:22.615 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:22.615 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:22.615 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:22.615 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.616 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:22.616 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014902+0000", 2024-04-25T22:52:22.616 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:22.616 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.616 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.616 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:22.616 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014902+0000", 2024-04-25T22:52:22.616 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:22.616 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.616 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.616 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:22.616 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014903+0000", 2024-04-25T22:52:22.616 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.65e-07 2024-04-25T22:52:22.617 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.617 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.617 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:22.617 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014910+0000", 2024-04-25T22:52:22.617 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7619999999999995e-06 2024-04-25T22:52:22.617 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.617 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.617 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:22.617 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014915+0000", 2024-04-25T22:52:22.617 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2660000000000003e-06 2024-04-25T22:52:22.617 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.617 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.617 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:22.617 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014918+0000", 2024-04-25T22:52:22.617 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.331e-06 2024-04-25T22:52:22.618 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.618 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.618 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:22.618 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015554+0000", 2024-04-25T22:52:22.618 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00063627599999999996 2024-04-25T22:52:22.618 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.618 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.618 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:22.618 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015685+0000", 2024-04-25T22:52:22.618 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013059399999999999 2024-04-25T22:52:22.618 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.618 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.618 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:22.619 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015820+0000", 2024-04-25T22:52:22.619 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013471499999999999 2024-04-25T22:52:22.619 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.619 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.619 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:22.619 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017394+0000", 2024-04-25T22:52:22.619 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0015747459999999999 2024-04-25T22:52:22.619 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.619 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.619 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:22.619 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022598+0000", 2024-04-25T22:52:22.619 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.005203811 2024-04-25T22:52:22.619 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.619 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.620 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:22.620 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022671+0000", 2024-04-25T22:52:22.620 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3042999999999998e-05 2024-04-25T22:52:22.620 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.620 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.620 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:22.620 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022718+0000", 2024-04-25T22:52:22.620 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7136999999999999e-05 2024-04-25T22:52:22.620 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:22.620 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:22.620 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:22.620 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.620 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.620 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:22.621 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.014933+0000", 2024-04-25T22:52:22.621 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.582536683000001, 2024-04-25T22:52:22.621 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079271519999999998, 2024-04-25T22:52:22.621 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:22.621 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:22.621 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:22.621 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:22.621 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.621 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:22.621 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014933+0000", 2024-04-25T22:52:22.621 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:22.621 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.621 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.621 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:22.622 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014933+0000", 2024-04-25T22:52:22.622 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:22.622 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.622 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.622 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:22.622 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014933+0000", 2024-04-25T22:52:22.622 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0999999999999999e-07 2024-04-25T22:52:22.622 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.622 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.622 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:22.622 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014937+0000", 2024-04-25T22:52:22.622 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6090000000000001e-06 2024-04-25T22:52:22.622 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.622 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.623 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:22.623 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014943+0000", 2024-04-25T22:52:22.623 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.7100000000000001e-06 2024-04-25T22:52:22.623 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.623 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.623 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:22.623 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014949+0000", 2024-04-25T22:52:22.623 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9410000000000004e-06 2024-04-25T22:52:22.623 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.623 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.623 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:22.623 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016135+0000", 2024-04-25T22:52:22.623 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0011854750000000001 2024-04-25T22:52:22.623 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.623 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.624 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:22.624 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016185+0000", 2024-04-25T22:52:22.625 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.9888000000000001e-05 2024-04-25T22:52:22.625 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.625 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.625 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:22.626 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016297+0000", 2024-04-25T22:52:22.626 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011231299999999999 2024-04-25T22:52:22.626 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.626 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.626 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:22.626 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017399+0000", 2024-04-25T22:52:22.626 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0011018149999999999 2024-04-25T22:52:22.626 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.626 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.626 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:22.626 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022764+0000", 2024-04-25T22:52:22.626 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0053649819999999999 2024-04-25T22:52:22.626 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.627 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.627 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:22.627 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022821+0000", 2024-04-25T22:52:22.627 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7655000000000003e-05 2024-04-25T22:52:22.627 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.627 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.627 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:22.627 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022860+0000", 2024-04-25T22:52:22.627 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8353999999999999e-05 2024-04-25T22:52:22.627 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:22.627 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:22.627 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:22.627 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.627 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.628 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:22.628 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.014957+0000", 2024-04-25T22:52:22.628 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.582512852000001, 2024-04-25T22:52:22.628 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0083856810000000007, 2024-04-25T22:52:22.628 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:22.628 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:22.628 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:22.628 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:22.628 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.628 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:22.628 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014957+0000", 2024-04-25T22:52:22.628 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:22.628 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.629 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.629 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:22.629 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014957+0000", 2024-04-25T22:52:22.629 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:22.629 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.629 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.629 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:22.629 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014957+0000", 2024-04-25T22:52:22.629 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:52:22.629 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.629 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.629 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:22.629 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014961+0000", 2024-04-25T22:52:22.629 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2309999999999998e-06 2024-04-25T22:52:22.630 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.630 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.630 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:22.630 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014969+0000", 2024-04-25T22:52:22.630 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2540000000000003e-06 2024-04-25T22:52:22.630 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.630 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.630 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:22.630 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014972+0000", 2024-04-25T22:52:22.630 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4580000000000002e-06 2024-04-25T22:52:22.630 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.630 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.630 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:22.630 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016130+0000", 2024-04-25T22:52:22.631 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001157812 2024-04-25T22:52:22.631 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.631 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.631 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:22.631 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016247+0000", 2024-04-25T22:52:22.631 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000117268 2024-04-25T22:52:22.631 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.631 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.631 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:22.631 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016381+0000", 2024-04-25T22:52:22.631 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013417999999999999 2024-04-25T22:52:22.631 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.631 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.632 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:22.632 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017946+0000", 2024-04-25T22:52:22.632 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001564817 2024-04-25T22:52:22.632 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.632 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.632 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:22.632 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023240+0000", 2024-04-25T22:52:22.632 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0052938289999999999 2024-04-25T22:52:22.632 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.632 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.632 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:22.632 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023295+0000", 2024-04-25T22:52:22.632 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4969999999999997e-05 2024-04-25T22:52:22.632 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.633 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.633 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:22.633 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023342+0000", 2024-04-25T22:52:22.633 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7126000000000002e-05 2024-04-25T22:52:22.633 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:22.633 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:22.633 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:22.633 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.633 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.633 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:22.633 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.014978+0000", 2024-04-25T22:52:22.633 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.582491734000001, 2024-04-25T22:52:22.633 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0074058609999999997, 2024-04-25T22:52:22.633 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:22.633 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:22.634 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:22.634 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:22.634 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.634 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:22.634 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014978+0000", 2024-04-25T22:52:22.634 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:22.634 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.634 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.634 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:22.634 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014978+0000", 2024-04-25T22:52:22.635 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:22.635 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.635 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.635 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:22.635 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014978+0000", 2024-04-25T22:52:22.635 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0600000000000001e-07 2024-04-25T22:52:22.635 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.635 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.635 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:22.635 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014980+0000", 2024-04-25T22:52:22.635 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3130000000000001e-06 2024-04-25T22:52:22.635 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.635 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.636 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:22.636 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014984+0000", 2024-04-25T22:52:22.636 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6689999999999999e-06 2024-04-25T22:52:22.636 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.636 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.636 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:22.636 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014987+0000", 2024-04-25T22:52:22.636 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0709999999999999e-06 2024-04-25T22:52:22.636 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.636 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.636 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:22.636 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015035+0000", 2024-04-25T22:52:22.636 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7737000000000001e-05 2024-04-25T22:52:22.636 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.637 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.637 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:22.637 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:52:22.637 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113053 2024-04-25T22:52:22.637 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.637 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.637 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:22.637 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015255+0000", 2024-04-25T22:52:22.637 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010735599999999999 2024-04-25T22:52:22.637 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.637 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.637 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:22.637 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016248+0000", 2024-04-25T22:52:22.638 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00099310200000000005 2024-04-25T22:52:22.638 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.638 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.638 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:22.638 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022282+0000", 2024-04-25T22:52:22.638 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060341769999999999 2024-04-25T22:52:22.638 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.638 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.638 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:22.638 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022341+0000", 2024-04-25T22:52:22.638 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8938999999999999e-05 2024-04-25T22:52:22.638 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.638 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.639 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:22.639 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022384+0000", 2024-04-25T22:52:22.639 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2138000000000002e-05 2024-04-25T22:52:22.639 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:22.639 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:22.639 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:22.639 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.639 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.639 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:22.639 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.014995+0000", 2024-04-25T22:52:22.639 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.582473991000001, 2024-04-25T22:52:22.639 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075678170000000001, 2024-04-25T22:52:22.639 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:22.639 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:22.639 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-25T22:52:22.640 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:22.640 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.640 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:22.640 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014995+0000", 2024-04-25T22:52:22.640 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:22.640 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.640 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.640 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:22.640 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014995+0000", 2024-04-25T22:52:22.640 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:22.640 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.640 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.640 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:22.641 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014996+0000", 2024-04-25T22:52:22.641 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7500000000000001e-07 2024-04-25T22:52:22.641 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.641 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.641 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:22.641 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014998+0000", 2024-04-25T22:52:22.641 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2330000000000001e-06 2024-04-25T22:52:22.641 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.641 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.641 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:22.641 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015002+0000", 2024-04-25T22:52:22.641 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9570000000000004e-06 2024-04-25T22:52:22.641 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.641 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.642 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:22.642 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015008+0000", 2024-04-25T22:52:22.642 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0340000000000002e-06 2024-04-25T22:52:22.642 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.642 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.642 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:22.642 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015476+0000", 2024-04-25T22:52:22.642 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00046806899999999999 2024-04-25T22:52:22.642 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.642 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.642 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:22.642 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015565+0000", 2024-04-25T22:52:22.642 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.9126e-05 2024-04-25T22:52:22.643 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.643 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.643 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:22.643 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022563+0000", 2024-04-25T22:52:22.643 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0069981230000000002 2024-04-25T22:52:22.643 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:22.643 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:22.643 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:22.643 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.643 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.643 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:22.643 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.015033+0000", 2024-04-25T22:52:22.643 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.582435937, 2024-04-25T22:52:22.643 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010204922999999999, 2024-04-25T22:52:22.644 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:22.644 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:22.644 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-25T22:52:22.644 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:22.644 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.644 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:22.644 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015033+0000", 2024-04-25T22:52:22.644 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:22.644 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.644 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.644 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:22.644 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015033+0000", 2024-04-25T22:52:22.644 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:22.644 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.644 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.645 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:22.645 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015036+0000", 2024-04-25T22:52:22.645 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9110000000000002e-06 2024-04-25T22:52:22.645 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.645 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.645 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:22.645 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015040+0000", 2024-04-25T22:52:22.645 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0570000000000003e-06 2024-04-25T22:52:22.645 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.645 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.645 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:22.645 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015050+0000", 2024-04-25T22:52:22.645 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1449999999999997e-06 2024-04-25T22:52:22.646 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.646 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.646 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:22.646 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015058+0000", 2024-04-25T22:52:22.646 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.3960000000000006e-06 2024-04-25T22:52:22.646 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.646 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.646 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:22.646 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016951+0000", 2024-04-25T22:52:22.646 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0018930150000000001 2024-04-25T22:52:22.646 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.646 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.646 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:22.646 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017101+0000", 2024-04-25T22:52:22.647 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00015004800000000001 2024-04-25T22:52:22.647 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.647 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.647 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:22.647 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.025238+0000", 2024-04-25T22:52:22.647 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0081373509999999993 2024-04-25T22:52:22.647 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:22.647 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:22.647 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:22.647 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.647 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.647 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:22.647 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.015069+0000", 2024-04-25T22:52:22.647 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.582400003, 2024-04-25T22:52:22.648 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0066281769999999999, 2024-04-25T22:52:22.648 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:22.648 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:22.648 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-25T22:52:22.648 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:22.648 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.648 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:22.648 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015069+0000", 2024-04-25T22:52:22.648 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:22.648 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.648 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.648 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:22.648 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015069+0000", 2024-04-25T22:52:22.648 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:22.648 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.649 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.649 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:22.649 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015070+0000", 2024-04-25T22:52:22.649 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8899999999999999e-07 2024-04-25T22:52:22.649 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.649 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.649 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:22.649 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015082+0000", 2024-04-25T22:52:22.649 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.164e-05 2024-04-25T22:52:22.649 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.649 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.649 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:22.649 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015093+0000", 2024-04-25T22:52:22.649 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1066e-05 2024-04-25T22:52:22.649 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.650 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.650 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:22.650 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015099+0000", 2024-04-25T22:52:22.650 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8619999999999999e-06 2024-04-25T22:52:22.650 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.650 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.650 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:22.650 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:52:22.650 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.9821000000000003e-05 2024-04-25T22:52:22.650 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.650 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.650 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:22.650 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015221+0000", 2024-04-25T22:52:22.651 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2868999999999996e-05 2024-04-25T22:52:22.651 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.651 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.651 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:22.651 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021698+0000", 2024-04-25T22:52:22.651 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064762300000000004 2024-04-25T22:52:22.651 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:22.651 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:22.651 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:22.651 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.651 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.651 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:52:22.651 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.016597+0000", 2024-04-25T22:52:22.651 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.580872361000001, 2024-04-25T22:52:22.651 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001422113, 2024-04-25T22:52:22.652 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:22.652 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:22.652 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:22.652 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:22.652 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.652 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:22.652 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016597+0000", 2024-04-25T22:52:22.652 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:22.652 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.652 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.652 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:22.652 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016597+0000", 2024-04-25T22:52:22.652 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:22.652 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.652 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.653 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:22.653 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016598+0000", 2024-04-25T22:52:22.653 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2900000000000004e-07 2024-04-25T22:52:22.653 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.653 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.653 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:22.653 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016616+0000", 2024-04-25T22:52:22.653 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8876e-05 2024-04-25T22:52:22.653 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.653 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.653 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:22.653 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016626+0000", 2024-04-25T22:52:22.653 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.8900000000000002e-06 2024-04-25T22:52:22.653 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.653 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.654 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:22.654 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016634+0000", 2024-04-25T22:52:22.654 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7060000000000004e-06 2024-04-25T22:52:22.654 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.654 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.654 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:22.654 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016706+0000", 2024-04-25T22:52:22.654 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2102999999999997e-05 2024-04-25T22:52:22.654 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.654 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.654 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:22.654 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016727+0000", 2024-04-25T22:52:22.654 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0687e-05 2024-04-25T22:52:22.655 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.655 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.655 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:22.655 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017972+0000", 2024-04-25T22:52:22.655 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0012454829999999999 2024-04-25T22:52:22.655 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.655 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.655 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:22.655 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.018019+0000", 2024-04-25T22:52:22.655 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6839000000000003e-05 2024-04-25T22:52:22.655 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:22.655 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:22.655 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:22.655 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.655 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.656 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-25T22:52:22.656 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.016652+0000", 2024-04-25T22:52:22.656 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.580817747000001, 2024-04-25T22:52:22.656 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004473599, 2024-04-25T22:52:22.656 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:22.656 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:22.656 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:22.656 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:22.656 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.656 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:22.656 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016652+0000", 2024-04-25T22:52:22.656 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:22.656 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.657 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.657 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:22.657 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016652+0000", 2024-04-25T22:52:22.657 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:22.657 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.657 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.657 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:22.657 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016652+0000", 2024-04-25T22:52:22.657 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1899999999999998e-07 2024-04-25T22:52:22.657 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.657 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.657 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:22.657 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016657+0000", 2024-04-25T22:52:22.657 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4680000000000003e-06 2024-04-25T22:52:22.658 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.658 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.658 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:22.658 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016664+0000", 2024-04-25T22:52:22.658 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8210000000000002e-06 2024-04-25T22:52:22.658 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.658 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.658 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:22.658 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016669+0000", 2024-04-25T22:52:22.658 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8520000000000003e-06 2024-04-25T22:52:22.658 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.658 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.658 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:22.658 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016779+0000", 2024-04-25T22:52:22.659 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000109444 2024-04-25T22:52:22.659 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.659 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.659 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:22.659 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016798+0000", 2024-04-25T22:52:22.659 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9799000000000001e-05 2024-04-25T22:52:22.659 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.659 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.659 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:22.659 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021086+0000", 2024-04-25T22:52:22.659 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042879889999999999 2024-04-25T22:52:22.659 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.659 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.659 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:22.660 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021125+0000", 2024-04-25T22:52:22.660 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8807000000000003e-05 2024-04-25T22:52:22.660 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:22.660 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:22.660 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:22.660 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.660 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.660 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-25T22:52:22.660 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.016733+0000", 2024-04-25T22:52:22.660 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.580736848000001, 2024-04-25T22:52:22.660 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004231612, 2024-04-25T22:52:22.660 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:22.660 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:22.661 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:22.661 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:22.661 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.661 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:22.661 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016733+0000", 2024-04-25T22:52:22.661 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:22.661 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.661 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.661 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:22.661 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016733+0000", 2024-04-25T22:52:22.661 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:22.661 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.661 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.661 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:22.662 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016733+0000", 2024-04-25T22:52:22.662 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2100000000000002e-07 2024-04-25T22:52:22.662 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.662 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.662 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:22.662 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016756+0000", 2024-04-25T22:52:22.662 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2886000000000001e-05 2024-04-25T22:52:22.662 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.662 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.662 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:22.662 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016765+0000", 2024-04-25T22:52:22.662 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.3610000000000007e-06 2024-04-25T22:52:22.662 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.662 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.663 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:22.663 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016771+0000", 2024-04-25T22:52:22.663 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0020000000000003e-06 2024-04-25T22:52:22.663 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.663 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.663 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:22.663 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017050+0000", 2024-04-25T22:52:22.663 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00027877199999999999 2024-04-25T22:52:22.663 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.663 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.663 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:22.663 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017067+0000", 2024-04-25T22:52:22.663 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7499e-05 2024-04-25T22:52:22.664 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.664 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.664 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:22.664 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.020921+0000", 2024-04-25T22:52:22.664 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003853123 2024-04-25T22:52:22.664 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.664 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.664 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:22.664 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.020964+0000", 2024-04-25T22:52:22.664 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3547999999999997e-05 2024-04-25T22:52:22.664 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:22.664 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:22.664 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:22.664 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.664 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.665 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 1 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:52:22.665 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.019562+0000", 2024-04-25T22:52:22.665 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.577907803999999, 2024-04-25T22:52:22.665 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0045866930000000002, 2024-04-25T22:52:22.665 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:22.665 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:22.665 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "reached pg", 2024-04-25T22:52:22.665 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:22.665 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.665 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:22.665 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.019562+0000", 2024-04-25T22:52:22.665 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:22.665 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.665 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.665 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:22.666 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.019562+0000", 2024-04-25T22:52:22.666 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:22.666 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.666 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.666 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:22.666 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.019562+0000", 2024-04-25T22:52:22.666 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0100000000000005e-07 2024-04-25T22:52:22.666 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.666 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.666 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:22.666 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.019570+0000", 2024-04-25T22:52:22.666 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5599999999999996e-06 2024-04-25T22:52:22.666 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.666 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.667 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:22.667 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.019586+0000", 2024-04-25T22:52:22.667 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6086000000000002e-05 2024-04-25T22:52:22.667 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.667 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.667 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:22.667 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.019600+0000", 2024-04-25T22:52:22.667 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3934000000000001e-05 2024-04-25T22:52:22.667 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.667 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.667 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:22.667 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.019889+0000", 2024-04-25T22:52:22.667 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00028888200000000002 2024-04-25T22:52:22.668 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.668 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.668 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:22.668 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.024148+0000", 2024-04-25T22:52:22.668 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042597299999999998 2024-04-25T22:52:22.668 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:22.668 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:22.668 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:22.668 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.668 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.668 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-25T22:52:22.668 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.021542+0000", 2024-04-25T22:52:22.668 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.575927549999999, 2024-04-25T22:52:22.668 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001339589, 2024-04-25T22:52:22.668 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:22.669 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:22.669 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-25T22:52:22.669 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:22.669 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.669 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:22.669 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021542+0000", 2024-04-25T22:52:22.669 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:22.669 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.669 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.669 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:22.669 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021542+0000", 2024-04-25T22:52:22.669 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:22.669 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.670 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.670 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:22.670 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021542+0000", 2024-04-25T22:52:22.670 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1600000000000002e-07 2024-04-25T22:52:22.670 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.670 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.670 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:22.670 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021545+0000", 2024-04-25T22:52:22.670 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.774e-06 2024-04-25T22:52:22.670 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.670 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.670 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:22.670 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021553+0000", 2024-04-25T22:52:22.671 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.2099999999999993e-06 2024-04-25T22:52:22.671 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.671 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.671 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:22.671 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021559+0000", 2024-04-25T22:52:22.671 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.1249999999999998e-06 2024-04-25T22:52:22.671 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.671 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.671 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:22.671 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022752+0000", 2024-04-25T22:52:22.671 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0011931120000000001 2024-04-25T22:52:22.671 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.671 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.671 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:22.672 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022759+0000", 2024-04-25T22:52:22.672 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4420000000000003e-06 2024-04-25T22:52:22.672 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.672 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.672 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:22.672 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022881+0000", 2024-04-25T22:52:22.672 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012250999999999999 2024-04-25T22:52:22.672 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:22.672 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:22.672 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:22.672 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.672 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.672 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e14/12 ondisk, result = 0)", 2024-04-25T22:52:22.672 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.021769+0000", 2024-04-25T22:52:22.673 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.575700286, 2024-04-25T22:52:22.673 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001336928, 2024-04-25T22:52:22.673 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:22.673 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:22.673 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-25T22:52:22.673 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:22.673 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.673 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:22.673 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021769+0000", 2024-04-25T22:52:22.673 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:22.673 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.673 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.673 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:22.673 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021769+0000", 2024-04-25T22:52:22.674 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:22.674 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.674 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.674 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:22.674 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021770+0000", 2024-04-25T22:52:22.674 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7700000000000005e-07 2024-04-25T22:52:22.674 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.674 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.674 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:22.674 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021773+0000", 2024-04-25T22:52:22.674 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5250000000000001e-06 2024-04-25T22:52:22.674 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.674 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.675 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:22.675 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021780+0000", 2024-04-25T22:52:22.675 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.187e-06 2024-04-25T22:52:22.675 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.675 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.675 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:22.675 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021796+0000", 2024-04-25T22:52:22.675 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5218000000000001e-05 2024-04-25T22:52:22.675 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.675 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.675 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:22.675 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023001+0000", 2024-04-25T22:52:22.675 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001205993 2024-04-25T22:52:22.676 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.676 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.676 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:22.676 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023009+0000", 2024-04-25T22:52:22.676 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9249999999999995e-06 2024-04-25T22:52:22.676 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.676 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.676 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:22.676 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023106+0000", 2024-04-25T22:52:22.676 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6602999999999996e-05 2024-04-25T22:52:22.676 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:22.676 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:22.676 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:22.676 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.677 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.677 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-25T22:52:22.677 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.021807+0000", 2024-04-25T22:52:22.677 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.575661895, 2024-04-25T22:52:22.677 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0013936809999999999, 2024-04-25T22:52:22.677 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:22.677 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:22.677 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-25T22:52:22.677 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:22.677 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.677 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:22.677 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021807+0000", 2024-04-25T22:52:22.677 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:22.677 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.677 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.678 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:22.678 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021807+0000", 2024-04-25T22:52:22.678 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:22.678 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.678 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.678 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:22.678 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021808+0000", 2024-04-25T22:52:22.678 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3200000000000001e-07 2024-04-25T22:52:22.678 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.678 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.678 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:22.678 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021811+0000", 2024-04-25T22:52:22.678 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5480000000000002e-06 2024-04-25T22:52:22.679 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.679 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.679 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:22.679 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021818+0000", 2024-04-25T22:52:22.679 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4450000000000001e-06 2024-04-25T22:52:22.679 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.679 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.679 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:22.679 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021823+0000", 2024-04-25T22:52:22.679 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.22e-06 2024-04-25T22:52:22.679 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.679 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.679 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:22.679 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023122+0000", 2024-04-25T22:52:22.679 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001298808 2024-04-25T22:52:22.680 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.680 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.680 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:22.680 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023126+0000", 2024-04-25T22:52:22.680 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9400000000000004e-06 2024-04-25T22:52:22.680 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.680 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.680 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:22.680 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023201+0000", 2024-04-25T22:52:22.680 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5388000000000004e-05 2024-04-25T22:52:22.680 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:22.680 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:22.680 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:22.680 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.681 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.681 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-25T22:52:22.681 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.022040+0000", 2024-04-25T22:52:22.681 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.575429482000001, 2024-04-25T22:52:22.681 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0013084100000000001, 2024-04-25T22:52:22.681 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:22.681 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:22.681 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-25T22:52:22.681 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:22.681 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.681 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:22.681 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022040+0000", 2024-04-25T22:52:22.681 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:22.681 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.682 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.682 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:22.682 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022040+0000", 2024-04-25T22:52:22.682 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:22.682 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.682 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.682 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:22.682 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022040+0000", 2024-04-25T22:52:22.682 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9999999999999999e-07 2024-04-25T22:52:22.682 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.682 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.682 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:22.682 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022043+0000", 2024-04-25T22:52:22.683 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.362e-06 2024-04-25T22:52:22.683 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.683 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.683 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:22.683 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022049+0000", 2024-04-25T22:52:22.683 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.947e-06 2024-04-25T22:52:22.683 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.683 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.683 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:22.683 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022055+0000", 2024-04-25T22:52:22.683 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.1909999999999997e-06 2024-04-25T22:52:22.683 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.683 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.683 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:22.683 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023227+0000", 2024-04-25T22:52:22.684 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0011720820000000001 2024-04-25T22:52:22.684 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.684 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.684 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:22.684 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023235+0000", 2024-04-25T22:52:22.684 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.2330000000000006e-06 2024-04-25T22:52:22.684 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.684 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.684 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:22.684 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023348+0000", 2024-04-25T22:52:22.684 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011329500000000001 2024-04-25T22:52:22.684 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:22.684 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:22.684 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:22.685 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.685 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.685 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-25T22:52:22.685 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:55.010264+0000", 2024-04-25T22:52:22.685 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 27.587205714, 2024-04-25T22:52:22.685 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001484476, 2024-04-25T22:52:22.685 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:22.685 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:22.685 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:22.685 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:22.685 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.685 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:22.685 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010264+0000", 2024-04-25T22:52:22.686 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:22.686 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.686 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.686 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:22.686 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010264+0000", 2024-04-25T22:52:22.686 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:22.686 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.686 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.686 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:22.686 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010265+0000", 2024-04-25T22:52:22.686 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5e-06 2024-04-25T22:52:22.686 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.686 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.686 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:22.687 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010272+0000", 2024-04-25T22:52:22.687 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0910000000000004e-06 2024-04-25T22:52:22.687 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.687 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.687 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:22.687 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010287+0000", 2024-04-25T22:52:22.687 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4644000000000001e-05 2024-04-25T22:52:22.687 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.687 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.687 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:22.687 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010296+0000", 2024-04-25T22:52:22.687 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2159999999999995e-06 2024-04-25T22:52:22.687 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.688 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.688 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:22.688 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010394+0000", 2024-04-25T22:52:22.688 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.8148999999999998e-05 2024-04-25T22:52:22.688 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.688 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.688 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:22.688 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010503+0000", 2024-04-25T22:52:22.688 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000108857 2024-04-25T22:52:22.688 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.688 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.688 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:22.688 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010592+0000", 2024-04-25T22:52:22.688 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.9083000000000001e-05 2024-04-25T22:52:22.689 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.689 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.689 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:22.689 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.011161+0000", 2024-04-25T22:52:22.689 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00056919800000000003 2024-04-25T22:52:22.689 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.689 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.689 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:22.689 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.011676+0000", 2024-04-25T22:52:22.689 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00051500999999999999 2024-04-25T22:52:22.689 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.689 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.689 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:22.690 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.011717+0000", 2024-04-25T22:52:22.690 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0262999999999997e-05 2024-04-25T22:52:22.690 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.690 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.690 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:22.690 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.011748+0000", 2024-04-25T22:52:22.690 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1464999999999998e-05 2024-04-25T22:52:22.690 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:22.690 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:22.690 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:22.690 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.690 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.690 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-25T22:52:22.691 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:52:17.012790+0000", 2024-04-25T22:52:22.691 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 5.5846798700000004, 2024-04-25T22:52:22.691 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001434444, 2024-04-25T22:52:22.691 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:22.691 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:22.691 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:22.691 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:22.691 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.691 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:22.691 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.012790+0000", 2024-04-25T22:52:22.691 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:22.691 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.691 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.691 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:22.692 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.012790+0000", 2024-04-25T22:52:22.692 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:22.692 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.692 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.692 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:22.692 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.012791+0000", 2024-04-25T22:52:22.692 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0699999999999999e-06 2024-04-25T22:52:22.692 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.692 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.692 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:22.692 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.012797+0000", 2024-04-25T22:52:22.692 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0519999999999998e-06 2024-04-25T22:52:22.692 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.692 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.693 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:22.693 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.012811+0000", 2024-04-25T22:52:22.693 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4287999999999999e-05 2024-04-25T22:52:22.693 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.693 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.693 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:22.693 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.012838+0000", 2024-04-25T22:52:22.693 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6727999999999999e-05 2024-04-25T22:52:22.693 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.693 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.693 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:22.693 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.012909+0000", 2024-04-25T22:52:22.693 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.1211000000000006e-05 2024-04-25T22:52:22.693 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.694 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.694 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:22.694 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.013015+0000", 2024-04-25T22:52:22.694 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010619 2024-04-25T22:52:22.694 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.694 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.694 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:22.694 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.013189+0000", 2024-04-25T22:52:22.694 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00017439199999999999 2024-04-25T22:52:22.694 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.694 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.694 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:22.694 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.013903+0000", 2024-04-25T22:52:22.695 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00071379099999999997 2024-04-25T22:52:22.695 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.695 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.695 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:22.695 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.014159+0000", 2024-04-25T22:52:22.695 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00025561699999999998 2024-04-25T22:52:22.695 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.695 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.695 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:22.695 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.014192+0000", 2024-04-25T22:52:22.695 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2941000000000002e-05 2024-04-25T22:52:22.695 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:22.695 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:22.695 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:22.696 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.014224+0000", 2024-04-25T22:52:22.696 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2163999999999999e-05 2024-04-25T22:52:22.696 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:22.696 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:22.696 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:22.696 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:22.696 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:22.696 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-25T22:52:22.698 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:52:22.698 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:22.697+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:22.797 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:22.797+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:22.813 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:22.813 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:52:22.813 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-25T22:52:22.813 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:22.822 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:52:22.899 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:22.899+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:22.926 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:22.926 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:52:22.926 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-25T22:52:22.926 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-25T22:52:22.927 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:22.935 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:52:23.000 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:22.999+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:23.068 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:52:23.079 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:23.079 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:52:23.079 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:52:23.079 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:52:23.079 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.080 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:52:23.080 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:52:23.080 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 35.110705338000002, 2024-04-25T22:52:23.080 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:52:23.080 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:23.080 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:23.080 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:23.080 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:23.080 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.080 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:23.080 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:52:23.080 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:23.080 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.080 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.081 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:23.081 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:52:23.081 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:23.081 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.081 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.081 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:23.081 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:52:23.081 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:52:23.081 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.081 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.081 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:23.081 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:52:23.081 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:52:23.081 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.082 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.082 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:23.082 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:52:23.082 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:52:23.082 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.082 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.082 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:23.082 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:52:23.082 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:52:23.082 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.082 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.082 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:23.082 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:52:23.083 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:52:23.083 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.083 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.083 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:23.083 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:52:23.083 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:52:23.083 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.083 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.083 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:23.083 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:52:23.083 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:52:23.083 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.083 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.084 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:23.084 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:52:23.084 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:52:23.084 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:23.084 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:23.084 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:23.084 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.084 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.084 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:110 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'72, mlcod=10'68)", 2024-04-25T22:52:23.084 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:23.084 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 35.110071337999997, 2024-04-25T22:52:23.084 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065316630000000001, 2024-04-25T22:52:23.084 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:23.085 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:23.085 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:23.085 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:23.085 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.085 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:23.085 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:23.085 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:23.085 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.085 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.085 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:23.085 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:23.085 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:23.085 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.085 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.086 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:23.086 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:23.086 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.58e-07 2024-04-25T22:52:23.086 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.086 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.086 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:23.086 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967811+0000", 2024-04-25T22:52:23.086 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.118e-06 2024-04-25T22:52:23.086 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.086 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.086 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:23.086 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967817+0000", 2024-04-25T22:52:23.086 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3709999999999996e-06 2024-04-25T22:52:23.087 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.087 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.087 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:23.087 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967820+0000", 2024-04-25T22:52:23.087 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2210000000000002e-06 2024-04-25T22:52:23.087 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.087 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.087 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:23.087 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967876+0000", 2024-04-25T22:52:23.087 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5507000000000002e-05 2024-04-25T22:52:23.087 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.087 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.088 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:23.088 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967893+0000", 2024-04-25T22:52:23.088 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7812000000000002e-05 2024-04-25T22:52:23.088 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.088 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.088 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:23.088 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974317+0000", 2024-04-25T22:52:23.088 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064237160000000003 2024-04-25T22:52:23.088 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.088 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.088 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:23.088 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:52:23.088 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.156e-05 2024-04-25T22:52:23.088 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:23.089 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:23.089 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:23.089 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.089 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.089 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'68)", 2024-04-25T22:52:23.089 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:23.089 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 35.109653825000002, 2024-04-25T22:52:23.089 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061292279999999996, 2024-04-25T22:52:23.089 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:23.089 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:23.090 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:23.090 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:23.090 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.090 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:23.090 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:23.090 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:23.090 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.090 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.090 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:23.090 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:23.090 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:23.090 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.090 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.091 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:23.091 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:23.091 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6300000000000001e-07 2024-04-25T22:52:23.091 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.091 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.091 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:23.091 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968228+0000", 2024-04-25T22:52:23.091 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6139999999999999e-06 2024-04-25T22:52:23.091 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.091 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.091 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:23.091 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968235+0000", 2024-04-25T22:52:23.092 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7020000000000001e-06 2024-04-25T22:52:23.092 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.092 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.092 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:23.092 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968238+0000", 2024-04-25T22:52:23.092 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0010000000000002e-06 2024-04-25T22:52:23.092 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.092 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.092 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:23.092 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968297+0000", 2024-04-25T22:52:23.092 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8424999999999997e-05 2024-04-25T22:52:23.092 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.092 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.093 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:23.093 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968316+0000", 2024-04-25T22:52:23.093 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8814999999999999e-05 2024-04-25T22:52:23.093 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.093 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.093 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:23.093 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:52:23.093 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060239439999999998 2024-04-25T22:52:23.093 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.093 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.093 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:23.093 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974354+0000", 2024-04-25T22:52:23.093 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4364e-05 2024-04-25T22:52:23.093 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:23.094 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:23.094 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:23.094 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.094 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.094 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'68)", 2024-04-25T22:52:23.094 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:23.094 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 35.109216822999997, 2024-04-25T22:52:23.094 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005948414, 2024-04-25T22:52:23.094 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:23.094 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:23.094 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:23.094 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:23.094 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.094 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:23.095 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:23.095 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:23.095 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.095 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.095 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:23.095 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:23.095 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:23.095 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.095 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.095 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:23.095 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:23.095 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6199999999999998e-07 2024-04-25T22:52:23.095 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.095 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.095 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:23.096 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968723+0000", 2024-04-25T22:52:23.096 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1148999999999993e-05 2024-04-25T22:52:23.096 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.096 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.096 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:23.096 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968730+0000", 2024-04-25T22:52:23.096 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1749999999999999e-06 2024-04-25T22:52:23.096 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.096 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.096 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:23.096 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968734+0000", 2024-04-25T22:52:23.096 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5200000000000002e-06 2024-04-25T22:52:23.096 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.097 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.097 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:23.097 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968771+0000", 2024-04-25T22:52:23.097 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6851999999999999e-05 2024-04-25T22:52:23.097 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.097 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.097 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:23.097 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968788+0000", 2024-04-25T22:52:23.097 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7027000000000001e-05 2024-04-25T22:52:23.097 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.097 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.097 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:23.097 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974589+0000", 2024-04-25T22:52:23.098 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058013320000000002 2024-04-25T22:52:23.098 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.098 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.098 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:23.098 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974610+0000", 2024-04-25T22:52:23.098 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0897e-05 2024-04-25T22:52:23.098 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:23.098 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:23.098 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:23.098 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.098 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.098 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'68)", 2024-04-25T22:52:23.099 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:23.099 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 35.108646813, 2024-04-25T22:52:23.099 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053935750000000003, 2024-04-25T22:52:23.099 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:23.099 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:23.099 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:23.099 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:23.099 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.099 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:23.099 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:23.099 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:23.099 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.099 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.100 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:23.100 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:23.100 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:23.100 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.100 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.100 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:23.100 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:23.100 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.03e-07 2024-04-25T22:52:23.100 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.100 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.100 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:23.100 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969235+0000", 2024-04-25T22:52:23.100 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2399999999999999e-06 2024-04-25T22:52:23.101 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.101 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.101 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:23.101 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969242+0000", 2024-04-25T22:52:23.101 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1269999999999997e-06 2024-04-25T22:52:23.101 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.101 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.101 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:23.101 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969246+0000", 2024-04-25T22:52:23.101 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3840000000000001e-06 2024-04-25T22:52:23.101 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.101 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.101 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:23.101 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969278+0000", 2024-04-25T22:52:23.102 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1868e-05 2024-04-25T22:52:23.102 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.102 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.102 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:23.102 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969295+0000", 2024-04-25T22:52:23.102 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7530999999999999e-05 2024-04-25T22:52:23.102 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.102 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.102 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:23.102 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974611+0000", 2024-04-25T22:52:23.102 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053160789999999996 2024-04-25T22:52:23.102 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.102 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.103 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:23.103 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974625+0000", 2024-04-25T22:52:23.103 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3943e-05 2024-04-25T22:52:23.103 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:23.103 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:23.103 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:23.103 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.103 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.103 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-25T22:52:23.103 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:23.103 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 34.915050905000001, 2024-04-25T22:52:23.103 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054952610000000004, 2024-04-25T22:52:23.103 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:23.104 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:23.104 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:23.104 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:23.104 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.104 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:23.104 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:23.104 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:23.104 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.104 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.104 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:23.104 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:23.104 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:23.104 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.104 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.105 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:23.105 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:23.105 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.68e-07 2024-04-25T22:52:23.105 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.105 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.105 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:23.105 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162898+0000", 2024-04-25T22:52:23.105 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9470999999999999e-05 2024-04-25T22:52:23.105 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.105 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.105 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:23.105 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162906+0000", 2024-04-25T22:52:23.105 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1580000000000005e-06 2024-04-25T22:52:23.106 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.106 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.106 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:23.106 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162911+0000", 2024-04-25T22:52:23.106 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4779999999999999e-06 2024-04-25T22:52:23.106 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.106 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.106 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:23.106 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162952+0000", 2024-04-25T22:52:23.106 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0629e-05 2024-04-25T22:52:23.106 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.106 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.106 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:23.107 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162968+0000", 2024-04-25T22:52:23.107 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6239000000000002e-05 2024-04-25T22:52:23.107 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.107 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.107 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:23.107 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168281+0000", 2024-04-25T22:52:23.107 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053132869999999999 2024-04-25T22:52:23.107 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.107 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.107 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:23.107 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168323+0000", 2024-04-25T22:52:23.107 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1430999999999997e-05 2024-04-25T22:52:23.108 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:23.108 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:23.108 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:23.108 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.108 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.108 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-04-25T22:52:23.108 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:23.108 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 34.484573543000003, 2024-04-25T22:52:23.108 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050872510000000001, 2024-04-25T22:52:23.108 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:23.108 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:23.108 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:23.108 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:23.109 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.109 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:23.109 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:23.109 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:23.109 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.109 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.109 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:23.109 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:23.109 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:23.109 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.109 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.109 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:23.109 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:23.110 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.72e-07 2024-04-25T22:52:23.110 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.110 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.110 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:23.110 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593381+0000", 2024-04-25T22:52:23.110 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5797000000000006e-05 2024-04-25T22:52:23.110 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.110 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.110 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:23.110 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593389+0000", 2024-04-25T22:52:23.110 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8480000000000001e-06 2024-04-25T22:52:23.110 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.110 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.111 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:23.111 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593393+0000", 2024-04-25T22:52:23.111 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4819999999999996e-06 2024-04-25T22:52:23.111 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.111 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.111 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:23.111 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593435+0000", 2024-04-25T22:52:23.111 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1600000000000002e-05 2024-04-25T22:52:23.111 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.111 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.111 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:23.111 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593454+0000", 2024-04-25T22:52:23.111 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8868e-05 2024-04-25T22:52:23.112 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.112 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.112 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:23.112 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598350+0000", 2024-04-25T22:52:23.112 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004895763 2024-04-25T22:52:23.112 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.112 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.112 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:23.112 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598392+0000", 2024-04-25T22:52:23.112 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2521000000000002e-05 2024-04-25T22:52:23.112 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:23.112 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:23.113 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:23.113 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.113 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.113 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:23.113 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:52:23.113 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 30.066209639, 2024-04-25T22:52:23.113 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:52:23.113 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:23.113 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:23.113 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:23.113 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:23.113 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.113 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:23.113 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:52:23.114 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:23.114 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.114 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.114 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:23.114 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:52:23.114 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:23.114 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.114 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.114 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:23.114 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:52:23.115 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:52:23.115 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.115 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.115 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:23.115 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:52:23.115 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:52:23.115 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.116 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.116 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:23.116 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:52:23.116 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:52:23.116 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.116 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.116 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:23.116 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:52:23.116 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:52:23.116 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.116 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.116 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:23.116 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:52:23.117 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:52:23.117 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.117 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.117 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:23.117 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:52:23.117 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:52:23.117 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.117 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.117 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:23.117 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:52:23.117 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:52:23.117 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.117 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.117 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:23.118 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:52:23.118 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:52:23.118 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.118 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.118 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:23.118 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:52:23.118 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:52:23.118 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.118 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.118 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:23.118 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:52:23.118 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:52:23.118 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.119 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.119 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:23.119 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:52:23.119 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:52:23.119 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:23.119 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:23.119 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:23.119 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.119 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.119 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:23.119 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:52:23.119 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 30.065535263000001, 2024-04-25T22:52:23.119 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:52:23.119 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:23.120 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:23.120 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:23.120 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:23.120 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.120 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:23.120 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:52:23.120 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:23.120 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.120 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.120 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:23.120 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:52:23.120 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:23.120 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.120 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.120 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:23.121 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:52:23.121 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:52:23.121 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.121 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.121 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:23.121 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:52:23.121 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:52:23.121 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.121 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.121 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:23.121 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:52:23.121 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:52:23.121 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.121 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.121 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:23.122 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:52:23.122 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:52:23.122 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.122 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.122 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:23.122 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:52:23.122 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:52:23.122 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.122 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.122 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:23.122 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:52:23.122 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:52:23.122 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.123 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.123 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:23.123 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:52:23.123 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:52:23.123 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.123 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.123 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:23.123 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:52:23.123 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:52:23.123 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.123 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.123 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:23.123 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:52:23.123 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:52:23.123 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.124 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.124 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:23.124 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:52:23.124 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:52:23.124 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.124 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.124 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:23.124 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:52:23.124 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:52:23.124 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:23.124 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:23.124 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:23.124 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.125 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.125 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:23.125 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:52:23.125 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 30.065026051, 2024-04-25T22:52:23.125 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:52:23.125 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:23.125 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:23.125 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:23.125 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:23.125 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.125 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:23.125 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:52:23.125 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:23.126 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.126 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.126 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:23.126 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:52:23.126 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:23.126 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.126 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.126 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:23.126 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:52:23.126 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:52:23.126 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.126 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.126 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:23.126 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:52:23.127 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:52:23.127 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.127 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.127 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:23.127 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:52:23.127 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:52:23.127 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.127 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.127 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:23.127 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:52:23.127 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:52:23.127 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.127 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.127 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:23.128 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:52:23.128 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:52:23.128 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.128 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.128 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:23.128 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:52:23.128 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:52:23.128 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.128 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.128 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:23.128 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:52:23.128 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:52:23.128 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.128 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.128 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:23.128 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:52:23.129 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:52:23.129 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.129 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.129 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:23.129 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:52:23.129 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:52:23.129 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.129 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.129 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:23.129 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:52:23.129 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:52:23.129 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.129 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.130 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:23.130 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:52:23.130 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:52:23.130 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:23.130 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:23.130 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:23.130 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.130 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.130 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:23.130 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:23.130 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 30.064612853, 2024-04-25T22:52:23.130 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:52:23.130 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:23.131 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:23.131 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:23.131 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:23.131 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.131 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:23.131 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:23.131 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:23.131 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.131 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.131 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:23.131 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:23.131 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:23.132 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.132 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.132 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:23.132 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:23.132 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:52:23.132 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.132 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.132 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:23.132 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:52:23.132 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:52:23.132 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.132 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.132 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:23.133 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:52:23.133 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:52:23.133 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.133 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.133 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:23.133 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:52:23.133 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:52:23.133 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.133 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.133 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:23.133 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:52:23.133 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:52:23.133 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.133 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.134 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:23.134 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:52:23.134 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:52:23.134 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.134 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.134 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:23.134 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:52:23.134 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:52:23.134 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.134 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.134 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:23.134 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:52:23.134 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:52:23.134 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.135 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.135 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:23.135 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:52:23.135 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:52:23.135 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.135 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.135 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:23.135 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:52:23.135 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:52:23.135 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.135 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.135 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:23.135 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:52:23.135 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:52:23.136 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:23.136 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:23.136 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:23.136 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.136 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.136 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:23.136 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:52:23.136 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 30.064562183, 2024-04-25T22:52:23.136 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:52:23.136 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:23.136 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:23.136 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:23.137 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:23.137 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.137 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:23.137 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:52:23.137 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:23.137 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.137 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.137 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:23.137 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:52:23.137 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:23.137 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.137 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.137 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:23.137 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:52:23.137 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:52:23.138 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.138 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.138 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:23.138 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:52:23.138 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:52:23.138 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.138 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.138 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:23.138 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:52:23.138 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:52:23.138 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.138 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.139 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:23.139 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:52:23.139 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:52:23.139 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.139 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.139 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:23.139 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:52:23.139 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:52:23.139 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.139 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.139 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:52:23.139 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:52:23.139 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:52:23.140 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.140 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.140 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:23.140 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:52:23.140 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:52:23.140 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.140 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.140 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:23.140 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:52:23.140 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:52:23.140 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.140 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.140 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:23.140 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:52:23.141 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:52:23.141 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.141 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.141 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:23.141 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:52:23.141 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:52:23.141 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.141 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.141 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:23.141 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:52:23.141 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:52:23.141 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.141 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.141 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:23.141 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:52:23.141 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:52:23.142 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.142 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.142 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:23.142 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:52:23.142 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:52:23.142 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:23.142 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:23.142 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:23.142 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.142 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.142 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:23.142 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:52:23.142 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 30.064525314000001, 2024-04-25T22:52:23.143 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:52:23.143 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:23.143 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:23.143 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:23.143 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:23.143 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.143 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:23.143 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:52:23.143 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:23.143 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.143 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.143 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:23.143 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:52:23.143 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:23.144 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.144 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.144 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:23.144 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:52:23.144 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:52:23.144 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.144 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.144 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:23.144 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:52:23.144 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:52:23.144 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.144 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.144 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:23.144 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:52:23.144 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:52:23.145 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.145 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.145 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:23.145 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:52:23.145 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:52:23.145 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.145 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.145 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:23.145 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:52:23.145 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:52:23.145 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.145 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.145 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:52:23.145 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:52:23.145 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:52:23.146 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.146 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.146 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:23.146 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:52:23.146 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:52:23.146 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.146 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.146 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:23.146 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:52:23.146 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:52:23.146 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.146 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.146 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:23.146 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:52:23.146 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:52:23.147 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.147 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.147 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:23.147 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:52:23.147 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:52:23.147 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.147 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.147 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:23.147 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:52:23.147 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:52:23.147 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.147 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.147 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:23.148 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:52:23.148 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:52:23.148 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.148 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.148 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:23.148 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:52:23.148 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:52:23.148 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:23.148 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:23.148 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:23.148 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.148 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.148 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:23.148 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:52:23.148 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 30.064500347999999, 2024-04-25T22:52:23.148 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:52:23.149 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:23.149 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:23.149 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:23.149 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:23.149 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.149 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:23.149 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:52:23.149 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:23.149 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.149 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.149 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:23.149 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:52:23.149 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:23.150 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.150 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.150 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:23.150 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:52:23.150 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:52:23.150 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.150 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.150 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:23.150 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:52:23.150 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:52:23.150 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.150 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.150 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:23.150 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:52:23.151 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:52:23.151 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.151 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.151 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:23.151 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:52:23.151 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:52:23.151 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.151 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.151 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:23.151 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:52:23.151 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:52:23.151 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.151 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.151 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:23.151 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:52:23.151 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:52:23.152 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.152 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.152 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:23.152 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:52:23.152 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:52:23.152 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.152 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.152 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:23.152 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:52:23.152 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:52:23.152 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.152 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.152 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:23.152 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:52:23.152 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:52:23.152 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.153 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.153 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:23.153 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:52:23.153 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:52:23.153 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.153 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.153 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:23.153 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:52:23.153 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:52:23.153 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:23.153 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:23.153 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:23.153 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.153 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.154 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:23.154 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:52:23.154 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 30.064463984, 2024-04-25T22:52:23.154 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:52:23.154 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:23.154 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:23.154 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:52:23.154 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:23.154 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.154 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:23.154 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:52:23.154 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:23.154 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.154 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.155 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:23.155 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:52:23.155 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:23.155 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.155 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.155 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:23.155 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:52:23.155 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:52:23.155 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.155 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.155 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:23.155 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:52:23.155 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:52:23.155 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.155 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.156 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:23.156 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:52:23.156 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:52:23.156 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.156 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.156 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:23.156 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:52:23.156 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:52:23.156 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.156 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.156 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:23.156 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:52:23.156 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:52:23.156 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.157 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.157 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:52:23.157 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:52:23.157 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:52:23.157 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.157 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.157 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:23.157 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:52:23.157 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:52:23.157 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.157 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.157 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:23.157 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:52:23.157 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:52:23.157 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.157 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.158 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:23.158 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:52:23.158 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:52:23.158 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:23.158 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:23.158 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:23.158 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.158 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.158 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:23.158 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:23.158 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 30.064432903, 2024-04-25T22:52:23.158 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:52:23.158 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:23.158 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:23.158 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:52:23.159 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:23.159 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.159 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:23.159 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:23.159 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:23.159 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.159 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.159 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:23.159 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:23.159 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:23.159 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.159 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.159 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:23.159 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:23.159 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:52:23.160 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.160 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.160 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:23.160 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:52:23.160 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:52:23.160 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.160 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.160 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:23.160 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:52:23.160 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:52:23.160 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.160 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.160 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:23.160 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:52:23.161 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:52:23.161 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.161 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.161 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:23.161 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:52:23.161 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:52:23.161 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.161 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.161 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:23.161 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:52:23.161 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:52:23.161 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.161 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.162 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:23.162 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:52:23.162 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:52:23.162 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:23.162 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:23.162 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:23.162 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.162 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.162 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:52:23.162 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:23.162 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 30.063991934000001, 2024-04-25T22:52:23.162 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064881979999999997, 2024-04-25T22:52:23.162 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:23.163 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:23.163 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:23.163 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:23.163 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.163 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:23.163 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:23.163 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:23.163 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.163 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.163 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:23.163 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:23.163 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:23.163 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.163 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.163 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:23.164 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:23.164 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2699999999999999e-07 2024-04-25T22:52:23.164 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.164 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.164 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:23.164 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013898+0000", 2024-04-25T22:52:23.164 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0796e-05 2024-04-25T22:52:23.164 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.164 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.164 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:23.164 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013907+0000", 2024-04-25T22:52:23.164 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5140000000000007e-06 2024-04-25T22:52:23.164 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.164 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.165 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:23.165 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013952+0000", 2024-04-25T22:52:23.165 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4134000000000001e-05 2024-04-25T22:52:23.165 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.165 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.165 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:23.165 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016812+0000", 2024-04-25T22:52:23.165 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028601059999999998 2024-04-25T22:52:23.165 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.165 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.165 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:23.165 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.017052+0000", 2024-04-25T22:52:23.165 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024056500000000001 2024-04-25T22:52:23.166 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.166 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.166 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:23.166 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020350+0000", 2024-04-25T22:52:23.166 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032978320000000001 2024-04-25T22:52:23.166 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.166 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.166 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:23.166 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020375+0000", 2024-04-25T22:52:23.166 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4624e-05 2024-04-25T22:52:23.166 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:23.166 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:23.166 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:23.166 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.167 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.167 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-25T22:52:23.167 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:23.167 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 30.050461488, 2024-04-25T22:52:23.167 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058583000000000003, 2024-04-25T22:52:23.167 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:23.167 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:23.167 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:23.167 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:23.167 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.167 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:23.167 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:23.167 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:23.167 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.168 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.168 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:23.168 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:23.168 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:23.168 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.168 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.168 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:23.168 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:23.168 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.41e-07 2024-04-25T22:52:23.168 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.168 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.168 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:23.168 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027428+0000", 2024-04-25T22:52:23.168 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.075e-05 2024-04-25T22:52:23.169 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.169 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.169 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:23.169 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027435+0000", 2024-04-25T22:52:23.169 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3610000000000003e-06 2024-04-25T22:52:23.169 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.169 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.169 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:23.169 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027442+0000", 2024-04-25T22:52:23.169 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0400000000000004e-06 2024-04-25T22:52:23.169 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.169 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.169 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:23.169 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028094+0000", 2024-04-25T22:52:23.170 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00065134800000000005 2024-04-25T22:52:23.170 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.170 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.170 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:23.170 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028107+0000", 2024-04-25T22:52:23.170 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3087e-05 2024-04-25T22:52:23.170 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.170 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.170 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:23.170 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033239+0000", 2024-04-25T22:52:23.170 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051319429999999999 2024-04-25T22:52:23.170 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.170 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.170 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:23.171 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033275+0000", 2024-04-25T22:52:23.171 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6430000000000002e-05 2024-04-25T22:52:23.171 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:23.171 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:23.171 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:23.171 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.171 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.171 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-25T22:52:23.171 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:23.171 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 30.050076651000001, 2024-04-25T22:52:23.171 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005413597, 2024-04-25T22:52:23.171 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:23.171 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:23.171 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:23.171 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:23.172 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.172 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:23.172 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:23.172 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:23.172 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.172 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.172 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:23.172 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:23.172 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:23.172 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.172 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.172 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:23.172 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:23.172 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3799999999999997e-07 2024-04-25T22:52:23.172 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.173 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.173 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:23.173 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027816+0000", 2024-04-25T22:52:23.173 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3230999999999999e-05 2024-04-25T22:52:23.173 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.173 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.173 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:23.173 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027823+0000", 2024-04-25T22:52:23.173 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9039999999999992e-06 2024-04-25T22:52:23.173 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.173 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.173 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:23.173 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027841+0000", 2024-04-25T22:52:23.173 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7651000000000001e-05 2024-04-25T22:52:23.174 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.174 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.174 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:23.174 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027904+0000", 2024-04-25T22:52:23.174 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3058000000000005e-05 2024-04-25T22:52:23.174 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.174 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.174 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:23.174 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027926+0000", 2024-04-25T22:52:23.174 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1450999999999998e-05 2024-04-25T22:52:23.174 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.174 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.174 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:23.175 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033177+0000", 2024-04-25T22:52:23.175 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052508909999999997 2024-04-25T22:52:23.175 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.175 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.175 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:23.175 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033215+0000", 2024-04-25T22:52:23.175 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8872999999999999e-05 2024-04-25T22:52:23.175 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:23.175 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:23.175 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:23.175 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.175 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.175 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 171 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:52:23.176 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:23.176 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 30.050019549000002, 2024-04-25T22:52:23.176 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054322240000000003, 2024-04-25T22:52:23.176 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:23.176 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:23.176 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "reached pg", 2024-04-25T22:52:23.176 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:23.176 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.176 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:23.176 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:23.176 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:23.176 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.176 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.176 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:23.177 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:23.177 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:23.177 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.177 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.177 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:23.177 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:23.177 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7500000000000001e-07 2024-04-25T22:52:23.177 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.177 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.177 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:23.177 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027868+0000", 2024-04-25T22:52:23.177 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5750000000000001e-06 2024-04-25T22:52:23.177 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.177 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.178 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:23.178 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027885+0000", 2024-04-25T22:52:23.178 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7272e-05 2024-04-25T22:52:23.178 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.178 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.178 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:23.178 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027900+0000", 2024-04-25T22:52:23.178 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.502e-05 2024-04-25T22:52:23.178 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.178 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.178 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:23.178 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028381+0000", 2024-04-25T22:52:23.179 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00048039399999999998 2024-04-25T22:52:23.179 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:23.179 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:23.179 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:23.179 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033291+0000", 2024-04-25T22:52:23.179 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049105879999999996 2024-04-25T22:52:23.179 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:23.179 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:23.179 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:23.179 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:23.179 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:23.179 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:23.180 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-25T22:52:23.182 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:23.181+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:23.182 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:52:23.204 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-25T22:52:23.205 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:52:23.223 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-25T22:52:23.224 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:52:23.242 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-25T22:52:23.242 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:52:23.283 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:23.282+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:23.290 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:23.290 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:23.299 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:52:23.384 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:23.383+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:23.442 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:23.442 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:23.451 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:52:23.484 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:23.484+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:23.553 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:23.553 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:23.562 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:52:23.607 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:23.607+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:23.676 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:23.676 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:23.685 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:52:23.686 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:23.686+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:23.787 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:23.786+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:23.830 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:23.830 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:23.842 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:52:23.888 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:23.887+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:23.943 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:23.943 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:23.952 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:52:23.989 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:23.988+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:24.061 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:24.062 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:24.070 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:52:24.083 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is unset 2024-04-25T22:52:24.090 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:24.090+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:24.173 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:24.173 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:24.182 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:52:24.191 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:24.190+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:24.284 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:24.284 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:24.291 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:24.291+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:24.293 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:52:24.392 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:24.392+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:24.399 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:24.399 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:24.408 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:52:24.493 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:24.492+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:24.509 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:24.509 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:24.518 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:52:24.593 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:24.593+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:24.620 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:24.621 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:24.629 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:52:24.694 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:24.694+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:24.734 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:24.735 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:24.744 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:52:24.757 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-25T22:52:24.757 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-25T22:52:24.757 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2024-04-25T22:52:24.758 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 3.0 2024-04-25T22:52:24.795 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:24.794+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:24.846 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:24.847 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:24.855 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:52:24.896 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:24.896+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:24.957 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:24.957 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:24.966 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:52:24.998 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:24.998+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:25.069 INFO:teuthology.orchestra.run.smithi052.stdout:moved 0 / 210 (0%) 2024-04-25T22:52:25.069 INFO:teuthology.orchestra.run.smithi052.stdout:avg 70 2024-04-25T22:52:25.069 INFO:teuthology.orchestra.run.smithi052.stdout:stddev 2.16025 -> 2.16025 (expected baseline 6.8313) 2024-04-25T22:52:25.069 INFO:teuthology.orchestra.run.smithi052.stdout:min osd.2 with 67 -> 67 pgs (0.957143 -> 0.957143 * mean) 2024-04-25T22:52:25.069 INFO:teuthology.orchestra.run.smithi052.stdout:max osd.1 with 72 -> 72 pgs (1.02857 -> 1.02857 * mean) 2024-04-25T22:52:25.069 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:52:25.070 INFO:teuthology.orchestra.run.smithi052.stdout:oload 1000 2024-04-25T22:52:25.070 INFO:teuthology.orchestra.run.smithi052.stdout:max_change 3 2024-04-25T22:52:25.070 INFO:teuthology.orchestra.run.smithi052.stdout:max_change_osds 4 2024-04-25T22:52:25.070 INFO:teuthology.orchestra.run.smithi052.stdout:average_utilization 0.0003 2024-04-25T22:52:25.070 INFO:teuthology.orchestra.run.smithi052.stdout:overload_utilization 0.0034 2024-04-25T22:52:25.070 INFO:teuthology.orchestra.run.smithi052.stderr:no change 2024-04-25T22:52:25.082 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:25.082 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:25.084 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '1000', 'type': 'reweight-by-utilization'} 2024-04-25T22:52:25.084 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 1000 1.0 2024-04-25T22:52:25.089 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:52:25.133 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:25.133+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:25.192 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:25.192 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:25.199 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:25.199+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:25.201 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:52:25.253 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:52:25.301 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:25.301+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:25.344 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:25.345 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:25.353 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:52:25.377 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-25T22:52:25.378 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:52:25.382 INFO:teuthology.orchestra.run.smithi052.stdout:moved 0 / 210 (0%) 2024-04-25T22:52:25.382 INFO:teuthology.orchestra.run.smithi052.stdout:avg 70 2024-04-25T22:52:25.382 INFO:teuthology.orchestra.run.smithi052.stdout:stddev 2.16025 -> 2.16025 (expected baseline 6.8313) 2024-04-25T22:52:25.382 INFO:teuthology.orchestra.run.smithi052.stdout:min osd.2 with 67 -> 67 pgs (0.957143 -> 0.957143 * mean) 2024-04-25T22:52:25.382 INFO:teuthology.orchestra.run.smithi052.stdout:max osd.1 with 72 -> 72 pgs (1.02857 -> 1.02857 * mean) 2024-04-25T22:52:25.382 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:52:25.382 INFO:teuthology.orchestra.run.smithi052.stdout:oload 1000 2024-04-25T22:52:25.382 INFO:teuthology.orchestra.run.smithi052.stdout:max_change 1 2024-04-25T22:52:25.382 INFO:teuthology.orchestra.run.smithi052.stdout:max_change_osds 4 2024-04-25T22:52:25.382 INFO:teuthology.orchestra.run.smithi052.stdout:average_utilization 0.0003 2024-04-25T22:52:25.383 INFO:teuthology.orchestra.run.smithi052.stdout:overload_utilization 0.0034 2024-04-25T22:52:25.383 INFO:teuthology.orchestra.run.smithi052.stderr:no change 2024-04-25T22:52:25.395 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2024-04-25T22:52:25.395 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 110 0.05 2024-04-25T22:52:25.398 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-25T22:52:25.398 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:52:25.401 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:25.401+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:25.415 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-25T22:52:25.415 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:52:25.468 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:25.468 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:52:25.468 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-04-25T22:52:25.468 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:25.477 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:52:25.521 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:25.520+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:25.579 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:25.579 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:52:25.579 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:52:25.579 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:52:25.579 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:25.587 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:52:25.604 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:25.603+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:25.692 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-25T22:52:25.689+0000 7fcadd096640 -1 mgr.server reply reply (1) Operation not permitted no change 2024-04-25T22:52:25.692 INFO:teuthology.orchestra.run.smithi052.stdout:moved 4 / 210 (1.90476%) 2024-04-25T22:52:25.692 INFO:teuthology.orchestra.run.smithi052.stdout:avg 70 2024-04-25T22:52:25.692 INFO:teuthology.orchestra.run.smithi052.stdout:stddev 2.16025 -> 2.94392 (expected baseline 6.8313) 2024-04-25T22:52:25.693 INFO:teuthology.orchestra.run.smithi052.stdout:min osd.2 with 67 -> 69 pgs (0.957143 -> 0.985714 * mean) 2024-04-25T22:52:25.693 INFO:teuthology.orchestra.run.smithi052.stdout:max osd.1 with 72 -> 74 pgs (1.02857 -> 1.05714 * mean) 2024-04-25T22:52:25.693 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:52:25.693 INFO:teuthology.orchestra.run.smithi052.stdout:oload 110 2024-04-25T22:52:25.693 INFO:teuthology.orchestra.run.smithi052.stdout:max_change 0.05 2024-04-25T22:52:25.693 INFO:teuthology.orchestra.run.smithi052.stdout:max_change_osds 4 2024-04-25T22:52:25.693 INFO:teuthology.orchestra.run.smithi052.stdout:average_utilization 0.0003 2024-04-25T22:52:25.693 INFO:teuthology.orchestra.run.smithi052.stdout:overload_utilization 0.0004 2024-04-25T22:52:25.693 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 weight 1.0000 -> 0.9500 2024-04-25T22:52:25.693 INFO:teuthology.orchestra.run.smithi052.stderr:no change 2024-04-25T22:52:25.704 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '1000', 'type': 'reweight-by-utilization'} 2024-04-25T22:52:25.704 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 1000 3.0 2024-04-25T22:52:25.705 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:25.705+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:25.732 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:25.732 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-04-25T22:52:25.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-04-25T22:52:25.733 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:52:25.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.733 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:25.733 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:25.733 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.7654286, 2024-04-25T22:52:25.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0103421, 2024-04-25T22:52:25.733 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:25.733 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:25.733 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:25.733 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:25.733 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:25.733 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:25.734 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 115 2024-04-25T22:52:25.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.734 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:25.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:25.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:25.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:25.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:25.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:25.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:25.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:25.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:25.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9500000000000002e-07 2024-04-25T22:52:25.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:25.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965108+0000", 2024-04-25T22:52:25.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9177999999999994e-05 2024-04-25T22:52:25.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:25.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965127+0000", 2024-04-25T22:52:25.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8868e-05 2024-04-25T22:52:25.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:25.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965133+0000", 2024-04-25T22:52:25.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8929999999999999e-06 2024-04-25T22:52:25.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:25.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.969991+0000", 2024-04-25T22:52:25.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048573849999999997 2024-04-25T22:52:25.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:25.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970072+0000", 2024-04-25T22:52:25.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0728000000000004e-05 2024-04-25T22:52:25.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:25.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970189+0000", 2024-04-25T22:52:25.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000117778 2024-04-25T22:52:25.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:25.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970946+0000", 2024-04-25T22:52:25.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00075704600000000004 2024-04-25T22:52:25.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:25.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975297+0000", 2024-04-25T22:52:25.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004350217 2024-04-25T22:52:25.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:25.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975343+0000", 2024-04-25T22:52:25.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6687999999999998e-05 2024-04-25T22:52:25.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:25.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975380+0000", 2024-04-25T22:52:25.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6724000000000003e-05 2024-04-25T22:52:25.739 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:25.739 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:25.739 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:25.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.739 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:25.739 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:25.739 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.765322568999999, 2024-04-25T22:52:25.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010304384, 2024-04-25T22:52:25.739 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:25.739 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:25.739 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:25.740 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:25.740 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:25.740 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:25.740 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 116 2024-04-25T22:52:25.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.740 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:25.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:25.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:25.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:25.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:25.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:25.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:25.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:25.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:25.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5799999999999999e-07 2024-04-25T22:52:25.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:25.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965154+0000", 2024-04-25T22:52:25.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0009e-05 2024-04-25T22:52:25.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:25.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965164+0000", 2024-04-25T22:52:25.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8490000000000001e-06 2024-04-25T22:52:25.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:25.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965169+0000", 2024-04-25T22:52:25.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0730000000000004e-06 2024-04-25T22:52:25.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:25.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970609+0000", 2024-04-25T22:52:25.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054397689999999997 2024-04-25T22:52:25.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:25.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970651+0000", 2024-04-25T22:52:25.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1873999999999999e-05 2024-04-25T22:52:25.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:25.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970723+0000", 2024-04-25T22:52:25.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2039999999999995e-05 2024-04-25T22:52:25.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:25.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971358+0000", 2024-04-25T22:52:25.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063489500000000001 2024-04-25T22:52:25.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:25.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975409+0000", 2024-04-25T22:52:25.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040506880000000002 2024-04-25T22:52:25.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:25.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975432+0000", 2024-04-25T22:52:25.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3315999999999998e-05 2024-04-25T22:52:25.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:25.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975448+0000", 2024-04-25T22:52:25.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6313000000000001e-05 2024-04-25T22:52:25.745 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:25.745 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:25.745 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:25.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.745 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:25.745 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:25.746 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.765287987000001, 2024-04-25T22:52:25.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010384338999999999, 2024-04-25T22:52:25.746 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:25.746 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:25.746 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:25.746 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:25.746 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:25.746 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:25.746 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-04-25T22:52:25.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.746 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:25.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:25.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:25.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:25.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:25.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:25.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:25.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:25.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:25.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3600000000000004e-07 2024-04-25T22:52:25.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:25.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965185+0000", 2024-04-25T22:52:25.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.117e-06 2024-04-25T22:52:25.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:25.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965192+0000", 2024-04-25T22:52:25.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3239999999999997e-06 2024-04-25T22:52:25.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:25.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965198+0000", 2024-04-25T22:52:25.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6370000000000004e-06 2024-04-25T22:52:25.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:25.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970973+0000", 2024-04-25T22:52:25.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057748239999999996 2024-04-25T22:52:25.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:25.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971049+0000", 2024-04-25T22:52:25.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6029e-05 2024-04-25T22:52:25.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:25.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971174+0000", 2024-04-25T22:52:25.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012462399999999999 2024-04-25T22:52:25.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:25.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971553+0000", 2024-04-25T22:52:25.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037896499999999999 2024-04-25T22:52:25.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:25.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975482+0000", 2024-04-25T22:52:25.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039297459999999996 2024-04-25T22:52:25.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:25.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975529+0000", 2024-04-25T22:52:25.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6387000000000002e-05 2024-04-25T22:52:25.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:25.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975563+0000", 2024-04-25T22:52:25.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4150000000000003e-05 2024-04-25T22:52:25.751 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:25.751 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:25.752 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:25.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.752 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:25.752 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:25.752 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.718241663999997, 2024-04-25T22:52:25.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012637705000000001, 2024-04-25T22:52:25.752 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:25.752 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:25.752 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:25.752 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:25.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:25.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:25.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:25.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:25.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:25.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:25.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:25.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012227+0000", 2024-04-25T22:52:25.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.863e-06 2024-04-25T22:52:25.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:25.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012236+0000", 2024-04-25T22:52:25.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1109999999999997e-06 2024-04-25T22:52:25.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:25.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012309+0000", 2024-04-25T22:52:25.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3242000000000001e-05 2024-04-25T22:52:25.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:25.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012324+0000", 2024-04-25T22:52:25.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4837e-05 2024-04-25T22:52:25.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:25.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015060+0000", 2024-04-25T22:52:25.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027363349999999999 2024-04-25T22:52:25.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:25.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015169+0000", 2024-04-25T22:52:25.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108372 2024-04-25T22:52:25.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:25.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015498+0000", 2024-04-25T22:52:25.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032949999999999999 2024-04-25T22:52:25.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:25.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021282+0000", 2024-04-25T22:52:25.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057836429999999998 2024-04-25T22:52:25.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:25.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024709+0000", 2024-04-25T22:52:25.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034271979999999998 2024-04-25T22:52:25.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:25.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024802+0000", 2024-04-25T22:52:25.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2960000000000004e-05 2024-04-25T22:52:25.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:25.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024863+0000", 2024-04-25T22:52:25.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0643999999999997e-05 2024-04-25T22:52:25.757 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:25.757 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:25.757 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:25.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.757 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:25.758 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:25.758 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.718117892999999, 2024-04-25T22:52:25.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012979447999999999, 2024-04-25T22:52:25.758 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:25.758 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:25.758 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:25.758 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:25.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:25.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:25.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:25.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:25.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:25.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:25.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:25.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:25.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:52:25.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:25.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012354+0000", 2024-04-25T22:52:25.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7740000000000004e-06 2024-04-25T22:52:25.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:25.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012365+0000", 2024-04-25T22:52:25.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.064e-05 2024-04-25T22:52:25.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:25.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012382+0000", 2024-04-25T22:52:25.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6999000000000001e-05 2024-04-25T22:52:25.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:25.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015958+0000", 2024-04-25T22:52:25.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035765699999999998 2024-04-25T22:52:25.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:25.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016037+0000", 2024-04-25T22:52:25.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8242000000000001e-05 2024-04-25T22:52:25.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:25.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016404+0000", 2024-04-25T22:52:25.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036784300000000002 2024-04-25T22:52:25.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:25.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021294+0000", 2024-04-25T22:52:25.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048890629999999999 2024-04-25T22:52:25.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:25.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024959+0000", 2024-04-25T22:52:25.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036651570000000001 2024-04-25T22:52:25.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:25.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025097+0000", 2024-04-25T22:52:25.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013788099999999999 2024-04-25T22:52:25.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:25.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025328+0000", 2024-04-25T22:52:25.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231492 2024-04-25T22:52:25.763 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:25.763 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:25.763 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:25.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.763 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:25.764 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:25.764 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.718030124000002, 2024-04-25T22:52:25.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013049827, 2024-04-25T22:52:25.764 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:25.764 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:25.764 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:25.764 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:25.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:25.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:25.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:25.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:25.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:25.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:25.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:25.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012437+0000", 2024-04-25T22:52:25.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-04-25T22:52:25.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:25.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012440+0000", 2024-04-25T22:52:25.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7609999999999999e-06 2024-04-25T22:52:25.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:25.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012449+0000", 2024-04-25T22:52:25.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.285e-06 2024-04-25T22:52:25.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:25.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012457+0000", 2024-04-25T22:52:25.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9510000000000006e-06 2024-04-25T22:52:25.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:25.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017106+0000", 2024-04-25T22:52:25.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046494220000000003 2024-04-25T22:52:25.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:25.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017223+0000", 2024-04-25T22:52:25.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116824 2024-04-25T22:52:25.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:25.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017345+0000", 2024-04-25T22:52:25.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122175 2024-04-25T22:52:25.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:25.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021299+0000", 2024-04-25T22:52:25.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039534879999999998 2024-04-25T22:52:25.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:25.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025398+0000", 2024-04-25T22:52:25.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040988960000000003 2024-04-25T22:52:25.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:25.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025439+0000", 2024-04-25T22:52:25.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0915999999999999e-05 2024-04-25T22:52:25.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:25.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025486+0000", 2024-04-25T22:52:25.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7534999999999998e-05 2024-04-25T22:52:25.769 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:25.769 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:25.769 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:25.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.769 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:25.769 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:25.769 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.717999972999998, 2024-04-25T22:52:25.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020988041999999998, 2024-04-25T22:52:25.769 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:25.769 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:25.769 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:25.769 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:25.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:25.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:25.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:25.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:25.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:25.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:25.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:25.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:25.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.99e-07 2024-04-25T22:52:25.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:25.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012470+0000", 2024-04-25T22:52:25.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2789999999999999e-06 2024-04-25T22:52:25.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:25.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012477+0000", 2024-04-25T22:52:25.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:52:25.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:25.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012500+0000", 2024-04-25T22:52:25.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2490999999999999e-05 2024-04-25T22:52:25.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:25.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021911+0000", 2024-04-25T22:52:25.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094114160000000006 2024-04-25T22:52:25.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:25.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022000+0000", 2024-04-25T22:52:25.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8601000000000001e-05 2024-04-25T22:52:25.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:25.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022359+0000", 2024-04-25T22:52:25.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035921999999999999 2024-04-25T22:52:25.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:25.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025541+0000", 2024-04-25T22:52:25.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031820619999999998 2024-04-25T22:52:25.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:25.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033375+0000", 2024-04-25T22:52:25.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078338379999999992 2024-04-25T22:52:25.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:25.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033415+0000", 2024-04-25T22:52:25.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9527000000000003e-05 2024-04-25T22:52:25.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:25.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033455+0000", 2024-04-25T22:52:25.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9932000000000003e-05 2024-04-25T22:52:25.774 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:25.774 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:25.774 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:25.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.775 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:25.775 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:25.775 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.717944780000003, 2024-04-25T22:52:25.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021043857999999999, 2024-04-25T22:52:25.775 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:25.775 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:25.775 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:25.775 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:25.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:25.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:25.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:25.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:25.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:25.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:25.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:25.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012523+0000", 2024-04-25T22:52:25.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.361e-06 2024-04-25T22:52:25.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:25.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012530+0000", 2024-04-25T22:52:25.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5440000000000004e-06 2024-04-25T22:52:25.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:25.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012541+0000", 2024-04-25T22:52:25.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1745e-05 2024-04-25T22:52:25.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:25.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012551+0000", 2024-04-25T22:52:25.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5789999999999993e-06 2024-04-25T22:52:25.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:25.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022709+0000", 2024-04-25T22:52:25.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010157685 2024-04-25T22:52:25.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:25.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022957+0000", 2024-04-25T22:52:25.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024824599999999998 2024-04-25T22:52:25.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:25.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023443+0000", 2024-04-25T22:52:25.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048578599999999999 2024-04-25T22:52:25.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:25.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025547+0000", 2024-04-25T22:52:25.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021044789999999998 2024-04-25T22:52:25.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:25.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033509+0000", 2024-04-25T22:52:25.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0079622180000000001 2024-04-25T22:52:25.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:25.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033542+0000", 2024-04-25T22:52:25.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3018000000000001e-05 2024-04-25T22:52:25.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:25.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033566+0000", 2024-04-25T22:52:25.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3197000000000002e-05 2024-04-25T22:52:25.780 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:25.780 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:25.780 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:25.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.780 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:25.781 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:25.781 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.717904814999997, 2024-04-25T22:52:25.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021122696, 2024-04-25T22:52:25.781 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:25.781 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:25.781 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:25.781 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:25.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:25.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:25.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:25.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:25.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:25.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:25.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:25.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:25.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:52:25.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:25.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012566+0000", 2024-04-25T22:52:25.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-04-25T22:52:25.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:25.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012619+0000", 2024-04-25T22:52:25.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2607e-05 2024-04-25T22:52:25.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:25.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012628+0000", 2024-04-25T22:52:25.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6500000000000008e-06 2024-04-25T22:52:25.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:25.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024024+0000", 2024-04-25T22:52:25.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011396007999999999 2024-04-25T22:52:25.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:25.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024198+0000", 2024-04-25T22:52:25.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000173215 2024-04-25T22:52:25.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:25.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024447+0000", 2024-04-25T22:52:25.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024898500000000002 2024-04-25T22:52:25.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:25.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026431+0000", 2024-04-25T22:52:25.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001984923 2024-04-25T22:52:25.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:25.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033608+0000", 2024-04-25T22:52:25.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071768459999999997 2024-04-25T22:52:25.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:25.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033646+0000", 2024-04-25T22:52:25.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299000000000003e-05 2024-04-25T22:52:25.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:25.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033684+0000", 2024-04-25T22:52:25.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8773000000000003e-05 2024-04-25T22:52:25.786 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:25.786 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:25.786 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:25.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.786 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:25.786 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:25.786 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.717816216000003, 2024-04-25T22:52:25.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021175381, 2024-04-25T22:52:25.787 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:25.787 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:25.787 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:25.787 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:25.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:25.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:25.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:25.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:25.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:25.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:25.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:25.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012651+0000", 2024-04-25T22:52:25.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:52:25.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:25.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012656+0000", 2024-04-25T22:52:25.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8899999999999998e-06 2024-04-25T22:52:25.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:25.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012666+0000", 2024-04-25T22:52:25.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0346999999999999e-05 2024-04-25T22:52:25.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:25.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012675+0000", 2024-04-25T22:52:25.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9930000000000001e-06 2024-04-25T22:52:25.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:25.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025661+0000", 2024-04-25T22:52:25.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01298531 2024-04-25T22:52:25.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:25.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025757+0000", 2024-04-25T22:52:25.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5822000000000005e-05 2024-04-25T22:52:25.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:25.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025907+0000", 2024-04-25T22:52:25.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015051499999999999 2024-04-25T22:52:25.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:25.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026435+0000", 2024-04-25T22:52:25.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052762200000000005 2024-04-25T22:52:25.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:25.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033732+0000", 2024-04-25T22:52:25.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072978419999999997 2024-04-25T22:52:25.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:25.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033787+0000", 2024-04-25T22:52:25.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4703999999999997e-05 2024-04-25T22:52:25.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:25.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033826+0000", 2024-04-25T22:52:25.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8458999999999999e-05 2024-04-25T22:52:25.792 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:25.792 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:25.792 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:25.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.792 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:25.792 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:25.792 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.717760802000001, 2024-04-25T22:52:25.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021244174000000001, 2024-04-25T22:52:25.792 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:25.792 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:25.792 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:25.793 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:25.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:25.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:25.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:25.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:25.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:25.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:25.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:25.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:25.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:52:25.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:25.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012712+0000", 2024-04-25T22:52:25.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.913e-06 2024-04-25T22:52:25.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:25.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012722+0000", 2024-04-25T22:52:25.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2879999999999998e-06 2024-04-25T22:52:25.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:25.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012727+0000", 2024-04-25T22:52:25.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8429999999999998e-06 2024-04-25T22:52:25.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:25.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026099+0000", 2024-04-25T22:52:25.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013371450999999999 2024-04-25T22:52:25.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:25.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026147+0000", 2024-04-25T22:52:25.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7837999999999998e-05 2024-04-25T22:52:25.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:25.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026254+0000", 2024-04-25T22:52:25.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107314 2024-04-25T22:52:25.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:25.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026686+0000", 2024-04-25T22:52:25.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000432428 2024-04-25T22:52:25.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:25.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033873+0000", 2024-04-25T22:52:25.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071864399999999997 2024-04-25T22:52:25.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:25.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033904+0000", 2024-04-25T22:52:25.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1321e-05 2024-04-25T22:52:25.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:25.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033950+0000", 2024-04-25T22:52:25.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5707999999999997e-05 2024-04-25T22:52:25.797 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:25.797 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:25.797 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:25.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.798 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:25.798 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:25.798 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.717730416999999, 2024-04-25T22:52:25.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01096505, 2024-04-25T22:52:25.798 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:25.798 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:25.798 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:25.798 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:25.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:25.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:25.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:25.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:25.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:25.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:25.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:25.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012737+0000", 2024-04-25T22:52:25.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:52:25.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:25.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012739+0000", 2024-04-25T22:52:25.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-04-25T22:52:25.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:25.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012743+0000", 2024-04-25T22:52:25.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3239999999999996e-06 2024-04-25T22:52:25.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:25.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012746+0000", 2024-04-25T22:52:25.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.129e-06 2024-04-25T22:52:25.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:25.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012796+0000", 2024-04-25T22:52:25.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9231999999999999e-05 2024-04-25T22:52:25.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:25.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012915+0000", 2024-04-25T22:52:25.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119021 2024-04-25T22:52:25.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:25.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013069+0000", 2024-04-25T22:52:25.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015463900000000001 2024-04-25T22:52:25.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:25.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019237+0000", 2024-04-25T22:52:25.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061680329999999998 2024-04-25T22:52:25.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:25.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023603+0000", 2024-04-25T22:52:25.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043655860000000003 2024-04-25T22:52:25.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:25.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023659+0000", 2024-04-25T22:52:25.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6484000000000003e-05 2024-04-25T22:52:25.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:25.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023701+0000", 2024-04-25T22:52:25.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1761999999999998e-05 2024-04-25T22:52:25.803 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:25.803 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:25.803 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:25.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.803 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:25.803 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:25.803 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.717705469000002, 2024-04-25T22:52:25.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011234429000000001, 2024-04-25T22:52:25.803 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:25.803 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:25.804 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:25.804 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:25.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:25.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:25.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:25.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:25.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:25.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:25.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:25.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012762+0000", 2024-04-25T22:52:25.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-04-25T22:52:25.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:25.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012765+0000", 2024-04-25T22:52:25.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2569999999999999e-06 2024-04-25T22:52:25.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:25.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012783+0000", 2024-04-25T22:52:25.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8431999999999999e-05 2024-04-25T22:52:25.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:25.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012799+0000", 2024-04-25T22:52:25.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5438999999999999e-05 2024-04-25T22:52:25.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:25.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013826+0000", 2024-04-25T22:52:25.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010275060000000001 2024-04-25T22:52:25.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:25.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013913+0000", 2024-04-25T22:52:25.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.708e-05 2024-04-25T22:52:25.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:25.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014098+0000", 2024-04-25T22:52:25.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018519399999999999 2024-04-25T22:52:25.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:25.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019684+0000", 2024-04-25T22:52:25.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055860079999999999 2024-04-25T22:52:25.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:25.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023876+0000", 2024-04-25T22:52:25.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041918800000000003 2024-04-25T22:52:25.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:25.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023957+0000", 2024-04-25T22:52:25.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1165e-05 2024-04-25T22:52:25.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:25.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023995+0000", 2024-04-25T22:52:25.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:52:25.808 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:25.808 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:25.808 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:25.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.809 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:25.809 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:25.809 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.717607690000001, 2024-04-25T22:52:25.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011131200000000001, 2024-04-25T22:52:25.809 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:25.809 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:25.809 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:25.809 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:25.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:25.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:25.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:25.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:25.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:25.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:25.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:25.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012860+0000", 2024-04-25T22:52:25.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3900000000000004e-07 2024-04-25T22:52:25.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:25.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012865+0000", 2024-04-25T22:52:25.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5609999999999998e-06 2024-04-25T22:52:25.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:25.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012895+0000", 2024-04-25T22:52:25.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9847000000000001e-05 2024-04-25T22:52:25.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:25.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012905+0000", 2024-04-25T22:52:25.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.03e-05 2024-04-25T22:52:25.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:25.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015020+0000", 2024-04-25T22:52:25.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021142940000000001 2024-04-25T22:52:25.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:25.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015182+0000", 2024-04-25T22:52:25.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016248099999999999 2024-04-25T22:52:25.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:52:25.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015357+0000", 2024-04-25T22:52:25.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017471000000000001 2024-04-25T22:52:25.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:25.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021021+0000", 2024-04-25T22:52:25.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056638340000000004 2024-04-25T22:52:25.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:25.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023712+0000", 2024-04-25T22:52:25.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026910380000000002 2024-04-25T22:52:25.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:25.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023763+0000", 2024-04-25T22:52:25.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1477999999999997e-05 2024-04-25T22:52:25.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:25.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023990+0000", 2024-04-25T22:52:25.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000226818 2024-04-25T22:52:25.814 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:25.814 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:25.814 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:25.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.815 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:25.815 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:25.815 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.717484593999998, 2024-04-25T22:52:25.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011705299000000001, 2024-04-25T22:52:25.815 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:25.815 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:25.815 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:25.815 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:25.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:25.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:25.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:25.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:25.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:25.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:25.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:25.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012983+0000", 2024-04-25T22:52:25.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:52:25.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:25.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012986+0000", 2024-04-25T22:52:25.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5700000000000001e-06 2024-04-25T22:52:25.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:25.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012993+0000", 2024-04-25T22:52:25.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8730000000000001e-06 2024-04-25T22:52:25.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:25.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013000+0000", 2024-04-25T22:52:25.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1890000000000001e-06 2024-04-25T22:52:25.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:25.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:52:25.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002147866 2024-04-25T22:52:25.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:25.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015351+0000", 2024-04-25T22:52:25.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020300799999999999 2024-04-25T22:52:25.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:25.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016260+0000", 2024-04-25T22:52:25.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00090926799999999997 2024-04-25T22:52:25.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:25.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022669+0000", 2024-04-25T22:52:25.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064082849999999997 2024-04-25T22:52:25.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:25.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024584+0000", 2024-04-25T22:52:25.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019151699999999999 2024-04-25T22:52:25.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:25.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024643+0000", 2024-04-25T22:52:25.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8888999999999998e-05 2024-04-25T22:52:25.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:25.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024687+0000", 2024-04-25T22:52:25.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4444999999999999e-05 2024-04-25T22:52:25.820 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:25.820 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:25.820 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:25.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.820 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:25.820 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:25.820 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.717457003, 2024-04-25T22:52:25.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011249699, 2024-04-25T22:52:25.820 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:25.820 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:25.821 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:25.821 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:25.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:25.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:25.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:25.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:25.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:25.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:25.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:25.822 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013010+0000", 2024-04-25T22:52:25.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2099999999999996e-07 2024-04-25T22:52:25.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.822 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:25.822 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013013+0000", 2024-04-25T22:52:25.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1310000000000002e-06 2024-04-25T22:52:25.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.822 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:25.822 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013020+0000", 2024-04-25T22:52:25.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3330000000000002e-06 2024-04-25T22:52:25.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:25.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013025+0000", 2024-04-25T22:52:25.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6760000000000004e-06 2024-04-25T22:52:25.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:25.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013163+0000", 2024-04-25T22:52:25.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013824599999999999 2024-04-25T22:52:25.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:25.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013504+0000", 2024-04-25T22:52:25.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034080299999999998 2024-04-25T22:52:25.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:25.824 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013613+0000", 2024-04-25T22:52:25.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108705 2024-04-25T22:52:25.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:25.824 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015831+0000", 2024-04-25T22:52:25.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002217672 2024-04-25T22:52:25.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:25.824 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024137+0000", 2024-04-25T22:52:25.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0083060489999999994 2024-04-25T22:52:25.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:25.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024218+0000", 2024-04-25T22:52:25.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1351000000000001e-05 2024-04-25T22:52:25.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:25.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024259+0000", 2024-04-25T22:52:25.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1112000000000002e-05 2024-04-25T22:52:25.825 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:25.825 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:25.825 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:25.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.826 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.826 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:25.826 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:25.826 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.717369277000003, 2024-04-25T22:52:25.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020379749999999999, 2024-04-25T22:52:25.826 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:25.826 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:25.826 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:25.826 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:25.826 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.826 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:25.826 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:25.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:25.826 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.827 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:25.827 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:25.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:25.827 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.827 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:25.827 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013098+0000", 2024-04-25T22:52:25.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:52:25.827 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.827 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:25.827 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013105+0000", 2024-04-25T22:52:25.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5969999999999997e-06 2024-04-25T22:52:25.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.828 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:25.828 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013190+0000", 2024-04-25T22:52:25.828 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5618999999999995e-05 2024-04-25T22:52:25.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.828 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:25.828 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013200+0000", 2024-04-25T22:52:25.828 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5859999999999994e-06 2024-04-25T22:52:25.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.828 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:25.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020265+0000", 2024-04-25T22:52:25.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070653349999999998 2024-04-25T22:52:25.829 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.829 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:25.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020454+0000", 2024-04-25T22:52:25.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189316 2024-04-25T22:52:25.829 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.829 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:25.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020586+0000", 2024-04-25T22:52:25.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013195700000000001 2024-04-25T22:52:25.829 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.830 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:25.830 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023822+0000", 2024-04-25T22:52:25.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032358529999999999 2024-04-25T22:52:25.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.830 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:25.830 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033409+0000", 2024-04-25T22:52:25.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095870520000000004 2024-04-25T22:52:25.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.831 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:25.831 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033447+0000", 2024-04-25T22:52:25.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7261999999999997e-05 2024-04-25T22:52:25.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.831 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.831 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:25.831 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033477+0000", 2024-04-25T22:52:25.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0389e-05 2024-04-25T22:52:25.831 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:25.831 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:25.831 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:25.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.831 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.831 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:25.832 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:25.832 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.717252770999998, 2024-04-25T22:52:25.832 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010857383999999999, 2024-04-25T22:52:25.832 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:25.832 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:25.832 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:25.832 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:25.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.832 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:25.832 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:25.832 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:25.832 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.832 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:25.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:25.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:25.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.833 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:25.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:25.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:52:25.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.833 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:25.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013218+0000", 2024-04-25T22:52:25.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8199999999999998e-06 2024-04-25T22:52:25.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:25.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013226+0000", 2024-04-25T22:52:25.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7649999999999993e-06 2024-04-25T22:52:25.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:25.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013259+0000", 2024-04-25T22:52:25.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2727e-05 2024-04-25T22:52:25.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:25.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014809+0000", 2024-04-25T22:52:25.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001550144 2024-04-25T22:52:25.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:25.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014958+0000", 2024-04-25T22:52:25.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014890300000000001 2024-04-25T22:52:25.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:52:25.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015087+0000", 2024-04-25T22:52:25.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012939200000000001 2024-04-25T22:52:25.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:25.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020212+0000", 2024-04-25T22:52:25.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051248939999999996 2024-04-25T22:52:25.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.836 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:25.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023699+0000", 2024-04-25T22:52:25.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034873289999999999 2024-04-25T22:52:25.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.836 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:25.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024014+0000", 2024-04-25T22:52:25.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031473999999999999 2024-04-25T22:52:25.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:25.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024071+0000", 2024-04-25T22:52:25.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7040000000000003e-05 2024-04-25T22:52:25.837 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:25.837 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:25.837 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:25.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.837 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:25.837 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:25.837 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.717198066000002, 2024-04-25T22:52:25.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012329677000000001, 2024-04-25T22:52:25.837 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:25.837 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:25.838 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:25.838 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:25.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:25.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:25.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:25.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:25.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:25.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:25.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:25.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013269+0000", 2024-04-25T22:52:25.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5000000000000002e-07 2024-04-25T22:52:25.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:25.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:52:25.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6909999999999999e-06 2024-04-25T22:52:25.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:25.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013284+0000", 2024-04-25T22:52:25.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0963e-05 2024-04-25T22:52:25.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:25.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013361+0000", 2024-04-25T22:52:25.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7379999999999994e-05 2024-04-25T22:52:25.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:25.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013448+0000", 2024-04-25T22:52:25.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6990000000000006e-05 2024-04-25T22:52:25.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:25.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013632+0000", 2024-04-25T22:52:25.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018396800000000001 2024-04-25T22:52:25.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:25.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013800+0000", 2024-04-25T22:52:25.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167467 2024-04-25T22:52:25.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:25.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.018570+0000", 2024-04-25T22:52:25.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047701460000000003 2024-04-25T22:52:25.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:25.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025507+0000", 2024-04-25T22:52:25.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069372039999999998 2024-04-25T22:52:25.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:25.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025562+0000", 2024-04-25T22:52:25.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4858999999999998e-05 2024-04-25T22:52:25.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:25.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025598+0000", 2024-04-25T22:52:25.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6259e-05 2024-04-25T22:52:25.842 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:25.842 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:25.843 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:25.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.843 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:25.843 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:25.843 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.717066193000001, 2024-04-25T22:52:25.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020176666999999999, 2024-04-25T22:52:25.843 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:25.843 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:25.843 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:52:25.843 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:25.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:25.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:25.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:25.844 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.844 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:25.844 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:25.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:25.844 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.844 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:25.844 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:52:25.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-04-25T22:52:25.844 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:25.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013405+0000", 2024-04-25T22:52:25.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0559999999999998e-06 2024-04-25T22:52:25.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:25.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013422+0000", 2024-04-25T22:52:25.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6770999999999999e-05 2024-04-25T22:52:25.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:25.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013431+0000", 2024-04-25T22:52:25.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5019999999999998e-06 2024-04-25T22:52:25.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:25.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021720+0000", 2024-04-25T22:52:25.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082884340000000008 2024-04-25T22:52:25.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:25.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022122+0000", 2024-04-25T22:52:25.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000401634 2024-04-25T22:52:25.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:25.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:25.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:25.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033577+0000", 2024-04-25T22:52:25.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011455435999999999 2024-04-25T22:52:25.847 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:25.847 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:25.847 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:25.847 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:25.847 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:25.847 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:25.849 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:52:25.849 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:25.848+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:25.949 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:25.949+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:25.959 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-25T22:52:25.959 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-25T22:52:25.960 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-25T22:52:25.960 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-25T22:52:25.969 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:52:26.000 INFO:teuthology.orchestra.run.smithi052.stdout:moved 0 / 210 (0%) 2024-04-25T22:52:26.000 INFO:teuthology.orchestra.run.smithi052.stdout:avg 70 2024-04-25T22:52:26.000 INFO:teuthology.orchestra.run.smithi052.stdout:stddev 2.16025 -> 2.16025 (expected baseline 6.8313) 2024-04-25T22:52:26.000 INFO:teuthology.orchestra.run.smithi052.stdout:min osd.2 with 67 -> 67 pgs (0.957143 -> 0.957143 * mean) 2024-04-25T22:52:26.000 INFO:teuthology.orchestra.run.smithi052.stdout:max osd.1 with 72 -> 72 pgs (1.02857 -> 1.02857 * mean) 2024-04-25T22:52:26.000 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:52:26.000 INFO:teuthology.orchestra.run.smithi052.stdout:oload 1000 2024-04-25T22:52:26.001 INFO:teuthology.orchestra.run.smithi052.stdout:max_change 3 2024-04-25T22:52:26.001 INFO:teuthology.orchestra.run.smithi052.stdout:max_change_osds 4 2024-04-25T22:52:26.001 INFO:teuthology.orchestra.run.smithi052.stdout:average_utilization 0.0003 2024-04-25T22:52:26.001 INFO:teuthology.orchestra.run.smithi052.stdout:overload_utilization 0.0034 2024-04-25T22:52:26.001 INFO:teuthology.orchestra.run.smithi052.stderr:no change 2024-04-25T22:52:26.013 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '110', 'type': 'reweight-by-utilization'} 2024-04-25T22:52:26.013 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 110 3.0 2024-04-25T22:52:26.050 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:26.049+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:26.074 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-25T22:52:26.074 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-25T22:52:26.074 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-25T22:52:26.074 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-25T22:52:26.074 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-25T22:52:26.083 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:52:26.101 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-25T22:52:26.150 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:26.150+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:26.186 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-25T22:52:26.186 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-25T22:52:26.186 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-25T22:52:26.187 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-25T22:52:26.187 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.187 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(mds.0.3:28 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:52:26.187 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.013845+0000", 2024-04-25T22:52:26.187 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 33.171042507000003, 2024-04-25T22:52:26.187 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002002658, 2024-04-25T22:52:26.187 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:26.187 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:26.187 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:26.187 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:26.187 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.187 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:26.188 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013845+0000", 2024-04-25T22:52:26.188 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:26.188 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.188 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.188 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:26.188 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013845+0000", 2024-04-25T22:52:26.188 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:26.188 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.188 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.188 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:26.188 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013845+0000", 2024-04-25T22:52:26.188 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6100000000000002e-07 2024-04-25T22:52:26.188 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.188 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.189 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:26.189 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013859+0000", 2024-04-25T22:52:26.189 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4045e-05 2024-04-25T22:52:26.189 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.189 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.189 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:26.189 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013883+0000", 2024-04-25T22:52:26.189 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4020999999999999e-05 2024-04-25T22:52:26.189 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.189 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.189 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:26.189 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013904+0000", 2024-04-25T22:52:26.189 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.084e-05 2024-04-25T22:52:26.190 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.190 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.190 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:26.190 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013953+0000", 2024-04-25T22:52:26.190 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8652000000000001e-05 2024-04-25T22:52:26.190 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.190 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.190 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:26.190 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013983+0000", 2024-04-25T22:52:26.190 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0083e-05 2024-04-25T22:52:26.190 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.190 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.190 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:26.191 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015809+0000", 2024-04-25T22:52:26.191 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001826708 2024-04-25T22:52:26.191 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.191 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.191 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:26.191 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015848+0000", 2024-04-25T22:52:26.191 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8047999999999999e-05 2024-04-25T22:52:26.191 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:26.191 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:26.191 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:26.191 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.191 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.191 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:26.191 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.014834+0000", 2024-04-25T22:52:26.191 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 33.170052912000003, 2024-04-25T22:52:26.191 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0082660119999999997, 2024-04-25T22:52:26.192 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:26.192 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:26.192 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:26.192 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:26.192 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.192 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:26.192 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014834+0000", 2024-04-25T22:52:26.192 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:26.192 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.192 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.192 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:26.192 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014834+0000", 2024-04-25T22:52:26.192 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:26.192 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.192 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.193 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:26.193 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014837+0000", 2024-04-25T22:52:26.193 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.774e-06 2024-04-25T22:52:26.193 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.193 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.193 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:26.193 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014844+0000", 2024-04-25T22:52:26.193 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.1629999999999999e-06 2024-04-25T22:52:26.193 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.193 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.193 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:26.193 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014853+0000", 2024-04-25T22:52:26.193 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0829999999999993e-06 2024-04-25T22:52:26.193 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.194 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.194 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:26.194 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014862+0000", 2024-04-25T22:52:26.194 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0239999999999997e-06 2024-04-25T22:52:26.194 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.194 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.194 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:26.194 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014926+0000", 2024-04-25T22:52:26.194 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4571000000000002e-05 2024-04-25T22:52:26.194 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.194 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.194 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:26.194 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015064+0000", 2024-04-25T22:52:26.195 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013788200000000001 2024-04-25T22:52:26.195 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.195 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.195 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:26.195 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015240+0000", 2024-04-25T22:52:26.195 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000175697 2024-04-25T22:52:26.195 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.195 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.195 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:26.195 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017382+0000", 2024-04-25T22:52:26.195 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021422920000000001 2024-04-25T22:52:26.195 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.195 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.195 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:26.196 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023016+0000", 2024-04-25T22:52:26.196 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00563446 2024-04-25T22:52:26.196 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.196 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.196 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:26.196 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023062+0000", 2024-04-25T22:52:26.196 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5667999999999997e-05 2024-04-25T22:52:26.196 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.196 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.196 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:26.196 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023100+0000", 2024-04-25T22:52:26.196 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8398000000000001e-05 2024-04-25T22:52:26.196 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:26.196 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:26.197 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:26.197 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.197 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.197 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:26.197 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.014883+0000", 2024-04-25T22:52:26.197 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 33.170004693999999, 2024-04-25T22:52:26.197 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0083115319999999999, 2024-04-25T22:52:26.197 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:26.197 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:26.197 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:26.197 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:26.197 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.197 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:26.198 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014883+0000", 2024-04-25T22:52:26.198 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:26.198 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.198 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.198 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:26.198 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014883+0000", 2024-04-25T22:52:26.198 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:26.198 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.198 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.198 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:26.198 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014883+0000", 2024-04-25T22:52:26.198 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1200000000000003e-07 2024-04-25T22:52:26.198 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.199 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.199 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:26.199 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014887+0000", 2024-04-25T22:52:26.199 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4249999999999998e-06 2024-04-25T22:52:26.199 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.199 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.199 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:26.199 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014892+0000", 2024-04-25T22:52:26.199 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1150000000000002e-06 2024-04-25T22:52:26.199 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.199 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.199 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:26.199 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014896+0000", 2024-04-25T22:52:26.200 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3030000000000001e-06 2024-04-25T22:52:26.200 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.200 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.200 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:26.200 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015597+0000", 2024-04-25T22:52:26.200 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00070106400000000005 2024-04-25T22:52:26.200 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.200 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.200 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:26.200 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015681+0000", 2024-04-25T22:52:26.200 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.3417000000000004e-05 2024-04-25T22:52:26.200 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.200 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.200 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:26.200 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015800+0000", 2024-04-25T22:52:26.201 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000119522 2024-04-25T22:52:26.201 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.201 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.201 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:26.201 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017389+0000", 2024-04-25T22:52:26.201 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0015889739999999999 2024-04-25T22:52:26.201 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.201 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.201 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:26.201 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023129+0000", 2024-04-25T22:52:26.201 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0057398420000000002 2024-04-25T22:52:26.201 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.201 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.201 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:26.202 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023161+0000", 2024-04-25T22:52:26.202 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2002999999999998e-05 2024-04-25T22:52:26.202 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.202 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.202 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:26.202 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023194+0000", 2024-04-25T22:52:26.202 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3355000000000002e-05 2024-04-25T22:52:26.202 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:26.202 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:26.202 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:26.202 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.202 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.202 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:26.203 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.014902+0000", 2024-04-25T22:52:26.203 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 33.169985048999997, 2024-04-25T22:52:26.203 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0078159460000000007, 2024-04-25T22:52:26.203 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:26.203 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:26.203 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:26.203 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:26.203 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.203 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:26.203 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014902+0000", 2024-04-25T22:52:26.203 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:26.203 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.203 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.203 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:26.204 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014902+0000", 2024-04-25T22:52:26.204 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:26.204 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.204 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.204 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:26.204 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014903+0000", 2024-04-25T22:52:26.204 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.65e-07 2024-04-25T22:52:26.204 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.204 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.204 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:26.204 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014910+0000", 2024-04-25T22:52:26.204 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7619999999999995e-06 2024-04-25T22:52:26.204 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.204 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.205 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:26.205 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014915+0000", 2024-04-25T22:52:26.205 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2660000000000003e-06 2024-04-25T22:52:26.205 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.205 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.205 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:26.205 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014918+0000", 2024-04-25T22:52:26.205 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.331e-06 2024-04-25T22:52:26.205 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.205 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.205 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:26.205 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015554+0000", 2024-04-25T22:52:26.205 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00063627599999999996 2024-04-25T22:52:26.205 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.206 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.206 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:26.206 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015685+0000", 2024-04-25T22:52:26.206 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013059399999999999 2024-04-25T22:52:26.206 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.206 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.206 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:26.206 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015820+0000", 2024-04-25T22:52:26.206 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013471499999999999 2024-04-25T22:52:26.206 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.206 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.206 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:26.206 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017394+0000", 2024-04-25T22:52:26.207 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0015747459999999999 2024-04-25T22:52:26.207 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.207 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.207 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:26.207 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022598+0000", 2024-04-25T22:52:26.207 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.005203811 2024-04-25T22:52:26.207 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.207 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.207 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:26.207 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022671+0000", 2024-04-25T22:52:26.207 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3042999999999998e-05 2024-04-25T22:52:26.207 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.207 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.208 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:26.208 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022718+0000", 2024-04-25T22:52:26.208 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7136999999999999e-05 2024-04-25T22:52:26.208 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:26.208 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:26.208 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:26.208 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.208 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.208 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:26.208 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.014933+0000", 2024-04-25T22:52:26.208 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 33.169954675, 2024-04-25T22:52:26.208 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079271519999999998, 2024-04-25T22:52:26.208 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:26.208 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:26.209 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:26.209 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:26.209 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.209 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:26.209 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014933+0000", 2024-04-25T22:52:26.209 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:26.209 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.209 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.209 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:26.209 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014933+0000", 2024-04-25T22:52:26.209 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:26.209 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.209 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.209 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:26.210 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014933+0000", 2024-04-25T22:52:26.210 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0999999999999999e-07 2024-04-25T22:52:26.210 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.210 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.210 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:26.210 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014937+0000", 2024-04-25T22:52:26.210 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6090000000000001e-06 2024-04-25T22:52:26.210 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.210 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.210 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:26.210 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014943+0000", 2024-04-25T22:52:26.210 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.7100000000000001e-06 2024-04-25T22:52:26.210 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.210 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.211 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:26.211 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014949+0000", 2024-04-25T22:52:26.211 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9410000000000004e-06 2024-04-25T22:52:26.211 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.211 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.211 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:26.211 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016135+0000", 2024-04-25T22:52:26.211 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0011854750000000001 2024-04-25T22:52:26.211 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.211 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.211 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:26.211 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016185+0000", 2024-04-25T22:52:26.211 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.9888000000000001e-05 2024-04-25T22:52:26.211 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.212 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.212 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:26.212 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016297+0000", 2024-04-25T22:52:26.212 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011231299999999999 2024-04-25T22:52:26.212 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.212 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.212 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:26.212 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017399+0000", 2024-04-25T22:52:26.212 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0011018149999999999 2024-04-25T22:52:26.212 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.212 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.212 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:26.212 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022764+0000", 2024-04-25T22:52:26.212 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0053649819999999999 2024-04-25T22:52:26.213 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.213 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.213 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:26.213 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022821+0000", 2024-04-25T22:52:26.213 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7655000000000003e-05 2024-04-25T22:52:26.213 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.213 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.213 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:26.213 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022860+0000", 2024-04-25T22:52:26.213 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8353999999999999e-05 2024-04-25T22:52:26.213 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:26.213 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:26.213 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:26.213 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.214 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.214 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:26.214 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.014957+0000", 2024-04-25T22:52:26.214 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 33.169930844, 2024-04-25T22:52:26.214 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0083856810000000007, 2024-04-25T22:52:26.214 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:26.214 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:26.214 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:26.214 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:26.214 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.214 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:26.214 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014957+0000", 2024-04-25T22:52:26.214 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:26.215 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.215 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.215 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:26.215 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014957+0000", 2024-04-25T22:52:26.215 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:26.215 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.215 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.215 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:26.215 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014957+0000", 2024-04-25T22:52:26.215 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:52:26.215 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.215 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.215 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:26.215 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014961+0000", 2024-04-25T22:52:26.216 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2309999999999998e-06 2024-04-25T22:52:26.216 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.216 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.216 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:26.216 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014969+0000", 2024-04-25T22:52:26.216 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2540000000000003e-06 2024-04-25T22:52:26.216 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.216 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.216 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:26.216 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014972+0000", 2024-04-25T22:52:26.216 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4580000000000002e-06 2024-04-25T22:52:26.216 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.216 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.217 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:26.217 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016130+0000", 2024-04-25T22:52:26.217 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001157812 2024-04-25T22:52:26.217 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.217 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.217 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:26.217 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016247+0000", 2024-04-25T22:52:26.217 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000117268 2024-04-25T22:52:26.217 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.217 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.217 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:26.217 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016381+0000", 2024-04-25T22:52:26.217 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013417999999999999 2024-04-25T22:52:26.218 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.218 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.218 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:26.218 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017946+0000", 2024-04-25T22:52:26.218 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001564817 2024-04-25T22:52:26.218 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.218 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.218 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:26.218 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023240+0000", 2024-04-25T22:52:26.218 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0052938289999999999 2024-04-25T22:52:26.218 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.218 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.218 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:26.218 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023295+0000", 2024-04-25T22:52:26.219 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4969999999999997e-05 2024-04-25T22:52:26.219 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.219 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.219 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:26.219 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023342+0000", 2024-04-25T22:52:26.219 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7126000000000002e-05 2024-04-25T22:52:26.219 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:26.219 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:26.219 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:26.219 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.219 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.219 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:26.219 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.014978+0000", 2024-04-25T22:52:26.220 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 33.169909726, 2024-04-25T22:52:26.220 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0074058609999999997, 2024-04-25T22:52:26.220 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:26.220 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:26.220 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:26.220 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:26.220 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.220 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:26.220 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014978+0000", 2024-04-25T22:52:26.220 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:26.220 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.220 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.220 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:26.221 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014978+0000", 2024-04-25T22:52:26.221 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:26.221 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.221 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.221 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:26.221 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014978+0000", 2024-04-25T22:52:26.221 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0600000000000001e-07 2024-04-25T22:52:26.221 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.221 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.221 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:26.221 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014980+0000", 2024-04-25T22:52:26.221 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3130000000000001e-06 2024-04-25T22:52:26.221 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.221 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.222 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:26.222 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014984+0000", 2024-04-25T22:52:26.222 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6689999999999999e-06 2024-04-25T22:52:26.222 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.222 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.222 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:26.222 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014987+0000", 2024-04-25T22:52:26.222 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0709999999999999e-06 2024-04-25T22:52:26.222 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.222 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.222 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:26.222 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015035+0000", 2024-04-25T22:52:26.222 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7737000000000001e-05 2024-04-25T22:52:26.223 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.223 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.223 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:26.223 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:52:26.223 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113053 2024-04-25T22:52:26.223 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.223 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.223 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:26.223 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015255+0000", 2024-04-25T22:52:26.223 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010735599999999999 2024-04-25T22:52:26.223 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.223 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.223 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:26.223 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016248+0000", 2024-04-25T22:52:26.224 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00099310200000000005 2024-04-25T22:52:26.224 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.224 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.224 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:26.224 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022282+0000", 2024-04-25T22:52:26.224 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060341769999999999 2024-04-25T22:52:26.224 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.224 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.224 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:26.224 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022341+0000", 2024-04-25T22:52:26.224 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8938999999999999e-05 2024-04-25T22:52:26.224 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.224 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.225 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:26.225 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022384+0000", 2024-04-25T22:52:26.225 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2138000000000002e-05 2024-04-25T22:52:26.225 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:26.225 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:26.225 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:26.225 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.225 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.225 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:26.225 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.014995+0000", 2024-04-25T22:52:26.225 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 33.169891982999999, 2024-04-25T22:52:26.225 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075678170000000001, 2024-04-25T22:52:26.225 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:26.225 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:26.226 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-25T22:52:26.226 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:26.226 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.226 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:26.226 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014995+0000", 2024-04-25T22:52:26.226 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:26.226 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.226 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.226 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:26.226 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014995+0000", 2024-04-25T22:52:26.226 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:26.226 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.226 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.226 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:26.227 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014996+0000", 2024-04-25T22:52:26.227 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7500000000000001e-07 2024-04-25T22:52:26.227 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.227 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.227 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:26.227 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014998+0000", 2024-04-25T22:52:26.227 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2330000000000001e-06 2024-04-25T22:52:26.227 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.227 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.227 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:26.227 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015002+0000", 2024-04-25T22:52:26.227 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9570000000000004e-06 2024-04-25T22:52:26.227 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.227 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.228 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:26.228 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015008+0000", 2024-04-25T22:52:26.228 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0340000000000002e-06 2024-04-25T22:52:26.228 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.228 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.228 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:26.228 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015476+0000", 2024-04-25T22:52:26.228 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00046806899999999999 2024-04-25T22:52:26.228 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.228 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.228 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:26.228 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015565+0000", 2024-04-25T22:52:26.228 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.9126e-05 2024-04-25T22:52:26.229 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.229 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.229 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:26.229 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022563+0000", 2024-04-25T22:52:26.229 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0069981230000000002 2024-04-25T22:52:26.229 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:26.229 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:26.229 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:26.229 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.229 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.229 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:26.229 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.015033+0000", 2024-04-25T22:52:26.229 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 33.169853928999999, 2024-04-25T22:52:26.230 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010204922999999999, 2024-04-25T22:52:26.230 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:26.230 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:26.230 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-25T22:52:26.230 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:26.230 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.230 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:26.230 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015033+0000", 2024-04-25T22:52:26.230 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:26.230 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.230 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.230 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:26.230 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015033+0000", 2024-04-25T22:52:26.230 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:26.231 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.231 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.231 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:26.231 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015036+0000", 2024-04-25T22:52:26.231 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9110000000000002e-06 2024-04-25T22:52:26.231 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.231 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.231 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:26.231 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015040+0000", 2024-04-25T22:52:26.231 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0570000000000003e-06 2024-04-25T22:52:26.231 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.231 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.231 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:26.231 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015050+0000", 2024-04-25T22:52:26.232 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1449999999999997e-06 2024-04-25T22:52:26.232 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.232 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.232 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:26.232 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015058+0000", 2024-04-25T22:52:26.232 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.3960000000000006e-06 2024-04-25T22:52:26.232 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.232 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.232 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:26.232 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016951+0000", 2024-04-25T22:52:26.232 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0018930150000000001 2024-04-25T22:52:26.232 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.232 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.232 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:26.233 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017101+0000", 2024-04-25T22:52:26.233 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00015004800000000001 2024-04-25T22:52:26.233 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.233 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.233 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:26.233 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.025238+0000", 2024-04-25T22:52:26.233 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0081373509999999993 2024-04-25T22:52:26.233 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:26.233 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:26.233 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:26.233 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.233 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.233 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:26.233 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.015069+0000", 2024-04-25T22:52:26.234 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 33.169817995000002, 2024-04-25T22:52:26.234 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0066281769999999999, 2024-04-25T22:52:26.234 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:26.234 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:26.234 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-25T22:52:26.234 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:26.234 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.234 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:26.234 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015069+0000", 2024-04-25T22:52:26.234 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:26.234 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.234 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.234 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:26.234 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015069+0000", 2024-04-25T22:52:26.235 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:26.235 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.235 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.235 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:26.235 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015070+0000", 2024-04-25T22:52:26.235 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8899999999999999e-07 2024-04-25T22:52:26.235 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.235 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.235 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:26.235 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015082+0000", 2024-04-25T22:52:26.235 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.164e-05 2024-04-25T22:52:26.235 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.235 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.235 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:26.236 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015093+0000", 2024-04-25T22:52:26.236 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1066e-05 2024-04-25T22:52:26.236 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.236 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.236 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:26.236 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015099+0000", 2024-04-25T22:52:26.236 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8619999999999999e-06 2024-04-25T22:52:26.236 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.236 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.236 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:26.236 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:52:26.236 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.9821000000000003e-05 2024-04-25T22:52:26.236 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.236 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.237 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:26.237 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015221+0000", 2024-04-25T22:52:26.237 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2868999999999996e-05 2024-04-25T22:52:26.237 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.237 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.237 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:26.237 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021698+0000", 2024-04-25T22:52:26.237 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064762300000000004 2024-04-25T22:52:26.237 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:26.237 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:26.237 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:26.237 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.237 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.237 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:52:26.238 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.016597+0000", 2024-04-25T22:52:26.238 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 33.168290353000003, 2024-04-25T22:52:26.238 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001422113, 2024-04-25T22:52:26.238 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:26.238 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:26.238 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:26.238 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:26.238 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.238 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:26.238 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016597+0000", 2024-04-25T22:52:26.238 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:26.238 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.238 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.238 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:26.239 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016597+0000", 2024-04-25T22:52:26.239 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:26.239 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.239 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.239 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:26.239 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016598+0000", 2024-04-25T22:52:26.239 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2900000000000004e-07 2024-04-25T22:52:26.239 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.239 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.239 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:26.239 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016616+0000", 2024-04-25T22:52:26.239 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8876e-05 2024-04-25T22:52:26.239 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.239 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.240 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:26.240 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016626+0000", 2024-04-25T22:52:26.240 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.8900000000000002e-06 2024-04-25T22:52:26.240 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.240 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.240 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:26.240 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016634+0000", 2024-04-25T22:52:26.240 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7060000000000004e-06 2024-04-25T22:52:26.240 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.240 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.240 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:26.240 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016706+0000", 2024-04-25T22:52:26.240 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2102999999999997e-05 2024-04-25T22:52:26.240 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.240 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.241 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:26.241 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016727+0000", 2024-04-25T22:52:26.241 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0687e-05 2024-04-25T22:52:26.241 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.241 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.241 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:26.241 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017972+0000", 2024-04-25T22:52:26.241 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0012454829999999999 2024-04-25T22:52:26.241 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.241 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.241 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:26.241 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.018019+0000", 2024-04-25T22:52:26.241 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6839000000000003e-05 2024-04-25T22:52:26.241 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:26.242 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:26.242 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:26.242 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.242 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.242 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-25T22:52:26.242 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.016652+0000", 2024-04-25T22:52:26.242 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 33.168235738999996, 2024-04-25T22:52:26.242 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004473599, 2024-04-25T22:52:26.242 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:26.242 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:26.242 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:26.242 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:26.242 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.243 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:26.243 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016652+0000", 2024-04-25T22:52:26.243 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:26.243 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.243 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.243 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:26.243 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016652+0000", 2024-04-25T22:52:26.243 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:26.243 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.243 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.243 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:26.243 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016652+0000", 2024-04-25T22:52:26.243 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1899999999999998e-07 2024-04-25T22:52:26.243 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.244 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.244 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:26.244 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016657+0000", 2024-04-25T22:52:26.244 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4680000000000003e-06 2024-04-25T22:52:26.244 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.244 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.244 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:26.244 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016664+0000", 2024-04-25T22:52:26.244 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8210000000000002e-06 2024-04-25T22:52:26.244 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.244 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.244 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:26.244 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016669+0000", 2024-04-25T22:52:26.244 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8520000000000003e-06 2024-04-25T22:52:26.245 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.245 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.245 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:26.245 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016779+0000", 2024-04-25T22:52:26.245 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000109444 2024-04-25T22:52:26.245 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.245 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.245 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:26.245 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016798+0000", 2024-04-25T22:52:26.245 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9799000000000001e-05 2024-04-25T22:52:26.245 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.245 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.245 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:26.246 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021086+0000", 2024-04-25T22:52:26.246 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042879889999999999 2024-04-25T22:52:26.246 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.246 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.246 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:26.246 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021125+0000", 2024-04-25T22:52:26.246 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8807000000000003e-05 2024-04-25T22:52:26.246 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:26.246 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:26.246 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:26.246 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.246 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.246 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-25T22:52:26.246 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.016733+0000", 2024-04-25T22:52:26.247 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 33.16815484, 2024-04-25T22:52:26.247 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004231612, 2024-04-25T22:52:26.247 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:26.247 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:26.247 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:26.247 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:26.247 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.247 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:26.247 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016733+0000", 2024-04-25T22:52:26.247 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:26.247 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.247 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.247 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:26.247 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016733+0000", 2024-04-25T22:52:26.248 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:26.248 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.248 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.248 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:26.248 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016733+0000", 2024-04-25T22:52:26.248 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2100000000000002e-07 2024-04-25T22:52:26.248 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.248 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.248 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:26.248 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016756+0000", 2024-04-25T22:52:26.248 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2886000000000001e-05 2024-04-25T22:52:26.248 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.248 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.248 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:26.249 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016765+0000", 2024-04-25T22:52:26.249 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.3610000000000007e-06 2024-04-25T22:52:26.249 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.249 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.249 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:26.249 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016771+0000", 2024-04-25T22:52:26.249 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0020000000000003e-06 2024-04-25T22:52:26.249 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.249 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.249 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:26.249 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017050+0000", 2024-04-25T22:52:26.249 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00027877199999999999 2024-04-25T22:52:26.249 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.249 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.250 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:26.250 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017067+0000", 2024-04-25T22:52:26.250 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7499e-05 2024-04-25T22:52:26.250 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.250 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.250 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:26.250 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.020921+0000", 2024-04-25T22:52:26.250 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003853123 2024-04-25T22:52:26.250 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.250 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.250 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:26.250 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.020964+0000", 2024-04-25T22:52:26.250 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3547999999999997e-05 2024-04-25T22:52:26.250 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:26.251 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:26.251 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:26.251 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.251 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.251 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 1 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:52:26.251 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.019562+0000", 2024-04-25T22:52:26.251 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 33.165325795999998, 2024-04-25T22:52:26.251 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0045866930000000002, 2024-04-25T22:52:26.251 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:26.251 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:26.251 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "reached pg", 2024-04-25T22:52:26.251 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:26.251 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.251 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:26.252 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.019562+0000", 2024-04-25T22:52:26.252 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:26.252 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.252 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.252 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:26.252 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.019562+0000", 2024-04-25T22:52:26.252 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:26.252 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.252 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.252 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:26.252 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.019562+0000", 2024-04-25T22:52:26.252 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0100000000000005e-07 2024-04-25T22:52:26.252 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.252 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.253 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:26.253 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.019570+0000", 2024-04-25T22:52:26.253 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5599999999999996e-06 2024-04-25T22:52:26.253 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.253 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.253 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:26.253 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.019586+0000", 2024-04-25T22:52:26.253 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6086000000000002e-05 2024-04-25T22:52:26.253 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.253 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.253 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:26.253 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.019600+0000", 2024-04-25T22:52:26.253 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3934000000000001e-05 2024-04-25T22:52:26.253 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.253 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.254 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:26.254 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.019889+0000", 2024-04-25T22:52:26.254 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00028888200000000002 2024-04-25T22:52:26.254 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.254 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.254 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:26.254 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.024148+0000", 2024-04-25T22:52:26.254 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042597299999999998 2024-04-25T22:52:26.254 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:26.254 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:26.254 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:26.254 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.254 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.254 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-25T22:52:26.255 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.021542+0000", 2024-04-25T22:52:26.255 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 33.163345542000002, 2024-04-25T22:52:26.255 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001339589, 2024-04-25T22:52:26.255 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:26.255 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:26.255 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-25T22:52:26.255 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:26.255 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.255 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:26.255 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021542+0000", 2024-04-25T22:52:26.255 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:26.255 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.255 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.255 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:26.256 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021542+0000", 2024-04-25T22:52:26.256 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:26.256 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.256 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.256 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:26.256 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021542+0000", 2024-04-25T22:52:26.256 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1600000000000002e-07 2024-04-25T22:52:26.256 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.256 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.256 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:26.256 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021545+0000", 2024-04-25T22:52:26.256 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.774e-06 2024-04-25T22:52:26.256 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.256 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.256 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:26.257 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021553+0000", 2024-04-25T22:52:26.257 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.2099999999999993e-06 2024-04-25T22:52:26.257 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.257 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.257 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:26.257 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021559+0000", 2024-04-25T22:52:26.257 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.1249999999999998e-06 2024-04-25T22:52:26.257 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.257 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.257 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:26.257 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022752+0000", 2024-04-25T22:52:26.257 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0011931120000000001 2024-04-25T22:52:26.257 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.258 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.258 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:26.258 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022759+0000", 2024-04-25T22:52:26.258 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4420000000000003e-06 2024-04-25T22:52:26.258 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.258 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.258 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:26.258 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022881+0000", 2024-04-25T22:52:26.258 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012250999999999999 2024-04-25T22:52:26.258 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:26.258 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:26.258 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:26.258 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.259 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.259 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e14/12 ondisk, result = 0)", 2024-04-25T22:52:26.259 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.021769+0000", 2024-04-25T22:52:26.259 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 33.163118277999999, 2024-04-25T22:52:26.259 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001336928, 2024-04-25T22:52:26.259 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:26.259 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:26.259 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-25T22:52:26.259 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:26.259 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.259 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:26.259 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021769+0000", 2024-04-25T22:52:26.259 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:26.259 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.260 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.260 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:26.260 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021769+0000", 2024-04-25T22:52:26.260 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:26.260 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.260 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.260 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:26.260 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021770+0000", 2024-04-25T22:52:26.260 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7700000000000005e-07 2024-04-25T22:52:26.260 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.260 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.260 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:26.260 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021773+0000", 2024-04-25T22:52:26.260 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5250000000000001e-06 2024-04-25T22:52:26.261 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.261 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.261 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:26.261 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021780+0000", 2024-04-25T22:52:26.261 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.187e-06 2024-04-25T22:52:26.261 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.261 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.261 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:26.261 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021796+0000", 2024-04-25T22:52:26.261 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5218000000000001e-05 2024-04-25T22:52:26.261 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.261 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.261 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:26.261 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023001+0000", 2024-04-25T22:52:26.262 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001205993 2024-04-25T22:52:26.262 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.262 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.262 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:26.262 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023009+0000", 2024-04-25T22:52:26.262 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9249999999999995e-06 2024-04-25T22:52:26.262 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.262 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.262 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:26.262 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023106+0000", 2024-04-25T22:52:26.262 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6602999999999996e-05 2024-04-25T22:52:26.262 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:26.262 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:26.263 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:26.263 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.263 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.263 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-25T22:52:26.263 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.021807+0000", 2024-04-25T22:52:26.263 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 33.163079887000002, 2024-04-25T22:52:26.263 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0013936809999999999, 2024-04-25T22:52:26.263 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:26.263 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:26.263 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-25T22:52:26.263 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:26.263 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.263 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:26.263 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021807+0000", 2024-04-25T22:52:26.264 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:26.264 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.264 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.264 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:26.264 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021807+0000", 2024-04-25T22:52:26.264 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:26.264 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.264 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.264 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:26.264 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021808+0000", 2024-04-25T22:52:26.264 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3200000000000001e-07 2024-04-25T22:52:26.264 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.264 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.264 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:26.265 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021811+0000", 2024-04-25T22:52:26.265 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5480000000000002e-06 2024-04-25T22:52:26.265 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.265 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.265 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:26.265 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021818+0000", 2024-04-25T22:52:26.265 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4450000000000001e-06 2024-04-25T22:52:26.265 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.265 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.265 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:26.265 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021823+0000", 2024-04-25T22:52:26.265 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.22e-06 2024-04-25T22:52:26.265 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.265 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.266 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:26.266 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023122+0000", 2024-04-25T22:52:26.266 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001298808 2024-04-25T22:52:26.266 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.266 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.266 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:26.266 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023126+0000", 2024-04-25T22:52:26.266 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9400000000000004e-06 2024-04-25T22:52:26.266 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.266 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.266 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:26.266 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023201+0000", 2024-04-25T22:52:26.266 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5388000000000004e-05 2024-04-25T22:52:26.267 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:26.267 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:26.267 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:26.267 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.267 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.267 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-25T22:52:26.267 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:55.010264+0000", 2024-04-25T22:52:26.267 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 31.174623705999998, 2024-04-25T22:52:26.267 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001484476, 2024-04-25T22:52:26.267 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:26.267 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:26.267 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:26.267 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:26.268 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.268 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:26.268 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010264+0000", 2024-04-25T22:52:26.268 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:26.268 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.268 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.268 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:26.268 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010264+0000", 2024-04-25T22:52:26.268 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:26.268 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.268 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.268 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:26.268 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010265+0000", 2024-04-25T22:52:26.269 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5e-06 2024-04-25T22:52:26.269 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.269 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.269 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:26.269 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010272+0000", 2024-04-25T22:52:26.269 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0910000000000004e-06 2024-04-25T22:52:26.269 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.269 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.269 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:26.269 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010287+0000", 2024-04-25T22:52:26.269 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4644000000000001e-05 2024-04-25T22:52:26.269 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.269 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.269 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:26.270 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010296+0000", 2024-04-25T22:52:26.270 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2159999999999995e-06 2024-04-25T22:52:26.270 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.270 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.270 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:26.270 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010394+0000", 2024-04-25T22:52:26.270 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.8148999999999998e-05 2024-04-25T22:52:26.270 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.270 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.270 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:26.270 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010503+0000", 2024-04-25T22:52:26.270 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000108857 2024-04-25T22:52:26.270 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.270 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.271 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:26.271 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010592+0000", 2024-04-25T22:52:26.271 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.9083000000000001e-05 2024-04-25T22:52:26.271 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.271 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.271 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:26.271 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.011161+0000", 2024-04-25T22:52:26.271 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00056919800000000003 2024-04-25T22:52:26.271 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.271 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.271 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:26.271 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.011676+0000", 2024-04-25T22:52:26.271 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00051500999999999999 2024-04-25T22:52:26.272 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.272 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.272 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:26.272 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.011717+0000", 2024-04-25T22:52:26.272 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0262999999999997e-05 2024-04-25T22:52:26.272 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.272 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.272 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:26.272 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.011748+0000", 2024-04-25T22:52:26.272 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1464999999999998e-05 2024-04-25T22:52:26.272 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:26.272 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:26.272 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:26.273 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.273 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.273 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-25T22:52:26.273 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:52:17.012790+0000", 2024-04-25T22:52:26.273 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 9.1720978619999993, 2024-04-25T22:52:26.273 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001434444, 2024-04-25T22:52:26.273 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:26.273 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:26.273 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:26.273 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:26.273 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.273 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:26.273 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.012790+0000", 2024-04-25T22:52:26.273 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:26.274 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.274 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.274 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:26.274 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.012790+0000", 2024-04-25T22:52:26.274 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:26.274 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.274 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.274 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:26.274 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.012791+0000", 2024-04-25T22:52:26.274 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0699999999999999e-06 2024-04-25T22:52:26.274 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.274 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.274 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:26.275 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.012797+0000", 2024-04-25T22:52:26.275 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0519999999999998e-06 2024-04-25T22:52:26.275 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.275 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.275 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:26.275 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.012811+0000", 2024-04-25T22:52:26.275 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4287999999999999e-05 2024-04-25T22:52:26.275 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.275 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.275 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:26.275 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.012838+0000", 2024-04-25T22:52:26.275 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6727999999999999e-05 2024-04-25T22:52:26.276 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.276 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.276 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:26.276 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.012909+0000", 2024-04-25T22:52:26.276 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.1211000000000006e-05 2024-04-25T22:52:26.276 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.276 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.276 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:26.276 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.013015+0000", 2024-04-25T22:52:26.276 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010619 2024-04-25T22:52:26.276 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.276 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.276 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:26.276 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.013189+0000", 2024-04-25T22:52:26.276 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00017439199999999999 2024-04-25T22:52:26.277 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.277 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.277 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:26.277 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.013903+0000", 2024-04-25T22:52:26.277 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00071379099999999997 2024-04-25T22:52:26.277 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.277 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.277 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:26.277 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.014159+0000", 2024-04-25T22:52:26.277 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00025561699999999998 2024-04-25T22:52:26.277 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.277 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.277 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:26.277 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.014192+0000", 2024-04-25T22:52:26.278 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2941000000000002e-05 2024-04-25T22:52:26.278 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.278 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.278 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:26.278 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.014224+0000", 2024-04-25T22:52:26.278 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2163999999999999e-05 2024-04-25T22:52:26.278 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:26.278 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:26.278 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:26.278 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.278 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.278 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:52:26.278 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:52:23.013398+0000", 2024-04-25T22:52:26.278 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 3.1714893979999998, 2024-04-25T22:52:26.279 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0015020369999999999, 2024-04-25T22:52:26.279 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:26.279 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:26.279 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:26.279 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:26.279 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.279 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:26.279 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:23.013398+0000", 2024-04-25T22:52:26.279 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:26.279 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.279 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.279 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:26.279 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:23.013398+0000", 2024-04-25T22:52:26.279 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:26.280 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.280 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.280 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:26.280 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:23.013399+0000", 2024-04-25T22:52:26.280 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.362e-06 2024-04-25T22:52:26.280 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.280 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.280 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:26.280 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:23.013406+0000", 2024-04-25T22:52:26.280 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.1409999999999999e-06 2024-04-25T22:52:26.280 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.280 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.280 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:26.280 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:23.013420+0000", 2024-04-25T22:52:26.280 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3232e-05 2024-04-25T22:52:26.281 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.281 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.281 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:26.281 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:23.013429+0000", 2024-04-25T22:52:26.281 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0310000000000004e-06 2024-04-25T22:52:26.281 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.281 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.281 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:26.281 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:23.013514+0000", 2024-04-25T22:52:26.281 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5620999999999999e-05 2024-04-25T22:52:26.281 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.281 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.281 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:26.281 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:23.013581+0000", 2024-04-25T22:52:26.281 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.6804999999999995e-05 2024-04-25T22:52:26.282 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.282 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.282 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:26.282 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:23.013683+0000", 2024-04-25T22:52:26.282 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010186 2024-04-25T22:52:26.282 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.282 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.282 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:26.282 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:23.014298+0000", 2024-04-25T22:52:26.282 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061501399999999999 2024-04-25T22:52:26.282 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.282 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.282 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:26.282 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:23.014839+0000", 2024-04-25T22:52:26.283 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000540523 2024-04-25T22:52:26.283 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.283 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.283 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:26.283 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:23.014871+0000", 2024-04-25T22:52:26.283 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2004000000000001e-05 2024-04-25T22:52:26.283 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:26.283 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:26.283 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:26.283 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:23.014900+0000", 2024-04-25T22:52:26.283 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9444000000000001e-05 2024-04-25T22:52:26.283 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:26.283 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:26.283 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:26.283 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:26.284 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:26.284 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-25T22:52:26.285 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:52:26.286 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:26.285+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:26.386 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:26.385+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:26.399 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:26.399 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:52:26.399 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-25T22:52:26.400 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:26.408 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:52:26.487 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:26.487+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:26.552 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:26.552 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:52:26.552 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-25T22:52:26.552 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-25T22:52:26.552 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:26.561 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:52:26.587 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:26.587+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:26.665 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:26.666 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:52:26.666 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:52:26.666 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:52:26.666 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.666 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:52:26.666 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:52:26.666 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 38.696935388999997, 2024-04-25T22:52:26.666 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:52:26.666 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:26.666 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:26.666 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:26.667 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:26.667 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.667 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:26.667 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:52:26.667 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:26.667 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.667 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.667 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:26.667 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:52:26.667 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:26.667 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.667 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.667 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:26.668 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:52:26.668 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:52:26.668 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.668 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.668 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:26.668 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:52:26.668 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:52:26.668 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.668 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.668 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:26.668 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:52:26.668 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:52:26.668 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.669 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.669 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:26.669 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:52:26.669 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:52:26.669 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.669 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.669 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:26.669 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:52:26.669 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:52:26.669 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.669 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.669 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:26.669 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:52:26.669 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:52:26.670 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.670 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.670 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:26.670 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:52:26.670 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:52:26.670 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.670 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.670 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:26.670 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:52:26.670 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:52:26.670 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:26.670 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:26.671 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:26.671 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.671 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.671 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:110 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'72, mlcod=10'68)", 2024-04-25T22:52:26.671 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:26.671 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 38.696301388999998, 2024-04-25T22:52:26.671 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065316630000000001, 2024-04-25T22:52:26.671 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:26.671 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:26.671 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:26.671 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:26.671 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.671 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:26.671 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:26.671 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:26.672 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.672 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.672 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:26.672 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:26.672 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:26.672 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.672 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.672 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:26.672 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:26.672 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.58e-07 2024-04-25T22:52:26.672 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.672 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.672 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:26.672 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967811+0000", 2024-04-25T22:52:26.672 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.118e-06 2024-04-25T22:52:26.673 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.673 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.673 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:26.673 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967817+0000", 2024-04-25T22:52:26.673 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3709999999999996e-06 2024-04-25T22:52:26.673 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.673 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.673 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:26.673 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967820+0000", 2024-04-25T22:52:26.673 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2210000000000002e-06 2024-04-25T22:52:26.673 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.673 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.673 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:26.673 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967876+0000", 2024-04-25T22:52:26.673 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5507000000000002e-05 2024-04-25T22:52:26.673 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.674 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.674 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:26.674 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967893+0000", 2024-04-25T22:52:26.674 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7812000000000002e-05 2024-04-25T22:52:26.674 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.674 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.674 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:26.674 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974317+0000", 2024-04-25T22:52:26.674 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064237160000000003 2024-04-25T22:52:26.674 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.674 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.674 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:26.674 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:52:26.675 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.156e-05 2024-04-25T22:52:26.675 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:26.675 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:26.675 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:26.675 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.675 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.675 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'68)", 2024-04-25T22:52:26.675 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:26.675 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 38.695883876000003, 2024-04-25T22:52:26.675 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061292279999999996, 2024-04-25T22:52:26.675 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:26.675 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:26.675 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:26.675 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:26.676 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.676 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:26.676 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:26.676 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:26.676 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.676 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.676 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:26.676 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:26.676 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:26.676 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.676 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.676 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:26.676 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:26.677 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6300000000000001e-07 2024-04-25T22:52:26.677 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.677 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.677 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:26.677 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968228+0000", 2024-04-25T22:52:26.677 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6139999999999999e-06 2024-04-25T22:52:26.677 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.677 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.677 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:26.677 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968235+0000", 2024-04-25T22:52:26.677 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7020000000000001e-06 2024-04-25T22:52:26.677 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.677 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.678 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:26.678 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968238+0000", 2024-04-25T22:52:26.678 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0010000000000002e-06 2024-04-25T22:52:26.678 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.678 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.678 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:26.678 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968297+0000", 2024-04-25T22:52:26.678 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8424999999999997e-05 2024-04-25T22:52:26.678 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.678 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.678 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:26.678 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968316+0000", 2024-04-25T22:52:26.678 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8814999999999999e-05 2024-04-25T22:52:26.679 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.679 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.679 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:26.679 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:52:26.679 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060239439999999998 2024-04-25T22:52:26.679 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.679 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.679 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:26.679 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974354+0000", 2024-04-25T22:52:26.679 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4364e-05 2024-04-25T22:52:26.679 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:26.679 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:26.680 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:26.680 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.680 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.680 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'68)", 2024-04-25T22:52:26.680 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:26.680 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 38.695446873999998, 2024-04-25T22:52:26.680 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005948414, 2024-04-25T22:52:26.680 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:26.680 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:26.680 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:26.680 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:26.681 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.681 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:26.681 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:26.681 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:26.681 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.681 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.681 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:26.681 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:26.681 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:26.681 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.681 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.681 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:26.681 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:26.682 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6199999999999998e-07 2024-04-25T22:52:26.682 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.682 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.682 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:26.682 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968723+0000", 2024-04-25T22:52:26.682 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1148999999999993e-05 2024-04-25T22:52:26.682 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.682 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.682 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:26.682 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968730+0000", 2024-04-25T22:52:26.682 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1749999999999999e-06 2024-04-25T22:52:26.682 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.682 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.683 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:26.683 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968734+0000", 2024-04-25T22:52:26.683 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5200000000000002e-06 2024-04-25T22:52:26.683 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.683 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.683 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:26.683 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968771+0000", 2024-04-25T22:52:26.683 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6851999999999999e-05 2024-04-25T22:52:26.683 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.683 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.683 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:26.683 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968788+0000", 2024-04-25T22:52:26.683 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7027000000000001e-05 2024-04-25T22:52:26.683 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.684 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.684 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:26.684 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974589+0000", 2024-04-25T22:52:26.684 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058013320000000002 2024-04-25T22:52:26.684 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.684 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.684 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:26.684 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974610+0000", 2024-04-25T22:52:26.684 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0897e-05 2024-04-25T22:52:26.684 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:26.684 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:26.684 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:26.684 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.684 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.685 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'68)", 2024-04-25T22:52:26.685 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:26.685 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 38.694876864000001, 2024-04-25T22:52:26.685 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053935750000000003, 2024-04-25T22:52:26.685 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:26.685 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:26.685 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:26.685 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:26.685 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.685 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:26.685 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:26.685 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:26.685 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.685 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.685 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:26.686 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:26.686 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:26.686 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.686 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.686 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:26.686 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:26.686 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.03e-07 2024-04-25T22:52:26.686 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.686 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.686 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:26.686 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969235+0000", 2024-04-25T22:52:26.686 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2399999999999999e-06 2024-04-25T22:52:26.686 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.687 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.687 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:26.687 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969242+0000", 2024-04-25T22:52:26.687 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1269999999999997e-06 2024-04-25T22:52:26.687 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.687 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.687 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:26.687 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969246+0000", 2024-04-25T22:52:26.687 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3840000000000001e-06 2024-04-25T22:52:26.687 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.687 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.687 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:26.687 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969278+0000", 2024-04-25T22:52:26.687 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1868e-05 2024-04-25T22:52:26.688 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.688 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.688 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:26.688 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969295+0000", 2024-04-25T22:52:26.688 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7530999999999999e-05 2024-04-25T22:52:26.688 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.688 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.688 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:26.688 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974611+0000", 2024-04-25T22:52:26.688 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053160789999999996 2024-04-25T22:52:26.688 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.688 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.688 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:26.689 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974625+0000", 2024-04-25T22:52:26.689 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3943e-05 2024-04-25T22:52:26.689 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:26.689 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:26.689 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:26.689 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.689 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.689 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-25T22:52:26.689 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:26.689 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 38.501280956000002, 2024-04-25T22:52:26.689 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054952610000000004, 2024-04-25T22:52:26.689 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:26.689 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:26.689 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:26.689 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:26.690 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.690 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:26.690 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:26.690 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:26.690 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.690 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.690 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:26.690 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:26.690 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:26.690 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.690 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.690 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:26.690 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:26.690 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.68e-07 2024-04-25T22:52:26.691 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.691 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.691 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:26.691 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162898+0000", 2024-04-25T22:52:26.691 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9470999999999999e-05 2024-04-25T22:52:26.691 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.691 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.691 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:26.691 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162906+0000", 2024-04-25T22:52:26.691 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1580000000000005e-06 2024-04-25T22:52:26.691 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.691 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.691 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:26.692 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162911+0000", 2024-04-25T22:52:26.692 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4779999999999999e-06 2024-04-25T22:52:26.692 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.692 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.692 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:26.692 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162952+0000", 2024-04-25T22:52:26.692 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0629e-05 2024-04-25T22:52:26.692 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.692 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.692 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:26.692 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162968+0000", 2024-04-25T22:52:26.692 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6239000000000002e-05 2024-04-25T22:52:26.693 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.693 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.693 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:26.693 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168281+0000", 2024-04-25T22:52:26.693 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053132869999999999 2024-04-25T22:52:26.693 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.693 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.693 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:26.693 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168323+0000", 2024-04-25T22:52:26.693 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1430999999999997e-05 2024-04-25T22:52:26.693 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:26.693 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:26.693 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:26.694 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.694 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.694 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-04-25T22:52:26.694 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:26.694 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 38.070803593999997, 2024-04-25T22:52:26.694 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050872510000000001, 2024-04-25T22:52:26.694 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:26.694 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:26.694 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:26.694 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:26.694 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.694 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:26.694 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:26.695 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:26.695 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.695 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.695 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:26.695 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:26.695 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:26.695 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.695 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.695 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:26.695 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:26.695 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.72e-07 2024-04-25T22:52:26.695 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.695 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.695 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:26.695 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593381+0000", 2024-04-25T22:52:26.696 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5797000000000006e-05 2024-04-25T22:52:26.696 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.696 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.696 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:26.696 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593389+0000", 2024-04-25T22:52:26.696 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8480000000000001e-06 2024-04-25T22:52:26.696 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.696 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.696 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:26.696 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593393+0000", 2024-04-25T22:52:26.696 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4819999999999996e-06 2024-04-25T22:52:26.696 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.696 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.696 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:26.697 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593435+0000", 2024-04-25T22:52:26.697 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1600000000000002e-05 2024-04-25T22:52:26.697 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.697 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.697 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:26.697 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593454+0000", 2024-04-25T22:52:26.697 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8868e-05 2024-04-25T22:52:26.697 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.697 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.697 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:26.697 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598350+0000", 2024-04-25T22:52:26.697 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004895763 2024-04-25T22:52:26.697 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.697 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.698 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:26.698 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598392+0000", 2024-04-25T22:52:26.698 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2521000000000002e-05 2024-04-25T22:52:26.698 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:26.698 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:26.698 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:26.698 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.698 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.698 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:26.698 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:52:26.698 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 33.652439690000001, 2024-04-25T22:52:26.698 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:52:26.698 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:26.699 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:26.699 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:26.699 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:26.699 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.699 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:26.699 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:52:26.699 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:26.699 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.699 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.699 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:26.699 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:52:26.699 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:26.699 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.699 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.700 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:26.700 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:52:26.700 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:52:26.700 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.700 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.700 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:26.700 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:52:26.700 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:52:26.700 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.700 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.700 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:26.700 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:52:26.700 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:52:26.700 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.701 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.701 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:26.701 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:52:26.701 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:52:26.701 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.701 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.701 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:26.701 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:52:26.701 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:52:26.701 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.701 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.701 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:26.701 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:52:26.702 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:52:26.702 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.702 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.702 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:26.702 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:52:26.702 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:52:26.702 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.702 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.702 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:26.702 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:52:26.702 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:52:26.702 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.703 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.703 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:26.703 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:52:26.703 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:52:26.703 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.703 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.703 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:26.703 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:52:26.703 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:52:26.703 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.703 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.703 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:26.703 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:52:26.703 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:52:26.704 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:26.704 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:26.704 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:26.704 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.704 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.704 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:26.704 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:52:26.704 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 33.651765314000002, 2024-04-25T22:52:26.704 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:52:26.704 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:26.704 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:26.704 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:26.704 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:26.704 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.705 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:26.705 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:52:26.705 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:26.705 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.705 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.705 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:26.705 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:52:26.705 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:26.705 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.705 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.705 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:26.705 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:52:26.706 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:52:26.706 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.706 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.706 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:26.706 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:52:26.706 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:52:26.706 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.706 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.706 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:26.706 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:52:26.706 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:52:26.706 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.706 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.707 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:26.707 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:52:26.707 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:52:26.707 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.707 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.707 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:26.707 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:52:26.707 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:52:26.707 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.707 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.707 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:26.707 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:52:26.707 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:52:26.707 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.708 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.708 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:26.708 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:52:26.708 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:52:26.708 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.708 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.708 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:26.708 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:52:26.708 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:52:26.708 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.708 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.708 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:26.708 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:52:26.708 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:52:26.709 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.709 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.709 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:26.709 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:52:26.709 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:52:26.709 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.709 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.709 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:26.710 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:52:26.710 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:52:26.710 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:26.710 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:26.710 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:26.710 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.710 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.710 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:26.710 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:52:26.710 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 33.651256101999998, 2024-04-25T22:52:26.710 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:52:26.710 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:26.711 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:26.711 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:26.711 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:26.711 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.711 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:26.711 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:52:26.711 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:26.711 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.711 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.711 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:26.711 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:52:26.711 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:26.711 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.711 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.711 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:26.712 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:52:26.712 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:52:26.712 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.712 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.712 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:26.712 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:52:26.712 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:52:26.712 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.712 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.712 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:26.712 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:52:26.712 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:52:26.712 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.713 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.713 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:26.713 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:52:26.713 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:52:26.713 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.713 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.713 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:26.713 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:52:26.713 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:52:26.713 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.713 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.713 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:26.713 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:52:26.713 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:52:26.713 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.714 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.714 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:26.714 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:52:26.714 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:52:26.714 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.714 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.714 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:26.714 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:52:26.714 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:52:26.714 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.714 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.714 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:26.714 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:52:26.714 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:52:26.715 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.715 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.715 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:26.715 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:52:26.715 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:52:26.715 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.715 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.715 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:26.715 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:52:26.715 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:52:26.715 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:26.715 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:26.716 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:26.716 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.716 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.716 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:26.716 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:26.716 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 33.650842904000001, 2024-04-25T22:52:26.716 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:52:26.716 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:26.716 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:26.716 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:26.717 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:26.717 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.717 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:26.717 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:26.717 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:26.717 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.717 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.717 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:26.717 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:26.717 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:26.717 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.717 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.717 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:26.717 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:26.718 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:52:26.718 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.718 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.718 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:26.718 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:52:26.718 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:52:26.718 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.718 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.718 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:26.718 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:52:26.718 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:52:26.718 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.718 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.719 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:26.719 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:52:26.719 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:52:26.719 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.719 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.719 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:26.721 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:52:26.722 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:52:26.722 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.722 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.722 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:26.722 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:52:26.722 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:52:26.722 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.722 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.722 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:26.722 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:52:26.722 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:52:26.722 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.723 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.723 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:26.723 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:52:26.723 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:52:26.723 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.723 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.723 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:26.723 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:52:26.723 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:52:26.723 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.723 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.723 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:26.723 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:52:26.724 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:52:26.724 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.724 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.724 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:26.724 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:52:26.724 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:52:26.724 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:26.724 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:26.724 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:26.724 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.724 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.724 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:26.724 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:52:26.725 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 33.650792234000001, 2024-04-25T22:52:26.725 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:52:26.725 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:26.725 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:26.725 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:26.725 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:26.725 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.725 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:26.725 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:52:26.725 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:26.725 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.725 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.726 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:26.726 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:52:26.726 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:26.726 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.726 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.726 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:26.726 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:52:26.726 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:52:26.726 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.726 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.726 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:26.726 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:52:26.727 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:52:26.727 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.727 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.727 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:26.727 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:52:26.727 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:52:26.727 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.727 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.727 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:26.727 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:52:26.727 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:52:26.728 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.728 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.728 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:26.728 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:52:26.728 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:52:26.728 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.728 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.728 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:52:26.728 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:52:26.728 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:52:26.728 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.728 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.729 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:26.729 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:52:26.729 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:52:26.729 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.729 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.729 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:26.729 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:52:26.729 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:52:26.729 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.729 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.729 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:26.729 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:52:26.730 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:52:26.730 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.730 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.730 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:26.730 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:52:26.730 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:52:26.730 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.730 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.730 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:26.730 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:52:26.730 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:52:26.730 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.731 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.731 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:26.731 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:52:26.731 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:52:26.731 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.731 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.731 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:26.731 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:52:26.731 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:52:26.731 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:26.731 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:26.731 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:26.731 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.731 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.732 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:26.732 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:52:26.732 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 33.650755365000002, 2024-04-25T22:52:26.732 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:52:26.732 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:26.732 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:26.732 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:26.732 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:26.733 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.733 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:26.733 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:52:26.733 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:26.733 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.733 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.733 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:26.733 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:52:26.733 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:26.733 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.733 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.733 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:26.733 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:52:26.734 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:52:26.734 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.734 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.734 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:26.734 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:52:26.734 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:52:26.734 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.734 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.734 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:26.734 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:52:26.734 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:52:26.734 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.735 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.735 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:26.735 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:52:26.735 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:52:26.735 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.735 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.735 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:26.735 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:52:26.735 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:52:26.735 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.735 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.735 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:52:26.735 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:52:26.736 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:52:26.736 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.736 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.736 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:26.736 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:52:26.736 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:52:26.736 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.736 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.736 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:26.736 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:52:26.736 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:52:26.736 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.736 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.737 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:26.737 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:52:26.737 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:52:26.737 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.737 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.737 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:26.737 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:52:26.737 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:52:26.737 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.737 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.737 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:26.737 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:52:26.737 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:52:26.738 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.738 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.738 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:26.738 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:52:26.738 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:52:26.738 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.738 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.738 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:26.738 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:52:26.738 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:52:26.738 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:26.738 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:26.738 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:26.738 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.739 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.739 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:26.739 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:52:26.739 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 33.650730398999997, 2024-04-25T22:52:26.739 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:52:26.739 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:26.739 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:26.739 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:26.739 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:26.739 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.739 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:26.739 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:52:26.739 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:26.739 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.740 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.740 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:26.740 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:52:26.740 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:26.740 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.740 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.740 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:26.740 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:52:26.740 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:52:26.740 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.740 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.740 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:26.740 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:52:26.741 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:52:26.741 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.741 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.741 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:26.741 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:52:26.741 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:52:26.741 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.741 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.741 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:26.741 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:52:26.741 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:52:26.741 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.741 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.741 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:26.742 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:52:26.742 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:52:26.742 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.742 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.742 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:26.742 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:52:26.742 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:52:26.742 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.742 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.742 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:26.742 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:52:26.743 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:52:26.743 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.743 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.743 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:26.743 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:52:26.743 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:52:26.743 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.743 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.743 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:26.743 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:52:26.743 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:52:26.743 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.743 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.743 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:26.744 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:52:26.744 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:52:26.744 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.744 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.744 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:26.744 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:52:26.744 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:52:26.744 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:26.744 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:26.744 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:26.744 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.744 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.744 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:26.745 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:52:26.745 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 33.650694035000001, 2024-04-25T22:52:26.745 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:52:26.745 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:26.745 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:26.745 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:52:26.745 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:26.745 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.745 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:26.745 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:52:26.745 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:26.745 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.745 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.746 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:26.746 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:52:26.746 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:26.746 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.746 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.746 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:26.746 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:52:26.746 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:52:26.746 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.746 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.746 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:26.746 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:52:26.746 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:52:26.747 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.747 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.747 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:26.747 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:52:26.747 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:52:26.747 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.747 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.747 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:26.747 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:52:26.747 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:52:26.747 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.747 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.747 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:26.747 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:52:26.747 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:52:26.748 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.748 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.748 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:52:26.748 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:52:26.748 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:52:26.748 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.748 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.748 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:26.748 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:52:26.748 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:52:26.748 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.748 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.748 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:26.748 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:52:26.748 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:52:26.749 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.749 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.749 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:26.749 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:52:26.749 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:52:26.749 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:26.749 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:26.749 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:26.749 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.749 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.749 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:26.749 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:26.749 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 33.650662953999998, 2024-04-25T22:52:26.749 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:52:26.749 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:26.749 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:26.750 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:52:26.750 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:26.750 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.750 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:26.750 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:26.750 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:26.750 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.750 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.750 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:26.750 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:26.750 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:26.750 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.750 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.751 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:26.751 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:26.751 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:52:26.751 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.751 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.751 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:26.751 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:52:26.751 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:52:26.751 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.751 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.751 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:26.751 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:52:26.751 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:52:26.751 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.751 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.751 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:26.752 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:52:26.752 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:52:26.752 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.752 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.752 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:26.752 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:52:26.752 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:52:26.752 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.752 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.752 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:26.752 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:52:26.752 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:52:26.753 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.753 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.753 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:26.753 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:52:26.753 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:52:26.753 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:26.753 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:26.753 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:26.753 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.753 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.753 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:52:26.753 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:26.753 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 33.650221985000002, 2024-04-25T22:52:26.753 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064881979999999997, 2024-04-25T22:52:26.754 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:26.754 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:26.754 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:26.754 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:26.754 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.754 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:26.754 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:26.754 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:26.754 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.754 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.754 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:26.754 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:26.754 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:26.755 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.755 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.755 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:26.755 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:26.755 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2699999999999999e-07 2024-04-25T22:52:26.755 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.755 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.755 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:26.755 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013898+0000", 2024-04-25T22:52:26.755 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0796e-05 2024-04-25T22:52:26.755 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.755 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.755 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:26.755 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013907+0000", 2024-04-25T22:52:26.755 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5140000000000007e-06 2024-04-25T22:52:26.756 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.756 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.756 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:26.756 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013952+0000", 2024-04-25T22:52:26.756 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4134000000000001e-05 2024-04-25T22:52:26.756 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.756 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.756 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:26.756 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016812+0000", 2024-04-25T22:52:26.756 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028601059999999998 2024-04-25T22:52:26.756 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.756 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.756 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:26.757 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.017052+0000", 2024-04-25T22:52:26.757 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024056500000000001 2024-04-25T22:52:26.757 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.757 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.757 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:26.757 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020350+0000", 2024-04-25T22:52:26.757 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032978320000000001 2024-04-25T22:52:26.757 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.757 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.757 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:26.757 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020375+0000", 2024-04-25T22:52:26.757 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4624e-05 2024-04-25T22:52:26.757 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:26.757 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:26.758 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:26.758 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.758 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.758 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-25T22:52:26.758 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:26.758 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 33.636691538999997, 2024-04-25T22:52:26.758 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058583000000000003, 2024-04-25T22:52:26.758 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:26.758 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:26.758 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:26.758 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:26.758 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.758 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:26.759 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:26.759 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:26.759 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.759 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.759 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:26.759 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:26.759 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:26.759 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.759 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.759 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:26.759 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:26.759 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.41e-07 2024-04-25T22:52:26.759 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.759 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.760 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:26.760 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027428+0000", 2024-04-25T22:52:26.760 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.075e-05 2024-04-25T22:52:26.760 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.760 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.760 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:26.760 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027435+0000", 2024-04-25T22:52:26.760 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3610000000000003e-06 2024-04-25T22:52:26.760 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.760 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.760 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:26.760 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027442+0000", 2024-04-25T22:52:26.760 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0400000000000004e-06 2024-04-25T22:52:26.760 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.761 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.761 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:26.761 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028094+0000", 2024-04-25T22:52:26.761 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00065134800000000005 2024-04-25T22:52:26.761 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.761 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.761 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:26.761 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028107+0000", 2024-04-25T22:52:26.761 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3087e-05 2024-04-25T22:52:26.761 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.761 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.761 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:26.761 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033239+0000", 2024-04-25T22:52:26.762 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051319429999999999 2024-04-25T22:52:26.762 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.762 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.762 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:26.762 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033275+0000", 2024-04-25T22:52:26.762 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6430000000000002e-05 2024-04-25T22:52:26.762 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:26.762 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:26.762 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:26.762 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.762 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.762 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-25T22:52:26.762 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:26.763 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 33.636306701999999, 2024-04-25T22:52:26.763 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005413597, 2024-04-25T22:52:26.763 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:26.763 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:26.763 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:26.763 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:26.763 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.763 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:26.763 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:26.763 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:26.763 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.763 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.763 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:26.764 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:26.764 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:26.764 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.764 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.764 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:26.764 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:26.764 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3799999999999997e-07 2024-04-25T22:52:26.764 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.764 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.764 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:26.764 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027816+0000", 2024-04-25T22:52:26.764 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3230999999999999e-05 2024-04-25T22:52:26.765 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.765 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.765 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:26.765 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027823+0000", 2024-04-25T22:52:26.765 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9039999999999992e-06 2024-04-25T22:52:26.765 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.765 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.765 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:26.765 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027841+0000", 2024-04-25T22:52:26.765 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7651000000000001e-05 2024-04-25T22:52:26.765 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.765 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.765 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:26.766 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027904+0000", 2024-04-25T22:52:26.766 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3058000000000005e-05 2024-04-25T22:52:26.766 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.766 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.766 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:26.766 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027926+0000", 2024-04-25T22:52:26.766 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1450999999999998e-05 2024-04-25T22:52:26.766 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.766 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.766 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:26.766 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033177+0000", 2024-04-25T22:52:26.766 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052508909999999997 2024-04-25T22:52:26.766 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.767 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.767 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:26.767 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033215+0000", 2024-04-25T22:52:26.767 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8872999999999999e-05 2024-04-25T22:52:26.767 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:26.767 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:26.767 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:26.767 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.767 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.767 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 171 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:52:26.767 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:26.767 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 33.636249599999999, 2024-04-25T22:52:26.767 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054322240000000003, 2024-04-25T22:52:26.767 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:26.767 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:26.768 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "reached pg", 2024-04-25T22:52:26.768 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:26.768 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.768 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:26.768 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:26.768 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:26.768 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.768 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.768 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:26.768 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:26.768 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:26.768 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.768 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.768 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:26.768 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:26.769 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7500000000000001e-07 2024-04-25T22:52:26.769 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.769 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.769 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:26.769 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027868+0000", 2024-04-25T22:52:26.769 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5750000000000001e-06 2024-04-25T22:52:26.769 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.769 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.769 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:26.769 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027885+0000", 2024-04-25T22:52:26.769 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7272e-05 2024-04-25T22:52:26.769 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.769 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.769 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:26.770 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027900+0000", 2024-04-25T22:52:26.770 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.502e-05 2024-04-25T22:52:26.770 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.770 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.770 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:26.770 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028381+0000", 2024-04-25T22:52:26.770 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00048039399999999998 2024-04-25T22:52:26.770 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:26.770 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:26.770 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:26.770 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033291+0000", 2024-04-25T22:52:26.770 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049105879999999996 2024-04-25T22:52:26.771 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:26.771 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:26.771 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:26.771 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:26.771 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:26.771 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:26.772 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:52:26.773 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:26.772+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:26.872 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:26.872+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:26.886 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:26.886 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:52:26.886 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-04-25T22:52:26.886 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:26.895 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:52:26.973 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:26.973+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:26.997 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:26.997 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:52:26.997 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:52:26.997 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:52:26.997 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:27.006 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:52:27.074 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:27.074+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:27.095 INFO:teuthology.orchestra.run.smithi052.stdout:moved 8 / 210 (3.80952%) 2024-04-25T22:52:27.095 INFO:teuthology.orchestra.run.smithi052.stdout:avg 70 2024-04-25T22:52:27.095 INFO:teuthology.orchestra.run.smithi052.stdout:stddev 2.16025 -> 5.09902 (expected baseline 6.8313) 2024-04-25T22:52:27.095 INFO:teuthology.orchestra.run.smithi052.stdout:min osd.2 with 67 -> 72 pgs (0.957143 -> 1.02857 * mean) 2024-04-25T22:52:27.095 INFO:teuthology.orchestra.run.smithi052.stdout:max osd.1 with 72 -> 75 pgs (1.02857 -> 1.07143 * mean) 2024-04-25T22:52:27.095 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:52:27.095 INFO:teuthology.orchestra.run.smithi052.stdout:oload 110 2024-04-25T22:52:27.096 INFO:teuthology.orchestra.run.smithi052.stdout:max_change 3 2024-04-25T22:52:27.096 INFO:teuthology.orchestra.run.smithi052.stdout:max_change_osds 4 2024-04-25T22:52:27.096 INFO:teuthology.orchestra.run.smithi052.stdout:average_utilization 0.0003 2024-04-25T22:52:27.096 INFO:teuthology.orchestra.run.smithi052.stdout:overload_utilization 0.0004 2024-04-25T22:52:27.096 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 weight 1.0000 -> 0.8791 2024-04-25T22:52:27.096 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is set 2024-04-25T22:52:27.152 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:27.152 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-04-25T22:52:27.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-04-25T22:52:27.152 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:52:27.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.152 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:27.152 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:27.152 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 39.184950237999999, 2024-04-25T22:52:27.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0103421, 2024-04-25T22:52:27.152 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:27.153 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:27.153 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:27.153 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:27.153 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:27.153 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:27.153 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 115 2024-04-25T22:52:27.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.153 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:27.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:27.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:27.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:27.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:27.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:27.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:27.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:27.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:27.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9500000000000002e-07 2024-04-25T22:52:27.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:27.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965108+0000", 2024-04-25T22:52:27.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9177999999999994e-05 2024-04-25T22:52:27.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:27.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965127+0000", 2024-04-25T22:52:27.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8868e-05 2024-04-25T22:52:27.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:27.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965133+0000", 2024-04-25T22:52:27.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8929999999999999e-06 2024-04-25T22:52:27.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:27.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.969991+0000", 2024-04-25T22:52:27.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048573849999999997 2024-04-25T22:52:27.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:27.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970072+0000", 2024-04-25T22:52:27.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0728000000000004e-05 2024-04-25T22:52:27.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:27.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970189+0000", 2024-04-25T22:52:27.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000117778 2024-04-25T22:52:27.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:27.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970946+0000", 2024-04-25T22:52:27.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00075704600000000004 2024-04-25T22:52:27.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:27.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975297+0000", 2024-04-25T22:52:27.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004350217 2024-04-25T22:52:27.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:27.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975343+0000", 2024-04-25T22:52:27.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6687999999999998e-05 2024-04-25T22:52:27.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:27.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975380+0000", 2024-04-25T22:52:27.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6724000000000003e-05 2024-04-25T22:52:27.158 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:27.158 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:27.158 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:27.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.159 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:27.159 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:27.159 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 39.184844206999998, 2024-04-25T22:52:27.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010304384, 2024-04-25T22:52:27.159 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:27.159 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:27.159 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:27.159 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:27.159 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:27.159 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:27.159 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 116 2024-04-25T22:52:27.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.160 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:27.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:27.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:27.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:27.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:27.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:27.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:27.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:27.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:27.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5799999999999999e-07 2024-04-25T22:52:27.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:27.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965154+0000", 2024-04-25T22:52:27.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0009e-05 2024-04-25T22:52:27.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:27.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965164+0000", 2024-04-25T22:52:27.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8490000000000001e-06 2024-04-25T22:52:27.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:27.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965169+0000", 2024-04-25T22:52:27.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0730000000000004e-06 2024-04-25T22:52:27.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:27.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970609+0000", 2024-04-25T22:52:27.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054397689999999997 2024-04-25T22:52:27.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:27.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970651+0000", 2024-04-25T22:52:27.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1873999999999999e-05 2024-04-25T22:52:27.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:27.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970723+0000", 2024-04-25T22:52:27.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2039999999999995e-05 2024-04-25T22:52:27.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:27.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971358+0000", 2024-04-25T22:52:27.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063489500000000001 2024-04-25T22:52:27.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:27.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975409+0000", 2024-04-25T22:52:27.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040506880000000002 2024-04-25T22:52:27.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:27.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975432+0000", 2024-04-25T22:52:27.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3315999999999998e-05 2024-04-25T22:52:27.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:27.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975448+0000", 2024-04-25T22:52:27.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6313000000000001e-05 2024-04-25T22:52:27.166 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:27.166 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:27.167 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:27.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.167 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:27.167 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:27.167 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 39.184809625, 2024-04-25T22:52:27.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010384338999999999, 2024-04-25T22:52:27.167 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:27.167 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:27.167 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:27.167 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:27.167 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:27.167 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:27.167 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-04-25T22:52:27.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.168 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:27.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:27.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:27.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:27.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:27.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:27.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:27.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:27.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:27.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3600000000000004e-07 2024-04-25T22:52:27.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:27.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965185+0000", 2024-04-25T22:52:27.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.117e-06 2024-04-25T22:52:27.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:27.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965192+0000", 2024-04-25T22:52:27.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3239999999999997e-06 2024-04-25T22:52:27.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:27.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965198+0000", 2024-04-25T22:52:27.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6370000000000004e-06 2024-04-25T22:52:27.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:27.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970973+0000", 2024-04-25T22:52:27.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057748239999999996 2024-04-25T22:52:27.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:27.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971049+0000", 2024-04-25T22:52:27.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6029e-05 2024-04-25T22:52:27.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:27.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971174+0000", 2024-04-25T22:52:27.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012462399999999999 2024-04-25T22:52:27.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:27.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971553+0000", 2024-04-25T22:52:27.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037896499999999999 2024-04-25T22:52:27.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:27.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975482+0000", 2024-04-25T22:52:27.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039297459999999996 2024-04-25T22:52:27.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:27.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975529+0000", 2024-04-25T22:52:27.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6387000000000002e-05 2024-04-25T22:52:27.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:27.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975563+0000", 2024-04-25T22:52:27.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4150000000000003e-05 2024-04-25T22:52:27.172 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:27.172 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:27.172 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:27.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.173 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:27.173 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:27.173 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 34.137763302000003, 2024-04-25T22:52:27.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012637705000000001, 2024-04-25T22:52:27.173 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:27.173 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:27.173 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:27.173 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:27.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:27.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:27.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:27.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:27.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:27.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:27.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:27.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012227+0000", 2024-04-25T22:52:27.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.863e-06 2024-04-25T22:52:27.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:27.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012236+0000", 2024-04-25T22:52:27.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1109999999999997e-06 2024-04-25T22:52:27.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:27.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012309+0000", 2024-04-25T22:52:27.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3242000000000001e-05 2024-04-25T22:52:27.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:27.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012324+0000", 2024-04-25T22:52:27.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4837e-05 2024-04-25T22:52:27.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:27.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015060+0000", 2024-04-25T22:52:27.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027363349999999999 2024-04-25T22:52:27.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:27.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015169+0000", 2024-04-25T22:52:27.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108372 2024-04-25T22:52:27.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:27.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015498+0000", 2024-04-25T22:52:27.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032949999999999999 2024-04-25T22:52:27.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:27.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021282+0000", 2024-04-25T22:52:27.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057836429999999998 2024-04-25T22:52:27.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:27.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024709+0000", 2024-04-25T22:52:27.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034271979999999998 2024-04-25T22:52:27.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:27.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024802+0000", 2024-04-25T22:52:27.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2960000000000004e-05 2024-04-25T22:52:27.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:27.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024863+0000", 2024-04-25T22:52:27.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0643999999999997e-05 2024-04-25T22:52:27.179 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:27.179 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:27.179 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:27.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.179 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:27.179 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:27.180 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 34.137639530999998, 2024-04-25T22:52:27.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012979447999999999, 2024-04-25T22:52:27.180 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:27.180 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:27.180 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:27.180 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:27.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:27.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:27.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:27.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:27.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:27.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:27.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:27.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:27.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:52:27.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:27.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012354+0000", 2024-04-25T22:52:27.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7740000000000004e-06 2024-04-25T22:52:27.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:27.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012365+0000", 2024-04-25T22:52:27.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.064e-05 2024-04-25T22:52:27.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:27.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012382+0000", 2024-04-25T22:52:27.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6999000000000001e-05 2024-04-25T22:52:27.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:27.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015958+0000", 2024-04-25T22:52:27.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035765699999999998 2024-04-25T22:52:27.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:27.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016037+0000", 2024-04-25T22:52:27.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8242000000000001e-05 2024-04-25T22:52:27.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:27.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016404+0000", 2024-04-25T22:52:27.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036784300000000002 2024-04-25T22:52:27.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:27.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021294+0000", 2024-04-25T22:52:27.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048890629999999999 2024-04-25T22:52:27.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:27.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024959+0000", 2024-04-25T22:52:27.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036651570000000001 2024-04-25T22:52:27.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:27.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025097+0000", 2024-04-25T22:52:27.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013788099999999999 2024-04-25T22:52:27.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:27.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025328+0000", 2024-04-25T22:52:27.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231492 2024-04-25T22:52:27.185 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:27.185 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:27.185 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:27.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.185 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:27.185 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:27.185 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 34.137551762000001, 2024-04-25T22:52:27.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013049827, 2024-04-25T22:52:27.185 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:27.185 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:27.186 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:27.186 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:27.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:27.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:27.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:27.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:27.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:27.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:27.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:27.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012437+0000", 2024-04-25T22:52:27.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-04-25T22:52:27.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:27.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012440+0000", 2024-04-25T22:52:27.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7609999999999999e-06 2024-04-25T22:52:27.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:27.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012449+0000", 2024-04-25T22:52:27.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.285e-06 2024-04-25T22:52:27.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:27.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012457+0000", 2024-04-25T22:52:27.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9510000000000006e-06 2024-04-25T22:52:27.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:27.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017106+0000", 2024-04-25T22:52:27.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046494220000000003 2024-04-25T22:52:27.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:27.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017223+0000", 2024-04-25T22:52:27.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116824 2024-04-25T22:52:27.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:27.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017345+0000", 2024-04-25T22:52:27.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122175 2024-04-25T22:52:27.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:27.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021299+0000", 2024-04-25T22:52:27.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039534879999999998 2024-04-25T22:52:27.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:27.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025398+0000", 2024-04-25T22:52:27.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040988960000000003 2024-04-25T22:52:27.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:27.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025439+0000", 2024-04-25T22:52:27.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0915999999999999e-05 2024-04-25T22:52:27.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:27.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025486+0000", 2024-04-25T22:52:27.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7534999999999998e-05 2024-04-25T22:52:27.191 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:27.191 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:27.191 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:27.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.191 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:27.191 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:27.191 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 34.137521610999997, 2024-04-25T22:52:27.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020988041999999998, 2024-04-25T22:52:27.191 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:27.192 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:27.192 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:27.192 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:27.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:27.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:27.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:27.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:27.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:27.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:27.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:27.193 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:27.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.99e-07 2024-04-25T22:52:27.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.193 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:27.193 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012470+0000", 2024-04-25T22:52:27.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2789999999999999e-06 2024-04-25T22:52:27.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.193 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:27.193 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012477+0000", 2024-04-25T22:52:27.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:52:27.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.194 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:27.194 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012500+0000", 2024-04-25T22:52:27.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2490999999999999e-05 2024-04-25T22:52:27.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.194 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:27.194 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021911+0000", 2024-04-25T22:52:27.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094114160000000006 2024-04-25T22:52:27.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.194 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:27.194 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022000+0000", 2024-04-25T22:52:27.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8601000000000001e-05 2024-04-25T22:52:27.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:27.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022359+0000", 2024-04-25T22:52:27.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035921999999999999 2024-04-25T22:52:27.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:27.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025541+0000", 2024-04-25T22:52:27.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031820619999999998 2024-04-25T22:52:27.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:27.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033375+0000", 2024-04-25T22:52:27.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078338379999999992 2024-04-25T22:52:27.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:27.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033415+0000", 2024-04-25T22:52:27.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9527000000000003e-05 2024-04-25T22:52:27.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:27.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033455+0000", 2024-04-25T22:52:27.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9932000000000003e-05 2024-04-25T22:52:27.196 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:27.196 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:27.196 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:27.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.197 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:27.197 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:27.197 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 34.137466418000002, 2024-04-25T22:52:27.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021043857999999999, 2024-04-25T22:52:27.197 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:27.197 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:27.197 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:27.197 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:27.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:27.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:27.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:27.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.198 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:27.198 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:27.198 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:27.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.198 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:27.198 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012523+0000", 2024-04-25T22:52:27.198 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.361e-06 2024-04-25T22:52:27.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.198 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:27.198 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012530+0000", 2024-04-25T22:52:27.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5440000000000004e-06 2024-04-25T22:52:27.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:27.199 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012541+0000", 2024-04-25T22:52:27.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1745e-05 2024-04-25T22:52:27.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:27.199 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012551+0000", 2024-04-25T22:52:27.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5789999999999993e-06 2024-04-25T22:52:27.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.200 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:27.200 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022709+0000", 2024-04-25T22:52:27.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010157685 2024-04-25T22:52:27.200 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.200 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.200 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:27.200 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022957+0000", 2024-04-25T22:52:27.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024824599999999998 2024-04-25T22:52:27.200 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.200 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.200 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:27.200 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023443+0000", 2024-04-25T22:52:27.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048578599999999999 2024-04-25T22:52:27.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:27.201 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025547+0000", 2024-04-25T22:52:27.201 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021044789999999998 2024-04-25T22:52:27.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:27.201 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033509+0000", 2024-04-25T22:52:27.201 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0079622180000000001 2024-04-25T22:52:27.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:27.202 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033542+0000", 2024-04-25T22:52:27.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3018000000000001e-05 2024-04-25T22:52:27.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.202 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.202 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:27.202 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033566+0000", 2024-04-25T22:52:27.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3197000000000002e-05 2024-04-25T22:52:27.202 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:27.202 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:27.202 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:27.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.202 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.202 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:27.203 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:27.203 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 34.137426453000003, 2024-04-25T22:52:27.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021122696, 2024-04-25T22:52:27.203 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:27.203 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:27.203 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:27.203 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:27.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:27.203 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:27.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:27.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:27.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:27.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:27.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:27.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:27.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:52:27.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:27.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012566+0000", 2024-04-25T22:52:27.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-04-25T22:52:27.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:27.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012619+0000", 2024-04-25T22:52:27.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2607e-05 2024-04-25T22:52:27.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:27.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012628+0000", 2024-04-25T22:52:27.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6500000000000008e-06 2024-04-25T22:52:27.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:27.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024024+0000", 2024-04-25T22:52:27.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011396007999999999 2024-04-25T22:52:27.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:27.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024198+0000", 2024-04-25T22:52:27.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000173215 2024-04-25T22:52:27.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:27.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024447+0000", 2024-04-25T22:52:27.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024898500000000002 2024-04-25T22:52:27.207 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.207 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:27.207 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026431+0000", 2024-04-25T22:52:27.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001984923 2024-04-25T22:52:27.207 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.207 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:27.207 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033608+0000", 2024-04-25T22:52:27.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071768459999999997 2024-04-25T22:52:27.207 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:27.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033646+0000", 2024-04-25T22:52:27.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299000000000003e-05 2024-04-25T22:52:27.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:27.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033684+0000", 2024-04-25T22:52:27.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8773000000000003e-05 2024-04-25T22:52:27.208 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:27.208 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:27.208 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:27.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.209 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:27.209 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:27.209 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 34.137337854000002, 2024-04-25T22:52:27.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021175381, 2024-04-25T22:52:27.209 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:27.209 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:27.209 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:27.209 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:27.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:27.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:27.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:27.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:27.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:27.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:27.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:27.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012651+0000", 2024-04-25T22:52:27.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:52:27.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:27.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012656+0000", 2024-04-25T22:52:27.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8899999999999998e-06 2024-04-25T22:52:27.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:27.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012666+0000", 2024-04-25T22:52:27.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0346999999999999e-05 2024-04-25T22:52:27.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:27.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012675+0000", 2024-04-25T22:52:27.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9930000000000001e-06 2024-04-25T22:52:27.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:27.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025661+0000", 2024-04-25T22:52:27.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01298531 2024-04-25T22:52:27.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:27.212 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025757+0000", 2024-04-25T22:52:27.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5822000000000005e-05 2024-04-25T22:52:27.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:27.212 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025907+0000", 2024-04-25T22:52:27.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015051499999999999 2024-04-25T22:52:27.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:27.213 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026435+0000", 2024-04-25T22:52:27.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052762200000000005 2024-04-25T22:52:27.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.213 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:27.213 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033732+0000", 2024-04-25T22:52:27.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072978419999999997 2024-04-25T22:52:27.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.213 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:27.213 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033787+0000", 2024-04-25T22:52:27.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4703999999999997e-05 2024-04-25T22:52:27.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:27.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033826+0000", 2024-04-25T22:52:27.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8458999999999999e-05 2024-04-25T22:52:27.214 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:27.214 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:27.214 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:27.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.214 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:27.214 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:27.214 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 34.13728244, 2024-04-25T22:52:27.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021244174000000001, 2024-04-25T22:52:27.214 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:27.215 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:27.215 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:27.215 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:27.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:27.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:27.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:27.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:27.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:27.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:27.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.216 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:27.216 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:27.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:52:27.216 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.216 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:27.216 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012712+0000", 2024-04-25T22:52:27.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.913e-06 2024-04-25T22:52:27.216 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.216 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:27.216 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012722+0000", 2024-04-25T22:52:27.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2879999999999998e-06 2024-04-25T22:52:27.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:27.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012727+0000", 2024-04-25T22:52:27.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8429999999999998e-06 2024-04-25T22:52:27.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:27.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026099+0000", 2024-04-25T22:52:27.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013371450999999999 2024-04-25T22:52:27.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:27.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026147+0000", 2024-04-25T22:52:27.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7837999999999998e-05 2024-04-25T22:52:27.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:27.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026254+0000", 2024-04-25T22:52:27.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107314 2024-04-25T22:52:27.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:27.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026686+0000", 2024-04-25T22:52:27.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000432428 2024-04-25T22:52:27.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:27.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033873+0000", 2024-04-25T22:52:27.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071864399999999997 2024-04-25T22:52:27.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:27.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033904+0000", 2024-04-25T22:52:27.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1321e-05 2024-04-25T22:52:27.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:27.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033950+0000", 2024-04-25T22:52:27.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5707999999999997e-05 2024-04-25T22:52:27.220 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:27.220 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:27.220 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:27.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.220 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:27.220 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:27.220 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 34.137252054999998, 2024-04-25T22:52:27.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01096505, 2024-04-25T22:52:27.220 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:27.220 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:27.220 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:27.220 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:27.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:27.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:27.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:27.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:27.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:27.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:27.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:27.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012737+0000", 2024-04-25T22:52:27.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:52:27.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:27.222 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012739+0000", 2024-04-25T22:52:27.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-04-25T22:52:27.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:27.222 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012743+0000", 2024-04-25T22:52:27.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3239999999999996e-06 2024-04-25T22:52:27.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:27.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012746+0000", 2024-04-25T22:52:27.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.129e-06 2024-04-25T22:52:27.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:27.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012796+0000", 2024-04-25T22:52:27.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9231999999999999e-05 2024-04-25T22:52:27.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:27.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012915+0000", 2024-04-25T22:52:27.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119021 2024-04-25T22:52:27.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:27.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013069+0000", 2024-04-25T22:52:27.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015463900000000001 2024-04-25T22:52:27.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:27.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019237+0000", 2024-04-25T22:52:27.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061680329999999998 2024-04-25T22:52:27.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:27.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023603+0000", 2024-04-25T22:52:27.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043655860000000003 2024-04-25T22:52:27.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:27.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023659+0000", 2024-04-25T22:52:27.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6484000000000003e-05 2024-04-25T22:52:27.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:27.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023701+0000", 2024-04-25T22:52:27.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1761999999999998e-05 2024-04-25T22:52:27.225 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:27.225 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:27.225 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:27.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.226 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:27.226 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:27.226 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 34.137227107000001, 2024-04-25T22:52:27.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011234429000000001, 2024-04-25T22:52:27.226 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:27.226 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:27.226 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:27.226 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:27.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:27.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:27.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:27.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:27.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:27.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:27.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:27.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012762+0000", 2024-04-25T22:52:27.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-04-25T22:52:27.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:27.228 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012765+0000", 2024-04-25T22:52:27.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2569999999999999e-06 2024-04-25T22:52:27.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.228 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:27.228 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012783+0000", 2024-04-25T22:52:27.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8431999999999999e-05 2024-04-25T22:52:27.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.228 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:27.228 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012799+0000", 2024-04-25T22:52:27.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5438999999999999e-05 2024-04-25T22:52:27.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.228 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:27.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013826+0000", 2024-04-25T22:52:27.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010275060000000001 2024-04-25T22:52:27.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:27.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013913+0000", 2024-04-25T22:52:27.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.708e-05 2024-04-25T22:52:27.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:27.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014098+0000", 2024-04-25T22:52:27.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018519399999999999 2024-04-25T22:52:27.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:27.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019684+0000", 2024-04-25T22:52:27.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055860079999999999 2024-04-25T22:52:27.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:27.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023876+0000", 2024-04-25T22:52:27.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041918800000000003 2024-04-25T22:52:27.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:27.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023957+0000", 2024-04-25T22:52:27.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1165e-05 2024-04-25T22:52:27.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:27.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023995+0000", 2024-04-25T22:52:27.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:52:27.231 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:27.231 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:27.231 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:27.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.231 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:27.231 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:27.231 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 34.137129328, 2024-04-25T22:52:27.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011131200000000001, 2024-04-25T22:52:27.232 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:27.232 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:27.232 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:27.232 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:27.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:27.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:27.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:27.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:27.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:27.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:27.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:27.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012860+0000", 2024-04-25T22:52:27.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3900000000000004e-07 2024-04-25T22:52:27.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:27.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012865+0000", 2024-04-25T22:52:27.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5609999999999998e-06 2024-04-25T22:52:27.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:27.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012895+0000", 2024-04-25T22:52:27.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9847000000000001e-05 2024-04-25T22:52:27.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:27.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012905+0000", 2024-04-25T22:52:27.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.03e-05 2024-04-25T22:52:27.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:27.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015020+0000", 2024-04-25T22:52:27.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021142940000000001 2024-04-25T22:52:27.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:27.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015182+0000", 2024-04-25T22:52:27.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016248099999999999 2024-04-25T22:52:27.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:52:27.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015357+0000", 2024-04-25T22:52:27.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017471000000000001 2024-04-25T22:52:27.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:27.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021021+0000", 2024-04-25T22:52:27.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056638340000000004 2024-04-25T22:52:27.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:27.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023712+0000", 2024-04-25T22:52:27.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026910380000000002 2024-04-25T22:52:27.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:27.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023763+0000", 2024-04-25T22:52:27.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1477999999999997e-05 2024-04-25T22:52:27.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:27.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023990+0000", 2024-04-25T22:52:27.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000226818 2024-04-25T22:52:27.237 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:27.237 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:27.237 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:27.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.237 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:27.237 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:27.237 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 34.137006231999997, 2024-04-25T22:52:27.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011705299000000001, 2024-04-25T22:52:27.237 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:27.237 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:27.237 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:27.237 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:27.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:27.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:27.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:27.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:27.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:27.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:27.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:27.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012983+0000", 2024-04-25T22:52:27.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:52:27.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:27.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012986+0000", 2024-04-25T22:52:27.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5700000000000001e-06 2024-04-25T22:52:27.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:27.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012993+0000", 2024-04-25T22:52:27.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8730000000000001e-06 2024-04-25T22:52:27.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:27.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013000+0000", 2024-04-25T22:52:27.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1890000000000001e-06 2024-04-25T22:52:27.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:27.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:52:27.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002147866 2024-04-25T22:52:27.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:27.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015351+0000", 2024-04-25T22:52:27.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020300799999999999 2024-04-25T22:52:27.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:27.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016260+0000", 2024-04-25T22:52:27.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00090926799999999997 2024-04-25T22:52:27.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:27.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022669+0000", 2024-04-25T22:52:27.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064082849999999997 2024-04-25T22:52:27.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:27.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024584+0000", 2024-04-25T22:52:27.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019151699999999999 2024-04-25T22:52:27.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:27.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024643+0000", 2024-04-25T22:52:27.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8888999999999998e-05 2024-04-25T22:52:27.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:27.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024687+0000", 2024-04-25T22:52:27.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4444999999999999e-05 2024-04-25T22:52:27.242 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:27.242 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:27.242 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:27.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.243 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:27.243 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:27.243 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 34.136978640999999, 2024-04-25T22:52:27.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011249699, 2024-04-25T22:52:27.243 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:27.243 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:27.243 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:27.243 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:27.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:27.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:27.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:27.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:27.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:27.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:27.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:27.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013010+0000", 2024-04-25T22:52:27.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2099999999999996e-07 2024-04-25T22:52:27.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:27.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013013+0000", 2024-04-25T22:52:27.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1310000000000002e-06 2024-04-25T22:52:27.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:27.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013020+0000", 2024-04-25T22:52:27.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3330000000000002e-06 2024-04-25T22:52:27.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:27.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013025+0000", 2024-04-25T22:52:27.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6760000000000004e-06 2024-04-25T22:52:27.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:27.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013163+0000", 2024-04-25T22:52:27.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013824599999999999 2024-04-25T22:52:27.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:27.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013504+0000", 2024-04-25T22:52:27.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034080299999999998 2024-04-25T22:52:27.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:27.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013613+0000", 2024-04-25T22:52:27.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108705 2024-04-25T22:52:27.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:27.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015831+0000", 2024-04-25T22:52:27.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002217672 2024-04-25T22:52:27.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.247 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:27.247 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024137+0000", 2024-04-25T22:52:27.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0083060489999999994 2024-04-25T22:52:27.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.247 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:27.247 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024218+0000", 2024-04-25T22:52:27.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1351000000000001e-05 2024-04-25T22:52:27.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.248 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:27.248 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024259+0000", 2024-04-25T22:52:27.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1112000000000002e-05 2024-04-25T22:52:27.248 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:27.248 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:27.248 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:27.248 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.248 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:27.248 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:27.248 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 34.136890915000002, 2024-04-25T22:52:27.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020379749999999999, 2024-04-25T22:52:27.248 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:27.248 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:27.249 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:27.249 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:27.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:27.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:27.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:27.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:27.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:27.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:27.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:27.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013098+0000", 2024-04-25T22:52:27.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:52:27.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:27.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013105+0000", 2024-04-25T22:52:27.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5969999999999997e-06 2024-04-25T22:52:27.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:27.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013190+0000", 2024-04-25T22:52:27.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5618999999999995e-05 2024-04-25T22:52:27.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:27.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013200+0000", 2024-04-25T22:52:27.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5859999999999994e-06 2024-04-25T22:52:27.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:27.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020265+0000", 2024-04-25T22:52:27.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070653349999999998 2024-04-25T22:52:27.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:27.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020454+0000", 2024-04-25T22:52:27.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189316 2024-04-25T22:52:27.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.252 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:27.252 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020586+0000", 2024-04-25T22:52:27.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013195700000000001 2024-04-25T22:52:27.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.252 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:27.252 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023822+0000", 2024-04-25T22:52:27.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032358529999999999 2024-04-25T22:52:27.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.252 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:27.252 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033409+0000", 2024-04-25T22:52:27.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095870520000000004 2024-04-25T22:52:27.253 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.253 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.253 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:27.253 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033447+0000", 2024-04-25T22:52:27.253 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7261999999999997e-05 2024-04-25T22:52:27.253 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.253 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.253 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:27.253 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033477+0000", 2024-04-25T22:52:27.253 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0389e-05 2024-04-25T22:52:27.253 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:27.253 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:27.253 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:27.253 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.254 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:27.254 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:27.254 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 34.136774408999997, 2024-04-25T22:52:27.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010857383999999999, 2024-04-25T22:52:27.254 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:27.254 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:27.254 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:27.254 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:27.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:27.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:27.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:27.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:27.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:27.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:27.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:27.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:27.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:52:27.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.256 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:27.256 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013218+0000", 2024-04-25T22:52:27.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8199999999999998e-06 2024-04-25T22:52:27.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.256 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:27.256 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013226+0000", 2024-04-25T22:52:27.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7649999999999993e-06 2024-04-25T22:52:27.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.256 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:27.256 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013259+0000", 2024-04-25T22:52:27.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2727e-05 2024-04-25T22:52:27.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.257 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:27.257 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014809+0000", 2024-04-25T22:52:27.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001550144 2024-04-25T22:52:27.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.257 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:27.257 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014958+0000", 2024-04-25T22:52:27.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014890300000000001 2024-04-25T22:52:27.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.257 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:52:27.257 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015087+0000", 2024-04-25T22:52:27.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012939200000000001 2024-04-25T22:52:27.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:27.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020212+0000", 2024-04-25T22:52:27.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051248939999999996 2024-04-25T22:52:27.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:27.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023699+0000", 2024-04-25T22:52:27.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034873289999999999 2024-04-25T22:52:27.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:27.259 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024014+0000", 2024-04-25T22:52:27.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031473999999999999 2024-04-25T22:52:27.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.259 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:27.259 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024071+0000", 2024-04-25T22:52:27.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7040000000000003e-05 2024-04-25T22:52:27.259 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:27.259 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:27.259 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:27.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.259 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:27.259 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:27.260 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 34.136719704000001, 2024-04-25T22:52:27.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012329677000000001, 2024-04-25T22:52:27.260 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:27.260 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:27.260 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:27.260 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:27.260 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.260 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:27.260 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:27.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:27.260 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.260 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.260 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:27.260 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:27.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:27.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.261 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:27.261 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013269+0000", 2024-04-25T22:52:27.261 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5000000000000002e-07 2024-04-25T22:52:27.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.261 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:27.261 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:52:27.261 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6909999999999999e-06 2024-04-25T22:52:27.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.261 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:27.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013284+0000", 2024-04-25T22:52:27.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0963e-05 2024-04-25T22:52:27.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:27.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013361+0000", 2024-04-25T22:52:27.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7379999999999994e-05 2024-04-25T22:52:27.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:27.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013448+0000", 2024-04-25T22:52:27.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6990000000000006e-05 2024-04-25T22:52:27.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:27.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013632+0000", 2024-04-25T22:52:27.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018396800000000001 2024-04-25T22:52:27.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:27.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013800+0000", 2024-04-25T22:52:27.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167467 2024-04-25T22:52:27.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:27.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.018570+0000", 2024-04-25T22:52:27.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047701460000000003 2024-04-25T22:52:27.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:27.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025507+0000", 2024-04-25T22:52:27.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069372039999999998 2024-04-25T22:52:27.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:27.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025562+0000", 2024-04-25T22:52:27.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4858999999999998e-05 2024-04-25T22:52:27.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:27.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025598+0000", 2024-04-25T22:52:27.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6259e-05 2024-04-25T22:52:27.265 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:27.265 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:27.265 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:27.265 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.265 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.265 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:27.265 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:27.265 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 34.136587831, 2024-04-25T22:52:27.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020176666999999999, 2024-04-25T22:52:27.265 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:27.265 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:27.265 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:52:27.266 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:27.266 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.266 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:27.266 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:27.266 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:27.266 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.266 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.266 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:27.266 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:27.266 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:27.266 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.266 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.266 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:27.267 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:52:27.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-04-25T22:52:27.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.267 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:27.267 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013405+0000", 2024-04-25T22:52:27.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0559999999999998e-06 2024-04-25T22:52:27.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.267 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:27.267 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013422+0000", 2024-04-25T22:52:27.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6770999999999999e-05 2024-04-25T22:52:27.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.267 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:27.268 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013431+0000", 2024-04-25T22:52:27.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5019999999999998e-06 2024-04-25T22:52:27.268 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.268 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.268 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:27.268 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021720+0000", 2024-04-25T22:52:27.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082884340000000008 2024-04-25T22:52:27.268 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.268 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.268 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:27.268 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022122+0000", 2024-04-25T22:52:27.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000401634 2024-04-25T22:52:27.269 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:27.269 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:27.269 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:27.269 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033577+0000", 2024-04-25T22:52:27.269 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011455435999999999 2024-04-25T22:52:27.269 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:27.269 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:27.269 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:27.269 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:27.269 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:27.269 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:27.271 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:52:27.271 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:27.269+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:27.371 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:27.370+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:27.386 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-25T22:52:27.387 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-25T22:52:27.387 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-25T22:52:27.387 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-25T22:52:27.397 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:52:27.427 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:52:27.473 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:27.472+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:27.500 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-25T22:52:27.500 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-25T22:52:27.500 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-25T22:52:27.500 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-25T22:52:27.500 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-25T22:52:27.509 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:52:27.564 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-25T22:52:27.564 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:52:27.583 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-25T22:52:27.583 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:52:27.593 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:27.593+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:27.601 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-25T22:52:27.601 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:52:27.651 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:27.651 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:27.660 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:52:27.675 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:27.674+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:27.773 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:27.773 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:27.776 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:27.776+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:27.782 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:52:27.878 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:27.877+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:27.885 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:27.885 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:27.895 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:52:27.980 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:27.979+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:28.036 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:28.036 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:28.045 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:52:28.080 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:28.079+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:28.151 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:28.151 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:28.159 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:52:28.181 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:28.180+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:28.261 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:28.261 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:28.271 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:52:28.315 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:28.314+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:28.373 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:28.374 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:28.383 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:52:28.384 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:28.381+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:28.483 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:28.483+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:28.488 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:28.489 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:28.497 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:52:28.584 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:28.583+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:28.600 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:28.600 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:28.609 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:52:28.685 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:28.684+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:28.711 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:28.711 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:28.720 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:52:28.786 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:28.785+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:28.828 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:28.828 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:28.837 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:52:28.887 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:28.886+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:28.939 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:28.939 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:28.948 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:52:28.987 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:28.987+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:29.050 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:29.050 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:29.059 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:52:29.089 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:29.088+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:29.113 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-25T22:52:29.171 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:29.171 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:29.180 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:52:29.189 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:29.188+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:29.283 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:29.283 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:29.290 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:29.289+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:29.292 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:52:29.390 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:29.390+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:29.393 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:29.393 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:29.402 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:52:29.491 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:29.490+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:29.517 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:29.518 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:29.527 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:52:29.592 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:29.591+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:29.613 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:52:29.629 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:29.629 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:29.639 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:52:29.693 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:29.693+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:29.736 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-25T22:52:29.737 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:52:29.742 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:29.742 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:29.751 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:52:29.755 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-25T22:52:29.755 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:52:29.773 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-25T22:52:29.773 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:52:29.795 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:29.795+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:29.858 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:29.858 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:52:29.858 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-25T22:52:29.859 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:29.867 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:52:29.896 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:29.896+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:29.968 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:29.969 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:52:29.969 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-25T22:52:29.969 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-25T22:52:29.969 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:29.978 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:52:30.021 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:30.020+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:30.082 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:30.083 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:52:30.083 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:52:30.083 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:52:30.083 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.083 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:52:30.083 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:52:30.083 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 42.113786810000001, 2024-04-25T22:52:30.083 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:52:30.083 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:30.083 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:30.083 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:30.083 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:30.084 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.084 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:30.084 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:52:30.084 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:30.084 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.084 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.084 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:30.084 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:52:30.084 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:30.084 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.084 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.084 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:30.084 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:52:30.084 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:52:30.085 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.085 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.085 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:30.085 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:52:30.085 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:52:30.085 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.085 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.085 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:30.085 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:52:30.085 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:52:30.085 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.085 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.085 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:30.086 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:52:30.086 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:52:30.086 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.086 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.086 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:30.086 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:52:30.086 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:52:30.086 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.086 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.086 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:30.086 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:52:30.086 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:52:30.086 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.087 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.087 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:30.087 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:52:30.087 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:52:30.087 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.087 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.087 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:30.087 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:52:30.087 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:52:30.087 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:30.087 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:30.087 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:30.087 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.087 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.088 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:110 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'72, mlcod=10'68)", 2024-04-25T22:52:30.088 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:30.088 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 42.113152810000003, 2024-04-25T22:52:30.088 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065316630000000001, 2024-04-25T22:52:30.088 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:30.088 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:30.088 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:30.088 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:30.088 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.088 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:30.088 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:30.088 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:30.088 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.088 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.089 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:30.089 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:30.089 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:30.089 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.089 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.089 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:30.089 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:30.089 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.58e-07 2024-04-25T22:52:30.089 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.089 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.089 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:30.089 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967811+0000", 2024-04-25T22:52:30.089 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.118e-06 2024-04-25T22:52:30.089 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.090 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.090 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:30.090 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967817+0000", 2024-04-25T22:52:30.090 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3709999999999996e-06 2024-04-25T22:52:30.090 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.090 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.090 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:30.090 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967820+0000", 2024-04-25T22:52:30.090 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2210000000000002e-06 2024-04-25T22:52:30.090 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.090 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.090 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:30.090 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967876+0000", 2024-04-25T22:52:30.090 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5507000000000002e-05 2024-04-25T22:52:30.091 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.091 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.091 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:30.091 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967893+0000", 2024-04-25T22:52:30.091 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7812000000000002e-05 2024-04-25T22:52:30.091 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.091 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.091 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:30.091 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974317+0000", 2024-04-25T22:52:30.091 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064237160000000003 2024-04-25T22:52:30.091 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.091 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.091 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:30.092 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:52:30.092 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.156e-05 2024-04-25T22:52:30.092 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:30.092 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:30.092 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:30.092 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.092 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.092 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'68)", 2024-04-25T22:52:30.092 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:30.092 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 42.112735297, 2024-04-25T22:52:30.092 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061292279999999996, 2024-04-25T22:52:30.092 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:30.092 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:30.092 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:30.093 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:30.093 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.093 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:30.093 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:30.093 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:30.093 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.093 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.093 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:30.093 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:30.093 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:30.093 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.093 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.093 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:30.093 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:30.094 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6300000000000001e-07 2024-04-25T22:52:30.094 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.094 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.094 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:30.094 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968228+0000", 2024-04-25T22:52:30.094 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6139999999999999e-06 2024-04-25T22:52:30.094 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.094 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.094 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:30.094 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968235+0000", 2024-04-25T22:52:30.094 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7020000000000001e-06 2024-04-25T22:52:30.094 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.094 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.095 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:30.095 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968238+0000", 2024-04-25T22:52:30.095 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0010000000000002e-06 2024-04-25T22:52:30.095 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.095 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.095 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:30.095 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968297+0000", 2024-04-25T22:52:30.095 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8424999999999997e-05 2024-04-25T22:52:30.095 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.095 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.095 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:30.095 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968316+0000", 2024-04-25T22:52:30.095 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8814999999999999e-05 2024-04-25T22:52:30.095 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.096 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.096 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:30.096 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:52:30.096 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060239439999999998 2024-04-25T22:52:30.096 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.096 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.096 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:30.096 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974354+0000", 2024-04-25T22:52:30.096 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4364e-05 2024-04-25T22:52:30.096 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:30.096 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:30.096 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:30.096 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.096 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.097 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'68)", 2024-04-25T22:52:30.097 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:30.097 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 42.112298295000002, 2024-04-25T22:52:30.097 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005948414, 2024-04-25T22:52:30.097 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:30.097 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:30.097 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:30.097 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:30.097 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.097 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:30.097 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:30.097 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:30.097 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.097 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.098 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:30.098 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:30.098 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:30.098 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.098 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.098 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:30.098 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:30.098 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6199999999999998e-07 2024-04-25T22:52:30.098 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.098 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.098 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:30.098 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968723+0000", 2024-04-25T22:52:30.098 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1148999999999993e-05 2024-04-25T22:52:30.099 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.099 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.099 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:30.099 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968730+0000", 2024-04-25T22:52:30.099 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1749999999999999e-06 2024-04-25T22:52:30.099 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.099 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.099 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:30.099 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968734+0000", 2024-04-25T22:52:30.099 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5200000000000002e-06 2024-04-25T22:52:30.099 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.099 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.099 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:30.099 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968771+0000", 2024-04-25T22:52:30.100 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6851999999999999e-05 2024-04-25T22:52:30.100 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.100 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.100 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:30.100 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968788+0000", 2024-04-25T22:52:30.100 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7027000000000001e-05 2024-04-25T22:52:30.100 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.100 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.100 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:30.100 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974589+0000", 2024-04-25T22:52:30.100 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058013320000000002 2024-04-25T22:52:30.100 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.100 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.100 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:30.101 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974610+0000", 2024-04-25T22:52:30.101 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0897e-05 2024-04-25T22:52:30.101 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:30.101 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:30.101 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:30.101 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.101 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.101 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'68)", 2024-04-25T22:52:30.101 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:30.101 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 42.111728284999998, 2024-04-25T22:52:30.101 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053935750000000003, 2024-04-25T22:52:30.101 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:30.101 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:30.101 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:30.102 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:30.102 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.102 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:30.102 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:30.102 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:30.102 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.102 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.102 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:30.102 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:30.102 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:30.102 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.102 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.102 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:30.103 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:30.103 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.03e-07 2024-04-25T22:52:30.103 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.103 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.103 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:30.103 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969235+0000", 2024-04-25T22:52:30.103 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2399999999999999e-06 2024-04-25T22:52:30.103 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.103 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.103 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:30.103 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969242+0000", 2024-04-25T22:52:30.103 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1269999999999997e-06 2024-04-25T22:52:30.103 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.103 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.104 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:30.104 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969246+0000", 2024-04-25T22:52:30.104 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3840000000000001e-06 2024-04-25T22:52:30.104 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.104 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.104 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:30.104 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969278+0000", 2024-04-25T22:52:30.104 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1868e-05 2024-04-25T22:52:30.104 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.104 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.104 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:30.104 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969295+0000", 2024-04-25T22:52:30.104 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7530999999999999e-05 2024-04-25T22:52:30.104 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.105 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.105 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:30.105 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974611+0000", 2024-04-25T22:52:30.105 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053160789999999996 2024-04-25T22:52:30.105 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.105 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.105 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:30.105 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974625+0000", 2024-04-25T22:52:30.105 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3943e-05 2024-04-25T22:52:30.105 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:30.105 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:30.105 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:30.105 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.105 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.106 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-25T22:52:30.106 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:30.106 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 41.918132376999999, 2024-04-25T22:52:30.106 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054952610000000004, 2024-04-25T22:52:30.106 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:30.106 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:30.106 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:30.106 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:30.106 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.106 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:30.106 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:30.106 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:30.106 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.106 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.107 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:30.107 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:30.107 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:30.107 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.107 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.107 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:30.107 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:30.107 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.68e-07 2024-04-25T22:52:30.107 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.107 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.107 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:30.107 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162898+0000", 2024-04-25T22:52:30.107 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9470999999999999e-05 2024-04-25T22:52:30.108 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.108 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.108 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:30.108 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162906+0000", 2024-04-25T22:52:30.108 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1580000000000005e-06 2024-04-25T22:52:30.108 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.108 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.108 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:30.108 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162911+0000", 2024-04-25T22:52:30.108 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4779999999999999e-06 2024-04-25T22:52:30.108 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.108 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.108 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:30.108 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162952+0000", 2024-04-25T22:52:30.108 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0629e-05 2024-04-25T22:52:30.109 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.109 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.109 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:30.109 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162968+0000", 2024-04-25T22:52:30.109 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6239000000000002e-05 2024-04-25T22:52:30.109 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.109 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.109 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:30.109 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168281+0000", 2024-04-25T22:52:30.109 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053132869999999999 2024-04-25T22:52:30.109 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.109 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.109 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:30.109 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168323+0000", 2024-04-25T22:52:30.110 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1430999999999997e-05 2024-04-25T22:52:30.110 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:30.110 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:30.110 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:30.110 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.110 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.110 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-04-25T22:52:30.110 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:30.110 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 41.487655015000001, 2024-04-25T22:52:30.110 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050872510000000001, 2024-04-25T22:52:30.110 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:30.110 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:30.110 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:30.111 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:30.111 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.111 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:30.111 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:30.111 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:30.111 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.111 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.111 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:30.111 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:30.111 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:30.111 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.111 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.111 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:30.112 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:30.112 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.72e-07 2024-04-25T22:52:30.112 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.112 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.112 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:30.112 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593381+0000", 2024-04-25T22:52:30.112 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5797000000000006e-05 2024-04-25T22:52:30.112 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.112 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.112 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:30.112 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593389+0000", 2024-04-25T22:52:30.112 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8480000000000001e-06 2024-04-25T22:52:30.112 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.112 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.113 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:30.113 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593393+0000", 2024-04-25T22:52:30.113 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4819999999999996e-06 2024-04-25T22:52:30.113 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.113 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.113 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:30.113 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593435+0000", 2024-04-25T22:52:30.113 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1600000000000002e-05 2024-04-25T22:52:30.113 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.113 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.113 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:30.113 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593454+0000", 2024-04-25T22:52:30.113 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8868e-05 2024-04-25T22:52:30.113 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.114 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.114 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:30.114 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598350+0000", 2024-04-25T22:52:30.114 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004895763 2024-04-25T22:52:30.114 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.114 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.114 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:30.114 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598392+0000", 2024-04-25T22:52:30.114 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2521000000000002e-05 2024-04-25T22:52:30.114 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:30.114 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:30.114 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:30.114 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.114 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.115 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:30.115 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:52:30.115 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 37.069291110999998, 2024-04-25T22:52:30.115 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:52:30.115 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:30.115 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:30.115 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:30.115 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:30.115 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.115 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:30.115 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:52:30.115 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:30.115 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.115 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.116 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:30.116 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:52:30.116 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:30.116 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.116 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.116 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:30.116 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:52:30.116 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:52:30.116 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.116 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.116 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:30.116 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:52:30.116 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:52:30.116 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.117 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.117 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:30.117 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:52:30.117 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:52:30.117 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.117 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.117 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:30.117 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:52:30.117 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:52:30.117 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.117 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.117 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:30.117 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:52:30.117 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:52:30.118 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.118 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.118 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:30.118 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:52:30.118 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:52:30.118 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.118 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.118 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:30.118 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:52:30.118 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:52:30.118 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.118 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.118 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:30.119 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:52:30.119 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:52:30.119 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.119 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.119 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:30.119 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:52:30.119 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:52:30.119 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.119 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.119 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:30.119 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:52:30.119 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:52:30.119 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.119 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.120 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:30.120 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:52:30.120 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:52:30.120 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:30.120 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:30.120 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:30.120 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.120 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.120 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:30.120 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:52:30.120 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 37.068616734999999, 2024-04-25T22:52:30.120 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:52:30.120 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:30.120 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:30.120 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:30.121 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:30.121 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.121 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:30.121 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:52:30.121 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:30.121 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.121 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.121 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:30.121 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:52:30.121 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:30.121 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.121 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.121 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:30.121 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:52:30.122 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:52:30.122 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.122 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.122 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:30.122 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:52:30.122 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:52:30.122 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.122 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.122 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:30.122 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:52:30.122 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:52:30.122 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.122 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.123 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:30.123 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:52:30.123 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:52:30.123 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.123 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.123 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:30.123 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:52:30.123 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:52:30.123 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.123 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.123 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:30.123 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:52:30.123 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:52:30.123 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.124 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.124 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:30.124 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:52:30.124 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:52:30.124 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.124 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.124 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:30.124 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:52:30.124 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:52:30.124 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.124 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.124 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:30.124 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:52:30.124 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:52:30.125 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.125 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.125 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:30.125 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:52:30.125 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:52:30.125 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.125 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.125 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:30.125 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:52:30.125 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:52:30.125 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:30.125 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:30.125 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:30.125 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.126 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.126 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:30.126 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:52:30.126 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 37.068107523000002, 2024-04-25T22:52:30.126 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:52:30.126 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:30.126 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:30.126 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:30.126 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:30.126 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.126 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:30.126 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:52:30.126 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:30.127 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.127 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.127 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:30.127 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:52:30.127 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:30.127 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.127 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.127 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:30.127 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:52:30.127 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:52:30.127 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.127 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.127 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:30.127 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:52:30.128 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:52:30.128 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.128 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.128 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:30.128 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:52:30.128 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:52:30.128 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.128 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.128 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:30.128 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:52:30.128 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:52:30.128 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.128 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.128 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:30.129 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:52:30.129 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:52:30.129 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.129 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.129 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:30.129 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:52:30.129 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:52:30.129 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.129 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.129 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:30.129 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:52:30.129 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:52:30.129 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.129 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.130 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:30.130 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:52:30.130 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:52:30.130 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.130 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.130 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:30.130 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:52:30.130 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:52:30.130 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.130 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.130 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:30.130 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:52:30.130 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:52:30.131 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.131 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.131 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:30.131 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:52:30.131 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:52:30.131 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:30.131 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:30.131 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:30.131 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.131 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.131 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:30.131 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:30.131 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 37.067694324999998, 2024-04-25T22:52:30.131 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:52:30.132 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:30.132 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:30.132 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:30.132 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:30.132 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.132 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:30.132 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:30.132 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:30.132 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.132 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.132 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:30.132 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:30.132 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:30.132 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.132 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.133 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:30.133 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:30.133 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:52:30.133 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.133 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.133 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:30.133 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:52:30.133 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:52:30.133 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.133 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.133 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:30.133 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:52:30.133 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:52:30.133 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.134 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.134 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:30.134 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:52:30.134 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:52:30.134 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.134 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.134 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:30.134 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:52:30.134 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:52:30.134 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.134 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.134 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:30.134 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:52:30.134 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:52:30.135 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.135 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.135 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:30.135 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:52:30.135 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:52:30.135 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.135 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.135 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:30.135 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:52:30.135 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:52:30.135 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.135 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.135 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:30.135 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:52:30.136 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:52:30.136 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.136 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.136 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:30.136 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:52:30.136 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:52:30.136 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.136 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.136 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:30.136 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:52:30.136 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:52:30.136 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:30.136 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:30.136 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:30.137 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.137 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.137 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:30.137 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:52:30.137 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 37.067643654999998, 2024-04-25T22:52:30.137 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:52:30.137 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:30.137 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:30.137 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:30.137 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:30.137 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.137 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:30.137 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:52:30.137 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:30.138 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.138 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.138 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:30.138 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:52:30.138 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:30.138 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.138 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.138 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:30.138 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:52:30.138 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:52:30.138 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.138 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.138 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:30.139 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:52:30.139 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:52:30.139 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.139 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.139 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:30.139 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:52:30.139 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:52:30.139 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.139 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.139 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:30.139 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:52:30.139 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:52:30.139 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.139 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.140 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:30.140 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:52:30.140 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:52:30.140 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.140 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.140 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:52:30.140 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:52:30.140 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:52:30.140 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.140 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.140 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:30.140 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:52:30.140 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:52:30.140 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.141 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.141 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:30.141 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:52:30.141 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:52:30.141 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.141 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.141 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:30.141 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:52:30.141 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:52:30.141 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.141 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.141 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:30.141 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:52:30.142 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:52:30.142 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.142 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.142 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:30.142 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:52:30.142 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:52:30.142 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.142 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.142 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:30.142 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:52:30.142 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:52:30.142 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.142 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.143 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:30.143 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:52:30.143 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:52:30.143 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:30.143 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:30.143 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:30.143 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.143 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.143 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:30.143 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:52:30.143 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 37.067606785999999, 2024-04-25T22:52:30.143 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:52:30.143 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:30.143 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:30.144 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:30.144 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:30.144 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.144 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:30.144 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:52:30.144 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:30.144 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.144 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.144 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:30.144 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:52:30.144 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:30.144 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.144 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.144 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:30.145 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:52:30.145 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:52:30.145 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.145 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.145 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:30.145 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:52:30.145 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:52:30.145 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.145 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.145 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:30.145 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:52:30.145 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:52:30.145 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.145 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.145 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:30.146 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:52:30.146 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:52:30.146 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.146 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.146 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:30.146 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:52:30.146 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:52:30.146 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.146 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.146 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:52:30.146 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:52:30.146 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:52:30.146 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.147 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.147 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:30.147 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:52:30.147 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:52:30.147 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.147 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.147 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:30.147 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:52:30.147 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:52:30.147 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.147 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.147 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:30.147 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:52:30.147 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:52:30.147 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.148 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.148 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:30.148 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:52:30.148 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:52:30.148 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.148 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.148 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:30.148 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:52:30.148 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:52:30.148 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.148 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.148 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:30.148 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:52:30.148 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:52:30.149 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.149 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.149 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:30.149 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:52:30.149 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:52:30.149 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:30.149 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:30.149 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:30.149 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.149 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.149 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:30.149 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:52:30.149 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 37.067581820000001, 2024-04-25T22:52:30.149 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:52:30.150 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:30.150 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:30.150 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:30.150 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:30.150 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.150 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:30.150 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:52:30.150 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:30.150 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.150 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.150 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:30.150 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:52:30.150 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:30.151 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.151 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.151 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:30.151 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:52:30.151 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:52:30.151 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.151 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.151 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:30.151 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:52:30.151 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:52:30.151 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.151 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.151 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:30.151 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:52:30.151 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:52:30.152 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.152 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.152 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:30.152 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:52:30.152 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:52:30.152 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.152 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.152 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:30.152 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:52:30.152 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:52:30.152 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.152 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.152 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:30.153 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:52:30.153 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:52:30.153 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.153 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.153 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:30.153 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:52:30.153 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:52:30.153 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.153 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.153 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:30.153 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:52:30.153 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:52:30.153 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.153 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.154 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:30.154 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:52:30.154 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:52:30.154 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.154 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.154 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:30.154 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:52:30.154 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:52:30.154 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.154 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.154 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:30.154 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:52:30.154 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:52:30.154 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:30.155 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:30.155 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:30.155 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.155 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.155 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:30.155 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:52:30.155 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 37.067545455999998, 2024-04-25T22:52:30.155 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:52:30.155 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:30.155 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:30.155 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:52:30.155 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:30.155 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.155 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:30.156 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:52:30.156 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:30.156 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.156 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.156 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:30.156 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:52:30.156 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:30.156 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.156 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.156 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:30.156 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:52:30.156 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:52:30.156 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.156 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.157 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:30.157 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:52:30.157 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:52:30.157 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.157 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.157 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:30.157 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:52:30.157 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:52:30.157 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.157 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.157 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:30.157 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:52:30.157 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:52:30.157 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.158 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.158 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:30.158 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:52:30.158 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:52:30.158 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.158 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.158 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:52:30.158 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:52:30.158 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:52:30.158 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.158 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.158 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:30.158 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:52:30.159 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:52:30.159 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.159 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.159 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:30.159 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:52:30.159 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:52:30.159 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.159 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.159 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:30.159 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:52:30.159 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:52:30.159 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:30.159 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:30.159 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:30.159 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.160 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.160 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:30.160 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:30.160 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 37.067514375000002, 2024-04-25T22:52:30.160 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:52:30.160 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:30.160 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:30.160 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:52:30.160 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:30.160 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.160 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:30.160 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:30.160 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:30.160 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.161 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.161 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:30.161 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:30.161 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:30.161 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.161 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.161 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:30.161 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:30.161 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:52:30.161 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.161 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.161 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:30.161 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:52:30.161 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:52:30.162 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.162 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.162 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:30.162 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:52:30.162 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:52:30.162 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.162 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.162 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:30.162 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:52:30.162 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:52:30.162 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.162 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.162 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:30.162 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:52:30.163 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:52:30.163 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.163 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.163 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:30.163 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:52:30.163 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:52:30.163 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.163 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.163 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:30.163 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:52:30.163 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:52:30.163 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:30.163 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:30.163 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:30.164 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.164 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.164 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:52:30.164 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:30.164 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 37.067073405999999, 2024-04-25T22:52:30.164 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064881979999999997, 2024-04-25T22:52:30.164 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:30.164 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:30.164 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:30.164 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:30.164 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.164 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:30.164 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:30.164 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:30.165 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.165 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.165 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:30.165 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:30.165 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:30.165 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.165 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.165 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:30.165 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:30.165 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2699999999999999e-07 2024-04-25T22:52:30.165 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.165 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.165 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:30.165 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013898+0000", 2024-04-25T22:52:30.166 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0796e-05 2024-04-25T22:52:30.166 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.166 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.166 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:30.166 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013907+0000", 2024-04-25T22:52:30.166 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5140000000000007e-06 2024-04-25T22:52:30.166 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.166 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.166 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:30.166 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013952+0000", 2024-04-25T22:52:30.166 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4134000000000001e-05 2024-04-25T22:52:30.166 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.166 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.167 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:30.167 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016812+0000", 2024-04-25T22:52:30.167 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028601059999999998 2024-04-25T22:52:30.167 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.167 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.167 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:30.167 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.017052+0000", 2024-04-25T22:52:30.167 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024056500000000001 2024-04-25T22:52:30.167 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.167 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.167 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:30.167 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020350+0000", 2024-04-25T22:52:30.167 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032978320000000001 2024-04-25T22:52:30.167 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.168 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.168 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:30.168 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020375+0000", 2024-04-25T22:52:30.168 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4624e-05 2024-04-25T22:52:30.168 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:30.168 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:30.168 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:30.168 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.168 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.168 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-25T22:52:30.168 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:30.168 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 37.053542960000001, 2024-04-25T22:52:30.168 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058583000000000003, 2024-04-25T22:52:30.168 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:30.169 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:30.169 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:30.169 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:30.169 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.169 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:30.169 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:30.169 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:30.169 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.169 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.169 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:30.169 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:30.169 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:30.169 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.169 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.170 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:30.170 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:30.170 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.41e-07 2024-04-25T22:52:30.170 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.170 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.170 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:30.170 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027428+0000", 2024-04-25T22:52:30.170 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.075e-05 2024-04-25T22:52:30.170 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.170 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.170 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:30.170 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027435+0000", 2024-04-25T22:52:30.170 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3610000000000003e-06 2024-04-25T22:52:30.170 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.171 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.171 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:30.171 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027442+0000", 2024-04-25T22:52:30.171 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0400000000000004e-06 2024-04-25T22:52:30.171 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.171 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.171 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:30.171 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028094+0000", 2024-04-25T22:52:30.171 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00065134800000000005 2024-04-25T22:52:30.171 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.171 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.171 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:30.171 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028107+0000", 2024-04-25T22:52:30.172 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3087e-05 2024-04-25T22:52:30.172 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.172 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.172 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:30.172 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033239+0000", 2024-04-25T22:52:30.172 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051319429999999999 2024-04-25T22:52:30.172 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.172 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.172 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:30.172 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033275+0000", 2024-04-25T22:52:30.172 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6430000000000002e-05 2024-04-25T22:52:30.172 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:30.172 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:30.172 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:30.173 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.173 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.173 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-25T22:52:30.173 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:30.173 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 37.053158123000003, 2024-04-25T22:52:30.173 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005413597, 2024-04-25T22:52:30.173 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:30.173 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:30.173 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:30.173 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:30.173 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.173 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:30.173 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:30.173 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:30.173 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.174 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.174 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:30.174 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:30.174 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:30.174 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.174 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.174 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:30.174 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:30.174 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3799999999999997e-07 2024-04-25T22:52:30.174 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.174 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.174 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:30.174 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027816+0000", 2024-04-25T22:52:30.175 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3230999999999999e-05 2024-04-25T22:52:30.175 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.175 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.175 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:30.175 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027823+0000", 2024-04-25T22:52:30.175 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9039999999999992e-06 2024-04-25T22:52:30.175 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.175 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.175 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:30.175 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027841+0000", 2024-04-25T22:52:30.175 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7651000000000001e-05 2024-04-25T22:52:30.175 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.175 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.175 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:30.176 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027904+0000", 2024-04-25T22:52:30.176 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3058000000000005e-05 2024-04-25T22:52:30.176 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.176 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.176 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:30.176 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027926+0000", 2024-04-25T22:52:30.176 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1450999999999998e-05 2024-04-25T22:52:30.176 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.176 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.176 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:30.176 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033177+0000", 2024-04-25T22:52:30.176 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052508909999999997 2024-04-25T22:52:30.176 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.176 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.176 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:30.177 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033215+0000", 2024-04-25T22:52:30.177 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8872999999999999e-05 2024-04-25T22:52:30.177 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:30.177 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:30.177 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:30.177 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.177 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.177 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 171 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:52:30.177 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:30.177 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 37.053101021000003, 2024-04-25T22:52:30.177 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054322240000000003, 2024-04-25T22:52:30.177 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:30.177 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:30.177 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "reached pg", 2024-04-25T22:52:30.178 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:30.178 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.178 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:30.178 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:30.178 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:30.178 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.178 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.178 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:30.178 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:30.178 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:30.178 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.178 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.178 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:30.179 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:30.179 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7500000000000001e-07 2024-04-25T22:52:30.179 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.179 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.179 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:30.179 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027868+0000", 2024-04-25T22:52:30.179 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5750000000000001e-06 2024-04-25T22:52:30.179 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.179 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.179 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:30.179 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027885+0000", 2024-04-25T22:52:30.179 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7272e-05 2024-04-25T22:52:30.179 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.179 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.180 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:30.180 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027900+0000", 2024-04-25T22:52:30.180 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.502e-05 2024-04-25T22:52:30.180 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.180 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.180 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:30.180 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028381+0000", 2024-04-25T22:52:30.180 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00048039399999999998 2024-04-25T22:52:30.180 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:30.180 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:30.180 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:30.180 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033291+0000", 2024-04-25T22:52:30.180 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049105879999999996 2024-04-25T22:52:30.180 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:30.181 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:30.181 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:30.181 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:30.181 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:30.181 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:30.183 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is set 2024-04-25T22:52:30.183 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:52:30.184 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:30.181+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:30.283 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:30.282+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:30.291 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:30.291 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:52:30.291 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-04-25T22:52:30.291 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:30.300 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:52:30.384 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:30.384+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:30.402 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:30.403 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:52:30.403 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:52:30.403 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:52:30.403 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:30.410 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:52:30.485 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:30.485+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:30.514 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:30.514 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-04-25T22:52:30.514 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-04-25T22:52:30.514 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:52:30.514 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.514 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:30.514 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:30.515 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 42.547117827000001, 2024-04-25T22:52:30.515 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0103421, 2024-04-25T22:52:30.515 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:30.515 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:30.515 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:30.515 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:30.515 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:30.515 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:30.515 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 115 2024-04-25T22:52:30.515 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.515 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:30.515 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.515 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:30.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:30.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:30.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:30.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:30.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:30.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:30.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:30.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9500000000000002e-07 2024-04-25T22:52:30.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:30.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965108+0000", 2024-04-25T22:52:30.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9177999999999994e-05 2024-04-25T22:52:30.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:30.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965127+0000", 2024-04-25T22:52:30.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8868e-05 2024-04-25T22:52:30.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:30.518 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965133+0000", 2024-04-25T22:52:30.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8929999999999999e-06 2024-04-25T22:52:30.518 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.518 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:30.518 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.969991+0000", 2024-04-25T22:52:30.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048573849999999997 2024-04-25T22:52:30.518 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.518 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:30.518 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970072+0000", 2024-04-25T22:52:30.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0728000000000004e-05 2024-04-25T22:52:30.518 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.519 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:30.520 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970189+0000", 2024-04-25T22:52:30.520 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000117778 2024-04-25T22:52:30.520 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.520 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:30.520 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970946+0000", 2024-04-25T22:52:30.520 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00075704600000000004 2024-04-25T22:52:30.520 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.520 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:30.520 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975297+0000", 2024-04-25T22:52:30.520 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004350217 2024-04-25T22:52:30.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:30.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975343+0000", 2024-04-25T22:52:30.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6687999999999998e-05 2024-04-25T22:52:30.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:30.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975380+0000", 2024-04-25T22:52:30.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6724000000000003e-05 2024-04-25T22:52:30.521 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:30.521 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:30.521 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:30.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.522 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:30.522 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:30.522 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 42.547011796, 2024-04-25T22:52:30.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010304384, 2024-04-25T22:52:30.522 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:30.522 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:30.522 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:30.522 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:30.522 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:30.522 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:30.522 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 116 2024-04-25T22:52:30.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.523 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:30.523 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.523 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:30.523 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:30.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:30.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.523 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.523 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:30.524 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:30.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:30.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.524 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:30.524 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:30.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5799999999999999e-07 2024-04-25T22:52:30.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.524 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:30.524 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965154+0000", 2024-04-25T22:52:30.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0009e-05 2024-04-25T22:52:30.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:30.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965164+0000", 2024-04-25T22:52:30.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8490000000000001e-06 2024-04-25T22:52:30.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:30.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965169+0000", 2024-04-25T22:52:30.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0730000000000004e-06 2024-04-25T22:52:30.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:30.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970609+0000", 2024-04-25T22:52:30.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054397689999999997 2024-04-25T22:52:30.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:30.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970651+0000", 2024-04-25T22:52:30.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1873999999999999e-05 2024-04-25T22:52:30.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:30.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970723+0000", 2024-04-25T22:52:30.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2039999999999995e-05 2024-04-25T22:52:30.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:30.527 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971358+0000", 2024-04-25T22:52:30.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063489500000000001 2024-04-25T22:52:30.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.527 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:30.527 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975409+0000", 2024-04-25T22:52:30.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040506880000000002 2024-04-25T22:52:30.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.527 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:30.527 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975432+0000", 2024-04-25T22:52:30.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3315999999999998e-05 2024-04-25T22:52:30.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.528 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:30.528 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975448+0000", 2024-04-25T22:52:30.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6313000000000001e-05 2024-04-25T22:52:30.528 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:30.528 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:30.528 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:30.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.529 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:30.529 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:30.529 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 42.546977214000002, 2024-04-25T22:52:30.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010384338999999999, 2024-04-25T22:52:30.529 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:30.529 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:30.529 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:30.529 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:30.529 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:30.529 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:30.529 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-04-25T22:52:30.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.530 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:30.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:30.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:30.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:30.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:30.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:30.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:30.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:30.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:30.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3600000000000004e-07 2024-04-25T22:52:30.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:30.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965185+0000", 2024-04-25T22:52:30.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.117e-06 2024-04-25T22:52:30.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:30.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965192+0000", 2024-04-25T22:52:30.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3239999999999997e-06 2024-04-25T22:52:30.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.532 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:30.532 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965198+0000", 2024-04-25T22:52:30.532 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6370000000000004e-06 2024-04-25T22:52:30.532 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.532 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.532 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:30.533 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970973+0000", 2024-04-25T22:52:30.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057748239999999996 2024-04-25T22:52:30.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.533 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:30.533 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971049+0000", 2024-04-25T22:52:30.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6029e-05 2024-04-25T22:52:30.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.533 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:30.533 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971174+0000", 2024-04-25T22:52:30.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012462399999999999 2024-04-25T22:52:30.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:30.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971553+0000", 2024-04-25T22:52:30.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037896499999999999 2024-04-25T22:52:30.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:30.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975482+0000", 2024-04-25T22:52:30.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039297459999999996 2024-04-25T22:52:30.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:30.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975529+0000", 2024-04-25T22:52:30.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6387000000000002e-05 2024-04-25T22:52:30.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:30.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975563+0000", 2024-04-25T22:52:30.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4150000000000003e-05 2024-04-25T22:52:30.535 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:30.535 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:30.535 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:30.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.535 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:30.535 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:30.536 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.499930890999998, 2024-04-25T22:52:30.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012637705000000001, 2024-04-25T22:52:30.536 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:30.536 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:30.536 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:30.536 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:30.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.536 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:30.536 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:30.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:30.536 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.536 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:30.536 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:30.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:30.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:30.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012227+0000", 2024-04-25T22:52:30.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.863e-06 2024-04-25T22:52:30.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:30.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012236+0000", 2024-04-25T22:52:30.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1109999999999997e-06 2024-04-25T22:52:30.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:30.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012309+0000", 2024-04-25T22:52:30.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3242000000000001e-05 2024-04-25T22:52:30.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.538 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:30.538 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012324+0000", 2024-04-25T22:52:30.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4837e-05 2024-04-25T22:52:30.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:30.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015060+0000", 2024-04-25T22:52:30.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027363349999999999 2024-04-25T22:52:30.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:30.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015169+0000", 2024-04-25T22:52:30.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108372 2024-04-25T22:52:30.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:30.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015498+0000", 2024-04-25T22:52:30.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032949999999999999 2024-04-25T22:52:30.540 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.540 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:30.540 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021282+0000", 2024-04-25T22:52:30.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057836429999999998 2024-04-25T22:52:30.540 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.540 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:30.540 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024709+0000", 2024-04-25T22:52:30.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034271979999999998 2024-04-25T22:52:30.540 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.540 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:30.540 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024802+0000", 2024-04-25T22:52:30.541 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2960000000000004e-05 2024-04-25T22:52:30.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.541 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.541 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:30.541 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024863+0000", 2024-04-25T22:52:30.541 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0643999999999997e-05 2024-04-25T22:52:30.541 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:30.541 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:30.541 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:30.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.541 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.541 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:30.541 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:30.541 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.49980712, 2024-04-25T22:52:30.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012979447999999999, 2024-04-25T22:52:30.542 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:30.542 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:30.542 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:30.542 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:30.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.542 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:30.542 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:30.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:30.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.542 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:30.542 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:30.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:30.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:30.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:30.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:52:30.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:30.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012354+0000", 2024-04-25T22:52:30.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7740000000000004e-06 2024-04-25T22:52:30.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:30.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012365+0000", 2024-04-25T22:52:30.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.064e-05 2024-04-25T22:52:30.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:30.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012382+0000", 2024-04-25T22:52:30.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6999000000000001e-05 2024-04-25T22:52:30.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:30.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015958+0000", 2024-04-25T22:52:30.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035765699999999998 2024-04-25T22:52:30.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.545 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:30.545 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016037+0000", 2024-04-25T22:52:30.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8242000000000001e-05 2024-04-25T22:52:30.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.545 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:30.545 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016404+0000", 2024-04-25T22:52:30.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036784300000000002 2024-04-25T22:52:30.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.545 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:30.545 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021294+0000", 2024-04-25T22:52:30.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048890629999999999 2024-04-25T22:52:30.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.546 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:30.546 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024959+0000", 2024-04-25T22:52:30.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036651570000000001 2024-04-25T22:52:30.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.546 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:30.546 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025097+0000", 2024-04-25T22:52:30.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013788099999999999 2024-04-25T22:52:30.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.546 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:30.546 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025328+0000", 2024-04-25T22:52:30.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231492 2024-04-25T22:52:30.547 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:30.547 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:30.547 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:30.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.547 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:30.547 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:30.547 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.499719351000003, 2024-04-25T22:52:30.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013049827, 2024-04-25T22:52:30.547 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:30.547 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:30.547 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:30.547 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:30.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.548 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:30.548 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:30.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:30.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.548 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:30.548 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:30.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:30.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.548 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:30.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012437+0000", 2024-04-25T22:52:30.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-04-25T22:52:30.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:30.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012440+0000", 2024-04-25T22:52:30.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7609999999999999e-06 2024-04-25T22:52:30.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:30.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012449+0000", 2024-04-25T22:52:30.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.285e-06 2024-04-25T22:52:30.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:30.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012457+0000", 2024-04-25T22:52:30.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9510000000000006e-06 2024-04-25T22:52:30.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017106+0000", 2024-04-25T22:52:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046494220000000003 2024-04-25T22:52:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017223+0000", 2024-04-25T22:52:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116824 2024-04-25T22:52:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017345+0000", 2024-04-25T22:52:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122175 2024-04-25T22:52:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021299+0000", 2024-04-25T22:52:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039534879999999998 2024-04-25T22:52:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025398+0000", 2024-04-25T22:52:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040988960000000003 2024-04-25T22:52:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025439+0000", 2024-04-25T22:52:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0915999999999999e-05 2024-04-25T22:52:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025486+0000", 2024-04-25T22:52:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7534999999999998e-05 2024-04-25T22:52:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.499689199999999, 2024-04-25T22:52:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020988041999999998, 2024-04-25T22:52:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:30.554 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:30.554 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:30.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:30.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:30.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:30.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.555 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:30.555 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:30.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:30.555 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.555 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.99e-07 2024-04-25T22:52:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012470+0000", 2024-04-25T22:52:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2789999999999999e-06 2024-04-25T22:52:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012477+0000", 2024-04-25T22:52:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:52:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012500+0000", 2024-04-25T22:52:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2490999999999999e-05 2024-04-25T22:52:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021911+0000", 2024-04-25T22:52:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094114160000000006 2024-04-25T22:52:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022000+0000", 2024-04-25T22:52:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8601000000000001e-05 2024-04-25T22:52:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:30.558 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022359+0000", 2024-04-25T22:52:30.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035921999999999999 2024-04-25T22:52:30.558 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.558 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.558 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:30.558 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025541+0000", 2024-04-25T22:52:30.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031820619999999998 2024-04-25T22:52:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033375+0000", 2024-04-25T22:52:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078338379999999992 2024-04-25T22:52:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033415+0000", 2024-04-25T22:52:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9527000000000003e-05 2024-04-25T22:52:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:30.560 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033455+0000", 2024-04-25T22:52:30.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9932000000000003e-05 2024-04-25T22:52:30.560 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:30.560 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:30.560 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:30.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.560 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.560 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:30.560 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:30.561 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.499634006999997, 2024-04-25T22:52:30.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021043857999999999, 2024-04-25T22:52:30.561 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:30.561 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:30.561 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:30.561 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:30.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:30.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:30.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:30.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.562 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:30.562 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:30.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:30.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.562 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.562 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:30.562 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012523+0000", 2024-04-25T22:52:30.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.361e-06 2024-04-25T22:52:30.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.563 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.563 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:30.563 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012530+0000", 2024-04-25T22:52:30.563 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5440000000000004e-06 2024-04-25T22:52:30.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.563 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.563 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:30.563 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012541+0000", 2024-04-25T22:52:30.563 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1745e-05 2024-04-25T22:52:30.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.563 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.563 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:30.563 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012551+0000", 2024-04-25T22:52:30.564 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5789999999999993e-06 2024-04-25T22:52:30.564 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.564 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:30.564 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022709+0000", 2024-04-25T22:52:30.564 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010157685 2024-04-25T22:52:30.564 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.564 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:30.564 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022957+0000", 2024-04-25T22:52:30.564 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024824599999999998 2024-04-25T22:52:30.564 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.564 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:30.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023443+0000", 2024-04-25T22:52:30.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048578599999999999 2024-04-25T22:52:30.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:30.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025547+0000", 2024-04-25T22:52:30.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021044789999999998 2024-04-25T22:52:30.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:30.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033509+0000", 2024-04-25T22:52:30.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0079622180000000001 2024-04-25T22:52:30.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:30.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033542+0000", 2024-04-25T22:52:30.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3018000000000001e-05 2024-04-25T22:52:30.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:30.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033566+0000", 2024-04-25T22:52:30.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3197000000000002e-05 2024-04-25T22:52:30.567 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:30.567 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:30.567 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:30.567 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.567 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.567 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:30.567 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:30.567 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.499594041999998, 2024-04-25T22:52:30.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021122696, 2024-04-25T22:52:30.567 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:30.567 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:30.567 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:30.567 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:30.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.568 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:30.568 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:30.568 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:30.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.568 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:30.568 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:30.568 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:30.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.569 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:30.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:30.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:52:30.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.569 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:30.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012566+0000", 2024-04-25T22:52:30.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-04-25T22:52:30.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.569 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:30.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012619+0000", 2024-04-25T22:52:30.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2607e-05 2024-04-25T22:52:30.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:30.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012628+0000", 2024-04-25T22:52:30.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6500000000000008e-06 2024-04-25T22:52:30.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:30.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024024+0000", 2024-04-25T22:52:30.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011396007999999999 2024-04-25T22:52:30.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:30.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024198+0000", 2024-04-25T22:52:30.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000173215 2024-04-25T22:52:30.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:30.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024447+0000", 2024-04-25T22:52:30.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024898500000000002 2024-04-25T22:52:30.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:30.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026431+0000", 2024-04-25T22:52:30.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001984923 2024-04-25T22:52:30.572 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.572 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.572 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:30.572 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033608+0000", 2024-04-25T22:52:30.572 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071768459999999997 2024-04-25T22:52:30.572 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.572 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.572 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:30.572 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033646+0000", 2024-04-25T22:52:30.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299000000000003e-05 2024-04-25T22:52:30.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:30.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033684+0000", 2024-04-25T22:52:30.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8773000000000003e-05 2024-04-25T22:52:30.573 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:30.573 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:30.573 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:30.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.573 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:30.573 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:30.573 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.499505442999997, 2024-04-25T22:52:30.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021175381, 2024-04-25T22:52:30.574 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:30.574 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:30.574 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:30.574 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:30.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:30.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:30.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:30.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:30.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:30.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:30.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:30.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012651+0000", 2024-04-25T22:52:30.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:52:30.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.576 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:30.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012656+0000", 2024-04-25T22:52:30.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8899999999999998e-06 2024-04-25T22:52:30.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.576 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:30.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012666+0000", 2024-04-25T22:52:30.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0346999999999999e-05 2024-04-25T22:52:30.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:30.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012675+0000", 2024-04-25T22:52:30.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9930000000000001e-06 2024-04-25T22:52:30.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:30.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025661+0000", 2024-04-25T22:52:30.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01298531 2024-04-25T22:52:30.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:30.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025757+0000", 2024-04-25T22:52:30.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5822000000000005e-05 2024-04-25T22:52:30.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:30.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025907+0000", 2024-04-25T22:52:30.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015051499999999999 2024-04-25T22:52:30.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:30.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026435+0000", 2024-04-25T22:52:30.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052762200000000005 2024-04-25T22:52:30.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:30.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033732+0000", 2024-04-25T22:52:30.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072978419999999997 2024-04-25T22:52:30.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:30.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033787+0000", 2024-04-25T22:52:30.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4703999999999997e-05 2024-04-25T22:52:30.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:30.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033826+0000", 2024-04-25T22:52:30.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8458999999999999e-05 2024-04-25T22:52:30.579 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:30.579 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:30.579 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:30.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.580 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:30.580 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:30.580 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.499450029000002, 2024-04-25T22:52:30.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021244174000000001, 2024-04-25T22:52:30.580 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:30.580 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:30.580 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:30.580 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:30.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.580 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:30.580 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:30.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:30.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.581 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.581 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:30.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:30.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:30.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.581 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.581 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:30.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:30.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:52:30.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:30.582 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012712+0000", 2024-04-25T22:52:30.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.913e-06 2024-04-25T22:52:30.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:30.582 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012722+0000", 2024-04-25T22:52:30.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2879999999999998e-06 2024-04-25T22:52:30.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:30.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012727+0000", 2024-04-25T22:52:30.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8429999999999998e-06 2024-04-25T22:52:30.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:30.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026099+0000", 2024-04-25T22:52:30.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013371450999999999 2024-04-25T22:52:30.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:30.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026147+0000", 2024-04-25T22:52:30.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7837999999999998e-05 2024-04-25T22:52:30.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:30.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026254+0000", 2024-04-25T22:52:30.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107314 2024-04-25T22:52:30.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:30.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026686+0000", 2024-04-25T22:52:30.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000432428 2024-04-25T22:52:30.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:30.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033873+0000", 2024-04-25T22:52:30.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071864399999999997 2024-04-25T22:52:30.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:30.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033904+0000", 2024-04-25T22:52:30.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1321e-05 2024-04-25T22:52:30.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:30.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033950+0000", 2024-04-25T22:52:30.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5707999999999997e-05 2024-04-25T22:52:30.585 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:30.585 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:30.585 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:30.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.586 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:30.586 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:30.586 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.499419644, 2024-04-25T22:52:30.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01096505, 2024-04-25T22:52:30.586 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:30.586 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:30.586 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:30.586 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:30.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.586 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:30.586 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:30.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:30.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.587 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:30.587 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:30.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:30.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.587 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:30.587 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012737+0000", 2024-04-25T22:52:30.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:52:30.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.587 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:30.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012739+0000", 2024-04-25T22:52:30.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-04-25T22:52:30.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:30.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012743+0000", 2024-04-25T22:52:30.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3239999999999996e-06 2024-04-25T22:52:30.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:30.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012746+0000", 2024-04-25T22:52:30.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.129e-06 2024-04-25T22:52:30.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:30.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012796+0000", 2024-04-25T22:52:30.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9231999999999999e-05 2024-04-25T22:52:30.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:30.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012915+0000", 2024-04-25T22:52:30.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119021 2024-04-25T22:52:30.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:30.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013069+0000", 2024-04-25T22:52:30.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015463900000000001 2024-04-25T22:52:30.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.590 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.590 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:30.590 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019237+0000", 2024-04-25T22:52:30.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061680329999999998 2024-04-25T22:52:30.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.590 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.590 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:30.590 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023603+0000", 2024-04-25T22:52:30.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043655860000000003 2024-04-25T22:52:30.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.590 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.590 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:30.591 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023659+0000", 2024-04-25T22:52:30.591 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6484000000000003e-05 2024-04-25T22:52:30.591 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.591 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.591 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:30.591 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023701+0000", 2024-04-25T22:52:30.591 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1761999999999998e-05 2024-04-25T22:52:30.591 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:30.591 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:30.591 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:30.591 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.591 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.591 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:30.592 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:30.592 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.499394696000003, 2024-04-25T22:52:30.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011234429000000001, 2024-04-25T22:52:30.592 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:30.592 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:30.592 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:30.592 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:30.592 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.592 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:30.592 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:30.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:30.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.592 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.593 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:30.593 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:30.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:30.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.593 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:30.593 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012762+0000", 2024-04-25T22:52:30.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-04-25T22:52:30.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.593 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:30.593 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012765+0000", 2024-04-25T22:52:30.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2569999999999999e-06 2024-04-25T22:52:30.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:30.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012783+0000", 2024-04-25T22:52:30.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8431999999999999e-05 2024-04-25T22:52:30.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:30.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012799+0000", 2024-04-25T22:52:30.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5438999999999999e-05 2024-04-25T22:52:30.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:30.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013826+0000", 2024-04-25T22:52:30.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010275060000000001 2024-04-25T22:52:30.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.595 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:30.595 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013913+0000", 2024-04-25T22:52:30.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.708e-05 2024-04-25T22:52:30.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.595 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:30.595 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014098+0000", 2024-04-25T22:52:30.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018519399999999999 2024-04-25T22:52:30.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.595 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:30.595 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019684+0000", 2024-04-25T22:52:30.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055860079999999999 2024-04-25T22:52:30.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:30.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023876+0000", 2024-04-25T22:52:30.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041918800000000003 2024-04-25T22:52:30.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:30.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023957+0000", 2024-04-25T22:52:30.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1165e-05 2024-04-25T22:52:30.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:30.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023995+0000", 2024-04-25T22:52:30.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:52:30.597 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:30.597 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:30.597 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:30.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.597 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:30.597 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:30.597 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.499296917000002, 2024-04-25T22:52:30.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011131200000000001, 2024-04-25T22:52:30.597 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:30.597 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:30.597 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:30.597 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:30.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.598 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:30.598 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:30.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:30.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.598 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:30.598 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:30.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:30.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.598 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:30.598 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012860+0000", 2024-04-25T22:52:30.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3900000000000004e-07 2024-04-25T22:52:30.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.599 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:30.599 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012865+0000", 2024-04-25T22:52:30.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5609999999999998e-06 2024-04-25T22:52:30.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.599 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:30.599 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012895+0000", 2024-04-25T22:52:30.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9847000000000001e-05 2024-04-25T22:52:30.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.599 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:30.599 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012905+0000", 2024-04-25T22:52:30.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.03e-05 2024-04-25T22:52:30.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:30.600 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015020+0000", 2024-04-25T22:52:30.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021142940000000001 2024-04-25T22:52:30.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:30.600 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015182+0000", 2024-04-25T22:52:30.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016248099999999999 2024-04-25T22:52:30.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:52:30.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015357+0000", 2024-04-25T22:52:30.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017471000000000001 2024-04-25T22:52:30.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:30.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021021+0000", 2024-04-25T22:52:30.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056638340000000004 2024-04-25T22:52:30.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:30.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023712+0000", 2024-04-25T22:52:30.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026910380000000002 2024-04-25T22:52:30.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:30.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023763+0000", 2024-04-25T22:52:30.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1477999999999997e-05 2024-04-25T22:52:30.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:30.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023990+0000", 2024-04-25T22:52:30.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000226818 2024-04-25T22:52:30.602 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:30.602 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:30.602 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:30.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.603 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:30.605 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:30.605 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.499173820999999, 2024-04-25T22:52:30.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011705299000000001, 2024-04-25T22:52:30.606 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:30.606 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:30.606 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:30.606 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:30.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:30.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:30.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:30.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:30.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:30.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:30.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.607 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:30.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012983+0000", 2024-04-25T22:52:30.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:52:30.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.607 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:30.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012986+0000", 2024-04-25T22:52:30.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5700000000000001e-06 2024-04-25T22:52:30.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.607 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:30.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012993+0000", 2024-04-25T22:52:30.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8730000000000001e-06 2024-04-25T22:52:30.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:30.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013000+0000", 2024-04-25T22:52:30.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1890000000000001e-06 2024-04-25T22:52:30.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:30.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:52:30.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002147866 2024-04-25T22:52:30.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:30.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015351+0000", 2024-04-25T22:52:30.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020300799999999999 2024-04-25T22:52:30.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:30.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016260+0000", 2024-04-25T22:52:30.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00090926799999999997 2024-04-25T22:52:30.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:30.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022669+0000", 2024-04-25T22:52:30.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064082849999999997 2024-04-25T22:52:30.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:30.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024584+0000", 2024-04-25T22:52:30.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019151699999999999 2024-04-25T22:52:30.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:30.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024643+0000", 2024-04-25T22:52:30.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8888999999999998e-05 2024-04-25T22:52:30.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:30.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024687+0000", 2024-04-25T22:52:30.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4444999999999999e-05 2024-04-25T22:52:30.611 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:30.611 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:30.611 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:30.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.611 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:30.611 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:30.611 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.499146230000001, 2024-04-25T22:52:30.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011249699, 2024-04-25T22:52:30.611 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:30.611 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:30.611 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:30.611 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:30.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:30.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:30.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:30.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:30.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:30.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:30.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:30.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013010+0000", 2024-04-25T22:52:30.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2099999999999996e-07 2024-04-25T22:52:30.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.613 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:30.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013013+0000", 2024-04-25T22:52:30.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1310000000000002e-06 2024-04-25T22:52:30.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.613 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:30.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013020+0000", 2024-04-25T22:52:30.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3330000000000002e-06 2024-04-25T22:52:30.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.613 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:30.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013025+0000", 2024-04-25T22:52:30.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6760000000000004e-06 2024-04-25T22:52:30.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.614 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:30.614 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013163+0000", 2024-04-25T22:52:30.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013824599999999999 2024-04-25T22:52:30.614 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.614 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:30.614 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013504+0000", 2024-04-25T22:52:30.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034080299999999998 2024-04-25T22:52:30.614 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.614 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:30.614 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013613+0000", 2024-04-25T22:52:30.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108705 2024-04-25T22:52:30.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:30.615 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015831+0000", 2024-04-25T22:52:30.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002217672 2024-04-25T22:52:30.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:30.615 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024137+0000", 2024-04-25T22:52:30.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0083060489999999994 2024-04-25T22:52:30.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:30.615 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024218+0000", 2024-04-25T22:52:30.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1351000000000001e-05 2024-04-25T22:52:30.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:30.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024259+0000", 2024-04-25T22:52:30.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1112000000000002e-05 2024-04-25T22:52:30.616 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:30.616 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:30.616 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:30.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.616 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:30.616 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:30.616 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.499058503999997, 2024-04-25T22:52:30.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020379749999999999, 2024-04-25T22:52:30.617 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:30.617 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:30.617 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:30.617 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:30.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:30.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:30.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:30.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:30.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:30.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:30.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:30.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013098+0000", 2024-04-25T22:52:30.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:52:30.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:30.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013105+0000", 2024-04-25T22:52:30.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5969999999999997e-06 2024-04-25T22:52:30.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:30.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013190+0000", 2024-04-25T22:52:30.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5618999999999995e-05 2024-04-25T22:52:30.619 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.619 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:30.619 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013200+0000", 2024-04-25T22:52:30.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5859999999999994e-06 2024-04-25T22:52:30.619 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.619 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:30.619 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020265+0000", 2024-04-25T22:52:30.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070653349999999998 2024-04-25T22:52:30.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.620 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:30.620 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020454+0000", 2024-04-25T22:52:30.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189316 2024-04-25T22:52:30.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.620 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:30.620 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020586+0000", 2024-04-25T22:52:30.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013195700000000001 2024-04-25T22:52:30.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:30.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023822+0000", 2024-04-25T22:52:30.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032358529999999999 2024-04-25T22:52:30.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:30.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033409+0000", 2024-04-25T22:52:30.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095870520000000004 2024-04-25T22:52:30.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:30.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033447+0000", 2024-04-25T22:52:30.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7261999999999997e-05 2024-04-25T22:52:30.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:30.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033477+0000", 2024-04-25T22:52:30.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0389e-05 2024-04-25T22:52:30.622 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:30.622 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:30.622 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:30.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.622 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:30.622 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:30.622 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.498941997999999, 2024-04-25T22:52:30.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010857383999999999, 2024-04-25T22:52:30.622 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:30.623 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:30.623 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:30.623 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:30.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:30.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:30.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:30.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:30.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:30.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:30.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:30.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:30.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:52:30.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:30.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013218+0000", 2024-04-25T22:52:30.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8199999999999998e-06 2024-04-25T22:52:30.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:30.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013226+0000", 2024-04-25T22:52:30.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7649999999999993e-06 2024-04-25T22:52:30.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.625 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:30.625 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013259+0000", 2024-04-25T22:52:30.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2727e-05 2024-04-25T22:52:30.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.625 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:30.625 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014809+0000", 2024-04-25T22:52:30.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001550144 2024-04-25T22:52:30.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.625 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:30.625 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014958+0000", 2024-04-25T22:52:30.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014890300000000001 2024-04-25T22:52:30.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:52:30.626 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015087+0000", 2024-04-25T22:52:30.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012939200000000001 2024-04-25T22:52:30.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:30.626 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020212+0000", 2024-04-25T22:52:30.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051248939999999996 2024-04-25T22:52:30.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:30.626 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023699+0000", 2024-04-25T22:52:30.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034873289999999999 2024-04-25T22:52:30.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.627 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:30.627 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024014+0000", 2024-04-25T22:52:30.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031473999999999999 2024-04-25T22:52:30.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.627 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:30.627 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024071+0000", 2024-04-25T22:52:30.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7040000000000003e-05 2024-04-25T22:52:30.627 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:30.627 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:30.627 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:30.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.628 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:30.628 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:30.628 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.498887293000003, 2024-04-25T22:52:30.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012329677000000001, 2024-04-25T22:52:30.628 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:30.628 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:30.628 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:30.628 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:30.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:30.628 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:30.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:30.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:30.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:30.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:30.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:30.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013269+0000", 2024-04-25T22:52:30.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5000000000000002e-07 2024-04-25T22:52:30.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:30.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:52:30.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6909999999999999e-06 2024-04-25T22:52:30.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:30.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013284+0000", 2024-04-25T22:52:30.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0963e-05 2024-04-25T22:52:30.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:30.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013361+0000", 2024-04-25T22:52:30.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7379999999999994e-05 2024-04-25T22:52:30.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:30.631 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013448+0000", 2024-04-25T22:52:30.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6990000000000006e-05 2024-04-25T22:52:30.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.631 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.631 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:30.631 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013632+0000", 2024-04-25T22:52:30.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018396800000000001 2024-04-25T22:52:30.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.631 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.631 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:30.631 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013800+0000", 2024-04-25T22:52:30.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167467 2024-04-25T22:52:30.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.632 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:30.632 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.018570+0000", 2024-04-25T22:52:30.632 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047701460000000003 2024-04-25T22:52:30.632 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.632 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:30.632 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025507+0000", 2024-04-25T22:52:30.632 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069372039999999998 2024-04-25T22:52:30.632 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.632 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:30.632 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025562+0000", 2024-04-25T22:52:30.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4858999999999998e-05 2024-04-25T22:52:30.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:30.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025598+0000", 2024-04-25T22:52:30.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6259e-05 2024-04-25T22:52:30.633 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:30.633 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:30.633 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:30.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.633 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:30.633 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:30.634 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.498755420000002, 2024-04-25T22:52:30.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020176666999999999, 2024-04-25T22:52:30.634 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:30.634 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:30.634 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:52:30.634 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:30.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:30.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:30.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:30.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:30.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:30.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:30.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.635 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:30.635 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:52:30.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-04-25T22:52:30.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.635 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:30.635 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013405+0000", 2024-04-25T22:52:30.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0559999999999998e-06 2024-04-25T22:52:30.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.636 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:30.636 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013422+0000", 2024-04-25T22:52:30.636 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6770999999999999e-05 2024-04-25T22:52:30.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.636 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:30.636 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013431+0000", 2024-04-25T22:52:30.636 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5019999999999998e-06 2024-04-25T22:52:30.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.636 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:30.636 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021720+0000", 2024-04-25T22:52:30.636 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082884340000000008 2024-04-25T22:52:30.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.637 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.637 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:30.637 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022122+0000", 2024-04-25T22:52:30.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000401634 2024-04-25T22:52:30.637 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:30.637 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:30.637 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:30.637 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033577+0000", 2024-04-25T22:52:30.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011455435999999999 2024-04-25T22:52:30.637 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:30.637 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:30.637 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:30.637 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:30.637 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:30.638 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:30.639 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:52:30.640 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:30.639+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:30.739 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:30.738+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:30.749 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-25T22:52:30.749 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-25T22:52:30.749 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-25T22:52:30.749 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-25T22:52:30.758 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:52:30.840 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:30.840+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:30.860 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-25T22:52:30.860 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-25T22:52:30.860 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-25T22:52:30.860 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-25T22:52:30.860 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-25T22:52:30.869 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:52:30.941 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:30.941+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:30.973 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-25T22:52:30.973 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-25T22:52:30.974 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-25T22:52:30.974 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-25T22:52:30.974 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:30.974 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(mds.0.3:28 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:52:30.974 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.013845+0000", 2024-04-25T22:52:30.975 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 37.957073012999999, 2024-04-25T22:52:30.975 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002002658, 2024-04-25T22:52:30.975 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:30.975 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:30.975 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:30.975 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:30.975 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:30.976 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:30.976 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013845+0000", 2024-04-25T22:52:30.976 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:30.976 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:30.976 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:30.976 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:30.976 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013845+0000", 2024-04-25T22:52:30.977 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:30.977 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:30.977 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:30.977 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:30.977 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013845+0000", 2024-04-25T22:52:30.979 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6100000000000002e-07 2024-04-25T22:52:30.979 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:30.979 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:30.979 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:30.979 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013859+0000", 2024-04-25T22:52:30.980 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4045e-05 2024-04-25T22:52:30.980 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:30.980 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:30.980 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:30.980 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013883+0000", 2024-04-25T22:52:30.980 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4020999999999999e-05 2024-04-25T22:52:30.981 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:30.981 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:30.981 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:30.981 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013904+0000", 2024-04-25T22:52:30.981 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.084e-05 2024-04-25T22:52:30.981 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:30.982 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:30.982 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:30.982 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013953+0000", 2024-04-25T22:52:30.982 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8652000000000001e-05 2024-04-25T22:52:30.982 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:30.982 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:30.983 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:30.983 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013983+0000", 2024-04-25T22:52:30.983 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0083e-05 2024-04-25T22:52:30.983 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:30.983 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:30.983 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:30.983 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015809+0000", 2024-04-25T22:52:30.984 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001826708 2024-04-25T22:52:30.984 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:30.984 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:30.984 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:30.984 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015848+0000", 2024-04-25T22:52:30.984 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8047999999999999e-05 2024-04-25T22:52:30.984 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:30.984 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:30.984 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:30.984 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:30.984 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:30.984 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:30.984 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.014834+0000", 2024-04-25T22:52:30.985 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 37.956083417999999, 2024-04-25T22:52:30.985 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0082660119999999997, 2024-04-25T22:52:30.985 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:30.985 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:30.985 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:30.985 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:30.985 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:30.985 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:30.985 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014834+0000", 2024-04-25T22:52:30.985 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:30.985 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:30.985 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:30.985 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:30.985 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014834+0000", 2024-04-25T22:52:30.985 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:30.986 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:30.986 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:30.986 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:30.986 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014837+0000", 2024-04-25T22:52:30.986 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.774e-06 2024-04-25T22:52:30.986 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:30.986 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:30.986 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:30.986 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014844+0000", 2024-04-25T22:52:30.986 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.1629999999999999e-06 2024-04-25T22:52:30.986 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:30.986 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:30.986 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:30.986 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014853+0000", 2024-04-25T22:52:30.987 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0829999999999993e-06 2024-04-25T22:52:30.987 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:30.987 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:30.987 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:30.987 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014862+0000", 2024-04-25T22:52:30.987 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0239999999999997e-06 2024-04-25T22:52:30.987 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:30.987 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:30.987 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:30.987 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014926+0000", 2024-04-25T22:52:30.987 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4571000000000002e-05 2024-04-25T22:52:30.987 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:30.987 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:30.987 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:30.988 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015064+0000", 2024-04-25T22:52:30.988 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013788200000000001 2024-04-25T22:52:30.988 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:30.988 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:30.988 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:30.988 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015240+0000", 2024-04-25T22:52:30.988 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000175697 2024-04-25T22:52:30.988 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:30.988 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:30.988 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:30.988 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017382+0000", 2024-04-25T22:52:30.988 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021422920000000001 2024-04-25T22:52:30.988 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:30.988 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:30.988 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:30.989 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023016+0000", 2024-04-25T22:52:30.989 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00563446 2024-04-25T22:52:30.989 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:30.989 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:30.989 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:30.989 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023062+0000", 2024-04-25T22:52:30.989 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5667999999999997e-05 2024-04-25T22:52:30.989 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:30.989 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:30.989 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:30.989 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023100+0000", 2024-04-25T22:52:30.989 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8398000000000001e-05 2024-04-25T22:52:30.989 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:30.989 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:30.990 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:30.990 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:30.990 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:30.990 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:30.990 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.014883+0000", 2024-04-25T22:52:30.990 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 37.956035200000002, 2024-04-25T22:52:30.990 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0083115319999999999, 2024-04-25T22:52:30.990 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:30.990 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:30.990 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:30.990 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:30.990 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:30.990 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:30.990 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014883+0000", 2024-04-25T22:52:30.991 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:30.991 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:30.991 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:30.991 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:30.991 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014883+0000", 2024-04-25T22:52:30.991 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:30.991 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:30.991 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:30.991 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:30.991 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014883+0000", 2024-04-25T22:52:30.991 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1200000000000003e-07 2024-04-25T22:52:30.991 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:30.991 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:30.991 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:30.991 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014887+0000", 2024-04-25T22:52:30.992 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4249999999999998e-06 2024-04-25T22:52:30.992 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:30.992 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:30.992 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:30.992 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014892+0000", 2024-04-25T22:52:30.992 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1150000000000002e-06 2024-04-25T22:52:30.992 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:30.992 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:30.992 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:30.992 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014896+0000", 2024-04-25T22:52:30.992 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3030000000000001e-06 2024-04-25T22:52:30.992 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:30.992 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:30.992 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:30.993 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015597+0000", 2024-04-25T22:52:30.993 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00070106400000000005 2024-04-25T22:52:30.993 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:30.993 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:30.993 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:30.993 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015681+0000", 2024-04-25T22:52:30.993 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.3417000000000004e-05 2024-04-25T22:52:30.993 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:30.993 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:30.993 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:30.993 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015800+0000", 2024-04-25T22:52:30.993 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000119522 2024-04-25T22:52:30.993 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:30.993 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:30.993 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:30.994 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017389+0000", 2024-04-25T22:52:30.994 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0015889739999999999 2024-04-25T22:52:30.994 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:30.994 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:30.994 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:30.994 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023129+0000", 2024-04-25T22:52:30.994 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0057398420000000002 2024-04-25T22:52:30.994 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:30.994 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:30.994 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:30.994 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023161+0000", 2024-04-25T22:52:30.994 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2002999999999998e-05 2024-04-25T22:52:30.994 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:30.995 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:30.995 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:30.995 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023194+0000", 2024-04-25T22:52:30.995 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3355000000000002e-05 2024-04-25T22:52:30.995 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:30.995 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:30.995 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:30.995 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:30.995 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:30.995 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:30.995 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.014902+0000", 2024-04-25T22:52:30.995 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 37.956015555, 2024-04-25T22:52:30.995 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0078159460000000007, 2024-04-25T22:52:30.995 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:30.996 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:30.996 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:30.996 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:30.996 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:30.996 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:30.996 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014902+0000", 2024-04-25T22:52:30.996 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:30.996 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:30.996 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:30.996 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:30.996 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014902+0000", 2024-04-25T22:52:30.997 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:30.997 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:30.997 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:30.997 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:30.997 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014903+0000", 2024-04-25T22:52:30.997 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.65e-07 2024-04-25T22:52:30.997 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:30.997 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:30.997 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:30.997 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014910+0000", 2024-04-25T22:52:30.997 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7619999999999995e-06 2024-04-25T22:52:30.997 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:30.997 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:30.998 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:30.998 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014915+0000", 2024-04-25T22:52:30.998 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2660000000000003e-06 2024-04-25T22:52:30.998 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:30.998 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:30.998 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:30.998 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014918+0000", 2024-04-25T22:52:30.998 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.331e-06 2024-04-25T22:52:30.998 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:30.998 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:30.998 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:30.998 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015554+0000", 2024-04-25T22:52:30.998 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00063627599999999996 2024-04-25T22:52:30.998 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:30.999 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:30.999 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:30.999 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015685+0000", 2024-04-25T22:52:30.999 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013059399999999999 2024-04-25T22:52:30.999 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:30.999 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:30.999 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:30.999 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015820+0000", 2024-04-25T22:52:30.999 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013471499999999999 2024-04-25T22:52:30.999 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:30.999 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:30.999 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:30.999 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017394+0000", 2024-04-25T22:52:30.999 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0015747459999999999 2024-04-25T22:52:31.000 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.000 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.000 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:31.000 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022598+0000", 2024-04-25T22:52:31.000 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.005203811 2024-04-25T22:52:31.000 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.000 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.000 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:31.000 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022671+0000", 2024-04-25T22:52:31.000 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3042999999999998e-05 2024-04-25T22:52:31.000 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.000 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.000 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:31.000 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022718+0000", 2024-04-25T22:52:31.001 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7136999999999999e-05 2024-04-25T22:52:31.001 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:31.001 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:31.001 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:31.001 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.001 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.001 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:31.001 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.014933+0000", 2024-04-25T22:52:31.001 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 37.955985181000003, 2024-04-25T22:52:31.001 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079271519999999998, 2024-04-25T22:52:31.001 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:31.001 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:31.001 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:31.001 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:31.002 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.002 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:31.002 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014933+0000", 2024-04-25T22:52:31.002 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:31.002 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.002 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.002 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:31.002 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014933+0000", 2024-04-25T22:52:31.002 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:31.002 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.002 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.002 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:31.002 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014933+0000", 2024-04-25T22:52:31.002 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0999999999999999e-07 2024-04-25T22:52:31.003 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.003 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.003 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:31.003 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014937+0000", 2024-04-25T22:52:31.003 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6090000000000001e-06 2024-04-25T22:52:31.003 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.003 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.003 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:31.003 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014943+0000", 2024-04-25T22:52:31.003 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.7100000000000001e-06 2024-04-25T22:52:31.003 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.003 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.003 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:31.003 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014949+0000", 2024-04-25T22:52:31.004 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9410000000000004e-06 2024-04-25T22:52:31.004 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.004 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.004 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:31.004 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016135+0000", 2024-04-25T22:52:31.004 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0011854750000000001 2024-04-25T22:52:31.004 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.004 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.004 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:31.004 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016185+0000", 2024-04-25T22:52:31.004 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.9888000000000001e-05 2024-04-25T22:52:31.004 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.004 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.004 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:31.004 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016297+0000", 2024-04-25T22:52:31.005 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011231299999999999 2024-04-25T22:52:31.005 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.005 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.005 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:31.005 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017399+0000", 2024-04-25T22:52:31.005 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0011018149999999999 2024-04-25T22:52:31.005 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.005 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.005 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:31.005 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022764+0000", 2024-04-25T22:52:31.005 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0053649819999999999 2024-04-25T22:52:31.005 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.005 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.006 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:31.006 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022821+0000", 2024-04-25T22:52:31.006 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7655000000000003e-05 2024-04-25T22:52:31.006 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.006 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.006 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:31.006 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022860+0000", 2024-04-25T22:52:31.006 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8353999999999999e-05 2024-04-25T22:52:31.006 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:31.006 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:31.006 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:31.006 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.006 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.006 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:31.007 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.014957+0000", 2024-04-25T22:52:31.007 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 37.955961350000003, 2024-04-25T22:52:31.007 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0083856810000000007, 2024-04-25T22:52:31.007 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:31.007 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:31.007 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:31.007 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:31.007 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.007 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:31.007 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014957+0000", 2024-04-25T22:52:31.007 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:31.007 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.008 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.008 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:31.008 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014957+0000", 2024-04-25T22:52:31.008 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:31.008 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.008 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.008 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:31.008 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014957+0000", 2024-04-25T22:52:31.008 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:52:31.008 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.008 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.008 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:31.008 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014961+0000", 2024-04-25T22:52:31.008 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2309999999999998e-06 2024-04-25T22:52:31.009 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.009 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.009 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:31.009 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014969+0000", 2024-04-25T22:52:31.009 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2540000000000003e-06 2024-04-25T22:52:31.009 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.009 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.009 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:31.009 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014972+0000", 2024-04-25T22:52:31.009 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4580000000000002e-06 2024-04-25T22:52:31.009 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.009 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.009 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:31.009 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016130+0000", 2024-04-25T22:52:31.010 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001157812 2024-04-25T22:52:31.010 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.010 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.010 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:31.010 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016247+0000", 2024-04-25T22:52:31.010 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000117268 2024-04-25T22:52:31.010 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.010 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.010 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:31.010 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016381+0000", 2024-04-25T22:52:31.010 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013417999999999999 2024-04-25T22:52:31.010 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.010 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.010 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:31.011 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017946+0000", 2024-04-25T22:52:31.011 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001564817 2024-04-25T22:52:31.014 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.014 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.014 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:31.014 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023240+0000", 2024-04-25T22:52:31.014 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0052938289999999999 2024-04-25T22:52:31.014 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.014 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.014 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:31.014 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023295+0000", 2024-04-25T22:52:31.014 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4969999999999997e-05 2024-04-25T22:52:31.014 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.014 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.014 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:31.014 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023342+0000", 2024-04-25T22:52:31.015 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7126000000000002e-05 2024-04-25T22:52:31.015 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:31.015 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:31.015 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:31.015 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.015 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.015 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:31.015 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.014978+0000", 2024-04-25T22:52:31.015 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 37.955940232000003, 2024-04-25T22:52:31.015 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0074058609999999997, 2024-04-25T22:52:31.015 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:31.015 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:31.015 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:31.015 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:31.016 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.016 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:31.016 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014978+0000", 2024-04-25T22:52:31.016 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:31.016 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.016 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.016 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:31.016 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014978+0000", 2024-04-25T22:52:31.016 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:31.016 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.016 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.016 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:31.016 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014978+0000", 2024-04-25T22:52:31.016 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0600000000000001e-07 2024-04-25T22:52:31.017 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.017 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.017 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:31.017 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014980+0000", 2024-04-25T22:52:31.017 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3130000000000001e-06 2024-04-25T22:52:31.017 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.017 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.017 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:31.017 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014984+0000", 2024-04-25T22:52:31.017 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6689999999999999e-06 2024-04-25T22:52:31.017 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.017 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.017 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:31.017 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014987+0000", 2024-04-25T22:52:31.018 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0709999999999999e-06 2024-04-25T22:52:31.018 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.018 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.018 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:31.018 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015035+0000", 2024-04-25T22:52:31.018 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7737000000000001e-05 2024-04-25T22:52:31.018 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.018 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.018 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:31.018 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:52:31.018 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113053 2024-04-25T22:52:31.018 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.018 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.018 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:31.018 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015255+0000", 2024-04-25T22:52:31.019 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010735599999999999 2024-04-25T22:52:31.019 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.019 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.019 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:31.019 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016248+0000", 2024-04-25T22:52:31.019 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00099310200000000005 2024-04-25T22:52:31.019 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.019 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.019 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:31.019 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022282+0000", 2024-04-25T22:52:31.019 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060341769999999999 2024-04-25T22:52:31.019 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.019 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.019 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:31.020 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022341+0000", 2024-04-25T22:52:31.020 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8938999999999999e-05 2024-04-25T22:52:31.020 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.020 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.020 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:31.020 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022384+0000", 2024-04-25T22:52:31.020 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2138000000000002e-05 2024-04-25T22:52:31.020 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:31.020 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:31.020 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:31.020 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.020 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.020 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:31.020 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.014995+0000", 2024-04-25T22:52:31.020 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 37.955922489000002, 2024-04-25T22:52:31.021 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075678170000000001, 2024-04-25T22:52:31.021 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:31.021 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:31.021 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-25T22:52:31.021 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:31.021 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.021 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:31.021 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014995+0000", 2024-04-25T22:52:31.021 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:31.021 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.021 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.021 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:31.021 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014995+0000", 2024-04-25T22:52:31.021 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:31.022 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.022 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.022 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:31.022 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014996+0000", 2024-04-25T22:52:31.022 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7500000000000001e-07 2024-04-25T22:52:31.022 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.022 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.022 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:31.022 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014998+0000", 2024-04-25T22:52:31.022 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2330000000000001e-06 2024-04-25T22:52:31.022 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.022 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.022 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:31.023 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015002+0000", 2024-04-25T22:52:31.023 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9570000000000004e-06 2024-04-25T22:52:31.023 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.023 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.023 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:31.023 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015008+0000", 2024-04-25T22:52:31.023 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0340000000000002e-06 2024-04-25T22:52:31.023 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.023 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.023 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:31.023 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015476+0000", 2024-04-25T22:52:31.023 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00046806899999999999 2024-04-25T22:52:31.023 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.023 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.024 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:31.024 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015565+0000", 2024-04-25T22:52:31.024 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.9126e-05 2024-04-25T22:52:31.024 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.024 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.024 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:31.024 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022563+0000", 2024-04-25T22:52:31.024 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0069981230000000002 2024-04-25T22:52:31.024 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:31.024 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:31.024 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:31.024 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.024 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.024 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:31.025 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.015033+0000", 2024-04-25T22:52:31.025 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 37.955884435000002, 2024-04-25T22:52:31.025 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010204922999999999, 2024-04-25T22:52:31.025 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:31.025 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:31.025 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-25T22:52:31.025 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:31.025 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.025 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:31.025 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015033+0000", 2024-04-25T22:52:31.025 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:31.025 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.025 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.025 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:31.026 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015033+0000", 2024-04-25T22:52:31.026 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:31.026 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.026 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.026 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:31.026 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015036+0000", 2024-04-25T22:52:31.026 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9110000000000002e-06 2024-04-25T22:52:31.026 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.026 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.026 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:31.026 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015040+0000", 2024-04-25T22:52:31.026 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0570000000000003e-06 2024-04-25T22:52:31.026 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.026 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.027 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:31.027 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015050+0000", 2024-04-25T22:52:31.027 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1449999999999997e-06 2024-04-25T22:52:31.027 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.027 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.027 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:31.027 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015058+0000", 2024-04-25T22:52:31.027 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.3960000000000006e-06 2024-04-25T22:52:31.027 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.027 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.027 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:31.027 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016951+0000", 2024-04-25T22:52:31.027 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0018930150000000001 2024-04-25T22:52:31.027 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.028 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.028 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:31.028 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017101+0000", 2024-04-25T22:52:31.028 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00015004800000000001 2024-04-25T22:52:31.028 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.028 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.028 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:31.028 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.025238+0000", 2024-04-25T22:52:31.028 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0081373509999999993 2024-04-25T22:52:31.028 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:31.028 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:31.028 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:31.028 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.028 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.028 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:31.029 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.015069+0000", 2024-04-25T22:52:31.029 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 37.955848500999998, 2024-04-25T22:52:31.029 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0066281769999999999, 2024-04-25T22:52:31.029 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:31.029 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:31.029 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-25T22:52:31.029 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:31.029 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.029 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:31.029 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015069+0000", 2024-04-25T22:52:31.029 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:31.029 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.029 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.029 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:31.030 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015069+0000", 2024-04-25T22:52:31.030 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:31.030 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.030 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.030 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:31.030 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015070+0000", 2024-04-25T22:52:31.030 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8899999999999999e-07 2024-04-25T22:52:31.030 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.030 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.030 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:31.030 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015082+0000", 2024-04-25T22:52:31.030 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.164e-05 2024-04-25T22:52:31.030 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.031 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.031 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:31.031 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015093+0000", 2024-04-25T22:52:31.031 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1066e-05 2024-04-25T22:52:31.031 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.031 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.031 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:31.031 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015099+0000", 2024-04-25T22:52:31.031 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8619999999999999e-06 2024-04-25T22:52:31.031 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.031 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.031 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:31.031 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:52:31.031 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.9821000000000003e-05 2024-04-25T22:52:31.032 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.032 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.032 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:31.032 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015221+0000", 2024-04-25T22:52:31.032 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2868999999999996e-05 2024-04-25T22:52:31.032 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.032 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.032 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:31.032 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021698+0000", 2024-04-25T22:52:31.032 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064762300000000004 2024-04-25T22:52:31.032 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:31.032 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:31.032 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:31.032 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.033 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.033 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:52:31.033 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.016597+0000", 2024-04-25T22:52:31.033 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 37.954320858999999, 2024-04-25T22:52:31.033 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001422113, 2024-04-25T22:52:31.033 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:31.033 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:31.033 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:31.033 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:31.033 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.033 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:31.033 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016597+0000", 2024-04-25T22:52:31.033 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:31.033 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.034 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.034 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:31.034 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016597+0000", 2024-04-25T22:52:31.034 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:31.034 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.034 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.034 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:31.034 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016598+0000", 2024-04-25T22:52:31.034 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2900000000000004e-07 2024-04-25T22:52:31.034 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.034 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.034 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:31.034 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016616+0000", 2024-04-25T22:52:31.034 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8876e-05 2024-04-25T22:52:31.034 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.035 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.035 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:31.035 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016626+0000", 2024-04-25T22:52:31.035 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.8900000000000002e-06 2024-04-25T22:52:31.035 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.035 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.035 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:31.035 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016634+0000", 2024-04-25T22:52:31.035 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7060000000000004e-06 2024-04-25T22:52:31.035 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.035 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.035 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:31.035 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016706+0000", 2024-04-25T22:52:31.035 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2102999999999997e-05 2024-04-25T22:52:31.036 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.036 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.036 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:31.036 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016727+0000", 2024-04-25T22:52:31.036 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0687e-05 2024-04-25T22:52:31.036 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.036 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.036 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:31.036 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017972+0000", 2024-04-25T22:52:31.036 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0012454829999999999 2024-04-25T22:52:31.036 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.036 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.036 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:31.037 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.018019+0000", 2024-04-25T22:52:31.037 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6839000000000003e-05 2024-04-25T22:52:31.037 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:31.037 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:31.037 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:31.037 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.037 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.037 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-25T22:52:31.037 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.016652+0000", 2024-04-25T22:52:31.037 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 37.954266244999999, 2024-04-25T22:52:31.037 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004473599, 2024-04-25T22:52:31.037 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:31.037 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:31.038 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:31.038 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:31.038 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.038 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:31.038 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016652+0000", 2024-04-25T22:52:31.038 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:31.038 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.038 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.038 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:31.038 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016652+0000", 2024-04-25T22:52:31.038 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:31.038 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.038 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.038 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:31.039 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016652+0000", 2024-04-25T22:52:31.039 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1899999999999998e-07 2024-04-25T22:52:31.039 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.039 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.039 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:31.039 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016657+0000", 2024-04-25T22:52:31.039 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4680000000000003e-06 2024-04-25T22:52:31.039 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.039 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.039 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:31.039 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016664+0000", 2024-04-25T22:52:31.039 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8210000000000002e-06 2024-04-25T22:52:31.039 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.039 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.039 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:31.040 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016669+0000", 2024-04-25T22:52:31.040 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8520000000000003e-06 2024-04-25T22:52:31.040 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.040 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.040 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:31.040 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016779+0000", 2024-04-25T22:52:31.040 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000109444 2024-04-25T22:52:31.040 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.040 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.040 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:31.040 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016798+0000", 2024-04-25T22:52:31.040 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9799000000000001e-05 2024-04-25T22:52:31.040 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.040 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.041 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:31.041 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021086+0000", 2024-04-25T22:52:31.041 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042879889999999999 2024-04-25T22:52:31.041 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.041 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.041 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:31.041 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021125+0000", 2024-04-25T22:52:31.041 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8807000000000003e-05 2024-04-25T22:52:31.041 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:31.041 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:31.041 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:31.041 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.041 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.041 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-25T22:52:31.041 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.016733+0000", 2024-04-25T22:52:31.042 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 37.954185346000003, 2024-04-25T22:52:31.042 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004231612, 2024-04-25T22:52:31.042 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:31.042 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:31.042 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:31.042 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:31.042 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.042 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:31.042 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016733+0000", 2024-04-25T22:52:31.042 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:31.042 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.042 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.042 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:31.042 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016733+0000", 2024-04-25T22:52:31.043 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:31.043 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.043 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.043 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:31.043 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016733+0000", 2024-04-25T22:52:31.043 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2100000000000002e-07 2024-04-25T22:52:31.043 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.043 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.043 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:31.043 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016756+0000", 2024-04-25T22:52:31.043 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2886000000000001e-05 2024-04-25T22:52:31.043 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.043 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.043 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:31.044 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016765+0000", 2024-04-25T22:52:31.044 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.3610000000000007e-06 2024-04-25T22:52:31.044 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.044 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.044 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:31.044 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016771+0000", 2024-04-25T22:52:31.044 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0020000000000003e-06 2024-04-25T22:52:31.044 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.044 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.044 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:31.044 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017050+0000", 2024-04-25T22:52:31.044 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00027877199999999999 2024-04-25T22:52:31.044 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.044 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.044 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:31.045 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017067+0000", 2024-04-25T22:52:31.045 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7499e-05 2024-04-25T22:52:31.045 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.045 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.045 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:31.045 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.020921+0000", 2024-04-25T22:52:31.045 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003853123 2024-04-25T22:52:31.045 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.045 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.045 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:31.045 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.020964+0000", 2024-04-25T22:52:31.045 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3547999999999997e-05 2024-04-25T22:52:31.045 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:31.045 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:31.045 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:31.046 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.046 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.046 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 1 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:52:31.046 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.019562+0000", 2024-04-25T22:52:31.046 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 37.951356302000001, 2024-04-25T22:52:31.046 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0045866930000000002, 2024-04-25T22:52:31.046 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:31.046 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:31.046 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "reached pg", 2024-04-25T22:52:31.046 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:31.046 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.046 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:31.046 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.019562+0000", 2024-04-25T22:52:31.046 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:31.047 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.047 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.047 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:31.047 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.019562+0000", 2024-04-25T22:52:31.047 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:31.047 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.047 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.047 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:31.047 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.019562+0000", 2024-04-25T22:52:31.047 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0100000000000005e-07 2024-04-25T22:52:31.047 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.047 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.047 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:31.048 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.019570+0000", 2024-04-25T22:52:31.048 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5599999999999996e-06 2024-04-25T22:52:31.048 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.048 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.048 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:31.048 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.019586+0000", 2024-04-25T22:52:31.048 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6086000000000002e-05 2024-04-25T22:52:31.048 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.048 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.048 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:31.048 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.019600+0000", 2024-04-25T22:52:31.048 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3934000000000001e-05 2024-04-25T22:52:31.048 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.048 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.048 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:31.049 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.019889+0000", 2024-04-25T22:52:31.049 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00028888200000000002 2024-04-25T22:52:31.049 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.049 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.049 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:31.049 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.024148+0000", 2024-04-25T22:52:31.049 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042597299999999998 2024-04-25T22:52:31.049 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:31.049 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:31.049 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:31.049 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.049 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.049 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-25T22:52:31.050 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.021542+0000", 2024-04-25T22:52:31.050 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 37.949376047999998, 2024-04-25T22:52:31.050 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001339589, 2024-04-25T22:52:31.050 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:31.050 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:31.050 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-25T22:52:31.050 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:31.050 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.050 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:31.050 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021542+0000", 2024-04-25T22:52:31.050 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:31.050 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.050 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.051 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:31.051 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021542+0000", 2024-04-25T22:52:31.051 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:31.051 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.051 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.051 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:31.051 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021542+0000", 2024-04-25T22:52:31.051 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1600000000000002e-07 2024-04-25T22:52:31.051 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.051 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.051 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:31.051 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021545+0000", 2024-04-25T22:52:31.051 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.774e-06 2024-04-25T22:52:31.051 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.052 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.052 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:31.052 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021553+0000", 2024-04-25T22:52:31.052 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.2099999999999993e-06 2024-04-25T22:52:31.052 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.052 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.052 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:31.052 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021559+0000", 2024-04-25T22:52:31.052 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.1249999999999998e-06 2024-04-25T22:52:31.052 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.052 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.052 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:31.052 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022752+0000", 2024-04-25T22:52:31.052 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0011931120000000001 2024-04-25T22:52:31.053 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.053 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.053 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:31.053 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022759+0000", 2024-04-25T22:52:31.053 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4420000000000003e-06 2024-04-25T22:52:31.053 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.053 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.053 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:31.053 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022881+0000", 2024-04-25T22:52:31.053 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012250999999999999 2024-04-25T22:52:31.053 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:31.053 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:31.053 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:31.054 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.054 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.054 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e14/12 ondisk, result = 0)", 2024-04-25T22:52:31.054 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.021769+0000", 2024-04-25T22:52:31.054 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 37.949148784000002, 2024-04-25T22:52:31.054 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001336928, 2024-04-25T22:52:31.054 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:31.054 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:31.054 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-25T22:52:31.054 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:31.054 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.054 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:31.054 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021769+0000", 2024-04-25T22:52:31.055 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:31.055 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.055 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.055 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:31.055 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021769+0000", 2024-04-25T22:52:31.055 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:31.055 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.055 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.055 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:31.055 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021770+0000", 2024-04-25T22:52:31.055 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7700000000000005e-07 2024-04-25T22:52:31.055 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.055 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.056 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:31.056 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021773+0000", 2024-04-25T22:52:31.056 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5250000000000001e-06 2024-04-25T22:52:31.056 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.056 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.056 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:31.056 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021780+0000", 2024-04-25T22:52:31.056 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.187e-06 2024-04-25T22:52:31.056 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.056 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.056 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:31.056 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021796+0000", 2024-04-25T22:52:31.056 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5218000000000001e-05 2024-04-25T22:52:31.056 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.057 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.057 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:31.057 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023001+0000", 2024-04-25T22:52:31.057 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001205993 2024-04-25T22:52:31.057 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.057 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.057 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:31.057 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023009+0000", 2024-04-25T22:52:31.057 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9249999999999995e-06 2024-04-25T22:52:31.057 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.057 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.057 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:31.057 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023106+0000", 2024-04-25T22:52:31.058 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6602999999999996e-05 2024-04-25T22:52:31.058 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:31.058 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:31.058 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:31.058 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.058 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.058 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-25T22:52:31.058 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.021807+0000", 2024-04-25T22:52:31.058 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 37.949110392999998, 2024-04-25T22:52:31.058 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0013936809999999999, 2024-04-25T22:52:31.058 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:31.058 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:31.058 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-25T22:52:31.058 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:31.059 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.059 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:31.059 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021807+0000", 2024-04-25T22:52:31.059 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:31.059 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.059 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.059 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:31.059 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021807+0000", 2024-04-25T22:52:31.059 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:31.059 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.059 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.059 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:31.059 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021808+0000", 2024-04-25T22:52:31.060 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3200000000000001e-07 2024-04-25T22:52:31.060 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.060 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.060 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:31.060 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021811+0000", 2024-04-25T22:52:31.060 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5480000000000002e-06 2024-04-25T22:52:31.060 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.060 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.060 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:31.060 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021818+0000", 2024-04-25T22:52:31.060 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4450000000000001e-06 2024-04-25T22:52:31.060 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.060 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.060 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:31.060 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021823+0000", 2024-04-25T22:52:31.061 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.22e-06 2024-04-25T22:52:31.061 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.061 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.061 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:31.061 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023122+0000", 2024-04-25T22:52:31.061 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001298808 2024-04-25T22:52:31.061 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.061 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.061 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:31.061 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023126+0000", 2024-04-25T22:52:31.061 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9400000000000004e-06 2024-04-25T22:52:31.061 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.061 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.061 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:31.061 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023201+0000", 2024-04-25T22:52:31.062 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5388000000000004e-05 2024-04-25T22:52:31.062 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:31.062 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:31.062 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:31.062 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.062 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.062 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-25T22:52:31.062 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:55.010264+0000", 2024-04-25T22:52:31.062 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 35.960654212000001, 2024-04-25T22:52:31.062 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001484476, 2024-04-25T22:52:31.062 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:31.062 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:31.062 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:31.063 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:31.063 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.063 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:31.063 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010264+0000", 2024-04-25T22:52:31.063 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:31.063 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.063 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.063 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:31.063 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010264+0000", 2024-04-25T22:52:31.063 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:31.063 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.063 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.063 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:31.063 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010265+0000", 2024-04-25T22:52:31.064 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5e-06 2024-04-25T22:52:31.064 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.064 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.064 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:31.064 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010272+0000", 2024-04-25T22:52:31.064 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0910000000000004e-06 2024-04-25T22:52:31.064 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.064 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.064 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:31.064 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010287+0000", 2024-04-25T22:52:31.064 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4644000000000001e-05 2024-04-25T22:52:31.064 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.064 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.064 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:31.065 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010296+0000", 2024-04-25T22:52:31.065 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2159999999999995e-06 2024-04-25T22:52:31.065 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.065 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.065 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:31.065 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010394+0000", 2024-04-25T22:52:31.065 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.8148999999999998e-05 2024-04-25T22:52:31.065 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.065 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.065 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:31.065 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010503+0000", 2024-04-25T22:52:31.065 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000108857 2024-04-25T22:52:31.065 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.065 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.066 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:31.066 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010592+0000", 2024-04-25T22:52:31.066 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.9083000000000001e-05 2024-04-25T22:52:31.066 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.066 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.066 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:31.066 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.011161+0000", 2024-04-25T22:52:31.066 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00056919800000000003 2024-04-25T22:52:31.066 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.066 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.066 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:31.066 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.011676+0000", 2024-04-25T22:52:31.066 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00051500999999999999 2024-04-25T22:52:31.066 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.067 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.067 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:31.067 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.011717+0000", 2024-04-25T22:52:31.067 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0262999999999997e-05 2024-04-25T22:52:31.067 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.067 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.067 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:31.067 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.011748+0000", 2024-04-25T22:52:31.067 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1464999999999998e-05 2024-04-25T22:52:31.067 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:31.067 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:31.067 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:31.067 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.067 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.068 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-25T22:52:31.068 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:52:17.012790+0000", 2024-04-25T22:52:31.068 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 13.958128368000001, 2024-04-25T22:52:31.068 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001434444, 2024-04-25T22:52:31.068 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:31.068 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:31.068 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:31.068 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:31.068 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.068 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:31.068 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.012790+0000", 2024-04-25T22:52:31.068 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:31.068 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.068 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.069 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:31.069 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.012790+0000", 2024-04-25T22:52:31.069 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:31.069 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.069 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.069 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:31.069 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.012791+0000", 2024-04-25T22:52:31.069 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0699999999999999e-06 2024-04-25T22:52:31.069 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.069 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.069 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:31.069 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.012797+0000", 2024-04-25T22:52:31.069 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0519999999999998e-06 2024-04-25T22:52:31.069 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.069 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.070 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:31.070 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.012811+0000", 2024-04-25T22:52:31.070 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4287999999999999e-05 2024-04-25T22:52:31.070 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.070 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.070 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:31.070 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.012838+0000", 2024-04-25T22:52:31.070 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6727999999999999e-05 2024-04-25T22:52:31.070 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.070 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.070 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:31.070 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.012909+0000", 2024-04-25T22:52:31.070 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.1211000000000006e-05 2024-04-25T22:52:31.070 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.071 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.071 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:31.071 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.013015+0000", 2024-04-25T22:52:31.071 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010619 2024-04-25T22:52:31.071 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.071 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.071 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:31.071 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.013189+0000", 2024-04-25T22:52:31.071 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00017439199999999999 2024-04-25T22:52:31.071 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.071 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.071 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:31.071 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.013903+0000", 2024-04-25T22:52:31.071 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00071379099999999997 2024-04-25T22:52:31.071 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.072 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.072 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:31.072 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.014159+0000", 2024-04-25T22:52:31.072 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00025561699999999998 2024-04-25T22:52:31.072 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.072 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.072 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:31.072 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.014192+0000", 2024-04-25T22:52:31.072 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2941000000000002e-05 2024-04-25T22:52:31.072 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.072 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.072 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:31.072 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.014224+0000", 2024-04-25T22:52:31.073 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2163999999999999e-05 2024-04-25T22:52:31.073 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:31.073 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:31.073 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:31.073 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.073 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.073 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:52:31.073 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:52:23.013398+0000", 2024-04-25T22:52:31.073 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 7.9575199039999998, 2024-04-25T22:52:31.073 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0015020369999999999, 2024-04-25T22:52:31.073 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:31.073 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:31.073 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:31.073 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:31.073 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.074 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:31.074 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:23.013398+0000", 2024-04-25T22:52:31.074 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:31.074 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.074 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.074 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:31.074 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:23.013398+0000", 2024-04-25T22:52:31.074 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:31.074 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.074 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.074 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:31.074 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:23.013399+0000", 2024-04-25T22:52:31.074 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.362e-06 2024-04-25T22:52:31.074 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.075 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.075 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:31.075 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:23.013406+0000", 2024-04-25T22:52:31.075 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.1409999999999999e-06 2024-04-25T22:52:31.075 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.075 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.075 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:31.075 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:23.013420+0000", 2024-04-25T22:52:31.075 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3232e-05 2024-04-25T22:52:31.075 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.075 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.075 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:31.075 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:23.013429+0000", 2024-04-25T22:52:31.075 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0310000000000004e-06 2024-04-25T22:52:31.076 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.076 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.076 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:31.076 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:23.013514+0000", 2024-04-25T22:52:31.076 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5620999999999999e-05 2024-04-25T22:52:31.076 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.076 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.076 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:31.076 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:23.013581+0000", 2024-04-25T22:52:31.076 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.6804999999999995e-05 2024-04-25T22:52:31.076 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.076 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.076 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:31.076 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:23.013683+0000", 2024-04-25T22:52:31.076 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010186 2024-04-25T22:52:31.077 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.077 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.077 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:31.077 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:23.014298+0000", 2024-04-25T22:52:31.077 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061501399999999999 2024-04-25T22:52:31.077 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.077 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.077 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:31.077 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:23.014839+0000", 2024-04-25T22:52:31.077 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000540523 2024-04-25T22:52:31.077 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.077 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.077 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:31.077 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:23.014871+0000", 2024-04-25T22:52:31.078 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2004000000000001e-05 2024-04-25T22:52:31.078 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:31.078 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:31.078 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:31.078 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:23.014900+0000", 2024-04-25T22:52:31.078 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9444000000000001e-05 2024-04-25T22:52:31.078 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:31.078 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:31.078 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:31.078 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:31.078 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:31.078 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-25T22:52:31.080 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:52:31.080 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:31.079+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:31.181 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:31.181+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:31.190 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:31.190 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:52:31.190 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-25T22:52:31.190 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:31.199 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:52:31.282 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:31.281+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:31.301 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:31.301 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:52:31.301 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-25T22:52:31.302 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-25T22:52:31.302 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:31.310 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:52:31.383 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:31.383+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:31.456 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:31.456 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:52:31.456 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:52:31.457 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:52:31.457 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.457 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:52:31.457 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:52:31.457 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 43.487376941000001, 2024-04-25T22:52:31.458 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:52:31.458 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:31.458 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:31.458 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:31.458 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:31.458 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.459 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:31.459 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:52:31.459 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:31.459 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.459 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.459 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:31.459 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:52:31.459 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:31.459 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.459 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.460 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:31.460 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:52:31.460 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:52:31.460 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.460 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.460 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:31.460 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:52:31.460 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:52:31.460 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.460 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.460 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:31.460 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:52:31.460 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:52:31.460 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.461 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.461 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:31.461 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:52:31.461 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:52:31.461 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.461 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.461 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:31.461 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:52:31.461 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:52:31.461 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.461 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.461 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:31.461 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:52:31.461 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:52:31.462 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.462 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.462 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:31.462 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:52:31.462 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:52:31.462 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.462 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.462 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:31.462 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:52:31.462 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:52:31.462 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:31.462 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:31.462 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:31.462 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.463 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.463 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:110 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'72, mlcod=10'68)", 2024-04-25T22:52:31.463 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:31.463 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 43.486742941000003, 2024-04-25T22:52:31.463 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065316630000000001, 2024-04-25T22:52:31.463 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:31.463 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:31.463 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:31.463 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:31.463 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.463 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:31.463 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:31.464 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:31.464 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.464 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.464 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:31.464 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:31.464 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:31.464 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.464 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.464 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:31.464 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:31.464 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.58e-07 2024-04-25T22:52:31.464 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.464 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.464 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:31.465 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967811+0000", 2024-04-25T22:52:31.465 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.118e-06 2024-04-25T22:52:31.465 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.465 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.465 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:31.465 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967817+0000", 2024-04-25T22:52:31.465 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3709999999999996e-06 2024-04-25T22:52:31.465 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.465 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.465 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:31.465 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967820+0000", 2024-04-25T22:52:31.466 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2210000000000002e-06 2024-04-25T22:52:31.466 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.466 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.466 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:31.466 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967876+0000", 2024-04-25T22:52:31.466 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5507000000000002e-05 2024-04-25T22:52:31.466 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.466 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.466 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:31.466 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967893+0000", 2024-04-25T22:52:31.466 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7812000000000002e-05 2024-04-25T22:52:31.466 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.466 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.467 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:31.467 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974317+0000", 2024-04-25T22:52:31.467 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064237160000000003 2024-04-25T22:52:31.467 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.467 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.467 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:31.467 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:52:31.467 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.156e-05 2024-04-25T22:52:31.467 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:31.467 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:31.467 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:31.467 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.467 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.467 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'68)", 2024-04-25T22:52:31.467 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:31.468 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 43.486325428000001, 2024-04-25T22:52:31.468 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061292279999999996, 2024-04-25T22:52:31.468 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:31.468 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:31.468 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:31.468 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:31.468 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.468 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:31.468 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:31.468 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:31.468 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.469 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.469 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:31.469 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:31.469 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:31.469 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.469 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.469 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:31.469 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:31.469 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6300000000000001e-07 2024-04-25T22:52:31.469 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.469 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.469 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:31.470 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968228+0000", 2024-04-25T22:52:31.470 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6139999999999999e-06 2024-04-25T22:52:31.470 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.470 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.470 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:31.470 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968235+0000", 2024-04-25T22:52:31.470 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7020000000000001e-06 2024-04-25T22:52:31.470 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.470 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.470 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:31.470 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968238+0000", 2024-04-25T22:52:31.470 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0010000000000002e-06 2024-04-25T22:52:31.470 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.471 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.471 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:31.471 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968297+0000", 2024-04-25T22:52:31.471 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8424999999999997e-05 2024-04-25T22:52:31.471 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.471 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.471 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:31.471 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968316+0000", 2024-04-25T22:52:31.471 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8814999999999999e-05 2024-04-25T22:52:31.471 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.471 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.471 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:31.471 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:52:31.471 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060239439999999998 2024-04-25T22:52:31.472 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.472 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.472 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:31.472 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974354+0000", 2024-04-25T22:52:31.472 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4364e-05 2024-04-25T22:52:31.472 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:31.472 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:31.472 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:31.472 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.472 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.472 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'68)", 2024-04-25T22:52:31.472 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:31.472 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 43.485888426000002, 2024-04-25T22:52:31.472 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005948414, 2024-04-25T22:52:31.473 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:31.473 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:31.473 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:31.473 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:31.473 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.473 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:31.473 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:31.473 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:31.473 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.473 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.473 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:31.473 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:31.473 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:31.473 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.474 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.474 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:31.474 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:31.474 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6199999999999998e-07 2024-04-25T22:52:31.474 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.474 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.474 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:31.474 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968723+0000", 2024-04-25T22:52:31.474 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1148999999999993e-05 2024-04-25T22:52:31.474 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.475 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.475 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:31.475 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968730+0000", 2024-04-25T22:52:31.475 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1749999999999999e-06 2024-04-25T22:52:31.475 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.475 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.476 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:31.476 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968734+0000", 2024-04-25T22:52:31.476 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5200000000000002e-06 2024-04-25T22:52:31.476 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.476 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.477 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:31.477 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968771+0000", 2024-04-25T22:52:31.477 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6851999999999999e-05 2024-04-25T22:52:31.477 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.477 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.477 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:31.477 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968788+0000", 2024-04-25T22:52:31.477 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7027000000000001e-05 2024-04-25T22:52:31.477 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.477 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.477 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:31.477 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974589+0000", 2024-04-25T22:52:31.477 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058013320000000002 2024-04-25T22:52:31.478 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.478 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.478 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:31.478 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974610+0000", 2024-04-25T22:52:31.478 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0897e-05 2024-04-25T22:52:31.478 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:31.478 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:31.478 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:31.478 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.478 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.478 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'68)", 2024-04-25T22:52:31.478 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:31.478 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 43.485318415999998, 2024-04-25T22:52:31.479 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053935750000000003, 2024-04-25T22:52:31.479 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:31.479 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:31.479 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:31.479 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:31.479 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.479 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:31.479 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:31.479 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:31.479 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.479 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.479 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:31.479 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:31.479 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:31.479 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.480 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.480 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:31.480 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:31.480 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.03e-07 2024-04-25T22:52:31.480 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.480 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.480 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:31.480 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969235+0000", 2024-04-25T22:52:31.480 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2399999999999999e-06 2024-04-25T22:52:31.480 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.480 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.480 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:31.480 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969242+0000", 2024-04-25T22:52:31.480 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1269999999999997e-06 2024-04-25T22:52:31.481 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.481 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.481 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:31.481 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969246+0000", 2024-04-25T22:52:31.481 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3840000000000001e-06 2024-04-25T22:52:31.481 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.481 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.481 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:31.481 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969278+0000", 2024-04-25T22:52:31.481 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1868e-05 2024-04-25T22:52:31.481 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.481 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.481 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:31.481 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969295+0000", 2024-04-25T22:52:31.482 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7530999999999999e-05 2024-04-25T22:52:31.482 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.482 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.482 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:31.482 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974611+0000", 2024-04-25T22:52:31.482 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053160789999999996 2024-04-25T22:52:31.482 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.482 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.482 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:31.482 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974625+0000", 2024-04-25T22:52:31.482 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3943e-05 2024-04-25T22:52:31.482 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:31.482 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:31.482 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:31.483 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.483 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.483 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-25T22:52:31.483 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:31.483 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 43.291722507999999, 2024-04-25T22:52:31.483 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054952610000000004, 2024-04-25T22:52:31.483 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:31.483 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:31.483 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:31.483 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:31.483 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.483 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:31.483 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:31.483 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:31.483 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.484 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.484 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:31.484 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:31.484 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:31.484 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.484 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.484 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:31.484 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:31.484 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.68e-07 2024-04-25T22:52:31.484 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.484 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.484 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:31.484 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162898+0000", 2024-04-25T22:52:31.484 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9470999999999999e-05 2024-04-25T22:52:31.485 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.485 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.485 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:31.485 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162906+0000", 2024-04-25T22:52:31.485 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1580000000000005e-06 2024-04-25T22:52:31.485 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.485 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.485 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:31.485 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162911+0000", 2024-04-25T22:52:31.485 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4779999999999999e-06 2024-04-25T22:52:31.485 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.485 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.486 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:31.486 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162952+0000", 2024-04-25T22:52:31.486 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0629e-05 2024-04-25T22:52:31.486 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.486 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.486 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:31.486 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162968+0000", 2024-04-25T22:52:31.486 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6239000000000002e-05 2024-04-25T22:52:31.486 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.486 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.486 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:31.486 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168281+0000", 2024-04-25T22:52:31.486 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053132869999999999 2024-04-25T22:52:31.487 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.487 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.487 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:31.487 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168323+0000", 2024-04-25T22:52:31.487 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1430999999999997e-05 2024-04-25T22:52:31.487 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:31.487 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:31.487 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:31.487 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.487 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.487 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-04-25T22:52:31.487 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:31.487 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 42.861245146000002, 2024-04-25T22:52:31.487 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050872510000000001, 2024-04-25T22:52:31.487 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:31.488 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:31.488 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:31.488 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:31.488 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.488 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:31.488 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:31.488 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:31.488 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.488 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.488 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:31.488 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:31.488 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:31.488 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.488 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.489 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:31.489 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:31.489 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.72e-07 2024-04-25T22:52:31.489 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.489 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.489 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:31.489 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593381+0000", 2024-04-25T22:52:31.489 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5797000000000006e-05 2024-04-25T22:52:31.489 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.489 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.489 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:31.489 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593389+0000", 2024-04-25T22:52:31.489 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8480000000000001e-06 2024-04-25T22:52:31.489 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.490 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.490 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:31.490 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593393+0000", 2024-04-25T22:52:31.490 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4819999999999996e-06 2024-04-25T22:52:31.490 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.490 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.490 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:31.490 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593435+0000", 2024-04-25T22:52:31.490 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1600000000000002e-05 2024-04-25T22:52:31.490 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.490 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.490 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:31.490 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593454+0000", 2024-04-25T22:52:31.490 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8868e-05 2024-04-25T22:52:31.491 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.491 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.491 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:31.491 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598350+0000", 2024-04-25T22:52:31.491 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004895763 2024-04-25T22:52:31.491 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.491 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.491 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:31.491 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598392+0000", 2024-04-25T22:52:31.491 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2521000000000002e-05 2024-04-25T22:52:31.491 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:31.491 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:31.491 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:31.491 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.492 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.492 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:31.492 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:52:31.492 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 38.442881241999999, 2024-04-25T22:52:31.492 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:52:31.492 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:31.492 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:31.492 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:31.492 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:31.492 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.492 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:31.492 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:52:31.492 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:31.492 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.493 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.493 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:31.493 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:52:31.493 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:31.493 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.493 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.493 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:31.493 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:52:31.493 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:52:31.493 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.493 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.493 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:31.493 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:52:31.493 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:52:31.493 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.494 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.494 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:31.494 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:52:31.494 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:52:31.494 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.494 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.494 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:31.494 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:52:31.494 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:52:31.494 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.494 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.494 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:31.494 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:52:31.494 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:52:31.495 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.495 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.495 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:31.495 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:52:31.495 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:52:31.495 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.495 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.495 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:31.495 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:52:31.495 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:52:31.495 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.495 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.495 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:31.495 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:52:31.496 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:52:31.496 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.496 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.496 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:31.496 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:52:31.496 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:52:31.496 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.496 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.496 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:31.496 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:52:31.496 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:52:31.496 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.496 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.496 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:31.496 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:52:31.497 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:52:31.497 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:31.497 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:31.497 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:31.497 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.497 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.497 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:31.497 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:52:31.497 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 38.442206865999999, 2024-04-25T22:52:31.497 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:52:31.497 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:31.497 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:31.497 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:31.497 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:31.498 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.498 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:31.498 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:52:31.498 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:31.498 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.498 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.498 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:31.498 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:52:31.498 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:31.498 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.498 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.498 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:31.498 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:52:31.498 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:52:31.499 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.499 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.499 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:31.499 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:52:31.499 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:52:31.499 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.499 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.499 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:31.499 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:52:31.499 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:52:31.499 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.499 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.499 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:31.500 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:52:31.500 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:52:31.500 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.500 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.500 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:31.500 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:52:31.500 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:52:31.500 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.500 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.500 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:31.500 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:52:31.500 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:52:31.500 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.500 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.501 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:31.501 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:52:31.501 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:52:31.501 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.501 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.501 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:31.501 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:52:31.501 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:52:31.501 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.501 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.501 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:31.501 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:52:31.501 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:52:31.501 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.501 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.502 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:31.502 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:52:31.502 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:52:31.502 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.502 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.502 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:31.502 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:52:31.502 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:52:31.502 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:31.502 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:31.502 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:31.502 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.503 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.503 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:31.503 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:52:31.503 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 38.441697654000002, 2024-04-25T22:52:31.503 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:52:31.503 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:31.503 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:31.503 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:31.503 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:31.503 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.503 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:31.503 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:52:31.503 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:31.503 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.504 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.504 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:31.504 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:52:31.504 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:31.504 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.504 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.504 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:31.504 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:52:31.504 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:52:31.504 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.504 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.504 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:31.504 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:52:31.504 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:52:31.505 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.505 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.505 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:31.505 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:52:31.505 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:52:31.505 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.505 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.505 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:31.505 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:52:31.505 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:52:31.505 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.505 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.505 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:31.506 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:52:31.506 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:52:31.506 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.506 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.506 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:31.506 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:52:31.506 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:52:31.506 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.506 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.506 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:31.506 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:52:31.506 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:52:31.506 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.506 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.507 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:31.507 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:52:31.507 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:52:31.507 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.507 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.507 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:31.507 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:52:31.507 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:52:31.507 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.507 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.507 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:31.507 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:52:31.507 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:52:31.507 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.508 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.508 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:31.508 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:52:31.508 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:52:31.508 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:31.508 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:31.508 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:31.508 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.508 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.508 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:31.508 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:31.508 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 38.441284455999998, 2024-04-25T22:52:31.508 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:52:31.508 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:31.509 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:31.509 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:31.509 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:31.509 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.509 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:31.509 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:31.509 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:31.509 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.509 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.509 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:31.509 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:31.509 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:31.509 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.509 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.510 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:31.510 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:31.510 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:52:31.510 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.510 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.510 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:31.510 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:52:31.510 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:52:31.510 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.510 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.510 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:31.510 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:52:31.510 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:52:31.511 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.511 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.511 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:31.511 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:52:31.511 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:52:31.511 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.511 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.511 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:31.511 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:52:31.511 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:52:31.511 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.511 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.511 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:31.511 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:52:31.512 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:52:31.512 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.512 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.512 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:31.512 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:52:31.512 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:52:31.512 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.512 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.512 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:31.512 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:52:31.512 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:52:31.512 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.512 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.512 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:31.513 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:52:31.513 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:52:31.513 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.513 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.513 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:31.513 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:52:31.513 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:52:31.513 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.513 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.513 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:31.513 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:52:31.513 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:52:31.513 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:31.513 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:31.514 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:31.514 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.514 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.514 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:31.514 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:52:31.514 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 38.441233785999998, 2024-04-25T22:52:31.514 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:52:31.514 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:31.514 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:31.514 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:31.514 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:31.514 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.514 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:31.514 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:52:31.515 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:31.515 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.515 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.515 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:31.515 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:52:31.515 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:31.515 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.515 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.515 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:31.515 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:52:31.515 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:52:31.515 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.515 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.515 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:31.516 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:52:31.516 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:52:31.516 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.516 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.516 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:31.516 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:52:31.516 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:52:31.516 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.516 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.516 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:31.516 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:52:31.516 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:52:31.516 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.516 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.517 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:31.517 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:52:31.517 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:52:31.517 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.517 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.517 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:52:31.517 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:52:31.517 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:52:31.517 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.517 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.517 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:31.517 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:52:31.517 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:52:31.517 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.518 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.518 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:31.518 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:52:31.518 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:52:31.518 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.518 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.518 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:31.518 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:52:31.518 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:52:31.518 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.518 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.518 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:31.518 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:52:31.518 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:52:31.519 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.519 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.519 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:31.519 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:52:31.519 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:52:31.519 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.519 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.519 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:31.519 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:52:31.519 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:52:31.519 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.519 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.519 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:31.520 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:52:31.520 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:52:31.520 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:31.520 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:31.520 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:31.520 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.520 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.520 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:31.520 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:52:31.520 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 38.441196916999999, 2024-04-25T22:52:31.520 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:52:31.520 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:31.520 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:31.520 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:31.521 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:31.521 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.521 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:31.521 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:52:31.521 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:31.521 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.521 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.521 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:31.521 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:52:31.521 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:31.521 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.521 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.521 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:31.521 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:52:31.522 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:52:31.522 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.522 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.522 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:31.522 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:52:31.522 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:52:31.522 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.522 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.522 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:31.522 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:52:31.522 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:52:31.522 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.522 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.523 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:31.523 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:52:31.523 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:52:31.523 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.523 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.523 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:31.523 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:52:31.523 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:52:31.523 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.523 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.523 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:52:31.523 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:52:31.523 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:52:31.523 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.524 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.524 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:31.524 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:52:31.524 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:52:31.524 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.524 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.524 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:31.524 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:52:31.524 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:52:31.524 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.524 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.524 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:31.524 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:52:31.524 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:52:31.525 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.525 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.525 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:31.525 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:52:31.525 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:52:31.525 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.525 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.525 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:31.525 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:52:31.525 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:52:31.525 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.525 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.525 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:31.525 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:52:31.526 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:52:31.526 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.526 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.526 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:31.526 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:52:31.526 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:52:31.526 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:31.526 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:31.526 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:31.526 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.526 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.526 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:31.526 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:52:31.526 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 38.441171951000001, 2024-04-25T22:52:31.527 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:52:31.527 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:31.527 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:31.527 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:31.527 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:31.527 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.527 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:31.527 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:52:31.527 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:31.527 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.527 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.527 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:31.527 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:52:31.527 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:31.528 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.528 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.528 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:31.528 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:52:31.528 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:52:31.528 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.528 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.528 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:31.528 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:52:31.528 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:52:31.528 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.528 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.528 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:31.528 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:52:31.528 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:52:31.529 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.529 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.529 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:31.529 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:52:31.529 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:52:31.529 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.529 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.529 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:31.529 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:52:31.529 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:52:31.529 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.529 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.529 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:31.529 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:52:31.530 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:52:31.530 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.530 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.530 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:31.530 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:52:31.530 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:52:31.530 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.530 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.530 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:31.530 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:52:31.530 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:52:31.530 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.530 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.531 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:31.531 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:52:31.531 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:52:31.531 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.531 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.531 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:31.531 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:52:31.531 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:52:31.531 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.531 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.531 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:31.531 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:52:31.531 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:52:31.531 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:31.531 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:31.532 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:31.532 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.532 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.532 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:31.532 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:52:31.532 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 38.441135586999998, 2024-04-25T22:52:31.532 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:52:31.532 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:31.532 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:31.532 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:52:31.532 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:31.532 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.532 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:31.532 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:52:31.533 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:31.533 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.533 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.533 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:31.533 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:52:31.533 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:31.533 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.533 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.533 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:31.533 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:52:31.533 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:52:31.533 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.533 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.533 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:31.534 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:52:31.534 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:52:31.534 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.534 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.534 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:31.534 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:52:31.534 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:52:31.534 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.534 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.534 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:31.534 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:52:31.534 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:52:31.534 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.534 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.535 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:31.535 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:52:31.535 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:52:31.535 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.535 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.535 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:52:31.535 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:52:31.535 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:52:31.535 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.535 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.535 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:31.535 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:52:31.535 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:52:31.535 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.535 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.536 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:31.536 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:52:31.536 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:52:31.536 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.536 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.536 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:31.536 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:52:31.536 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:52:31.536 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:31.536 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:31.536 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:31.536 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.536 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.537 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:31.537 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:31.537 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 38.441104506000002, 2024-04-25T22:52:31.537 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:52:31.537 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:31.537 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:31.537 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:52:31.537 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:31.537 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.537 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:31.537 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:31.537 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:31.538 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.538 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.538 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:31.538 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:31.538 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:31.538 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.538 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.538 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:31.538 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:31.538 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:52:31.539 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.539 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.539 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:31.539 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:52:31.539 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:52:31.539 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.539 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.539 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:31.539 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:52:31.539 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:52:31.539 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.539 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.539 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:31.539 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:52:31.540 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:52:31.540 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.540 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.540 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:31.540 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:52:31.540 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:52:31.540 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.540 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.540 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:31.540 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:52:31.540 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:52:31.540 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.540 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.540 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:31.541 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:52:31.541 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:52:31.541 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:31.541 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:31.541 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:31.541 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.541 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.541 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:52:31.541 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:31.541 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 38.440663536999999, 2024-04-25T22:52:31.541 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064881979999999997, 2024-04-25T22:52:31.541 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:31.541 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:31.541 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:31.542 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:31.542 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.542 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:31.542 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:31.542 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:31.542 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.542 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.542 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:31.542 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:31.542 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:31.542 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.542 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.542 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:31.542 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:31.543 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2699999999999999e-07 2024-04-25T22:52:31.543 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.543 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.543 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:31.543 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013898+0000", 2024-04-25T22:52:31.543 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0796e-05 2024-04-25T22:52:31.543 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.543 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.543 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:31.543 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013907+0000", 2024-04-25T22:52:31.543 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5140000000000007e-06 2024-04-25T22:52:31.543 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.543 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.543 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:31.544 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013952+0000", 2024-04-25T22:52:31.544 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4134000000000001e-05 2024-04-25T22:52:31.544 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.544 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.544 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:31.544 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016812+0000", 2024-04-25T22:52:31.544 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028601059999999998 2024-04-25T22:52:31.544 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.544 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.544 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:31.544 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.017052+0000", 2024-04-25T22:52:31.544 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024056500000000001 2024-04-25T22:52:31.544 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.545 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.545 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:31.545 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020350+0000", 2024-04-25T22:52:31.545 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032978320000000001 2024-04-25T22:52:31.545 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.545 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.545 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:31.545 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020375+0000", 2024-04-25T22:52:31.545 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4624e-05 2024-04-25T22:52:31.545 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:31.545 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:31.545 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:31.545 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.545 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.546 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-25T22:52:31.546 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:31.546 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 38.427133091000002, 2024-04-25T22:52:31.546 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058583000000000003, 2024-04-25T22:52:31.546 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:31.546 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:31.546 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:31.546 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:31.546 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.546 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:31.546 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:31.546 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:31.546 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.547 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.547 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:31.547 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:31.547 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:31.547 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.547 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.547 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:31.547 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:31.547 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.41e-07 2024-04-25T22:52:31.547 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.547 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.547 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:31.547 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027428+0000", 2024-04-25T22:52:31.547 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.075e-05 2024-04-25T22:52:31.548 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.548 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.548 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:31.548 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027435+0000", 2024-04-25T22:52:31.548 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3610000000000003e-06 2024-04-25T22:52:31.548 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.548 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.548 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:31.548 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027442+0000", 2024-04-25T22:52:31.548 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0400000000000004e-06 2024-04-25T22:52:31.548 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.548 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.548 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:31.549 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028094+0000", 2024-04-25T22:52:31.549 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00065134800000000005 2024-04-25T22:52:31.549 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.549 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.549 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:31.549 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028107+0000", 2024-04-25T22:52:31.549 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3087e-05 2024-04-25T22:52:31.549 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.549 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.549 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:31.549 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033239+0000", 2024-04-25T22:52:31.549 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051319429999999999 2024-04-25T22:52:31.549 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.549 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.550 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:31.550 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033275+0000", 2024-04-25T22:52:31.550 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6430000000000002e-05 2024-04-25T22:52:31.550 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:31.550 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:31.550 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:31.550 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.550 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.550 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-25T22:52:31.550 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:31.550 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 38.426748254000003, 2024-04-25T22:52:31.550 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005413597, 2024-04-25T22:52:31.550 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:31.551 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:31.551 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:31.551 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:31.551 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.551 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:31.551 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:31.551 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:31.551 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.551 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.551 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:31.551 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:31.551 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:31.551 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.552 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.552 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:31.552 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:31.552 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3799999999999997e-07 2024-04-25T22:52:31.552 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.552 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.552 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:31.552 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027816+0000", 2024-04-25T22:52:31.552 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3230999999999999e-05 2024-04-25T22:52:31.552 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.552 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.552 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:31.552 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027823+0000", 2024-04-25T22:52:31.553 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9039999999999992e-06 2024-04-25T22:52:31.553 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.553 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.553 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:31.553 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027841+0000", 2024-04-25T22:52:31.553 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7651000000000001e-05 2024-04-25T22:52:31.553 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.553 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.553 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:31.553 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027904+0000", 2024-04-25T22:52:31.553 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3058000000000005e-05 2024-04-25T22:52:31.553 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.553 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.553 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:31.553 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027926+0000", 2024-04-25T22:52:31.554 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1450999999999998e-05 2024-04-25T22:52:31.554 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.554 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.554 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:31.554 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033177+0000", 2024-04-25T22:52:31.554 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052508909999999997 2024-04-25T22:52:31.554 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.554 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.554 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:31.554 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033215+0000", 2024-04-25T22:52:31.554 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8872999999999999e-05 2024-04-25T22:52:31.554 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:31.554 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:31.554 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:31.555 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.555 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.555 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 171 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:52:31.555 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:31.555 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 38.426691151999997, 2024-04-25T22:52:31.555 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054322240000000003, 2024-04-25T22:52:31.555 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:31.555 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:31.555 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "reached pg", 2024-04-25T22:52:31.555 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:31.555 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.555 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:31.555 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:31.555 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:31.556 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.556 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.556 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:31.556 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:31.556 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:31.556 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.556 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.556 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:31.556 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:31.556 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7500000000000001e-07 2024-04-25T22:52:31.556 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.556 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.556 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:31.556 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027868+0000", 2024-04-25T22:52:31.557 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5750000000000001e-06 2024-04-25T22:52:31.557 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.557 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.557 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:31.557 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027885+0000", 2024-04-25T22:52:31.557 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7272e-05 2024-04-25T22:52:31.557 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.557 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.557 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:31.557 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027900+0000", 2024-04-25T22:52:31.557 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.502e-05 2024-04-25T22:52:31.557 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.557 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.557 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:31.557 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028381+0000", 2024-04-25T22:52:31.558 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00048039399999999998 2024-04-25T22:52:31.558 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:31.558 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:31.558 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:31.558 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033291+0000", 2024-04-25T22:52:31.558 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049105879999999996 2024-04-25T22:52:31.558 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:31.558 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:31.558 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:31.558 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:31.558 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:31.558 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:31.560 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:52:31.560 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:31.559+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:31.661 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:31.660+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:31.673 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:31.674 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:52:31.674 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-04-25T22:52:31.674 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:31.683 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:52:31.762 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:31.761+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:31.784 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:52:31.785 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:31.785 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:52:31.785 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:52:31.785 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:52:31.786 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:31.795 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:52:31.882 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:31.881+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:31.920 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-25T22:52:31.921 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:52:31.940 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-25T22:52:31.940 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:52:31.942 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:31.943 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:31.952 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:52:31.958 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-25T22:52:31.958 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:52:31.994 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:31.993+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:32.065 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:32.064+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:32.068 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:32.068 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:32.077 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:52:32.113 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-25T22:52:32.113 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-25T22:52:32.113 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-04-25T22:52:32.113 INFO:tasks.thrashosds.thrasher:Setting osd 0 primary_affinity to 0.724361 2024-04-25T22:52:32.113 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 0.7243614237146335 2024-04-25T22:52:32.166 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:32.165+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:32.183 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-25T22:52:32.221 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:32.221 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:32.230 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:52:32.266 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:32.266+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:32.333 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:32.333 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:32.342 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:52:32.367 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:32.367+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:32.451 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:32.451 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:32.459 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:52:32.468 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:32.468+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:32.564 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:32.564 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:32.569 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:32.569+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:32.573 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:52:32.670 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:32.670+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:32.675 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:32.675 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:32.685 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:52:32.771 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:32.771+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:32.790 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:32.790 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:32.799 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:52:32.872 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:32.872+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:32.902 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:32.902 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:32.910 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:52:32.973 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:32.972+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:33.013 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:33.013 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:33.023 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:52:33.074 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:33.074+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:33.109 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is unset 2024-04-25T22:52:33.111 INFO:teuthology.orchestra.run.smithi052.stderr:set osd.0 primary-affinity to 0.724361 (8474712) 2024-04-25T22:52:33.133 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:33.133 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:33.142 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:52:33.175 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:33.174+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:33.244 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:33.244 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:33.253 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:52:33.276 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:33.275+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:33.356 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:33.357 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:33.366 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:52:33.376 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:33.376+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:33.470 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:33.471 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:33.478 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:33.477+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:33.479 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:52:33.579 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:33.578+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:33.623 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:33.623 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:33.632 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:52:33.680 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:33.680+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:33.776 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:33.776 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:33.781 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:33.781+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:33.785 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:52:33.882 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:33.881+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:33.892 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:33.892 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:33.900 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:52:33.970 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:52:33.982 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:33.982+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:34.003 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:34.003 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:34.012 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:52:34.083 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:34.082+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:34.107 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-25T22:52:34.107 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:52:34.129 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-25T22:52:34.129 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:52:34.147 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-25T22:52:34.147 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:52:34.157 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:34.157 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-04-25T22:52:34.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-04-25T22:52:34.158 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:52:34.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.158 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:34.158 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:34.158 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.190716088000002, 2024-04-25T22:52:34.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0103421, 2024-04-25T22:52:34.158 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:34.158 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:34.158 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:34.158 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:34.158 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:34.158 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:34.159 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 115 2024-04-25T22:52:34.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.159 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:34.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:34.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:34.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:34.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:34.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:34.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:34.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:34.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:34.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9500000000000002e-07 2024-04-25T22:52:34.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:34.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965108+0000", 2024-04-25T22:52:34.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9177999999999994e-05 2024-04-25T22:52:34.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:34.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965127+0000", 2024-04-25T22:52:34.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8868e-05 2024-04-25T22:52:34.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:34.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965133+0000", 2024-04-25T22:52:34.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8929999999999999e-06 2024-04-25T22:52:34.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:34.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.969991+0000", 2024-04-25T22:52:34.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048573849999999997 2024-04-25T22:52:34.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:34.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970072+0000", 2024-04-25T22:52:34.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0728000000000004e-05 2024-04-25T22:52:34.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:34.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970189+0000", 2024-04-25T22:52:34.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000117778 2024-04-25T22:52:34.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:34.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970946+0000", 2024-04-25T22:52:34.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00075704600000000004 2024-04-25T22:52:34.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:34.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975297+0000", 2024-04-25T22:52:34.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004350217 2024-04-25T22:52:34.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:34.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975343+0000", 2024-04-25T22:52:34.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6687999999999998e-05 2024-04-25T22:52:34.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:34.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975380+0000", 2024-04-25T22:52:34.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6724000000000003e-05 2024-04-25T22:52:34.164 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:34.164 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:34.164 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:34.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.164 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:34.164 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:34.165 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.190610057000001, 2024-04-25T22:52:34.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010304384, 2024-04-25T22:52:34.165 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:34.165 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:34.165 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:34.165 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:34.165 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:34.165 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:34.165 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 116 2024-04-25T22:52:34.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.165 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:34.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:34.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:34.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:34.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:34.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:34.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:34.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:34.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:34.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5799999999999999e-07 2024-04-25T22:52:34.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:34.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965154+0000", 2024-04-25T22:52:34.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0009e-05 2024-04-25T22:52:34.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:34.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965164+0000", 2024-04-25T22:52:34.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8490000000000001e-06 2024-04-25T22:52:34.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:34.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965169+0000", 2024-04-25T22:52:34.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0730000000000004e-06 2024-04-25T22:52:34.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:34.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970609+0000", 2024-04-25T22:52:34.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054397689999999997 2024-04-25T22:52:34.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:34.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970651+0000", 2024-04-25T22:52:34.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1873999999999999e-05 2024-04-25T22:52:34.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:34.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970723+0000", 2024-04-25T22:52:34.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2039999999999995e-05 2024-04-25T22:52:34.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:34.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971358+0000", 2024-04-25T22:52:34.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063489500000000001 2024-04-25T22:52:34.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:34.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975409+0000", 2024-04-25T22:52:34.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040506880000000002 2024-04-25T22:52:34.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:34.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975432+0000", 2024-04-25T22:52:34.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3315999999999998e-05 2024-04-25T22:52:34.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:34.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975448+0000", 2024-04-25T22:52:34.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6313000000000001e-05 2024-04-25T22:52:34.170 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:34.170 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:34.170 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:34.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.170 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:34.170 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:34.170 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.190575475000003, 2024-04-25T22:52:34.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010384338999999999, 2024-04-25T22:52:34.171 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:34.171 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:34.171 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:34.171 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:34.171 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:34.171 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:34.171 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-04-25T22:52:34.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.171 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:34.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:34.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:34.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:34.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:34.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:34.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:34.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:34.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:34.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3600000000000004e-07 2024-04-25T22:52:34.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:34.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965185+0000", 2024-04-25T22:52:34.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.117e-06 2024-04-25T22:52:34.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:34.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965192+0000", 2024-04-25T22:52:34.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3239999999999997e-06 2024-04-25T22:52:34.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:34.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965198+0000", 2024-04-25T22:52:34.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6370000000000004e-06 2024-04-25T22:52:34.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:34.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970973+0000", 2024-04-25T22:52:34.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057748239999999996 2024-04-25T22:52:34.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:34.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971049+0000", 2024-04-25T22:52:34.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6029e-05 2024-04-25T22:52:34.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:34.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971174+0000", 2024-04-25T22:52:34.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012462399999999999 2024-04-25T22:52:34.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:34.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971553+0000", 2024-04-25T22:52:34.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037896499999999999 2024-04-25T22:52:34.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:34.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975482+0000", 2024-04-25T22:52:34.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039297459999999996 2024-04-25T22:52:34.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:34.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975529+0000", 2024-04-25T22:52:34.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6387000000000002e-05 2024-04-25T22:52:34.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:34.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975563+0000", 2024-04-25T22:52:34.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4150000000000003e-05 2024-04-25T22:52:34.176 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:34.176 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:34.176 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:34.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.177 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:34.177 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:34.177 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.143529151999999, 2024-04-25T22:52:34.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012637705000000001, 2024-04-25T22:52:34.177 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:34.177 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:34.177 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:34.177 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:34.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:34.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:34.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:34.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:34.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:34.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:34.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:34.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012227+0000", 2024-04-25T22:52:34.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.863e-06 2024-04-25T22:52:34.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:34.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012236+0000", 2024-04-25T22:52:34.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1109999999999997e-06 2024-04-25T22:52:34.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:34.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012309+0000", 2024-04-25T22:52:34.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3242000000000001e-05 2024-04-25T22:52:34.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:34.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012324+0000", 2024-04-25T22:52:34.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4837e-05 2024-04-25T22:52:34.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:34.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015060+0000", 2024-04-25T22:52:34.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027363349999999999 2024-04-25T22:52:34.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:34.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015169+0000", 2024-04-25T22:52:34.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108372 2024-04-25T22:52:34.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:34.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015498+0000", 2024-04-25T22:52:34.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032949999999999999 2024-04-25T22:52:34.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:34.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021282+0000", 2024-04-25T22:52:34.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057836429999999998 2024-04-25T22:52:34.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:34.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024709+0000", 2024-04-25T22:52:34.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034271979999999998 2024-04-25T22:52:34.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:34.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024802+0000", 2024-04-25T22:52:34.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2960000000000004e-05 2024-04-25T22:52:34.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:34.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024863+0000", 2024-04-25T22:52:34.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0643999999999997e-05 2024-04-25T22:52:34.182 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:34.182 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:34.182 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:34.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.182 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:34.182 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:34.182 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.143405381000001, 2024-04-25T22:52:34.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012979447999999999, 2024-04-25T22:52:34.182 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:34.182 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:34.183 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:34.183 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:34.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:34.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:34.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:34.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:34.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:34.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:34.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:34.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:34.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:52:34.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:34.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012354+0000", 2024-04-25T22:52:34.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7740000000000004e-06 2024-04-25T22:52:34.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:34.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012365+0000", 2024-04-25T22:52:34.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.064e-05 2024-04-25T22:52:34.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:34.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012382+0000", 2024-04-25T22:52:34.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6999000000000001e-05 2024-04-25T22:52:34.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:34.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015958+0000", 2024-04-25T22:52:34.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035765699999999998 2024-04-25T22:52:34.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:34.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016037+0000", 2024-04-25T22:52:34.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8242000000000001e-05 2024-04-25T22:52:34.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:34.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016404+0000", 2024-04-25T22:52:34.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036784300000000002 2024-04-25T22:52:34.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:34.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021294+0000", 2024-04-25T22:52:34.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048890629999999999 2024-04-25T22:52:34.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:34.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024959+0000", 2024-04-25T22:52:34.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036651570000000001 2024-04-25T22:52:34.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:34.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025097+0000", 2024-04-25T22:52:34.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013788099999999999 2024-04-25T22:52:34.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:34.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025328+0000", 2024-04-25T22:52:34.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231492 2024-04-25T22:52:34.187 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:34.187 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:34.188 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:34.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.188 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:34.188 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:34.188 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.143317611999997, 2024-04-25T22:52:34.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013049827, 2024-04-25T22:52:34.188 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:34.188 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:34.188 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:34.188 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:34.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:34.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:34.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:34.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:34.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:34.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:34.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:34.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012437+0000", 2024-04-25T22:52:34.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-04-25T22:52:34.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:34.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012440+0000", 2024-04-25T22:52:34.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7609999999999999e-06 2024-04-25T22:52:34.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:34.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012449+0000", 2024-04-25T22:52:34.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.285e-06 2024-04-25T22:52:34.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:34.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012457+0000", 2024-04-25T22:52:34.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9510000000000006e-06 2024-04-25T22:52:34.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:34.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017106+0000", 2024-04-25T22:52:34.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046494220000000003 2024-04-25T22:52:34.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:34.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017223+0000", 2024-04-25T22:52:34.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116824 2024-04-25T22:52:34.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:34.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017345+0000", 2024-04-25T22:52:34.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122175 2024-04-25T22:52:34.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:34.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021299+0000", 2024-04-25T22:52:34.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039534879999999998 2024-04-25T22:52:34.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:34.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025398+0000", 2024-04-25T22:52:34.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040988960000000003 2024-04-25T22:52:34.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:34.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025439+0000", 2024-04-25T22:52:34.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0915999999999999e-05 2024-04-25T22:52:34.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:34.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025486+0000", 2024-04-25T22:52:34.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7534999999999998e-05 2024-04-25T22:52:34.193 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:34.193 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:34.193 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:34.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.193 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:34.193 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:34.193 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.143287461, 2024-04-25T22:52:34.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020988041999999998, 2024-04-25T22:52:34.193 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:34.193 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:34.193 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:34.193 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:34.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.194 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:34.194 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:34.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:34.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.194 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:34.194 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:34.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:34.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.194 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:34.194 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:34.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.99e-07 2024-04-25T22:52:34.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:34.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012470+0000", 2024-04-25T22:52:34.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2789999999999999e-06 2024-04-25T22:52:34.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:34.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012477+0000", 2024-04-25T22:52:34.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:52:34.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:34.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012500+0000", 2024-04-25T22:52:34.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2490999999999999e-05 2024-04-25T22:52:34.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:34.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021911+0000", 2024-04-25T22:52:34.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094114160000000006 2024-04-25T22:52:34.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:34.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022000+0000", 2024-04-25T22:52:34.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8601000000000001e-05 2024-04-25T22:52:34.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:34.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022359+0000", 2024-04-25T22:52:34.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035921999999999999 2024-04-25T22:52:34.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:34.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025541+0000", 2024-04-25T22:52:34.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031820619999999998 2024-04-25T22:52:34.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:34.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033375+0000", 2024-04-25T22:52:34.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078338379999999992 2024-04-25T22:52:34.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:34.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033415+0000", 2024-04-25T22:52:34.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9527000000000003e-05 2024-04-25T22:52:34.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.198 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:34.198 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033455+0000", 2024-04-25T22:52:34.198 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9932000000000003e-05 2024-04-25T22:52:34.198 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:34.198 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:34.198 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:34.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.198 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:34.198 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:34.198 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.143232267999998, 2024-04-25T22:52:34.198 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021043857999999999, 2024-04-25T22:52:34.199 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:34.199 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:34.199 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:34.199 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:34.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:34.199 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:34.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:34.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:34.199 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:34.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:34.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.200 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.200 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:34.200 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012523+0000", 2024-04-25T22:52:34.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.361e-06 2024-04-25T22:52:34.200 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.200 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.200 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:34.200 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012530+0000", 2024-04-25T22:52:34.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5440000000000004e-06 2024-04-25T22:52:34.200 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.200 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.200 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:34.200 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012541+0000", 2024-04-25T22:52:34.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1745e-05 2024-04-25T22:52:34.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:34.201 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012551+0000", 2024-04-25T22:52:34.201 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5789999999999993e-06 2024-04-25T22:52:34.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:34.201 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022709+0000", 2024-04-25T22:52:34.201 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010157685 2024-04-25T22:52:34.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:34.201 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022957+0000", 2024-04-25T22:52:34.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024824599999999998 2024-04-25T22:52:34.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.202 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.202 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:34.202 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023443+0000", 2024-04-25T22:52:34.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048578599999999999 2024-04-25T22:52:34.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.202 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.202 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:34.202 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025547+0000", 2024-04-25T22:52:34.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021044789999999998 2024-04-25T22:52:34.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.202 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:34.203 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033509+0000", 2024-04-25T22:52:34.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0079622180000000001 2024-04-25T22:52:34.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:34.203 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033542+0000", 2024-04-25T22:52:34.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3018000000000001e-05 2024-04-25T22:52:34.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:34.203 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033566+0000", 2024-04-25T22:52:34.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3197000000000002e-05 2024-04-25T22:52:34.204 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:34.204 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:34.204 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:34.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.204 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:34.204 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:34.204 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.143192302999999, 2024-04-25T22:52:34.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021122696, 2024-04-25T22:52:34.204 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:34.204 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:34.204 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:34.204 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:34.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:34.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:34.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:34.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:34.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:34.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:34.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:34.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:34.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:52:34.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:34.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012566+0000", 2024-04-25T22:52:34.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-04-25T22:52:34.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:34.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012619+0000", 2024-04-25T22:52:34.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2607e-05 2024-04-25T22:52:34.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:34.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012628+0000", 2024-04-25T22:52:34.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6500000000000008e-06 2024-04-25T22:52:34.207 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.207 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:34.207 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024024+0000", 2024-04-25T22:52:34.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011396007999999999 2024-04-25T22:52:34.207 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.207 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:34.207 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024198+0000", 2024-04-25T22:52:34.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000173215 2024-04-25T22:52:34.207 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.207 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:34.207 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024447+0000", 2024-04-25T22:52:34.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024898500000000002 2024-04-25T22:52:34.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:34.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026431+0000", 2024-04-25T22:52:34.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001984923 2024-04-25T22:52:34.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:34.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033608+0000", 2024-04-25T22:52:34.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071768459999999997 2024-04-25T22:52:34.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:34.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033646+0000", 2024-04-25T22:52:34.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299000000000003e-05 2024-04-25T22:52:34.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:34.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033684+0000", 2024-04-25T22:52:34.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8773000000000003e-05 2024-04-25T22:52:34.209 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:34.209 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:34.209 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:34.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.210 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:34.210 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:34.210 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.143103703999998, 2024-04-25T22:52:34.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021175381, 2024-04-25T22:52:34.210 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:34.210 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:34.210 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:34.210 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:34.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:34.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:34.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:34.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:34.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:34.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:34.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:34.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012651+0000", 2024-04-25T22:52:34.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:52:34.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:34.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012656+0000", 2024-04-25T22:52:34.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8899999999999998e-06 2024-04-25T22:52:34.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:34.212 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012666+0000", 2024-04-25T22:52:34.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0346999999999999e-05 2024-04-25T22:52:34.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:34.212 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012675+0000", 2024-04-25T22:52:34.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9930000000000001e-06 2024-04-25T22:52:34.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:34.212 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025661+0000", 2024-04-25T22:52:34.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01298531 2024-04-25T22:52:34.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.213 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:34.213 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025757+0000", 2024-04-25T22:52:34.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5822000000000005e-05 2024-04-25T22:52:34.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.213 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:34.213 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025907+0000", 2024-04-25T22:52:34.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015051499999999999 2024-04-25T22:52:34.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.213 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:34.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026435+0000", 2024-04-25T22:52:34.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052762200000000005 2024-04-25T22:52:34.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:34.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033732+0000", 2024-04-25T22:52:34.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072978419999999997 2024-04-25T22:52:34.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:34.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033787+0000", 2024-04-25T22:52:34.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4703999999999997e-05 2024-04-25T22:52:34.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:34.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033826+0000", 2024-04-25T22:52:34.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8458999999999999e-05 2024-04-25T22:52:34.215 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:34.215 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:34.215 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:34.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.215 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:34.215 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:34.215 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.143048290000003, 2024-04-25T22:52:34.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021244174000000001, 2024-04-25T22:52:34.215 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:34.216 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:34.216 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:34.216 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:34.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.216 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:34.216 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:34.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:34.216 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.216 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:34.216 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:34.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:34.216 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:34.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:34.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:52:34.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:34.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012712+0000", 2024-04-25T22:52:34.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.913e-06 2024-04-25T22:52:34.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:34.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012722+0000", 2024-04-25T22:52:34.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2879999999999998e-06 2024-04-25T22:52:34.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:34.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012727+0000", 2024-04-25T22:52:34.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8429999999999998e-06 2024-04-25T22:52:34.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:34.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026099+0000", 2024-04-25T22:52:34.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013371450999999999 2024-04-25T22:52:34.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:34.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026147+0000", 2024-04-25T22:52:34.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7837999999999998e-05 2024-04-25T22:52:34.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:34.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026254+0000", 2024-04-25T22:52:34.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107314 2024-04-25T22:52:34.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:34.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026686+0000", 2024-04-25T22:52:34.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000432428 2024-04-25T22:52:34.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:34.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033873+0000", 2024-04-25T22:52:34.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071864399999999997 2024-04-25T22:52:34.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:34.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033904+0000", 2024-04-25T22:52:34.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1321e-05 2024-04-25T22:52:34.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:34.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033950+0000", 2024-04-25T22:52:34.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5707999999999997e-05 2024-04-25T22:52:34.220 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:34.220 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:34.220 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:34.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.221 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:34.221 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:34.221 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.143017905000001, 2024-04-25T22:52:34.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01096505, 2024-04-25T22:52:34.221 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:34.221 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:34.221 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:34.221 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:34.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:34.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:34.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:34.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:34.222 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:34.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:34.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:34.222 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012737+0000", 2024-04-25T22:52:34.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:52:34.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:34.222 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012739+0000", 2024-04-25T22:52:34.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-04-25T22:52:34.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:34.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012743+0000", 2024-04-25T22:52:34.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3239999999999996e-06 2024-04-25T22:52:34.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:34.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012746+0000", 2024-04-25T22:52:34.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.129e-06 2024-04-25T22:52:34.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:34.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012796+0000", 2024-04-25T22:52:34.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9231999999999999e-05 2024-04-25T22:52:34.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:34.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012915+0000", 2024-04-25T22:52:34.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119021 2024-04-25T22:52:34.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:34.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013069+0000", 2024-04-25T22:52:34.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015463900000000001 2024-04-25T22:52:34.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:34.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019237+0000", 2024-04-25T22:52:34.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061680329999999998 2024-04-25T22:52:34.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:34.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023603+0000", 2024-04-25T22:52:34.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043655860000000003 2024-04-25T22:52:34.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:34.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023659+0000", 2024-04-25T22:52:34.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6484000000000003e-05 2024-04-25T22:52:34.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:34.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023701+0000", 2024-04-25T22:52:34.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1761999999999998e-05 2024-04-25T22:52:34.226 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:34.226 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:34.226 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:34.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.226 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:34.226 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:34.226 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.142992956999997, 2024-04-25T22:52:34.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011234429000000001, 2024-04-25T22:52:34.226 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:34.227 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:34.227 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:34.227 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:34.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:34.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:34.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:34.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:34.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:34.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:34.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.228 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:34.228 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012762+0000", 2024-04-25T22:52:34.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-04-25T22:52:34.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.228 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:34.228 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012765+0000", 2024-04-25T22:52:34.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2569999999999999e-06 2024-04-25T22:52:34.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.228 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:34.228 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012783+0000", 2024-04-25T22:52:34.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8431999999999999e-05 2024-04-25T22:52:34.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:34.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012799+0000", 2024-04-25T22:52:34.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5438999999999999e-05 2024-04-25T22:52:34.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:34.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013826+0000", 2024-04-25T22:52:34.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010275060000000001 2024-04-25T22:52:34.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:34.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013913+0000", 2024-04-25T22:52:34.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.708e-05 2024-04-25T22:52:34.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:34.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014098+0000", 2024-04-25T22:52:34.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018519399999999999 2024-04-25T22:52:34.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:34.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019684+0000", 2024-04-25T22:52:34.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055860079999999999 2024-04-25T22:52:34.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:34.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023876+0000", 2024-04-25T22:52:34.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041918800000000003 2024-04-25T22:52:34.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:34.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023957+0000", 2024-04-25T22:52:34.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1165e-05 2024-04-25T22:52:34.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:34.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023995+0000", 2024-04-25T22:52:34.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:52:34.231 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:34.231 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:34.231 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:34.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.232 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:34.232 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:34.232 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.142895178000003, 2024-04-25T22:52:34.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011131200000000001, 2024-04-25T22:52:34.232 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:34.232 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:34.232 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:34.232 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:34.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:34.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:34.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:34.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:34.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:34.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:34.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:34.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012860+0000", 2024-04-25T22:52:34.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3900000000000004e-07 2024-04-25T22:52:34.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:34.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012865+0000", 2024-04-25T22:52:34.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5609999999999998e-06 2024-04-25T22:52:34.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:34.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012895+0000", 2024-04-25T22:52:34.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9847000000000001e-05 2024-04-25T22:52:34.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:34.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012905+0000", 2024-04-25T22:52:34.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.03e-05 2024-04-25T22:52:34.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:34.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015020+0000", 2024-04-25T22:52:34.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021142940000000001 2024-04-25T22:52:34.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:34.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015182+0000", 2024-04-25T22:52:34.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016248099999999999 2024-04-25T22:52:34.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:52:34.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015357+0000", 2024-04-25T22:52:34.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017471000000000001 2024-04-25T22:52:34.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:34.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021021+0000", 2024-04-25T22:52:34.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056638340000000004 2024-04-25T22:52:34.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:34.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023712+0000", 2024-04-25T22:52:34.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026910380000000002 2024-04-25T22:52:34.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:34.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023763+0000", 2024-04-25T22:52:34.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1477999999999997e-05 2024-04-25T22:52:34.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:34.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023990+0000", 2024-04-25T22:52:34.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000226818 2024-04-25T22:52:34.237 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:34.237 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:34.237 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:34.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.237 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:34.237 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:34.237 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.142772082, 2024-04-25T22:52:34.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011705299000000001, 2024-04-25T22:52:34.237 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:34.237 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:34.238 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:34.238 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:34.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:34.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:34.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:34.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:34.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:34.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:34.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:34.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012983+0000", 2024-04-25T22:52:34.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:52:34.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:34.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012986+0000", 2024-04-25T22:52:34.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5700000000000001e-06 2024-04-25T22:52:34.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:34.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012993+0000", 2024-04-25T22:52:34.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8730000000000001e-06 2024-04-25T22:52:34.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:34.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013000+0000", 2024-04-25T22:52:34.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1890000000000001e-06 2024-04-25T22:52:34.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:34.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:52:34.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002147866 2024-04-25T22:52:34.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:34.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015351+0000", 2024-04-25T22:52:34.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020300799999999999 2024-04-25T22:52:34.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:34.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016260+0000", 2024-04-25T22:52:34.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00090926799999999997 2024-04-25T22:52:34.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:34.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022669+0000", 2024-04-25T22:52:34.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064082849999999997 2024-04-25T22:52:34.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:34.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024584+0000", 2024-04-25T22:52:34.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019151699999999999 2024-04-25T22:52:34.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:34.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024643+0000", 2024-04-25T22:52:34.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8888999999999998e-05 2024-04-25T22:52:34.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:34.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024687+0000", 2024-04-25T22:52:34.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4444999999999999e-05 2024-04-25T22:52:34.242 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:34.242 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:34.242 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:34.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.243 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:34.243 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:34.243 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.142744491000002, 2024-04-25T22:52:34.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011249699, 2024-04-25T22:52:34.243 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:34.243 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:34.243 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:34.243 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:34.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:34.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:34.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:34.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:34.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:34.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:34.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:34.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013010+0000", 2024-04-25T22:52:34.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2099999999999996e-07 2024-04-25T22:52:34.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:34.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013013+0000", 2024-04-25T22:52:34.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1310000000000002e-06 2024-04-25T22:52:34.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:34.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013020+0000", 2024-04-25T22:52:34.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3330000000000002e-06 2024-04-25T22:52:34.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:34.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013025+0000", 2024-04-25T22:52:34.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6760000000000004e-06 2024-04-25T22:52:34.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:34.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013163+0000", 2024-04-25T22:52:34.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013824599999999999 2024-04-25T22:52:34.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:34.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013504+0000", 2024-04-25T22:52:34.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034080299999999998 2024-04-25T22:52:34.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:34.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013613+0000", 2024-04-25T22:52:34.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108705 2024-04-25T22:52:34.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.247 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:34.247 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015831+0000", 2024-04-25T22:52:34.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002217672 2024-04-25T22:52:34.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.247 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:34.247 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024137+0000", 2024-04-25T22:52:34.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0083060489999999994 2024-04-25T22:52:34.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.247 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:34.248 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024218+0000", 2024-04-25T22:52:34.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1351000000000001e-05 2024-04-25T22:52:34.248 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.248 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:34.248 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024259+0000", 2024-04-25T22:52:34.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1112000000000002e-05 2024-04-25T22:52:34.248 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:34.248 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:34.248 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:34.248 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.248 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:34.248 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:34.249 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.142656764999998, 2024-04-25T22:52:34.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020379749999999999, 2024-04-25T22:52:34.249 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:34.249 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:34.249 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:34.249 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:34.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:34.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:34.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:34.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:34.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:34.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:34.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:34.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013098+0000", 2024-04-25T22:52:34.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:52:34.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:34.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013105+0000", 2024-04-25T22:52:34.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5969999999999997e-06 2024-04-25T22:52:34.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:34.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013190+0000", 2024-04-25T22:52:34.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5618999999999995e-05 2024-04-25T22:52:34.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:34.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013200+0000", 2024-04-25T22:52:34.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5859999999999994e-06 2024-04-25T22:52:34.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:34.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020265+0000", 2024-04-25T22:52:34.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070653349999999998 2024-04-25T22:52:34.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.252 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:34.252 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020454+0000", 2024-04-25T22:52:34.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189316 2024-04-25T22:52:34.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.252 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:34.252 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020586+0000", 2024-04-25T22:52:34.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013195700000000001 2024-04-25T22:52:34.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.252 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:34.252 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023822+0000", 2024-04-25T22:52:34.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032358529999999999 2024-04-25T22:52:34.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.253 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:34.253 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033409+0000", 2024-04-25T22:52:34.253 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095870520000000004 2024-04-25T22:52:34.253 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.253 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.253 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:34.253 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033447+0000", 2024-04-25T22:52:34.253 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7261999999999997e-05 2024-04-25T22:52:34.253 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.253 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.253 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:34.253 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033477+0000", 2024-04-25T22:52:34.253 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0389e-05 2024-04-25T22:52:34.253 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:34.254 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:34.254 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:34.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.254 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:34.254 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:34.254 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.142540259, 2024-04-25T22:52:34.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010857383999999999, 2024-04-25T22:52:34.254 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:34.254 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:34.254 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:34.254 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:34.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:34.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:34.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:34.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:34.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:34.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:34.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:34.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:34.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:52:34.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.256 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:34.256 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013218+0000", 2024-04-25T22:52:34.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8199999999999998e-06 2024-04-25T22:52:34.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.256 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:34.256 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013226+0000", 2024-04-25T22:52:34.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7649999999999993e-06 2024-04-25T22:52:34.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.256 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:34.256 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013259+0000", 2024-04-25T22:52:34.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2727e-05 2024-04-25T22:52:34.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.257 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:34.257 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014809+0000", 2024-04-25T22:52:34.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001550144 2024-04-25T22:52:34.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.257 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:34.257 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014958+0000", 2024-04-25T22:52:34.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014890300000000001 2024-04-25T22:52:34.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.257 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:52:34.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015087+0000", 2024-04-25T22:52:34.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012939200000000001 2024-04-25T22:52:34.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:34.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020212+0000", 2024-04-25T22:52:34.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051248939999999996 2024-04-25T22:52:34.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:34.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023699+0000", 2024-04-25T22:52:34.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034873289999999999 2024-04-25T22:52:34.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.259 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:34.259 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024014+0000", 2024-04-25T22:52:34.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031473999999999999 2024-04-25T22:52:34.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.259 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:34.259 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024071+0000", 2024-04-25T22:52:34.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7040000000000003e-05 2024-04-25T22:52:34.259 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:34.259 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:34.259 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:34.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.260 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:34.260 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:34.260 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.142485553999997, 2024-04-25T22:52:34.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012329677000000001, 2024-04-25T22:52:34.260 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:34.260 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:34.260 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:34.260 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:34.260 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.260 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:34.260 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:34.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:34.260 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.260 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.261 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:34.261 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:34.261 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:34.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.261 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:34.261 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013269+0000", 2024-04-25T22:52:34.261 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5000000000000002e-07 2024-04-25T22:52:34.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.261 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:34.261 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:52:34.261 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6909999999999999e-06 2024-04-25T22:52:34.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:34.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013284+0000", 2024-04-25T22:52:34.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0963e-05 2024-04-25T22:52:34.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:34.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013361+0000", 2024-04-25T22:52:34.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7379999999999994e-05 2024-04-25T22:52:34.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:34.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013448+0000", 2024-04-25T22:52:34.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6990000000000006e-05 2024-04-25T22:52:34.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:34.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013632+0000", 2024-04-25T22:52:34.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018396800000000001 2024-04-25T22:52:34.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:34.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013800+0000", 2024-04-25T22:52:34.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167467 2024-04-25T22:52:34.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:34.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.018570+0000", 2024-04-25T22:52:34.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047701460000000003 2024-04-25T22:52:34.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:34.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025507+0000", 2024-04-25T22:52:34.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069372039999999998 2024-04-25T22:52:34.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:34.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025562+0000", 2024-04-25T22:52:34.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4858999999999998e-05 2024-04-25T22:52:34.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.265 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.265 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:34.265 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025598+0000", 2024-04-25T22:52:34.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6259e-05 2024-04-25T22:52:34.265 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:34.265 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:34.265 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:34.265 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.265 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.265 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:34.265 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:34.265 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.142353681000003, 2024-04-25T22:52:34.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020176666999999999, 2024-04-25T22:52:34.266 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:34.266 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:34.266 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:52:34.266 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:34.266 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.266 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:34.266 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:34.266 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:34.266 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.266 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.266 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:34.266 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:34.266 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:34.266 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.267 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:34.267 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:52:34.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-04-25T22:52:34.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.267 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:34.267 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013405+0000", 2024-04-25T22:52:34.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0559999999999998e-06 2024-04-25T22:52:34.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.267 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:34.267 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013422+0000", 2024-04-25T22:52:34.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6770999999999999e-05 2024-04-25T22:52:34.268 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.268 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.268 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:34.268 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013431+0000", 2024-04-25T22:52:34.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5019999999999998e-06 2024-04-25T22:52:34.268 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.268 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.268 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:34.268 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021720+0000", 2024-04-25T22:52:34.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082884340000000008 2024-04-25T22:52:34.268 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.268 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.268 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:34.268 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022122+0000", 2024-04-25T22:52:34.269 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000401634 2024-04-25T22:52:34.269 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:34.269 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:34.269 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:34.269 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033577+0000", 2024-04-25T22:52:34.269 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011455435999999999 2024-04-25T22:52:34.269 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:34.269 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:34.269 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:34.269 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:34.269 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:34.269 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:34.271 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:52:34.272 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:34.270+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:34.372 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:34.370+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:34.380 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-25T22:52:34.381 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-25T22:52:34.381 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-25T22:52:34.381 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-25T22:52:34.391 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:52:34.472 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:34.472+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:34.493 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-25T22:52:34.493 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-25T22:52:34.493 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-25T22:52:34.493 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-25T22:52:34.494 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-25T22:52:34.502 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:52:34.573 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:34.573+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:34.647 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-25T22:52:34.647 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-25T22:52:34.647 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-25T22:52:34.647 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-25T22:52:34.647 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.647 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(mds.0.3:28 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:52:34.647 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.013845+0000", 2024-04-25T22:52:34.647 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 41.631434925999997, 2024-04-25T22:52:34.647 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002002658, 2024-04-25T22:52:34.647 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:34.647 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:34.648 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:34.648 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:34.648 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.648 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:34.648 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013845+0000", 2024-04-25T22:52:34.648 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:34.648 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.648 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.648 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:34.648 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013845+0000", 2024-04-25T22:52:34.648 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:34.648 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.648 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.648 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:34.648 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013845+0000", 2024-04-25T22:52:34.649 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6100000000000002e-07 2024-04-25T22:52:34.649 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.649 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.649 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:34.649 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013859+0000", 2024-04-25T22:52:34.649 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4045e-05 2024-04-25T22:52:34.649 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.649 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.649 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:34.649 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013883+0000", 2024-04-25T22:52:34.649 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4020999999999999e-05 2024-04-25T22:52:34.649 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.649 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.649 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:34.650 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013904+0000", 2024-04-25T22:52:34.650 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.084e-05 2024-04-25T22:52:34.650 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.650 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.650 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:34.650 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013953+0000", 2024-04-25T22:52:34.650 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8652000000000001e-05 2024-04-25T22:52:34.650 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.650 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.650 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:34.650 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013983+0000", 2024-04-25T22:52:34.650 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0083e-05 2024-04-25T22:52:34.650 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.651 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.651 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:34.651 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015809+0000", 2024-04-25T22:52:34.651 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001826708 2024-04-25T22:52:34.651 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.651 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.651 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:34.651 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015848+0000", 2024-04-25T22:52:34.651 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8047999999999999e-05 2024-04-25T22:52:34.651 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:34.651 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:34.651 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:34.651 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.651 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.651 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:34.652 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.014834+0000", 2024-04-25T22:52:34.652 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 41.630445330999997, 2024-04-25T22:52:34.652 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0082660119999999997, 2024-04-25T22:52:34.652 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:34.652 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:34.652 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:34.652 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:34.652 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.652 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:34.652 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014834+0000", 2024-04-25T22:52:34.652 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:34.652 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.652 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.652 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:34.653 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014834+0000", 2024-04-25T22:52:34.653 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:34.653 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.653 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.653 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:34.653 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014837+0000", 2024-04-25T22:52:34.653 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.774e-06 2024-04-25T22:52:34.653 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.653 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.653 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:34.653 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014844+0000", 2024-04-25T22:52:34.653 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.1629999999999999e-06 2024-04-25T22:52:34.653 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.653 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.653 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:34.654 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014853+0000", 2024-04-25T22:52:34.654 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0829999999999993e-06 2024-04-25T22:52:34.654 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.654 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.654 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:34.654 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014862+0000", 2024-04-25T22:52:34.654 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0239999999999997e-06 2024-04-25T22:52:34.654 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.654 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.654 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:34.654 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014926+0000", 2024-04-25T22:52:34.654 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4571000000000002e-05 2024-04-25T22:52:34.654 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.655 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.655 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:34.655 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015064+0000", 2024-04-25T22:52:34.655 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013788200000000001 2024-04-25T22:52:34.655 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.655 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.655 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:34.655 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015240+0000", 2024-04-25T22:52:34.655 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000175697 2024-04-25T22:52:34.655 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.655 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.655 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:34.655 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017382+0000", 2024-04-25T22:52:34.655 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021422920000000001 2024-04-25T22:52:34.655 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.656 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.656 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:34.656 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023016+0000", 2024-04-25T22:52:34.656 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00563446 2024-04-25T22:52:34.656 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.656 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.656 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:34.656 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023062+0000", 2024-04-25T22:52:34.656 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5667999999999997e-05 2024-04-25T22:52:34.656 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.656 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.656 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:34.656 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023100+0000", 2024-04-25T22:52:34.656 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8398000000000001e-05 2024-04-25T22:52:34.657 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:34.657 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:34.657 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:34.657 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.657 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.657 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:34.657 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.014883+0000", 2024-04-25T22:52:34.657 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 41.630397113000001, 2024-04-25T22:52:34.657 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0083115319999999999, 2024-04-25T22:52:34.657 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:34.657 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:34.657 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:34.657 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:34.658 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.658 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:34.658 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014883+0000", 2024-04-25T22:52:34.658 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:34.658 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.658 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.658 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:34.658 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014883+0000", 2024-04-25T22:52:34.658 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:34.658 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.658 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.658 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:34.658 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014883+0000", 2024-04-25T22:52:34.658 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1200000000000003e-07 2024-04-25T22:52:34.659 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.659 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.659 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:34.659 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014887+0000", 2024-04-25T22:52:34.659 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4249999999999998e-06 2024-04-25T22:52:34.659 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.659 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.659 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:34.659 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014892+0000", 2024-04-25T22:52:34.659 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1150000000000002e-06 2024-04-25T22:52:34.659 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.659 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.659 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:34.659 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014896+0000", 2024-04-25T22:52:34.660 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3030000000000001e-06 2024-04-25T22:52:34.660 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.660 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.660 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:34.660 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015597+0000", 2024-04-25T22:52:34.660 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00070106400000000005 2024-04-25T22:52:34.660 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.660 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.660 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:34.660 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015681+0000", 2024-04-25T22:52:34.660 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.3417000000000004e-05 2024-04-25T22:52:34.660 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.660 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.660 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:34.661 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015800+0000", 2024-04-25T22:52:34.661 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000119522 2024-04-25T22:52:34.661 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.661 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.661 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:34.661 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017389+0000", 2024-04-25T22:52:34.661 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0015889739999999999 2024-04-25T22:52:34.661 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.661 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.661 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:34.661 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023129+0000", 2024-04-25T22:52:34.661 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0057398420000000002 2024-04-25T22:52:34.661 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.661 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.662 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:34.662 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023161+0000", 2024-04-25T22:52:34.662 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2002999999999998e-05 2024-04-25T22:52:34.662 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.662 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.662 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:34.662 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023194+0000", 2024-04-25T22:52:34.662 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3355000000000002e-05 2024-04-25T22:52:34.662 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:34.662 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:34.662 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:34.662 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.662 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.662 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:34.663 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.014902+0000", 2024-04-25T22:52:34.663 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 41.630377467999999, 2024-04-25T22:52:34.663 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0078159460000000007, 2024-04-25T22:52:34.663 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:34.663 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:34.663 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:34.663 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:34.663 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.663 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:34.663 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014902+0000", 2024-04-25T22:52:34.663 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:34.663 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.663 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.663 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:34.664 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014902+0000", 2024-04-25T22:52:34.664 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:34.664 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.664 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.664 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:34.664 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014903+0000", 2024-04-25T22:52:34.664 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.65e-07 2024-04-25T22:52:34.664 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.664 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.664 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:34.664 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014910+0000", 2024-04-25T22:52:34.664 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7619999999999995e-06 2024-04-25T22:52:34.664 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.664 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.664 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:34.665 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014915+0000", 2024-04-25T22:52:34.665 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2660000000000003e-06 2024-04-25T22:52:34.665 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.665 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.665 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:34.665 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014918+0000", 2024-04-25T22:52:34.665 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.331e-06 2024-04-25T22:52:34.665 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.665 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.665 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:34.665 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015554+0000", 2024-04-25T22:52:34.665 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00063627599999999996 2024-04-25T22:52:34.665 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.665 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.666 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:34.666 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015685+0000", 2024-04-25T22:52:34.666 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013059399999999999 2024-04-25T22:52:34.666 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.666 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.666 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:34.666 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015820+0000", 2024-04-25T22:52:34.666 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013471499999999999 2024-04-25T22:52:34.666 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.666 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.666 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:34.666 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017394+0000", 2024-04-25T22:52:34.666 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0015747459999999999 2024-04-25T22:52:34.666 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.667 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.667 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:34.667 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022598+0000", 2024-04-25T22:52:34.667 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.005203811 2024-04-25T22:52:34.667 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.667 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.667 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:34.667 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022671+0000", 2024-04-25T22:52:34.667 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3042999999999998e-05 2024-04-25T22:52:34.667 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.667 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.667 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:34.667 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022718+0000", 2024-04-25T22:52:34.667 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7136999999999999e-05 2024-04-25T22:52:34.668 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:34.668 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:34.668 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:34.668 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.668 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.668 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:34.668 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.014933+0000", 2024-04-25T22:52:34.668 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 41.630347094000001, 2024-04-25T22:52:34.668 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079271519999999998, 2024-04-25T22:52:34.668 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:34.668 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:34.668 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:34.668 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:34.668 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.668 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:34.669 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014933+0000", 2024-04-25T22:52:34.669 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:34.669 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.669 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.669 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:34.669 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014933+0000", 2024-04-25T22:52:34.669 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:34.669 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.669 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.669 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:34.669 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014933+0000", 2024-04-25T22:52:34.669 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0999999999999999e-07 2024-04-25T22:52:34.669 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.669 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.670 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:34.670 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014937+0000", 2024-04-25T22:52:34.670 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6090000000000001e-06 2024-04-25T22:52:34.670 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.670 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.670 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:34.670 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014943+0000", 2024-04-25T22:52:34.670 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.7100000000000001e-06 2024-04-25T22:52:34.670 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.670 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.670 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:34.670 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014949+0000", 2024-04-25T22:52:34.670 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9410000000000004e-06 2024-04-25T22:52:34.670 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.670 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.671 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:34.671 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016135+0000", 2024-04-25T22:52:34.671 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0011854750000000001 2024-04-25T22:52:34.671 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.671 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.671 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:34.671 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016185+0000", 2024-04-25T22:52:34.671 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.9888000000000001e-05 2024-04-25T22:52:34.671 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.671 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.671 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:34.671 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016297+0000", 2024-04-25T22:52:34.671 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011231299999999999 2024-04-25T22:52:34.671 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.672 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.672 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:34.672 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017399+0000", 2024-04-25T22:52:34.672 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0011018149999999999 2024-04-25T22:52:34.672 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.672 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.672 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:34.672 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022764+0000", 2024-04-25T22:52:34.672 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0053649819999999999 2024-04-25T22:52:34.672 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.672 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.672 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:34.672 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022821+0000", 2024-04-25T22:52:34.672 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7655000000000003e-05 2024-04-25T22:52:34.673 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.673 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.673 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:34.673 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022860+0000", 2024-04-25T22:52:34.673 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8353999999999999e-05 2024-04-25T22:52:34.673 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:34.673 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:34.673 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:34.673 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.673 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.673 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:34.673 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.014957+0000", 2024-04-25T22:52:34.673 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 41.630323263000001, 2024-04-25T22:52:34.673 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0083856810000000007, 2024-04-25T22:52:34.673 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:34.674 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:34.674 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:34.674 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:34.674 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.674 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:34.674 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014957+0000", 2024-04-25T22:52:34.674 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:34.674 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.674 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.674 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:34.674 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014957+0000", 2024-04-25T22:52:34.674 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:34.674 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.675 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.675 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:34.675 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014957+0000", 2024-04-25T22:52:34.675 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:52:34.675 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.675 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.675 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:34.675 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014961+0000", 2024-04-25T22:52:34.675 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2309999999999998e-06 2024-04-25T22:52:34.675 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.675 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.675 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:34.675 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014969+0000", 2024-04-25T22:52:34.675 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2540000000000003e-06 2024-04-25T22:52:34.676 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.676 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.676 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:34.676 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014972+0000", 2024-04-25T22:52:34.676 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4580000000000002e-06 2024-04-25T22:52:34.676 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.676 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.676 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:34.676 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016130+0000", 2024-04-25T22:52:34.676 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001157812 2024-04-25T22:52:34.676 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.676 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.676 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:34.676 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016247+0000", 2024-04-25T22:52:34.676 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000117268 2024-04-25T22:52:34.677 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.677 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.677 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:34.677 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016381+0000", 2024-04-25T22:52:34.677 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013417999999999999 2024-04-25T22:52:34.677 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.677 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.677 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:34.677 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017946+0000", 2024-04-25T22:52:34.677 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001564817 2024-04-25T22:52:34.677 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.677 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.677 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:34.677 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023240+0000", 2024-04-25T22:52:34.678 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0052938289999999999 2024-04-25T22:52:34.678 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.678 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.678 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:34.678 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023295+0000", 2024-04-25T22:52:34.678 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4969999999999997e-05 2024-04-25T22:52:34.678 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.678 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.678 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:34.678 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023342+0000", 2024-04-25T22:52:34.678 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7126000000000002e-05 2024-04-25T22:52:34.678 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:34.678 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:34.679 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:34.679 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.679 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.679 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:34.679 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.014978+0000", 2024-04-25T22:52:34.679 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 41.630302145000002, 2024-04-25T22:52:34.679 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0074058609999999997, 2024-04-25T22:52:34.679 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:34.679 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:34.680 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:34.680 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:34.680 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.680 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:34.680 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014978+0000", 2024-04-25T22:52:34.680 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:34.680 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.680 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.680 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:34.680 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014978+0000", 2024-04-25T22:52:34.680 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:34.680 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.680 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.680 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:34.681 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014978+0000", 2024-04-25T22:52:34.681 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0600000000000001e-07 2024-04-25T22:52:34.681 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.681 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.681 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:34.681 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014980+0000", 2024-04-25T22:52:34.681 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3130000000000001e-06 2024-04-25T22:52:34.681 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.681 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.681 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:34.681 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014984+0000", 2024-04-25T22:52:34.681 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6689999999999999e-06 2024-04-25T22:52:34.681 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.681 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.682 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:34.682 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014987+0000", 2024-04-25T22:52:34.682 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0709999999999999e-06 2024-04-25T22:52:34.682 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.682 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.682 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:34.682 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015035+0000", 2024-04-25T22:52:34.682 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7737000000000001e-05 2024-04-25T22:52:34.682 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.682 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.682 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:34.682 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:52:34.682 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113053 2024-04-25T22:52:34.683 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.683 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.683 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:34.683 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015255+0000", 2024-04-25T22:52:34.683 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010735599999999999 2024-04-25T22:52:34.683 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.683 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.683 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:34.683 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016248+0000", 2024-04-25T22:52:34.683 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00099310200000000005 2024-04-25T22:52:34.683 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.683 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.683 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:34.683 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022282+0000", 2024-04-25T22:52:34.683 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060341769999999999 2024-04-25T22:52:34.684 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.684 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.684 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:34.684 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022341+0000", 2024-04-25T22:52:34.684 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8938999999999999e-05 2024-04-25T22:52:34.684 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.684 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.684 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:34.684 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022384+0000", 2024-04-25T22:52:34.684 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2138000000000002e-05 2024-04-25T22:52:34.684 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:34.684 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:34.684 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:34.684 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.685 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.685 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:34.685 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.014995+0000", 2024-04-25T22:52:34.685 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 41.630284402000001, 2024-04-25T22:52:34.685 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075678170000000001, 2024-04-25T22:52:34.685 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:34.685 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:34.685 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-25T22:52:34.685 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:34.685 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.685 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:34.685 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014995+0000", 2024-04-25T22:52:34.685 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:34.685 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.686 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.686 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:34.686 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014995+0000", 2024-04-25T22:52:34.686 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:34.686 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.686 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.686 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:34.686 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014996+0000", 2024-04-25T22:52:34.686 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7500000000000001e-07 2024-04-25T22:52:34.686 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.686 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.686 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:34.686 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014998+0000", 2024-04-25T22:52:34.686 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2330000000000001e-06 2024-04-25T22:52:34.687 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.687 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.687 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:34.687 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015002+0000", 2024-04-25T22:52:34.687 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9570000000000004e-06 2024-04-25T22:52:34.687 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.687 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.687 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:34.687 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015008+0000", 2024-04-25T22:52:34.687 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0340000000000002e-06 2024-04-25T22:52:34.687 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.687 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.687 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:34.687 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015476+0000", 2024-04-25T22:52:34.688 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00046806899999999999 2024-04-25T22:52:34.688 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.688 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.688 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:34.688 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015565+0000", 2024-04-25T22:52:34.688 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.9126e-05 2024-04-25T22:52:34.688 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.688 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.688 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:34.688 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022563+0000", 2024-04-25T22:52:34.688 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0069981230000000002 2024-04-25T22:52:34.688 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:34.688 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:34.689 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:34.689 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.689 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.689 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:34.689 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.015033+0000", 2024-04-25T22:52:34.689 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 41.630246348, 2024-04-25T22:52:34.689 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010204922999999999, 2024-04-25T22:52:34.689 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:34.689 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:34.689 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-25T22:52:34.689 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:34.689 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.689 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:34.689 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015033+0000", 2024-04-25T22:52:34.690 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:34.690 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.690 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.690 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:34.690 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015033+0000", 2024-04-25T22:52:34.690 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:34.690 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.690 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.690 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:34.690 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015036+0000", 2024-04-25T22:52:34.690 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9110000000000002e-06 2024-04-25T22:52:34.690 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.690 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.690 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:34.691 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015040+0000", 2024-04-25T22:52:34.691 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0570000000000003e-06 2024-04-25T22:52:34.691 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.691 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.691 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:34.691 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015050+0000", 2024-04-25T22:52:34.691 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1449999999999997e-06 2024-04-25T22:52:34.691 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.691 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.691 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:34.691 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015058+0000", 2024-04-25T22:52:34.691 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.3960000000000006e-06 2024-04-25T22:52:34.691 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.692 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.692 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:34.692 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016951+0000", 2024-04-25T22:52:34.692 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0018930150000000001 2024-04-25T22:52:34.692 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.692 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.692 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:34.692 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017101+0000", 2024-04-25T22:52:34.692 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00015004800000000001 2024-04-25T22:52:34.692 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.692 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.692 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:34.692 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.025238+0000", 2024-04-25T22:52:34.693 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0081373509999999993 2024-04-25T22:52:34.693 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:34.693 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:34.693 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:34.693 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.693 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.693 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:34.693 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.015069+0000", 2024-04-25T22:52:34.693 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 41.630210413999997, 2024-04-25T22:52:34.693 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0066281769999999999, 2024-04-25T22:52:34.693 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:34.693 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:34.693 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-25T22:52:34.693 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:34.694 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.694 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:34.694 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015069+0000", 2024-04-25T22:52:34.694 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:34.694 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.694 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.694 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:34.694 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015069+0000", 2024-04-25T22:52:34.694 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:34.694 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.694 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.694 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:34.694 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015070+0000", 2024-04-25T22:52:34.695 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8899999999999999e-07 2024-04-25T22:52:34.695 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.695 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.695 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:34.695 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015082+0000", 2024-04-25T22:52:34.695 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.164e-05 2024-04-25T22:52:34.695 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.695 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.695 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:34.695 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015093+0000", 2024-04-25T22:52:34.695 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1066e-05 2024-04-25T22:52:34.695 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.695 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.695 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:34.696 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015099+0000", 2024-04-25T22:52:34.696 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8619999999999999e-06 2024-04-25T22:52:34.696 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.696 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.696 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:34.696 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:52:34.696 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.9821000000000003e-05 2024-04-25T22:52:34.696 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.696 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.696 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:34.696 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015221+0000", 2024-04-25T22:52:34.696 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2868999999999996e-05 2024-04-25T22:52:34.696 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.696 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.697 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:34.697 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021698+0000", 2024-04-25T22:52:34.697 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064762300000000004 2024-04-25T22:52:34.697 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:34.697 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:34.697 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:34.697 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.697 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.697 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:52:34.697 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.016597+0000", 2024-04-25T22:52:34.697 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 41.628682771999998, 2024-04-25T22:52:34.697 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001422113, 2024-04-25T22:52:34.697 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:34.697 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:34.698 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:34.698 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:34.698 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.698 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:34.698 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016597+0000", 2024-04-25T22:52:34.698 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:34.698 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.698 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.698 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:34.698 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016597+0000", 2024-04-25T22:52:34.698 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:34.698 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.698 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.698 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:34.699 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016598+0000", 2024-04-25T22:52:34.699 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2900000000000004e-07 2024-04-25T22:52:34.699 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.699 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.699 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:34.699 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016616+0000", 2024-04-25T22:52:34.699 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8876e-05 2024-04-25T22:52:34.699 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.699 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.699 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:34.699 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016626+0000", 2024-04-25T22:52:34.699 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.8900000000000002e-06 2024-04-25T22:52:34.699 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.699 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.700 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:34.700 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016634+0000", 2024-04-25T22:52:34.700 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7060000000000004e-06 2024-04-25T22:52:34.700 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.700 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.700 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:34.700 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016706+0000", 2024-04-25T22:52:34.700 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2102999999999997e-05 2024-04-25T22:52:34.700 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.700 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.700 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:34.700 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016727+0000", 2024-04-25T22:52:34.700 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0687e-05 2024-04-25T22:52:34.700 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.701 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.701 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:34.701 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017972+0000", 2024-04-25T22:52:34.701 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0012454829999999999 2024-04-25T22:52:34.701 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.701 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.701 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:34.701 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.018019+0000", 2024-04-25T22:52:34.701 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6839000000000003e-05 2024-04-25T22:52:34.701 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:34.701 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:34.701 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:34.701 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.701 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.702 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-25T22:52:34.702 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.016652+0000", 2024-04-25T22:52:34.702 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 41.628628157999998, 2024-04-25T22:52:34.702 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004473599, 2024-04-25T22:52:34.702 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:34.702 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:34.702 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:34.702 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:34.702 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.702 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:34.702 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016652+0000", 2024-04-25T22:52:34.702 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:34.703 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.703 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.703 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:34.703 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016652+0000", 2024-04-25T22:52:34.703 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:34.703 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.703 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.703 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:34.703 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016652+0000", 2024-04-25T22:52:34.703 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1899999999999998e-07 2024-04-25T22:52:34.703 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.703 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.703 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:34.703 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016657+0000", 2024-04-25T22:52:34.704 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4680000000000003e-06 2024-04-25T22:52:34.704 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.704 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.704 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:34.704 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016664+0000", 2024-04-25T22:52:34.704 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8210000000000002e-06 2024-04-25T22:52:34.704 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.704 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.704 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:34.704 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016669+0000", 2024-04-25T22:52:34.704 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8520000000000003e-06 2024-04-25T22:52:34.704 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.704 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.704 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:34.705 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016779+0000", 2024-04-25T22:52:34.705 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000109444 2024-04-25T22:52:34.705 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.705 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.705 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:34.705 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016798+0000", 2024-04-25T22:52:34.705 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9799000000000001e-05 2024-04-25T22:52:34.705 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.705 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.705 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:34.705 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021086+0000", 2024-04-25T22:52:34.705 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042879889999999999 2024-04-25T22:52:34.705 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.705 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.705 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:34.706 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021125+0000", 2024-04-25T22:52:34.706 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8807000000000003e-05 2024-04-25T22:52:34.706 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:34.706 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:34.706 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:34.706 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.706 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.706 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-25T22:52:34.706 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.016733+0000", 2024-04-25T22:52:34.706 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 41.628547259000001, 2024-04-25T22:52:34.706 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004231612, 2024-04-25T22:52:34.706 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:34.706 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:34.707 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:34.707 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:34.707 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.707 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:34.707 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016733+0000", 2024-04-25T22:52:34.707 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:34.707 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.707 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.707 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:34.707 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016733+0000", 2024-04-25T22:52:34.707 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:34.707 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.707 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.707 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:34.708 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016733+0000", 2024-04-25T22:52:34.708 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2100000000000002e-07 2024-04-25T22:52:34.708 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.708 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.708 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:34.708 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016756+0000", 2024-04-25T22:52:34.708 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2886000000000001e-05 2024-04-25T22:52:34.708 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.708 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.708 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:34.708 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016765+0000", 2024-04-25T22:52:34.708 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.3610000000000007e-06 2024-04-25T22:52:34.708 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.708 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.708 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:34.709 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016771+0000", 2024-04-25T22:52:34.709 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0020000000000003e-06 2024-04-25T22:52:34.709 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.709 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.709 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:34.709 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017050+0000", 2024-04-25T22:52:34.709 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00027877199999999999 2024-04-25T22:52:34.709 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.709 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.709 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:34.709 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017067+0000", 2024-04-25T22:52:34.709 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7499e-05 2024-04-25T22:52:34.709 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.709 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.710 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:34.710 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.020921+0000", 2024-04-25T22:52:34.710 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003853123 2024-04-25T22:52:34.710 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.710 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.710 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:34.710 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.020964+0000", 2024-04-25T22:52:34.710 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3547999999999997e-05 2024-04-25T22:52:34.710 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:34.710 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:34.710 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:34.710 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.710 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.711 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 1 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:52:34.711 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.019562+0000", 2024-04-25T22:52:34.711 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 41.625718214999999, 2024-04-25T22:52:34.711 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0045866930000000002, 2024-04-25T22:52:34.711 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:34.711 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:34.711 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "reached pg", 2024-04-25T22:52:34.711 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:34.711 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.711 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:34.711 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.019562+0000", 2024-04-25T22:52:34.711 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:34.711 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.711 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.712 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:34.712 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.019562+0000", 2024-04-25T22:52:34.712 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:34.712 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.712 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.712 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:34.712 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.019562+0000", 2024-04-25T22:52:34.712 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0100000000000005e-07 2024-04-25T22:52:34.712 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.712 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.712 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:34.712 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.019570+0000", 2024-04-25T22:52:34.712 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5599999999999996e-06 2024-04-25T22:52:34.712 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.712 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.713 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:34.713 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.019586+0000", 2024-04-25T22:52:34.713 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6086000000000002e-05 2024-04-25T22:52:34.713 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.713 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.713 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:34.713 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.019600+0000", 2024-04-25T22:52:34.713 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3934000000000001e-05 2024-04-25T22:52:34.713 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.713 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.713 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:34.713 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.019889+0000", 2024-04-25T22:52:34.713 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00028888200000000002 2024-04-25T22:52:34.713 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.714 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.714 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:34.714 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.024148+0000", 2024-04-25T22:52:34.714 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042597299999999998 2024-04-25T22:52:34.714 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:34.714 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:34.714 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:34.714 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.714 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.714 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-25T22:52:34.714 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.021542+0000", 2024-04-25T22:52:34.714 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 41.623737961000003, 2024-04-25T22:52:34.714 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001339589, 2024-04-25T22:52:34.715 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:34.715 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:34.715 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-25T22:52:34.715 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:34.715 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.715 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:34.715 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021542+0000", 2024-04-25T22:52:34.715 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:34.715 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.715 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.715 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:34.715 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021542+0000", 2024-04-25T22:52:34.715 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:34.715 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.716 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.716 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:34.716 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021542+0000", 2024-04-25T22:52:34.716 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1600000000000002e-07 2024-04-25T22:52:34.716 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.716 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.716 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:34.716 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021545+0000", 2024-04-25T22:52:34.716 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.774e-06 2024-04-25T22:52:34.716 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.716 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.716 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:34.716 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021553+0000", 2024-04-25T22:52:34.716 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.2099999999999993e-06 2024-04-25T22:52:34.717 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.717 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.717 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:34.717 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021559+0000", 2024-04-25T22:52:34.717 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.1249999999999998e-06 2024-04-25T22:52:34.717 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.717 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.717 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:34.717 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022752+0000", 2024-04-25T22:52:34.717 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0011931120000000001 2024-04-25T22:52:34.717 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.717 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.717 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:34.718 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022759+0000", 2024-04-25T22:52:34.718 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4420000000000003e-06 2024-04-25T22:52:34.718 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.718 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.718 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:34.718 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022881+0000", 2024-04-25T22:52:34.718 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012250999999999999 2024-04-25T22:52:34.718 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:34.718 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:34.718 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:34.719 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.719 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.719 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e14/12 ondisk, result = 0)", 2024-04-25T22:52:34.719 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.021769+0000", 2024-04-25T22:52:34.719 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 41.623510697, 2024-04-25T22:52:34.719 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001336928, 2024-04-25T22:52:34.719 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:34.719 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:34.719 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-25T22:52:34.719 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:34.719 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.719 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:34.719 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021769+0000", 2024-04-25T22:52:34.719 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:34.720 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.720 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.720 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:34.720 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021769+0000", 2024-04-25T22:52:34.720 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:34.720 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.720 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.720 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:34.720 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021770+0000", 2024-04-25T22:52:34.720 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7700000000000005e-07 2024-04-25T22:52:34.720 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.720 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.720 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:34.720 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021773+0000", 2024-04-25T22:52:34.721 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5250000000000001e-06 2024-04-25T22:52:34.721 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.721 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.721 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:34.721 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021780+0000", 2024-04-25T22:52:34.721 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.187e-06 2024-04-25T22:52:34.721 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.721 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.721 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:34.721 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021796+0000", 2024-04-25T22:52:34.721 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5218000000000001e-05 2024-04-25T22:52:34.721 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.721 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.721 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:34.721 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023001+0000", 2024-04-25T22:52:34.722 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001205993 2024-04-25T22:52:34.722 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.722 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.722 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:34.722 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023009+0000", 2024-04-25T22:52:34.722 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9249999999999995e-06 2024-04-25T22:52:34.722 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.722 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.722 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:34.722 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023106+0000", 2024-04-25T22:52:34.722 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6602999999999996e-05 2024-04-25T22:52:34.722 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:34.722 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:34.723 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:34.723 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.723 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.723 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-25T22:52:34.723 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.021807+0000", 2024-04-25T22:52:34.723 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 41.623472305999996, 2024-04-25T22:52:34.723 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0013936809999999999, 2024-04-25T22:52:34.723 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:34.723 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:34.723 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-25T22:52:34.723 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:34.723 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.723 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:34.723 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021807+0000", 2024-04-25T22:52:34.723 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:34.724 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.724 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.724 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:34.724 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021807+0000", 2024-04-25T22:52:34.724 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:34.724 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.724 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.724 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:34.724 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021808+0000", 2024-04-25T22:52:34.724 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3200000000000001e-07 2024-04-25T22:52:34.724 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.724 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.724 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:34.725 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021811+0000", 2024-04-25T22:52:34.725 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5480000000000002e-06 2024-04-25T22:52:34.725 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.725 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.725 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:34.725 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021818+0000", 2024-04-25T22:52:34.725 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4450000000000001e-06 2024-04-25T22:52:34.725 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.725 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.726 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:34.726 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021823+0000", 2024-04-25T22:52:34.726 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.22e-06 2024-04-25T22:52:34.726 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.726 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.726 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:34.726 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023122+0000", 2024-04-25T22:52:34.726 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001298808 2024-04-25T22:52:34.726 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.726 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.726 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:34.726 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023126+0000", 2024-04-25T22:52:34.726 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9400000000000004e-06 2024-04-25T22:52:34.726 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.727 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.727 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:34.727 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023201+0000", 2024-04-25T22:52:34.727 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5388000000000004e-05 2024-04-25T22:52:34.727 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:34.727 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:34.727 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:34.727 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.727 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.727 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-25T22:52:34.727 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:55.010264+0000", 2024-04-25T22:52:34.727 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 39.635016125, 2024-04-25T22:52:34.727 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001484476, 2024-04-25T22:52:34.728 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:34.728 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:34.728 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:34.728 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:34.728 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.728 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:34.728 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010264+0000", 2024-04-25T22:52:34.728 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:34.728 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.728 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.729 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:34.729 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010264+0000", 2024-04-25T22:52:34.729 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:34.729 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.730 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.730 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:34.730 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010265+0000", 2024-04-25T22:52:34.730 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5e-06 2024-04-25T22:52:34.730 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.730 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.730 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:34.730 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010272+0000", 2024-04-25T22:52:34.730 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0910000000000004e-06 2024-04-25T22:52:34.730 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.730 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.730 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:34.730 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010287+0000", 2024-04-25T22:52:34.731 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4644000000000001e-05 2024-04-25T22:52:34.731 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.731 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.731 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:34.731 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010296+0000", 2024-04-25T22:52:34.731 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2159999999999995e-06 2024-04-25T22:52:34.731 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.731 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.731 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:34.731 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010394+0000", 2024-04-25T22:52:34.731 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.8148999999999998e-05 2024-04-25T22:52:34.731 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.731 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.732 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:34.732 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010503+0000", 2024-04-25T22:52:34.732 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000108857 2024-04-25T22:52:34.732 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.732 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.732 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:34.732 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010592+0000", 2024-04-25T22:52:34.732 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.9083000000000001e-05 2024-04-25T22:52:34.732 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.732 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.732 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:34.732 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.011161+0000", 2024-04-25T22:52:34.732 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00056919800000000003 2024-04-25T22:52:34.732 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.733 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.733 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:34.733 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.011676+0000", 2024-04-25T22:52:34.733 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00051500999999999999 2024-04-25T22:52:34.733 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.733 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.733 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:34.733 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.011717+0000", 2024-04-25T22:52:34.733 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0262999999999997e-05 2024-04-25T22:52:34.733 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.733 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.733 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:34.733 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.011748+0000", 2024-04-25T22:52:34.734 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1464999999999998e-05 2024-04-25T22:52:34.734 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:34.734 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:34.734 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:34.734 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.734 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.734 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-25T22:52:34.734 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:52:17.012790+0000", 2024-04-25T22:52:34.734 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 17.632490280999999, 2024-04-25T22:52:34.734 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001434444, 2024-04-25T22:52:34.734 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:34.734 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:34.734 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:34.735 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:34.735 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.735 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:34.735 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.012790+0000", 2024-04-25T22:52:34.735 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:34.735 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.735 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.735 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:34.735 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.012790+0000", 2024-04-25T22:52:34.735 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:34.735 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.735 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.735 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:34.735 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.012791+0000", 2024-04-25T22:52:34.736 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0699999999999999e-06 2024-04-25T22:52:34.736 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.736 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.736 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:34.736 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.012797+0000", 2024-04-25T22:52:34.736 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0519999999999998e-06 2024-04-25T22:52:34.736 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.736 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.736 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:34.736 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.012811+0000", 2024-04-25T22:52:34.736 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4287999999999999e-05 2024-04-25T22:52:34.736 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.736 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.737 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:34.737 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.012838+0000", 2024-04-25T22:52:34.737 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6727999999999999e-05 2024-04-25T22:52:34.737 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.737 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.737 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:34.737 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.012909+0000", 2024-04-25T22:52:34.737 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.1211000000000006e-05 2024-04-25T22:52:34.737 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.737 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.737 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:34.737 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.013015+0000", 2024-04-25T22:52:34.737 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010619 2024-04-25T22:52:34.737 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.737 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.737 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:34.738 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.013189+0000", 2024-04-25T22:52:34.738 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00017439199999999999 2024-04-25T22:52:34.738 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.738 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.738 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:34.738 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.013903+0000", 2024-04-25T22:52:34.738 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00071379099999999997 2024-04-25T22:52:34.738 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.738 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.738 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:34.738 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.014159+0000", 2024-04-25T22:52:34.738 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00025561699999999998 2024-04-25T22:52:34.738 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.738 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.738 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:34.739 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.014192+0000", 2024-04-25T22:52:34.739 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2941000000000002e-05 2024-04-25T22:52:34.739 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.739 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.739 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:34.739 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.014224+0000", 2024-04-25T22:52:34.739 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2163999999999999e-05 2024-04-25T22:52:34.739 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:34.739 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:34.739 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:34.739 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.739 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.739 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:52:34.739 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:52:23.013398+0000", 2024-04-25T22:52:34.739 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 11.631881817, 2024-04-25T22:52:34.740 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0015020369999999999, 2024-04-25T22:52:34.740 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:34.740 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:34.740 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:34.740 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:34.740 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.740 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:34.740 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:23.013398+0000", 2024-04-25T22:52:34.740 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:34.740 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.740 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.740 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:34.740 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:23.013398+0000", 2024-04-25T22:52:34.740 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:34.740 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.741 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.741 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:34.741 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:23.013399+0000", 2024-04-25T22:52:34.741 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.362e-06 2024-04-25T22:52:34.741 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.741 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.741 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:34.741 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:23.013406+0000", 2024-04-25T22:52:34.741 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.1409999999999999e-06 2024-04-25T22:52:34.741 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.741 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.741 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:34.741 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:23.013420+0000", 2024-04-25T22:52:34.741 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3232e-05 2024-04-25T22:52:34.741 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.742 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.742 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:34.742 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:23.013429+0000", 2024-04-25T22:52:34.742 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0310000000000004e-06 2024-04-25T22:52:34.742 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.742 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.742 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:34.742 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:23.013514+0000", 2024-04-25T22:52:34.742 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5620999999999999e-05 2024-04-25T22:52:34.742 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.742 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.742 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:34.742 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:23.013581+0000", 2024-04-25T22:52:34.742 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.6804999999999995e-05 2024-04-25T22:52:34.743 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.743 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.743 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:34.743 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:23.013683+0000", 2024-04-25T22:52:34.743 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010186 2024-04-25T22:52:34.743 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.743 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.743 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:34.743 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:23.014298+0000", 2024-04-25T22:52:34.743 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061501399999999999 2024-04-25T22:52:34.743 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.743 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.743 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:34.744 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:23.014839+0000", 2024-04-25T22:52:34.744 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000540523 2024-04-25T22:52:34.744 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.744 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.744 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:34.744 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:23.014871+0000", 2024-04-25T22:52:34.744 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2004000000000001e-05 2024-04-25T22:52:34.744 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:34.744 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:34.744 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:34.744 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:23.014900+0000", 2024-04-25T22:52:34.744 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9444000000000001e-05 2024-04-25T22:52:34.744 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:34.744 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:34.745 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:34.745 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:34.745 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:34.745 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-25T22:52:34.746 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:52:34.747 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:34.746+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:34.846 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:34.846+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:34.855 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:34.855 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:52:34.855 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-25T22:52:34.856 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:34.864 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:52:34.947 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:34.947+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:34.969 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:34.969 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:52:34.970 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-25T22:52:34.970 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-25T22:52:34.970 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:34.979 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:52:35.049 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:35.048+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:35.083 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:35.083 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:52:35.083 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:52:35.083 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:52:35.083 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.083 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:52:35.083 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:52:35.083 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 47.113338413999998, 2024-04-25T22:52:35.083 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:52:35.083 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:35.084 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:35.084 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:35.084 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:35.084 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.084 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:35.084 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:52:35.084 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:35.084 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.084 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.084 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:35.084 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:52:35.084 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:35.084 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.084 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.085 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:35.085 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:52:35.085 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:52:35.085 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.085 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.085 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:35.085 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:52:35.085 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:52:35.085 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.085 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.085 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:35.085 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:52:35.085 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:52:35.085 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.085 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.086 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:35.086 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:52:35.086 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:52:35.086 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.086 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.086 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:35.086 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:52:35.086 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:52:35.086 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.086 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.086 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:35.086 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:52:35.086 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:52:35.086 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.087 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.087 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:35.087 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:52:35.087 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:52:35.087 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.087 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.087 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:35.087 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:52:35.087 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:52:35.087 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:35.087 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:35.087 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:35.087 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.087 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.087 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:110 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'72, mlcod=10'68)", 2024-04-25T22:52:35.088 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:35.088 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 47.112704414, 2024-04-25T22:52:35.088 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065316630000000001, 2024-04-25T22:52:35.088 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:35.088 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:35.088 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:35.088 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:35.088 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.088 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:35.088 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:35.088 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:35.088 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.088 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.088 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:35.089 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:35.089 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:35.089 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.089 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.089 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:35.089 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:35.089 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.58e-07 2024-04-25T22:52:35.089 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.089 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.089 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:35.089 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967811+0000", 2024-04-25T22:52:35.089 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.118e-06 2024-04-25T22:52:35.089 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.089 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.089 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:35.090 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967817+0000", 2024-04-25T22:52:35.090 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3709999999999996e-06 2024-04-25T22:52:35.090 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.090 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.090 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:35.090 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967820+0000", 2024-04-25T22:52:35.090 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2210000000000002e-06 2024-04-25T22:52:35.090 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.090 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.090 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:35.090 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967876+0000", 2024-04-25T22:52:35.090 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5507000000000002e-05 2024-04-25T22:52:35.090 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.090 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.091 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:35.091 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967893+0000", 2024-04-25T22:52:35.091 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7812000000000002e-05 2024-04-25T22:52:35.091 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.091 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.091 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:35.091 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974317+0000", 2024-04-25T22:52:35.091 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064237160000000003 2024-04-25T22:52:35.091 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.091 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.091 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:35.091 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:52:35.091 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.156e-05 2024-04-25T22:52:35.092 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:35.092 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:35.092 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:35.092 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.092 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.092 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'68)", 2024-04-25T22:52:35.092 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:35.092 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 47.112286900999997, 2024-04-25T22:52:35.092 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061292279999999996, 2024-04-25T22:52:35.092 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:35.092 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:35.092 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:35.092 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:35.092 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.092 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:35.093 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:35.093 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:35.093 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.093 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.093 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:35.093 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:35.093 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:35.093 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.093 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.093 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:35.093 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:35.093 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6300000000000001e-07 2024-04-25T22:52:35.093 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.093 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.094 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:35.094 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968228+0000", 2024-04-25T22:52:35.094 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6139999999999999e-06 2024-04-25T22:52:35.094 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.094 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.094 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:35.094 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968235+0000", 2024-04-25T22:52:35.094 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7020000000000001e-06 2024-04-25T22:52:35.094 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.094 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.094 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:35.094 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968238+0000", 2024-04-25T22:52:35.094 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0010000000000002e-06 2024-04-25T22:52:35.094 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.095 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.095 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:35.095 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968297+0000", 2024-04-25T22:52:35.095 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8424999999999997e-05 2024-04-25T22:52:35.095 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.095 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.095 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:35.095 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968316+0000", 2024-04-25T22:52:35.095 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8814999999999999e-05 2024-04-25T22:52:35.095 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.095 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.095 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:35.095 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:52:35.095 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060239439999999998 2024-04-25T22:52:35.095 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.096 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.096 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:35.096 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974354+0000", 2024-04-25T22:52:35.096 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4364e-05 2024-04-25T22:52:35.096 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:35.096 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:35.096 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:35.096 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.096 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.096 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'68)", 2024-04-25T22:52:35.096 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:35.096 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 47.111849898999999, 2024-04-25T22:52:35.096 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005948414, 2024-04-25T22:52:35.097 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:35.097 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:35.097 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:35.097 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:35.097 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.097 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:35.097 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:35.097 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:35.097 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.097 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.097 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:35.097 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:35.097 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:35.097 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.098 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.098 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:35.098 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:35.098 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6199999999999998e-07 2024-04-25T22:52:35.098 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.098 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.098 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:35.098 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968723+0000", 2024-04-25T22:52:35.098 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1148999999999993e-05 2024-04-25T22:52:35.098 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.098 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.098 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:35.098 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968730+0000", 2024-04-25T22:52:35.098 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1749999999999999e-06 2024-04-25T22:52:35.099 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.099 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.099 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:35.099 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968734+0000", 2024-04-25T22:52:35.099 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5200000000000002e-06 2024-04-25T22:52:35.099 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.099 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.099 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:35.099 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968771+0000", 2024-04-25T22:52:35.099 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6851999999999999e-05 2024-04-25T22:52:35.099 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.099 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.099 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:35.099 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968788+0000", 2024-04-25T22:52:35.100 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7027000000000001e-05 2024-04-25T22:52:35.100 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.100 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.100 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:35.100 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974589+0000", 2024-04-25T22:52:35.100 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058013320000000002 2024-04-25T22:52:35.100 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.100 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.100 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:35.100 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974610+0000", 2024-04-25T22:52:35.100 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0897e-05 2024-04-25T22:52:35.101 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:35.101 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:35.101 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:35.101 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.101 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.101 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'68)", 2024-04-25T22:52:35.101 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:35.101 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 47.111279889000002, 2024-04-25T22:52:35.101 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053935750000000003, 2024-04-25T22:52:35.101 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:35.101 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:35.101 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:35.102 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:35.102 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.102 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:35.102 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:35.103 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:35.103 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.103 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.103 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:35.103 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:35.103 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:35.103 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.103 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.103 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:35.103 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:35.103 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.03e-07 2024-04-25T22:52:35.103 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.103 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.103 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:35.104 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969235+0000", 2024-04-25T22:52:35.104 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2399999999999999e-06 2024-04-25T22:52:35.104 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.104 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.104 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:35.104 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969242+0000", 2024-04-25T22:52:35.104 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1269999999999997e-06 2024-04-25T22:52:35.104 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.104 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.104 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:35.104 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969246+0000", 2024-04-25T22:52:35.104 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3840000000000001e-06 2024-04-25T22:52:35.104 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.104 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.105 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:35.105 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969278+0000", 2024-04-25T22:52:35.105 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1868e-05 2024-04-25T22:52:35.105 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.105 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.105 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:35.105 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969295+0000", 2024-04-25T22:52:35.105 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7530999999999999e-05 2024-04-25T22:52:35.105 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.105 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.105 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:35.105 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974611+0000", 2024-04-25T22:52:35.105 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053160789999999996 2024-04-25T22:52:35.105 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.106 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.106 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:35.106 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974625+0000", 2024-04-25T22:52:35.106 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3943e-05 2024-04-25T22:52:35.106 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:35.106 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:35.106 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:35.106 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.106 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.106 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-25T22:52:35.106 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:35.106 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 46.917683981000003, 2024-04-25T22:52:35.106 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054952610000000004, 2024-04-25T22:52:35.107 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:35.107 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:35.107 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:35.107 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:35.107 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.107 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:35.107 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:35.107 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:35.107 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.109 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.109 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:35.109 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:35.109 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:35.109 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.109 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.109 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:35.109 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:35.110 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.68e-07 2024-04-25T22:52:35.110 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.110 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.110 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:35.110 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162898+0000", 2024-04-25T22:52:35.110 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9470999999999999e-05 2024-04-25T22:52:35.110 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.110 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.110 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:35.110 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162906+0000", 2024-04-25T22:52:35.110 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1580000000000005e-06 2024-04-25T22:52:35.110 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.110 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.110 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:35.111 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162911+0000", 2024-04-25T22:52:35.111 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4779999999999999e-06 2024-04-25T22:52:35.111 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.111 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.111 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:35.111 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162952+0000", 2024-04-25T22:52:35.111 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0629e-05 2024-04-25T22:52:35.111 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.111 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.111 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:35.111 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162968+0000", 2024-04-25T22:52:35.111 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6239000000000002e-05 2024-04-25T22:52:35.111 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.111 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.111 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:35.112 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168281+0000", 2024-04-25T22:52:35.112 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053132869999999999 2024-04-25T22:52:35.112 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.112 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.112 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:35.112 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168323+0000", 2024-04-25T22:52:35.112 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1430999999999997e-05 2024-04-25T22:52:35.112 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:35.112 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:35.112 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:35.112 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.112 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.112 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-04-25T22:52:35.113 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:35.113 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 46.487206618999998, 2024-04-25T22:52:35.113 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050872510000000001, 2024-04-25T22:52:35.113 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:35.113 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:35.113 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:35.113 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:35.113 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.113 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:35.113 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:35.113 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:35.113 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.113 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.113 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:35.114 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:35.114 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:35.114 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.114 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.114 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:35.114 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:35.114 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.72e-07 2024-04-25T22:52:35.114 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.114 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.114 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:35.114 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593381+0000", 2024-04-25T22:52:35.114 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5797000000000006e-05 2024-04-25T22:52:35.114 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.115 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.115 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:35.115 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593389+0000", 2024-04-25T22:52:35.115 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8480000000000001e-06 2024-04-25T22:52:35.115 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.115 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.115 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:35.115 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593393+0000", 2024-04-25T22:52:35.115 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4819999999999996e-06 2024-04-25T22:52:35.115 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.115 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.115 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:35.115 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593435+0000", 2024-04-25T22:52:35.115 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1600000000000002e-05 2024-04-25T22:52:35.115 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.116 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.116 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:35.116 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593454+0000", 2024-04-25T22:52:35.116 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8868e-05 2024-04-25T22:52:35.116 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.116 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.116 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:35.116 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598350+0000", 2024-04-25T22:52:35.116 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004895763 2024-04-25T22:52:35.116 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.116 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.116 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:35.116 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598392+0000", 2024-04-25T22:52:35.116 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2521000000000002e-05 2024-04-25T22:52:35.117 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:35.117 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:35.117 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:35.117 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.117 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.117 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:35.117 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:52:35.117 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 42.068842715000002, 2024-04-25T22:52:35.117 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:52:35.117 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:35.117 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:35.117 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:35.117 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:35.117 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.118 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:35.118 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:52:35.118 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:35.118 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.118 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.118 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:35.118 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:52:35.118 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:35.118 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.118 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.118 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:35.118 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:52:35.118 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:52:35.118 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.119 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.119 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:35.119 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:52:35.119 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:52:35.119 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.119 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.119 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:35.119 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:52:35.119 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:52:35.119 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.119 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.119 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:35.119 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:52:35.120 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:52:35.120 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.120 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.120 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:35.120 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:52:35.120 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:52:35.120 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.120 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.120 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:35.120 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:52:35.120 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:52:35.120 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.120 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.121 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:35.121 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:52:35.121 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:52:35.121 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.121 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.121 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:35.121 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:52:35.121 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:52:35.121 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.121 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.121 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:35.121 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:52:35.121 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:52:35.121 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.121 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.122 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:35.122 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:52:35.122 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:52:35.122 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.122 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.122 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:35.122 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:52:35.122 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:52:35.122 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:35.122 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:35.122 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:35.122 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.122 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.123 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:35.123 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:52:35.123 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 42.068168339000003, 2024-04-25T22:52:35.123 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:52:35.123 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:35.123 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:35.123 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:35.123 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:35.123 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.123 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:35.123 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:52:35.123 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:35.123 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.123 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.124 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:35.124 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:52:35.124 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:35.124 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.124 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.124 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:35.124 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:52:35.124 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:52:35.124 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.124 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.124 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:35.124 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:52:35.124 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:52:35.124 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.125 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.125 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:35.125 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:52:35.125 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:52:35.125 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.125 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.125 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:35.125 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:52:35.125 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:52:35.125 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.125 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.125 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:35.125 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:52:35.125 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:52:35.126 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.126 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.126 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:35.126 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:52:35.126 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:52:35.126 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.126 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.126 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:35.126 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:52:35.126 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:52:35.126 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.126 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.126 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:35.126 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:52:35.127 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:52:35.127 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.127 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.127 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:35.127 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:52:35.127 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:52:35.127 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.127 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.127 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:35.127 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:52:35.127 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:52:35.127 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.127 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.128 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:35.128 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:52:35.128 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:52:35.128 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:35.128 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:35.128 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:35.128 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.128 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.128 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:35.128 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:52:35.128 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 42.067659126999999, 2024-04-25T22:52:35.128 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:52:35.128 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:35.128 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:35.129 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:35.129 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:35.129 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.129 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:35.129 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:52:35.129 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:35.129 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.129 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.129 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:35.129 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:52:35.129 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:35.129 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.129 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.129 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:35.130 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:52:35.130 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:52:35.130 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.130 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.130 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:35.130 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:52:35.130 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:52:35.130 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.130 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.130 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:35.130 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:52:35.130 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:52:35.130 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.130 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.131 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:35.131 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:52:35.131 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:52:35.131 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.131 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.131 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:35.131 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:52:35.131 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:52:35.131 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.131 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.131 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:35.131 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:52:35.131 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:52:35.131 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.131 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.132 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:35.132 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:52:35.132 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:52:35.132 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.132 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.132 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:35.132 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:52:35.132 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:52:35.132 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.132 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.132 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:35.132 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:52:35.132 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:52:35.132 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.133 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.133 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:35.133 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:52:35.133 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:52:35.133 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.133 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.133 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:35.134 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:52:35.134 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:52:35.134 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:35.134 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:35.134 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:35.134 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.134 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.134 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:35.134 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:35.134 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 42.067245929000002, 2024-04-25T22:52:35.134 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:52:35.134 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:35.134 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:35.135 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:35.135 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:35.135 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.135 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:35.135 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:35.135 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:35.135 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.135 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.135 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:35.135 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:35.135 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:35.135 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.135 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.135 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:35.136 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:35.136 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:52:35.136 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.136 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.136 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:35.136 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:52:35.136 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:52:35.136 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.136 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.136 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:35.136 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:52:35.136 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:52:35.136 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.136 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.137 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:35.137 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:52:35.137 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:52:35.137 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.137 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.137 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:35.137 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:52:35.137 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:52:35.137 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.137 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.137 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:35.137 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:52:35.137 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:52:35.137 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.138 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.138 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:35.138 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:52:35.138 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:52:35.138 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.138 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.138 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:35.138 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:52:35.138 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:52:35.138 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.138 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.138 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:35.138 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:52:35.139 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:52:35.139 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.139 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.139 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:35.139 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:52:35.139 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:52:35.139 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.139 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.139 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:35.139 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:52:35.139 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:52:35.139 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:35.139 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:35.139 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:35.140 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.140 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.140 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:35.140 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:52:35.140 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 42.067195259000002, 2024-04-25T22:52:35.140 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:52:35.140 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:35.140 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:35.140 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:35.140 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:35.140 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.140 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:35.140 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:52:35.140 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:35.141 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.141 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.141 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:35.141 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:52:35.141 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:35.141 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.141 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.141 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:35.141 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:52:35.141 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:52:35.141 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.141 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.141 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:35.141 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:52:35.141 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:52:35.142 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.142 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.142 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:35.142 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:52:35.142 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:52:35.142 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.142 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.142 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:35.142 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:52:35.142 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:52:35.142 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.142 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.142 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:35.142 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:52:35.143 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:52:35.143 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.143 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.143 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:52:35.143 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:52:35.143 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:52:35.143 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.143 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.143 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:35.143 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:52:35.143 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:52:35.143 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.143 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.143 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:35.144 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:52:35.144 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:52:35.144 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.144 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.144 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:35.144 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:52:35.144 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:52:35.144 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.144 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.144 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:35.144 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:52:35.144 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:52:35.144 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.144 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.145 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:35.145 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:52:35.145 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:52:35.145 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.145 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.145 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:35.145 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:52:35.145 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:52:35.145 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.145 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.145 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:35.145 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:52:35.145 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:52:35.145 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:35.146 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:35.146 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:35.146 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.146 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.146 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:35.146 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:52:35.146 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 42.067158390000003, 2024-04-25T22:52:35.146 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:52:35.146 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:35.146 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:35.146 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:35.146 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:35.146 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.146 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:35.147 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:52:35.147 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:35.147 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.147 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.147 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:35.147 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:52:35.147 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:35.147 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.147 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.147 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:35.147 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:52:35.147 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:52:35.147 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.148 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.148 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:35.148 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:52:35.148 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:52:35.148 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.148 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.148 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:35.148 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:52:35.148 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:52:35.148 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.148 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.148 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:35.148 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:52:35.148 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:52:35.149 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.149 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.149 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:35.149 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:52:35.149 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:52:35.149 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.149 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.149 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:52:35.149 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:52:35.149 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:52:35.149 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.149 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.149 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:35.149 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:52:35.149 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:52:35.150 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.150 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.150 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:35.150 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:52:35.150 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:52:35.150 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.150 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.150 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:35.150 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:52:35.150 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:52:35.150 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.150 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.150 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:35.151 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:52:35.151 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:52:35.151 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.151 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.151 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:35.151 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:52:35.151 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:52:35.151 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.151 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.151 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:35.151 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:52:35.151 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:52:35.151 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.151 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.151 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:35.152 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:52:35.152 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:52:35.152 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:35.152 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:35.152 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:35.152 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.152 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.152 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:35.152 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:52:35.152 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 42.067133423999998, 2024-04-25T22:52:35.152 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:52:35.152 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:35.152 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:35.152 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:35.153 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:35.153 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.153 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:35.153 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:52:35.153 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:35.153 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.153 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.153 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:35.153 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:52:35.153 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:35.153 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.153 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.153 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:35.153 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:52:35.154 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:52:35.154 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.154 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.154 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:35.154 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:52:35.154 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:52:35.154 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.154 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.154 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:35.154 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:52:35.154 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:52:35.154 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.154 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.155 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:35.155 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:52:35.155 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:52:35.155 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.155 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.155 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:35.155 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:52:35.155 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:52:35.155 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.155 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.155 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:35.155 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:52:35.155 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:52:35.155 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.156 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.156 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:35.156 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:52:35.156 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:52:35.156 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.156 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.156 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:35.156 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:52:35.156 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:52:35.156 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.156 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.156 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:35.156 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:52:35.156 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:52:35.157 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.157 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.157 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:35.157 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:52:35.157 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:52:35.157 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.157 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.157 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:35.157 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:52:35.157 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:52:35.157 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:35.157 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:35.157 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:35.157 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.157 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.158 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:35.158 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:52:35.158 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 42.067097060000002, 2024-04-25T22:52:35.158 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:52:35.158 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:35.158 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:35.158 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:52:35.158 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:35.158 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.158 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:35.158 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:52:35.158 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:35.158 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.158 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.159 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:35.159 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:52:35.159 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:35.159 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.159 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.159 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:35.159 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:52:35.159 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:52:35.159 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.159 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.159 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:35.159 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:52:35.159 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:52:35.159 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.160 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.160 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:35.160 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:52:35.160 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:52:35.160 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.160 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.160 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:35.160 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:52:35.160 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:52:35.160 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.160 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.160 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:35.160 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:52:35.160 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:52:35.161 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.161 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.161 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:52:35.161 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:52:35.161 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:52:35.161 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.161 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.161 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:35.161 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:52:35.161 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:52:35.161 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.161 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.161 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:35.161 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:52:35.162 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:52:35.162 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.162 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.162 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:35.162 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:52:35.162 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:52:35.162 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:35.162 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:35.162 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:35.162 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.162 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.162 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:35.162 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:35.162 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 42.067065978999999, 2024-04-25T22:52:35.163 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:52:35.163 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:35.163 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:35.163 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:52:35.163 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:35.163 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.163 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:35.163 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:35.163 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:35.163 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.163 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.163 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:35.163 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:35.163 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:35.163 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.164 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.164 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:35.164 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:35.164 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:52:35.164 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.164 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.164 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:35.164 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:52:35.164 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:52:35.164 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.164 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.164 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:35.164 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:52:35.164 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:52:35.165 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.165 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.165 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:35.165 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:52:35.165 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:52:35.165 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.165 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.165 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:35.165 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:52:35.165 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:52:35.165 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.165 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.165 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:35.165 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:52:35.166 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:52:35.166 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.166 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.166 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:35.166 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:52:35.166 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:52:35.166 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:35.166 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:35.166 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:35.166 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.166 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.166 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:52:35.166 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:35.166 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 42.066625010000003, 2024-04-25T22:52:35.167 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064881979999999997, 2024-04-25T22:52:35.167 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:35.167 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:35.167 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:35.167 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:35.167 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.167 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:35.167 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:35.167 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:35.167 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.167 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.167 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:35.167 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:35.167 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:35.168 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.168 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.168 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:35.168 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:35.168 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2699999999999999e-07 2024-04-25T22:52:35.168 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.168 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.168 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:35.168 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013898+0000", 2024-04-25T22:52:35.168 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0796e-05 2024-04-25T22:52:35.168 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.168 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.168 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:35.168 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013907+0000", 2024-04-25T22:52:35.169 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5140000000000007e-06 2024-04-25T22:52:35.169 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.169 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.169 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:35.169 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013952+0000", 2024-04-25T22:52:35.169 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4134000000000001e-05 2024-04-25T22:52:35.169 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.169 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.169 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:35.169 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016812+0000", 2024-04-25T22:52:35.169 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028601059999999998 2024-04-25T22:52:35.169 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.169 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.169 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:35.169 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.017052+0000", 2024-04-25T22:52:35.170 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024056500000000001 2024-04-25T22:52:35.170 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.170 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.170 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:35.170 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020350+0000", 2024-04-25T22:52:35.170 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032978320000000001 2024-04-25T22:52:35.170 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.170 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.170 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:35.170 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020375+0000", 2024-04-25T22:52:35.170 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4624e-05 2024-04-25T22:52:35.170 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:35.170 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:35.171 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:35.171 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.171 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.171 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-25T22:52:35.171 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:35.171 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 42.053094563999998, 2024-04-25T22:52:35.171 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058583000000000003, 2024-04-25T22:52:35.171 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:35.171 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:35.171 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:35.171 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:35.171 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.171 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:35.171 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:35.171 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:35.172 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.172 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.172 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:35.172 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:35.172 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:35.172 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.172 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.172 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:35.172 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:35.172 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.41e-07 2024-04-25T22:52:35.172 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.172 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.172 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:35.173 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027428+0000", 2024-04-25T22:52:35.173 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.075e-05 2024-04-25T22:52:35.173 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.173 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.173 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:35.173 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027435+0000", 2024-04-25T22:52:35.173 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3610000000000003e-06 2024-04-25T22:52:35.173 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.173 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.173 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:35.173 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027442+0000", 2024-04-25T22:52:35.173 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0400000000000004e-06 2024-04-25T22:52:35.173 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.173 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.174 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:35.174 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028094+0000", 2024-04-25T22:52:35.174 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00065134800000000005 2024-04-25T22:52:35.174 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.174 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.174 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:35.174 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028107+0000", 2024-04-25T22:52:35.174 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3087e-05 2024-04-25T22:52:35.174 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.174 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.175 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:35.175 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033239+0000", 2024-04-25T22:52:35.175 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051319429999999999 2024-04-25T22:52:35.175 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.175 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.175 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:35.175 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033275+0000", 2024-04-25T22:52:35.175 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6430000000000002e-05 2024-04-25T22:52:35.175 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:35.175 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:35.175 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:35.175 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.175 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.175 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-25T22:52:35.175 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:35.176 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 42.052709727, 2024-04-25T22:52:35.176 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005413597, 2024-04-25T22:52:35.176 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:35.176 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:35.176 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:35.176 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:35.176 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.176 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:35.176 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:35.176 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:35.176 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.176 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.176 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:35.177 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:35.177 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:35.177 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.177 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.177 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:35.177 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:35.177 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3799999999999997e-07 2024-04-25T22:52:35.177 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.177 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.177 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:35.177 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027816+0000", 2024-04-25T22:52:35.178 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3230999999999999e-05 2024-04-25T22:52:35.178 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.178 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.178 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:35.178 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027823+0000", 2024-04-25T22:52:35.178 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9039999999999992e-06 2024-04-25T22:52:35.178 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.178 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.178 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:35.178 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027841+0000", 2024-04-25T22:52:35.178 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7651000000000001e-05 2024-04-25T22:52:35.178 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.178 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.178 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:35.179 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027904+0000", 2024-04-25T22:52:35.179 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3058000000000005e-05 2024-04-25T22:52:35.179 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.179 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.179 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:35.179 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027926+0000", 2024-04-25T22:52:35.179 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1450999999999998e-05 2024-04-25T22:52:35.179 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.179 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.179 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:35.179 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033177+0000", 2024-04-25T22:52:35.179 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052508909999999997 2024-04-25T22:52:35.179 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.179 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.180 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:35.180 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033215+0000", 2024-04-25T22:52:35.180 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8872999999999999e-05 2024-04-25T22:52:35.180 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:35.180 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:35.180 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:35.180 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.180 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.180 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 171 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:52:35.180 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:35.180 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 42.052652625, 2024-04-25T22:52:35.180 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054322240000000003, 2024-04-25T22:52:35.180 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:35.180 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:35.181 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "reached pg", 2024-04-25T22:52:35.181 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:35.181 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.181 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:35.181 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:35.181 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:35.181 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.181 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.181 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:35.181 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:35.181 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:35.181 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.181 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.181 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:35.181 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:35.182 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7500000000000001e-07 2024-04-25T22:52:35.182 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.182 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.182 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:35.182 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027868+0000", 2024-04-25T22:52:35.182 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5750000000000001e-06 2024-04-25T22:52:35.182 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.182 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.182 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:35.182 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027885+0000", 2024-04-25T22:52:35.182 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7272e-05 2024-04-25T22:52:35.182 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.182 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.182 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:35.183 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027900+0000", 2024-04-25T22:52:35.183 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.502e-05 2024-04-25T22:52:35.183 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.183 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.183 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:35.183 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028381+0000", 2024-04-25T22:52:35.183 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00048039399999999998 2024-04-25T22:52:35.183 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:35.183 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:35.183 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:35.183 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033291+0000", 2024-04-25T22:52:35.183 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049105879999999996 2024-04-25T22:52:35.183 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:35.184 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:35.184 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:35.184 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:35.184 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:35.184 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:35.184 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-25T22:52:35.187 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:35.185+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:35.187 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:52:35.286 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:35.285+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:35.303 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:35.303 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:52:35.303 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-04-25T22:52:35.303 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:35.314 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:52:35.387 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:35.387+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:35.418 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:35.418 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:52:35.418 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:52:35.418 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:52:35.419 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:35.427 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:52:35.511 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:35.510+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:35.574 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:35.574 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-04-25T22:52:35.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-04-25T22:52:35.574 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:52:35.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.574 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:35.574 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:35.574 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.606975003999999, 2024-04-25T22:52:35.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0103421, 2024-04-25T22:52:35.575 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:35.575 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:35.575 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:35.575 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:35.575 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:35.575 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:35.575 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 115 2024-04-25T22:52:35.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.575 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:35.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:35.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:35.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:35.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.576 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:35.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:35.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:35.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.576 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:35.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:35.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9500000000000002e-07 2024-04-25T22:52:35.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.576 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:35.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965108+0000", 2024-04-25T22:52:35.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9177999999999994e-05 2024-04-25T22:52:35.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:35.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965127+0000", 2024-04-25T22:52:35.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8868e-05 2024-04-25T22:52:35.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:35.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965133+0000", 2024-04-25T22:52:35.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8929999999999999e-06 2024-04-25T22:52:35.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:35.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.969991+0000", 2024-04-25T22:52:35.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048573849999999997 2024-04-25T22:52:35.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:35.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970072+0000", 2024-04-25T22:52:35.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0728000000000004e-05 2024-04-25T22:52:35.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:35.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970189+0000", 2024-04-25T22:52:35.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000117778 2024-04-25T22:52:35.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:35.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970946+0000", 2024-04-25T22:52:35.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00075704600000000004 2024-04-25T22:52:35.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:35.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975297+0000", 2024-04-25T22:52:35.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004350217 2024-04-25T22:52:35.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:35.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975343+0000", 2024-04-25T22:52:35.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6687999999999998e-05 2024-04-25T22:52:35.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.580 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:35.580 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975380+0000", 2024-04-25T22:52:35.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6724000000000003e-05 2024-04-25T22:52:35.580 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:35.580 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:35.580 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:35.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.580 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:35.580 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:35.580 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.606868972999997, 2024-04-25T22:52:35.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010304384, 2024-04-25T22:52:35.581 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:35.581 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:35.581 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:35.581 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:35.581 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:35.581 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:35.581 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 116 2024-04-25T22:52:35.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.581 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:35.581 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.581 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:35.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:35.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:35.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:35.582 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:35.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:35.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:35.582 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:35.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5799999999999999e-07 2024-04-25T22:52:35.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:35.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965154+0000", 2024-04-25T22:52:35.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0009e-05 2024-04-25T22:52:35.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:35.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965164+0000", 2024-04-25T22:52:35.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8490000000000001e-06 2024-04-25T22:52:35.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:35.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965169+0000", 2024-04-25T22:52:35.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0730000000000004e-06 2024-04-25T22:52:35.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:35.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970609+0000", 2024-04-25T22:52:35.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054397689999999997 2024-04-25T22:52:35.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:35.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970651+0000", 2024-04-25T22:52:35.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1873999999999999e-05 2024-04-25T22:52:35.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:35.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970723+0000", 2024-04-25T22:52:35.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2039999999999995e-05 2024-04-25T22:52:35.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:35.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971358+0000", 2024-04-25T22:52:35.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063489500000000001 2024-04-25T22:52:35.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:35.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975409+0000", 2024-04-25T22:52:35.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040506880000000002 2024-04-25T22:52:35.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:35.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975432+0000", 2024-04-25T22:52:35.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3315999999999998e-05 2024-04-25T22:52:35.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.586 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:35.586 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975448+0000", 2024-04-25T22:52:35.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6313000000000001e-05 2024-04-25T22:52:35.586 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:35.586 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:35.586 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:35.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.586 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:35.586 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:35.586 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.606834391, 2024-04-25T22:52:35.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010384338999999999, 2024-04-25T22:52:35.587 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:35.587 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:35.587 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:35.587 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:35.587 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:35.587 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:35.587 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-04-25T22:52:35.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.587 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:35.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.587 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:35.587 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:35.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:35.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.587 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:35.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:35.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:35.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:35.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:35.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3600000000000004e-07 2024-04-25T22:52:35.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:35.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965185+0000", 2024-04-25T22:52:35.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.117e-06 2024-04-25T22:52:35.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:35.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965192+0000", 2024-04-25T22:52:35.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3239999999999997e-06 2024-04-25T22:52:35.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:35.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965198+0000", 2024-04-25T22:52:35.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6370000000000004e-06 2024-04-25T22:52:35.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:35.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970973+0000", 2024-04-25T22:52:35.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057748239999999996 2024-04-25T22:52:35.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.590 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.590 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:35.590 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971049+0000", 2024-04-25T22:52:35.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6029e-05 2024-04-25T22:52:35.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.590 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.590 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:35.590 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971174+0000", 2024-04-25T22:52:35.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012462399999999999 2024-04-25T22:52:35.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.590 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.590 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:35.590 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971553+0000", 2024-04-25T22:52:35.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037896499999999999 2024-04-25T22:52:35.591 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.591 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.591 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:35.591 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975482+0000", 2024-04-25T22:52:35.591 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039297459999999996 2024-04-25T22:52:35.591 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.591 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.591 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:35.591 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975529+0000", 2024-04-25T22:52:35.591 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6387000000000002e-05 2024-04-25T22:52:35.591 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.591 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.591 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:35.591 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975563+0000", 2024-04-25T22:52:35.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4150000000000003e-05 2024-04-25T22:52:35.592 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:35.592 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:35.592 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:35.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.592 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.592 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:35.592 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:35.592 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 42.559788068000003, 2024-04-25T22:52:35.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012637705000000001, 2024-04-25T22:52:35.592 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:35.592 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:35.592 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:35.593 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:35.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.593 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:35.593 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:35.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:35.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.593 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:35.593 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:35.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:35.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.593 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:35.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012227+0000", 2024-04-25T22:52:35.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.863e-06 2024-04-25T22:52:35.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:35.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012236+0000", 2024-04-25T22:52:35.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1109999999999997e-06 2024-04-25T22:52:35.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:35.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012309+0000", 2024-04-25T22:52:35.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3242000000000001e-05 2024-04-25T22:52:35.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.595 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:35.595 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012324+0000", 2024-04-25T22:52:35.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4837e-05 2024-04-25T22:52:35.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.595 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:35.595 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015060+0000", 2024-04-25T22:52:35.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027363349999999999 2024-04-25T22:52:35.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.595 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:35.595 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015169+0000", 2024-04-25T22:52:35.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108372 2024-04-25T22:52:35.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:35.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015498+0000", 2024-04-25T22:52:35.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032949999999999999 2024-04-25T22:52:35.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:35.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021282+0000", 2024-04-25T22:52:35.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057836429999999998 2024-04-25T22:52:35.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:35.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024709+0000", 2024-04-25T22:52:35.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034271979999999998 2024-04-25T22:52:35.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:35.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024802+0000", 2024-04-25T22:52:35.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2960000000000004e-05 2024-04-25T22:52:35.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:35.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024863+0000", 2024-04-25T22:52:35.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0643999999999997e-05 2024-04-25T22:52:35.597 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:35.597 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:35.597 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:35.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.597 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:35.597 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:35.598 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 42.559664296999998, 2024-04-25T22:52:35.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012979447999999999, 2024-04-25T22:52:35.598 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:35.598 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:35.598 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:35.598 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:35.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.598 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:35.598 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:35.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:35.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.598 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:35.598 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:35.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:35.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.599 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:35.599 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:35.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:52:35.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.599 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:35.599 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012354+0000", 2024-04-25T22:52:35.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7740000000000004e-06 2024-04-25T22:52:35.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:35.600 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012365+0000", 2024-04-25T22:52:35.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.064e-05 2024-04-25T22:52:35.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:35.600 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012382+0000", 2024-04-25T22:52:35.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6999000000000001e-05 2024-04-25T22:52:35.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:35.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015958+0000", 2024-04-25T22:52:35.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035765699999999998 2024-04-25T22:52:35.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:35.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016037+0000", 2024-04-25T22:52:35.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8242000000000001e-05 2024-04-25T22:52:35.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:35.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016404+0000", 2024-04-25T22:52:35.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036784300000000002 2024-04-25T22:52:35.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:35.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021294+0000", 2024-04-25T22:52:35.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048890629999999999 2024-04-25T22:52:35.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:35.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024959+0000", 2024-04-25T22:52:35.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036651570000000001 2024-04-25T22:52:35.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:35.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025097+0000", 2024-04-25T22:52:35.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013788099999999999 2024-04-25T22:52:35.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:35.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025328+0000", 2024-04-25T22:52:35.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231492 2024-04-25T22:52:35.603 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:35.603 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:35.603 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:35.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.603 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:35.603 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:35.603 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 42.559576528000001, 2024-04-25T22:52:35.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013049827, 2024-04-25T22:52:35.603 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:35.603 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:35.604 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:35.604 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:35.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:35.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:35.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:35.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:35.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:35.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:35.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:35.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012437+0000", 2024-04-25T22:52:35.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-04-25T22:52:35.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:35.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012440+0000", 2024-04-25T22:52:35.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7609999999999999e-06 2024-04-25T22:52:35.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:35.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012449+0000", 2024-04-25T22:52:35.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.285e-06 2024-04-25T22:52:35.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:35.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012457+0000", 2024-04-25T22:52:35.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9510000000000006e-06 2024-04-25T22:52:35.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:35.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017106+0000", 2024-04-25T22:52:35.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046494220000000003 2024-04-25T22:52:35.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:35.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017223+0000", 2024-04-25T22:52:35.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116824 2024-04-25T22:52:35.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:35.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017345+0000", 2024-04-25T22:52:35.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122175 2024-04-25T22:52:35.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.607 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:35.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021299+0000", 2024-04-25T22:52:35.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039534879999999998 2024-04-25T22:52:35.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.607 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:35.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025398+0000", 2024-04-25T22:52:35.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040988960000000003 2024-04-25T22:52:35.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.607 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:35.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025439+0000", 2024-04-25T22:52:35.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0915999999999999e-05 2024-04-25T22:52:35.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:35.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025486+0000", 2024-04-25T22:52:35.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7534999999999998e-05 2024-04-25T22:52:35.608 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:35.608 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:35.608 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:35.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.608 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:35.608 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:35.608 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 42.559546376999997, 2024-04-25T22:52:35.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020988041999999998, 2024-04-25T22:52:35.609 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:35.609 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:35.609 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:35.609 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:35.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:35.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:35.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:35.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:35.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:35.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:35.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:35.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:35.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.99e-07 2024-04-25T22:52:35.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:35.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012470+0000", 2024-04-25T22:52:35.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2789999999999999e-06 2024-04-25T22:52:35.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:35.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012477+0000", 2024-04-25T22:52:35.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:52:35.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:35.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012500+0000", 2024-04-25T22:52:35.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2490999999999999e-05 2024-04-25T22:52:35.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:35.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021911+0000", 2024-04-25T22:52:35.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094114160000000006 2024-04-25T22:52:35.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:35.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022000+0000", 2024-04-25T22:52:35.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8601000000000001e-05 2024-04-25T22:52:35.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:35.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022359+0000", 2024-04-25T22:52:35.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035921999999999999 2024-04-25T22:52:35.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:35.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025541+0000", 2024-04-25T22:52:35.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031820619999999998 2024-04-25T22:52:35.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.613 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:35.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033375+0000", 2024-04-25T22:52:35.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078338379999999992 2024-04-25T22:52:35.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.613 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:35.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033415+0000", 2024-04-25T22:52:35.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9527000000000003e-05 2024-04-25T22:52:35.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.614 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:35.614 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033455+0000", 2024-04-25T22:52:35.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9932000000000003e-05 2024-04-25T22:52:35.614 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:35.614 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:35.614 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:35.614 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.614 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:35.614 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:35.614 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 42.559491184000002, 2024-04-25T22:52:35.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021043857999999999, 2024-04-25T22:52:35.614 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:35.615 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:35.615 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:35.615 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:35.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:35.615 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:35.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:35.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:35.615 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:35.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:35.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:35.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012523+0000", 2024-04-25T22:52:35.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.361e-06 2024-04-25T22:52:35.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:35.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012530+0000", 2024-04-25T22:52:35.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5440000000000004e-06 2024-04-25T22:52:35.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:35.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012541+0000", 2024-04-25T22:52:35.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1745e-05 2024-04-25T22:52:35.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:35.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012551+0000", 2024-04-25T22:52:35.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5789999999999993e-06 2024-04-25T22:52:35.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:35.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022709+0000", 2024-04-25T22:52:35.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010157685 2024-04-25T22:52:35.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:35.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022957+0000", 2024-04-25T22:52:35.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024824599999999998 2024-04-25T22:52:35.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:35.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023443+0000", 2024-04-25T22:52:35.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048578599999999999 2024-04-25T22:52:35.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:35.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025547+0000", 2024-04-25T22:52:35.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021044789999999998 2024-04-25T22:52:35.619 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.619 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:35.619 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033509+0000", 2024-04-25T22:52:35.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0079622180000000001 2024-04-25T22:52:35.619 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.619 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:35.619 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033542+0000", 2024-04-25T22:52:35.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3018000000000001e-05 2024-04-25T22:52:35.619 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.620 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:35.620 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033566+0000", 2024-04-25T22:52:35.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3197000000000002e-05 2024-04-25T22:52:35.620 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:35.620 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:35.620 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:35.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.620 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:35.620 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:35.620 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 42.559451219000003, 2024-04-25T22:52:35.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021122696, 2024-04-25T22:52:35.621 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:35.621 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:35.621 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:35.621 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:35.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:35.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:35.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:35.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:35.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:35.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:35.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:35.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:35.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:52:35.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:35.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012566+0000", 2024-04-25T22:52:35.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-04-25T22:52:35.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:35.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012619+0000", 2024-04-25T22:52:35.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2607e-05 2024-04-25T22:52:35.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:35.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012628+0000", 2024-04-25T22:52:35.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6500000000000008e-06 2024-04-25T22:52:35.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:35.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024024+0000", 2024-04-25T22:52:35.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011396007999999999 2024-04-25T22:52:35.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:35.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024198+0000", 2024-04-25T22:52:35.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000173215 2024-04-25T22:52:35.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:35.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024447+0000", 2024-04-25T22:52:35.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024898500000000002 2024-04-25T22:52:35.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:35.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026431+0000", 2024-04-25T22:52:35.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001984923 2024-04-25T22:52:35.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.625 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:35.625 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033608+0000", 2024-04-25T22:52:35.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071768459999999997 2024-04-25T22:52:35.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.625 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:35.625 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033646+0000", 2024-04-25T22:52:35.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299000000000003e-05 2024-04-25T22:52:35.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.625 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:35.625 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033684+0000", 2024-04-25T22:52:35.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8773000000000003e-05 2024-04-25T22:52:35.625 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:35.626 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:35.626 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:35.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.626 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:35.626 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:35.626 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 42.559362620000002, 2024-04-25T22:52:35.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021175381, 2024-04-25T22:52:35.626 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:35.626 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:35.626 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:35.626 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:35.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:35.626 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:35.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:35.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.627 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:35.627 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:35.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:35.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.627 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:35.627 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012651+0000", 2024-04-25T22:52:35.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:52:35.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.627 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:35.627 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012656+0000", 2024-04-25T22:52:35.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8899999999999998e-06 2024-04-25T22:52:35.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:35.628 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012666+0000", 2024-04-25T22:52:35.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0346999999999999e-05 2024-04-25T22:52:35.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:35.628 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012675+0000", 2024-04-25T22:52:35.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9930000000000001e-06 2024-04-25T22:52:35.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:35.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025661+0000", 2024-04-25T22:52:35.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01298531 2024-04-25T22:52:35.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:35.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025757+0000", 2024-04-25T22:52:35.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5822000000000005e-05 2024-04-25T22:52:35.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:35.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025907+0000", 2024-04-25T22:52:35.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015051499999999999 2024-04-25T22:52:35.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:35.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026435+0000", 2024-04-25T22:52:35.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052762200000000005 2024-04-25T22:52:35.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:35.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033732+0000", 2024-04-25T22:52:35.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072978419999999997 2024-04-25T22:52:35.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:35.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033787+0000", 2024-04-25T22:52:35.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4703999999999997e-05 2024-04-25T22:52:35.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.631 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.631 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:35.631 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033826+0000", 2024-04-25T22:52:35.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8458999999999999e-05 2024-04-25T22:52:35.631 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:35.631 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:35.631 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:35.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.631 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.631 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:35.631 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:35.631 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 42.559307206, 2024-04-25T22:52:35.632 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021244174000000001, 2024-04-25T22:52:35.632 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:35.632 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:35.632 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:35.632 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:35.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.632 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:35.632 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:35.632 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:35.632 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.632 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:35.632 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:35.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:35.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:35.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:35.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:52:35.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:35.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012712+0000", 2024-04-25T22:52:35.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.913e-06 2024-04-25T22:52:35.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:35.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012722+0000", 2024-04-25T22:52:35.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2879999999999998e-06 2024-04-25T22:52:35.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:35.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012727+0000", 2024-04-25T22:52:35.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8429999999999998e-06 2024-04-25T22:52:35.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:35.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026099+0000", 2024-04-25T22:52:35.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013371450999999999 2024-04-25T22:52:35.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.635 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:35.635 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026147+0000", 2024-04-25T22:52:35.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7837999999999998e-05 2024-04-25T22:52:35.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.635 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:35.635 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026254+0000", 2024-04-25T22:52:35.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107314 2024-04-25T22:52:35.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.636 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:35.636 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026686+0000", 2024-04-25T22:52:35.636 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000432428 2024-04-25T22:52:35.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.636 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:35.636 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033873+0000", 2024-04-25T22:52:35.636 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071864399999999997 2024-04-25T22:52:35.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.637 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.637 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:35.637 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033904+0000", 2024-04-25T22:52:35.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1321e-05 2024-04-25T22:52:35.637 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.637 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.637 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:35.637 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033950+0000", 2024-04-25T22:52:35.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5707999999999997e-05 2024-04-25T22:52:35.637 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:35.637 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:35.638 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:35.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.638 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:35.638 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:35.638 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 42.559276820999997, 2024-04-25T22:52:35.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01096505, 2024-04-25T22:52:35.638 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:35.638 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:35.639 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:35.639 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:35.639 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.639 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:35.639 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:35.639 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:35.639 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.639 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.639 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:35.639 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:35.639 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:35.639 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.640 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.640 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:35.640 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012737+0000", 2024-04-25T22:52:35.640 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:52:35.640 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.640 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.640 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:35.640 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012739+0000", 2024-04-25T22:52:35.640 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-04-25T22:52:35.640 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.640 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.640 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:35.641 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012743+0000", 2024-04-25T22:52:35.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3239999999999996e-06 2024-04-25T22:52:35.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.641 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:35.641 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012746+0000", 2024-04-25T22:52:35.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.129e-06 2024-04-25T22:52:35.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.641 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:35.641 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012796+0000", 2024-04-25T22:52:35.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9231999999999999e-05 2024-04-25T22:52:35.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:35.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012915+0000", 2024-04-25T22:52:35.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119021 2024-04-25T22:52:35.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:35.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013069+0000", 2024-04-25T22:52:35.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015463900000000001 2024-04-25T22:52:35.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:35.643 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019237+0000", 2024-04-25T22:52:35.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061680329999999998 2024-04-25T22:52:35.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.643 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:35.643 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023603+0000", 2024-04-25T22:52:35.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043655860000000003 2024-04-25T22:52:35.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.643 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:35.643 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023659+0000", 2024-04-25T22:52:35.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6484000000000003e-05 2024-04-25T22:52:35.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.644 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:35.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023701+0000", 2024-04-25T22:52:35.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1761999999999998e-05 2024-04-25T22:52:35.644 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:35.644 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:35.644 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:35.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.644 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.644 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:35.644 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:35.644 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 42.559251873000001, 2024-04-25T22:52:35.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011234429000000001, 2024-04-25T22:52:35.644 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:35.644 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:35.645 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:35.645 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:35.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.645 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:35.645 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:35.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:35.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.645 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:35.645 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:35.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:35.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:35.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012762+0000", 2024-04-25T22:52:35.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-04-25T22:52:35.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:35.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012765+0000", 2024-04-25T22:52:35.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2569999999999999e-06 2024-04-25T22:52:35.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:35.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012783+0000", 2024-04-25T22:52:35.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8431999999999999e-05 2024-04-25T22:52:35.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:35.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012799+0000", 2024-04-25T22:52:35.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5438999999999999e-05 2024-04-25T22:52:35.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:35.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013826+0000", 2024-04-25T22:52:35.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010275060000000001 2024-04-25T22:52:35.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:35.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013913+0000", 2024-04-25T22:52:35.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.708e-05 2024-04-25T22:52:35.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:35.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014098+0000", 2024-04-25T22:52:35.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018519399999999999 2024-04-25T22:52:35.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:35.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019684+0000", 2024-04-25T22:52:35.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055860079999999999 2024-04-25T22:52:35.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:35.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023876+0000", 2024-04-25T22:52:35.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041918800000000003 2024-04-25T22:52:35.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:35.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023957+0000", 2024-04-25T22:52:35.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1165e-05 2024-04-25T22:52:35.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:35.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023995+0000", 2024-04-25T22:52:35.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:52:35.649 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:35.649 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:35.649 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:35.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.650 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:35.650 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:35.650 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 42.559154094, 2024-04-25T22:52:35.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011131200000000001, 2024-04-25T22:52:35.650 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:35.650 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:35.650 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:35.650 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:35.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:35.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:35.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:35.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:35.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:35.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:35.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:35.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012860+0000", 2024-04-25T22:52:35.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3900000000000004e-07 2024-04-25T22:52:35.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:35.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012865+0000", 2024-04-25T22:52:35.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5609999999999998e-06 2024-04-25T22:52:35.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:35.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012895+0000", 2024-04-25T22:52:35.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9847000000000001e-05 2024-04-25T22:52:35.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:35.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012905+0000", 2024-04-25T22:52:35.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.03e-05 2024-04-25T22:52:35.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:35.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015020+0000", 2024-04-25T22:52:35.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021142940000000001 2024-04-25T22:52:35.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:35.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015182+0000", 2024-04-25T22:52:35.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016248099999999999 2024-04-25T22:52:35.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:52:35.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015357+0000", 2024-04-25T22:52:35.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017471000000000001 2024-04-25T22:52:35.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:35.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021021+0000", 2024-04-25T22:52:35.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056638340000000004 2024-04-25T22:52:35.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.654 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:35.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023712+0000", 2024-04-25T22:52:35.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026910380000000002 2024-04-25T22:52:35.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.654 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:35.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023763+0000", 2024-04-25T22:52:35.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1477999999999997e-05 2024-04-25T22:52:35.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.654 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:35.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023990+0000", 2024-04-25T22:52:35.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000226818 2024-04-25T22:52:35.655 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:35.655 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:35.655 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:35.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.655 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:35.655 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:35.655 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 42.559030997999997, 2024-04-25T22:52:35.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011705299000000001, 2024-04-25T22:52:35.655 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:35.655 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:35.655 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:35.655 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:35.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:35.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:35.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:35.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:35.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:35.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:35.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:35.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012983+0000", 2024-04-25T22:52:35.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:52:35.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:35.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012986+0000", 2024-04-25T22:52:35.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5700000000000001e-06 2024-04-25T22:52:35.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:35.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012993+0000", 2024-04-25T22:52:35.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8730000000000001e-06 2024-04-25T22:52:35.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:35.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013000+0000", 2024-04-25T22:52:35.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1890000000000001e-06 2024-04-25T22:52:35.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.658 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:35.658 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:52:35.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002147866 2024-04-25T22:52:35.658 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.658 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:35.658 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015351+0000", 2024-04-25T22:52:35.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020300799999999999 2024-04-25T22:52:35.658 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.658 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:35.658 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016260+0000", 2024-04-25T22:52:35.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00090926799999999997 2024-04-25T22:52:35.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.659 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:35.659 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022669+0000", 2024-04-25T22:52:35.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064082849999999997 2024-04-25T22:52:35.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.659 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:35.659 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024584+0000", 2024-04-25T22:52:35.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019151699999999999 2024-04-25T22:52:35.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.659 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:35.659 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024643+0000", 2024-04-25T22:52:35.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8888999999999998e-05 2024-04-25T22:52:35.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:35.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024687+0000", 2024-04-25T22:52:35.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4444999999999999e-05 2024-04-25T22:52:35.660 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:35.660 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:35.660 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:35.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.660 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:35.660 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:35.660 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 42.559003406999999, 2024-04-25T22:52:35.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011249699, 2024-04-25T22:52:35.661 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:35.661 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:35.661 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:35.661 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:35.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:35.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:35.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:35.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:35.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:35.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:35.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.662 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:35.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013010+0000", 2024-04-25T22:52:35.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2099999999999996e-07 2024-04-25T22:52:35.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.662 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:35.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013013+0000", 2024-04-25T22:52:35.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1310000000000002e-06 2024-04-25T22:52:35.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:35.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013020+0000", 2024-04-25T22:52:35.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3330000000000002e-06 2024-04-25T22:52:35.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:35.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013025+0000", 2024-04-25T22:52:35.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6760000000000004e-06 2024-04-25T22:52:35.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:35.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013163+0000", 2024-04-25T22:52:35.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013824599999999999 2024-04-25T22:52:35.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:35.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013504+0000", 2024-04-25T22:52:35.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034080299999999998 2024-04-25T22:52:35.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:35.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013613+0000", 2024-04-25T22:52:35.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108705 2024-04-25T22:52:35.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.665 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:35.665 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015831+0000", 2024-04-25T22:52:35.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002217672 2024-04-25T22:52:35.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.665 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:35.665 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024137+0000", 2024-04-25T22:52:35.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0083060489999999994 2024-04-25T22:52:35.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.665 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:35.665 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024218+0000", 2024-04-25T22:52:35.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1351000000000001e-05 2024-04-25T22:52:35.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.666 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:35.666 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024259+0000", 2024-04-25T22:52:35.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1112000000000002e-05 2024-04-25T22:52:35.666 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:35.666 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:35.666 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:35.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.666 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:35.666 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:35.666 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 42.558915681000002, 2024-04-25T22:52:35.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020379749999999999, 2024-04-25T22:52:35.667 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:35.667 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:35.667 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:35.667 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:35.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:35.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:35.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:35.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:35.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:35.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:35.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:35.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013098+0000", 2024-04-25T22:52:35.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:52:35.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:35.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013105+0000", 2024-04-25T22:52:35.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5969999999999997e-06 2024-04-25T22:52:35.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:35.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013190+0000", 2024-04-25T22:52:35.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5618999999999995e-05 2024-04-25T22:52:35.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:35.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013200+0000", 2024-04-25T22:52:35.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5859999999999994e-06 2024-04-25T22:52:35.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:35.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020265+0000", 2024-04-25T22:52:35.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070653349999999998 2024-04-25T22:52:35.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:35.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020454+0000", 2024-04-25T22:52:35.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189316 2024-04-25T22:52:35.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:35.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020586+0000", 2024-04-25T22:52:35.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013195700000000001 2024-04-25T22:52:35.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:35.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023822+0000", 2024-04-25T22:52:35.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032358529999999999 2024-04-25T22:52:35.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:35.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033409+0000", 2024-04-25T22:52:35.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095870520000000004 2024-04-25T22:52:35.671 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.671 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:35.671 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033447+0000", 2024-04-25T22:52:35.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7261999999999997e-05 2024-04-25T22:52:35.671 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.671 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:35.671 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033477+0000", 2024-04-25T22:52:35.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0389e-05 2024-04-25T22:52:35.671 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:35.671 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:35.671 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:35.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.672 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:35.672 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:35.672 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 42.558799174999997, 2024-04-25T22:52:35.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010857383999999999, 2024-04-25T22:52:35.672 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:35.672 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:35.672 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:35.672 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:35.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:35.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:35.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:35.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:35.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:35.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:35.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:35.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:35.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:52:35.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:35.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013218+0000", 2024-04-25T22:52:35.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8199999999999998e-06 2024-04-25T22:52:35.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:35.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013226+0000", 2024-04-25T22:52:35.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7649999999999993e-06 2024-04-25T22:52:35.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:35.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013259+0000", 2024-04-25T22:52:35.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2727e-05 2024-04-25T22:52:35.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:35.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014809+0000", 2024-04-25T22:52:35.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001550144 2024-04-25T22:52:35.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:35.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014958+0000", 2024-04-25T22:52:35.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014890300000000001 2024-04-25T22:52:35.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:52:35.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015087+0000", 2024-04-25T22:52:35.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012939200000000001 2024-04-25T22:52:35.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.676 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:35.676 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020212+0000", 2024-04-25T22:52:35.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051248939999999996 2024-04-25T22:52:35.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.676 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:35.676 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023699+0000", 2024-04-25T22:52:35.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034873289999999999 2024-04-25T22:52:35.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.676 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:35.676 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024014+0000", 2024-04-25T22:52:35.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031473999999999999 2024-04-25T22:52:35.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:35.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024071+0000", 2024-04-25T22:52:35.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7040000000000003e-05 2024-04-25T22:52:35.677 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:35.677 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:35.677 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:35.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.677 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:35.677 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:35.677 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 42.558744470000001, 2024-04-25T22:52:35.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012329677000000001, 2024-04-25T22:52:35.678 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:35.678 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:35.678 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:35.678 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:35.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:35.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:35.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:35.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:35.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:35.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:35.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:35.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013269+0000", 2024-04-25T22:52:35.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5000000000000002e-07 2024-04-25T22:52:35.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:35.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:52:35.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6909999999999999e-06 2024-04-25T22:52:35.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:35.680 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013284+0000", 2024-04-25T22:52:35.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0963e-05 2024-04-25T22:52:35.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.680 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:35.680 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013361+0000", 2024-04-25T22:52:35.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7379999999999994e-05 2024-04-25T22:52:35.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.680 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:35.680 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013448+0000", 2024-04-25T22:52:35.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6990000000000006e-05 2024-04-25T22:52:35.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:35.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013632+0000", 2024-04-25T22:52:35.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018396800000000001 2024-04-25T22:52:35.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:35.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013800+0000", 2024-04-25T22:52:35.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167467 2024-04-25T22:52:35.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:35.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.018570+0000", 2024-04-25T22:52:35.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047701460000000003 2024-04-25T22:52:35.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:35.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025507+0000", 2024-04-25T22:52:35.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069372039999999998 2024-04-25T22:52:35.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:35.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025562+0000", 2024-04-25T22:52:35.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4858999999999998e-05 2024-04-25T22:52:35.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:35.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025598+0000", 2024-04-25T22:52:35.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6259e-05 2024-04-25T22:52:35.683 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:35.683 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:35.683 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:35.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.683 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:35.683 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:35.683 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 42.558612597, 2024-04-25T22:52:35.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020176666999999999, 2024-04-25T22:52:35.684 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:35.684 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:35.684 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:52:35.684 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:35.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:35.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:35.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:35.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:35.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:35.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:35.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:35.685 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:52:35.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-04-25T22:52:35.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:35.685 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013405+0000", 2024-04-25T22:52:35.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0559999999999998e-06 2024-04-25T22:52:35.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:35.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013422+0000", 2024-04-25T22:52:35.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6770999999999999e-05 2024-04-25T22:52:35.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.686 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:35.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013431+0000", 2024-04-25T22:52:35.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5019999999999998e-06 2024-04-25T22:52:35.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.686 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:35.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021720+0000", 2024-04-25T22:52:35.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082884340000000008 2024-04-25T22:52:35.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:35.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022122+0000", 2024-04-25T22:52:35.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000401634 2024-04-25T22:52:35.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:35.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:35.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:35.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033577+0000", 2024-04-25T22:52:35.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011455435999999999 2024-04-25T22:52:35.687 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:35.687 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:35.687 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:35.687 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:35.687 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:35.687 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:35.689 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:52:35.690 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:35.688+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:35.790 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:35.788+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:35.796 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-25T22:52:35.796 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-25T22:52:35.796 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-25T22:52:35.796 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-25T22:52:35.805 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:52:35.891 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:35.890+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:35.948 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-25T22:52:35.948 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-25T22:52:35.948 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-25T22:52:35.948 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-25T22:52:35.948 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-25T22:52:35.956 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:52:36.000 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:35.999+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:36.060 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-25T22:52:36.060 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-25T22:52:36.061 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-25T22:52:36.061 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-25T22:52:36.061 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.061 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(mds.0.3:28 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:52:36.061 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.013845+0000", 2024-04-25T22:52:36.061 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.045140994, 2024-04-25T22:52:36.061 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002002658, 2024-04-25T22:52:36.061 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:36.061 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:36.061 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:36.061 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:36.062 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.062 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:36.062 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013845+0000", 2024-04-25T22:52:36.062 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:36.062 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.062 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.062 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:36.062 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013845+0000", 2024-04-25T22:52:36.062 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:36.062 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.063 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.063 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:36.063 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013845+0000", 2024-04-25T22:52:36.063 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6100000000000002e-07 2024-04-25T22:52:36.063 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.063 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.063 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:36.063 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013859+0000", 2024-04-25T22:52:36.063 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4045e-05 2024-04-25T22:52:36.063 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.063 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.063 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:36.064 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013883+0000", 2024-04-25T22:52:36.064 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4020999999999999e-05 2024-04-25T22:52:36.064 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.064 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.064 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:36.064 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013904+0000", 2024-04-25T22:52:36.064 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.084e-05 2024-04-25T22:52:36.064 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.064 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.064 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:36.064 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013953+0000", 2024-04-25T22:52:36.064 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8652000000000001e-05 2024-04-25T22:52:36.065 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.065 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.065 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:36.065 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.013983+0000", 2024-04-25T22:52:36.065 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0083e-05 2024-04-25T22:52:36.065 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.065 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.065 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:36.065 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015809+0000", 2024-04-25T22:52:36.065 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001826708 2024-04-25T22:52:36.065 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.065 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.066 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:36.066 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015848+0000", 2024-04-25T22:52:36.066 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8047999999999999e-05 2024-04-25T22:52:36.066 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:36.066 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:36.066 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:36.066 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.066 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.066 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:36.066 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.014834+0000", 2024-04-25T22:52:36.066 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.044151399, 2024-04-25T22:52:36.067 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0082660119999999997, 2024-04-25T22:52:36.067 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:36.067 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:36.067 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:36.067 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:36.067 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.067 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:36.067 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014834+0000", 2024-04-25T22:52:36.067 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:36.067 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.067 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.067 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:36.067 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014834+0000", 2024-04-25T22:52:36.068 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:36.068 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.068 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.068 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:36.068 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014837+0000", 2024-04-25T22:52:36.068 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.774e-06 2024-04-25T22:52:36.068 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.068 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.068 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:36.068 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014844+0000", 2024-04-25T22:52:36.068 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.1629999999999999e-06 2024-04-25T22:52:36.068 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.069 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.069 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:36.069 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014853+0000", 2024-04-25T22:52:36.069 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0829999999999993e-06 2024-04-25T22:52:36.069 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.069 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.069 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:36.069 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014862+0000", 2024-04-25T22:52:36.069 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0239999999999997e-06 2024-04-25T22:52:36.069 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.069 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.069 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:36.070 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014926+0000", 2024-04-25T22:52:36.070 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4571000000000002e-05 2024-04-25T22:52:36.070 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.070 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.070 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:36.070 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015064+0000", 2024-04-25T22:52:36.070 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013788200000000001 2024-04-25T22:52:36.070 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.070 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.070 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:36.070 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015240+0000", 2024-04-25T22:52:36.071 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000175697 2024-04-25T22:52:36.071 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.071 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.071 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:36.071 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017382+0000", 2024-04-25T22:52:36.071 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021422920000000001 2024-04-25T22:52:36.071 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.071 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.071 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:36.071 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023016+0000", 2024-04-25T22:52:36.071 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00563446 2024-04-25T22:52:36.071 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.071 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.072 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:36.072 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023062+0000", 2024-04-25T22:52:36.072 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5667999999999997e-05 2024-04-25T22:52:36.072 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.072 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.072 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:36.072 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023100+0000", 2024-04-25T22:52:36.072 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8398000000000001e-05 2024-04-25T22:52:36.072 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:36.072 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:36.072 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:36.073 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.073 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.073 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:36.073 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.014883+0000", 2024-04-25T22:52:36.073 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.044103180999997, 2024-04-25T22:52:36.073 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0083115319999999999, 2024-04-25T22:52:36.073 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:36.073 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:36.073 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:36.073 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:36.073 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.073 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:36.074 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014883+0000", 2024-04-25T22:52:36.074 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:36.074 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.074 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.074 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:36.074 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014883+0000", 2024-04-25T22:52:36.074 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:36.074 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.074 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.074 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:36.074 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014883+0000", 2024-04-25T22:52:36.075 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1200000000000003e-07 2024-04-25T22:52:36.075 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.075 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.075 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:36.075 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014887+0000", 2024-04-25T22:52:36.075 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4249999999999998e-06 2024-04-25T22:52:36.075 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.075 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.075 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:36.075 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014892+0000", 2024-04-25T22:52:36.075 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1150000000000002e-06 2024-04-25T22:52:36.076 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.076 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.076 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:36.076 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014896+0000", 2024-04-25T22:52:36.076 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3030000000000001e-06 2024-04-25T22:52:36.076 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.076 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.076 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:36.076 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015597+0000", 2024-04-25T22:52:36.076 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00070106400000000005 2024-04-25T22:52:36.076 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.077 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.077 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:36.077 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015681+0000", 2024-04-25T22:52:36.077 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.3417000000000004e-05 2024-04-25T22:52:36.077 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.077 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.077 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:36.077 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015800+0000", 2024-04-25T22:52:36.077 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000119522 2024-04-25T22:52:36.077 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.077 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.078 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:36.078 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017389+0000", 2024-04-25T22:52:36.078 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0015889739999999999 2024-04-25T22:52:36.078 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.078 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.078 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:36.078 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023129+0000", 2024-04-25T22:52:36.078 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0057398420000000002 2024-04-25T22:52:36.078 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.078 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.078 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:36.079 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023161+0000", 2024-04-25T22:52:36.079 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2002999999999998e-05 2024-04-25T22:52:36.079 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.079 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.079 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:36.079 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023194+0000", 2024-04-25T22:52:36.079 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3355000000000002e-05 2024-04-25T22:52:36.079 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:36.079 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:36.079 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:36.079 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.079 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.080 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:36.080 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.014902+0000", 2024-04-25T22:52:36.080 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.044083536000002, 2024-04-25T22:52:36.080 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0078159460000000007, 2024-04-25T22:52:36.080 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:36.080 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:36.080 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:36.080 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:36.080 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.080 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:36.081 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014902+0000", 2024-04-25T22:52:36.081 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:36.081 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.081 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.081 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:36.081 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014902+0000", 2024-04-25T22:52:36.081 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:36.081 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.081 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.081 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:36.081 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014903+0000", 2024-04-25T22:52:36.081 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.65e-07 2024-04-25T22:52:36.082 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.082 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.082 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:36.082 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014910+0000", 2024-04-25T22:52:36.082 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7619999999999995e-06 2024-04-25T22:52:36.082 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.082 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.082 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:36.082 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014915+0000", 2024-04-25T22:52:36.082 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2660000000000003e-06 2024-04-25T22:52:36.083 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.083 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.083 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:36.083 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014918+0000", 2024-04-25T22:52:36.083 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.331e-06 2024-04-25T22:52:36.083 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.083 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.083 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:36.083 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015554+0000", 2024-04-25T22:52:36.083 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00063627599999999996 2024-04-25T22:52:36.083 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.084 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.084 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:36.084 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015685+0000", 2024-04-25T22:52:36.084 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013059399999999999 2024-04-25T22:52:36.084 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.084 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.084 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:36.084 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015820+0000", 2024-04-25T22:52:36.084 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013471499999999999 2024-04-25T22:52:36.084 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.084 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.084 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:36.085 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017394+0000", 2024-04-25T22:52:36.085 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0015747459999999999 2024-04-25T22:52:36.085 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.085 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.085 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:36.085 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022598+0000", 2024-04-25T22:52:36.085 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.005203811 2024-04-25T22:52:36.085 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.085 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.085 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:36.085 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022671+0000", 2024-04-25T22:52:36.086 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3042999999999998e-05 2024-04-25T22:52:36.086 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.086 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.086 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:36.086 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022718+0000", 2024-04-25T22:52:36.086 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7136999999999999e-05 2024-04-25T22:52:36.086 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:36.086 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:36.086 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:36.086 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.087 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.087 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:36.087 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.014933+0000", 2024-04-25T22:52:36.087 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.044053161999997, 2024-04-25T22:52:36.087 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0079271519999999998, 2024-04-25T22:52:36.087 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:36.087 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:36.087 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:36.087 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:36.087 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.087 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:36.087 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014933+0000", 2024-04-25T22:52:36.087 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:36.088 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.088 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.088 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:36.088 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014933+0000", 2024-04-25T22:52:36.088 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:36.088 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.088 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.088 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:36.088 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014933+0000", 2024-04-25T22:52:36.088 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0999999999999999e-07 2024-04-25T22:52:36.088 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.088 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.089 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:36.089 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014937+0000", 2024-04-25T22:52:36.089 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6090000000000001e-06 2024-04-25T22:52:36.089 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.089 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.089 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:36.089 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014943+0000", 2024-04-25T22:52:36.089 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.7100000000000001e-06 2024-04-25T22:52:36.089 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.089 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.090 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:36.090 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014949+0000", 2024-04-25T22:52:36.090 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9410000000000004e-06 2024-04-25T22:52:36.090 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.090 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.090 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:36.090 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016135+0000", 2024-04-25T22:52:36.090 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0011854750000000001 2024-04-25T22:52:36.090 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.090 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.090 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:36.091 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016185+0000", 2024-04-25T22:52:36.091 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.9888000000000001e-05 2024-04-25T22:52:36.091 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.091 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.091 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:36.091 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016297+0000", 2024-04-25T22:52:36.091 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011231299999999999 2024-04-25T22:52:36.091 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.091 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.091 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:36.091 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017399+0000", 2024-04-25T22:52:36.091 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0011018149999999999 2024-04-25T22:52:36.091 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.092 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.092 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:36.092 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022764+0000", 2024-04-25T22:52:36.092 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0053649819999999999 2024-04-25T22:52:36.092 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.092 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.092 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:36.092 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022821+0000", 2024-04-25T22:52:36.092 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7655000000000003e-05 2024-04-25T22:52:36.092 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.092 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.092 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:36.093 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022860+0000", 2024-04-25T22:52:36.093 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8353999999999999e-05 2024-04-25T22:52:36.093 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:36.093 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:36.093 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:36.093 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.093 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.093 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:36.093 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.014957+0000", 2024-04-25T22:52:36.093 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.044029330999997, 2024-04-25T22:52:36.093 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0083856810000000007, 2024-04-25T22:52:36.093 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:36.093 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:36.094 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:36.094 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:36.094 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.094 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:36.094 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014957+0000", 2024-04-25T22:52:36.094 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:36.094 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.094 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.094 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:36.094 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014957+0000", 2024-04-25T22:52:36.094 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:36.094 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.095 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.095 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:36.095 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014957+0000", 2024-04-25T22:52:36.095 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:52:36.095 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.095 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.095 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:36.095 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014961+0000", 2024-04-25T22:52:36.095 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2309999999999998e-06 2024-04-25T22:52:36.095 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.095 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.095 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:36.096 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014969+0000", 2024-04-25T22:52:36.096 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2540000000000003e-06 2024-04-25T22:52:36.096 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.096 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.096 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:36.096 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014972+0000", 2024-04-25T22:52:36.096 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4580000000000002e-06 2024-04-25T22:52:36.096 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.096 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.096 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:36.096 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016130+0000", 2024-04-25T22:52:36.096 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001157812 2024-04-25T22:52:36.097 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.097 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.097 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:36.097 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016247+0000", 2024-04-25T22:52:36.097 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000117268 2024-04-25T22:52:36.097 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.097 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.097 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:36.097 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016381+0000", 2024-04-25T22:52:36.097 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013417999999999999 2024-04-25T22:52:36.098 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.098 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.098 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:36.098 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017946+0000", 2024-04-25T22:52:36.098 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001564817 2024-04-25T22:52:36.098 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.098 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.098 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:36.098 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023240+0000", 2024-04-25T22:52:36.098 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0052938289999999999 2024-04-25T22:52:36.099 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.099 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.099 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:36.099 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023295+0000", 2024-04-25T22:52:36.099 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4969999999999997e-05 2024-04-25T22:52:36.099 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.099 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.099 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:36.099 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023342+0000", 2024-04-25T22:52:36.099 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7126000000000002e-05 2024-04-25T22:52:36.099 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:36.100 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:36.100 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:36.100 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.100 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.100 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:36.100 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.014978+0000", 2024-04-25T22:52:36.100 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.044008212999998, 2024-04-25T22:52:36.100 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0074058609999999997, 2024-04-25T22:52:36.100 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:36.100 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:36.100 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:36.101 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:36.101 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.101 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:36.101 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014978+0000", 2024-04-25T22:52:36.101 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:36.101 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.101 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.101 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:36.101 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014978+0000", 2024-04-25T22:52:36.101 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:36.101 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.101 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.102 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:36.102 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014978+0000", 2024-04-25T22:52:36.102 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0600000000000001e-07 2024-04-25T22:52:36.102 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.102 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.102 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:36.102 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014980+0000", 2024-04-25T22:52:36.102 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3130000000000001e-06 2024-04-25T22:52:36.102 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.102 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.102 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:36.102 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014984+0000", 2024-04-25T22:52:36.103 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6689999999999999e-06 2024-04-25T22:52:36.103 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.103 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.103 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:36.103 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014987+0000", 2024-04-25T22:52:36.103 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0709999999999999e-06 2024-04-25T22:52:36.103 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.103 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.103 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:36.103 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015035+0000", 2024-04-25T22:52:36.104 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7737000000000001e-05 2024-04-25T22:52:36.104 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.104 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.104 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:36.104 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:52:36.104 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000113053 2024-04-25T22:52:36.104 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.104 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.104 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:36.104 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015255+0000", 2024-04-25T22:52:36.104 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010735599999999999 2024-04-25T22:52:36.105 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.105 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.105 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:36.105 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016248+0000", 2024-04-25T22:52:36.105 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00099310200000000005 2024-04-25T22:52:36.105 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.105 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.105 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:36.105 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022282+0000", 2024-04-25T22:52:36.106 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060341769999999999 2024-04-25T22:52:36.106 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.106 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.106 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:36.106 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022341+0000", 2024-04-25T22:52:36.106 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8938999999999999e-05 2024-04-25T22:52:36.106 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.106 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.106 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:36.106 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022384+0000", 2024-04-25T22:52:36.107 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2138000000000002e-05 2024-04-25T22:52:36.107 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:36.107 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:36.107 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:36.107 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.107 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.107 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:36.107 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.014995+0000", 2024-04-25T22:52:36.107 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.043990469999997, 2024-04-25T22:52:36.107 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0075678170000000001, 2024-04-25T22:52:36.107 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:36.108 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:36.108 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-25T22:52:36.108 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:36.108 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.108 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:36.108 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014995+0000", 2024-04-25T22:52:36.108 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:36.108 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.108 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.108 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:36.108 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014995+0000", 2024-04-25T22:52:36.108 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:36.108 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.109 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.109 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:36.109 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014996+0000", 2024-04-25T22:52:36.109 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7500000000000001e-07 2024-04-25T22:52:36.109 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.109 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.109 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:36.109 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.014998+0000", 2024-04-25T22:52:36.109 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2330000000000001e-06 2024-04-25T22:52:36.109 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.109 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.110 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:36.110 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015002+0000", 2024-04-25T22:52:36.110 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9570000000000004e-06 2024-04-25T22:52:36.110 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.110 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.110 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:36.110 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015008+0000", 2024-04-25T22:52:36.110 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0340000000000002e-06 2024-04-25T22:52:36.110 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.110 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.110 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:36.111 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015476+0000", 2024-04-25T22:52:36.111 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00046806899999999999 2024-04-25T22:52:36.111 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.111 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.111 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:36.111 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015565+0000", 2024-04-25T22:52:36.111 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.9126e-05 2024-04-25T22:52:36.111 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.111 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.111 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:36.111 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022563+0000", 2024-04-25T22:52:36.111 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0069981230000000002 2024-04-25T22:52:36.112 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:36.112 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:36.112 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:36.112 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.112 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.112 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:36.112 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.015033+0000", 2024-04-25T22:52:36.112 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.043952416000003, 2024-04-25T22:52:36.112 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010204922999999999, 2024-04-25T22:52:36.112 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:36.112 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:36.112 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-25T22:52:36.113 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:36.113 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.113 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:36.113 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015033+0000", 2024-04-25T22:52:36.113 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:36.113 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.113 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.113 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:36.113 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015033+0000", 2024-04-25T22:52:36.113 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:36.113 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.113 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.114 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:36.114 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015036+0000", 2024-04-25T22:52:36.114 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9110000000000002e-06 2024-04-25T22:52:36.114 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.114 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.114 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:36.114 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015040+0000", 2024-04-25T22:52:36.114 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0570000000000003e-06 2024-04-25T22:52:36.114 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.114 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.114 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:36.115 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015050+0000", 2024-04-25T22:52:36.115 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1449999999999997e-06 2024-04-25T22:52:36.115 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.115 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.115 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:36.115 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015058+0000", 2024-04-25T22:52:36.115 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.3960000000000006e-06 2024-04-25T22:52:36.115 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.115 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.115 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:36.115 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016951+0000", 2024-04-25T22:52:36.116 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0018930150000000001 2024-04-25T22:52:36.116 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.116 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.116 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:36.116 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017101+0000", 2024-04-25T22:52:36.116 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00015004800000000001 2024-04-25T22:52:36.116 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.116 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.116 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:36.116 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.025238+0000", 2024-04-25T22:52:36.117 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0081373509999999993 2024-04-25T22:52:36.117 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:36.117 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:36.117 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:36.117 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.117 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.117 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:36.117 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.015069+0000", 2024-04-25T22:52:36.117 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.043916482, 2024-04-25T22:52:36.117 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0066281769999999999, 2024-04-25T22:52:36.117 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:36.117 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:36.118 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-25T22:52:36.118 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:36.118 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.118 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:36.118 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015069+0000", 2024-04-25T22:52:36.118 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:36.118 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.118 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.118 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:36.118 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015069+0000", 2024-04-25T22:52:36.118 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:36.119 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.119 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.119 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:36.119 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015070+0000", 2024-04-25T22:52:36.119 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8899999999999999e-07 2024-04-25T22:52:36.119 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.119 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.119 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:36.119 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015082+0000", 2024-04-25T22:52:36.119 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.164e-05 2024-04-25T22:52:36.119 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.120 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.120 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:36.120 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015093+0000", 2024-04-25T22:52:36.120 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1066e-05 2024-04-25T22:52:36.120 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.120 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.120 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:36.120 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015099+0000", 2024-04-25T22:52:36.120 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8619999999999999e-06 2024-04-25T22:52:36.120 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.121 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.121 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:36.121 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:52:36.121 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.9821000000000003e-05 2024-04-25T22:52:36.121 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.121 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.121 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:36.121 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.015221+0000", 2024-04-25T22:52:36.121 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2868999999999996e-05 2024-04-25T22:52:36.121 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.121 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.122 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:36.122 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021698+0000", 2024-04-25T22:52:36.122 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064762300000000004 2024-04-25T22:52:36.122 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:36.122 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:36.122 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:36.122 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.122 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.122 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:52:36.122 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.016597+0000", 2024-04-25T22:52:36.122 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.042388840000001, 2024-04-25T22:52:36.123 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001422113, 2024-04-25T22:52:36.123 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:36.123 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:36.123 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:36.123 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:36.123 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.123 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:36.123 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016597+0000", 2024-04-25T22:52:36.123 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:36.123 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.123 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.123 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:36.124 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016597+0000", 2024-04-25T22:52:36.124 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:36.124 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.124 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.124 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:36.124 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016598+0000", 2024-04-25T22:52:36.124 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2900000000000004e-07 2024-04-25T22:52:36.124 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.124 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.124 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:36.124 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016616+0000", 2024-04-25T22:52:36.124 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8876e-05 2024-04-25T22:52:36.125 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.125 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.125 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:36.125 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016626+0000", 2024-04-25T22:52:36.125 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.8900000000000002e-06 2024-04-25T22:52:36.125 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.125 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.125 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:36.125 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016634+0000", 2024-04-25T22:52:36.125 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7060000000000004e-06 2024-04-25T22:52:36.125 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.126 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.126 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:36.126 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016706+0000", 2024-04-25T22:52:36.126 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.2102999999999997e-05 2024-04-25T22:52:36.126 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.126 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.126 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:36.126 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016727+0000", 2024-04-25T22:52:36.126 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.0687e-05 2024-04-25T22:52:36.126 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.126 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.127 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:36.127 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017972+0000", 2024-04-25T22:52:36.127 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0012454829999999999 2024-04-25T22:52:36.127 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.127 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.127 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:36.127 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.018019+0000", 2024-04-25T22:52:36.127 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6839000000000003e-05 2024-04-25T22:52:36.127 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:36.127 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:36.129 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:36.129 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.129 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.129 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-25T22:52:36.129 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.016652+0000", 2024-04-25T22:52:36.129 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.042334226000001, 2024-04-25T22:52:36.129 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004473599, 2024-04-25T22:52:36.130 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:36.130 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:36.130 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:36.130 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:36.130 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.130 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:36.130 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016652+0000", 2024-04-25T22:52:36.130 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:36.130 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.130 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.131 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:36.131 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016652+0000", 2024-04-25T22:52:36.131 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:36.131 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.131 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.131 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:36.131 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016652+0000", 2024-04-25T22:52:36.131 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1899999999999998e-07 2024-04-25T22:52:36.131 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.131 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.131 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:36.132 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016657+0000", 2024-04-25T22:52:36.132 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4680000000000003e-06 2024-04-25T22:52:36.132 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.132 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.132 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:36.132 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016664+0000", 2024-04-25T22:52:36.132 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.8210000000000002e-06 2024-04-25T22:52:36.132 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.132 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.132 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:36.133 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016669+0000", 2024-04-25T22:52:36.133 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8520000000000003e-06 2024-04-25T22:52:36.133 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.133 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.133 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:36.133 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016779+0000", 2024-04-25T22:52:36.133 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000109444 2024-04-25T22:52:36.133 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.133 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.133 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:36.133 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016798+0000", 2024-04-25T22:52:36.133 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9799000000000001e-05 2024-04-25T22:52:36.134 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.134 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.134 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:36.134 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021086+0000", 2024-04-25T22:52:36.134 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042879889999999999 2024-04-25T22:52:36.134 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.134 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.134 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:36.134 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021125+0000", 2024-04-25T22:52:36.134 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8807000000000003e-05 2024-04-25T22:52:36.134 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:36.134 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:36.135 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:36.135 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.135 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.135 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-25T22:52:36.135 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.016733+0000", 2024-04-25T22:52:36.135 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.042253326999997, 2024-04-25T22:52:36.135 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004231612, 2024-04-25T22:52:36.135 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:36.135 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:36.135 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:36.135 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:36.135 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.136 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:36.136 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016733+0000", 2024-04-25T22:52:36.136 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:36.136 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.136 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.136 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:36.136 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016733+0000", 2024-04-25T22:52:36.136 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:36.136 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.136 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.136 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:36.136 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016733+0000", 2024-04-25T22:52:36.137 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2100000000000002e-07 2024-04-25T22:52:36.137 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.137 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.137 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:36.137 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016756+0000", 2024-04-25T22:52:36.137 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2886000000000001e-05 2024-04-25T22:52:36.137 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.137 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.137 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:36.137 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016765+0000", 2024-04-25T22:52:36.137 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.3610000000000007e-06 2024-04-25T22:52:36.137 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.138 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.138 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:36.138 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.016771+0000", 2024-04-25T22:52:36.138 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0020000000000003e-06 2024-04-25T22:52:36.138 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.138 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.138 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:36.138 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017050+0000", 2024-04-25T22:52:36.138 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00027877199999999999 2024-04-25T22:52:36.138 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.138 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.139 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:36.139 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.017067+0000", 2024-04-25T22:52:36.139 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7499e-05 2024-04-25T22:52:36.139 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.139 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.139 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:36.139 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.020921+0000", 2024-04-25T22:52:36.139 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003853123 2024-04-25T22:52:36.139 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.139 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.139 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:36.140 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.020964+0000", 2024-04-25T22:52:36.140 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3547999999999997e-05 2024-04-25T22:52:36.140 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:36.140 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:36.140 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:36.140 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.140 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.140 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 1 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:52:36.140 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.019562+0000", 2024-04-25T22:52:36.140 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.039424283000002, 2024-04-25T22:52:36.140 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0045866930000000002, 2024-04-25T22:52:36.140 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:36.141 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:36.141 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "reached pg", 2024-04-25T22:52:36.141 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:36.141 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.141 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:36.141 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.019562+0000", 2024-04-25T22:52:36.141 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:36.141 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.141 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.141 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:36.141 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.019562+0000", 2024-04-25T22:52:36.142 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:36.142 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.142 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.142 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:36.142 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.019562+0000", 2024-04-25T22:52:36.142 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0100000000000005e-07 2024-04-25T22:52:36.142 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.142 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.142 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:36.142 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.019570+0000", 2024-04-25T22:52:36.142 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5599999999999996e-06 2024-04-25T22:52:36.142 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.143 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.143 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:36.143 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.019586+0000", 2024-04-25T22:52:36.143 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.6086000000000002e-05 2024-04-25T22:52:36.143 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.143 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.143 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:36.143 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.019600+0000", 2024-04-25T22:52:36.143 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3934000000000001e-05 2024-04-25T22:52:36.143 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.143 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.144 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:36.144 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.019889+0000", 2024-04-25T22:52:36.144 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00028888200000000002 2024-04-25T22:52:36.144 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.144 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.144 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:36.144 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.024148+0000", 2024-04-25T22:52:36.144 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042597299999999998 2024-04-25T22:52:36.144 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:36.144 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:36.144 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:36.144 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.145 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.145 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-25T22:52:36.145 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.021542+0000", 2024-04-25T22:52:36.145 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.037444029, 2024-04-25T22:52:36.145 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001339589, 2024-04-25T22:52:36.145 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:36.145 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:36.145 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-25T22:52:36.145 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:36.145 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.145 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:36.145 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021542+0000", 2024-04-25T22:52:36.146 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:36.146 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.146 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.146 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:36.146 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021542+0000", 2024-04-25T22:52:36.146 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:36.146 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.146 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.146 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:36.146 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021542+0000", 2024-04-25T22:52:36.146 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1600000000000002e-07 2024-04-25T22:52:36.147 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.147 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.147 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:36.147 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021545+0000", 2024-04-25T22:52:36.147 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.774e-06 2024-04-25T22:52:36.147 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.147 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.147 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:36.147 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021553+0000", 2024-04-25T22:52:36.147 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.2099999999999993e-06 2024-04-25T22:52:36.147 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.147 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.148 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:36.148 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021559+0000", 2024-04-25T22:52:36.148 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.1249999999999998e-06 2024-04-25T22:52:36.148 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.148 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.148 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:36.148 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022752+0000", 2024-04-25T22:52:36.148 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0011931120000000001 2024-04-25T22:52:36.148 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.148 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.148 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:36.148 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022759+0000", 2024-04-25T22:52:36.149 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4420000000000003e-06 2024-04-25T22:52:36.149 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.149 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.149 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:36.149 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.022881+0000", 2024-04-25T22:52:36.149 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012250999999999999 2024-04-25T22:52:36.149 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:36.149 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:36.149 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:36.149 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.149 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.149 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e14/12 ondisk, result = 0)", 2024-04-25T22:52:36.150 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.021769+0000", 2024-04-25T22:52:36.150 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.037216764999997, 2024-04-25T22:52:36.150 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001336928, 2024-04-25T22:52:36.150 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:36.150 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:36.150 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-25T22:52:36.150 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:36.150 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.151 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:36.151 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021769+0000", 2024-04-25T22:52:36.151 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:36.151 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.151 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.151 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:36.151 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021769+0000", 2024-04-25T22:52:36.151 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:36.151 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.151 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.151 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:36.152 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021770+0000", 2024-04-25T22:52:36.152 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7700000000000005e-07 2024-04-25T22:52:36.152 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.152 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.152 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:36.152 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021773+0000", 2024-04-25T22:52:36.152 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5250000000000001e-06 2024-04-25T22:52:36.152 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.152 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.152 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:36.152 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021780+0000", 2024-04-25T22:52:36.153 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.187e-06 2024-04-25T22:52:36.153 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.153 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.153 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:36.153 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021796+0000", 2024-04-25T22:52:36.153 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5218000000000001e-05 2024-04-25T22:52:36.153 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.153 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.153 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:36.153 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023001+0000", 2024-04-25T22:52:36.154 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001205993 2024-04-25T22:52:36.154 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.154 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.154 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:36.154 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023009+0000", 2024-04-25T22:52:36.154 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9249999999999995e-06 2024-04-25T22:52:36.154 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.154 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.154 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:36.154 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023106+0000", 2024-04-25T22:52:36.154 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6602999999999996e-05 2024-04-25T22:52:36.155 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:36.155 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:36.155 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:36.155 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.155 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.155 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-25T22:52:36.155 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:53.021807+0000", 2024-04-25T22:52:36.155 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 43.037178374, 2024-04-25T22:52:36.155 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0013936809999999999, 2024-04-25T22:52:36.155 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:36.155 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:36.156 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-25T22:52:36.156 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:36.156 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.156 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:36.156 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021807+0000", 2024-04-25T22:52:36.156 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:36.156 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.156 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.156 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:36.156 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021807+0000", 2024-04-25T22:52:36.156 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:36.157 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.157 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.157 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:36.157 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021808+0000", 2024-04-25T22:52:36.157 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3200000000000001e-07 2024-04-25T22:52:36.157 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.157 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.157 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:36.157 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021811+0000", 2024-04-25T22:52:36.157 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5480000000000002e-06 2024-04-25T22:52:36.157 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.157 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.158 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:36.158 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021818+0000", 2024-04-25T22:52:36.158 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4450000000000001e-06 2024-04-25T22:52:36.158 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.158 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.158 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:36.158 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.021823+0000", 2024-04-25T22:52:36.158 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.22e-06 2024-04-25T22:52:36.158 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.158 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.159 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:36.159 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023122+0000", 2024-04-25T22:52:36.159 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001298808 2024-04-25T22:52:36.159 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.159 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.159 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:36.159 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023126+0000", 2024-04-25T22:52:36.159 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9400000000000004e-06 2024-04-25T22:52:36.159 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.159 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.159 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:36.160 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:53.023201+0000", 2024-04-25T22:52:36.160 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5388000000000004e-05 2024-04-25T22:52:36.160 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:36.160 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:36.160 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:36.160 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.160 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.160 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-25T22:52:36.160 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:51:55.010264+0000", 2024-04-25T22:52:36.160 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 41.048722193000003, 2024-04-25T22:52:36.160 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001484476, 2024-04-25T22:52:36.161 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:36.161 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:36.161 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:36.161 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:36.161 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.161 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:36.161 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010264+0000", 2024-04-25T22:52:36.161 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:36.161 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.161 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.161 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:36.161 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010264+0000", 2024-04-25T22:52:36.162 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:36.162 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.162 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.162 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:36.162 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010265+0000", 2024-04-25T22:52:36.162 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5e-06 2024-04-25T22:52:36.162 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.162 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.162 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:36.162 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010272+0000", 2024-04-25T22:52:36.162 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0910000000000004e-06 2024-04-25T22:52:36.163 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.163 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.163 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:36.163 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010287+0000", 2024-04-25T22:52:36.163 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4644000000000001e-05 2024-04-25T22:52:36.163 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.163 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.163 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:36.163 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010296+0000", 2024-04-25T22:52:36.163 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2159999999999995e-06 2024-04-25T22:52:36.163 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.163 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.164 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:36.164 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010394+0000", 2024-04-25T22:52:36.164 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.8148999999999998e-05 2024-04-25T22:52:36.164 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.164 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.164 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:36.164 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010503+0000", 2024-04-25T22:52:36.164 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000108857 2024-04-25T22:52:36.164 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.164 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.164 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:36.165 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.010592+0000", 2024-04-25T22:52:36.165 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.9083000000000001e-05 2024-04-25T22:52:36.165 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.165 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.165 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:36.165 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.011161+0000", 2024-04-25T22:52:36.165 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00056919800000000003 2024-04-25T22:52:36.165 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.165 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.165 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:36.165 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.011676+0000", 2024-04-25T22:52:36.166 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00051500999999999999 2024-04-25T22:52:36.166 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.166 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.166 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:36.166 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.011717+0000", 2024-04-25T22:52:36.166 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0262999999999997e-05 2024-04-25T22:52:36.166 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.166 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.166 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:36.166 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:51:55.011748+0000", 2024-04-25T22:52:36.166 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1464999999999998e-05 2024-04-25T22:52:36.167 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:36.167 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:36.167 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:36.167 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.167 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.167 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-25T22:52:36.167 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:52:17.012790+0000", 2024-04-25T22:52:36.167 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 19.046196348999999, 2024-04-25T22:52:36.167 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001434444, 2024-04-25T22:52:36.167 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:36.168 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:36.168 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:36.168 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:36.168 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.168 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:36.168 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.012790+0000", 2024-04-25T22:52:36.168 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:36.168 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.168 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.168 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:36.169 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.012790+0000", 2024-04-25T22:52:36.169 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:36.169 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.169 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.169 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:36.169 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.012791+0000", 2024-04-25T22:52:36.169 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0699999999999999e-06 2024-04-25T22:52:36.169 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.169 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.169 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:36.169 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.012797+0000", 2024-04-25T22:52:36.169 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0519999999999998e-06 2024-04-25T22:52:36.170 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.170 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.170 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:36.170 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.012811+0000", 2024-04-25T22:52:36.170 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4287999999999999e-05 2024-04-25T22:52:36.170 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.170 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.170 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:36.170 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.012838+0000", 2024-04-25T22:52:36.170 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6727999999999999e-05 2024-04-25T22:52:36.170 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.171 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.171 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:36.171 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.012909+0000", 2024-04-25T22:52:36.171 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.1211000000000006e-05 2024-04-25T22:52:36.171 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.171 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.171 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:36.171 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.013015+0000", 2024-04-25T22:52:36.171 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010619 2024-04-25T22:52:36.171 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.171 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.171 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:36.171 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.013189+0000", 2024-04-25T22:52:36.172 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00017439199999999999 2024-04-25T22:52:36.172 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.172 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.172 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:36.172 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.013903+0000", 2024-04-25T22:52:36.172 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00071379099999999997 2024-04-25T22:52:36.172 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.172 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.172 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:36.172 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.014159+0000", 2024-04-25T22:52:36.172 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00025561699999999998 2024-04-25T22:52:36.173 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.173 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.173 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:36.173 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.014192+0000", 2024-04-25T22:52:36.173 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2941000000000002e-05 2024-04-25T22:52:36.173 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.173 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.173 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:36.173 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:17.014224+0000", 2024-04-25T22:52:36.173 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2163999999999999e-05 2024-04-25T22:52:36.173 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:36.173 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:36.174 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:36.174 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.174 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.174 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-25T22:52:36.174 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-25T22:52:23.013398+0000", 2024-04-25T22:52:36.174 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 13.045587885, 2024-04-25T22:52:36.174 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0015020369999999999, 2024-04-25T22:52:36.174 INFO:teuthology.orchestra.run.smithi164.stdout: "continuous": false, 2024-04-25T22:52:36.174 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-25T22:52:36.174 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:36.175 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-25T22:52:36.175 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.175 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-25T22:52:36.175 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:23.013398+0000", 2024-04-25T22:52:36.175 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:36.175 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.175 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.175 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-25T22:52:36.175 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:23.013398+0000", 2024-04-25T22:52:36.175 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-25T22:52:36.175 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.175 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.175 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-25T22:52:36.176 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:23.013399+0000", 2024-04-25T22:52:36.176 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.362e-06 2024-04-25T22:52:36.176 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.176 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.176 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-25T22:52:36.176 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:23.013406+0000", 2024-04-25T22:52:36.176 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.1409999999999999e-06 2024-04-25T22:52:36.176 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.176 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.176 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-25T22:52:36.176 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:23.013420+0000", 2024-04-25T22:52:36.176 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3232e-05 2024-04-25T22:52:36.176 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.177 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.177 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-25T22:52:36.177 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:23.013429+0000", 2024-04-25T22:52:36.177 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0310000000000004e-06 2024-04-25T22:52:36.177 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.177 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.177 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-25T22:52:36.177 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:23.013514+0000", 2024-04-25T22:52:36.177 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5620999999999999e-05 2024-04-25T22:52:36.177 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.177 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.177 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-25T22:52:36.178 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:23.013581+0000", 2024-04-25T22:52:36.178 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.6804999999999995e-05 2024-04-25T22:52:36.178 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.178 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.178 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:36.178 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:23.013683+0000", 2024-04-25T22:52:36.178 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010186 2024-04-25T22:52:36.178 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.178 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.178 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-25T22:52:36.178 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:23.014298+0000", 2024-04-25T22:52:36.179 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061501399999999999 2024-04-25T22:52:36.179 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.179 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.179 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:36.179 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:23.014839+0000", 2024-04-25T22:52:36.179 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000540523 2024-04-25T22:52:36.179 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.179 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.179 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-25T22:52:36.179 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:23.014871+0000", 2024-04-25T22:52:36.179 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2004000000000001e-05 2024-04-25T22:52:36.180 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-25T22:52:36.180 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-25T22:52:36.180 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-25T22:52:36.180 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-25T22:52:23.014900+0000", 2024-04-25T22:52:36.180 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9444000000000001e-05 2024-04-25T22:52:36.180 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:36.180 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:36.180 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:36.180 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-25T22:52:36.180 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-25T22:52:36.180 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-25T22:52:36.183 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is unset 2024-04-25T22:52:36.183 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:52:36.184 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:36.181+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:36.272 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:52:36.283 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:36.282+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:36.297 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:36.297 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:52:36.297 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-25T22:52:36.297 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:36.307 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:52:36.384 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:36.383+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:36.405 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-25T22:52:36.406 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:52:36.411 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:36.411 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:52:36.411 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-25T22:52:36.411 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-25T22:52:36.411 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:36.420 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:52:36.425 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-25T22:52:36.425 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:52:36.442 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-25T22:52:36.443 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:52:36.504 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:36.503+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:36.563 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:36.563 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:36.573 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:52:36.586 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:36.585+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:36.686 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:36.686 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:36.687 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:36.686+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:36.695 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:52:36.787 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:36.786+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:36.797 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:36.797 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:36.807 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:52:36.888 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:36.887+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:36.950 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:36.950 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:36.959 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:52:37.002 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:37.001+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:37.074 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:37.075 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:37.084 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-25T22:52:37.089 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:37.089+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:37.190 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:37.190+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:37.228 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:37.228 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:37.237 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-25T22:52:37.291 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:37.291+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:37.338 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:37.338 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:37.347 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:52:37.392 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:37.391+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:37.461 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:37.461 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:37.471 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:52:37.512 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:37.511+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:37.594 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:52:37.593+0000 7f682c630640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28625) UID: 0 2024-04-25T22:52:37.614 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:37.614 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:37.623 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:52:37.695 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:37.695+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:37.726 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:37.726 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:37.734 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:52:37.797 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:37.796+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:37.850 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:37.850 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:37.859 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:52:37.901 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:37.900+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:37.999 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:37.998+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:38.003 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:38.003 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:38.012 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:52:38.100 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:38.099+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:38.128 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-25T22:52:38.128 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-25T22:52:38.129 INFO:tasks.thrashosds.thrasher:Killing osd 1, live_osds are [0, 1, 2] 2024-04-25T22:52:38.129 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.1 doing powercycle of ubuntu@smithi164.front.sepia.ceph.com 2024-04-25T22:52:38.129 INFO:teuthology.orchestra.console.smithi164:Power off 2024-04-25T22:52:38.129 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-25T22:52:38.154 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:38.154 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:38.155 DEBUG:teuthology.orchestra.console.smithi164:power off output: Chassis Power Control: Down/Off 2024-04-25T22:52:38.155 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T22:52:38.166 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:52:38.179 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on 2024-04-25T22:52:38.185 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-25T22:52:38.210 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:38.209+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:38.269 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:38.270 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:38.278 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:52:38.302 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:38.301+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:38.403 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:38.402+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:38.419 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:38.419 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:38.428 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:52:38.455 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:52:38.504 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:38.503+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:38.572 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:38.572 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:38.580 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-25T22:52:38.580 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:52:38.582 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:52:38.598 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-25T22:52:38.599 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:52:38.605 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:38.604+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:38.617 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-25T22:52:38.617 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:52:38.688 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:38.689 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:52:38.689 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-04-25T22:52:38.689 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:38.697 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:52:38.705 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:38.705+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:38.799 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:38.799 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:52:38.800 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:52:38.800 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:52:38.800 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:38.806 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:38.805+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:38.808 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:52:38.907 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:38.907+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:38.952 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:38.952 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-04-25T22:52:38.952 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-04-25T22:52:38.952 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:52:38.952 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.953 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:38.953 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:38.953 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.985258340000001, 2024-04-25T22:52:38.953 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0103421, 2024-04-25T22:52:38.953 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:38.953 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:38.953 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:38.953 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:38.953 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:38.953 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:38.953 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 115 2024-04-25T22:52:38.953 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.953 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:38.953 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.954 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:38.954 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:38.954 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:38.954 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.954 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.954 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:38.954 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:38.954 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:38.954 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.954 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.954 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:38.954 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:38.955 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9500000000000002e-07 2024-04-25T22:52:38.955 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.955 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.955 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:38.955 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965108+0000", 2024-04-25T22:52:38.955 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9177999999999994e-05 2024-04-25T22:52:38.955 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.955 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.955 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:38.955 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965127+0000", 2024-04-25T22:52:38.955 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8868e-05 2024-04-25T22:52:38.955 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.955 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.955 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:38.956 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965133+0000", 2024-04-25T22:52:38.956 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8929999999999999e-06 2024-04-25T22:52:38.956 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.956 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.956 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:38.956 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.969991+0000", 2024-04-25T22:52:38.956 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048573849999999997 2024-04-25T22:52:38.956 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.956 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.956 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:38.956 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970072+0000", 2024-04-25T22:52:38.956 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0728000000000004e-05 2024-04-25T22:52:38.956 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.957 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.957 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:38.957 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970189+0000", 2024-04-25T22:52:38.957 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000117778 2024-04-25T22:52:38.957 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.957 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.957 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:38.957 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970946+0000", 2024-04-25T22:52:38.957 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00075704600000000004 2024-04-25T22:52:38.957 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.957 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.957 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:38.957 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975297+0000", 2024-04-25T22:52:38.957 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004350217 2024-04-25T22:52:38.958 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.958 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.958 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:38.958 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975343+0000", 2024-04-25T22:52:38.958 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6687999999999998e-05 2024-04-25T22:52:38.958 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.958 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.958 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:38.958 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975380+0000", 2024-04-25T22:52:38.958 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6724000000000003e-05 2024-04-25T22:52:38.958 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:38.958 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:38.958 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:38.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.959 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.959 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:38.959 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:38.959 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.985152309, 2024-04-25T22:52:38.959 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010304384, 2024-04-25T22:52:38.959 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:38.959 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:38.959 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:38.959 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:38.959 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:38.959 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:38.959 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 116 2024-04-25T22:52:38.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.960 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:38.960 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.960 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:38.960 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:38.960 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:38.960 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.960 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.960 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:38.960 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:38.960 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:38.960 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.960 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.960 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:38.960 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:38.961 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5799999999999999e-07 2024-04-25T22:52:38.961 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.961 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.961 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:38.961 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965154+0000", 2024-04-25T22:52:38.961 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0009e-05 2024-04-25T22:52:38.961 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.961 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.961 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:38.961 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965164+0000", 2024-04-25T22:52:38.961 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8490000000000001e-06 2024-04-25T22:52:38.961 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.961 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.962 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:38.962 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965169+0000", 2024-04-25T22:52:38.962 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0730000000000004e-06 2024-04-25T22:52:38.962 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.962 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.962 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:38.962 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970609+0000", 2024-04-25T22:52:38.962 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054397689999999997 2024-04-25T22:52:38.962 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.962 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.962 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:38.962 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970651+0000", 2024-04-25T22:52:38.962 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1873999999999999e-05 2024-04-25T22:52:38.962 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.963 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.963 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:38.963 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970723+0000", 2024-04-25T22:52:38.963 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2039999999999995e-05 2024-04-25T22:52:38.963 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.963 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.963 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:38.963 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971358+0000", 2024-04-25T22:52:38.963 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063489500000000001 2024-04-25T22:52:38.963 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.963 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.963 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:38.963 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975409+0000", 2024-04-25T22:52:38.963 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040506880000000002 2024-04-25T22:52:38.963 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.964 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.964 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:38.964 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975432+0000", 2024-04-25T22:52:38.964 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3315999999999998e-05 2024-04-25T22:52:38.964 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.964 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.964 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:38.964 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975448+0000", 2024-04-25T22:52:38.964 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6313000000000001e-05 2024-04-25T22:52:38.964 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:38.964 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:38.964 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:38.964 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.964 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.965 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:38.965 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:38.965 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.985117727000002, 2024-04-25T22:52:38.965 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010384338999999999, 2024-04-25T22:52:38.965 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:38.965 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:38.965 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:38.965 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:38.965 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:38.965 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:38.965 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-04-25T22:52:38.965 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.965 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:38.966 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.966 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:38.966 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:38.966 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:38.966 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.966 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.966 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:38.966 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:38.966 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:38.966 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.966 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.966 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:38.966 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:38.967 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3600000000000004e-07 2024-04-25T22:52:38.967 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.967 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.967 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:38.967 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965185+0000", 2024-04-25T22:52:38.967 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.117e-06 2024-04-25T22:52:38.967 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.967 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.967 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:38.967 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965192+0000", 2024-04-25T22:52:38.967 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3239999999999997e-06 2024-04-25T22:52:38.967 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.967 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.967 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:38.968 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965198+0000", 2024-04-25T22:52:38.968 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6370000000000004e-06 2024-04-25T22:52:38.968 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.968 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.968 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:38.968 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970973+0000", 2024-04-25T22:52:38.968 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057748239999999996 2024-04-25T22:52:38.968 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.968 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.968 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:38.968 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971049+0000", 2024-04-25T22:52:38.968 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6029e-05 2024-04-25T22:52:38.968 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.968 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.969 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:38.969 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971174+0000", 2024-04-25T22:52:38.969 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012462399999999999 2024-04-25T22:52:38.969 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.969 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.969 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:38.969 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971553+0000", 2024-04-25T22:52:38.969 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037896499999999999 2024-04-25T22:52:38.969 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.969 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.969 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:38.969 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975482+0000", 2024-04-25T22:52:38.970 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039297459999999996 2024-04-25T22:52:38.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.970 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.970 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:38.970 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975529+0000", 2024-04-25T22:52:38.970 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6387000000000002e-05 2024-04-25T22:52:38.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.970 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.970 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:38.970 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975563+0000", 2024-04-25T22:52:38.970 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4150000000000003e-05 2024-04-25T22:52:38.971 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:38.971 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:38.971 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:38.971 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.971 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.971 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:38.971 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:38.971 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 45.938071403999999, 2024-04-25T22:52:38.971 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012637705000000001, 2024-04-25T22:52:38.971 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:38.971 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:38.972 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:38.972 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:38.972 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.972 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:38.972 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:38.972 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:38.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.972 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.972 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:38.972 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:38.972 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:38.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.972 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.972 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:38.973 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012227+0000", 2024-04-25T22:52:38.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.863e-06 2024-04-25T22:52:38.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.973 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.973 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:38.973 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012236+0000", 2024-04-25T22:52:38.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1109999999999997e-06 2024-04-25T22:52:38.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.973 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.973 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:38.973 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012309+0000", 2024-04-25T22:52:38.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3242000000000001e-05 2024-04-25T22:52:38.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.973 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.973 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:38.974 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012324+0000", 2024-04-25T22:52:38.974 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4837e-05 2024-04-25T22:52:38.974 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.974 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:38.974 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015060+0000", 2024-04-25T22:52:38.974 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027363349999999999 2024-04-25T22:52:38.974 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.974 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:38.974 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015169+0000", 2024-04-25T22:52:38.974 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108372 2024-04-25T22:52:38.974 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.975 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.975 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:38.975 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015498+0000", 2024-04-25T22:52:38.975 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032949999999999999 2024-04-25T22:52:38.975 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.975 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.975 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:38.975 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021282+0000", 2024-04-25T22:52:38.975 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057836429999999998 2024-04-25T22:52:38.975 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.975 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.975 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:38.975 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024709+0000", 2024-04-25T22:52:38.975 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034271979999999998 2024-04-25T22:52:38.976 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.976 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.976 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:38.976 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024802+0000", 2024-04-25T22:52:38.976 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2960000000000004e-05 2024-04-25T22:52:38.976 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.976 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.976 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:38.976 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024863+0000", 2024-04-25T22:52:38.976 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0643999999999997e-05 2024-04-25T22:52:38.976 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:38.976 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:38.976 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:38.977 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.977 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.977 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:38.977 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:38.977 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 45.937947633, 2024-04-25T22:52:38.977 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012979447999999999, 2024-04-25T22:52:38.977 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:38.977 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:38.977 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:38.977 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:38.977 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.977 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:38.977 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:38.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:38.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.978 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:38.978 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:38.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:38.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.978 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:38.978 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:38.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:52:38.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.978 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:38.978 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012354+0000", 2024-04-25T22:52:38.979 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7740000000000004e-06 2024-04-25T22:52:38.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.979 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:38.979 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012365+0000", 2024-04-25T22:52:38.979 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.064e-05 2024-04-25T22:52:38.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.979 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:38.979 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012382+0000", 2024-04-25T22:52:38.979 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6999000000000001e-05 2024-04-25T22:52:38.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.979 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:38.980 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015958+0000", 2024-04-25T22:52:38.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035765699999999998 2024-04-25T22:52:38.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.980 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:38.980 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016037+0000", 2024-04-25T22:52:38.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8242000000000001e-05 2024-04-25T22:52:38.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.980 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:38.980 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016404+0000", 2024-04-25T22:52:38.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036784300000000002 2024-04-25T22:52:38.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.981 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:38.981 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021294+0000", 2024-04-25T22:52:38.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048890629999999999 2024-04-25T22:52:38.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.981 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:38.981 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024959+0000", 2024-04-25T22:52:38.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036651570000000001 2024-04-25T22:52:38.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.981 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:38.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025097+0000", 2024-04-25T22:52:38.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013788099999999999 2024-04-25T22:52:38.982 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.982 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:38.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025328+0000", 2024-04-25T22:52:38.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231492 2024-04-25T22:52:38.982 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:38.982 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:38.982 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:38.982 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.982 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:38.983 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:38.983 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 45.937859864000004, 2024-04-25T22:52:38.983 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013049827, 2024-04-25T22:52:38.983 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:38.983 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:38.983 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:38.983 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:38.983 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.983 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:38.983 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:38.983 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:38.983 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.983 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.984 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:38.984 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:38.984 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:38.984 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.984 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.984 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:38.984 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012437+0000", 2024-04-25T22:52:38.984 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-04-25T22:52:38.984 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.984 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.984 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:38.984 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012440+0000", 2024-04-25T22:52:38.984 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7609999999999999e-06 2024-04-25T22:52:38.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:38.985 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012449+0000", 2024-04-25T22:52:38.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.285e-06 2024-04-25T22:52:38.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:38.985 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012457+0000", 2024-04-25T22:52:38.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9510000000000006e-06 2024-04-25T22:52:38.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:38.985 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017106+0000", 2024-04-25T22:52:38.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046494220000000003 2024-04-25T22:52:38.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:38.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017223+0000", 2024-04-25T22:52:38.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116824 2024-04-25T22:52:38.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:38.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017345+0000", 2024-04-25T22:52:38.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122175 2024-04-25T22:52:38.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:38.987 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021299+0000", 2024-04-25T22:52:38.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039534879999999998 2024-04-25T22:52:38.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.987 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:38.987 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025398+0000", 2024-04-25T22:52:38.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040988960000000003 2024-04-25T22:52:38.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.987 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:38.987 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025439+0000", 2024-04-25T22:52:38.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0915999999999999e-05 2024-04-25T22:52:38.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.988 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:38.988 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025486+0000", 2024-04-25T22:52:38.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7534999999999998e-05 2024-04-25T22:52:38.988 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:38.988 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:38.988 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:38.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.988 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:38.988 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:38.988 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 45.937829712999999, 2024-04-25T22:52:38.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020988041999999998, 2024-04-25T22:52:38.988 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:38.989 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:38.989 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:38.989 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:38.989 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.989 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:38.989 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:38.989 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:38.989 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.989 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.989 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:38.989 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:38.989 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:38.989 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.989 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.990 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:38.990 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:38.990 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.99e-07 2024-04-25T22:52:38.990 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.990 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.990 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:38.990 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012470+0000", 2024-04-25T22:52:38.990 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2789999999999999e-06 2024-04-25T22:52:38.990 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.990 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.990 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:38.990 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012477+0000", 2024-04-25T22:52:38.990 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:52:38.991 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.991 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.991 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:38.991 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012500+0000", 2024-04-25T22:52:38.991 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2490999999999999e-05 2024-04-25T22:52:38.991 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.991 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.991 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:38.991 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021911+0000", 2024-04-25T22:52:38.991 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094114160000000006 2024-04-25T22:52:38.991 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.991 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.991 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:38.991 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022000+0000", 2024-04-25T22:52:38.992 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8601000000000001e-05 2024-04-25T22:52:38.992 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.992 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.992 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:38.992 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022359+0000", 2024-04-25T22:52:38.992 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035921999999999999 2024-04-25T22:52:38.992 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.992 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.992 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:38.992 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025541+0000", 2024-04-25T22:52:38.992 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031820619999999998 2024-04-25T22:52:38.992 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.992 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.993 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:38.993 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033375+0000", 2024-04-25T22:52:38.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078338379999999992 2024-04-25T22:52:38.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.993 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.993 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:38.993 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033415+0000", 2024-04-25T22:52:38.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9527000000000003e-05 2024-04-25T22:52:38.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.993 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.993 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:38.993 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033455+0000", 2024-04-25T22:52:38.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9932000000000003e-05 2024-04-25T22:52:38.993 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:38.994 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:38.994 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:38.994 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.994 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:38.994 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:38.994 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 45.937774519999998, 2024-04-25T22:52:38.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021043857999999999, 2024-04-25T22:52:38.994 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:38.994 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:38.994 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:38.994 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:38.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:38.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:38.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:38.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:38.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:38.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:38.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:38.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012523+0000", 2024-04-25T22:52:38.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.361e-06 2024-04-25T22:52:38.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.996 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.996 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:38.996 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012530+0000", 2024-04-25T22:52:38.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5440000000000004e-06 2024-04-25T22:52:38.996 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.996 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.996 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:38.996 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012541+0000", 2024-04-25T22:52:38.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1745e-05 2024-04-25T22:52:38.996 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.996 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.996 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:38.996 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012551+0000", 2024-04-25T22:52:38.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5789999999999993e-06 2024-04-25T22:52:38.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:38.997 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022709+0000", 2024-04-25T22:52:38.997 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010157685 2024-04-25T22:52:38.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:38.997 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022957+0000", 2024-04-25T22:52:38.997 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024824599999999998 2024-04-25T22:52:38.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:38.997 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023443+0000", 2024-04-25T22:52:38.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048578599999999999 2024-04-25T22:52:38.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.998 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:38.998 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025547+0000", 2024-04-25T22:52:38.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021044789999999998 2024-04-25T22:52:38.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.998 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:38.998 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033509+0000", 2024-04-25T22:52:38.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0079622180000000001 2024-04-25T22:52:38.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.998 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:38.999 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033542+0000", 2024-04-25T22:52:38.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3018000000000001e-05 2024-04-25T22:52:38.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.999 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.999 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:38.999 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033566+0000", 2024-04-25T22:52:38.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3197000000000002e-05 2024-04-25T22:52:38.999 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:38.999 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:38.999 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:38.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:38.999 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:38.999 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:38.999 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:39.000 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 45.937734554999999, 2024-04-25T22:52:39.000 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021122696, 2024-04-25T22:52:39.001 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:39.001 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:39.001 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:39.002 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:39.002 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.002 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:39.002 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:39.002 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:39.002 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.002 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.002 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:39.002 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:39.002 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:39.002 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.002 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.002 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:39.003 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:39.003 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:52:39.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.003 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:39.003 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012566+0000", 2024-04-25T22:52:39.003 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-04-25T22:52:39.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.003 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:39.003 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012619+0000", 2024-04-25T22:52:39.003 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2607e-05 2024-04-25T22:52:39.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.004 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:39.004 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012628+0000", 2024-04-25T22:52:39.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6500000000000008e-06 2024-04-25T22:52:39.004 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.004 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.004 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:39.004 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024024+0000", 2024-04-25T22:52:39.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011396007999999999 2024-04-25T22:52:39.004 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.004 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.004 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:39.004 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024198+0000", 2024-04-25T22:52:39.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000173215 2024-04-25T22:52:39.004 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.004 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.005 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:39.005 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024447+0000", 2024-04-25T22:52:39.005 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024898500000000002 2024-04-25T22:52:39.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.005 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:39.005 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026431+0000", 2024-04-25T22:52:39.005 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001984923 2024-04-25T22:52:39.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.005 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:39.005 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033608+0000", 2024-04-25T22:52:39.005 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071768459999999997 2024-04-25T22:52:39.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.006 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:39.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033646+0000", 2024-04-25T22:52:39.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299000000000003e-05 2024-04-25T22:52:39.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.006 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:39.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033684+0000", 2024-04-25T22:52:39.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8773000000000003e-05 2024-04-25T22:52:39.006 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:39.006 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:39.006 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:39.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.007 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:39.007 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:39.007 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 45.937645955999997, 2024-04-25T22:52:39.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021175381, 2024-04-25T22:52:39.007 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:39.007 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:39.007 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:39.007 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:39.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.007 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:39.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:39.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:39.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:39.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:39.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:39.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:39.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012651+0000", 2024-04-25T22:52:39.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:52:39.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:39.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012656+0000", 2024-04-25T22:52:39.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8899999999999998e-06 2024-04-25T22:52:39.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.009 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:39.009 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012666+0000", 2024-04-25T22:52:39.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0346999999999999e-05 2024-04-25T22:52:39.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.009 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.009 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:39.009 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012675+0000", 2024-04-25T22:52:39.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9930000000000001e-06 2024-04-25T22:52:39.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.009 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.009 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:39.009 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025661+0000", 2024-04-25T22:52:39.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01298531 2024-04-25T22:52:39.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.009 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.009 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:39.010 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025757+0000", 2024-04-25T22:52:39.010 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5822000000000005e-05 2024-04-25T22:52:39.010 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.010 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.010 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:39.010 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025907+0000", 2024-04-25T22:52:39.010 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015051499999999999 2024-04-25T22:52:39.010 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.010 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.010 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:39.010 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026435+0000", 2024-04-25T22:52:39.010 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052762200000000005 2024-04-25T22:52:39.011 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.011 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.011 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:39.011 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033732+0000", 2024-04-25T22:52:39.011 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072978419999999997 2024-04-25T22:52:39.011 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.011 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.011 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:39.011 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033787+0000", 2024-04-25T22:52:39.011 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4703999999999997e-05 2024-04-25T22:52:39.011 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.011 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.011 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:39.011 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033826+0000", 2024-04-25T22:52:39.011 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8458999999999999e-05 2024-04-25T22:52:39.012 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:39.012 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:39.012 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:39.012 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.012 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.012 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:39.012 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:39.012 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 45.937590542000002, 2024-04-25T22:52:39.012 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021244174000000001, 2024-04-25T22:52:39.012 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:39.012 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:39.012 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:39.012 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:39.012 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.012 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:39.013 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:39.013 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:39.013 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.013 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.013 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:39.013 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:39.013 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:39.013 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.013 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.013 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:39.013 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:39.013 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:52:39.013 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.014 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.014 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:39.014 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012712+0000", 2024-04-25T22:52:39.014 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.913e-06 2024-04-25T22:52:39.014 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.014 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.014 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:39.014 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012722+0000", 2024-04-25T22:52:39.014 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2879999999999998e-06 2024-04-25T22:52:39.014 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.014 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.014 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:39.014 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012727+0000", 2024-04-25T22:52:39.015 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8429999999999998e-06 2024-04-25T22:52:39.015 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.015 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.015 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:39.015 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026099+0000", 2024-04-25T22:52:39.015 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013371450999999999 2024-04-25T22:52:39.015 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.015 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.015 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:39.015 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026147+0000", 2024-04-25T22:52:39.015 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7837999999999998e-05 2024-04-25T22:52:39.015 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.015 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.016 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:39.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026254+0000", 2024-04-25T22:52:39.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107314 2024-04-25T22:52:39.016 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.016 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.016 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:39.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026686+0000", 2024-04-25T22:52:39.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000432428 2024-04-25T22:52:39.016 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.016 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.016 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:39.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033873+0000", 2024-04-25T22:52:39.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071864399999999997 2024-04-25T22:52:39.016 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.017 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.017 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:39.017 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033904+0000", 2024-04-25T22:52:39.017 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1321e-05 2024-04-25T22:52:39.017 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.017 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.017 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:39.017 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033950+0000", 2024-04-25T22:52:39.017 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5707999999999997e-05 2024-04-25T22:52:39.017 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:39.017 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:39.017 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:39.017 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.017 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.017 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:39.018 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:39.018 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 45.937560157, 2024-04-25T22:52:39.018 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01096505, 2024-04-25T22:52:39.018 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:39.018 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:39.018 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:39.018 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:39.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.018 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:39.018 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:39.018 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:39.018 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.018 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:39.019 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:39.019 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:39.019 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.019 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.019 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:39.019 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012737+0000", 2024-04-25T22:52:39.019 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:52:39.019 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.019 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.019 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:39.019 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012739+0000", 2024-04-25T22:52:39.019 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-04-25T22:52:39.019 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.020 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:39.020 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012743+0000", 2024-04-25T22:52:39.020 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3239999999999996e-06 2024-04-25T22:52:39.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.020 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:39.020 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012746+0000", 2024-04-25T22:52:39.020 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.129e-06 2024-04-25T22:52:39.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.020 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:39.020 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012796+0000", 2024-04-25T22:52:39.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9231999999999999e-05 2024-04-25T22:52:39.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.021 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:39.021 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012915+0000", 2024-04-25T22:52:39.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119021 2024-04-25T22:52:39.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.021 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:39.021 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013069+0000", 2024-04-25T22:52:39.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015463900000000001 2024-04-25T22:52:39.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.021 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:39.022 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019237+0000", 2024-04-25T22:52:39.022 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061680329999999998 2024-04-25T22:52:39.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.022 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.022 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:39.022 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023603+0000", 2024-04-25T22:52:39.022 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043655860000000003 2024-04-25T22:52:39.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.022 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.022 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:39.022 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023659+0000", 2024-04-25T22:52:39.022 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6484000000000003e-05 2024-04-25T22:52:39.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.023 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.023 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:39.023 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023701+0000", 2024-04-25T22:52:39.023 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1761999999999998e-05 2024-04-25T22:52:39.023 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:39.023 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:39.023 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:39.023 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.023 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.023 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:39.023 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:39.023 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 45.937535209000004, 2024-04-25T22:52:39.023 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011234429000000001, 2024-04-25T22:52:39.023 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:39.023 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:39.024 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:39.024 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:39.024 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.024 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:39.024 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:39.024 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:39.024 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.024 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.024 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:39.024 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:39.024 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:39.024 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.025 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.025 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:39.025 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012762+0000", 2024-04-25T22:52:39.025 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-04-25T22:52:39.025 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.025 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.025 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:39.025 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012765+0000", 2024-04-25T22:52:39.025 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2569999999999999e-06 2024-04-25T22:52:39.025 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.025 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.025 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:39.025 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012783+0000", 2024-04-25T22:52:39.025 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8431999999999999e-05 2024-04-25T22:52:39.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:39.026 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012799+0000", 2024-04-25T22:52:39.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5438999999999999e-05 2024-04-25T22:52:39.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:39.026 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013826+0000", 2024-04-25T22:52:39.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010275060000000001 2024-04-25T22:52:39.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:39.026 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013913+0000", 2024-04-25T22:52:39.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.708e-05 2024-04-25T22:52:39.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.027 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.027 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:39.027 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014098+0000", 2024-04-25T22:52:39.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018519399999999999 2024-04-25T22:52:39.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.027 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.027 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:39.027 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019684+0000", 2024-04-25T22:52:39.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055860079999999999 2024-04-25T22:52:39.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.027 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.027 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:39.027 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023876+0000", 2024-04-25T22:52:39.028 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041918800000000003 2024-04-25T22:52:39.028 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.028 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:39.028 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023957+0000", 2024-04-25T22:52:39.028 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1165e-05 2024-04-25T22:52:39.028 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.028 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:39.028 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023995+0000", 2024-04-25T22:52:39.028 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:52:39.028 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:39.028 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:39.028 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:39.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.029 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.029 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:39.029 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:39.029 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 45.937437430000003, 2024-04-25T22:52:39.029 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011131200000000001, 2024-04-25T22:52:39.029 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:39.029 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:39.029 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:39.029 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:39.029 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.029 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:39.029 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:39.029 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:39.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.030 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.030 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:39.030 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:39.030 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:39.030 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.030 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.030 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:39.030 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012860+0000", 2024-04-25T22:52:39.030 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3900000000000004e-07 2024-04-25T22:52:39.030 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.030 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.030 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:39.030 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012865+0000", 2024-04-25T22:52:39.030 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5609999999999998e-06 2024-04-25T22:52:39.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.031 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.031 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:39.031 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012895+0000", 2024-04-25T22:52:39.031 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9847000000000001e-05 2024-04-25T22:52:39.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.031 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.031 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:39.031 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012905+0000", 2024-04-25T22:52:39.032 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.03e-05 2024-04-25T22:52:39.032 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.032 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.032 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:39.032 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015020+0000", 2024-04-25T22:52:39.032 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021142940000000001 2024-04-25T22:52:39.032 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.032 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.033 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:39.033 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015182+0000", 2024-04-25T22:52:39.033 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016248099999999999 2024-04-25T22:52:39.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.033 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:52:39.033 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015357+0000", 2024-04-25T22:52:39.033 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017471000000000001 2024-04-25T22:52:39.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.033 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:39.033 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021021+0000", 2024-04-25T22:52:39.033 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056638340000000004 2024-04-25T22:52:39.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.034 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:39.034 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023712+0000", 2024-04-25T22:52:39.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026910380000000002 2024-04-25T22:52:39.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.034 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:39.034 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023763+0000", 2024-04-25T22:52:39.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1477999999999997e-05 2024-04-25T22:52:39.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.034 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:39.034 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023990+0000", 2024-04-25T22:52:39.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000226818 2024-04-25T22:52:39.035 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:39.035 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:39.035 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:39.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.035 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.035 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:39.035 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:39.035 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 45.937314334, 2024-04-25T22:52:39.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011705299000000001, 2024-04-25T22:52:39.035 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:39.035 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:39.035 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:39.036 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:39.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.036 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:39.036 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:39.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:39.036 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.036 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:39.036 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:39.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:39.036 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.036 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:39.036 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012983+0000", 2024-04-25T22:52:39.037 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:52:39.037 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.037 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.037 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:39.037 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012986+0000", 2024-04-25T22:52:39.037 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5700000000000001e-06 2024-04-25T22:52:39.037 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.037 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.037 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:39.037 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012993+0000", 2024-04-25T22:52:39.037 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8730000000000001e-06 2024-04-25T22:52:39.037 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.037 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.037 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:39.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013000+0000", 2024-04-25T22:52:39.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1890000000000001e-06 2024-04-25T22:52:39.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:39.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:52:39.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002147866 2024-04-25T22:52:39.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:39.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015351+0000", 2024-04-25T22:52:39.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020300799999999999 2024-04-25T22:52:39.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:39.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016260+0000", 2024-04-25T22:52:39.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00090926799999999997 2024-04-25T22:52:39.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:39.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022669+0000", 2024-04-25T22:52:39.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064082849999999997 2024-04-25T22:52:39.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:39.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024584+0000", 2024-04-25T22:52:39.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019151699999999999 2024-04-25T22:52:39.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:39.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024643+0000", 2024-04-25T22:52:39.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8888999999999998e-05 2024-04-25T22:52:39.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:39.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024687+0000", 2024-04-25T22:52:39.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4444999999999999e-05 2024-04-25T22:52:39.040 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:39.040 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:39.040 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:39.041 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.041 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.041 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:39.041 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:39.041 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 45.937286743000001, 2024-04-25T22:52:39.041 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011249699, 2024-04-25T22:52:39.041 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:39.041 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:39.041 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:39.041 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:39.041 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.041 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:39.041 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:39.041 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:39.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.042 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:39.042 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:39.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:39.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.042 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:39.042 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013010+0000", 2024-04-25T22:52:39.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2099999999999996e-07 2024-04-25T22:52:39.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.042 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:39.042 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013013+0000", 2024-04-25T22:52:39.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1310000000000002e-06 2024-04-25T22:52:39.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.043 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:39.043 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013020+0000", 2024-04-25T22:52:39.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3330000000000002e-06 2024-04-25T22:52:39.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.043 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:39.043 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013025+0000", 2024-04-25T22:52:39.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6760000000000004e-06 2024-04-25T22:52:39.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.043 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:39.044 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013163+0000", 2024-04-25T22:52:39.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013824599999999999 2024-04-25T22:52:39.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.044 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.044 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:39.044 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013504+0000", 2024-04-25T22:52:39.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034080299999999998 2024-04-25T22:52:39.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.044 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.044 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:39.044 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013613+0000", 2024-04-25T22:52:39.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108705 2024-04-25T22:52:39.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.044 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:39.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015831+0000", 2024-04-25T22:52:39.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002217672 2024-04-25T22:52:39.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:39.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024137+0000", 2024-04-25T22:52:39.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0083060489999999994 2024-04-25T22:52:39.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:39.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024218+0000", 2024-04-25T22:52:39.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1351000000000001e-05 2024-04-25T22:52:39.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.046 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:39.046 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024259+0000", 2024-04-25T22:52:39.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1112000000000002e-05 2024-04-25T22:52:39.046 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:39.046 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:39.046 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:39.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.046 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:39.046 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:39.046 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 45.937199016999998, 2024-04-25T22:52:39.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020379749999999999, 2024-04-25T22:52:39.047 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:39.047 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:39.047 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:39.047 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:39.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:39.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:39.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:39.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:39.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:39.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:39.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.048 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:39.048 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013098+0000", 2024-04-25T22:52:39.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:52:39.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.048 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:39.048 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013105+0000", 2024-04-25T22:52:39.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5969999999999997e-06 2024-04-25T22:52:39.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.048 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:39.048 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013190+0000", 2024-04-25T22:52:39.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5618999999999995e-05 2024-04-25T22:52:39.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:39.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013200+0000", 2024-04-25T22:52:39.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5859999999999994e-06 2024-04-25T22:52:39.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:39.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020265+0000", 2024-04-25T22:52:39.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070653349999999998 2024-04-25T22:52:39.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:39.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020454+0000", 2024-04-25T22:52:39.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189316 2024-04-25T22:52:39.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:39.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020586+0000", 2024-04-25T22:52:39.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013195700000000001 2024-04-25T22:52:39.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:39.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023822+0000", 2024-04-25T22:52:39.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032358529999999999 2024-04-25T22:52:39.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:39.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033409+0000", 2024-04-25T22:52:39.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095870520000000004 2024-04-25T22:52:39.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:39.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033447+0000", 2024-04-25T22:52:39.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7261999999999997e-05 2024-04-25T22:52:39.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:39.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033477+0000", 2024-04-25T22:52:39.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0389e-05 2024-04-25T22:52:39.051 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:39.051 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:39.051 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:39.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.052 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:39.052 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:39.052 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 45.937082511, 2024-04-25T22:52:39.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010857383999999999, 2024-04-25T22:52:39.052 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:39.052 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:39.052 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:39.052 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:39.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:39.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:39.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:39.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.053 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:39.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:39.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:39.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.053 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:39.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:39.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:52:39.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.053 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:39.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013218+0000", 2024-04-25T22:52:39.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8199999999999998e-06 2024-04-25T22:52:39.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:39.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013226+0000", 2024-04-25T22:52:39.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7649999999999993e-06 2024-04-25T22:52:39.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:39.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013259+0000", 2024-04-25T22:52:39.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2727e-05 2024-04-25T22:52:39.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:39.055 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014809+0000", 2024-04-25T22:52:39.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001550144 2024-04-25T22:52:39.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.055 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:39.055 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014958+0000", 2024-04-25T22:52:39.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014890300000000001 2024-04-25T22:52:39.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.055 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:52:39.055 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015087+0000", 2024-04-25T22:52:39.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012939200000000001 2024-04-25T22:52:39.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.055 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:39.056 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020212+0000", 2024-04-25T22:52:39.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051248939999999996 2024-04-25T22:52:39.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:39.056 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023699+0000", 2024-04-25T22:52:39.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034873289999999999 2024-04-25T22:52:39.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:39.056 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024014+0000", 2024-04-25T22:52:39.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031473999999999999 2024-04-25T22:52:39.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:39.057 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024071+0000", 2024-04-25T22:52:39.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7040000000000003e-05 2024-04-25T22:52:39.057 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:39.057 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:39.057 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:39.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.057 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:39.057 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:39.057 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 45.937027806000003, 2024-04-25T22:52:39.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012329677000000001, 2024-04-25T22:52:39.057 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:39.057 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:39.057 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:39.058 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:39.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:39.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:39.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:39.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:39.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:39.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:39.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:39.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013269+0000", 2024-04-25T22:52:39.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5000000000000002e-07 2024-04-25T22:52:39.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:39.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:52:39.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6909999999999999e-06 2024-04-25T22:52:39.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:39.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013284+0000", 2024-04-25T22:52:39.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0963e-05 2024-04-25T22:52:39.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:39.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013361+0000", 2024-04-25T22:52:39.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7379999999999994e-05 2024-04-25T22:52:39.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:39.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013448+0000", 2024-04-25T22:52:39.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6990000000000006e-05 2024-04-25T22:52:39.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:39.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013632+0000", 2024-04-25T22:52:39.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018396800000000001 2024-04-25T22:52:39.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:39.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013800+0000", 2024-04-25T22:52:39.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167467 2024-04-25T22:52:39.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:39.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.018570+0000", 2024-04-25T22:52:39.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047701460000000003 2024-04-25T22:52:39.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:39.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025507+0000", 2024-04-25T22:52:39.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069372039999999998 2024-04-25T22:52:39.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:39.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025562+0000", 2024-04-25T22:52:39.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4858999999999998e-05 2024-04-25T22:52:39.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:39.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025598+0000", 2024-04-25T22:52:39.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6259e-05 2024-04-25T22:52:39.062 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:39.062 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:39.062 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:39.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.063 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:39.063 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:39.063 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 45.936895933000002, 2024-04-25T22:52:39.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020176666999999999, 2024-04-25T22:52:39.063 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:39.063 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:39.063 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:52:39.063 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:39.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:39.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:39.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:39.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.064 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:39.064 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:39.064 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:39.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.064 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:39.064 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:52:39.064 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-04-25T22:52:39.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.064 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:39.064 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013405+0000", 2024-04-25T22:52:39.064 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0559999999999998e-06 2024-04-25T22:52:39.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:39.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013422+0000", 2024-04-25T22:52:39.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6770999999999999e-05 2024-04-25T22:52:39.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:39.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013431+0000", 2024-04-25T22:52:39.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5019999999999998e-06 2024-04-25T22:52:39.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:39.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021720+0000", 2024-04-25T22:52:39.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082884340000000008 2024-04-25T22:52:39.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:39.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022122+0000", 2024-04-25T22:52:39.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000401634 2024-04-25T22:52:39.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:39.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033577+0000", 2024-04-25T22:52:39.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011455435999999999 2024-04-25T22:52:39.066 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:39.066 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:39.067 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:39.067 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:39.067 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:39.067 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:39.068 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:39.067+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:39.069 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:52:39.126 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is set 2024-04-25T22:52:39.169 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:39.167+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:39.175 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:39.175 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:52:39.175 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-25T22:52:39.175 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:39.184 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:52:39.269 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:39.268+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:39.286 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:39.286 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:52:39.286 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-25T22:52:39.287 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-25T22:52:39.287 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:39.295 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:52:39.370 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:39.369+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:39.400 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:39.400 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:52:39.400 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:52:39.400 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:52:39.400 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.400 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:52:39.400 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:52:39.400 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 51.431437838000001, 2024-04-25T22:52:39.401 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:52:39.401 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:39.401 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:39.401 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:39.401 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:39.401 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.401 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:39.401 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:52:39.401 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:39.401 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.401 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.401 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:39.401 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:52:39.401 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:39.402 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.402 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.402 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:39.402 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:52:39.402 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:52:39.402 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.402 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.402 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:39.402 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:52:39.402 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:52:39.402 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.402 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.403 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:39.403 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:52:39.403 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:52:39.403 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.403 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.403 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:39.403 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:52:39.403 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:52:39.403 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.403 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.403 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:39.403 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:52:39.403 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:52:39.403 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.404 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.404 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:39.404 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:52:39.404 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:52:39.404 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.404 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.404 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:39.404 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:52:39.404 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:52:39.404 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.404 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.404 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:39.404 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:52:39.404 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:52:39.404 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:39.405 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:39.405 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:39.405 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.405 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.405 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:110 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'72, mlcod=10'68)", 2024-04-25T22:52:39.405 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:39.405 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 51.430803838000003, 2024-04-25T22:52:39.405 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065316630000000001, 2024-04-25T22:52:39.405 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:39.405 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:39.405 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:39.405 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:39.405 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.405 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:39.406 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:39.406 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:39.406 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.406 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.406 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:39.406 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:39.406 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:39.406 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.406 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.406 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:39.406 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:39.406 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.58e-07 2024-04-25T22:52:39.406 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.407 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.407 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:39.407 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967811+0000", 2024-04-25T22:52:39.407 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.118e-06 2024-04-25T22:52:39.407 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.407 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.407 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:39.407 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967817+0000", 2024-04-25T22:52:39.407 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3709999999999996e-06 2024-04-25T22:52:39.407 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.407 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.407 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:39.407 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967820+0000", 2024-04-25T22:52:39.407 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2210000000000002e-06 2024-04-25T22:52:39.408 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.408 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.408 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:39.408 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967876+0000", 2024-04-25T22:52:39.408 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5507000000000002e-05 2024-04-25T22:52:39.408 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.408 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.408 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:39.408 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967893+0000", 2024-04-25T22:52:39.408 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7812000000000002e-05 2024-04-25T22:52:39.408 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.408 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.408 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:39.408 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974317+0000", 2024-04-25T22:52:39.409 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064237160000000003 2024-04-25T22:52:39.409 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.409 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.409 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:39.409 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:52:39.409 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.156e-05 2024-04-25T22:52:39.409 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:39.409 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:39.409 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:39.409 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.409 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.409 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'68)", 2024-04-25T22:52:39.409 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:39.409 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 51.430386325000001, 2024-04-25T22:52:39.410 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061292279999999996, 2024-04-25T22:52:39.410 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:39.410 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:39.410 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:39.410 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:39.410 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.410 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:39.410 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:39.410 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:39.410 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.410 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.410 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:39.410 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:39.411 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:39.411 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.411 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.411 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:39.411 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:39.411 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6300000000000001e-07 2024-04-25T22:52:39.411 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.411 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.411 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:39.411 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968228+0000", 2024-04-25T22:52:39.411 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6139999999999999e-06 2024-04-25T22:52:39.411 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.411 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.411 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:39.411 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968235+0000", 2024-04-25T22:52:39.412 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7020000000000001e-06 2024-04-25T22:52:39.412 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.412 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.412 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:39.412 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968238+0000", 2024-04-25T22:52:39.412 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0010000000000002e-06 2024-04-25T22:52:39.412 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.412 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.412 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:39.412 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968297+0000", 2024-04-25T22:52:39.412 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8424999999999997e-05 2024-04-25T22:52:39.412 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.412 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.412 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:39.413 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968316+0000", 2024-04-25T22:52:39.413 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8814999999999999e-05 2024-04-25T22:52:39.413 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.413 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.413 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:39.413 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:52:39.413 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060239439999999998 2024-04-25T22:52:39.413 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.413 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.413 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:39.413 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974354+0000", 2024-04-25T22:52:39.413 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4364e-05 2024-04-25T22:52:39.413 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:39.413 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:39.414 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:39.414 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.414 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.414 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'68)", 2024-04-25T22:52:39.414 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:39.414 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 51.429949323000002, 2024-04-25T22:52:39.414 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005948414, 2024-04-25T22:52:39.414 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:39.414 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:39.414 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:39.414 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:39.414 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.415 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:39.415 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:39.415 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:39.415 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.415 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.415 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:39.415 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:39.415 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:39.415 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.415 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.415 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:39.415 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:39.415 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6199999999999998e-07 2024-04-25T22:52:39.416 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.416 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.416 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:39.416 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968723+0000", 2024-04-25T22:52:39.416 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1148999999999993e-05 2024-04-25T22:52:39.416 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.416 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.416 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:39.416 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968730+0000", 2024-04-25T22:52:39.416 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1749999999999999e-06 2024-04-25T22:52:39.416 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.416 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.416 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:39.417 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968734+0000", 2024-04-25T22:52:39.417 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5200000000000002e-06 2024-04-25T22:52:39.417 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.417 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.417 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:39.417 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968771+0000", 2024-04-25T22:52:39.417 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6851999999999999e-05 2024-04-25T22:52:39.417 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.417 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.417 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:39.417 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968788+0000", 2024-04-25T22:52:39.417 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7027000000000001e-05 2024-04-25T22:52:39.417 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.418 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.418 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:39.418 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974589+0000", 2024-04-25T22:52:39.418 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058013320000000002 2024-04-25T22:52:39.418 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.418 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.418 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:39.418 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974610+0000", 2024-04-25T22:52:39.418 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0897e-05 2024-04-25T22:52:39.418 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:39.418 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:39.418 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:39.418 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.419 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.419 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'68)", 2024-04-25T22:52:39.419 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:39.419 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 51.429379312999998, 2024-04-25T22:52:39.419 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053935750000000003, 2024-04-25T22:52:39.419 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:39.419 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:39.419 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:39.419 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:39.419 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.419 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:39.419 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:39.419 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:39.419 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.420 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.420 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:39.420 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:39.420 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:39.420 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.420 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.420 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:39.420 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:39.420 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.03e-07 2024-04-25T22:52:39.420 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.420 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.420 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:39.421 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969235+0000", 2024-04-25T22:52:39.421 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2399999999999999e-06 2024-04-25T22:52:39.421 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.421 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.421 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:39.421 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969242+0000", 2024-04-25T22:52:39.421 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1269999999999997e-06 2024-04-25T22:52:39.421 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.421 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.421 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:39.421 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969246+0000", 2024-04-25T22:52:39.421 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3840000000000001e-06 2024-04-25T22:52:39.421 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.421 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.422 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:39.422 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969278+0000", 2024-04-25T22:52:39.422 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1868e-05 2024-04-25T22:52:39.422 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.422 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.422 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:39.422 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969295+0000", 2024-04-25T22:52:39.422 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7530999999999999e-05 2024-04-25T22:52:39.422 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.422 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.422 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:39.422 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974611+0000", 2024-04-25T22:52:39.422 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053160789999999996 2024-04-25T22:52:39.423 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.423 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.423 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:39.423 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974625+0000", 2024-04-25T22:52:39.423 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3943e-05 2024-04-25T22:52:39.423 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:39.423 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:39.423 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:39.423 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.423 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.423 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-25T22:52:39.423 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:39.423 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 51.235783404999999, 2024-04-25T22:52:39.423 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054952610000000004, 2024-04-25T22:52:39.424 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:39.424 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:39.424 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:39.424 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:39.424 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.424 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:39.424 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:39.424 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:39.424 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.424 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.424 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:39.424 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:39.424 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:39.424 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.425 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.425 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:39.425 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:39.425 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.68e-07 2024-04-25T22:52:39.425 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.425 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.425 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:39.425 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162898+0000", 2024-04-25T22:52:39.425 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9470999999999999e-05 2024-04-25T22:52:39.425 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.425 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.425 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:39.425 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162906+0000", 2024-04-25T22:52:39.425 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1580000000000005e-06 2024-04-25T22:52:39.426 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.426 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.426 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:39.426 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162911+0000", 2024-04-25T22:52:39.426 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4779999999999999e-06 2024-04-25T22:52:39.426 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.426 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.426 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:39.426 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162952+0000", 2024-04-25T22:52:39.426 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0629e-05 2024-04-25T22:52:39.426 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.426 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.426 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:39.427 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162968+0000", 2024-04-25T22:52:39.427 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6239000000000002e-05 2024-04-25T22:52:39.427 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.427 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.427 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:39.427 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168281+0000", 2024-04-25T22:52:39.427 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053132869999999999 2024-04-25T22:52:39.427 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.427 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.427 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:39.427 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168323+0000", 2024-04-25T22:52:39.427 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1430999999999997e-05 2024-04-25T22:52:39.427 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:39.427 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:39.428 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:39.428 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.428 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.428 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-04-25T22:52:39.428 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:39.428 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 50.805306043000002, 2024-04-25T22:52:39.428 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050872510000000001, 2024-04-25T22:52:39.428 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:39.428 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:39.428 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:39.428 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:39.428 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.428 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:39.429 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:39.429 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:39.429 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.429 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.429 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:39.429 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:39.429 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:39.429 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.429 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.429 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:39.429 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:39.429 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.72e-07 2024-04-25T22:52:39.429 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.430 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.430 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:39.430 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593381+0000", 2024-04-25T22:52:39.430 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5797000000000006e-05 2024-04-25T22:52:39.430 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.430 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.430 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:39.430 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593389+0000", 2024-04-25T22:52:39.430 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8480000000000001e-06 2024-04-25T22:52:39.430 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.430 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.430 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:39.430 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593393+0000", 2024-04-25T22:52:39.430 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4819999999999996e-06 2024-04-25T22:52:39.431 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.431 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.431 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:39.431 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593435+0000", 2024-04-25T22:52:39.431 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1600000000000002e-05 2024-04-25T22:52:39.431 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.431 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.431 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:39.431 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593454+0000", 2024-04-25T22:52:39.431 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8868e-05 2024-04-25T22:52:39.431 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.431 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.431 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:39.432 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598350+0000", 2024-04-25T22:52:39.432 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004895763 2024-04-25T22:52:39.432 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.432 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.432 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:39.432 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598392+0000", 2024-04-25T22:52:39.432 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2521000000000002e-05 2024-04-25T22:52:39.432 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:39.432 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:39.432 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:39.432 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.432 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.432 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:39.432 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:52:39.433 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 46.386942138999999, 2024-04-25T22:52:39.433 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:52:39.433 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:39.433 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:39.433 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:39.433 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:39.433 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.433 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:39.433 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:52:39.433 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:39.433 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.433 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.434 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:39.434 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:52:39.434 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:39.434 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.434 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.434 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:39.434 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:52:39.434 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:52:39.434 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.434 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.434 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:39.435 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:52:39.435 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:52:39.435 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.435 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.435 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:39.435 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:52:39.435 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:52:39.435 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.435 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.435 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:39.435 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:52:39.435 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:52:39.435 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.436 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.436 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:39.436 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:52:39.436 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:52:39.436 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.436 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.436 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:39.436 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:52:39.436 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:52:39.436 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.436 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.436 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:39.436 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:52:39.436 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:52:39.437 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.437 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.437 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:39.437 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:52:39.437 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:52:39.437 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.437 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.437 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:39.437 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:52:39.437 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:52:39.437 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.437 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.437 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:39.438 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:52:39.438 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:52:39.438 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.438 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.438 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:39.438 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:52:39.438 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:52:39.438 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:39.438 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:39.438 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:39.438 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.438 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.438 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:39.439 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:52:39.439 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 46.386267762999999, 2024-04-25T22:52:39.439 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:52:39.439 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:39.439 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:39.439 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:39.439 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:39.439 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.439 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:39.439 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:52:39.440 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:39.440 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.440 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.440 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:39.440 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:52:39.440 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:39.440 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.440 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.440 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:39.440 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:52:39.440 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:52:39.440 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.440 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.440 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:39.441 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:52:39.441 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:52:39.441 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.441 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.441 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:39.441 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:52:39.441 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:52:39.441 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.441 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.441 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:39.441 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:52:39.441 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:52:39.441 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.441 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.442 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:39.442 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:52:39.442 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:52:39.442 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.442 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.442 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:39.442 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:52:39.442 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:52:39.442 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.442 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.442 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:39.442 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:52:39.442 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:52:39.443 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.443 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.443 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:39.443 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:52:39.443 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:52:39.443 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.443 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.443 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:39.443 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:52:39.443 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:52:39.443 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.443 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.443 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:39.444 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:52:39.444 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:52:39.444 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.444 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.444 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:39.444 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:52:39.444 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:52:39.444 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:39.444 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:39.444 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:39.444 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.444 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.444 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:39.445 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:52:39.445 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 46.385758551000002, 2024-04-25T22:52:39.445 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:52:39.445 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:39.445 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:39.445 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:39.445 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:39.445 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.445 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:39.445 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:52:39.445 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:39.445 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.445 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.445 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:39.446 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:52:39.446 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:39.446 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.446 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.446 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:39.446 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:52:39.446 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:52:39.446 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.446 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.446 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:39.446 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:52:39.446 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:52:39.447 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.447 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.447 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:39.447 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:52:39.447 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:52:39.447 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.447 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.447 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:39.447 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:52:39.447 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:52:39.447 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.447 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.447 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:39.447 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:52:39.448 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:52:39.448 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.448 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.448 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:39.448 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:52:39.449 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:52:39.449 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.449 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.449 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:39.449 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:52:39.449 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:52:39.449 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.450 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.450 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:39.450 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:52:39.450 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:52:39.450 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.450 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.450 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:39.450 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:52:39.450 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:52:39.450 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.451 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.451 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:39.451 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:52:39.451 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:52:39.451 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.451 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.451 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:39.451 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:52:39.451 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:52:39.451 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:39.451 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:39.451 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:39.451 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.451 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.452 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:39.452 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:39.452 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 46.385345352999998, 2024-04-25T22:52:39.452 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:52:39.452 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:39.452 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:39.452 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:39.452 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:39.452 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.452 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:39.452 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:39.452 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:39.452 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.453 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.453 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:39.453 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:39.453 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:39.453 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.453 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.453 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:39.453 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:39.453 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:52:39.453 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.453 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.453 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:39.453 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:52:39.453 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:52:39.453 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.454 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.454 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:39.454 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:52:39.454 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:52:39.454 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.454 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.454 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:39.454 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:52:39.454 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:52:39.454 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.454 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.454 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:39.454 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:52:39.455 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:52:39.455 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.455 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.455 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:39.455 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:52:39.455 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:52:39.455 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.455 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.455 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:39.455 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:52:39.455 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:52:39.455 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.455 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.456 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:39.456 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:52:39.456 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:52:39.456 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.456 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.456 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:39.456 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:52:39.456 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:52:39.456 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.456 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.456 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:39.456 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:52:39.456 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:52:39.456 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.456 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.457 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:39.457 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:52:39.457 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:52:39.457 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:39.457 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:39.457 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:39.457 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.457 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.457 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:39.457 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:52:39.457 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 46.385294682999998, 2024-04-25T22:52:39.457 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:52:39.457 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:39.458 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:39.458 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:39.458 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:39.458 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.458 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:39.458 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:52:39.458 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:39.458 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.458 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.458 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:39.458 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:52:39.458 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:39.458 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.458 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.459 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:39.459 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:52:39.459 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:52:39.459 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.459 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.459 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:39.459 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:52:39.459 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:52:39.459 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.459 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.459 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:39.459 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:52:39.459 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:52:39.460 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.460 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.460 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:39.460 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:52:39.460 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:52:39.460 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.460 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.460 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:39.460 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:52:39.460 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:52:39.460 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.460 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.460 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:52:39.461 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:52:39.461 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:52:39.461 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.461 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.461 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:39.461 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:52:39.461 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:52:39.461 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.461 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.461 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:39.461 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:52:39.461 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:52:39.461 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.461 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.461 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:39.462 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:52:39.462 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:52:39.462 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.462 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.462 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:39.462 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:52:39.462 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:52:39.462 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.462 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.462 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:39.462 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:52:39.462 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:52:39.462 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.463 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.463 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:39.463 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:52:39.463 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:52:39.463 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.463 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.463 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:39.463 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:52:39.463 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:52:39.463 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:39.463 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:39.463 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:39.463 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.463 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.464 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:39.464 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:52:39.464 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 46.385257813999999, 2024-04-25T22:52:39.464 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:52:39.464 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:39.464 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:39.464 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:39.464 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:39.464 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.464 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:39.464 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:52:39.464 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:39.465 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.465 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.465 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:39.465 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:52:39.465 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:39.465 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.465 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.465 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:39.465 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:52:39.465 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:52:39.465 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.465 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.465 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:39.465 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:52:39.465 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:52:39.466 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.466 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.466 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:39.466 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:52:39.466 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:52:39.466 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.466 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.466 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:39.466 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:52:39.466 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:52:39.466 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.466 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.466 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:39.466 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:52:39.467 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:52:39.467 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.467 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.467 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:52:39.467 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:52:39.467 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:52:39.467 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.467 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.467 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:39.467 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:52:39.467 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:52:39.467 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.467 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.467 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:39.468 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:52:39.468 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:52:39.468 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.468 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.468 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:39.468 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:52:39.468 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:52:39.468 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.468 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.468 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:39.468 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:52:39.468 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:52:39.468 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.468 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.469 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:39.469 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:52:39.469 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:52:39.469 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.469 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.469 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:39.469 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:52:39.469 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:52:39.469 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.469 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.469 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:39.469 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:52:39.469 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:52:39.469 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:39.470 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:39.470 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:39.470 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.470 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.470 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:39.470 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:52:39.470 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 46.385232848000001, 2024-04-25T22:52:39.470 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:52:39.470 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:39.470 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:39.470 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:39.470 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:39.470 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.471 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:39.471 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:52:39.471 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:39.471 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.471 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.471 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:39.471 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:52:39.471 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:39.471 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.471 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.471 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:39.471 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:52:39.471 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:52:39.472 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.472 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.472 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:39.472 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:52:39.472 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:52:39.472 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.472 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.472 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:39.472 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:52:39.472 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:52:39.472 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.472 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.472 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:39.472 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:52:39.473 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:52:39.473 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.473 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.473 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:39.473 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:52:39.473 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:52:39.473 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.473 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.473 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:39.473 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:52:39.473 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:52:39.473 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.473 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.473 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:39.474 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:52:39.474 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:52:39.474 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.474 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.474 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:39.474 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:52:39.474 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:52:39.474 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.474 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.474 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:39.474 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:52:39.474 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:52:39.474 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.474 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.475 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:39.475 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:52:39.475 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:52:39.475 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.475 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.475 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:39.475 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:52:39.475 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:52:39.475 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:39.475 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:39.475 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:39.475 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.475 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.476 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:39.476 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:52:39.476 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 46.385196483999998, 2024-04-25T22:52:39.476 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:52:39.476 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:39.476 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:39.476 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:52:39.476 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:39.476 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.476 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:39.476 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:52:39.476 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:39.476 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.476 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.477 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:39.477 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:52:39.477 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:39.477 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.477 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.477 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:39.477 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:52:39.477 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:52:39.477 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.477 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.477 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:39.477 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:52:39.477 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:52:39.478 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.478 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.478 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:39.478 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:52:39.478 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:52:39.478 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.478 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.478 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:39.478 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:52:39.478 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:52:39.478 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.478 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.478 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:39.478 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:52:39.479 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:52:39.479 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.479 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.479 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:52:39.479 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:52:39.479 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:52:39.479 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.479 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.479 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:39.479 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:52:39.479 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:52:39.479 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.479 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.479 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:39.480 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:52:39.480 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:52:39.480 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.480 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.480 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:39.480 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:52:39.480 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:52:39.480 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:39.480 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:39.480 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:39.480 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.480 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.480 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:39.480 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:39.480 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 46.385165403000002, 2024-04-25T22:52:39.481 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:52:39.481 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:39.481 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:39.481 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:52:39.481 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:39.481 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.481 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:39.481 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:39.481 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:39.481 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.481 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.481 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:39.481 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:39.481 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:39.482 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.482 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.482 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:39.482 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:39.482 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:52:39.482 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.482 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.482 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:39.482 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:52:39.482 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:52:39.482 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.482 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.482 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:39.483 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:52:39.483 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:52:39.483 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.483 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.483 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:39.483 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:52:39.483 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:52:39.483 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.483 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.483 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:39.483 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:52:39.483 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:52:39.483 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.484 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.484 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:39.484 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:52:39.484 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:52:39.484 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.484 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.484 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:39.484 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:52:39.484 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:52:39.484 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:39.484 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:39.484 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:39.484 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.484 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.485 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:52:39.485 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:39.485 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 46.384724433999999, 2024-04-25T22:52:39.485 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064881979999999997, 2024-04-25T22:52:39.485 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:39.485 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:39.485 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:39.485 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:39.485 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.485 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:39.485 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:39.485 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:39.485 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.485 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.486 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:39.486 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:39.486 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:39.486 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.486 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.486 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:39.486 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:39.486 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2699999999999999e-07 2024-04-25T22:52:39.486 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.486 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.486 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:39.486 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013898+0000", 2024-04-25T22:52:39.486 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0796e-05 2024-04-25T22:52:39.487 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.487 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.487 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:39.487 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013907+0000", 2024-04-25T22:52:39.487 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5140000000000007e-06 2024-04-25T22:52:39.487 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.487 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.487 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:39.487 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013952+0000", 2024-04-25T22:52:39.487 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4134000000000001e-05 2024-04-25T22:52:39.487 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.487 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.487 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:39.487 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016812+0000", 2024-04-25T22:52:39.488 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028601059999999998 2024-04-25T22:52:39.488 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.488 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.488 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:39.488 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.017052+0000", 2024-04-25T22:52:39.488 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024056500000000001 2024-04-25T22:52:39.488 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.488 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.488 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:39.488 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020350+0000", 2024-04-25T22:52:39.488 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032978320000000001 2024-04-25T22:52:39.488 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.488 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.489 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:39.489 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020375+0000", 2024-04-25T22:52:39.489 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4624e-05 2024-04-25T22:52:39.489 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:39.489 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:39.489 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:39.489 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.489 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.489 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-25T22:52:39.489 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:39.489 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 46.371193988000002, 2024-04-25T22:52:39.489 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058583000000000003, 2024-04-25T22:52:39.489 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:39.489 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:39.490 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:39.490 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:39.490 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.490 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:39.490 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:39.490 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:39.490 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.490 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.490 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:39.490 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:39.490 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:39.490 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.490 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.491 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:39.491 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:39.491 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.41e-07 2024-04-25T22:52:39.491 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.491 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.491 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:39.491 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027428+0000", 2024-04-25T22:52:39.491 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.075e-05 2024-04-25T22:52:39.491 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.491 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.491 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:39.491 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027435+0000", 2024-04-25T22:52:39.491 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3610000000000003e-06 2024-04-25T22:52:39.491 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.492 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.492 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:39.492 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027442+0000", 2024-04-25T22:52:39.492 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0400000000000004e-06 2024-04-25T22:52:39.492 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.492 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.492 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:39.492 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028094+0000", 2024-04-25T22:52:39.492 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00065134800000000005 2024-04-25T22:52:39.492 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.492 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.492 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:39.492 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028107+0000", 2024-04-25T22:52:39.492 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3087e-05 2024-04-25T22:52:39.492 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.493 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.493 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:39.493 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033239+0000", 2024-04-25T22:52:39.493 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051319429999999999 2024-04-25T22:52:39.493 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.493 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.493 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:39.493 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033275+0000", 2024-04-25T22:52:39.493 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6430000000000002e-05 2024-04-25T22:52:39.493 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:39.493 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:39.493 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:39.493 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.493 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.494 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-25T22:52:39.494 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:39.494 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 46.370809151000003, 2024-04-25T22:52:39.494 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005413597, 2024-04-25T22:52:39.494 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:39.494 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:39.494 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:39.494 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:39.494 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.494 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:39.494 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:39.494 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:39.494 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.495 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.495 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:39.495 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:39.495 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:39.495 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.495 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.495 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:39.495 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:39.495 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3799999999999997e-07 2024-04-25T22:52:39.495 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.495 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.495 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:39.495 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027816+0000", 2024-04-25T22:52:39.495 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3230999999999999e-05 2024-04-25T22:52:39.496 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.496 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.496 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:39.496 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027823+0000", 2024-04-25T22:52:39.496 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9039999999999992e-06 2024-04-25T22:52:39.496 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.496 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.496 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:39.496 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027841+0000", 2024-04-25T22:52:39.496 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7651000000000001e-05 2024-04-25T22:52:39.496 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.496 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.496 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:39.496 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027904+0000", 2024-04-25T22:52:39.497 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3058000000000005e-05 2024-04-25T22:52:39.497 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.497 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.497 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:39.497 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027926+0000", 2024-04-25T22:52:39.497 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1450999999999998e-05 2024-04-25T22:52:39.497 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.497 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.497 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:39.497 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033177+0000", 2024-04-25T22:52:39.497 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052508909999999997 2024-04-25T22:52:39.497 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.497 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.497 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:39.498 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033215+0000", 2024-04-25T22:52:39.498 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8872999999999999e-05 2024-04-25T22:52:39.498 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:39.498 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:39.498 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:39.498 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.498 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.498 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 171 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:52:39.498 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:39.498 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 46.370752048999996, 2024-04-25T22:52:39.498 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054322240000000003, 2024-04-25T22:52:39.498 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:39.498 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:39.498 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "reached pg", 2024-04-25T22:52:39.499 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:39.499 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.499 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:39.499 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:39.499 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:39.499 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.499 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.499 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:39.499 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:39.499 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:39.499 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.499 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.499 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:39.500 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:39.500 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7500000000000001e-07 2024-04-25T22:52:39.500 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.500 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.500 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:39.500 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027868+0000", 2024-04-25T22:52:39.500 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5750000000000001e-06 2024-04-25T22:52:39.500 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.500 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.500 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:39.500 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027885+0000", 2024-04-25T22:52:39.500 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7272e-05 2024-04-25T22:52:39.500 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.500 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.501 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:39.501 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027900+0000", 2024-04-25T22:52:39.501 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.502e-05 2024-04-25T22:52:39.501 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.501 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.501 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:39.501 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028381+0000", 2024-04-25T22:52:39.501 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00048039399999999998 2024-04-25T22:52:39.501 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:39.501 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:39.501 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:39.501 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033291+0000", 2024-04-25T22:52:39.501 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049105879999999996 2024-04-25T22:52:39.501 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:39.502 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:39.502 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:39.502 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:39.502 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:39.502 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:39.503 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:52:39.504 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:39.501+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:39.604 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:39.602+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:39.612 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:39.612 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:52:39.612 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-04-25T22:52:39.612 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:39.621 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:52:39.706 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:39.704+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:39.764 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:39.764 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:52:39.764 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:52:39.764 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:52:39.764 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:39.773 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:52:39.814 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:39.812+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:39.907 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:39.906+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:39.917 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:39.917 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-04-25T22:52:39.917 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-04-25T22:52:39.917 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:52:39.917 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.917 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:39.918 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:39.918 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.950596206, 2024-04-25T22:52:39.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0103421, 2024-04-25T22:52:39.918 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:39.918 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:39.918 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:39.918 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:39.918 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:39.918 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:39.918 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 115 2024-04-25T22:52:39.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.918 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:39.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.919 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:39.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:39.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:39.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.919 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:39.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:39.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:39.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.919 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:39.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:39.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9500000000000002e-07 2024-04-25T22:52:39.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:39.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965108+0000", 2024-04-25T22:52:39.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9177999999999994e-05 2024-04-25T22:52:39.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:39.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965127+0000", 2024-04-25T22:52:39.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8868e-05 2024-04-25T22:52:39.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:39.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965133+0000", 2024-04-25T22:52:39.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8929999999999999e-06 2024-04-25T22:52:39.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.921 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:39.921 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.969991+0000", 2024-04-25T22:52:39.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048573849999999997 2024-04-25T22:52:39.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.921 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:39.921 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970072+0000", 2024-04-25T22:52:39.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0728000000000004e-05 2024-04-25T22:52:39.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.921 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:39.922 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970189+0000", 2024-04-25T22:52:39.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000117778 2024-04-25T22:52:39.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.922 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:39.922 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970946+0000", 2024-04-25T22:52:39.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00075704600000000004 2024-04-25T22:52:39.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.922 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:39.922 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975297+0000", 2024-04-25T22:52:39.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004350217 2024-04-25T22:52:39.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.923 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:39.923 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975343+0000", 2024-04-25T22:52:39.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6687999999999998e-05 2024-04-25T22:52:39.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.923 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.923 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:39.923 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975380+0000", 2024-04-25T22:52:39.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6724000000000003e-05 2024-04-25T22:52:39.923 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:39.923 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:39.923 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:39.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.923 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.923 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:39.923 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:39.924 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.950490174999999, 2024-04-25T22:52:39.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010304384, 2024-04-25T22:52:39.924 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:39.924 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:39.924 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:39.924 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:39.924 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:39.924 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:39.924 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 116 2024-04-25T22:52:39.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.924 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:39.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:39.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:39.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:39.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.925 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:39.925 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:39.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:39.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.925 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:39.925 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:39.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5799999999999999e-07 2024-04-25T22:52:39.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.925 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:39.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965154+0000", 2024-04-25T22:52:39.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0009e-05 2024-04-25T22:52:39.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:39.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965164+0000", 2024-04-25T22:52:39.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8490000000000001e-06 2024-04-25T22:52:39.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:39.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965169+0000", 2024-04-25T22:52:39.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0730000000000004e-06 2024-04-25T22:52:39.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.927 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:39.927 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970609+0000", 2024-04-25T22:52:39.927 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054397689999999997 2024-04-25T22:52:39.927 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.927 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.927 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:39.927 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970651+0000", 2024-04-25T22:52:39.927 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1873999999999999e-05 2024-04-25T22:52:39.927 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.927 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.927 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:39.927 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970723+0000", 2024-04-25T22:52:39.927 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2039999999999995e-05 2024-04-25T22:52:39.927 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.927 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.928 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:39.928 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971358+0000", 2024-04-25T22:52:39.928 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063489500000000001 2024-04-25T22:52:39.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.928 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.928 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:39.928 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975409+0000", 2024-04-25T22:52:39.928 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040506880000000002 2024-04-25T22:52:39.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.928 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.928 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:39.928 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975432+0000", 2024-04-25T22:52:39.928 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3315999999999998e-05 2024-04-25T22:52:39.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.929 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:39.929 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975448+0000", 2024-04-25T22:52:39.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6313000000000001e-05 2024-04-25T22:52:39.929 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:39.929 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:39.929 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:39.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.929 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:39.929 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:39.929 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.950455593000001, 2024-04-25T22:52:39.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010384338999999999, 2024-04-25T22:52:39.930 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:39.930 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:39.930 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:39.930 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:39.930 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:39.930 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:39.930 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-04-25T22:52:39.930 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.930 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:39.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.930 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:39.930 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:39.930 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:39.930 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.931 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:39.931 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:39.931 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:39.931 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.931 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.931 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:39.931 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:39.931 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3600000000000004e-07 2024-04-25T22:52:39.931 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.931 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.931 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:39.931 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965185+0000", 2024-04-25T22:52:39.931 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.117e-06 2024-04-25T22:52:39.932 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.932 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.932 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:39.932 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965192+0000", 2024-04-25T22:52:39.932 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3239999999999997e-06 2024-04-25T22:52:39.932 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.932 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.932 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:39.932 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965198+0000", 2024-04-25T22:52:39.932 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6370000000000004e-06 2024-04-25T22:52:39.932 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.932 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.932 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:39.932 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970973+0000", 2024-04-25T22:52:39.932 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057748239999999996 2024-04-25T22:52:39.933 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.933 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.933 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:39.933 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971049+0000", 2024-04-25T22:52:39.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6029e-05 2024-04-25T22:52:39.933 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.933 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.933 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:39.933 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971174+0000", 2024-04-25T22:52:39.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012462399999999999 2024-04-25T22:52:39.933 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.933 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.933 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:39.934 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971553+0000", 2024-04-25T22:52:39.934 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037896499999999999 2024-04-25T22:52:39.934 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.934 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.934 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:39.934 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975482+0000", 2024-04-25T22:52:39.934 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039297459999999996 2024-04-25T22:52:39.934 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.934 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.934 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:39.934 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975529+0000", 2024-04-25T22:52:39.934 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6387000000000002e-05 2024-04-25T22:52:39.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.935 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.935 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:39.935 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975563+0000", 2024-04-25T22:52:39.935 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4150000000000003e-05 2024-04-25T22:52:39.935 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:39.935 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:39.935 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:39.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.935 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.935 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:39.935 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:39.935 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.903409269999997, 2024-04-25T22:52:39.935 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012637705000000001, 2024-04-25T22:52:39.936 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:39.936 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:39.936 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:39.936 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:39.936 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.936 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:39.936 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:39.936 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:39.936 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.936 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.936 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:39.936 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:39.936 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:39.936 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.937 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.937 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:39.937 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012227+0000", 2024-04-25T22:52:39.937 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.863e-06 2024-04-25T22:52:39.937 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.937 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.937 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:39.937 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012236+0000", 2024-04-25T22:52:39.937 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1109999999999997e-06 2024-04-25T22:52:39.937 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.937 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.937 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:39.937 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012309+0000", 2024-04-25T22:52:39.937 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3242000000000001e-05 2024-04-25T22:52:39.937 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.937 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.938 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:39.938 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012324+0000", 2024-04-25T22:52:39.938 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4837e-05 2024-04-25T22:52:39.938 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.938 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.938 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:39.938 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015060+0000", 2024-04-25T22:52:39.938 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027363349999999999 2024-04-25T22:52:39.938 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.938 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.938 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:39.938 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015169+0000", 2024-04-25T22:52:39.938 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108372 2024-04-25T22:52:39.938 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.938 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.939 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:39.939 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015498+0000", 2024-04-25T22:52:39.939 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032949999999999999 2024-04-25T22:52:39.939 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.939 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.939 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:39.939 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021282+0000", 2024-04-25T22:52:39.939 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057836429999999998 2024-04-25T22:52:39.939 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.939 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.939 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:39.939 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024709+0000", 2024-04-25T22:52:39.939 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034271979999999998 2024-04-25T22:52:39.939 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.939 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.940 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:39.940 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024802+0000", 2024-04-25T22:52:39.940 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2960000000000004e-05 2024-04-25T22:52:39.940 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.940 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.940 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:39.940 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024863+0000", 2024-04-25T22:52:39.940 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0643999999999997e-05 2024-04-25T22:52:39.940 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:39.940 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:39.940 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:39.940 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.940 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.940 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:39.940 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:39.941 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.903285498999999, 2024-04-25T22:52:39.941 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012979447999999999, 2024-04-25T22:52:39.941 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:39.941 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:39.941 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:39.941 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:39.941 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.941 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:39.941 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:39.941 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:39.941 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.941 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.941 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:39.941 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:39.941 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:39.942 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.942 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.942 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:39.942 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:39.942 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:52:39.942 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.942 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.942 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:39.942 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012354+0000", 2024-04-25T22:52:39.942 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7740000000000004e-06 2024-04-25T22:52:39.942 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.942 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.942 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:39.942 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012365+0000", 2024-04-25T22:52:39.943 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.064e-05 2024-04-25T22:52:39.943 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.943 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.943 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:39.943 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012382+0000", 2024-04-25T22:52:39.943 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6999000000000001e-05 2024-04-25T22:52:39.943 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.943 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.943 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:39.943 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015958+0000", 2024-04-25T22:52:39.943 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035765699999999998 2024-04-25T22:52:39.943 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.943 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.943 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:39.944 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016037+0000", 2024-04-25T22:52:39.944 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8242000000000001e-05 2024-04-25T22:52:39.944 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.944 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.944 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:39.944 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016404+0000", 2024-04-25T22:52:39.944 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036784300000000002 2024-04-25T22:52:39.944 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.944 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.944 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:39.944 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021294+0000", 2024-04-25T22:52:39.944 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048890629999999999 2024-04-25T22:52:39.944 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.944 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.945 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:39.945 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024959+0000", 2024-04-25T22:52:39.945 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036651570000000001 2024-04-25T22:52:39.945 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.945 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.945 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:39.945 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025097+0000", 2024-04-25T22:52:39.945 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013788099999999999 2024-04-25T22:52:39.945 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.945 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.945 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:39.945 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025328+0000", 2024-04-25T22:52:39.945 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231492 2024-04-25T22:52:39.945 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:39.945 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:39.946 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:39.946 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.946 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.946 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:39.946 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:39.946 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.903197730000002, 2024-04-25T22:52:39.946 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013049827, 2024-04-25T22:52:39.946 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:39.946 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:39.946 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:39.946 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:39.946 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.946 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:39.946 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:39.946 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:39.947 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.947 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.947 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:39.947 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:39.947 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:39.947 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.947 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.947 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:39.947 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012437+0000", 2024-04-25T22:52:39.947 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-04-25T22:52:39.947 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.947 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.947 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:39.947 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012440+0000", 2024-04-25T22:52:39.948 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7609999999999999e-06 2024-04-25T22:52:39.948 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.948 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.948 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:39.948 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012449+0000", 2024-04-25T22:52:39.948 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.285e-06 2024-04-25T22:52:39.948 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.948 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.948 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:39.948 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012457+0000", 2024-04-25T22:52:39.948 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9510000000000006e-06 2024-04-25T22:52:39.948 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.948 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.948 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:39.948 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017106+0000", 2024-04-25T22:52:39.949 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046494220000000003 2024-04-25T22:52:39.949 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.949 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.949 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:39.949 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017223+0000", 2024-04-25T22:52:39.949 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116824 2024-04-25T22:52:39.949 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.949 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.949 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:39.949 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017345+0000", 2024-04-25T22:52:39.949 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122175 2024-04-25T22:52:39.949 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.949 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.949 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:39.950 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021299+0000", 2024-04-25T22:52:39.950 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039534879999999998 2024-04-25T22:52:39.950 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.950 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.950 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:39.950 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025398+0000", 2024-04-25T22:52:39.950 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040988960000000003 2024-04-25T22:52:39.950 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.950 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.950 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:39.950 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025439+0000", 2024-04-25T22:52:39.950 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0915999999999999e-05 2024-04-25T22:52:39.950 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.951 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.951 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:39.951 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025486+0000", 2024-04-25T22:52:39.951 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7534999999999998e-05 2024-04-25T22:52:39.951 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:39.951 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:39.951 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:39.951 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.951 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.951 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:39.951 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:39.951 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.903167578999998, 2024-04-25T22:52:39.951 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020988041999999998, 2024-04-25T22:52:39.951 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:39.952 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:39.952 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:39.952 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:39.952 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.952 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:39.952 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:39.952 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:39.952 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.952 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.952 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:39.952 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:39.952 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:39.952 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.952 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.952 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:39.953 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:39.953 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.99e-07 2024-04-25T22:52:39.953 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.953 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.953 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:39.953 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012470+0000", 2024-04-25T22:52:39.953 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2789999999999999e-06 2024-04-25T22:52:39.953 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.953 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.953 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:39.953 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012477+0000", 2024-04-25T22:52:39.953 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:52:39.953 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.954 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.954 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:39.954 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012500+0000", 2024-04-25T22:52:39.954 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2490999999999999e-05 2024-04-25T22:52:39.954 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.954 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.954 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:39.954 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021911+0000", 2024-04-25T22:52:39.954 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094114160000000006 2024-04-25T22:52:39.954 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.954 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.954 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:39.955 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022000+0000", 2024-04-25T22:52:39.955 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8601000000000001e-05 2024-04-25T22:52:39.955 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.955 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.955 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:39.955 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022359+0000", 2024-04-25T22:52:39.955 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035921999999999999 2024-04-25T22:52:39.955 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.955 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.955 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:39.955 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025541+0000", 2024-04-25T22:52:39.955 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031820619999999998 2024-04-25T22:52:39.955 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.955 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.956 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:39.956 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033375+0000", 2024-04-25T22:52:39.956 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078338379999999992 2024-04-25T22:52:39.956 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.956 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.956 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:39.956 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033415+0000", 2024-04-25T22:52:39.956 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9527000000000003e-05 2024-04-25T22:52:39.956 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.956 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.956 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:39.956 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033455+0000", 2024-04-25T22:52:39.956 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9932000000000003e-05 2024-04-25T22:52:39.956 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:39.957 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:39.957 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:39.957 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.957 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.957 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:39.957 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:39.957 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.903112385999997, 2024-04-25T22:52:39.957 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021043857999999999, 2024-04-25T22:52:39.957 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:39.957 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:39.957 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:39.957 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:39.957 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.957 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:39.958 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:39.958 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:39.958 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.958 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.958 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:39.958 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:39.958 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:39.958 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.958 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.958 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:39.958 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012523+0000", 2024-04-25T22:52:39.958 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.361e-06 2024-04-25T22:52:39.958 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.958 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.959 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:39.959 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012530+0000", 2024-04-25T22:52:39.959 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5440000000000004e-06 2024-04-25T22:52:39.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.959 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.959 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:39.959 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012541+0000", 2024-04-25T22:52:39.959 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1745e-05 2024-04-25T22:52:39.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.959 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.959 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:39.959 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012551+0000", 2024-04-25T22:52:39.959 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5789999999999993e-06 2024-04-25T22:52:39.960 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.960 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.960 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:39.960 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022709+0000", 2024-04-25T22:52:39.960 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010157685 2024-04-25T22:52:39.960 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.960 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.960 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:39.960 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022957+0000", 2024-04-25T22:52:39.960 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024824599999999998 2024-04-25T22:52:39.960 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.960 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.960 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:39.960 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023443+0000", 2024-04-25T22:52:39.961 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048578599999999999 2024-04-25T22:52:39.961 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.961 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.961 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:39.961 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025547+0000", 2024-04-25T22:52:39.961 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021044789999999998 2024-04-25T22:52:39.961 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.961 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.961 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:39.961 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033509+0000", 2024-04-25T22:52:39.961 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0079622180000000001 2024-04-25T22:52:39.961 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.961 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.961 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:39.962 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033542+0000", 2024-04-25T22:52:39.962 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3018000000000001e-05 2024-04-25T22:52:39.962 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.962 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.962 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:39.962 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033566+0000", 2024-04-25T22:52:39.962 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3197000000000002e-05 2024-04-25T22:52:39.962 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:39.962 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:39.962 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:39.962 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.962 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.962 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:39.962 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:39.963 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.903072420999997, 2024-04-25T22:52:39.963 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021122696, 2024-04-25T22:52:39.963 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:39.963 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:39.963 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:39.963 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:39.963 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.963 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:39.963 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:39.963 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:39.963 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.963 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.963 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:39.964 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:39.964 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:39.964 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.964 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.964 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:39.964 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:39.964 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:52:39.964 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.964 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.964 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:39.964 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012566+0000", 2024-04-25T22:52:39.964 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-04-25T22:52:39.964 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.964 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.965 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:39.965 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012619+0000", 2024-04-25T22:52:39.965 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2607e-05 2024-04-25T22:52:39.965 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.965 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.965 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:39.965 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012628+0000", 2024-04-25T22:52:39.965 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6500000000000008e-06 2024-04-25T22:52:39.965 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.965 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.965 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:39.965 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024024+0000", 2024-04-25T22:52:39.965 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011396007999999999 2024-04-25T22:52:39.965 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.965 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.966 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:39.966 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024198+0000", 2024-04-25T22:52:39.966 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000173215 2024-04-25T22:52:39.966 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.966 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.966 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:39.966 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024447+0000", 2024-04-25T22:52:39.966 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024898500000000002 2024-04-25T22:52:39.966 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.966 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.966 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:39.966 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026431+0000", 2024-04-25T22:52:39.966 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001984923 2024-04-25T22:52:39.966 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.967 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.967 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:39.967 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033608+0000", 2024-04-25T22:52:39.967 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071768459999999997 2024-04-25T22:52:39.967 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.967 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.967 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:39.967 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033646+0000", 2024-04-25T22:52:39.967 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299000000000003e-05 2024-04-25T22:52:39.967 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.967 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.967 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:39.967 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033684+0000", 2024-04-25T22:52:39.967 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8773000000000003e-05 2024-04-25T22:52:39.968 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:39.968 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:39.968 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:39.968 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.968 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.968 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:39.968 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:39.968 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.902983822000003, 2024-04-25T22:52:39.968 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021175381, 2024-04-25T22:52:39.968 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:39.968 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:39.968 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:39.968 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:39.969 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.969 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:39.969 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:39.969 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:39.969 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.969 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.969 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:39.969 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:39.969 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:39.969 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.969 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.969 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:39.969 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012651+0000", 2024-04-25T22:52:39.970 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:52:39.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.970 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.970 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:39.970 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012656+0000", 2024-04-25T22:52:39.970 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8899999999999998e-06 2024-04-25T22:52:39.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.970 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.970 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:39.970 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012666+0000", 2024-04-25T22:52:39.970 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0346999999999999e-05 2024-04-25T22:52:39.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.970 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.970 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:39.971 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012675+0000", 2024-04-25T22:52:39.971 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9930000000000001e-06 2024-04-25T22:52:39.971 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.971 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.971 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:39.971 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025661+0000", 2024-04-25T22:52:39.971 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01298531 2024-04-25T22:52:39.971 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.971 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.971 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:39.971 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025757+0000", 2024-04-25T22:52:39.971 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5822000000000005e-05 2024-04-25T22:52:39.971 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.971 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.972 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:39.972 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025907+0000", 2024-04-25T22:52:39.972 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015051499999999999 2024-04-25T22:52:39.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.972 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.972 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:39.972 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026435+0000", 2024-04-25T22:52:39.972 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052762200000000005 2024-04-25T22:52:39.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.972 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.972 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:39.972 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033732+0000", 2024-04-25T22:52:39.972 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072978419999999997 2024-04-25T22:52:39.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.973 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.973 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:39.973 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033787+0000", 2024-04-25T22:52:39.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4703999999999997e-05 2024-04-25T22:52:39.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.973 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.973 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:39.973 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033826+0000", 2024-04-25T22:52:39.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8458999999999999e-05 2024-04-25T22:52:39.973 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:39.973 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:39.973 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:39.974 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.974 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:39.974 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:39.974 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.902928408000001, 2024-04-25T22:52:39.974 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021244174000000001, 2024-04-25T22:52:39.974 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:39.974 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:39.974 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:39.974 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:39.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.974 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:39.974 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:39.975 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:39.975 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.975 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.975 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:39.975 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:39.975 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:39.975 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.975 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.975 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:39.975 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:39.975 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:52:39.975 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.975 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.976 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:39.976 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012712+0000", 2024-04-25T22:52:39.976 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.913e-06 2024-04-25T22:52:39.976 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.976 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.976 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:39.976 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012722+0000", 2024-04-25T22:52:39.976 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2879999999999998e-06 2024-04-25T22:52:39.976 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.976 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.976 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:39.976 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012727+0000", 2024-04-25T22:52:39.976 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8429999999999998e-06 2024-04-25T22:52:39.976 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.976 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.977 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:39.977 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026099+0000", 2024-04-25T22:52:39.977 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013371450999999999 2024-04-25T22:52:39.977 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.977 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.977 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:39.977 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026147+0000", 2024-04-25T22:52:39.977 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7837999999999998e-05 2024-04-25T22:52:39.977 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.977 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.977 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:39.977 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026254+0000", 2024-04-25T22:52:39.977 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107314 2024-04-25T22:52:39.977 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.978 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:39.978 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026686+0000", 2024-04-25T22:52:39.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000432428 2024-04-25T22:52:39.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.978 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:39.978 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033873+0000", 2024-04-25T22:52:39.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071864399999999997 2024-04-25T22:52:39.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.978 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:39.978 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033904+0000", 2024-04-25T22:52:39.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1321e-05 2024-04-25T22:52:39.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.979 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:39.979 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033950+0000", 2024-04-25T22:52:39.979 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5707999999999997e-05 2024-04-25T22:52:39.979 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:39.979 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:39.979 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:39.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.979 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:39.979 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:39.979 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.902898022999999, 2024-04-25T22:52:39.979 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01096505, 2024-04-25T22:52:39.980 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:39.980 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:39.980 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:39.980 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:39.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.980 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:39.980 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:39.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:39.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.980 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:39.980 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:39.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:39.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.981 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:39.981 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012737+0000", 2024-04-25T22:52:39.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:52:39.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.981 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:39.981 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012739+0000", 2024-04-25T22:52:39.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-04-25T22:52:39.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.981 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:39.981 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012743+0000", 2024-04-25T22:52:39.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3239999999999996e-06 2024-04-25T22:52:39.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.982 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:39.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012746+0000", 2024-04-25T22:52:39.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.129e-06 2024-04-25T22:52:39.982 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.982 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:39.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012796+0000", 2024-04-25T22:52:39.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9231999999999999e-05 2024-04-25T22:52:39.982 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.982 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:39.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012915+0000", 2024-04-25T22:52:39.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119021 2024-04-25T22:52:39.983 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.983 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.983 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:39.983 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013069+0000", 2024-04-25T22:52:39.983 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015463900000000001 2024-04-25T22:52:39.983 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.983 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.983 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:39.983 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019237+0000", 2024-04-25T22:52:39.983 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061680329999999998 2024-04-25T22:52:39.983 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.983 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.983 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:39.983 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023603+0000", 2024-04-25T22:52:39.984 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043655860000000003 2024-04-25T22:52:39.984 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.984 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.984 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:39.984 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023659+0000", 2024-04-25T22:52:39.984 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6484000000000003e-05 2024-04-25T22:52:39.984 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.984 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.984 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:39.984 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023701+0000", 2024-04-25T22:52:39.984 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1761999999999998e-05 2024-04-25T22:52:39.984 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:39.984 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:39.985 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:39.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.985 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:39.985 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:39.985 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.902873075000002, 2024-04-25T22:52:39.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011234429000000001, 2024-04-25T22:52:39.985 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:39.985 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:39.985 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:39.985 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:39.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:39.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:39.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:39.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:39.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:39.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:39.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:39.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012762+0000", 2024-04-25T22:52:39.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-04-25T22:52:39.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:39.987 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012765+0000", 2024-04-25T22:52:39.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2569999999999999e-06 2024-04-25T22:52:39.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.987 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:39.987 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012783+0000", 2024-04-25T22:52:39.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8431999999999999e-05 2024-04-25T22:52:39.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.987 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:39.987 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012799+0000", 2024-04-25T22:52:39.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5438999999999999e-05 2024-04-25T22:52:39.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.988 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:39.988 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013826+0000", 2024-04-25T22:52:39.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010275060000000001 2024-04-25T22:52:39.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.988 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:39.988 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013913+0000", 2024-04-25T22:52:39.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.708e-05 2024-04-25T22:52:39.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.988 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:39.988 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014098+0000", 2024-04-25T22:52:39.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018519399999999999 2024-04-25T22:52:39.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.989 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.989 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:39.989 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019684+0000", 2024-04-25T22:52:39.989 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055860079999999999 2024-04-25T22:52:39.989 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.989 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.989 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:39.989 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023876+0000", 2024-04-25T22:52:39.989 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041918800000000003 2024-04-25T22:52:39.989 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.989 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.989 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:39.989 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023957+0000", 2024-04-25T22:52:39.989 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1165e-05 2024-04-25T22:52:39.989 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.990 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.990 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:39.990 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023995+0000", 2024-04-25T22:52:39.990 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:52:39.990 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:39.990 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:39.990 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:39.990 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.990 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.990 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:39.990 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:39.990 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.902775296000002, 2024-04-25T22:52:39.990 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011131200000000001, 2024-04-25T22:52:39.991 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:39.991 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:39.991 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:39.991 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:39.991 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.991 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:39.991 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:39.991 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:39.991 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.991 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.991 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:39.991 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:39.991 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:39.991 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.992 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.992 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:39.992 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012860+0000", 2024-04-25T22:52:39.992 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3900000000000004e-07 2024-04-25T22:52:39.992 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.992 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.992 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:39.992 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012865+0000", 2024-04-25T22:52:39.992 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5609999999999998e-06 2024-04-25T22:52:39.992 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.992 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.992 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:39.992 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012895+0000", 2024-04-25T22:52:39.992 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9847000000000001e-05 2024-04-25T22:52:39.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.993 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.993 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:39.993 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012905+0000", 2024-04-25T22:52:39.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.03e-05 2024-04-25T22:52:39.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.993 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.993 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:39.993 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015020+0000", 2024-04-25T22:52:39.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021142940000000001 2024-04-25T22:52:39.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.993 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.993 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:39.993 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015182+0000", 2024-04-25T22:52:39.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016248099999999999 2024-04-25T22:52:39.994 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.994 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:52:39.994 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015357+0000", 2024-04-25T22:52:39.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017471000000000001 2024-04-25T22:52:39.994 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.994 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:39.994 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021021+0000", 2024-04-25T22:52:39.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056638340000000004 2024-04-25T22:52:39.994 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.994 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:39.994 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023712+0000", 2024-04-25T22:52:39.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026910380000000002 2024-04-25T22:52:39.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:39.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023763+0000", 2024-04-25T22:52:39.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1477999999999997e-05 2024-04-25T22:52:39.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:39.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023990+0000", 2024-04-25T22:52:39.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000226818 2024-04-25T22:52:39.995 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:39.995 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:39.995 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:39.996 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.996 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.996 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:39.996 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:39.996 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.902652199999999, 2024-04-25T22:52:39.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011705299000000001, 2024-04-25T22:52:39.996 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:39.996 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:39.996 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:39.996 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:39.996 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.996 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:39.996 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:39.997 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:39.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:39.997 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:39.997 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:39.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:39.997 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012983+0000", 2024-04-25T22:52:39.997 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:52:39.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:39.997 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012986+0000", 2024-04-25T22:52:39.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5700000000000001e-06 2024-04-25T22:52:39.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.998 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:39.998 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012993+0000", 2024-04-25T22:52:39.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8730000000000001e-06 2024-04-25T22:52:39.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.998 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:39.998 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013000+0000", 2024-04-25T22:52:39.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1890000000000001e-06 2024-04-25T22:52:39.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.999 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:39.999 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:52:39.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002147866 2024-04-25T22:52:39.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.999 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.999 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:39.999 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015351+0000", 2024-04-25T22:52:39.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020300799999999999 2024-04-25T22:52:39.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:39.999 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:39.999 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:39.999 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016260+0000", 2024-04-25T22:52:39.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00090926799999999997 2024-04-25T22:52:39.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.000 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.000 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:40.000 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022669+0000", 2024-04-25T22:52:40.000 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064082849999999997 2024-04-25T22:52:40.000 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.000 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.000 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:40.000 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024584+0000", 2024-04-25T22:52:40.000 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019151699999999999 2024-04-25T22:52:40.000 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.000 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.000 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:40.000 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024643+0000", 2024-04-25T22:52:40.000 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8888999999999998e-05 2024-04-25T22:52:40.001 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.001 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.001 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:40.001 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024687+0000", 2024-04-25T22:52:40.001 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4444999999999999e-05 2024-04-25T22:52:40.001 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:40.001 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:40.001 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:40.001 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.001 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.001 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:40.001 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:40.001 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.902624609, 2024-04-25T22:52:40.001 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011249699, 2024-04-25T22:52:40.002 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:40.002 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:40.002 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:40.002 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:40.002 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.002 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:40.002 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:40.002 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:40.002 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.002 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.002 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:40.002 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:40.002 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:40.002 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.003 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:40.003 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013010+0000", 2024-04-25T22:52:40.003 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2099999999999996e-07 2024-04-25T22:52:40.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.003 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:40.003 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013013+0000", 2024-04-25T22:52:40.003 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1310000000000002e-06 2024-04-25T22:52:40.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.003 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:40.003 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013020+0000", 2024-04-25T22:52:40.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3330000000000002e-06 2024-04-25T22:52:40.004 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.004 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.004 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:40.004 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013025+0000", 2024-04-25T22:52:40.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6760000000000004e-06 2024-04-25T22:52:40.004 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.004 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.004 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:40.004 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013163+0000", 2024-04-25T22:52:40.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013824599999999999 2024-04-25T22:52:40.004 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.004 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.004 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:40.005 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013504+0000", 2024-04-25T22:52:40.005 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034080299999999998 2024-04-25T22:52:40.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.005 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:40.005 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013613+0000", 2024-04-25T22:52:40.005 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108705 2024-04-25T22:52:40.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.005 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:40.005 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015831+0000", 2024-04-25T22:52:40.005 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002217672 2024-04-25T22:52:40.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.006 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:40.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024137+0000", 2024-04-25T22:52:40.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0083060489999999994 2024-04-25T22:52:40.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.006 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:40.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024218+0000", 2024-04-25T22:52:40.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1351000000000001e-05 2024-04-25T22:52:40.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.006 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:40.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024259+0000", 2024-04-25T22:52:40.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1112000000000002e-05 2024-04-25T22:52:40.006 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:40.007 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:40.007 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:40.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.007 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:40.007 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:40.007 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.902536883000003, 2024-04-25T22:52:40.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020379749999999999, 2024-04-25T22:52:40.007 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:40.007 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:40.007 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:40.007 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:40.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:40.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:40.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:40.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:40.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:40.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:40.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:40.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013098+0000", 2024-04-25T22:52:40.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:52:40.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.009 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.009 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:40.009 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013105+0000", 2024-04-25T22:52:40.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5969999999999997e-06 2024-04-25T22:52:40.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.009 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.009 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:40.009 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013190+0000", 2024-04-25T22:52:40.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5618999999999995e-05 2024-04-25T22:52:40.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.009 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.009 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:40.009 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013200+0000", 2024-04-25T22:52:40.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5859999999999994e-06 2024-04-25T22:52:40.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.010 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.010 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:40.010 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020265+0000", 2024-04-25T22:52:40.010 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070653349999999998 2024-04-25T22:52:40.010 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.010 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.010 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:40.010 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020454+0000", 2024-04-25T22:52:40.010 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189316 2024-04-25T22:52:40.010 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.010 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.010 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:40.010 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020586+0000", 2024-04-25T22:52:40.010 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013195700000000001 2024-04-25T22:52:40.011 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.011 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.011 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:40.011 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023822+0000", 2024-04-25T22:52:40.011 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032358529999999999 2024-04-25T22:52:40.011 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.011 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.011 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:40.011 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033409+0000", 2024-04-25T22:52:40.011 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095870520000000004 2024-04-25T22:52:40.011 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.011 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.011 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:40.011 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033447+0000", 2024-04-25T22:52:40.012 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7261999999999997e-05 2024-04-25T22:52:40.012 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.012 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.012 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:40.012 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033477+0000", 2024-04-25T22:52:40.012 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0389e-05 2024-04-25T22:52:40.012 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:40.012 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:40.012 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:40.012 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.012 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.012 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:40.012 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:40.013 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.902420376999999, 2024-04-25T22:52:40.013 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010857383999999999, 2024-04-25T22:52:40.013 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:40.013 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:40.013 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:40.013 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:40.013 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.013 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:40.013 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:40.013 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:40.013 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.013 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.013 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:40.013 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:40.014 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:40.014 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.014 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.014 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:40.014 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:40.014 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:52:40.014 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.014 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.014 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:40.014 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013218+0000", 2024-04-25T22:52:40.014 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8199999999999998e-06 2024-04-25T22:52:40.014 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.014 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.014 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:40.015 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013226+0000", 2024-04-25T22:52:40.015 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7649999999999993e-06 2024-04-25T22:52:40.015 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.015 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.015 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:40.015 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013259+0000", 2024-04-25T22:52:40.015 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2727e-05 2024-04-25T22:52:40.015 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.015 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.015 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:40.015 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014809+0000", 2024-04-25T22:52:40.015 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001550144 2024-04-25T22:52:40.015 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.015 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.015 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:40.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014958+0000", 2024-04-25T22:52:40.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014890300000000001 2024-04-25T22:52:40.016 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.016 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.016 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:52:40.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015087+0000", 2024-04-25T22:52:40.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012939200000000001 2024-04-25T22:52:40.016 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.016 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.016 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:40.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020212+0000", 2024-04-25T22:52:40.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051248939999999996 2024-04-25T22:52:40.016 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.016 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.017 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:40.017 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023699+0000", 2024-04-25T22:52:40.017 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034873289999999999 2024-04-25T22:52:40.017 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.017 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.017 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:40.017 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024014+0000", 2024-04-25T22:52:40.017 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031473999999999999 2024-04-25T22:52:40.017 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.017 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.017 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:40.017 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024071+0000", 2024-04-25T22:52:40.017 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7040000000000003e-05 2024-04-25T22:52:40.017 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:40.017 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:40.018 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:40.018 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.018 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:40.018 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:40.018 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.902365672000002, 2024-04-25T22:52:40.018 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012329677000000001, 2024-04-25T22:52:40.018 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:40.018 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:40.018 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:40.018 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:40.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.018 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:40.018 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:40.019 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:40.019 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.019 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.019 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:40.019 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:40.019 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:40.019 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.019 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.019 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:40.019 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013269+0000", 2024-04-25T22:52:40.019 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5000000000000002e-07 2024-04-25T22:52:40.019 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.019 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.019 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:40.020 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:52:40.020 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6909999999999999e-06 2024-04-25T22:52:40.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.020 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:40.020 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013284+0000", 2024-04-25T22:52:40.020 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0963e-05 2024-04-25T22:52:40.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.020 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:40.020 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013361+0000", 2024-04-25T22:52:40.020 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7379999999999994e-05 2024-04-25T22:52:40.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.021 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:40.021 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013448+0000", 2024-04-25T22:52:40.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6990000000000006e-05 2024-04-25T22:52:40.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.021 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:40.021 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013632+0000", 2024-04-25T22:52:40.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018396800000000001 2024-04-25T22:52:40.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.021 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:40.021 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013800+0000", 2024-04-25T22:52:40.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167467 2024-04-25T22:52:40.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.022 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:40.022 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.018570+0000", 2024-04-25T22:52:40.022 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047701460000000003 2024-04-25T22:52:40.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.022 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.022 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:40.022 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025507+0000", 2024-04-25T22:52:40.022 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069372039999999998 2024-04-25T22:52:40.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.022 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.022 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:40.022 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025562+0000", 2024-04-25T22:52:40.022 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4858999999999998e-05 2024-04-25T22:52:40.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.023 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.023 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:40.023 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025598+0000", 2024-04-25T22:52:40.023 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6259e-05 2024-04-25T22:52:40.023 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:40.023 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:40.023 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:40.023 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.023 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.023 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:40.023 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:40.023 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.902233799000001, 2024-04-25T22:52:40.023 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020176666999999999, 2024-04-25T22:52:40.023 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:40.024 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:40.024 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:52:40.024 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:40.024 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.024 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:40.024 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:40.024 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:40.024 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.024 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.024 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:40.024 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:40.024 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:40.024 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.024 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.024 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:40.025 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:52:40.025 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-04-25T22:52:40.025 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.025 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.025 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:40.025 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013405+0000", 2024-04-25T22:52:40.025 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0559999999999998e-06 2024-04-25T22:52:40.025 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.025 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.025 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:40.025 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013422+0000", 2024-04-25T22:52:40.025 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6770999999999999e-05 2024-04-25T22:52:40.025 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.025 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:40.026 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013431+0000", 2024-04-25T22:52:40.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5019999999999998e-06 2024-04-25T22:52:40.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:40.026 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021720+0000", 2024-04-25T22:52:40.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082884340000000008 2024-04-25T22:52:40.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:40.026 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022122+0000", 2024-04-25T22:52:40.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000401634 2024-04-25T22:52:40.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:40.027 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:40.027 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:40.027 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033577+0000", 2024-04-25T22:52:40.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011455435999999999 2024-04-25T22:52:40.027 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:40.027 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:40.027 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:40.027 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:40.027 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:40.027 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:40.029 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:52:40.029 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:40.027+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:40.130 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:40.129+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:40.139 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:40.139 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:52:40.139 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-25T22:52:40.139 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:40.148 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:52:40.231 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:40.230+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:40.251 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:40.251 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:52:40.251 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-25T22:52:40.251 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-25T22:52:40.251 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:40.260 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:52:40.332 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:40.331+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:40.403 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:40.404 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:52:40.404 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:52:40.404 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:52:40.404 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.404 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:52:40.404 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:52:40.404 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 52.434998479999997, 2024-04-25T22:52:40.404 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:52:40.404 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:40.404 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:40.404 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:40.404 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:40.404 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.404 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:40.405 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:52:40.405 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:40.405 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.405 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.405 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:40.405 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:52:40.405 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:40.405 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.405 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.405 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:40.405 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:52:40.405 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:52:40.405 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.406 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.406 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:40.406 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:52:40.406 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:52:40.406 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.406 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.406 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:40.406 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:52:40.406 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:52:40.406 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.406 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.406 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:40.407 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:52:40.407 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:52:40.407 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.407 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.407 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:40.407 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:52:40.407 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:52:40.407 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.407 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.407 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:40.407 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:52:40.407 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:52:40.408 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.408 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.408 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:40.408 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:52:40.408 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:52:40.408 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.408 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.408 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:40.408 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:52:40.408 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:52:40.408 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:40.408 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:40.408 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:40.408 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.409 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.409 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:110 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'72, mlcod=10'68)", 2024-04-25T22:52:40.409 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:40.409 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 52.434364479999999, 2024-04-25T22:52:40.409 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065316630000000001, 2024-04-25T22:52:40.409 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:40.409 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:40.409 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:40.409 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:40.409 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.409 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:40.409 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:40.409 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:40.409 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.409 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.410 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:40.410 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:40.410 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:40.410 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.410 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.410 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:40.410 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:40.410 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.58e-07 2024-04-25T22:52:40.410 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.410 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.410 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:40.410 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967811+0000", 2024-04-25T22:52:40.410 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.118e-06 2024-04-25T22:52:40.411 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.411 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.411 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:40.411 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967817+0000", 2024-04-25T22:52:40.411 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3709999999999996e-06 2024-04-25T22:52:40.411 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.411 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.411 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:40.411 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967820+0000", 2024-04-25T22:52:40.411 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2210000000000002e-06 2024-04-25T22:52:40.411 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.411 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.411 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:40.411 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967876+0000", 2024-04-25T22:52:40.412 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5507000000000002e-05 2024-04-25T22:52:40.412 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.412 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.412 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:40.412 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967893+0000", 2024-04-25T22:52:40.412 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7812000000000002e-05 2024-04-25T22:52:40.412 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.412 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.412 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:40.412 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974317+0000", 2024-04-25T22:52:40.412 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064237160000000003 2024-04-25T22:52:40.412 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.412 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.412 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:40.413 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:52:40.413 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.156e-05 2024-04-25T22:52:40.413 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:40.413 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:40.413 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:40.413 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.413 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.413 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'68)", 2024-04-25T22:52:40.413 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:40.413 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 52.433946966999997, 2024-04-25T22:52:40.413 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061292279999999996, 2024-04-25T22:52:40.413 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:40.413 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:40.414 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:40.414 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:40.414 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.414 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:40.414 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:40.414 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:40.414 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.414 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.414 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:40.414 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:40.414 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:40.414 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.414 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.414 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:40.415 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:40.415 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6300000000000001e-07 2024-04-25T22:52:40.415 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.415 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.415 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:40.415 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968228+0000", 2024-04-25T22:52:40.415 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6139999999999999e-06 2024-04-25T22:52:40.415 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.415 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.415 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:40.415 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968235+0000", 2024-04-25T22:52:40.415 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7020000000000001e-06 2024-04-25T22:52:40.415 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.415 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.416 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:40.416 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968238+0000", 2024-04-25T22:52:40.416 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0010000000000002e-06 2024-04-25T22:52:40.416 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.416 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.416 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:40.416 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968297+0000", 2024-04-25T22:52:40.416 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8424999999999997e-05 2024-04-25T22:52:40.416 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.416 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.416 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:40.416 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968316+0000", 2024-04-25T22:52:40.416 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8814999999999999e-05 2024-04-25T22:52:40.416 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.416 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.416 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:40.417 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:52:40.417 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060239439999999998 2024-04-25T22:52:40.417 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.417 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.417 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:40.417 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974354+0000", 2024-04-25T22:52:40.417 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4364e-05 2024-04-25T22:52:40.417 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:40.417 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:40.417 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:40.417 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.417 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.417 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'68)", 2024-04-25T22:52:40.417 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:40.418 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 52.433509964999999, 2024-04-25T22:52:40.418 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005948414, 2024-04-25T22:52:40.418 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:40.418 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:40.418 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:40.418 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:40.418 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.418 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:40.418 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:40.418 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:40.418 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.418 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.418 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:40.418 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:40.419 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:40.419 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.419 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.419 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:40.419 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:40.419 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6199999999999998e-07 2024-04-25T22:52:40.419 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.419 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.419 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:40.419 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968723+0000", 2024-04-25T22:52:40.419 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1148999999999993e-05 2024-04-25T22:52:40.419 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.419 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.419 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:40.420 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968730+0000", 2024-04-25T22:52:40.420 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1749999999999999e-06 2024-04-25T22:52:40.420 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.420 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.420 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:40.420 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968734+0000", 2024-04-25T22:52:40.420 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5200000000000002e-06 2024-04-25T22:52:40.420 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.420 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.420 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:40.420 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968771+0000", 2024-04-25T22:52:40.420 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6851999999999999e-05 2024-04-25T22:52:40.420 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.420 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.420 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:40.421 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968788+0000", 2024-04-25T22:52:40.421 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7027000000000001e-05 2024-04-25T22:52:40.421 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.421 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.421 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:40.421 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974589+0000", 2024-04-25T22:52:40.421 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058013320000000002 2024-04-25T22:52:40.421 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.421 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.421 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:40.421 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974610+0000", 2024-04-25T22:52:40.421 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0897e-05 2024-04-25T22:52:40.421 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:40.421 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:40.422 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:40.422 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.422 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.422 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'68)", 2024-04-25T22:52:40.422 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:40.422 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 52.432939955000002, 2024-04-25T22:52:40.422 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053935750000000003, 2024-04-25T22:52:40.422 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:40.422 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:40.422 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:40.422 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:40.422 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.422 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:40.422 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:40.423 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:40.423 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.423 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.423 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:40.423 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:40.423 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:40.423 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.423 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.423 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:40.423 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:40.423 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.03e-07 2024-04-25T22:52:40.423 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.423 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.423 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:40.423 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969235+0000", 2024-04-25T22:52:40.424 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2399999999999999e-06 2024-04-25T22:52:40.424 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.424 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.424 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:40.424 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969242+0000", 2024-04-25T22:52:40.424 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1269999999999997e-06 2024-04-25T22:52:40.424 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.424 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.424 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:40.424 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969246+0000", 2024-04-25T22:52:40.424 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3840000000000001e-06 2024-04-25T22:52:40.424 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.424 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.424 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:40.424 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969278+0000", 2024-04-25T22:52:40.424 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1868e-05 2024-04-25T22:52:40.425 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.425 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.425 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:40.425 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969295+0000", 2024-04-25T22:52:40.425 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7530999999999999e-05 2024-04-25T22:52:40.425 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.425 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.425 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:40.425 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974611+0000", 2024-04-25T22:52:40.425 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053160789999999996 2024-04-25T22:52:40.425 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.425 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.425 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:40.425 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974625+0000", 2024-04-25T22:52:40.425 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3943e-05 2024-04-25T22:52:40.425 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:40.426 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:40.426 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:40.426 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.426 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.426 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-25T22:52:40.426 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:40.426 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 52.239344047000003, 2024-04-25T22:52:40.426 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054952610000000004, 2024-04-25T22:52:40.426 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:40.426 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:40.426 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:40.426 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:40.426 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.426 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:40.427 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:40.427 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:40.427 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.427 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.427 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:40.427 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:40.427 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:40.427 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.427 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.427 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:40.427 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:40.427 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.68e-07 2024-04-25T22:52:40.427 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.427 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.427 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:40.428 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162898+0000", 2024-04-25T22:52:40.428 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9470999999999999e-05 2024-04-25T22:52:40.428 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.428 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.428 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:40.428 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162906+0000", 2024-04-25T22:52:40.428 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1580000000000005e-06 2024-04-25T22:52:40.428 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.428 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.428 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:40.428 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162911+0000", 2024-04-25T22:52:40.428 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4779999999999999e-06 2024-04-25T22:52:40.428 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.429 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.429 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:40.429 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162952+0000", 2024-04-25T22:52:40.429 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0629e-05 2024-04-25T22:52:40.429 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.429 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.429 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:40.429 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162968+0000", 2024-04-25T22:52:40.429 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6239000000000002e-05 2024-04-25T22:52:40.429 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.429 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.429 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:40.429 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168281+0000", 2024-04-25T22:52:40.430 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053132869999999999 2024-04-25T22:52:40.430 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.430 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.430 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:40.430 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168323+0000", 2024-04-25T22:52:40.430 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1430999999999997e-05 2024-04-25T22:52:40.430 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:40.430 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:40.430 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:40.430 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.430 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.430 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-04-25T22:52:40.430 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:40.430 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 51.808866684999998, 2024-04-25T22:52:40.431 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050872510000000001, 2024-04-25T22:52:40.431 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:40.431 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:40.431 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:40.431 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:40.431 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.431 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:40.431 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:40.431 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:40.431 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.431 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.431 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:40.431 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:40.431 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:40.432 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.432 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.432 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:40.432 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:40.432 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.72e-07 2024-04-25T22:52:40.432 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.432 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.432 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:40.432 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593381+0000", 2024-04-25T22:52:40.432 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5797000000000006e-05 2024-04-25T22:52:40.432 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.432 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.432 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:40.433 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593389+0000", 2024-04-25T22:52:40.433 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8480000000000001e-06 2024-04-25T22:52:40.433 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.433 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.433 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:40.433 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593393+0000", 2024-04-25T22:52:40.433 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4819999999999996e-06 2024-04-25T22:52:40.433 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.433 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.433 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:40.433 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593435+0000", 2024-04-25T22:52:40.433 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1600000000000002e-05 2024-04-25T22:52:40.433 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.433 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.434 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:40.434 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593454+0000", 2024-04-25T22:52:40.434 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8868e-05 2024-04-25T22:52:40.434 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.434 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.434 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:40.434 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598350+0000", 2024-04-25T22:52:40.434 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004895763 2024-04-25T22:52:40.434 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.434 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.434 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:40.434 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598392+0000", 2024-04-25T22:52:40.434 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2521000000000002e-05 2024-04-25T22:52:40.435 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:40.435 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:40.435 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:40.435 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.435 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.435 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:40.435 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:52:40.435 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 47.390502781000002, 2024-04-25T22:52:40.435 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:52:40.435 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:40.435 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:40.435 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:40.435 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:40.436 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.436 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:40.436 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:52:40.436 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:40.436 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.436 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.436 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:40.436 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:52:40.436 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:40.436 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.436 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.436 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:40.436 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:52:40.437 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:52:40.437 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.437 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.437 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:40.437 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:52:40.437 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:52:40.437 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.437 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.437 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:40.437 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:52:40.437 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:52:40.437 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.437 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.437 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:40.438 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:52:40.438 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:52:40.438 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.438 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.438 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:40.438 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:52:40.438 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:52:40.438 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.438 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.438 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:40.438 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:52:40.438 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:52:40.439 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.439 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.439 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:40.439 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:52:40.439 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:52:40.439 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.439 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.439 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:40.439 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:52:40.439 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:52:40.439 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.439 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.439 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:40.439 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:52:40.439 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:52:40.440 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.440 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.440 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:40.440 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:52:40.440 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:52:40.440 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.440 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.440 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:40.440 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:52:40.440 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:52:40.440 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:40.440 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:40.440 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:40.440 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.441 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.441 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:40.441 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:52:40.441 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 47.389828405000003, 2024-04-25T22:52:40.441 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:52:40.441 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:40.441 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:40.441 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:40.441 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:40.441 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.441 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:40.441 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:52:40.441 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:40.441 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.441 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.442 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:40.442 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:52:40.442 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:40.442 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.442 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.442 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:40.442 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:52:40.442 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:52:40.442 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.442 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.442 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:40.442 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:52:40.442 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:52:40.443 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.443 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.443 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:40.443 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:52:40.443 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:52:40.443 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.443 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.443 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:40.443 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:52:40.443 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:52:40.443 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.443 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.443 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:40.444 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:52:40.444 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:52:40.444 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.444 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.444 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:40.444 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:52:40.444 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:52:40.444 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.444 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.444 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:40.444 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:52:40.444 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:52:40.444 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.444 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.444 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:40.445 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:52:40.445 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:52:40.445 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.445 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.445 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:40.445 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:52:40.445 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:52:40.445 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.445 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.445 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:40.445 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:52:40.445 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:52:40.445 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.445 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.446 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:40.446 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:52:40.446 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:52:40.446 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:40.446 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:40.446 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:40.446 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.446 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.446 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:40.446 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:52:40.446 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 47.389319192999999, 2024-04-25T22:52:40.446 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:52:40.446 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:40.446 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:40.447 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:40.447 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:40.447 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.447 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:40.447 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:52:40.447 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:40.447 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.447 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.447 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:40.447 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:52:40.447 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:40.447 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.447 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.447 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:40.448 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:52:40.448 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:52:40.448 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.448 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.448 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:40.448 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:52:40.448 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:52:40.448 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.448 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.448 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:40.448 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:52:40.448 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:52:40.448 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.448 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.449 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:40.449 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:52:40.449 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:52:40.449 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.449 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.449 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:40.449 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:52:40.449 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:52:40.449 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.449 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.449 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:40.449 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:52:40.449 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:52:40.449 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.450 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.450 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:40.450 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:52:40.450 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:52:40.450 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.450 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.450 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:40.450 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:52:40.450 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:52:40.450 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.450 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.450 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:40.450 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:52:40.450 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:52:40.451 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.451 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.451 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:40.451 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:52:40.451 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:52:40.451 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.451 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.451 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:40.451 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:52:40.451 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:52:40.451 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:40.451 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:40.451 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:40.451 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.452 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.452 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:40.452 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:40.452 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 47.388905995000002, 2024-04-25T22:52:40.452 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:52:40.452 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:40.452 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:40.452 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:40.452 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:40.452 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.452 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:40.452 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:40.452 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:40.452 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.453 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.453 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:40.453 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:40.453 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:40.453 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.453 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.453 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:40.453 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:40.453 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:52:40.453 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.453 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.453 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:40.453 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:52:40.453 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:52:40.454 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.454 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.454 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:40.454 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:52:40.454 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:52:40.454 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.454 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.454 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:40.454 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:52:40.454 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:52:40.454 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.454 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.454 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:40.455 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:52:40.455 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:52:40.455 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.455 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.455 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:40.455 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:52:40.455 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:52:40.455 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.455 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.455 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:40.455 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:52:40.455 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:52:40.455 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.455 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.455 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:40.456 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:52:40.456 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:52:40.456 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.456 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.456 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:40.456 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:52:40.456 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:52:40.456 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.456 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.456 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:40.456 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:52:40.456 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:52:40.456 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.456 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.457 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:40.457 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:52:40.457 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:52:40.457 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:40.457 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:40.457 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:40.457 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.457 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.457 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:40.457 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:52:40.457 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 47.388855325000002, 2024-04-25T22:52:40.457 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:52:40.457 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:40.457 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:40.457 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:40.458 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:40.458 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.458 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:40.458 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:52:40.458 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:40.458 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.458 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.458 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:40.458 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:52:40.458 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:40.458 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.458 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.458 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:40.459 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:52:40.459 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:52:40.459 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.459 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.459 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:40.459 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:52:40.459 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:52:40.459 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.459 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.459 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:40.459 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:52:40.459 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:52:40.459 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.460 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.460 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:40.460 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:52:40.460 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:52:40.460 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.460 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.460 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:40.460 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:52:40.460 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:52:40.460 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.460 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.460 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:52:40.460 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:52:40.460 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:52:40.461 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.461 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.461 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:40.461 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:52:40.461 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:52:40.461 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.461 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.461 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:40.461 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:52:40.461 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:52:40.461 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.461 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.461 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:40.461 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:52:40.461 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:52:40.462 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.462 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.462 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:40.462 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:52:40.462 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:52:40.462 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.462 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.462 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:40.462 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:52:40.462 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:52:40.462 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.462 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.462 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:40.463 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:52:40.463 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:52:40.463 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.463 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.463 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:40.463 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:52:40.463 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:52:40.463 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:40.463 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:40.463 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:40.463 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.463 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.463 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:40.463 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:52:40.464 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 47.388818456000003, 2024-04-25T22:52:40.464 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:52:40.464 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:40.464 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:40.464 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:40.464 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:40.464 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.464 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:40.464 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:52:40.464 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:40.464 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.464 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.464 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:40.465 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:52:40.465 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:40.465 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.465 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.465 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:40.465 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:52:40.465 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:52:40.465 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.465 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.465 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:40.465 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:52:40.465 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:52:40.465 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.465 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.466 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:40.466 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:52:40.466 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:52:40.466 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.466 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.466 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:40.466 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:52:40.466 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:52:40.466 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.466 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.466 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:40.466 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:52:40.466 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:52:40.466 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.467 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.467 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:52:40.467 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:52:40.467 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:52:40.467 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.467 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.467 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:40.467 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:52:40.467 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:52:40.467 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.467 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.467 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:40.467 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:52:40.467 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:52:40.468 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.468 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.468 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:40.468 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:52:40.468 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:52:40.468 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.468 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.468 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:40.468 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:52:40.468 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:52:40.468 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.468 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.468 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:40.468 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:52:40.469 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:52:40.469 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.469 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.469 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:40.469 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:52:40.469 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:52:40.469 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.469 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.469 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:40.469 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:52:40.469 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:52:40.469 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:40.469 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:40.469 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:40.470 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.470 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.470 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:40.470 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:52:40.470 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 47.388793489999998, 2024-04-25T22:52:40.470 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:52:40.470 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:40.470 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:40.470 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:40.470 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:40.470 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.470 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:40.470 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:52:40.471 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:40.471 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.471 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.471 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:40.471 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:52:40.471 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:40.471 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.471 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.471 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:40.471 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:52:40.471 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:52:40.471 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.471 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.471 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:40.472 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:52:40.472 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:52:40.472 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.472 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.472 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:40.472 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:52:40.472 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:52:40.472 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.472 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.472 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:40.472 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:52:40.472 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:52:40.472 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.472 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.472 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:40.472 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:52:40.473 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:52:40.473 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.473 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.473 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:40.473 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:52:40.473 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:52:40.473 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.473 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.473 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:40.473 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:52:40.473 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:52:40.473 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.474 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.474 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:40.474 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:52:40.474 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:52:40.474 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.474 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.474 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:40.474 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:52:40.474 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:52:40.474 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.474 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.474 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:40.474 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:52:40.475 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:52:40.475 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.475 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.475 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:40.475 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:52:40.475 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:52:40.475 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:40.475 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:40.475 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:40.475 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.475 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.475 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:40.475 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:52:40.475 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 47.388757126000002, 2024-04-25T22:52:40.476 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:52:40.476 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:40.476 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:40.476 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:52:40.476 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:40.476 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.476 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:40.476 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:52:40.476 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:40.476 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.476 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.476 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:40.476 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:52:40.476 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:40.477 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.477 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.477 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:40.477 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:52:40.477 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:52:40.477 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.477 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.477 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:40.477 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:52:40.477 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:52:40.477 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.477 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.477 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:40.477 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:52:40.478 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:52:40.478 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.478 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.478 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:40.478 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:52:40.478 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:52:40.478 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.478 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.478 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:40.478 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:52:40.478 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:52:40.478 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.478 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.479 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:52:40.479 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:52:40.479 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:52:40.479 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.479 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.479 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:40.479 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:52:40.479 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:52:40.479 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.479 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.479 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:40.479 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:52:40.479 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:52:40.479 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.480 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.480 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:40.480 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:52:40.480 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:52:40.480 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:40.480 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:40.480 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:40.480 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.480 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.480 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:40.480 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:40.480 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 47.388726044999999, 2024-04-25T22:52:40.480 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:52:40.480 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:40.481 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:40.481 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:52:40.481 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:40.481 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.481 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:40.481 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:40.481 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:40.481 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.481 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.481 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:40.481 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:40.481 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:40.481 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.482 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.482 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:40.482 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:40.482 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:52:40.482 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.482 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.482 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:40.482 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:52:40.482 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:52:40.482 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.482 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.482 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:40.482 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:52:40.483 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:52:40.483 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.483 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.483 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:40.483 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:52:40.483 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:52:40.483 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.483 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.483 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:40.483 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:52:40.483 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:52:40.483 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.483 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.484 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:40.484 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:52:40.484 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:52:40.484 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.484 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.484 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:40.484 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:52:40.484 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:52:40.484 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:40.484 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:40.484 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:40.484 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.484 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.484 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:52:40.485 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:40.485 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 47.388285076000003, 2024-04-25T22:52:40.485 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064881979999999997, 2024-04-25T22:52:40.485 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:40.485 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:40.485 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:40.485 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:40.485 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.485 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:40.485 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:40.485 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:40.485 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.485 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.485 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:40.486 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:40.486 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:40.486 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.486 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.486 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:40.486 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:40.486 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2699999999999999e-07 2024-04-25T22:52:40.486 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.486 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.486 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:40.486 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013898+0000", 2024-04-25T22:52:40.486 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0796e-05 2024-04-25T22:52:40.486 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.487 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.487 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:40.487 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013907+0000", 2024-04-25T22:52:40.487 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5140000000000007e-06 2024-04-25T22:52:40.487 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.487 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.487 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:40.487 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013952+0000", 2024-04-25T22:52:40.487 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4134000000000001e-05 2024-04-25T22:52:40.487 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.488 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.488 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:40.488 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016812+0000", 2024-04-25T22:52:40.488 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028601059999999998 2024-04-25T22:52:40.488 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.488 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.488 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:40.488 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.017052+0000", 2024-04-25T22:52:40.488 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024056500000000001 2024-04-25T22:52:40.488 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.488 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.488 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:40.488 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020350+0000", 2024-04-25T22:52:40.488 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032978320000000001 2024-04-25T22:52:40.489 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.489 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.489 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:40.489 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020375+0000", 2024-04-25T22:52:40.489 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4624e-05 2024-04-25T22:52:40.489 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:40.489 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:40.489 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:40.489 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.489 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.489 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-25T22:52:40.489 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:40.489 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 47.374754629999998, 2024-04-25T22:52:40.489 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058583000000000003, 2024-04-25T22:52:40.490 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:40.490 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:40.490 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:40.490 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:40.490 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.490 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:40.490 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:40.490 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:40.490 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.490 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.490 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:40.490 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:40.490 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:40.490 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.491 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.491 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:40.491 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:40.491 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.41e-07 2024-04-25T22:52:40.491 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.491 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.491 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:40.491 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027428+0000", 2024-04-25T22:52:40.491 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.075e-05 2024-04-25T22:52:40.491 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.491 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.491 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:40.491 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027435+0000", 2024-04-25T22:52:40.491 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3610000000000003e-06 2024-04-25T22:52:40.492 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.492 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.492 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:40.492 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027442+0000", 2024-04-25T22:52:40.492 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0400000000000004e-06 2024-04-25T22:52:40.492 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.492 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.492 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:40.492 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028094+0000", 2024-04-25T22:52:40.492 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00065134800000000005 2024-04-25T22:52:40.492 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.492 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.492 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:40.493 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028107+0000", 2024-04-25T22:52:40.493 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3087e-05 2024-04-25T22:52:40.493 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.493 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.493 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:40.493 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033239+0000", 2024-04-25T22:52:40.493 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051319429999999999 2024-04-25T22:52:40.493 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.493 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.493 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:40.493 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033275+0000", 2024-04-25T22:52:40.493 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6430000000000002e-05 2024-04-25T22:52:40.493 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:40.493 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:40.493 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:40.494 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.494 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.494 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-25T22:52:40.494 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:40.494 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 47.374369793, 2024-04-25T22:52:40.494 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005413597, 2024-04-25T22:52:40.494 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:40.494 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:40.494 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:40.494 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:40.494 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.494 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:40.494 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:40.494 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:40.495 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.495 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.495 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:40.495 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:40.495 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:40.495 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.495 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.495 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:40.495 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:40.495 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3799999999999997e-07 2024-04-25T22:52:40.495 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.495 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.495 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:40.495 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027816+0000", 2024-04-25T22:52:40.496 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3230999999999999e-05 2024-04-25T22:52:40.496 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.496 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.496 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:40.496 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027823+0000", 2024-04-25T22:52:40.496 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9039999999999992e-06 2024-04-25T22:52:40.496 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.496 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.496 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:40.496 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027841+0000", 2024-04-25T22:52:40.496 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7651000000000001e-05 2024-04-25T22:52:40.496 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.496 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.496 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:40.496 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027904+0000", 2024-04-25T22:52:40.497 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3058000000000005e-05 2024-04-25T22:52:40.497 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.497 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.497 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:40.497 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027926+0000", 2024-04-25T22:52:40.497 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1450999999999998e-05 2024-04-25T22:52:40.497 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.497 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.497 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:40.497 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033177+0000", 2024-04-25T22:52:40.497 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052508909999999997 2024-04-25T22:52:40.497 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.497 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.497 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:40.498 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033215+0000", 2024-04-25T22:52:40.498 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8872999999999999e-05 2024-04-25T22:52:40.498 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:40.498 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:40.498 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:40.498 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.498 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.498 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 171 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:52:40.498 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:40.498 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 47.374312691, 2024-04-25T22:52:40.498 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054322240000000003, 2024-04-25T22:52:40.498 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:40.498 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:40.499 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "reached pg", 2024-04-25T22:52:40.499 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:40.499 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.499 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:40.499 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:40.499 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:40.499 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.499 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.499 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:40.499 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:40.499 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:40.499 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.499 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.499 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:40.500 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:40.500 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7500000000000001e-07 2024-04-25T22:52:40.500 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.500 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.500 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:40.500 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027868+0000", 2024-04-25T22:52:40.500 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5750000000000001e-06 2024-04-25T22:52:40.500 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.500 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.500 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:40.500 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027885+0000", 2024-04-25T22:52:40.500 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7272e-05 2024-04-25T22:52:40.500 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.501 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.501 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:40.501 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027900+0000", 2024-04-25T22:52:40.501 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.502e-05 2024-04-25T22:52:40.501 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.501 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.501 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:40.501 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028381+0000", 2024-04-25T22:52:40.501 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00048039399999999998 2024-04-25T22:52:40.501 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:40.501 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:40.501 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:40.501 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033291+0000", 2024-04-25T22:52:40.501 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049105879999999996 2024-04-25T22:52:40.502 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:40.502 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:40.502 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:40.502 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:40.502 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:40.502 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:40.503 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:52:40.504 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:40.502+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:40.604 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:40.602+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:40.610 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:40.610 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:52:40.610 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-04-25T22:52:40.610 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:40.619 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:52:40.627 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:52:40.705 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:40.704+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:40.760 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:40.761 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:52:40.761 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:52:40.761 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:52:40.761 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:40.765 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-25T22:52:40.765 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:52:40.770 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:52:40.784 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-25T22:52:40.784 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-25T22:52:40.802 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-25T22:52:40.803 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:52:40.814 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:40.812+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:40.871 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:40.872 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:40.880 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:52:40.924 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:40.923+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:40.984 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:40.984 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:40.994 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:52:41.035 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:41.034+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:41.109 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:41.108+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:41.137 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:41.137 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:41.141 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-25T22:52:41.145 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:52:41.210 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:41.209+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:41.248 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:41.248 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:41.257 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:52:41.310 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:41.309+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:41.360 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:41.361 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:41.369 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:52:41.411 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:41.410+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:41.511 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:41.512 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:41.512 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:41.510+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:41.520 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:52:41.613 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:41.611+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:41.662 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:41.662 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:41.671 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:52:41.713 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:41.713+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:41.774 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:41.774 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:41.783 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:52:41.814 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:41.813+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:41.884 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:41.885 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:41.893 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:52:41.915 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:41.914+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:41.994 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:41.995 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:42.003 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:52:42.016 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:42.015+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:42.106 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:42.107 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:42.115 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:52:42.117 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:42.115+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:42.134 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is set 2024-04-25T22:52:42.180 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T22:52:42.217 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:42.217 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:42.219 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:42.218+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:42.226 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:52:42.290 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on 2024-04-25T22:52:42.319 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:42.318+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:42.328 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:42.328 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:42.337 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:52:42.420 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:42.419+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:42.440 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:42.440 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:42.449 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:52:42.521 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:42.520+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:42.550 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:42.551 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:42.559 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:52:42.622 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:42.621+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:42.702 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:42.703 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:42.711 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:52:42.756 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:42.754+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:42.814 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:52:42.815 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:42.816 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:42.825 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:52:42.825 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:42.823+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:42.925 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:42.923+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:42.953 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-25T22:52:42.953 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:52:42.953 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:52:42.968 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:42.968 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:52:42.968 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:52:42.969 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:52:42.969 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:42.972 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-25T22:52:42.972 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:52:42.975 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:52:42.975 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:52:42.977 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:52:43.026 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:43.026+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:43.122 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:43.122 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-04-25T22:52:43.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-04-25T22:52:43.123 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:52:43.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.123 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:43.123 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:43.123 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 55.155311959999999, 2024-04-25T22:52:43.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0103421, 2024-04-25T22:52:43.123 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:43.123 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:43.123 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:43.123 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:43.123 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:43.123 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:43.123 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 115 2024-04-25T22:52:43.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.124 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:43.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:43.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:43.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:43.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:43.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:43.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:43.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:43.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:43.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9500000000000002e-07 2024-04-25T22:52:43.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:43.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965108+0000", 2024-04-25T22:52:43.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9177999999999994e-05 2024-04-25T22:52:43.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:43.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965127+0000", 2024-04-25T22:52:43.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8868e-05 2024-04-25T22:52:43.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:43.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965133+0000", 2024-04-25T22:52:43.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8929999999999999e-06 2024-04-25T22:52:43.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:43.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.969991+0000", 2024-04-25T22:52:43.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048573849999999997 2024-04-25T22:52:43.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:43.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970072+0000", 2024-04-25T22:52:43.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0728000000000004e-05 2024-04-25T22:52:43.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:43.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970189+0000", 2024-04-25T22:52:43.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000117778 2024-04-25T22:52:43.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:43.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970946+0000", 2024-04-25T22:52:43.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00075704600000000004 2024-04-25T22:52:43.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:43.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975297+0000", 2024-04-25T22:52:43.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004350217 2024-04-25T22:52:43.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:43.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975343+0000", 2024-04-25T22:52:43.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6687999999999998e-05 2024-04-25T22:52:43.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:43.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975380+0000", 2024-04-25T22:52:43.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6724000000000003e-05 2024-04-25T22:52:43.128 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:43.128 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:43.129 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:43.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.129 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:43.129 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:43.129 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 55.155205928999997, 2024-04-25T22:52:43.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010304384, 2024-04-25T22:52:43.129 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:43.129 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:43.129 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:43.129 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:43.129 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:43.129 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:43.130 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 116 2024-04-25T22:52:43.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.130 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:43.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:43.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:43.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:43.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:43.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:43.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:43.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:43.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:43.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5799999999999999e-07 2024-04-25T22:52:43.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:43.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965154+0000", 2024-04-25T22:52:43.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0009e-05 2024-04-25T22:52:43.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:43.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965164+0000", 2024-04-25T22:52:43.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8490000000000001e-06 2024-04-25T22:52:43.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:43.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965169+0000", 2024-04-25T22:52:43.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0730000000000004e-06 2024-04-25T22:52:43.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:43.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970609+0000", 2024-04-25T22:52:43.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054397689999999997 2024-04-25T22:52:43.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:43.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970651+0000", 2024-04-25T22:52:43.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1873999999999999e-05 2024-04-25T22:52:43.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:43.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970723+0000", 2024-04-25T22:52:43.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2039999999999995e-05 2024-04-25T22:52:43.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:43.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971358+0000", 2024-04-25T22:52:43.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063489500000000001 2024-04-25T22:52:43.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:43.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975409+0000", 2024-04-25T22:52:43.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040506880000000002 2024-04-25T22:52:43.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:43.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975432+0000", 2024-04-25T22:52:43.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3315999999999998e-05 2024-04-25T22:52:43.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:43.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975448+0000", 2024-04-25T22:52:43.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6313000000000001e-05 2024-04-25T22:52:43.134 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:43.134 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:43.135 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:43.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.135 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:43.135 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:43.135 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 55.155171347, 2024-04-25T22:52:43.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010384338999999999, 2024-04-25T22:52:43.135 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:43.135 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:43.135 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:43.135 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:43.135 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:43.135 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:43.136 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-04-25T22:52:43.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.136 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:43.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:43.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:43.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:43.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:43.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:43.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:43.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:43.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:43.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3600000000000004e-07 2024-04-25T22:52:43.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:43.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965185+0000", 2024-04-25T22:52:43.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.117e-06 2024-04-25T22:52:43.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:43.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965192+0000", 2024-04-25T22:52:43.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3239999999999997e-06 2024-04-25T22:52:43.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:43.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965198+0000", 2024-04-25T22:52:43.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6370000000000004e-06 2024-04-25T22:52:43.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:43.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970973+0000", 2024-04-25T22:52:43.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057748239999999996 2024-04-25T22:52:43.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.139 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:43.139 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971049+0000", 2024-04-25T22:52:43.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6029e-05 2024-04-25T22:52:43.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.139 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:43.139 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971174+0000", 2024-04-25T22:52:43.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012462399999999999 2024-04-25T22:52:43.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.139 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:43.139 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971553+0000", 2024-04-25T22:52:43.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037896499999999999 2024-04-25T22:52:43.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:43.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975482+0000", 2024-04-25T22:52:43.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039297459999999996 2024-04-25T22:52:43.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:43.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975529+0000", 2024-04-25T22:52:43.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6387000000000002e-05 2024-04-25T22:52:43.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:43.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975563+0000", 2024-04-25T22:52:43.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4150000000000003e-05 2024-04-25T22:52:43.141 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:43.141 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:43.141 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:43.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.141 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:43.141 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:43.141 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.108125024000003, 2024-04-25T22:52:43.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012637705000000001, 2024-04-25T22:52:43.141 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:43.141 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:43.141 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:43.141 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:43.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:43.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:43.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:43.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:43.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:43.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:43.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:43.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012227+0000", 2024-04-25T22:52:43.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.863e-06 2024-04-25T22:52:43.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.143 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:43.143 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012236+0000", 2024-04-25T22:52:43.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1109999999999997e-06 2024-04-25T22:52:43.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.143 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:43.143 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012309+0000", 2024-04-25T22:52:43.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3242000000000001e-05 2024-04-25T22:52:43.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.143 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:43.143 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012324+0000", 2024-04-25T22:52:43.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4837e-05 2024-04-25T22:52:43.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.144 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:43.144 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015060+0000", 2024-04-25T22:52:43.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027363349999999999 2024-04-25T22:52:43.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.144 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:43.144 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015169+0000", 2024-04-25T22:52:43.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108372 2024-04-25T22:52:43.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.144 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:43.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015498+0000", 2024-04-25T22:52:43.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032949999999999999 2024-04-25T22:52:43.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:43.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021282+0000", 2024-04-25T22:52:43.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057836429999999998 2024-04-25T22:52:43.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:43.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024709+0000", 2024-04-25T22:52:43.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034271979999999998 2024-04-25T22:52:43.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:43.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024802+0000", 2024-04-25T22:52:43.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2960000000000004e-05 2024-04-25T22:52:43.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:43.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024863+0000", 2024-04-25T22:52:43.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0643999999999997e-05 2024-04-25T22:52:43.146 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:43.146 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:43.146 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:43.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.146 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:43.147 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:43.147 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.108001252999998, 2024-04-25T22:52:43.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012979447999999999, 2024-04-25T22:52:43.147 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:43.147 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:43.147 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:43.147 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:43.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:43.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:43.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:43.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.148 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:43.148 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:43.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:43.148 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.148 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:43.148 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:43.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:52:43.148 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.148 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:43.148 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012354+0000", 2024-04-25T22:52:43.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7740000000000004e-06 2024-04-25T22:52:43.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:43.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012365+0000", 2024-04-25T22:52:43.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.064e-05 2024-04-25T22:52:43.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:43.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012382+0000", 2024-04-25T22:52:43.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6999000000000001e-05 2024-04-25T22:52:43.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:43.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015958+0000", 2024-04-25T22:52:43.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035765699999999998 2024-04-25T22:52:43.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:43.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016037+0000", 2024-04-25T22:52:43.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8242000000000001e-05 2024-04-25T22:52:43.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:43.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016404+0000", 2024-04-25T22:52:43.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036784300000000002 2024-04-25T22:52:43.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:43.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021294+0000", 2024-04-25T22:52:43.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048890629999999999 2024-04-25T22:52:43.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:43.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024959+0000", 2024-04-25T22:52:43.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036651570000000001 2024-04-25T22:52:43.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:43.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025097+0000", 2024-04-25T22:52:43.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013788099999999999 2024-04-25T22:52:43.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:43.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025328+0000", 2024-04-25T22:52:43.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231492 2024-04-25T22:52:43.152 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:43.152 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:43.152 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:43.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.152 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:43.152 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:43.153 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.107913484000001, 2024-04-25T22:52:43.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013049827, 2024-04-25T22:52:43.153 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:43.153 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:43.153 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:43.153 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:43.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:43.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:43.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:43.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:43.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:43.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:43.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:43.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012437+0000", 2024-04-25T22:52:43.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-04-25T22:52:43.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:43.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012440+0000", 2024-04-25T22:52:43.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7609999999999999e-06 2024-04-25T22:52:43.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:43.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012449+0000", 2024-04-25T22:52:43.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.285e-06 2024-04-25T22:52:43.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:43.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012457+0000", 2024-04-25T22:52:43.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9510000000000006e-06 2024-04-25T22:52:43.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:43.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017106+0000", 2024-04-25T22:52:43.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046494220000000003 2024-04-25T22:52:43.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:43.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017223+0000", 2024-04-25T22:52:43.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116824 2024-04-25T22:52:43.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:43.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017345+0000", 2024-04-25T22:52:43.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122175 2024-04-25T22:52:43.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:43.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021299+0000", 2024-04-25T22:52:43.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039534879999999998 2024-04-25T22:52:43.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:43.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025398+0000", 2024-04-25T22:52:43.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040988960000000003 2024-04-25T22:52:43.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:43.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025439+0000", 2024-04-25T22:52:43.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0915999999999999e-05 2024-04-25T22:52:43.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:43.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025486+0000", 2024-04-25T22:52:43.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7534999999999998e-05 2024-04-25T22:52:43.158 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:43.158 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:43.158 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:43.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.158 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:43.158 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:43.158 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.107883332999997, 2024-04-25T22:52:43.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020988041999999998, 2024-04-25T22:52:43.159 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:43.159 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:43.159 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:43.159 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:43.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:43.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:43.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:43.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:43.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:43.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:43.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:43.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:43.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.99e-07 2024-04-25T22:52:43.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:43.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012470+0000", 2024-04-25T22:52:43.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2789999999999999e-06 2024-04-25T22:52:43.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:43.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012477+0000", 2024-04-25T22:52:43.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:52:43.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:43.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012500+0000", 2024-04-25T22:52:43.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2490999999999999e-05 2024-04-25T22:52:43.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:43.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021911+0000", 2024-04-25T22:52:43.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094114160000000006 2024-04-25T22:52:43.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:43.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022000+0000", 2024-04-25T22:52:43.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8601000000000001e-05 2024-04-25T22:52:43.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:43.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022359+0000", 2024-04-25T22:52:43.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035921999999999999 2024-04-25T22:52:43.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:43.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025541+0000", 2024-04-25T22:52:43.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031820619999999998 2024-04-25T22:52:43.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:43.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033375+0000", 2024-04-25T22:52:43.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078338379999999992 2024-04-25T22:52:43.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:43.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033415+0000", 2024-04-25T22:52:43.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9527000000000003e-05 2024-04-25T22:52:43.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:43.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033455+0000", 2024-04-25T22:52:43.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9932000000000003e-05 2024-04-25T22:52:43.163 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:43.163 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:43.163 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:43.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.164 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:43.164 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:43.164 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.107828140000002, 2024-04-25T22:52:43.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021043857999999999, 2024-04-25T22:52:43.164 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:43.164 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:43.164 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:43.164 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:43.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:43.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:43.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:43.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:43.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:43.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:43.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:43.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012523+0000", 2024-04-25T22:52:43.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.361e-06 2024-04-25T22:52:43.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:43.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012530+0000", 2024-04-25T22:52:43.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5440000000000004e-06 2024-04-25T22:52:43.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:43.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012541+0000", 2024-04-25T22:52:43.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1745e-05 2024-04-25T22:52:43.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:43.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012551+0000", 2024-04-25T22:52:43.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5789999999999993e-06 2024-04-25T22:52:43.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:43.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022709+0000", 2024-04-25T22:52:43.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010157685 2024-04-25T22:52:43.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:43.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022957+0000", 2024-04-25T22:52:43.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024824599999999998 2024-04-25T22:52:43.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:43.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023443+0000", 2024-04-25T22:52:43.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048578599999999999 2024-04-25T22:52:43.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:43.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025547+0000", 2024-04-25T22:52:43.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021044789999999998 2024-04-25T22:52:43.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:43.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033509+0000", 2024-04-25T22:52:43.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0079622180000000001 2024-04-25T22:52:43.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:43.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033542+0000", 2024-04-25T22:52:43.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3018000000000001e-05 2024-04-25T22:52:43.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:43.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033566+0000", 2024-04-25T22:52:43.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3197000000000002e-05 2024-04-25T22:52:43.170 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:43.170 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:43.170 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:43.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.170 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:43.171 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:43.171 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.107788175000003, 2024-04-25T22:52:43.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021122696, 2024-04-25T22:52:43.171 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:43.171 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:43.171 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:43.171 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:43.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:43.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:43.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:43.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:43.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:43.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:43.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:43.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:43.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:52:43.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:43.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012566+0000", 2024-04-25T22:52:43.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-04-25T22:52:43.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:43.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012619+0000", 2024-04-25T22:52:43.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2607e-05 2024-04-25T22:52:43.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:43.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012628+0000", 2024-04-25T22:52:43.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6500000000000008e-06 2024-04-25T22:52:43.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:43.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024024+0000", 2024-04-25T22:52:43.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011396007999999999 2024-04-25T22:52:43.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:43.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024198+0000", 2024-04-25T22:52:43.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000173215 2024-04-25T22:52:43.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:43.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024447+0000", 2024-04-25T22:52:43.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024898500000000002 2024-04-25T22:52:43.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:43.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026431+0000", 2024-04-25T22:52:43.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001984923 2024-04-25T22:52:43.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:43.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033608+0000", 2024-04-25T22:52:43.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071768459999999997 2024-04-25T22:52:43.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:43.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033646+0000", 2024-04-25T22:52:43.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299000000000003e-05 2024-04-25T22:52:43.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:43.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033684+0000", 2024-04-25T22:52:43.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8773000000000003e-05 2024-04-25T22:52:43.176 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:43.176 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:43.176 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:43.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.176 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:43.176 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:43.176 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.107699576000002, 2024-04-25T22:52:43.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021175381, 2024-04-25T22:52:43.176 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:43.176 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:43.176 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:43.177 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:43.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:43.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:43.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:43.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:43.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:43.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:43.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:43.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012651+0000", 2024-04-25T22:52:43.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:52:43.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:43.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012656+0000", 2024-04-25T22:52:43.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8899999999999998e-06 2024-04-25T22:52:43.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:43.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012666+0000", 2024-04-25T22:52:43.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0346999999999999e-05 2024-04-25T22:52:43.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:43.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012675+0000", 2024-04-25T22:52:43.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9930000000000001e-06 2024-04-25T22:52:43.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:43.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025661+0000", 2024-04-25T22:52:43.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01298531 2024-04-25T22:52:43.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:43.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025757+0000", 2024-04-25T22:52:43.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5822000000000005e-05 2024-04-25T22:52:43.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:43.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025907+0000", 2024-04-25T22:52:43.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015051499999999999 2024-04-25T22:52:43.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:43.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026435+0000", 2024-04-25T22:52:43.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052762200000000005 2024-04-25T22:52:43.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:43.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033732+0000", 2024-04-25T22:52:43.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072978419999999997 2024-04-25T22:52:43.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:43.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033787+0000", 2024-04-25T22:52:43.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4703999999999997e-05 2024-04-25T22:52:43.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:43.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033826+0000", 2024-04-25T22:52:43.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8458999999999999e-05 2024-04-25T22:52:43.181 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:43.181 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:43.181 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:43.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.182 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:43.182 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:43.182 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.107644162, 2024-04-25T22:52:43.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021244174000000001, 2024-04-25T22:52:43.182 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:43.182 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:43.182 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:43.182 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:43.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:43.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:43.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:43.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:43.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:43.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:43.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:43.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:43.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:52:43.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:43.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012712+0000", 2024-04-25T22:52:43.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.913e-06 2024-04-25T22:52:43.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:43.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012722+0000", 2024-04-25T22:52:43.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2879999999999998e-06 2024-04-25T22:52:43.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:43.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012727+0000", 2024-04-25T22:52:43.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8429999999999998e-06 2024-04-25T22:52:43.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:43.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026099+0000", 2024-04-25T22:52:43.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013371450999999999 2024-04-25T22:52:43.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:43.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026147+0000", 2024-04-25T22:52:43.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7837999999999998e-05 2024-04-25T22:52:43.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:43.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026254+0000", 2024-04-25T22:52:43.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107314 2024-04-25T22:52:43.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:43.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026686+0000", 2024-04-25T22:52:43.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000432428 2024-04-25T22:52:43.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:43.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033873+0000", 2024-04-25T22:52:43.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071864399999999997 2024-04-25T22:52:43.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:43.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033904+0000", 2024-04-25T22:52:43.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1321e-05 2024-04-25T22:52:43.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:43.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033950+0000", 2024-04-25T22:52:43.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5707999999999997e-05 2024-04-25T22:52:43.187 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:43.187 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:43.187 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:43.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.188 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:43.188 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:43.188 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.107613776999997, 2024-04-25T22:52:43.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01096505, 2024-04-25T22:52:43.188 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:43.188 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:43.188 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:43.188 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:43.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:43.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:43.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:43.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:43.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:43.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:43.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:43.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012737+0000", 2024-04-25T22:52:43.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:52:43.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:43.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012739+0000", 2024-04-25T22:52:43.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-04-25T22:52:43.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:43.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012743+0000", 2024-04-25T22:52:43.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3239999999999996e-06 2024-04-25T22:52:43.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:43.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012746+0000", 2024-04-25T22:52:43.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.129e-06 2024-04-25T22:52:43.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:43.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012796+0000", 2024-04-25T22:52:43.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9231999999999999e-05 2024-04-25T22:52:43.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:43.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012915+0000", 2024-04-25T22:52:43.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119021 2024-04-25T22:52:43.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:43.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013069+0000", 2024-04-25T22:52:43.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015463900000000001 2024-04-25T22:52:43.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:43.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019237+0000", 2024-04-25T22:52:43.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061680329999999998 2024-04-25T22:52:43.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:43.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023603+0000", 2024-04-25T22:52:43.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043655860000000003 2024-04-25T22:52:43.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:43.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023659+0000", 2024-04-25T22:52:43.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6484000000000003e-05 2024-04-25T22:52:43.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:43.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023701+0000", 2024-04-25T22:52:43.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1761999999999998e-05 2024-04-25T22:52:43.193 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:43.193 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:43.193 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:43.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.193 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:43.193 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:43.193 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.107588829000001, 2024-04-25T22:52:43.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011234429000000001, 2024-04-25T22:52:43.193 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:43.193 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:43.193 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:43.194 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:43.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.194 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:43.194 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:43.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:43.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.194 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:43.194 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:43.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:43.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.194 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:43.194 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012762+0000", 2024-04-25T22:52:43.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-04-25T22:52:43.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:43.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012765+0000", 2024-04-25T22:52:43.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2569999999999999e-06 2024-04-25T22:52:43.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:43.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012783+0000", 2024-04-25T22:52:43.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8431999999999999e-05 2024-04-25T22:52:43.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:43.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012799+0000", 2024-04-25T22:52:43.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5438999999999999e-05 2024-04-25T22:52:43.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:43.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013826+0000", 2024-04-25T22:52:43.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010275060000000001 2024-04-25T22:52:43.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:43.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013913+0000", 2024-04-25T22:52:43.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.708e-05 2024-04-25T22:52:43.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:43.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014098+0000", 2024-04-25T22:52:43.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018519399999999999 2024-04-25T22:52:43.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:43.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019684+0000", 2024-04-25T22:52:43.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055860079999999999 2024-04-25T22:52:43.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:43.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023876+0000", 2024-04-25T22:52:43.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041918800000000003 2024-04-25T22:52:43.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.198 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:43.198 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023957+0000", 2024-04-25T22:52:43.198 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1165e-05 2024-04-25T22:52:43.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.198 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:43.198 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023995+0000", 2024-04-25T22:52:43.198 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:52:43.198 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:43.198 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:43.198 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:43.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.199 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:43.199 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:43.199 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.10749105, 2024-04-25T22:52:43.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011131200000000001, 2024-04-25T22:52:43.199 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:43.199 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:43.199 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:43.199 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:43.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:43.199 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:43.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:43.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.200 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:43.200 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:43.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:43.200 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.200 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.200 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:43.200 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012860+0000", 2024-04-25T22:52:43.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3900000000000004e-07 2024-04-25T22:52:43.200 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.200 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.200 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:43.200 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012865+0000", 2024-04-25T22:52:43.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5609999999999998e-06 2024-04-25T22:52:43.200 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:43.201 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012895+0000", 2024-04-25T22:52:43.201 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9847000000000001e-05 2024-04-25T22:52:43.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:43.201 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012905+0000", 2024-04-25T22:52:43.201 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.03e-05 2024-04-25T22:52:43.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:43.201 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015020+0000", 2024-04-25T22:52:43.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021142940000000001 2024-04-25T22:52:43.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.202 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.202 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:43.202 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015182+0000", 2024-04-25T22:52:43.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016248099999999999 2024-04-25T22:52:43.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.202 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.202 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:52:43.202 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015357+0000", 2024-04-25T22:52:43.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017471000000000001 2024-04-25T22:52:43.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.202 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:43.203 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021021+0000", 2024-04-25T22:52:43.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056638340000000004 2024-04-25T22:52:43.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:43.203 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023712+0000", 2024-04-25T22:52:43.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026910380000000002 2024-04-25T22:52:43.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:43.203 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023763+0000", 2024-04-25T22:52:43.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1477999999999997e-05 2024-04-25T22:52:43.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:43.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023990+0000", 2024-04-25T22:52:43.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000226818 2024-04-25T22:52:43.204 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:43.204 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:43.204 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:43.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.204 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:43.204 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:43.204 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.107367953999997, 2024-04-25T22:52:43.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011705299000000001, 2024-04-25T22:52:43.205 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:43.205 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:43.205 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:43.205 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:43.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:43.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:43.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:43.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:43.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:43.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:43.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:43.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012983+0000", 2024-04-25T22:52:43.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:52:43.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:43.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012986+0000", 2024-04-25T22:52:43.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5700000000000001e-06 2024-04-25T22:52:43.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:43.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012993+0000", 2024-04-25T22:52:43.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8730000000000001e-06 2024-04-25T22:52:43.207 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.207 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:43.207 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013000+0000", 2024-04-25T22:52:43.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1890000000000001e-06 2024-04-25T22:52:43.207 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.207 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:43.207 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:52:43.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002147866 2024-04-25T22:52:43.207 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.207 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:43.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015351+0000", 2024-04-25T22:52:43.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020300799999999999 2024-04-25T22:52:43.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:43.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016260+0000", 2024-04-25T22:52:43.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00090926799999999997 2024-04-25T22:52:43.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:43.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022669+0000", 2024-04-25T22:52:43.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064082849999999997 2024-04-25T22:52:43.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:43.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024584+0000", 2024-04-25T22:52:43.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019151699999999999 2024-04-25T22:52:43.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:43.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024643+0000", 2024-04-25T22:52:43.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8888999999999998e-05 2024-04-25T22:52:43.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:43.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024687+0000", 2024-04-25T22:52:43.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4444999999999999e-05 2024-04-25T22:52:43.210 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:43.210 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:43.210 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:43.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.210 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:43.210 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:43.210 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.107340362999999, 2024-04-25T22:52:43.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011249699, 2024-04-25T22:52:43.210 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:43.210 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:43.210 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:43.210 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:43.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:43.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:43.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:43.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:43.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:43.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:43.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:43.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013010+0000", 2024-04-25T22:52:43.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2099999999999996e-07 2024-04-25T22:52:43.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:43.212 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013013+0000", 2024-04-25T22:52:43.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1310000000000002e-06 2024-04-25T22:52:43.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:43.212 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013020+0000", 2024-04-25T22:52:43.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3330000000000002e-06 2024-04-25T22:52:43.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:43.212 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013025+0000", 2024-04-25T22:52:43.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6760000000000004e-06 2024-04-25T22:52:43.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.213 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:43.213 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013163+0000", 2024-04-25T22:52:43.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013824599999999999 2024-04-25T22:52:43.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.213 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:43.213 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013504+0000", 2024-04-25T22:52:43.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034080299999999998 2024-04-25T22:52:43.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.213 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:43.213 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013613+0000", 2024-04-25T22:52:43.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108705 2024-04-25T22:52:43.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:43.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015831+0000", 2024-04-25T22:52:43.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002217672 2024-04-25T22:52:43.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:43.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024137+0000", 2024-04-25T22:52:43.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0083060489999999994 2024-04-25T22:52:43.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:43.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024218+0000", 2024-04-25T22:52:43.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1351000000000001e-05 2024-04-25T22:52:43.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:43.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024259+0000", 2024-04-25T22:52:43.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1112000000000002e-05 2024-04-25T22:52:43.215 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:43.215 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:43.215 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:43.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.215 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:43.216 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:43.216 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.107252637000002, 2024-04-25T22:52:43.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020379749999999999, 2024-04-25T22:52:43.216 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:43.216 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:43.216 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:43.216 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:43.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.216 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:43.216 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:43.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:43.216 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:43.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:43.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:43.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:43.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013098+0000", 2024-04-25T22:52:43.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:52:43.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:43.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013105+0000", 2024-04-25T22:52:43.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5969999999999997e-06 2024-04-25T22:52:43.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:43.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013190+0000", 2024-04-25T22:52:43.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5618999999999995e-05 2024-04-25T22:52:43.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:43.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013200+0000", 2024-04-25T22:52:43.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5859999999999994e-06 2024-04-25T22:52:43.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:43.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020265+0000", 2024-04-25T22:52:43.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070653349999999998 2024-04-25T22:52:43.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:43.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020454+0000", 2024-04-25T22:52:43.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189316 2024-04-25T22:52:43.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:43.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020586+0000", 2024-04-25T22:52:43.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013195700000000001 2024-04-25T22:52:43.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:43.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023822+0000", 2024-04-25T22:52:43.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032358529999999999 2024-04-25T22:52:43.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:43.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033409+0000", 2024-04-25T22:52:43.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095870520000000004 2024-04-25T22:52:43.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:43.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033447+0000", 2024-04-25T22:52:43.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7261999999999997e-05 2024-04-25T22:52:43.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:43.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033477+0000", 2024-04-25T22:52:43.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0389e-05 2024-04-25T22:52:43.221 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:43.221 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:43.221 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:43.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.221 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:43.221 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:43.221 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.107136130999997, 2024-04-25T22:52:43.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010857383999999999, 2024-04-25T22:52:43.221 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:43.222 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:43.222 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:43.222 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:43.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:43.222 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:43.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:43.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:43.222 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:43.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:43.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:43.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:43.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:52:43.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:43.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013218+0000", 2024-04-25T22:52:43.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8199999999999998e-06 2024-04-25T22:52:43.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:43.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013226+0000", 2024-04-25T22:52:43.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7649999999999993e-06 2024-04-25T22:52:43.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:43.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013259+0000", 2024-04-25T22:52:43.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2727e-05 2024-04-25T22:52:43.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:43.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014809+0000", 2024-04-25T22:52:43.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001550144 2024-04-25T22:52:43.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:43.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014958+0000", 2024-04-25T22:52:43.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014890300000000001 2024-04-25T22:52:43.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:52:43.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015087+0000", 2024-04-25T22:52:43.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012939200000000001 2024-04-25T22:52:43.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:43.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020212+0000", 2024-04-25T22:52:43.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051248939999999996 2024-04-25T22:52:43.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:43.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023699+0000", 2024-04-25T22:52:43.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034873289999999999 2024-04-25T22:52:43.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:43.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024014+0000", 2024-04-25T22:52:43.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031473999999999999 2024-04-25T22:52:43.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:43.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024071+0000", 2024-04-25T22:52:43.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7040000000000003e-05 2024-04-25T22:52:43.227 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:43.227 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:43.227 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:43.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.227 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:43.227 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:43.227 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.107081426000001, 2024-04-25T22:52:43.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012329677000000001, 2024-04-25T22:52:43.227 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:43.227 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:43.228 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:43.228 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:43.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.228 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:43.228 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:43.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:43.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.228 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:43.228 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:43.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:43.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.228 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:43.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013269+0000", 2024-04-25T22:52:43.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5000000000000002e-07 2024-04-25T22:52:43.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:43.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:52:43.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6909999999999999e-06 2024-04-25T22:52:43.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:43.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013284+0000", 2024-04-25T22:52:43.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0963e-05 2024-04-25T22:52:43.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:43.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013361+0000", 2024-04-25T22:52:43.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7379999999999994e-05 2024-04-25T22:52:43.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:43.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013448+0000", 2024-04-25T22:52:43.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6990000000000006e-05 2024-04-25T22:52:43.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:43.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013632+0000", 2024-04-25T22:52:43.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018396800000000001 2024-04-25T22:52:43.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:43.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013800+0000", 2024-04-25T22:52:43.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167467 2024-04-25T22:52:43.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:43.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.018570+0000", 2024-04-25T22:52:43.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047701460000000003 2024-04-25T22:52:43.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:43.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025507+0000", 2024-04-25T22:52:43.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069372039999999998 2024-04-25T22:52:43.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:43.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025562+0000", 2024-04-25T22:52:43.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4858999999999998e-05 2024-04-25T22:52:43.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:43.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025598+0000", 2024-04-25T22:52:43.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6259e-05 2024-04-25T22:52:43.233 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:43.233 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:43.233 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:43.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.233 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:43.233 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:43.233 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.106949553, 2024-04-25T22:52:43.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020176666999999999, 2024-04-25T22:52:43.233 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:43.233 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:43.233 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:52:43.234 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:43.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:43.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:43.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:43.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:43.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:43.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:43.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:43.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:52:43.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-04-25T22:52:43.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:43.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013405+0000", 2024-04-25T22:52:43.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0559999999999998e-06 2024-04-25T22:52:43.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:43.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013422+0000", 2024-04-25T22:52:43.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6770999999999999e-05 2024-04-25T22:52:43.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:43.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013431+0000", 2024-04-25T22:52:43.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5019999999999998e-06 2024-04-25T22:52:43.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:43.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021720+0000", 2024-04-25T22:52:43.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082884340000000008 2024-04-25T22:52:43.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:43.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022122+0000", 2024-04-25T22:52:43.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000401634 2024-04-25T22:52:43.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:43.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:43.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:43.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033577+0000", 2024-04-25T22:52:43.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011455435999999999 2024-04-25T22:52:43.237 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:43.237 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:43.237 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:43.237 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:43.237 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:43.237 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:43.239 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:52:43.239 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:43.237+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:43.339 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-04-25T22:52:43.340 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:43.339+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:43.345 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:43.345 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:52:43.345 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-25T22:52:43.345 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:43.355 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:52:43.441 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:43.440+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:43.458 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:43.458 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:52:43.458 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-25T22:52:43.458 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-25T22:52:43.458 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:43.467 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:52:43.542 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:43.541+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:43.611 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:43.611 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:52:43.611 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:52:43.611 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:52:43.611 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.612 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:52:43.612 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:52:43.612 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 55.642307631999998, 2024-04-25T22:52:43.612 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:52:43.612 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:43.612 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:43.612 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:43.612 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:43.612 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.612 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:43.612 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:52:43.612 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:43.612 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.613 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.613 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:43.613 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:52:43.613 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:43.613 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.613 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.613 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:43.613 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:52:43.613 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:52:43.613 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.613 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.613 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:43.613 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:52:43.613 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:52:43.614 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.614 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.614 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:43.614 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:52:43.614 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:52:43.614 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.614 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.614 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:43.614 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:52:43.614 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:52:43.614 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.614 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.614 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:43.615 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:52:43.615 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:52:43.615 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.615 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.615 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:43.615 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:52:43.615 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:52:43.615 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.615 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.615 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:43.615 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:52:43.615 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:52:43.616 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.616 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.616 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:43.616 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:52:43.616 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:52:43.616 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:43.616 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:43.616 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:43.616 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.616 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.616 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:110 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'72, mlcod=10'68)", 2024-04-25T22:52:43.616 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:43.616 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 55.641673632, 2024-04-25T22:52:43.617 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065316630000000001, 2024-04-25T22:52:43.617 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:43.617 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:43.617 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:43.617 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:43.617 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.617 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:43.617 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:43.617 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:43.617 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.617 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.617 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:43.617 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:43.617 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:43.618 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.618 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.618 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:43.618 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:43.618 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.58e-07 2024-04-25T22:52:43.618 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.618 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.618 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:43.618 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967811+0000", 2024-04-25T22:52:43.618 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.118e-06 2024-04-25T22:52:43.618 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.618 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.618 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:43.619 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967817+0000", 2024-04-25T22:52:43.619 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3709999999999996e-06 2024-04-25T22:52:43.619 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.619 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.619 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:43.619 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967820+0000", 2024-04-25T22:52:43.619 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2210000000000002e-06 2024-04-25T22:52:43.619 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.619 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.619 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:43.619 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967876+0000", 2024-04-25T22:52:43.619 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5507000000000002e-05 2024-04-25T22:52:43.619 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.620 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.620 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:43.620 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967893+0000", 2024-04-25T22:52:43.620 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7812000000000002e-05 2024-04-25T22:52:43.620 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.620 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.620 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:43.620 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974317+0000", 2024-04-25T22:52:43.620 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064237160000000003 2024-04-25T22:52:43.620 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.620 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.620 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:43.620 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:52:43.620 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.156e-05 2024-04-25T22:52:43.621 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:43.621 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:43.621 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:43.621 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.621 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.621 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'68)", 2024-04-25T22:52:43.621 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:43.621 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 55.641256118999998, 2024-04-25T22:52:43.621 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061292279999999996, 2024-04-25T22:52:43.621 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:43.621 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:43.621 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:43.621 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:43.621 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.622 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:43.622 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:43.622 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:43.622 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.622 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.622 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:43.622 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:43.622 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:43.622 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.622 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.622 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:43.622 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:43.622 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6300000000000001e-07 2024-04-25T22:52:43.622 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.623 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.623 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:43.623 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968228+0000", 2024-04-25T22:52:43.623 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6139999999999999e-06 2024-04-25T22:52:43.623 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.623 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.623 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:43.623 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968235+0000", 2024-04-25T22:52:43.623 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7020000000000001e-06 2024-04-25T22:52:43.623 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.623 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.623 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:43.623 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968238+0000", 2024-04-25T22:52:43.623 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0010000000000002e-06 2024-04-25T22:52:43.624 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.624 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.624 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:43.624 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968297+0000", 2024-04-25T22:52:43.624 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8424999999999997e-05 2024-04-25T22:52:43.624 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.624 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.624 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:43.624 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968316+0000", 2024-04-25T22:52:43.624 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8814999999999999e-05 2024-04-25T22:52:43.624 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.624 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.624 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:43.625 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:52:43.625 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060239439999999998 2024-04-25T22:52:43.625 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.625 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.625 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:43.625 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974354+0000", 2024-04-25T22:52:43.625 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4364e-05 2024-04-25T22:52:43.625 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:43.625 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:43.625 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:43.625 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.625 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.625 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'68)", 2024-04-25T22:52:43.625 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:43.625 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 55.640819116999999, 2024-04-25T22:52:43.626 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005948414, 2024-04-25T22:52:43.626 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:43.626 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:43.626 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:43.626 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:43.626 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.626 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:43.626 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:43.626 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:43.626 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.626 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.626 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:43.626 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:43.627 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:43.627 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.627 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.627 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:43.627 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:43.627 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6199999999999998e-07 2024-04-25T22:52:43.627 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.627 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.627 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:43.627 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968723+0000", 2024-04-25T22:52:43.627 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1148999999999993e-05 2024-04-25T22:52:43.627 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.627 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.628 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:43.628 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968730+0000", 2024-04-25T22:52:43.628 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1749999999999999e-06 2024-04-25T22:52:43.628 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.628 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.628 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:43.628 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968734+0000", 2024-04-25T22:52:43.628 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5200000000000002e-06 2024-04-25T22:52:43.628 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.628 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.628 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:43.628 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968771+0000", 2024-04-25T22:52:43.628 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6851999999999999e-05 2024-04-25T22:52:43.629 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.629 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.629 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:43.629 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968788+0000", 2024-04-25T22:52:43.629 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7027000000000001e-05 2024-04-25T22:52:43.629 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.629 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.629 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:43.629 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974589+0000", 2024-04-25T22:52:43.629 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058013320000000002 2024-04-25T22:52:43.629 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.629 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.629 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:43.630 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974610+0000", 2024-04-25T22:52:43.630 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0897e-05 2024-04-25T22:52:43.630 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:43.630 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:43.630 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:43.630 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.630 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.630 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'68)", 2024-04-25T22:52:43.630 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:43.630 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 55.640249107000002, 2024-04-25T22:52:43.630 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053935750000000003, 2024-04-25T22:52:43.630 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:43.630 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:43.630 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:43.631 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:43.631 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.631 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:43.631 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:43.631 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:43.631 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.631 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.631 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:43.631 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:43.631 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:43.631 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.631 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.631 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:43.631 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:43.632 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.03e-07 2024-04-25T22:52:43.632 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.632 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.632 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:43.632 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969235+0000", 2024-04-25T22:52:43.632 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2399999999999999e-06 2024-04-25T22:52:43.632 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.632 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.632 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:43.632 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969242+0000", 2024-04-25T22:52:43.632 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1269999999999997e-06 2024-04-25T22:52:43.632 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.632 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.632 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:43.633 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969246+0000", 2024-04-25T22:52:43.633 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3840000000000001e-06 2024-04-25T22:52:43.633 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.633 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.633 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:43.633 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969278+0000", 2024-04-25T22:52:43.633 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1868e-05 2024-04-25T22:52:43.633 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.633 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.633 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:43.633 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969295+0000", 2024-04-25T22:52:43.633 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7530999999999999e-05 2024-04-25T22:52:43.633 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.634 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.634 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:43.634 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974611+0000", 2024-04-25T22:52:43.634 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053160789999999996 2024-04-25T22:52:43.634 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.634 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.634 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:43.634 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974625+0000", 2024-04-25T22:52:43.634 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3943e-05 2024-04-25T22:52:43.634 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:43.634 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:43.634 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:43.634 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.635 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.635 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-25T22:52:43.635 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:43.635 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 55.446653198999996, 2024-04-25T22:52:43.635 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054952610000000004, 2024-04-25T22:52:43.635 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:43.635 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:43.635 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:43.635 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:43.635 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.635 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:43.635 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:43.635 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:43.635 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.635 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.636 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:43.636 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:43.636 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:43.636 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.636 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.636 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:43.636 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:43.636 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.68e-07 2024-04-25T22:52:43.636 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.636 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.636 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:43.636 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162898+0000", 2024-04-25T22:52:43.636 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9470999999999999e-05 2024-04-25T22:52:43.636 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.636 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.636 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:43.637 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162906+0000", 2024-04-25T22:52:43.637 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1580000000000005e-06 2024-04-25T22:52:43.637 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.637 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.637 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:43.637 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162911+0000", 2024-04-25T22:52:43.637 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4779999999999999e-06 2024-04-25T22:52:43.637 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.637 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.637 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:43.637 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162952+0000", 2024-04-25T22:52:43.637 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0629e-05 2024-04-25T22:52:43.637 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.637 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.637 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:43.638 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162968+0000", 2024-04-25T22:52:43.638 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6239000000000002e-05 2024-04-25T22:52:43.638 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.638 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.638 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:43.638 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168281+0000", 2024-04-25T22:52:43.638 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053132869999999999 2024-04-25T22:52:43.638 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.638 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.638 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:43.638 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168323+0000", 2024-04-25T22:52:43.638 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1430999999999997e-05 2024-04-25T22:52:43.638 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:43.639 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:43.639 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:43.639 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.639 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.639 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-04-25T22:52:43.639 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:43.639 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 55.016175836999999, 2024-04-25T22:52:43.639 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050872510000000001, 2024-04-25T22:52:43.639 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:43.639 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:43.639 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:43.639 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:43.639 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.640 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:43.640 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:43.640 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:43.640 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.640 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.640 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:43.640 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:43.640 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:43.640 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.640 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.640 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:43.641 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:43.641 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.72e-07 2024-04-25T22:52:43.641 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.641 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.641 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:43.641 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593381+0000", 2024-04-25T22:52:43.641 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5797000000000006e-05 2024-04-25T22:52:43.641 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.641 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.641 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:43.641 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593389+0000", 2024-04-25T22:52:43.641 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8480000000000001e-06 2024-04-25T22:52:43.641 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.642 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.642 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:43.642 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593393+0000", 2024-04-25T22:52:43.642 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4819999999999996e-06 2024-04-25T22:52:43.642 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.642 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.642 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:43.642 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593435+0000", 2024-04-25T22:52:43.642 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1600000000000002e-05 2024-04-25T22:52:43.642 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.642 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.642 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:43.642 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593454+0000", 2024-04-25T22:52:43.643 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8868e-05 2024-04-25T22:52:43.643 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.643 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.643 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:43.643 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598350+0000", 2024-04-25T22:52:43.643 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004895763 2024-04-25T22:52:43.643 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.643 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.643 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:43.643 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598392+0000", 2024-04-25T22:52:43.643 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2521000000000002e-05 2024-04-25T22:52:43.643 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:43.643 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:43.643 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:43.643 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.644 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.644 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:43.644 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:52:43.644 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 50.597811933000003, 2024-04-25T22:52:43.644 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:52:43.644 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:43.644 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:43.644 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:43.644 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:43.644 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.644 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:43.644 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:52:43.644 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:43.644 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.644 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.645 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:43.645 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:52:43.645 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:43.645 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.645 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.645 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:43.645 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:52:43.645 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:52:43.645 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.645 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.645 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:43.645 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:52:43.645 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:52:43.645 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.646 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.646 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:43.646 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:52:43.646 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:52:43.646 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.646 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.646 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:43.646 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:52:43.646 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:52:43.646 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.646 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.646 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:43.646 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:52:43.647 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:52:43.647 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.647 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.647 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:43.647 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:52:43.647 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:52:43.647 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.647 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.647 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:43.647 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:52:43.647 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:52:43.647 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.647 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.647 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:43.648 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:52:43.648 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:52:43.648 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.648 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.648 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:43.648 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:52:43.648 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:52:43.648 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.648 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.648 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:43.648 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:52:43.648 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:52:43.648 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.648 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.648 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:43.649 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:52:43.649 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:52:43.649 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:43.649 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:43.649 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:43.649 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.649 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.649 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:43.649 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:52:43.649 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 50.597137557000003, 2024-04-25T22:52:43.649 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:52:43.649 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:43.649 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:43.650 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:43.650 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:43.650 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.650 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:43.650 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:52:43.650 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:43.650 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.650 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.650 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:43.650 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:52:43.650 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:43.650 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.650 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.650 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:43.651 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:52:43.651 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:52:43.651 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.651 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.651 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:43.651 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:52:43.651 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:52:43.651 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.651 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.651 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:43.651 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:52:43.651 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:52:43.651 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.651 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.651 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:43.651 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:52:43.652 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:52:43.652 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.652 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.652 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:43.652 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:52:43.652 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:52:43.652 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.652 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.652 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:43.652 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:52:43.652 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:52:43.652 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.652 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.652 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:43.653 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:52:43.653 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:52:43.653 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.653 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.653 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:43.653 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:52:43.653 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:52:43.653 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.653 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.653 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:43.653 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:52:43.653 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:52:43.654 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.654 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.654 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:43.654 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:52:43.654 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:52:43.654 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.654 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.654 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:43.654 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:52:43.654 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:52:43.654 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:43.654 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:43.654 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:43.655 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.655 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.655 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:43.655 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:52:43.655 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 50.596628344999999, 2024-04-25T22:52:43.655 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:52:43.655 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:43.655 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:43.655 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:43.655 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:43.655 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.655 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:43.655 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:52:43.655 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:43.656 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.656 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.656 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:43.656 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:52:43.656 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:43.656 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.656 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.656 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:43.656 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:52:43.656 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:52:43.656 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.656 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.656 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:43.656 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:52:43.657 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:52:43.657 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.657 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.657 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:43.657 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:52:43.657 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:52:43.657 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.657 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.657 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:43.657 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:52:43.657 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:52:43.657 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.657 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.658 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:43.658 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:52:43.658 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:52:43.658 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.658 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.658 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:43.658 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:52:43.658 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:52:43.658 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.658 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.658 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:43.658 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:52:43.658 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:52:43.659 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.659 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.659 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:43.659 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:52:43.659 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:52:43.659 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.659 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.659 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:43.659 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:52:43.659 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:52:43.659 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.659 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.659 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:43.659 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:52:43.660 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:52:43.660 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.660 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.660 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:43.660 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:52:43.660 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:52:43.660 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:43.660 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:43.660 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:43.660 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.660 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.660 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:43.660 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:43.661 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 50.596215147000002, 2024-04-25T22:52:43.661 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:52:43.661 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:43.661 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:43.661 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:43.661 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:43.661 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.661 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:43.661 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:43.661 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:43.661 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.661 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.661 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:43.661 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:43.661 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:43.662 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.662 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.662 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:43.662 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:43.662 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:52:43.662 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.662 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.662 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:43.662 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:52:43.662 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:52:43.662 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.662 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.662 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:43.663 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:52:43.663 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:52:43.663 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.663 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.663 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:43.663 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:52:43.663 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:52:43.663 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.663 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.663 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:43.663 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:52:43.663 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:52:43.663 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.664 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.664 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:43.664 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:52:43.664 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:52:43.664 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.664 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.664 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:43.664 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:52:43.664 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:52:43.664 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.664 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.664 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:43.664 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:52:43.664 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:52:43.665 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.665 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.665 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:43.665 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:52:43.665 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:52:43.665 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.665 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.665 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:43.665 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:52:43.665 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:52:43.665 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.665 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.665 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:43.665 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:52:43.665 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:52:43.666 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:43.666 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:43.666 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:43.666 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.666 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.666 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:43.666 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:52:43.666 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 50.596164477000002, 2024-04-25T22:52:43.666 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:52:43.666 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:43.666 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:43.666 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:43.666 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:43.667 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.667 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:43.667 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:52:43.667 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:43.667 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.667 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.667 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:43.667 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:52:43.667 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:43.667 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.667 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.667 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:43.667 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:52:43.667 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:52:43.668 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.668 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.668 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:43.668 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:52:43.668 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:52:43.668 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.668 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.668 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:43.668 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:52:43.668 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:52:43.668 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.668 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.668 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:43.669 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:52:43.669 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:52:43.669 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.669 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.669 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:43.669 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:52:43.669 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:52:43.669 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.669 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.669 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:52:43.669 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:52:43.669 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:52:43.669 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.669 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.670 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:43.670 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:52:43.670 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:52:43.670 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.670 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.670 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:43.670 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:52:43.670 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:52:43.670 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.670 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.670 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:43.670 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:52:43.670 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:52:43.670 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.671 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.671 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:43.671 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:52:43.671 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:52:43.671 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.671 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.671 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:43.671 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:52:43.671 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:52:43.671 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.671 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.672 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:43.672 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:52:43.672 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:52:43.672 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.672 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.672 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:43.672 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:52:43.672 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:52:43.672 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:43.672 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:43.672 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:43.672 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.672 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.673 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:43.673 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:52:43.673 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 50.596127608000003, 2024-04-25T22:52:43.673 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:52:43.673 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:43.673 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:43.673 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:43.673 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:43.673 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.673 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:43.673 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:52:43.673 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:43.673 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.673 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.674 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:43.674 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:52:43.674 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:43.674 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.674 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.674 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:43.674 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:52:43.674 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:52:43.674 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.674 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.674 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:43.674 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:52:43.674 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:52:43.675 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.675 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.675 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:43.675 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:52:43.675 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:52:43.675 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.675 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.675 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:43.675 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:52:43.675 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:52:43.675 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.675 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.675 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:43.675 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:52:43.675 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:52:43.675 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.676 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.676 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:52:43.676 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:52:43.676 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:52:43.676 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.676 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.676 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:43.676 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:52:43.676 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:52:43.676 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.676 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.676 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:43.676 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:52:43.676 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:52:43.677 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.677 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.677 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:43.677 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:52:43.677 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:52:43.677 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.677 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.677 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:43.677 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:52:43.677 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:52:43.677 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.677 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.677 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:43.678 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:52:43.678 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:52:43.678 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.678 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.678 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:43.678 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:52:43.678 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:52:43.678 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.678 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.678 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:43.678 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:52:43.678 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:52:43.678 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:43.678 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:43.679 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:43.679 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.679 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.679 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:43.679 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:52:43.679 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 50.596102641999998, 2024-04-25T22:52:43.679 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:52:43.679 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:43.679 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:43.679 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:43.679 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:43.679 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.679 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:43.680 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:52:43.680 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:43.680 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.680 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.680 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:43.680 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:52:43.680 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:43.680 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.680 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.680 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:43.680 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:52:43.680 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:52:43.680 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.681 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.681 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:43.681 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:52:43.681 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:52:43.681 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.681 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.681 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:43.681 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:52:43.681 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:52:43.681 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.681 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.681 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:43.681 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:52:43.681 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:52:43.681 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.682 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.682 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:43.682 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:52:43.682 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:52:43.682 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.682 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.682 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:43.682 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:52:43.682 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:52:43.682 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.682 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.682 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:43.683 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:52:43.683 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:52:43.683 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.683 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.683 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:43.683 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:52:43.683 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:52:43.683 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.683 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.683 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:43.683 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:52:43.683 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:52:43.683 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.683 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.684 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:43.684 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:52:43.684 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:52:43.684 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.684 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.684 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:43.684 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:52:43.684 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:52:43.684 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:43.684 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:43.684 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:43.684 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.684 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.684 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:43.685 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:52:43.685 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 50.596066278000002, 2024-04-25T22:52:43.685 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:52:43.685 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:43.685 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:43.685 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:52:43.685 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:43.685 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.685 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:43.685 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:52:43.685 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:43.685 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.685 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.685 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:43.686 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:52:43.686 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:43.686 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.686 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.686 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:43.686 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:52:43.686 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:52:43.686 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.686 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.686 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:43.686 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:52:43.686 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:52:43.686 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.687 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.687 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:43.687 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:52:43.687 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:52:43.687 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.687 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.687 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:43.687 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:52:43.687 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:52:43.687 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.687 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.687 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:43.687 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:52:43.688 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:52:43.688 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.688 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.688 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:52:43.688 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:52:43.688 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:52:43.688 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.688 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.688 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:43.688 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:52:43.688 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:52:43.688 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.688 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.689 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:43.689 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:52:43.689 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:52:43.689 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.689 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.689 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:43.689 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:52:43.689 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:52:43.689 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:43.689 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:43.689 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:43.689 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.689 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.689 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:43.689 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:43.690 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 50.596035196999999, 2024-04-25T22:52:43.690 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:52:43.690 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:43.690 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:43.690 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:52:43.690 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:43.690 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.690 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:43.690 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:43.690 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:43.690 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.690 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.690 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:43.690 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:43.691 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:43.691 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.691 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.691 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:43.691 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:43.691 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:52:43.691 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.691 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.691 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:43.691 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:52:43.691 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:52:43.691 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.691 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.691 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:43.692 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:52:43.692 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:52:43.692 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.692 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.692 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:43.692 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:52:43.692 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:52:43.692 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.692 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.692 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:43.692 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:52:43.692 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:52:43.692 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.692 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.692 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:43.693 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:52:43.693 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:52:43.693 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.693 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.693 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:43.693 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:52:43.693 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:52:43.693 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:43.693 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:43.693 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:43.693 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.693 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.693 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:52:43.693 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:43.693 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 50.595594228000003, 2024-04-25T22:52:43.694 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064881979999999997, 2024-04-25T22:52:43.694 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:43.694 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:43.694 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:43.694 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:43.694 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.694 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:43.694 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:43.694 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:43.694 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.694 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.694 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:43.694 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:43.695 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:43.695 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.695 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.695 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:43.695 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:43.695 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2699999999999999e-07 2024-04-25T22:52:43.695 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.695 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.695 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:43.695 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013898+0000", 2024-04-25T22:52:43.695 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0796e-05 2024-04-25T22:52:43.695 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.695 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.695 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:43.696 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013907+0000", 2024-04-25T22:52:43.696 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5140000000000007e-06 2024-04-25T22:52:43.696 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.696 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.696 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:43.696 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013952+0000", 2024-04-25T22:52:43.696 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4134000000000001e-05 2024-04-25T22:52:43.696 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.696 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.696 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:43.696 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016812+0000", 2024-04-25T22:52:43.696 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028601059999999998 2024-04-25T22:52:43.696 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.696 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.697 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:43.697 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.017052+0000", 2024-04-25T22:52:43.697 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024056500000000001 2024-04-25T22:52:43.697 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.697 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.697 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:43.697 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020350+0000", 2024-04-25T22:52:43.697 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032978320000000001 2024-04-25T22:52:43.697 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.697 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.697 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:43.697 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020375+0000", 2024-04-25T22:52:43.697 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4624e-05 2024-04-25T22:52:43.698 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:43.698 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:43.698 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:43.698 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.698 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.698 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-25T22:52:43.698 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:43.698 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 50.582063781999999, 2024-04-25T22:52:43.698 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058583000000000003, 2024-04-25T22:52:43.698 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:43.698 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:43.698 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:43.698 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:43.699 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.699 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:43.699 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:43.699 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:43.699 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.699 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.699 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:43.699 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:43.699 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:43.699 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.699 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.699 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:43.699 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:43.700 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.41e-07 2024-04-25T22:52:43.700 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.700 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.700 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:43.700 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027428+0000", 2024-04-25T22:52:43.700 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.075e-05 2024-04-25T22:52:43.700 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.700 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.700 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:43.700 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027435+0000", 2024-04-25T22:52:43.700 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3610000000000003e-06 2024-04-25T22:52:43.700 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.700 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.700 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:43.701 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027442+0000", 2024-04-25T22:52:43.701 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0400000000000004e-06 2024-04-25T22:52:43.701 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.701 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.701 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:43.701 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028094+0000", 2024-04-25T22:52:43.701 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00065134800000000005 2024-04-25T22:52:43.701 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.701 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.701 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:43.701 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028107+0000", 2024-04-25T22:52:43.701 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3087e-05 2024-04-25T22:52:43.701 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.701 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.702 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:43.702 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033239+0000", 2024-04-25T22:52:43.702 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051319429999999999 2024-04-25T22:52:43.702 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.702 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.702 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:43.702 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033275+0000", 2024-04-25T22:52:43.702 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6430000000000002e-05 2024-04-25T22:52:43.702 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:43.702 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:43.702 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:43.702 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.702 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.703 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-25T22:52:43.703 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:43.703 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 50.581678945, 2024-04-25T22:52:43.703 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005413597, 2024-04-25T22:52:43.703 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:43.703 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:43.703 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:43.703 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:43.703 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.703 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:43.703 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:43.703 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:43.703 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.703 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.704 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:43.704 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:43.704 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:43.704 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.704 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.704 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:43.704 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:43.704 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3799999999999997e-07 2024-04-25T22:52:43.704 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.704 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.704 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:43.704 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027816+0000", 2024-04-25T22:52:43.704 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3230999999999999e-05 2024-04-25T22:52:43.705 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.705 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.705 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:43.705 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027823+0000", 2024-04-25T22:52:43.705 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9039999999999992e-06 2024-04-25T22:52:43.705 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.705 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.705 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:43.705 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027841+0000", 2024-04-25T22:52:43.705 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7651000000000001e-05 2024-04-25T22:52:43.705 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.705 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.705 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:43.706 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027904+0000", 2024-04-25T22:52:43.706 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3058000000000005e-05 2024-04-25T22:52:43.706 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.706 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.706 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:43.706 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027926+0000", 2024-04-25T22:52:43.706 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1450999999999998e-05 2024-04-25T22:52:43.706 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.706 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.706 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:43.706 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033177+0000", 2024-04-25T22:52:43.706 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052508909999999997 2024-04-25T22:52:43.707 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.707 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.707 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:43.707 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033215+0000", 2024-04-25T22:52:43.707 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8872999999999999e-05 2024-04-25T22:52:43.707 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:43.707 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:43.707 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:43.707 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.707 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.707 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 171 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:52:43.707 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:43.707 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 50.581621843000001, 2024-04-25T22:52:43.707 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054322240000000003, 2024-04-25T22:52:43.708 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:43.708 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:43.708 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "reached pg", 2024-04-25T22:52:43.708 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:43.708 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.708 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:43.708 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:43.708 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:43.708 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.708 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.708 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:43.708 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:43.708 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:43.708 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.709 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.709 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:43.709 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:43.709 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7500000000000001e-07 2024-04-25T22:52:43.709 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.709 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.709 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:43.709 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027868+0000", 2024-04-25T22:52:43.709 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5750000000000001e-06 2024-04-25T22:52:43.709 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.709 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.709 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:43.709 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027885+0000", 2024-04-25T22:52:43.710 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7272e-05 2024-04-25T22:52:43.710 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.710 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.710 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:43.710 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027900+0000", 2024-04-25T22:52:43.710 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.502e-05 2024-04-25T22:52:43.710 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.710 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.710 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:43.710 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028381+0000", 2024-04-25T22:52:43.710 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00048039399999999998 2024-04-25T22:52:43.710 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:43.710 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:43.711 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:43.711 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033291+0000", 2024-04-25T22:52:43.711 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049105879999999996 2024-04-25T22:52:43.711 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:43.711 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:43.711 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:43.711 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:43.711 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:43.711 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:43.713 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:52:43.713 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:43.712+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:43.814 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:43.813+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:43.825 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:43.825 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:52:43.825 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-04-25T22:52:43.825 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:43.834 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:52:43.915 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:43.914+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:43.977 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:43.977 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:52:43.977 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:52:43.977 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:52:43.977 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:43.986 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:52:44.016 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:44.016+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:44.090 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:44.090 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-04-25T22:52:44.090 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-04-25T22:52:44.090 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:52:44.090 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.090 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:44.090 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:44.091 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 56.123148426, 2024-04-25T22:52:44.091 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0103421, 2024-04-25T22:52:44.091 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:44.091 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:44.091 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:44.091 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:44.091 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:44.091 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:44.091 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 115 2024-04-25T22:52:44.091 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.091 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:44.091 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.091 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:44.092 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:44.092 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:44.092 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.092 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.092 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:44.092 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:44.092 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:44.092 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.092 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.092 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:44.092 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:44.092 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9500000000000002e-07 2024-04-25T22:52:44.092 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.092 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.092 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:44.093 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965108+0000", 2024-04-25T22:52:44.093 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9177999999999994e-05 2024-04-25T22:52:44.093 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.093 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.093 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:44.093 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965127+0000", 2024-04-25T22:52:44.093 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8868e-05 2024-04-25T22:52:44.093 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.093 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.093 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:44.093 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965133+0000", 2024-04-25T22:52:44.093 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8929999999999999e-06 2024-04-25T22:52:44.093 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.093 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.093 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:44.094 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.969991+0000", 2024-04-25T22:52:44.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048573849999999997 2024-04-25T22:52:44.094 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.094 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.094 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:44.094 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970072+0000", 2024-04-25T22:52:44.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0728000000000004e-05 2024-04-25T22:52:44.094 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.094 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.094 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:44.094 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970189+0000", 2024-04-25T22:52:44.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000117778 2024-04-25T22:52:44.094 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.095 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.095 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:44.095 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970946+0000", 2024-04-25T22:52:44.095 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00075704600000000004 2024-04-25T22:52:44.095 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.095 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.095 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:44.095 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975297+0000", 2024-04-25T22:52:44.095 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004350217 2024-04-25T22:52:44.095 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.095 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.095 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:44.095 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975343+0000", 2024-04-25T22:52:44.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6687999999999998e-05 2024-04-25T22:52:44.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.096 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:44.096 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975380+0000", 2024-04-25T22:52:44.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6724000000000003e-05 2024-04-25T22:52:44.096 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:44.096 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:44.096 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:44.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.096 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:44.096 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:44.096 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 56.123042394999999, 2024-04-25T22:52:44.097 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010304384, 2024-04-25T22:52:44.097 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:44.097 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:44.097 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:44.097 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:44.097 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:44.097 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:44.097 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 116 2024-04-25T22:52:44.097 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.097 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:44.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.097 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:44.097 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:44.097 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:44.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.098 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:44.098 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:44.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:44.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.098 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:44.098 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:44.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5799999999999999e-07 2024-04-25T22:52:44.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.099 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:44.099 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965154+0000", 2024-04-25T22:52:44.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0009e-05 2024-04-25T22:52:44.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.099 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:44.099 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965164+0000", 2024-04-25T22:52:44.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8490000000000001e-06 2024-04-25T22:52:44.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.099 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:44.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965169+0000", 2024-04-25T22:52:44.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0730000000000004e-06 2024-04-25T22:52:44.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.100 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:44.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970609+0000", 2024-04-25T22:52:44.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054397689999999997 2024-04-25T22:52:44.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.100 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:44.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970651+0000", 2024-04-25T22:52:44.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1873999999999999e-05 2024-04-25T22:52:44.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:44.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970723+0000", 2024-04-25T22:52:44.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2039999999999995e-05 2024-04-25T22:52:44.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:44.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971358+0000", 2024-04-25T22:52:44.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063489500000000001 2024-04-25T22:52:44.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:44.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975409+0000", 2024-04-25T22:52:44.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040506880000000002 2024-04-25T22:52:44.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:44.102 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975432+0000", 2024-04-25T22:52:44.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3315999999999998e-05 2024-04-25T22:52:44.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:44.102 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975448+0000", 2024-04-25T22:52:44.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6313000000000001e-05 2024-04-25T22:52:44.102 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:44.102 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:44.102 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:44.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.103 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:44.103 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:44.103 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 56.123007813000001, 2024-04-25T22:52:44.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010384338999999999, 2024-04-25T22:52:44.103 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:44.103 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:44.103 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:44.103 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:44.103 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:44.103 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:44.103 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-04-25T22:52:44.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.104 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:44.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.104 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:44.104 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:44.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:44.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.104 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:44.104 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:44.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:44.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.104 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:44.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:44.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3600000000000004e-07 2024-04-25T22:52:44.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:44.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965185+0000", 2024-04-25T22:52:44.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.117e-06 2024-04-25T22:52:44.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:44.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965192+0000", 2024-04-25T22:52:44.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3239999999999997e-06 2024-04-25T22:52:44.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:44.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965198+0000", 2024-04-25T22:52:44.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6370000000000004e-06 2024-04-25T22:52:44.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:44.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970973+0000", 2024-04-25T22:52:44.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057748239999999996 2024-04-25T22:52:44.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:44.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971049+0000", 2024-04-25T22:52:44.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6029e-05 2024-04-25T22:52:44.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:44.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971174+0000", 2024-04-25T22:52:44.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012462399999999999 2024-04-25T22:52:44.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:44.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971553+0000", 2024-04-25T22:52:44.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037896499999999999 2024-04-25T22:52:44.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:44.108 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975482+0000", 2024-04-25T22:52:44.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039297459999999996 2024-04-25T22:52:44.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.108 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:44.108 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975529+0000", 2024-04-25T22:52:44.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6387000000000002e-05 2024-04-25T22:52:44.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.108 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:44.108 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975563+0000", 2024-04-25T22:52:44.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4150000000000003e-05 2024-04-25T22:52:44.108 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:44.108 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:44.109 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:44.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.109 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:44.109 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:44.109 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.075961489999997, 2024-04-25T22:52:44.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012637705000000001, 2024-04-25T22:52:44.109 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:44.109 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:44.109 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:44.109 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:44.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:44.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:44.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:44.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:44.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:44.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:44.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:44.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012227+0000", 2024-04-25T22:52:44.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.863e-06 2024-04-25T22:52:44.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.111 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:44.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012236+0000", 2024-04-25T22:52:44.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1109999999999997e-06 2024-04-25T22:52:44.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.111 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:44.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012309+0000", 2024-04-25T22:52:44.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3242000000000001e-05 2024-04-25T22:52:44.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.111 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:44.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012324+0000", 2024-04-25T22:52:44.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4837e-05 2024-04-25T22:52:44.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:44.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015060+0000", 2024-04-25T22:52:44.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027363349999999999 2024-04-25T22:52:44.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:44.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015169+0000", 2024-04-25T22:52:44.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108372 2024-04-25T22:52:44.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:44.113 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015498+0000", 2024-04-25T22:52:44.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032949999999999999 2024-04-25T22:52:44.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.113 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:44.113 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021282+0000", 2024-04-25T22:52:44.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057836429999999998 2024-04-25T22:52:44.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.113 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:44.113 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024709+0000", 2024-04-25T22:52:44.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034271979999999998 2024-04-25T22:52:44.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:44.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024802+0000", 2024-04-25T22:52:44.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2960000000000004e-05 2024-04-25T22:52:44.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:44.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024863+0000", 2024-04-25T22:52:44.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0643999999999997e-05 2024-04-25T22:52:44.114 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:44.114 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:44.114 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:44.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.115 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:44.115 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:44.115 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.075837718999999, 2024-04-25T22:52:44.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012979447999999999, 2024-04-25T22:52:44.115 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:44.115 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:44.115 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:44.115 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:44.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:44.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:44.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:44.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:44.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:44.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:44.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:44.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:44.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:52:44.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:44.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012354+0000", 2024-04-25T22:52:44.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7740000000000004e-06 2024-04-25T22:52:44.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.117 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:44.117 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012365+0000", 2024-04-25T22:52:44.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.064e-05 2024-04-25T22:52:44.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.117 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:44.117 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012382+0000", 2024-04-25T22:52:44.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6999000000000001e-05 2024-04-25T22:52:44.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.117 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:44.117 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015958+0000", 2024-04-25T22:52:44.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035765699999999998 2024-04-25T22:52:44.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:44.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016037+0000", 2024-04-25T22:52:44.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8242000000000001e-05 2024-04-25T22:52:44.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:44.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016404+0000", 2024-04-25T22:52:44.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036784300000000002 2024-04-25T22:52:44.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:44.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021294+0000", 2024-04-25T22:52:44.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048890629999999999 2024-04-25T22:52:44.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:44.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024959+0000", 2024-04-25T22:52:44.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036651570000000001 2024-04-25T22:52:44.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:44.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025097+0000", 2024-04-25T22:52:44.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013788099999999999 2024-04-25T22:52:44.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:44.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025328+0000", 2024-04-25T22:52:44.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231492 2024-04-25T22:52:44.120 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:44.120 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:44.120 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:44.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.120 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:44.120 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:44.120 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.075749950000002, 2024-04-25T22:52:44.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013049827, 2024-04-25T22:52:44.121 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:44.121 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:44.121 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:44.121 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:44.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:44.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:44.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:44.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:44.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:44.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:44.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:44.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012437+0000", 2024-04-25T22:52:44.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-04-25T22:52:44.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:44.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012440+0000", 2024-04-25T22:52:44.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7609999999999999e-06 2024-04-25T22:52:44.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:44.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012449+0000", 2024-04-25T22:52:44.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.285e-06 2024-04-25T22:52:44.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:44.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012457+0000", 2024-04-25T22:52:44.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9510000000000006e-06 2024-04-25T22:52:44.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:44.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017106+0000", 2024-04-25T22:52:44.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046494220000000003 2024-04-25T22:52:44.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:44.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017223+0000", 2024-04-25T22:52:44.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116824 2024-04-25T22:52:44.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:44.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017345+0000", 2024-04-25T22:52:44.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122175 2024-04-25T22:52:44.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:44.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021299+0000", 2024-04-25T22:52:44.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039534879999999998 2024-04-25T22:52:44.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:44.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025398+0000", 2024-04-25T22:52:44.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040988960000000003 2024-04-25T22:52:44.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:44.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025439+0000", 2024-04-25T22:52:44.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0915999999999999e-05 2024-04-25T22:52:44.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:44.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025486+0000", 2024-04-25T22:52:44.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7534999999999998e-05 2024-04-25T22:52:44.126 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:44.126 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:44.126 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:44.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.126 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:44.126 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:44.127 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.075719798999998, 2024-04-25T22:52:44.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020988041999999998, 2024-04-25T22:52:44.127 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:44.127 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:44.127 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:44.127 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:44.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:44.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:44.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:44.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:44.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:44.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:44.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:44.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:44.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.99e-07 2024-04-25T22:52:44.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:44.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012470+0000", 2024-04-25T22:52:44.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2789999999999999e-06 2024-04-25T22:52:44.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:44.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012477+0000", 2024-04-25T22:52:44.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:52:44.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:44.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012500+0000", 2024-04-25T22:52:44.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2490999999999999e-05 2024-04-25T22:52:44.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:44.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021911+0000", 2024-04-25T22:52:44.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094114160000000006 2024-04-25T22:52:44.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:44.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022000+0000", 2024-04-25T22:52:44.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8601000000000001e-05 2024-04-25T22:52:44.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:44.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022359+0000", 2024-04-25T22:52:44.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035921999999999999 2024-04-25T22:52:44.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:44.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025541+0000", 2024-04-25T22:52:44.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031820619999999998 2024-04-25T22:52:44.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:44.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033375+0000", 2024-04-25T22:52:44.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078338379999999992 2024-04-25T22:52:44.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:44.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033415+0000", 2024-04-25T22:52:44.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9527000000000003e-05 2024-04-25T22:52:44.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:44.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033455+0000", 2024-04-25T22:52:44.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9932000000000003e-05 2024-04-25T22:52:44.132 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:44.132 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:44.132 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:44.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.132 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:44.132 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:44.132 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.075664605999997, 2024-04-25T22:52:44.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021043857999999999, 2024-04-25T22:52:44.133 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:44.133 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:44.133 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:44.133 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:44.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:44.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:44.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:44.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:44.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:44.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:44.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:44.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012523+0000", 2024-04-25T22:52:44.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.361e-06 2024-04-25T22:52:44.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:44.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012530+0000", 2024-04-25T22:52:44.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5440000000000004e-06 2024-04-25T22:52:44.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:44.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012541+0000", 2024-04-25T22:52:44.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1745e-05 2024-04-25T22:52:44.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:44.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012551+0000", 2024-04-25T22:52:44.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5789999999999993e-06 2024-04-25T22:52:44.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:44.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022709+0000", 2024-04-25T22:52:44.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010157685 2024-04-25T22:52:44.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:44.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022957+0000", 2024-04-25T22:52:44.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024824599999999998 2024-04-25T22:52:44.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:44.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023443+0000", 2024-04-25T22:52:44.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048578599999999999 2024-04-25T22:52:44.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:44.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025547+0000", 2024-04-25T22:52:44.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021044789999999998 2024-04-25T22:52:44.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:44.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033509+0000", 2024-04-25T22:52:44.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0079622180000000001 2024-04-25T22:52:44.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:44.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033542+0000", 2024-04-25T22:52:44.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3018000000000001e-05 2024-04-25T22:52:44.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:44.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033566+0000", 2024-04-25T22:52:44.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3197000000000002e-05 2024-04-25T22:52:44.137 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:44.138 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:44.138 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:44.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.138 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:44.138 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:44.138 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.075624640999997, 2024-04-25T22:52:44.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021122696, 2024-04-25T22:52:44.138 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:44.138 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:44.138 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:44.138 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:44.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:44.139 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:44.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:44.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.139 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:44.139 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:44.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:44.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.139 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:44.139 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:44.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:52:44.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:44.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012566+0000", 2024-04-25T22:52:44.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-04-25T22:52:44.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:44.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012619+0000", 2024-04-25T22:52:44.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2607e-05 2024-04-25T22:52:44.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:44.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012628+0000", 2024-04-25T22:52:44.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6500000000000008e-06 2024-04-25T22:52:44.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:44.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024024+0000", 2024-04-25T22:52:44.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011396007999999999 2024-04-25T22:52:44.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:44.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024198+0000", 2024-04-25T22:52:44.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000173215 2024-04-25T22:52:44.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:44.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024447+0000", 2024-04-25T22:52:44.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024898500000000002 2024-04-25T22:52:44.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:44.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026431+0000", 2024-04-25T22:52:44.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001984923 2024-04-25T22:52:44.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:44.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033608+0000", 2024-04-25T22:52:44.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071768459999999997 2024-04-25T22:52:44.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:44.143 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033646+0000", 2024-04-25T22:52:44.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299000000000003e-05 2024-04-25T22:52:44.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.143 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:44.143 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033684+0000", 2024-04-25T22:52:44.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8773000000000003e-05 2024-04-25T22:52:44.143 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:44.143 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:44.143 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:44.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.143 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:44.144 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:44.144 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.075536042000003, 2024-04-25T22:52:44.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021175381, 2024-04-25T22:52:44.144 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:44.144 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:44.144 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:44.144 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:44.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.144 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:44.144 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:44.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:44.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.144 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:44.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:44.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:44.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:44.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012651+0000", 2024-04-25T22:52:44.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:52:44.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:44.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012656+0000", 2024-04-25T22:52:44.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8899999999999998e-06 2024-04-25T22:52:44.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:44.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012666+0000", 2024-04-25T22:52:44.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0346999999999999e-05 2024-04-25T22:52:44.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:44.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012675+0000", 2024-04-25T22:52:44.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9930000000000001e-06 2024-04-25T22:52:44.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:44.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025661+0000", 2024-04-25T22:52:44.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01298531 2024-04-25T22:52:44.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:44.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025757+0000", 2024-04-25T22:52:44.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5822000000000005e-05 2024-04-25T22:52:44.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:44.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025907+0000", 2024-04-25T22:52:44.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015051499999999999 2024-04-25T22:52:44.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:44.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026435+0000", 2024-04-25T22:52:44.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052762200000000005 2024-04-25T22:52:44.148 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.148 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:44.148 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033732+0000", 2024-04-25T22:52:44.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072978419999999997 2024-04-25T22:52:44.148 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.148 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:44.148 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033787+0000", 2024-04-25T22:52:44.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4703999999999997e-05 2024-04-25T22:52:44.148 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:44.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033826+0000", 2024-04-25T22:52:44.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8458999999999999e-05 2024-04-25T22:52:44.149 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:44.149 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:44.149 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:44.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.149 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:44.149 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:44.149 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.075480628000001, 2024-04-25T22:52:44.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021244174000000001, 2024-04-25T22:52:44.149 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:44.149 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:44.150 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:44.150 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:44.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:44.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:44.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:44.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:44.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:44.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:44.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:44.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:44.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:52:44.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:44.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012712+0000", 2024-04-25T22:52:44.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.913e-06 2024-04-25T22:52:44.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:44.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012722+0000", 2024-04-25T22:52:44.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2879999999999998e-06 2024-04-25T22:52:44.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:44.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012727+0000", 2024-04-25T22:52:44.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8429999999999998e-06 2024-04-25T22:52:44.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:44.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026099+0000", 2024-04-25T22:52:44.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013371450999999999 2024-04-25T22:52:44.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:44.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026147+0000", 2024-04-25T22:52:44.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7837999999999998e-05 2024-04-25T22:52:44.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:44.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026254+0000", 2024-04-25T22:52:44.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107314 2024-04-25T22:52:44.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:44.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026686+0000", 2024-04-25T22:52:44.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000432428 2024-04-25T22:52:44.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:44.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033873+0000", 2024-04-25T22:52:44.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071864399999999997 2024-04-25T22:52:44.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:44.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033904+0000", 2024-04-25T22:52:44.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1321e-05 2024-04-25T22:52:44.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:44.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033950+0000", 2024-04-25T22:52:44.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5707999999999997e-05 2024-04-25T22:52:44.155 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:44.155 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:44.155 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:44.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.155 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:44.155 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:44.156 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.075450242999999, 2024-04-25T22:52:44.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01096505, 2024-04-25T22:52:44.156 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:44.156 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:44.156 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:44.156 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:44.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:44.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:44.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:44.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:44.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:44.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:44.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:44.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012737+0000", 2024-04-25T22:52:44.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:52:44.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:44.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012739+0000", 2024-04-25T22:52:44.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-04-25T22:52:44.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:44.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012743+0000", 2024-04-25T22:52:44.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3239999999999996e-06 2024-04-25T22:52:44.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:44.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012746+0000", 2024-04-25T22:52:44.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.129e-06 2024-04-25T22:52:44.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:44.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012796+0000", 2024-04-25T22:52:44.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9231999999999999e-05 2024-04-25T22:52:44.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:44.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012915+0000", 2024-04-25T22:52:44.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119021 2024-04-25T22:52:44.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:44.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013069+0000", 2024-04-25T22:52:44.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015463900000000001 2024-04-25T22:52:44.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:44.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019237+0000", 2024-04-25T22:52:44.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061680329999999998 2024-04-25T22:52:44.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:44.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023603+0000", 2024-04-25T22:52:44.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043655860000000003 2024-04-25T22:52:44.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:44.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023659+0000", 2024-04-25T22:52:44.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6484000000000003e-05 2024-04-25T22:52:44.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:44.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023701+0000", 2024-04-25T22:52:44.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1761999999999998e-05 2024-04-25T22:52:44.161 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:44.161 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:44.161 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:44.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.161 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:44.161 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:44.161 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.075425295000002, 2024-04-25T22:52:44.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011234429000000001, 2024-04-25T22:52:44.161 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:44.161 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:44.161 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:44.162 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:44.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:44.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:44.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:44.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:44.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:44.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:44.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:44.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012762+0000", 2024-04-25T22:52:44.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-04-25T22:52:44.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:44.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012765+0000", 2024-04-25T22:52:44.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2569999999999999e-06 2024-04-25T22:52:44.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:44.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012783+0000", 2024-04-25T22:52:44.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8431999999999999e-05 2024-04-25T22:52:44.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:44.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012799+0000", 2024-04-25T22:52:44.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5438999999999999e-05 2024-04-25T22:52:44.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:44.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013826+0000", 2024-04-25T22:52:44.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010275060000000001 2024-04-25T22:52:44.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:44.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013913+0000", 2024-04-25T22:52:44.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.708e-05 2024-04-25T22:52:44.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:44.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014098+0000", 2024-04-25T22:52:44.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018519399999999999 2024-04-25T22:52:44.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:44.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019684+0000", 2024-04-25T22:52:44.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055860079999999999 2024-04-25T22:52:44.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:44.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023876+0000", 2024-04-25T22:52:44.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041918800000000003 2024-04-25T22:52:44.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:44.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023957+0000", 2024-04-25T22:52:44.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1165e-05 2024-04-25T22:52:44.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:44.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023995+0000", 2024-04-25T22:52:44.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:52:44.167 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:44.167 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:44.167 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:44.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.167 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:44.167 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:44.167 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.075327516000002, 2024-04-25T22:52:44.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011131200000000001, 2024-04-25T22:52:44.167 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:44.167 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:44.167 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:44.168 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:44.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:44.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:44.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:44.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:44.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:44.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:44.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:44.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012860+0000", 2024-04-25T22:52:44.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3900000000000004e-07 2024-04-25T22:52:44.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:44.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012865+0000", 2024-04-25T22:52:44.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5609999999999998e-06 2024-04-25T22:52:44.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:44.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012895+0000", 2024-04-25T22:52:44.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9847000000000001e-05 2024-04-25T22:52:44.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:44.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012905+0000", 2024-04-25T22:52:44.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.03e-05 2024-04-25T22:52:44.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:44.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015020+0000", 2024-04-25T22:52:44.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021142940000000001 2024-04-25T22:52:44.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:44.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015182+0000", 2024-04-25T22:52:44.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016248099999999999 2024-04-25T22:52:44.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:52:44.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015357+0000", 2024-04-25T22:52:44.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017471000000000001 2024-04-25T22:52:44.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:44.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021021+0000", 2024-04-25T22:52:44.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056638340000000004 2024-04-25T22:52:44.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:44.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023712+0000", 2024-04-25T22:52:44.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026910380000000002 2024-04-25T22:52:44.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:44.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023763+0000", 2024-04-25T22:52:44.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1477999999999997e-05 2024-04-25T22:52:44.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:44.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023990+0000", 2024-04-25T22:52:44.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000226818 2024-04-25T22:52:44.172 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:44.172 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:44.173 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:44.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.173 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:44.173 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:44.173 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.075204419999999, 2024-04-25T22:52:44.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011705299000000001, 2024-04-25T22:52:44.173 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:44.173 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:44.173 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:44.173 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:44.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:44.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:44.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:44.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:44.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:44.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:44.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:44.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012983+0000", 2024-04-25T22:52:44.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:52:44.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:44.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012986+0000", 2024-04-25T22:52:44.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5700000000000001e-06 2024-04-25T22:52:44.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:44.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012993+0000", 2024-04-25T22:52:44.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8730000000000001e-06 2024-04-25T22:52:44.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:44.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013000+0000", 2024-04-25T22:52:44.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1890000000000001e-06 2024-04-25T22:52:44.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:44.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:52:44.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002147866 2024-04-25T22:52:44.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:44.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015351+0000", 2024-04-25T22:52:44.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020300799999999999 2024-04-25T22:52:44.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:44.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016260+0000", 2024-04-25T22:52:44.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00090926799999999997 2024-04-25T22:52:44.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:44.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022669+0000", 2024-04-25T22:52:44.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064082849999999997 2024-04-25T22:52:44.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:44.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024584+0000", 2024-04-25T22:52:44.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019151699999999999 2024-04-25T22:52:44.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:44.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024643+0000", 2024-04-25T22:52:44.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8888999999999998e-05 2024-04-25T22:52:44.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:44.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024687+0000", 2024-04-25T22:52:44.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4444999999999999e-05 2024-04-25T22:52:44.178 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:44.178 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:44.178 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:44.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.178 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:44.178 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:44.179 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.075176829, 2024-04-25T22:52:44.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011249699, 2024-04-25T22:52:44.179 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:44.179 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:44.179 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:44.179 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:44.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:44.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:44.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:44.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:44.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:44.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:44.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:44.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013010+0000", 2024-04-25T22:52:44.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2099999999999996e-07 2024-04-25T22:52:44.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:44.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013013+0000", 2024-04-25T22:52:44.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1310000000000002e-06 2024-04-25T22:52:44.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:44.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013020+0000", 2024-04-25T22:52:44.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3330000000000002e-06 2024-04-25T22:52:44.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:44.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013025+0000", 2024-04-25T22:52:44.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6760000000000004e-06 2024-04-25T22:52:44.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:44.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013163+0000", 2024-04-25T22:52:44.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013824599999999999 2024-04-25T22:52:44.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:44.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013504+0000", 2024-04-25T22:52:44.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034080299999999998 2024-04-25T22:52:44.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:44.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013613+0000", 2024-04-25T22:52:44.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108705 2024-04-25T22:52:44.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:44.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015831+0000", 2024-04-25T22:52:44.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002217672 2024-04-25T22:52:44.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:44.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024137+0000", 2024-04-25T22:52:44.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0083060489999999994 2024-04-25T22:52:44.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:44.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024218+0000", 2024-04-25T22:52:44.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1351000000000001e-05 2024-04-25T22:52:44.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:44.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024259+0000", 2024-04-25T22:52:44.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1112000000000002e-05 2024-04-25T22:52:44.184 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:44.184 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:44.184 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:44.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.184 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:44.184 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:44.184 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.075089103000003, 2024-04-25T22:52:44.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020379749999999999, 2024-04-25T22:52:44.184 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:44.184 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:44.184 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:44.184 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:44.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:44.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:44.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:44.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:44.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:44.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:44.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:44.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013098+0000", 2024-04-25T22:52:44.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:52:44.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:44.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013105+0000", 2024-04-25T22:52:44.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5969999999999997e-06 2024-04-25T22:52:44.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:44.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013190+0000", 2024-04-25T22:52:44.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5618999999999995e-05 2024-04-25T22:52:44.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:44.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013200+0000", 2024-04-25T22:52:44.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5859999999999994e-06 2024-04-25T22:52:44.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:44.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020265+0000", 2024-04-25T22:52:44.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070653349999999998 2024-04-25T22:52:44.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:44.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020454+0000", 2024-04-25T22:52:44.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189316 2024-04-25T22:52:44.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:44.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020586+0000", 2024-04-25T22:52:44.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013195700000000001 2024-04-25T22:52:44.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:44.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023822+0000", 2024-04-25T22:52:44.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032358529999999999 2024-04-25T22:52:44.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:44.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033409+0000", 2024-04-25T22:52:44.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095870520000000004 2024-04-25T22:52:44.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:44.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033447+0000", 2024-04-25T22:52:44.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7261999999999997e-05 2024-04-25T22:52:44.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:44.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033477+0000", 2024-04-25T22:52:44.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0389e-05 2024-04-25T22:52:44.189 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:44.189 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:44.189 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:44.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.190 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:44.190 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:44.190 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.074972596999999, 2024-04-25T22:52:44.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010857383999999999, 2024-04-25T22:52:44.190 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:44.190 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:44.190 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:44.190 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:44.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:44.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:44.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:44.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:44.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:44.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:44.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:44.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:44.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:52:44.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:44.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013218+0000", 2024-04-25T22:52:44.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8199999999999998e-06 2024-04-25T22:52:44.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:44.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013226+0000", 2024-04-25T22:52:44.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7649999999999993e-06 2024-04-25T22:52:44.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:44.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013259+0000", 2024-04-25T22:52:44.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2727e-05 2024-04-25T22:52:44.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.193 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:44.193 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014809+0000", 2024-04-25T22:52:44.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001550144 2024-04-25T22:52:44.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.193 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:44.193 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014958+0000", 2024-04-25T22:52:44.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014890300000000001 2024-04-25T22:52:44.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.193 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:52:44.193 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015087+0000", 2024-04-25T22:52:44.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012939200000000001 2024-04-25T22:52:44.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.194 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:44.194 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020212+0000", 2024-04-25T22:52:44.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051248939999999996 2024-04-25T22:52:44.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.194 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:44.194 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023699+0000", 2024-04-25T22:52:44.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034873289999999999 2024-04-25T22:52:44.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.194 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:44.194 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024014+0000", 2024-04-25T22:52:44.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031473999999999999 2024-04-25T22:52:44.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:44.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024071+0000", 2024-04-25T22:52:44.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7040000000000003e-05 2024-04-25T22:52:44.195 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:44.195 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:44.195 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:44.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.195 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:44.195 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:44.196 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.074917892000002, 2024-04-25T22:52:44.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012329677000000001, 2024-04-25T22:52:44.196 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:44.196 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:44.196 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:44.196 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:44.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:44.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:44.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:44.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:44.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:44.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:44.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:44.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013269+0000", 2024-04-25T22:52:44.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5000000000000002e-07 2024-04-25T22:52:44.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:44.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:52:44.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6909999999999999e-06 2024-04-25T22:52:44.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:44.198 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013284+0000", 2024-04-25T22:52:44.198 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0963e-05 2024-04-25T22:52:44.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.198 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:44.198 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013361+0000", 2024-04-25T22:52:44.198 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7379999999999994e-05 2024-04-25T22:52:44.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.198 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:44.198 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013448+0000", 2024-04-25T22:52:44.198 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6990000000000006e-05 2024-04-25T22:52:44.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:44.199 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013632+0000", 2024-04-25T22:52:44.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018396800000000001 2024-04-25T22:52:44.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:44.199 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013800+0000", 2024-04-25T22:52:44.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167467 2024-04-25T22:52:44.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:44.199 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.018570+0000", 2024-04-25T22:52:44.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047701460000000003 2024-04-25T22:52:44.200 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.200 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.200 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:44.200 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025507+0000", 2024-04-25T22:52:44.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069372039999999998 2024-04-25T22:52:44.200 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.200 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.200 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:44.200 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025562+0000", 2024-04-25T22:52:44.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4858999999999998e-05 2024-04-25T22:52:44.200 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.200 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:44.201 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025598+0000", 2024-04-25T22:52:44.201 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6259e-05 2024-04-25T22:52:44.201 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:44.201 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:44.201 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:44.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.201 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:44.201 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:44.201 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.074786019000001, 2024-04-25T22:52:44.201 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020176666999999999, 2024-04-25T22:52:44.201 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:44.202 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:44.202 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:52:44.202 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:44.202 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.202 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:44.202 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:44.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:44.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.202 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.202 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:44.202 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:44.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:44.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:44.203 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:52:44.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-04-25T22:52:44.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:44.203 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013405+0000", 2024-04-25T22:52:44.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0559999999999998e-06 2024-04-25T22:52:44.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:44.203 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013422+0000", 2024-04-25T22:52:44.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6770999999999999e-05 2024-04-25T22:52:44.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:44.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013431+0000", 2024-04-25T22:52:44.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5019999999999998e-06 2024-04-25T22:52:44.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:44.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021720+0000", 2024-04-25T22:52:44.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082884340000000008 2024-04-25T22:52:44.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:44.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022122+0000", 2024-04-25T22:52:44.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000401634 2024-04-25T22:52:44.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:44.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:44.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:44.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033577+0000", 2024-04-25T22:52:44.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011455435999999999 2024-04-25T22:52:44.205 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:44.205 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:44.205 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:44.205 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:44.205 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:44.205 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:44.206 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-25T22:52:44.207 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:44.206+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:44.208 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:52:44.307 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:44.306+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:44.319 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:44.319 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:52:44.319 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-25T22:52:44.320 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:44.330 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:52:44.408 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:44.407+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:44.435 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:44.435 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:52:44.435 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-25T22:52:44.436 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-25T22:52:44.436 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:44.444 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:52:44.528 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:44.527+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:44.588 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:44.588 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:52:44.588 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:52:44.589 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:52:44.589 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.589 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:52:44.589 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:52:44.589 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 56.619666199000001, 2024-04-25T22:52:44.589 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:52:44.589 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:44.589 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:44.589 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:44.589 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:44.589 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.589 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:44.590 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:52:44.590 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:44.590 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.590 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.590 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:44.590 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:52:44.590 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:44.590 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.590 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.590 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:44.590 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:52:44.590 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:52:44.591 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.591 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.591 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:44.591 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:52:44.591 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:52:44.591 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.591 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.591 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:44.591 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:52:44.591 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:52:44.591 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.592 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.592 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:44.592 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:52:44.592 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:52:44.592 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.592 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.592 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:44.592 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:52:44.592 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:52:44.592 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.592 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.592 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:44.593 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:52:44.593 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:52:44.593 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.593 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.593 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:44.593 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:52:44.593 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:52:44.593 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.593 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.593 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:44.593 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:52:44.593 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:52:44.593 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:44.594 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:44.594 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:44.594 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.594 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.594 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:110 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'72, mlcod=10'68)", 2024-04-25T22:52:44.594 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:44.594 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 56.619032199000003, 2024-04-25T22:52:44.594 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065316630000000001, 2024-04-25T22:52:44.594 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:44.594 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:44.594 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:44.594 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:44.594 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.595 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:44.595 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:44.595 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:44.595 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.595 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.595 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:44.595 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:44.595 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:44.595 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.595 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.595 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:44.596 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:44.596 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.58e-07 2024-04-25T22:52:44.596 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.596 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.596 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:44.596 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967811+0000", 2024-04-25T22:52:44.596 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.118e-06 2024-04-25T22:52:44.596 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.596 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.596 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:44.596 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967817+0000", 2024-04-25T22:52:44.597 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3709999999999996e-06 2024-04-25T22:52:44.597 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.597 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.597 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:44.597 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967820+0000", 2024-04-25T22:52:44.597 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2210000000000002e-06 2024-04-25T22:52:44.597 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.598 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.598 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:44.598 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967876+0000", 2024-04-25T22:52:44.598 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5507000000000002e-05 2024-04-25T22:52:44.598 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.598 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.598 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:44.598 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967893+0000", 2024-04-25T22:52:44.598 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7812000000000002e-05 2024-04-25T22:52:44.598 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.598 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.598 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:44.598 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974317+0000", 2024-04-25T22:52:44.599 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064237160000000003 2024-04-25T22:52:44.599 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.599 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.599 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:44.599 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:52:44.599 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.156e-05 2024-04-25T22:52:44.599 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:44.599 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:44.599 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:44.599 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.599 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.599 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'68)", 2024-04-25T22:52:44.599 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:44.600 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 56.618614686000001, 2024-04-25T22:52:44.600 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061292279999999996, 2024-04-25T22:52:44.600 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:44.600 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:44.600 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:44.600 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:44.600 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.600 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:44.600 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:44.600 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:44.600 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.600 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.600 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:44.600 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:44.601 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:44.601 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.601 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.601 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:44.601 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:44.601 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6300000000000001e-07 2024-04-25T22:52:44.601 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.602 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.602 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:44.602 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968228+0000", 2024-04-25T22:52:44.602 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6139999999999999e-06 2024-04-25T22:52:44.602 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.602 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.602 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:44.602 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968235+0000", 2024-04-25T22:52:44.602 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7020000000000001e-06 2024-04-25T22:52:44.602 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.602 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.602 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:44.602 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968238+0000", 2024-04-25T22:52:44.603 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0010000000000002e-06 2024-04-25T22:52:44.603 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.603 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.603 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:44.603 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968297+0000", 2024-04-25T22:52:44.603 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8424999999999997e-05 2024-04-25T22:52:44.603 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.603 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.604 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:44.604 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968316+0000", 2024-04-25T22:52:44.604 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8814999999999999e-05 2024-04-25T22:52:44.604 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.604 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.604 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:44.604 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:52:44.604 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060239439999999998 2024-04-25T22:52:44.604 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.604 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.604 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:44.604 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974354+0000", 2024-04-25T22:52:44.604 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4364e-05 2024-04-25T22:52:44.605 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:44.605 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:44.605 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:44.605 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.605 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.605 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'68)", 2024-04-25T22:52:44.605 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:44.605 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 56.618177684000003, 2024-04-25T22:52:44.605 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005948414, 2024-04-25T22:52:44.605 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:44.605 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:44.605 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:44.605 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:44.606 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.606 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:44.606 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:44.606 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:44.606 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.606 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.606 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:44.606 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:44.606 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:44.606 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.606 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.606 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:44.606 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:44.607 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6199999999999998e-07 2024-04-25T22:52:44.607 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.607 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.607 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:44.607 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968723+0000", 2024-04-25T22:52:44.607 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1148999999999993e-05 2024-04-25T22:52:44.607 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.607 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.608 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:44.608 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968730+0000", 2024-04-25T22:52:44.608 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1749999999999999e-06 2024-04-25T22:52:44.608 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.608 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.608 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:44.608 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968734+0000", 2024-04-25T22:52:44.608 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5200000000000002e-06 2024-04-25T22:52:44.608 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.608 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.608 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:44.608 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968771+0000", 2024-04-25T22:52:44.608 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6851999999999999e-05 2024-04-25T22:52:44.609 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.609 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.609 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:44.609 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968788+0000", 2024-04-25T22:52:44.609 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7027000000000001e-05 2024-04-25T22:52:44.609 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.609 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.609 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:44.609 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974589+0000", 2024-04-25T22:52:44.609 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058013320000000002 2024-04-25T22:52:44.609 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.609 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.609 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:44.610 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974610+0000", 2024-04-25T22:52:44.610 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0897e-05 2024-04-25T22:52:44.610 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:44.610 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:44.610 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:44.610 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.610 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.610 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'68)", 2024-04-25T22:52:44.610 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:44.610 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 56.617607673999998, 2024-04-25T22:52:44.610 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053935750000000003, 2024-04-25T22:52:44.610 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:44.610 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:44.611 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:44.611 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:44.611 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.611 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:44.611 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:44.611 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:44.611 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.611 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.611 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:44.611 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:44.611 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:44.611 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.611 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.612 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:44.612 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:44.612 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.03e-07 2024-04-25T22:52:44.612 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.612 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.612 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:44.612 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969235+0000", 2024-04-25T22:52:44.612 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2399999999999999e-06 2024-04-25T22:52:44.612 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.612 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.612 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:44.612 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969242+0000", 2024-04-25T22:52:44.612 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1269999999999997e-06 2024-04-25T22:52:44.613 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.613 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.613 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:44.613 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969246+0000", 2024-04-25T22:52:44.613 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3840000000000001e-06 2024-04-25T22:52:44.613 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.613 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.613 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:44.613 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969278+0000", 2024-04-25T22:52:44.613 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1868e-05 2024-04-25T22:52:44.613 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.613 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.613 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:44.614 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969295+0000", 2024-04-25T22:52:44.614 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7530999999999999e-05 2024-04-25T22:52:44.614 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.614 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.614 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:44.614 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974611+0000", 2024-04-25T22:52:44.614 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053160789999999996 2024-04-25T22:52:44.614 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.614 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.614 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:44.614 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974625+0000", 2024-04-25T22:52:44.614 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3943e-05 2024-04-25T22:52:44.614 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:44.615 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:44.615 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:44.615 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.615 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.615 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-25T22:52:44.615 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:44.615 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 56.424011766, 2024-04-25T22:52:44.615 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054952610000000004, 2024-04-25T22:52:44.615 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:44.615 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:44.615 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:44.615 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:44.615 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.615 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:44.616 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:44.616 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:44.616 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.616 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.616 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:44.616 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:44.616 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:44.616 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.616 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.616 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:44.616 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:44.616 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.68e-07 2024-04-25T22:52:44.616 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.616 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.617 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:44.617 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162898+0000", 2024-04-25T22:52:44.617 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9470999999999999e-05 2024-04-25T22:52:44.617 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.617 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.617 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:44.617 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162906+0000", 2024-04-25T22:52:44.617 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1580000000000005e-06 2024-04-25T22:52:44.617 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.617 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.617 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:44.617 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162911+0000", 2024-04-25T22:52:44.617 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4779999999999999e-06 2024-04-25T22:52:44.618 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.618 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.618 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:44.618 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162952+0000", 2024-04-25T22:52:44.618 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0629e-05 2024-04-25T22:52:44.618 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.618 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.618 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:44.618 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162968+0000", 2024-04-25T22:52:44.618 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6239000000000002e-05 2024-04-25T22:52:44.618 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.618 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.618 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:44.619 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168281+0000", 2024-04-25T22:52:44.619 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053132869999999999 2024-04-25T22:52:44.619 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.619 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.619 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:44.619 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168323+0000", 2024-04-25T22:52:44.619 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1430999999999997e-05 2024-04-25T22:52:44.619 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:44.619 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:44.619 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:44.619 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.619 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.619 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-04-25T22:52:44.619 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:44.620 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 55.993534404000002, 2024-04-25T22:52:44.620 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050872510000000001, 2024-04-25T22:52:44.620 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:44.620 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:44.620 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:44.620 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:44.620 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.620 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:44.620 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:44.620 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:44.620 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.620 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.621 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:44.621 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:44.621 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:44.621 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.621 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.621 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:44.621 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:44.621 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.72e-07 2024-04-25T22:52:44.621 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.621 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.621 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:44.621 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593381+0000", 2024-04-25T22:52:44.621 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5797000000000006e-05 2024-04-25T22:52:44.622 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.622 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.622 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:44.622 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593389+0000", 2024-04-25T22:52:44.622 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8480000000000001e-06 2024-04-25T22:52:44.622 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.622 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.622 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:44.622 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593393+0000", 2024-04-25T22:52:44.622 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4819999999999996e-06 2024-04-25T22:52:44.622 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.622 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.622 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:44.623 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593435+0000", 2024-04-25T22:52:44.623 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1600000000000002e-05 2024-04-25T22:52:44.623 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.623 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.623 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:44.623 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593454+0000", 2024-04-25T22:52:44.623 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8868e-05 2024-04-25T22:52:44.623 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.623 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.623 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:44.623 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598350+0000", 2024-04-25T22:52:44.623 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004895763 2024-04-25T22:52:44.623 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.623 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.624 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:44.624 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598392+0000", 2024-04-25T22:52:44.624 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2521000000000002e-05 2024-04-25T22:52:44.624 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:44.624 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:44.624 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:44.624 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.624 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.624 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:44.624 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:52:44.624 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 51.575170499999999, 2024-04-25T22:52:44.624 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:52:44.624 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:44.624 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:44.625 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:44.625 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:44.625 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.625 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:44.625 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:52:44.625 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:44.625 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.625 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.625 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:44.625 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:52:44.625 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:44.625 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.625 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.625 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:44.626 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:52:44.626 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:52:44.626 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.626 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.626 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:44.626 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:52:44.626 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:52:44.626 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.626 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.626 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:44.626 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:52:44.626 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:52:44.626 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.627 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.627 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:44.627 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:52:44.627 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:52:44.627 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.627 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.627 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:44.627 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:52:44.627 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:52:44.627 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.627 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.627 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:44.627 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:52:44.628 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:52:44.628 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.628 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.628 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:44.628 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:52:44.628 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:52:44.628 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.628 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.628 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:44.628 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:52:44.628 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:52:44.628 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.628 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.629 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:44.629 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:52:44.629 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:52:44.629 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.629 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.629 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:44.629 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:52:44.629 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:52:44.629 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.629 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.629 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:44.629 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:52:44.629 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:52:44.630 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:44.630 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:44.630 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:44.630 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.630 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.630 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:44.630 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:52:44.630 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 51.574496123999999, 2024-04-25T22:52:44.630 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:52:44.630 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:44.630 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:44.630 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:44.630 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:44.630 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.631 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:44.631 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:52:44.631 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:44.631 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.631 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.631 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:44.631 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:52:44.631 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:44.631 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.631 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.631 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:44.631 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:52:44.631 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:52:44.632 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.632 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.632 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:44.632 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:52:44.632 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:52:44.632 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.632 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.632 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:44.632 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:52:44.632 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:52:44.632 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.632 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.632 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:44.632 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:52:44.633 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:52:44.633 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.633 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.633 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:44.633 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:52:44.633 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:52:44.633 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.633 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.633 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:44.633 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:52:44.633 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:52:44.633 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.633 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.633 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:44.634 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:52:44.634 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:52:44.634 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.634 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.634 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:44.634 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:52:44.634 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:52:44.634 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.634 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.634 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:44.634 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:52:44.634 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:52:44.634 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.635 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.635 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:44.635 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:52:44.635 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:52:44.635 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.635 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.635 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:44.635 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:52:44.635 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:52:44.635 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:44.635 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:44.635 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:44.635 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.636 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.636 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:44.636 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:52:44.636 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 51.573986912000002, 2024-04-25T22:52:44.636 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:52:44.636 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:44.636 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:44.636 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:44.636 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:44.636 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.636 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:44.636 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:52:44.636 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:44.636 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.637 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.637 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:44.637 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:52:44.637 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:44.637 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.637 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.637 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:44.637 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:52:44.637 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:52:44.637 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.637 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.637 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:44.637 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:52:44.638 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:52:44.638 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.638 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.638 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:44.638 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:52:44.638 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:52:44.638 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.638 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.638 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:44.638 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:52:44.638 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:52:44.638 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.638 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.638 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:44.639 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:52:44.639 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:52:44.639 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.639 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.639 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:44.639 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:52:44.639 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:52:44.639 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.639 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.639 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:44.639 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:52:44.639 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:52:44.639 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.640 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.640 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:44.640 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:52:44.640 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:52:44.640 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.640 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.640 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:44.640 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:52:44.640 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:52:44.640 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.640 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.640 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:44.640 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:52:44.640 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:52:44.641 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.641 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.641 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:44.641 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:52:44.641 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:52:44.641 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:44.641 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:44.641 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:44.641 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.641 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.641 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:44.641 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:44.641 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 51.573573713999998, 2024-04-25T22:52:44.642 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:52:44.642 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:44.642 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:44.642 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:44.642 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:44.642 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.642 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:44.642 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:44.642 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:44.642 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.642 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.642 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:44.642 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:44.643 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:44.643 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.643 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.643 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:44.643 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:44.643 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:52:44.643 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.643 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.643 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:44.643 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:52:44.643 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:52:44.643 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.643 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.643 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:44.643 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:52:44.644 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:52:44.644 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.644 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.644 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:44.644 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:52:44.644 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:52:44.644 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.644 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.644 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:44.644 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:52:44.645 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:52:44.645 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.645 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.645 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:44.645 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:52:44.645 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:52:44.645 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.645 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.645 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:44.645 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:52:44.645 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:52:44.645 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.645 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.646 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:44.646 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:52:44.646 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:52:44.646 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.646 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.646 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:44.646 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:52:44.646 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:52:44.646 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.646 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.646 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:44.646 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:52:44.646 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:52:44.646 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.647 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.647 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:44.647 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:52:44.647 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:52:44.647 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:44.647 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:44.647 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:44.647 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.647 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.647 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:44.647 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:52:44.647 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 51.573523043999998, 2024-04-25T22:52:44.647 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:52:44.647 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:44.647 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:44.648 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:44.648 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:44.648 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.648 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:44.648 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:52:44.648 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:44.648 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.648 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.648 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:44.648 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:52:44.648 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:44.648 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.648 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.648 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:44.648 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:52:44.649 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:52:44.649 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.649 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.649 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:44.649 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:52:44.649 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:52:44.649 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.649 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.649 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:44.649 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:52:44.649 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:52:44.649 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.649 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.650 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:44.650 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:52:44.650 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:52:44.650 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.650 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.650 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:44.650 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:52:44.650 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:52:44.650 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.650 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.650 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:52:44.650 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:52:44.650 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:52:44.650 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.651 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.651 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:44.651 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:52:44.651 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:52:44.651 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.651 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.651 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:44.651 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:52:44.651 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:52:44.651 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.651 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.651 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:44.651 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:52:44.652 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:52:44.652 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.652 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.652 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:44.652 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:52:44.652 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:52:44.652 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.652 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.652 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:44.652 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:52:44.652 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:52:44.652 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.652 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.652 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:44.653 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:52:44.653 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:52:44.653 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.653 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.653 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:44.653 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:52:44.653 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:52:44.653 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:44.653 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:44.653 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:44.653 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.653 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.653 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:44.653 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:52:44.653 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 51.573486174999999, 2024-04-25T22:52:44.654 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:52:44.654 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:44.654 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:44.654 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:44.654 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:44.654 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.654 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:44.654 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:52:44.654 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:44.654 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.654 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.654 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:44.654 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:52:44.655 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:44.655 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.655 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.655 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:44.655 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:52:44.655 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:52:44.655 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.655 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.655 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:44.655 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:52:44.655 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:52:44.655 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.655 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.655 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:44.655 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:52:44.656 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:52:44.656 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.656 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.656 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:44.656 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:52:44.656 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:52:44.656 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.656 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.656 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:44.656 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:52:44.656 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:52:44.656 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.656 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.656 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:52:44.657 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:52:44.657 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:52:44.657 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.657 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.657 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:44.657 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:52:44.657 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:52:44.657 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.657 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.657 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:44.657 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:52:44.657 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:52:44.657 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.657 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.657 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:44.658 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:52:44.658 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:52:44.658 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.658 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.658 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:44.658 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:52:44.658 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:52:44.658 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.658 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.658 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:44.658 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:52:44.658 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:52:44.658 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.659 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.659 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:44.659 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:52:44.659 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:52:44.659 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.659 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.659 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:44.659 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:52:44.659 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:52:44.659 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:44.659 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:44.659 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:44.659 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.659 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.660 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:44.660 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:52:44.660 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 51.573461209000001, 2024-04-25T22:52:44.660 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:52:44.660 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:44.660 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:44.660 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:44.660 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:44.660 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.660 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:44.660 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:52:44.660 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:44.660 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.660 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.661 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:44.661 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:52:44.661 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:44.661 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.661 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.661 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:44.661 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:52:44.661 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:52:44.661 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.661 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.661 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:44.661 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:52:44.661 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:52:44.662 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.662 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.662 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:44.662 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:52:44.662 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:52:44.662 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.662 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.662 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:44.662 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:52:44.662 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:52:44.662 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.662 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.663 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:44.663 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:52:44.663 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:52:44.663 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.663 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.663 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:44.663 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:52:44.663 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:52:44.663 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.663 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.663 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:44.663 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:52:44.663 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:52:44.664 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.664 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.664 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:44.664 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:52:44.664 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:52:44.664 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.664 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.664 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:44.664 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:52:44.664 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:52:44.664 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.664 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.664 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:44.664 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:52:44.665 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:52:44.665 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.665 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.665 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:44.665 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:52:44.665 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:52:44.665 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:44.665 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:44.665 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:44.665 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.665 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.665 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:44.665 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:52:44.665 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 51.573424844999998, 2024-04-25T22:52:44.666 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:52:44.666 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:44.666 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:44.666 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:52:44.666 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:44.666 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.666 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:44.666 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:52:44.666 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:44.666 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.666 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.666 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:44.666 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:52:44.667 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:44.667 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.667 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.667 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:44.667 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:52:44.667 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:52:44.667 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.667 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.667 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:44.667 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:52:44.667 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:52:44.667 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.667 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.668 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:44.668 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:52:44.668 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:52:44.668 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.668 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.668 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:44.668 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:52:44.668 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:52:44.668 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.668 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.668 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:44.668 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:52:44.668 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:52:44.668 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.669 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.669 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:52:44.669 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:52:44.669 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:52:44.669 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.669 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.669 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:44.669 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:52:44.669 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:52:44.669 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.669 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.669 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:44.669 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:52:44.669 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:52:44.670 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.670 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.670 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:44.670 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:52:44.670 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:52:44.670 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:44.670 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:44.670 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:44.670 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.670 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.670 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:44.670 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:44.671 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 51.573393764000002, 2024-04-25T22:52:44.671 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:52:44.671 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:44.671 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:44.671 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:52:44.671 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:44.671 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.671 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:44.671 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:44.671 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:44.671 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.671 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.671 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:44.671 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:44.672 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:44.672 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.672 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.672 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:44.672 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:44.672 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:52:44.672 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.672 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.672 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:44.672 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:52:44.672 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:52:44.672 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.672 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.673 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:44.673 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:52:44.673 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:52:44.673 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.673 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.673 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:44.673 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:52:44.673 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:52:44.673 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.673 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.673 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:44.673 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:52:44.673 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:52:44.673 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.674 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.674 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:44.674 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:52:44.674 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:52:44.674 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.674 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.674 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:44.674 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:52:44.674 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:52:44.674 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:44.674 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:44.674 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:44.674 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.675 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.675 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:52:44.675 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:44.675 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 51.572952794999999, 2024-04-25T22:52:44.675 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064881979999999997, 2024-04-25T22:52:44.675 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:44.675 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:44.675 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:44.675 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:44.675 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.675 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:44.675 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:44.675 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:44.675 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.676 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.676 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:44.676 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:44.676 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:44.676 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.676 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.676 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:44.676 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:44.676 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2699999999999999e-07 2024-04-25T22:52:44.676 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.676 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.676 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:44.676 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013898+0000", 2024-04-25T22:52:44.676 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0796e-05 2024-04-25T22:52:44.677 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.677 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.677 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:44.677 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013907+0000", 2024-04-25T22:52:44.677 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5140000000000007e-06 2024-04-25T22:52:44.677 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.677 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.677 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:44.677 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013952+0000", 2024-04-25T22:52:44.677 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4134000000000001e-05 2024-04-25T22:52:44.677 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.677 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.677 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:44.677 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016812+0000", 2024-04-25T22:52:44.678 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028601059999999998 2024-04-25T22:52:44.678 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.678 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.678 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:44.678 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.017052+0000", 2024-04-25T22:52:44.678 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024056500000000001 2024-04-25T22:52:44.678 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.678 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.678 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:44.678 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020350+0000", 2024-04-25T22:52:44.678 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032978320000000001 2024-04-25T22:52:44.678 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.678 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.679 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:44.679 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020375+0000", 2024-04-25T22:52:44.679 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4624e-05 2024-04-25T22:52:44.679 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:44.679 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:44.679 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:44.679 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.679 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.679 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-25T22:52:44.679 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:44.679 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 51.559422349000002, 2024-04-25T22:52:44.679 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058583000000000003, 2024-04-25T22:52:44.679 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:44.679 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:44.680 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:44.680 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:44.680 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.680 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:44.680 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:44.680 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:44.680 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.680 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.680 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:44.680 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:44.680 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:44.680 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.680 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.681 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:44.681 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:44.681 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.41e-07 2024-04-25T22:52:44.681 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.681 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.681 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:44.681 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027428+0000", 2024-04-25T22:52:44.681 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.075e-05 2024-04-25T22:52:44.681 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.681 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.681 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:44.681 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027435+0000", 2024-04-25T22:52:44.681 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3610000000000003e-06 2024-04-25T22:52:44.681 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.681 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.682 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:44.682 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027442+0000", 2024-04-25T22:52:44.682 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0400000000000004e-06 2024-04-25T22:52:44.682 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.682 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.682 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:44.682 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028094+0000", 2024-04-25T22:52:44.682 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00065134800000000005 2024-04-25T22:52:44.682 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.682 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.682 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:44.682 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028107+0000", 2024-04-25T22:52:44.682 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3087e-05 2024-04-25T22:52:44.683 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.683 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.683 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:44.683 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033239+0000", 2024-04-25T22:52:44.683 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051319429999999999 2024-04-25T22:52:44.683 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.683 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.683 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:44.683 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033275+0000", 2024-04-25T22:52:44.683 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6430000000000002e-05 2024-04-25T22:52:44.683 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:44.683 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:44.683 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:44.683 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.683 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.684 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-25T22:52:44.684 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:44.684 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 51.559037512000003, 2024-04-25T22:52:44.684 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005413597, 2024-04-25T22:52:44.684 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:44.684 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:44.684 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:44.684 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:44.684 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.684 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:44.684 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:44.684 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:44.684 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.684 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.685 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:44.685 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:44.685 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:44.685 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.685 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.685 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:44.685 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:44.685 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3799999999999997e-07 2024-04-25T22:52:44.685 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.685 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.685 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:44.685 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027816+0000", 2024-04-25T22:52:44.685 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3230999999999999e-05 2024-04-25T22:52:44.685 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.686 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.686 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:44.686 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027823+0000", 2024-04-25T22:52:44.686 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9039999999999992e-06 2024-04-25T22:52:44.686 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.686 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.686 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:44.686 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027841+0000", 2024-04-25T22:52:44.686 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7651000000000001e-05 2024-04-25T22:52:44.686 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.686 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.686 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:44.686 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027904+0000", 2024-04-25T22:52:44.686 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3058000000000005e-05 2024-04-25T22:52:44.687 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.687 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.687 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:44.687 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027926+0000", 2024-04-25T22:52:44.687 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1450999999999998e-05 2024-04-25T22:52:44.687 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.687 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.687 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:44.687 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033177+0000", 2024-04-25T22:52:44.687 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052508909999999997 2024-04-25T22:52:44.687 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.687 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.687 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:44.687 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033215+0000", 2024-04-25T22:52:44.688 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8872999999999999e-05 2024-04-25T22:52:44.688 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:44.688 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:44.688 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:44.688 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.688 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.688 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 171 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:52:44.688 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:44.688 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 51.558980409999997, 2024-04-25T22:52:44.688 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054322240000000003, 2024-04-25T22:52:44.688 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:44.688 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:44.688 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "reached pg", 2024-04-25T22:52:44.688 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:44.689 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.689 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:44.689 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:44.689 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:44.689 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.689 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.689 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:44.689 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:44.689 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:44.689 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.689 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.689 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:44.689 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:44.689 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7500000000000001e-07 2024-04-25T22:52:44.689 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.689 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.690 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:44.690 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027868+0000", 2024-04-25T22:52:44.690 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5750000000000001e-06 2024-04-25T22:52:44.690 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.690 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.690 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:44.690 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027885+0000", 2024-04-25T22:52:44.690 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7272e-05 2024-04-25T22:52:44.690 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.690 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.690 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:44.690 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027900+0000", 2024-04-25T22:52:44.690 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.502e-05 2024-04-25T22:52:44.690 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.691 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.691 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:44.691 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028381+0000", 2024-04-25T22:52:44.691 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00048039399999999998 2024-04-25T22:52:44.691 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:44.691 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:44.691 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:44.691 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033291+0000", 2024-04-25T22:52:44.691 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049105879999999996 2024-04-25T22:52:44.691 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:44.691 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:44.691 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:44.691 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:44.691 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:44.691 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:44.693 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:44.692+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:44.693 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:52:44.793 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:44.792+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:44.804 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:44.805 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:52:44.805 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-04-25T22:52:44.805 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:44.813 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:52:44.894 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:44.893+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:44.914 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:44.914 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:52:44.914 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:52:44.915 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:52:44.915 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:44.924 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:52:44.977 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:52:44.995 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:44.994+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:45.070 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:45.071 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-04-25T22:52:45.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-04-25T22:52:45.071 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:52:45.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.071 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:45.071 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:45.071 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 57.103731754999998, 2024-04-25T22:52:45.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0103421, 2024-04-25T22:52:45.071 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:45.071 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:45.071 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:45.071 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:45.072 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:45.072 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:45.072 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 115 2024-04-25T22:52:45.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.072 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:45.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:45.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:45.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:45.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:45.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:45.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:45.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:45.073 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:45.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9500000000000002e-07 2024-04-25T22:52:45.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:45.073 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965108+0000", 2024-04-25T22:52:45.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9177999999999994e-05 2024-04-25T22:52:45.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:45.074 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965127+0000", 2024-04-25T22:52:45.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8868e-05 2024-04-25T22:52:45.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.074 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:45.074 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965133+0000", 2024-04-25T22:52:45.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8929999999999999e-06 2024-04-25T22:52:45.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.074 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:45.074 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.969991+0000", 2024-04-25T22:52:45.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048573849999999997 2024-04-25T22:52:45.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:45.075 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970072+0000", 2024-04-25T22:52:45.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0728000000000004e-05 2024-04-25T22:52:45.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:45.075 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970189+0000", 2024-04-25T22:52:45.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000117778 2024-04-25T22:52:45.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:45.075 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970946+0000", 2024-04-25T22:52:45.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00075704600000000004 2024-04-25T22:52:45.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.076 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:45.076 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975297+0000", 2024-04-25T22:52:45.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004350217 2024-04-25T22:52:45.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.076 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:45.076 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975343+0000", 2024-04-25T22:52:45.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6687999999999998e-05 2024-04-25T22:52:45.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.076 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:45.076 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975380+0000", 2024-04-25T22:52:45.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6724000000000003e-05 2024-04-25T22:52:45.077 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:45.077 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:45.077 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:45.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.077 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:45.077 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:45.077 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 57.103625723999997, 2024-04-25T22:52:45.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010304384, 2024-04-25T22:52:45.077 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:45.077 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:45.077 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:45.077 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:45.078 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:45.078 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:45.078 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 116 2024-04-25T22:52:45.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.078 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:45.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:45.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:45.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:45.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:45.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:45.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:45.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:45.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:45.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5799999999999999e-07 2024-04-25T22:52:45.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:45.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965154+0000", 2024-04-25T22:52:45.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0009e-05 2024-04-25T22:52:45.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:45.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965164+0000", 2024-04-25T22:52:45.080 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8490000000000001e-06 2024-04-25T22:52:45.080 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.080 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.080 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:45.080 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965169+0000", 2024-04-25T22:52:45.080 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0730000000000004e-06 2024-04-25T22:52:45.080 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.080 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.080 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:45.080 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970609+0000", 2024-04-25T22:52:45.080 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054397689999999997 2024-04-25T22:52:45.080 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.080 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.080 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:45.081 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970651+0000", 2024-04-25T22:52:45.081 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1873999999999999e-05 2024-04-25T22:52:45.081 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.081 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.081 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:45.081 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970723+0000", 2024-04-25T22:52:45.081 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2039999999999995e-05 2024-04-25T22:52:45.081 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.081 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.081 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:45.081 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971358+0000", 2024-04-25T22:52:45.081 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063489500000000001 2024-04-25T22:52:45.081 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.081 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.081 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:45.082 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975409+0000", 2024-04-25T22:52:45.082 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040506880000000002 2024-04-25T22:52:45.082 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.082 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.082 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:45.082 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975432+0000", 2024-04-25T22:52:45.082 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3315999999999998e-05 2024-04-25T22:52:45.082 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.082 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.082 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:45.082 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975448+0000", 2024-04-25T22:52:45.082 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6313000000000001e-05 2024-04-25T22:52:45.082 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:45.082 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:45.083 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:45.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.083 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.083 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:45.083 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:45.083 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 57.103591141999999, 2024-04-25T22:52:45.083 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010384338999999999, 2024-04-25T22:52:45.083 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:45.083 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:45.083 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:45.083 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:45.083 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:45.083 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:45.083 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-04-25T22:52:45.084 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.084 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:45.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.084 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:45.084 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:45.084 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:45.084 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.084 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:45.084 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:45.084 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:45.084 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.084 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:45.085 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:45.085 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3600000000000004e-07 2024-04-25T22:52:45.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.085 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.085 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:45.085 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965185+0000", 2024-04-25T22:52:45.085 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.117e-06 2024-04-25T22:52:45.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.085 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.085 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:45.085 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965192+0000", 2024-04-25T22:52:45.085 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3239999999999997e-06 2024-04-25T22:52:45.086 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.086 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.086 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:45.086 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965198+0000", 2024-04-25T22:52:45.086 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6370000000000004e-06 2024-04-25T22:52:45.086 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.086 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.086 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:45.086 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970973+0000", 2024-04-25T22:52:45.086 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057748239999999996 2024-04-25T22:52:45.086 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.086 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.086 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:45.086 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971049+0000", 2024-04-25T22:52:45.087 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6029e-05 2024-04-25T22:52:45.087 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.087 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.087 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:45.087 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971174+0000", 2024-04-25T22:52:45.087 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012462399999999999 2024-04-25T22:52:45.087 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.087 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.087 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:45.087 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971553+0000", 2024-04-25T22:52:45.087 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037896499999999999 2024-04-25T22:52:45.087 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.087 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.088 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:45.088 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975482+0000", 2024-04-25T22:52:45.088 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039297459999999996 2024-04-25T22:52:45.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.088 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.088 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:45.088 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975529+0000", 2024-04-25T22:52:45.088 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6387000000000002e-05 2024-04-25T22:52:45.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.088 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.088 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:45.088 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975563+0000", 2024-04-25T22:52:45.088 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4150000000000003e-05 2024-04-25T22:52:45.089 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:45.089 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:45.089 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:45.089 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.089 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.089 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:45.089 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:45.089 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 52.056544819000003, 2024-04-25T22:52:45.089 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012637705000000001, 2024-04-25T22:52:45.089 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:45.089 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:45.089 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:45.089 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:45.089 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.090 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:45.090 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:45.090 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:45.090 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.090 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.090 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:45.090 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:45.090 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:45.090 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.090 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.090 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:45.090 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012227+0000", 2024-04-25T22:52:45.090 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.863e-06 2024-04-25T22:52:45.091 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.091 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.091 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:45.091 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012236+0000", 2024-04-25T22:52:45.091 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1109999999999997e-06 2024-04-25T22:52:45.091 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.091 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.091 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:45.091 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012309+0000", 2024-04-25T22:52:45.091 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3242000000000001e-05 2024-04-25T22:52:45.091 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.091 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.091 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:45.091 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012324+0000", 2024-04-25T22:52:45.092 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4837e-05 2024-04-25T22:52:45.092 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.092 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.092 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:45.092 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015060+0000", 2024-04-25T22:52:45.092 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027363349999999999 2024-04-25T22:52:45.092 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.092 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.092 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:45.092 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015169+0000", 2024-04-25T22:52:45.092 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108372 2024-04-25T22:52:45.092 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.092 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.092 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:45.092 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015498+0000", 2024-04-25T22:52:45.093 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032949999999999999 2024-04-25T22:52:45.093 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.093 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.093 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:45.093 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021282+0000", 2024-04-25T22:52:45.093 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057836429999999998 2024-04-25T22:52:45.093 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.093 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.093 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:45.093 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024709+0000", 2024-04-25T22:52:45.093 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034271979999999998 2024-04-25T22:52:45.093 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.093 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.093 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:45.094 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024802+0000", 2024-04-25T22:52:45.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2960000000000004e-05 2024-04-25T22:52:45.094 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.094 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.094 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:45.094 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024863+0000", 2024-04-25T22:52:45.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0643999999999997e-05 2024-04-25T22:52:45.094 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:45.094 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:45.094 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:45.094 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.094 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.094 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:45.094 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:45.094 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 52.056421047999997, 2024-04-25T22:52:45.095 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012979447999999999, 2024-04-25T22:52:45.095 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:45.095 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:45.095 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:45.095 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:45.095 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.095 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:45.095 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:45.095 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:45.095 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.095 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.095 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:45.095 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:45.095 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:45.095 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.096 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:45.096 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:45.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:52:45.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.096 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:45.096 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012354+0000", 2024-04-25T22:52:45.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7740000000000004e-06 2024-04-25T22:52:45.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.096 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:45.096 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012365+0000", 2024-04-25T22:52:45.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.064e-05 2024-04-25T22:52:45.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.097 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:45.097 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012382+0000", 2024-04-25T22:52:45.097 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6999000000000001e-05 2024-04-25T22:52:45.097 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.097 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:45.097 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015958+0000", 2024-04-25T22:52:45.097 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035765699999999998 2024-04-25T22:52:45.097 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.097 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:45.097 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016037+0000", 2024-04-25T22:52:45.097 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8242000000000001e-05 2024-04-25T22:52:45.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.098 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:45.098 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016404+0000", 2024-04-25T22:52:45.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036784300000000002 2024-04-25T22:52:45.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.098 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:45.098 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021294+0000", 2024-04-25T22:52:45.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048890629999999999 2024-04-25T22:52:45.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.098 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:45.099 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024959+0000", 2024-04-25T22:52:45.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036651570000000001 2024-04-25T22:52:45.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.099 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:45.099 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025097+0000", 2024-04-25T22:52:45.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013788099999999999 2024-04-25T22:52:45.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.099 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:45.099 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025328+0000", 2024-04-25T22:52:45.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231492 2024-04-25T22:52:45.099 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:45.099 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:45.100 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:45.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.100 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:45.100 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:45.100 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 52.056333279, 2024-04-25T22:52:45.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013049827, 2024-04-25T22:52:45.100 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:45.100 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:45.100 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:45.100 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:45.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.100 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:45.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:45.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:45.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:45.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:45.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:45.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:45.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012437+0000", 2024-04-25T22:52:45.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-04-25T22:52:45.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:45.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012440+0000", 2024-04-25T22:52:45.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7609999999999999e-06 2024-04-25T22:52:45.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:45.102 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012449+0000", 2024-04-25T22:52:45.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.285e-06 2024-04-25T22:52:45.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:45.102 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012457+0000", 2024-04-25T22:52:45.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9510000000000006e-06 2024-04-25T22:52:45.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.103 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:45.103 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017106+0000", 2024-04-25T22:52:45.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046494220000000003 2024-04-25T22:52:45.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.103 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:45.103 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017223+0000", 2024-04-25T22:52:45.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116824 2024-04-25T22:52:45.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.103 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:45.103 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017345+0000", 2024-04-25T22:52:45.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122175 2024-04-25T22:52:45.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.104 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:45.104 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021299+0000", 2024-04-25T22:52:45.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039534879999999998 2024-04-25T22:52:45.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.104 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:45.104 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025398+0000", 2024-04-25T22:52:45.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040988960000000003 2024-04-25T22:52:45.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.104 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:45.104 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025439+0000", 2024-04-25T22:52:45.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0915999999999999e-05 2024-04-25T22:52:45.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:45.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025486+0000", 2024-04-25T22:52:45.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7534999999999998e-05 2024-04-25T22:52:45.105 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:45.105 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:45.105 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:45.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.105 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:45.105 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:45.105 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 52.056303128000003, 2024-04-25T22:52:45.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020988041999999998, 2024-04-25T22:52:45.106 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:45.106 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:45.106 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:45.106 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:45.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:45.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:45.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:45.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:45.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:45.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:45.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:45.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:45.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.99e-07 2024-04-25T22:52:45.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:45.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012470+0000", 2024-04-25T22:52:45.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2789999999999999e-06 2024-04-25T22:52:45.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:45.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012477+0000", 2024-04-25T22:52:45.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:52:45.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.108 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:45.108 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012500+0000", 2024-04-25T22:52:45.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2490999999999999e-05 2024-04-25T22:52:45.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.108 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:45.108 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021911+0000", 2024-04-25T22:52:45.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094114160000000006 2024-04-25T22:52:45.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.108 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:45.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022000+0000", 2024-04-25T22:52:45.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8601000000000001e-05 2024-04-25T22:52:45.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:45.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022359+0000", 2024-04-25T22:52:45.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035921999999999999 2024-04-25T22:52:45.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:45.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025541+0000", 2024-04-25T22:52:45.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031820619999999998 2024-04-25T22:52:45.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:45.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033375+0000", 2024-04-25T22:52:45.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078338379999999992 2024-04-25T22:52:45.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:45.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033415+0000", 2024-04-25T22:52:45.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9527000000000003e-05 2024-04-25T22:52:45.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:45.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033455+0000", 2024-04-25T22:52:45.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9932000000000003e-05 2024-04-25T22:52:45.110 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:45.111 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:45.111 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:45.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.111 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:45.111 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:45.111 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 52.056247935000002, 2024-04-25T22:52:45.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021043857999999999, 2024-04-25T22:52:45.111 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:45.111 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:45.111 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:45.111 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:45.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.111 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:45.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:45.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:45.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:45.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:45.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:45.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:45.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012523+0000", 2024-04-25T22:52:45.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.361e-06 2024-04-25T22:52:45.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:45.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012530+0000", 2024-04-25T22:52:45.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5440000000000004e-06 2024-04-25T22:52:45.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.113 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:45.113 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012541+0000", 2024-04-25T22:52:45.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1745e-05 2024-04-25T22:52:45.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.113 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:45.113 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012551+0000", 2024-04-25T22:52:45.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5789999999999993e-06 2024-04-25T22:52:45.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.113 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:45.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022709+0000", 2024-04-25T22:52:45.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010157685 2024-04-25T22:52:45.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:45.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022957+0000", 2024-04-25T22:52:45.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024824599999999998 2024-04-25T22:52:45.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:45.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023443+0000", 2024-04-25T22:52:45.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048578599999999999 2024-04-25T22:52:45.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:45.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025547+0000", 2024-04-25T22:52:45.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021044789999999998 2024-04-25T22:52:45.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:45.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033509+0000", 2024-04-25T22:52:45.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0079622180000000001 2024-04-25T22:52:45.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:45.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033542+0000", 2024-04-25T22:52:45.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3018000000000001e-05 2024-04-25T22:52:45.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:45.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033566+0000", 2024-04-25T22:52:45.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3197000000000002e-05 2024-04-25T22:52:45.116 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:45.116 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:45.116 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:45.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.116 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:45.116 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:45.116 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 52.056207970000003, 2024-04-25T22:52:45.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021122696, 2024-04-25T22:52:45.116 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:45.117 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:45.117 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:45.117 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:45.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.117 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:45.117 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:45.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:45.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.117 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:45.117 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:45.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:45.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:45.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:45.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:52:45.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:45.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012566+0000", 2024-04-25T22:52:45.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-04-25T22:52:45.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:45.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012619+0000", 2024-04-25T22:52:45.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2607e-05 2024-04-25T22:52:45.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:45.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012628+0000", 2024-04-25T22:52:45.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6500000000000008e-06 2024-04-25T22:52:45.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:45.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024024+0000", 2024-04-25T22:52:45.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011396007999999999 2024-04-25T22:52:45.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:45.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024198+0000", 2024-04-25T22:52:45.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000173215 2024-04-25T22:52:45.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:45.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024447+0000", 2024-04-25T22:52:45.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024898500000000002 2024-04-25T22:52:45.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:45.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026431+0000", 2024-04-25T22:52:45.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001984923 2024-04-25T22:52:45.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:45.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033608+0000", 2024-04-25T22:52:45.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071768459999999997 2024-04-25T22:52:45.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:45.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033646+0000", 2024-04-25T22:52:45.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299000000000003e-05 2024-04-25T22:52:45.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:45.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033684+0000", 2024-04-25T22:52:45.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8773000000000003e-05 2024-04-25T22:52:45.121 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:45.122 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:45.122 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:45.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.122 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:45.122 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:45.122 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 52.056119371000001, 2024-04-25T22:52:45.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021175381, 2024-04-25T22:52:45.122 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:45.122 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:45.122 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:45.122 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:45.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:45.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:45.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:45.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:45.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:45.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:45.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:45.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012651+0000", 2024-04-25T22:52:45.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:52:45.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:45.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012656+0000", 2024-04-25T22:52:45.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8899999999999998e-06 2024-04-25T22:52:45.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:45.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012666+0000", 2024-04-25T22:52:45.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0346999999999999e-05 2024-04-25T22:52:45.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:45.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012675+0000", 2024-04-25T22:52:45.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9930000000000001e-06 2024-04-25T22:52:45.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:45.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025661+0000", 2024-04-25T22:52:45.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01298531 2024-04-25T22:52:45.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:45.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025757+0000", 2024-04-25T22:52:45.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5822000000000005e-05 2024-04-25T22:52:45.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:45.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025907+0000", 2024-04-25T22:52:45.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015051499999999999 2024-04-25T22:52:45.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:45.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026435+0000", 2024-04-25T22:52:45.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052762200000000005 2024-04-25T22:52:45.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:45.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033732+0000", 2024-04-25T22:52:45.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072978419999999997 2024-04-25T22:52:45.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:45.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033787+0000", 2024-04-25T22:52:45.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4703999999999997e-05 2024-04-25T22:52:45.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:45.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033826+0000", 2024-04-25T22:52:45.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8458999999999999e-05 2024-04-25T22:52:45.127 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:45.127 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:45.127 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:45.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.128 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:45.128 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:45.128 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 52.056063956999999, 2024-04-25T22:52:45.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021244174000000001, 2024-04-25T22:52:45.128 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:45.128 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:45.128 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:45.128 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:45.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:45.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:45.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:45.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:45.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:45.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:45.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:45.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:45.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:52:45.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:45.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012712+0000", 2024-04-25T22:52:45.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.913e-06 2024-04-25T22:52:45.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:45.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012722+0000", 2024-04-25T22:52:45.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2879999999999998e-06 2024-04-25T22:52:45.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:45.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012727+0000", 2024-04-25T22:52:45.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8429999999999998e-06 2024-04-25T22:52:45.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:45.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026099+0000", 2024-04-25T22:52:45.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013371450999999999 2024-04-25T22:52:45.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:45.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026147+0000", 2024-04-25T22:52:45.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7837999999999998e-05 2024-04-25T22:52:45.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:45.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026254+0000", 2024-04-25T22:52:45.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107314 2024-04-25T22:52:45.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:45.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026686+0000", 2024-04-25T22:52:45.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000432428 2024-04-25T22:52:45.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:45.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033873+0000", 2024-04-25T22:52:45.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071864399999999997 2024-04-25T22:52:45.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:45.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033904+0000", 2024-04-25T22:52:45.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1321e-05 2024-04-25T22:52:45.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:45.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033950+0000", 2024-04-25T22:52:45.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5707999999999997e-05 2024-04-25T22:52:45.133 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:45.133 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:45.133 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:45.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.133 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:45.133 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:45.133 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 52.056033571999997, 2024-04-25T22:52:45.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01096505, 2024-04-25T22:52:45.134 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:45.134 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:45.134 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:45.134 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:45.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:45.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:45.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:45.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:45.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:45.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:45.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:45.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012737+0000", 2024-04-25T22:52:45.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:52:45.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:45.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012739+0000", 2024-04-25T22:52:45.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-04-25T22:52:45.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:45.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012743+0000", 2024-04-25T22:52:45.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3239999999999996e-06 2024-04-25T22:52:45.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:45.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012746+0000", 2024-04-25T22:52:45.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.129e-06 2024-04-25T22:52:45.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:45.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012796+0000", 2024-04-25T22:52:45.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9231999999999999e-05 2024-04-25T22:52:45.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:45.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012915+0000", 2024-04-25T22:52:45.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119021 2024-04-25T22:52:45.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:45.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013069+0000", 2024-04-25T22:52:45.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015463900000000001 2024-04-25T22:52:45.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:45.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019237+0000", 2024-04-25T22:52:45.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061680329999999998 2024-04-25T22:52:45.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:45.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023603+0000", 2024-04-25T22:52:45.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043655860000000003 2024-04-25T22:52:45.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:45.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023659+0000", 2024-04-25T22:52:45.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6484000000000003e-05 2024-04-25T22:52:45.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:45.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023701+0000", 2024-04-25T22:52:45.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1761999999999998e-05 2024-04-25T22:52:45.138 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:45.138 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:45.138 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:45.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.139 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:45.139 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:45.139 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 52.056008624, 2024-04-25T22:52:45.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011234429000000001, 2024-04-25T22:52:45.139 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:45.139 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:45.139 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:45.139 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:45.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.139 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:45.139 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:45.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:45.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:45.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:45.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:45.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:45.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012762+0000", 2024-04-25T22:52:45.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-04-25T22:52:45.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:45.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012765+0000", 2024-04-25T22:52:45.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2569999999999999e-06 2024-04-25T22:52:45.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:45.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012783+0000", 2024-04-25T22:52:45.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8431999999999999e-05 2024-04-25T22:52:45.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:45.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012799+0000", 2024-04-25T22:52:45.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5438999999999999e-05 2024-04-25T22:52:45.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:45.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013826+0000", 2024-04-25T22:52:45.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010275060000000001 2024-04-25T22:52:45.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:45.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013913+0000", 2024-04-25T22:52:45.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.708e-05 2024-04-25T22:52:45.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:45.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014098+0000", 2024-04-25T22:52:45.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018519399999999999 2024-04-25T22:52:45.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.143 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:45.143 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019684+0000", 2024-04-25T22:52:45.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055860079999999999 2024-04-25T22:52:45.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.143 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:45.143 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023876+0000", 2024-04-25T22:52:45.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041918800000000003 2024-04-25T22:52:45.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.143 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:45.143 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023957+0000", 2024-04-25T22:52:45.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1165e-05 2024-04-25T22:52:45.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.144 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:45.144 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023995+0000", 2024-04-25T22:52:45.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:52:45.144 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:45.144 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:45.144 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:45.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.144 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:45.144 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:45.144 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 52.055910845, 2024-04-25T22:52:45.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011131200000000001, 2024-04-25T22:52:45.144 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:45.144 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:45.144 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:45.145 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:45.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:45.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:45.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:45.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:45.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:45.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:45.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:45.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012860+0000", 2024-04-25T22:52:45.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3900000000000004e-07 2024-04-25T22:52:45.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:45.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012865+0000", 2024-04-25T22:52:45.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5609999999999998e-06 2024-04-25T22:52:45.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:45.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012895+0000", 2024-04-25T22:52:45.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9847000000000001e-05 2024-04-25T22:52:45.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:45.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012905+0000", 2024-04-25T22:52:45.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.03e-05 2024-04-25T22:52:45.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:45.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015020+0000", 2024-04-25T22:52:45.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021142940000000001 2024-04-25T22:52:45.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:45.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015182+0000", 2024-04-25T22:52:45.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016248099999999999 2024-04-25T22:52:45.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:52:45.148 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015357+0000", 2024-04-25T22:52:45.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017471000000000001 2024-04-25T22:52:45.148 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.148 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:45.148 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021021+0000", 2024-04-25T22:52:45.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056638340000000004 2024-04-25T22:52:45.148 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.148 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:45.148 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023712+0000", 2024-04-25T22:52:45.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026910380000000002 2024-04-25T22:52:45.148 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:45.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023763+0000", 2024-04-25T22:52:45.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1477999999999997e-05 2024-04-25T22:52:45.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:45.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023990+0000", 2024-04-25T22:52:45.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000226818 2024-04-25T22:52:45.149 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:45.149 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:45.149 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:45.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.150 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:45.150 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:45.150 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 52.055787748999997, 2024-04-25T22:52:45.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011705299000000001, 2024-04-25T22:52:45.150 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:45.150 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:45.150 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:45.150 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:45.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:45.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:45.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:45.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:45.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:45.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:45.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:45.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012983+0000", 2024-04-25T22:52:45.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:52:45.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:45.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012986+0000", 2024-04-25T22:52:45.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5700000000000001e-06 2024-04-25T22:52:45.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:45.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012993+0000", 2024-04-25T22:52:45.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8730000000000001e-06 2024-04-25T22:52:45.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:45.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013000+0000", 2024-04-25T22:52:45.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1890000000000001e-06 2024-04-25T22:52:45.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:45.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:52:45.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002147866 2024-04-25T22:52:45.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:45.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015351+0000", 2024-04-25T22:52:45.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020300799999999999 2024-04-25T22:52:45.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:45.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016260+0000", 2024-04-25T22:52:45.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00090926799999999997 2024-04-25T22:52:45.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:45.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022669+0000", 2024-04-25T22:52:45.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064082849999999997 2024-04-25T22:52:45.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:45.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024584+0000", 2024-04-25T22:52:45.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019151699999999999 2024-04-25T22:52:45.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:45.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024643+0000", 2024-04-25T22:52:45.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8888999999999998e-05 2024-04-25T22:52:45.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:45.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024687+0000", 2024-04-25T22:52:45.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4444999999999999e-05 2024-04-25T22:52:45.156 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:45.156 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:45.156 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:45.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.157 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:45.157 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:45.157 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 52.055760157999998, 2024-04-25T22:52:45.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011249699, 2024-04-25T22:52:45.157 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:45.157 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:45.157 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:45.157 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:45.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:45.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:45.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:45.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:45.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:45.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:45.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:45.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013010+0000", 2024-04-25T22:52:45.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2099999999999996e-07 2024-04-25T22:52:45.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:45.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013013+0000", 2024-04-25T22:52:45.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1310000000000002e-06 2024-04-25T22:52:45.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:45.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013020+0000", 2024-04-25T22:52:45.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3330000000000002e-06 2024-04-25T22:52:45.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:45.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013025+0000", 2024-04-25T22:52:45.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6760000000000004e-06 2024-04-25T22:52:45.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:45.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013163+0000", 2024-04-25T22:52:45.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013824599999999999 2024-04-25T22:52:45.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:45.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013504+0000", 2024-04-25T22:52:45.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034080299999999998 2024-04-25T22:52:45.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:45.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013613+0000", 2024-04-25T22:52:45.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108705 2024-04-25T22:52:45.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:45.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015831+0000", 2024-04-25T22:52:45.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002217672 2024-04-25T22:52:45.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:45.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024137+0000", 2024-04-25T22:52:45.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0083060489999999994 2024-04-25T22:52:45.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:45.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024218+0000", 2024-04-25T22:52:45.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1351000000000001e-05 2024-04-25T22:52:45.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:45.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024259+0000", 2024-04-25T22:52:45.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1112000000000002e-05 2024-04-25T22:52:45.162 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:45.162 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:45.162 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:45.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.162 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:45.162 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:45.162 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 52.055672432000001, 2024-04-25T22:52:45.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020379749999999999, 2024-04-25T22:52:45.162 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:45.162 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:45.162 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:45.163 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:45.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:45.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:45.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:45.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:45.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:45.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:45.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:45.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013098+0000", 2024-04-25T22:52:45.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:52:45.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:45.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013105+0000", 2024-04-25T22:52:45.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5969999999999997e-06 2024-04-25T22:52:45.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:45.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013190+0000", 2024-04-25T22:52:45.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5618999999999995e-05 2024-04-25T22:52:45.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:45.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013200+0000", 2024-04-25T22:52:45.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5859999999999994e-06 2024-04-25T22:52:45.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:45.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020265+0000", 2024-04-25T22:52:45.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070653349999999998 2024-04-25T22:52:45.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:45.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020454+0000", 2024-04-25T22:52:45.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189316 2024-04-25T22:52:45.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:45.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020586+0000", 2024-04-25T22:52:45.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013195700000000001 2024-04-25T22:52:45.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:45.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023822+0000", 2024-04-25T22:52:45.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032358529999999999 2024-04-25T22:52:45.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:45.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033409+0000", 2024-04-25T22:52:45.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095870520000000004 2024-04-25T22:52:45.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:45.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033447+0000", 2024-04-25T22:52:45.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7261999999999997e-05 2024-04-25T22:52:45.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:45.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033477+0000", 2024-04-25T22:52:45.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0389e-05 2024-04-25T22:52:45.167 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:45.167 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:45.167 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:45.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.167 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:45.167 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:45.168 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 52.055555925999997, 2024-04-25T22:52:45.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010857383999999999, 2024-04-25T22:52:45.168 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:45.168 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:45.168 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:45.168 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:45.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:45.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:45.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:45.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:45.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:45.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:45.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:45.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:45.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:52:45.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:45.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013218+0000", 2024-04-25T22:52:45.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8199999999999998e-06 2024-04-25T22:52:45.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:45.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013226+0000", 2024-04-25T22:52:45.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7649999999999993e-06 2024-04-25T22:52:45.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:45.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013259+0000", 2024-04-25T22:52:45.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2727e-05 2024-04-25T22:52:45.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:45.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014809+0000", 2024-04-25T22:52:45.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001550144 2024-04-25T22:52:45.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:45.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014958+0000", 2024-04-25T22:52:45.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014890300000000001 2024-04-25T22:52:45.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:52:45.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015087+0000", 2024-04-25T22:52:45.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012939200000000001 2024-04-25T22:52:45.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:45.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020212+0000", 2024-04-25T22:52:45.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051248939999999996 2024-04-25T22:52:45.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:45.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023699+0000", 2024-04-25T22:52:45.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034873289999999999 2024-04-25T22:52:45.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:45.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024014+0000", 2024-04-25T22:52:45.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031473999999999999 2024-04-25T22:52:45.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:45.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024071+0000", 2024-04-25T22:52:45.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7040000000000003e-05 2024-04-25T22:52:45.172 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:45.173 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:45.173 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:45.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.173 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:45.173 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:45.173 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 52.055501221, 2024-04-25T22:52:45.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012329677000000001, 2024-04-25T22:52:45.173 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:45.173 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:45.173 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:45.173 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:45.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:45.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:45.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:45.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:45.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:45.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:45.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:45.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013269+0000", 2024-04-25T22:52:45.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5000000000000002e-07 2024-04-25T22:52:45.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:45.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:52:45.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6909999999999999e-06 2024-04-25T22:52:45.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:45.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013284+0000", 2024-04-25T22:52:45.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0963e-05 2024-04-25T22:52:45.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:45.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013361+0000", 2024-04-25T22:52:45.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7379999999999994e-05 2024-04-25T22:52:45.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:45.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013448+0000", 2024-04-25T22:52:45.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6990000000000006e-05 2024-04-25T22:52:45.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:45.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013632+0000", 2024-04-25T22:52:45.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018396800000000001 2024-04-25T22:52:45.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:45.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013800+0000", 2024-04-25T22:52:45.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167467 2024-04-25T22:52:45.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:45.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.018570+0000", 2024-04-25T22:52:45.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047701460000000003 2024-04-25T22:52:45.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:45.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025507+0000", 2024-04-25T22:52:45.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069372039999999998 2024-04-25T22:52:45.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:45.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025562+0000", 2024-04-25T22:52:45.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4858999999999998e-05 2024-04-25T22:52:45.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:45.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025598+0000", 2024-04-25T22:52:45.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6259e-05 2024-04-25T22:52:45.178 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:45.178 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:45.178 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:45.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.178 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:45.178 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:45.178 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 52.055369347999999, 2024-04-25T22:52:45.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020176666999999999, 2024-04-25T22:52:45.178 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:45.179 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:45.179 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:52:45.179 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:45.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:45.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:45.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:45.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:45.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:45.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:45.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:45.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:52:45.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-04-25T22:52:45.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:45.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013405+0000", 2024-04-25T22:52:45.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0559999999999998e-06 2024-04-25T22:52:45.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:45.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013422+0000", 2024-04-25T22:52:45.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6770999999999999e-05 2024-04-25T22:52:45.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:45.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013431+0000", 2024-04-25T22:52:45.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5019999999999998e-06 2024-04-25T22:52:45.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:45.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021720+0000", 2024-04-25T22:52:45.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082884340000000008 2024-04-25T22:52:45.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:45.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022122+0000", 2024-04-25T22:52:45.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000401634 2024-04-25T22:52:45.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:45.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:45.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:45.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033577+0000", 2024-04-25T22:52:45.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011455435999999999 2024-04-25T22:52:45.182 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:45.182 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:45.182 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:45.182 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:45.182 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:45.182 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:45.183 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-25T22:52:45.184 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:52:45.184 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:52:45.184 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-25T22:52:45.185 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:52:45.185 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:45.183+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:45.185 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:52:45.186 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:52:45.186 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:52:45.187 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is unset 2024-04-25T22:52:45.284 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:45.283+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:45.291 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:45.291 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:45.299 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:52:45.385 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:45.384+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:45.400 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:45.401 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:45.409 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:52:45.486 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:45.485+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:45.513 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:45.513 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:45.522 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:52:45.587 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:45.586+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:45.629 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:45.629 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:45.638 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:52:45.723 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:45.722+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:45.780 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:45.781 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:45.789 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:52:45.789 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:45.788+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:45.889 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:45.888+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:45.931 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:45.931 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:45.940 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:52:45.990 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:45.989+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:46.045 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:46.045 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:46.054 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:52:46.091 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:46.091+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:46.192 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:46.192+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:46.197 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:46.197 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:46.206 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:52:46.290 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T22:52:46.300 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:46.300+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:46.308 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:46.308 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:46.317 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:52:46.401 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:46.400+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:46.401 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on 2024-04-25T22:52:46.424 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:46.424 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:46.433 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:52:46.516 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:46.516+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:46.575 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:46.575 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:46.583 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:52:46.603 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:46.602+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:46.703 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:46.703+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:46.725 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:46.725 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:46.734 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:52:46.805 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:46.804+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:46.838 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:46.838 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:46.847 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:52:46.906 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:46.905+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:46.950 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:46.950 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:46.958 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:52:47.007 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:47.006+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:47.062 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:47.062 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:47.071 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:52:47.107 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:47.106+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:47.175 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:47.175 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:47.184 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:52:47.187 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:52:47.188 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-25T22:52:47.208 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:47.207+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:47.285 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:47.285 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:47.294 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:52:47.309 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:47.308+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:47.319 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-25T22:52:47.320 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:52:47.320 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:52:47.339 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-25T22:52:47.339 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:52:47.342 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:52:47.342 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:52:47.398 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:47.398 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-04-25T22:52:47.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-04-25T22:52:47.399 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:52:47.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.399 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:47.399 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:47.399 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 59.431037058999998, 2024-04-25T22:52:47.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0103421, 2024-04-25T22:52:47.399 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:47.400 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:47.400 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:47.400 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:47.400 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:47.400 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:47.400 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 115 2024-04-25T22:52:47.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.400 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:47.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:47.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:47.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:47.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:47.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:47.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:47.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:47.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:47.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9500000000000002e-07 2024-04-25T22:52:47.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:47.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965108+0000", 2024-04-25T22:52:47.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9177999999999994e-05 2024-04-25T22:52:47.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:47.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965127+0000", 2024-04-25T22:52:47.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8868e-05 2024-04-25T22:52:47.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:47.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965133+0000", 2024-04-25T22:52:47.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8929999999999999e-06 2024-04-25T22:52:47.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:47.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.969991+0000", 2024-04-25T22:52:47.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048573849999999997 2024-04-25T22:52:47.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:47.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970072+0000", 2024-04-25T22:52:47.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0728000000000004e-05 2024-04-25T22:52:47.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:47.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970189+0000", 2024-04-25T22:52:47.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000117778 2024-04-25T22:52:47.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:47.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970946+0000", 2024-04-25T22:52:47.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00075704600000000004 2024-04-25T22:52:47.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:47.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975297+0000", 2024-04-25T22:52:47.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004350217 2024-04-25T22:52:47.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:47.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975343+0000", 2024-04-25T22:52:47.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6687999999999998e-05 2024-04-25T22:52:47.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:47.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975380+0000", 2024-04-25T22:52:47.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6724000000000003e-05 2024-04-25T22:52:47.406 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:47.406 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:47.406 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:47.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.406 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:47.406 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:47.406 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 59.430931028000003, 2024-04-25T22:52:47.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010304384, 2024-04-25T22:52:47.406 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:47.406 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:47.406 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:47.407 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:47.407 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:47.407 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:47.407 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 116 2024-04-25T22:52:47.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.407 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:47.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:47.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:47.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:47.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:47.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:47.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:47.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:47.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:47.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5799999999999999e-07 2024-04-25T22:52:47.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:47.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965154+0000", 2024-04-25T22:52:47.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0009e-05 2024-04-25T22:52:47.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:47.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965164+0000", 2024-04-25T22:52:47.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8490000000000001e-06 2024-04-25T22:52:47.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:47.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965169+0000", 2024-04-25T22:52:47.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0730000000000004e-06 2024-04-25T22:52:47.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:47.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970609+0000", 2024-04-25T22:52:47.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054397689999999997 2024-04-25T22:52:47.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:47.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970651+0000", 2024-04-25T22:52:47.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1873999999999999e-05 2024-04-25T22:52:47.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:47.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970723+0000", 2024-04-25T22:52:47.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2039999999999995e-05 2024-04-25T22:52:47.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:47.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971358+0000", 2024-04-25T22:52:47.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063489500000000001 2024-04-25T22:52:47.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:47.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975409+0000", 2024-04-25T22:52:47.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040506880000000002 2024-04-25T22:52:47.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:47.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975432+0000", 2024-04-25T22:52:47.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3315999999999998e-05 2024-04-25T22:52:47.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:47.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975448+0000", 2024-04-25T22:52:47.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6313000000000001e-05 2024-04-25T22:52:47.412 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:47.412 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:47.412 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:47.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.412 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:47.412 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:47.412 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 59.430896445999998, 2024-04-25T22:52:47.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010384338999999999, 2024-04-25T22:52:47.412 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:47.412 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:47.412 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:47.413 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:47.413 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:47.413 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:47.413 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-04-25T22:52:47.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.413 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:47.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:47.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:47.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:47.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:47.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:47.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:47.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:47.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:47.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3600000000000004e-07 2024-04-25T22:52:47.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:47.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965185+0000", 2024-04-25T22:52:47.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.117e-06 2024-04-25T22:52:47.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:47.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965192+0000", 2024-04-25T22:52:47.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3239999999999997e-06 2024-04-25T22:52:47.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:47.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965198+0000", 2024-04-25T22:52:47.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6370000000000004e-06 2024-04-25T22:52:47.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:47.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970973+0000", 2024-04-25T22:52:47.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057748239999999996 2024-04-25T22:52:47.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:47.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971049+0000", 2024-04-25T22:52:47.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6029e-05 2024-04-25T22:52:47.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:47.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971174+0000", 2024-04-25T22:52:47.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012462399999999999 2024-04-25T22:52:47.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:47.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971553+0000", 2024-04-25T22:52:47.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037896499999999999 2024-04-25T22:52:47.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:47.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975482+0000", 2024-04-25T22:52:47.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039297459999999996 2024-04-25T22:52:47.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:47.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975529+0000", 2024-04-25T22:52:47.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6387000000000002e-05 2024-04-25T22:52:47.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:47.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975563+0000", 2024-04-25T22:52:47.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4150000000000003e-05 2024-04-25T22:52:47.418 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:47.418 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:47.418 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:47.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.418 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:47.418 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:47.418 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 54.383850123000002, 2024-04-25T22:52:47.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012637705000000001, 2024-04-25T22:52:47.418 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:47.418 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:47.419 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:47.419 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:47.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:47.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:47.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:47.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:47.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:47.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:47.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:47.420 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012227+0000", 2024-04-25T22:52:47.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.863e-06 2024-04-25T22:52:47.420 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.420 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:47.420 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012236+0000", 2024-04-25T22:52:47.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1109999999999997e-06 2024-04-25T22:52:47.420 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.420 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:47.420 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012309+0000", 2024-04-25T22:52:47.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3242000000000001e-05 2024-04-25T22:52:47.420 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.420 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:47.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012324+0000", 2024-04-25T22:52:47.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4837e-05 2024-04-25T22:52:47.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:47.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015060+0000", 2024-04-25T22:52:47.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027363349999999999 2024-04-25T22:52:47.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:47.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015169+0000", 2024-04-25T22:52:47.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108372 2024-04-25T22:52:47.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:47.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015498+0000", 2024-04-25T22:52:47.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032949999999999999 2024-04-25T22:52:47.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:47.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021282+0000", 2024-04-25T22:52:47.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057836429999999998 2024-04-25T22:52:47.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:47.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024709+0000", 2024-04-25T22:52:47.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034271979999999998 2024-04-25T22:52:47.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:47.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024802+0000", 2024-04-25T22:52:47.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2960000000000004e-05 2024-04-25T22:52:47.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:47.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024863+0000", 2024-04-25T22:52:47.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0643999999999997e-05 2024-04-25T22:52:47.423 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:47.423 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:47.423 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:47.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.424 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:47.424 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:47.424 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 54.383726351999996, 2024-04-25T22:52:47.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012979447999999999, 2024-04-25T22:52:47.424 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:47.424 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:47.424 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:47.424 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:47.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.424 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:47.424 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:47.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:47.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.425 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.425 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:47.425 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:47.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:47.425 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.425 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.425 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:47.425 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:47.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:52:47.425 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.425 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.425 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:47.425 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012354+0000", 2024-04-25T22:52:47.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7740000000000004e-06 2024-04-25T22:52:47.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.426 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:47.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012365+0000", 2024-04-25T22:52:47.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.064e-05 2024-04-25T22:52:47.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.426 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:47.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012382+0000", 2024-04-25T22:52:47.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6999000000000001e-05 2024-04-25T22:52:47.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.426 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:47.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015958+0000", 2024-04-25T22:52:47.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035765699999999998 2024-04-25T22:52:47.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:47.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016037+0000", 2024-04-25T22:52:47.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8242000000000001e-05 2024-04-25T22:52:47.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:47.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016404+0000", 2024-04-25T22:52:47.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036784300000000002 2024-04-25T22:52:47.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:47.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021294+0000", 2024-04-25T22:52:47.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048890629999999999 2024-04-25T22:52:47.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:47.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024959+0000", 2024-04-25T22:52:47.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036651570000000001 2024-04-25T22:52:47.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:47.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025097+0000", 2024-04-25T22:52:47.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013788099999999999 2024-04-25T22:52:47.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.429 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:47.429 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025328+0000", 2024-04-25T22:52:47.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231492 2024-04-25T22:52:47.429 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:47.429 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:47.429 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:47.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.429 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.429 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:47.429 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:47.429 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 54.383638583, 2024-04-25T22:52:47.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013049827, 2024-04-25T22:52:47.429 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:47.429 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:47.429 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:47.430 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:47.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.430 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:47.430 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:47.430 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:47.430 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.430 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:47.430 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:47.430 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:47.430 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.430 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:47.431 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012437+0000", 2024-04-25T22:52:47.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-04-25T22:52:47.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.431 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:47.431 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012440+0000", 2024-04-25T22:52:47.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7609999999999999e-06 2024-04-25T22:52:47.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.431 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:47.431 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012449+0000", 2024-04-25T22:52:47.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.285e-06 2024-04-25T22:52:47.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:47.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012457+0000", 2024-04-25T22:52:47.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9510000000000006e-06 2024-04-25T22:52:47.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:47.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017106+0000", 2024-04-25T22:52:47.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046494220000000003 2024-04-25T22:52:47.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:47.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017223+0000", 2024-04-25T22:52:47.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116824 2024-04-25T22:52:47.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.433 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:47.433 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017345+0000", 2024-04-25T22:52:47.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122175 2024-04-25T22:52:47.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.433 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:47.433 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021299+0000", 2024-04-25T22:52:47.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039534879999999998 2024-04-25T22:52:47.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.433 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:47.433 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025398+0000", 2024-04-25T22:52:47.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040988960000000003 2024-04-25T22:52:47.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.434 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.434 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:47.434 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025439+0000", 2024-04-25T22:52:47.434 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0915999999999999e-05 2024-04-25T22:52:47.434 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.434 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.434 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:47.434 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025486+0000", 2024-04-25T22:52:47.434 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7534999999999998e-05 2024-04-25T22:52:47.434 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:47.434 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:47.434 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:47.434 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.434 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.435 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:47.435 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:47.435 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 54.383608432000003, 2024-04-25T22:52:47.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020988041999999998, 2024-04-25T22:52:47.435 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:47.435 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:47.435 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:47.435 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:47.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.435 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:47.435 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:47.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:47.435 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.435 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:47.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:47.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:47.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:47.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:47.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.99e-07 2024-04-25T22:52:47.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:47.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012470+0000", 2024-04-25T22:52:47.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2789999999999999e-06 2024-04-25T22:52:47.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:47.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012477+0000", 2024-04-25T22:52:47.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:52:47.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:47.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012500+0000", 2024-04-25T22:52:47.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2490999999999999e-05 2024-04-25T22:52:47.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:47.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021911+0000", 2024-04-25T22:52:47.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094114160000000006 2024-04-25T22:52:47.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.438 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:47.438 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022000+0000", 2024-04-25T22:52:47.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8601000000000001e-05 2024-04-25T22:52:47.438 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.438 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:47.438 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022359+0000", 2024-04-25T22:52:47.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035921999999999999 2024-04-25T22:52:47.438 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.438 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:47.438 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025541+0000", 2024-04-25T22:52:47.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031820619999999998 2024-04-25T22:52:47.438 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.439 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.439 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:47.439 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033375+0000", 2024-04-25T22:52:47.439 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078338379999999992 2024-04-25T22:52:47.439 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.439 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.439 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:47.439 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033415+0000", 2024-04-25T22:52:47.439 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9527000000000003e-05 2024-04-25T22:52:47.439 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.439 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.439 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:47.439 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033455+0000", 2024-04-25T22:52:47.439 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9932000000000003e-05 2024-04-25T22:52:47.440 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:47.440 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:47.440 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:47.440 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.440 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.440 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:47.440 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:47.440 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 54.383553239000001, 2024-04-25T22:52:47.440 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021043857999999999, 2024-04-25T22:52:47.440 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:47.440 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:47.440 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:47.440 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:47.440 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.440 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:47.441 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:47.441 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:47.441 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.441 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.441 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:47.441 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:47.441 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:47.441 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.441 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.441 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:47.441 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012523+0000", 2024-04-25T22:52:47.441 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.361e-06 2024-04-25T22:52:47.441 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.442 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.442 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:47.442 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012530+0000", 2024-04-25T22:52:47.442 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5440000000000004e-06 2024-04-25T22:52:47.442 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.442 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.442 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:47.442 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012541+0000", 2024-04-25T22:52:47.442 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1745e-05 2024-04-25T22:52:47.442 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.442 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.442 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:47.442 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012551+0000", 2024-04-25T22:52:47.443 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5789999999999993e-06 2024-04-25T22:52:47.443 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.443 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.443 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:47.443 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022709+0000", 2024-04-25T22:52:47.443 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010157685 2024-04-25T22:52:47.443 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.443 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.443 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:47.443 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022957+0000", 2024-04-25T22:52:47.443 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024824599999999998 2024-04-25T22:52:47.443 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.443 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.443 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:47.443 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023443+0000", 2024-04-25T22:52:47.444 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048578599999999999 2024-04-25T22:52:47.444 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.444 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.444 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:47.444 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025547+0000", 2024-04-25T22:52:47.444 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021044789999999998 2024-04-25T22:52:47.444 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.444 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.444 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:47.444 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033509+0000", 2024-04-25T22:52:47.444 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0079622180000000001 2024-04-25T22:52:47.444 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.444 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.444 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:47.444 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033542+0000", 2024-04-25T22:52:47.444 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3018000000000001e-05 2024-04-25T22:52:47.445 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.445 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.445 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:47.445 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033566+0000", 2024-04-25T22:52:47.445 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3197000000000002e-05 2024-04-25T22:52:47.445 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:47.445 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:47.445 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:47.445 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.445 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.445 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:47.445 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:47.445 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 54.383513274000002, 2024-04-25T22:52:47.445 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021122696, 2024-04-25T22:52:47.445 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:47.446 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:47.446 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:47.446 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:47.446 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.446 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:47.446 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:47.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:47.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.446 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.446 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:47.446 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:47.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:47.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.446 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.447 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:47.447 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:47.447 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:52:47.447 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.447 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.447 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:47.447 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012566+0000", 2024-04-25T22:52:47.447 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-04-25T22:52:47.447 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.447 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.447 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:47.447 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012619+0000", 2024-04-25T22:52:47.447 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2607e-05 2024-04-25T22:52:47.447 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.447 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.448 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:47.448 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012628+0000", 2024-04-25T22:52:47.448 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6500000000000008e-06 2024-04-25T22:52:47.448 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.448 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.448 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:47.448 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024024+0000", 2024-04-25T22:52:47.448 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011396007999999999 2024-04-25T22:52:47.448 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.448 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.448 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:47.448 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024198+0000", 2024-04-25T22:52:47.448 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000173215 2024-04-25T22:52:47.448 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.448 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.448 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:47.449 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024447+0000", 2024-04-25T22:52:47.449 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024898500000000002 2024-04-25T22:52:47.449 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.449 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.449 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:47.449 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026431+0000", 2024-04-25T22:52:47.449 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001984923 2024-04-25T22:52:47.449 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.449 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.449 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:47.449 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033608+0000", 2024-04-25T22:52:47.449 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071768459999999997 2024-04-25T22:52:47.449 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.449 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.450 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:47.450 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033646+0000", 2024-04-25T22:52:47.450 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299000000000003e-05 2024-04-25T22:52:47.450 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.450 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.450 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:47.450 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033684+0000", 2024-04-25T22:52:47.450 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8773000000000003e-05 2024-04-25T22:52:47.450 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:47.450 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:47.450 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:47.450 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.450 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.451 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:47.451 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:47.451 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 54.383424675000001, 2024-04-25T22:52:47.451 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021175381, 2024-04-25T22:52:47.451 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:47.451 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:47.451 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:47.451 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:47.451 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.451 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:47.451 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:47.451 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:47.451 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.451 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.452 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:47.452 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:47.452 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:47.452 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.452 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.452 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:47.452 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012651+0000", 2024-04-25T22:52:47.452 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:52:47.452 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.452 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.452 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:47.452 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012656+0000", 2024-04-25T22:52:47.452 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8899999999999998e-06 2024-04-25T22:52:47.452 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.452 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.453 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:47.453 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012666+0000", 2024-04-25T22:52:47.453 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0346999999999999e-05 2024-04-25T22:52:47.453 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.453 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.453 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:47.453 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012675+0000", 2024-04-25T22:52:47.453 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9930000000000001e-06 2024-04-25T22:52:47.453 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.453 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.453 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:47.453 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025661+0000", 2024-04-25T22:52:47.453 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01298531 2024-04-25T22:52:47.453 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.454 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.454 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:47.454 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025757+0000", 2024-04-25T22:52:47.454 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5822000000000005e-05 2024-04-25T22:52:47.454 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.454 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.454 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:47.454 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025907+0000", 2024-04-25T22:52:47.454 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015051499999999999 2024-04-25T22:52:47.454 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.454 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.454 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:47.454 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026435+0000", 2024-04-25T22:52:47.455 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052762200000000005 2024-04-25T22:52:47.455 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.455 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.455 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:47.455 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033732+0000", 2024-04-25T22:52:47.455 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072978419999999997 2024-04-25T22:52:47.455 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.455 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.455 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:47.455 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033787+0000", 2024-04-25T22:52:47.455 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4703999999999997e-05 2024-04-25T22:52:47.455 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.455 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.455 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:47.456 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033826+0000", 2024-04-25T22:52:47.456 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8458999999999999e-05 2024-04-25T22:52:47.456 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:47.456 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:47.456 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:47.456 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.456 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.456 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:47.456 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:47.456 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 54.383369260999999, 2024-04-25T22:52:47.456 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021244174000000001, 2024-04-25T22:52:47.456 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:47.456 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:47.456 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:47.457 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:47.457 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.457 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:47.457 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:47.457 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:47.457 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.457 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.457 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:47.457 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:47.457 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:47.457 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.457 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.457 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:47.457 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:47.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:52:47.458 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.458 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:47.458 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012712+0000", 2024-04-25T22:52:47.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.913e-06 2024-04-25T22:52:47.458 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.458 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:47.458 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012722+0000", 2024-04-25T22:52:47.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2879999999999998e-06 2024-04-25T22:52:47.458 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.458 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:47.459 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012727+0000", 2024-04-25T22:52:47.459 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8429999999999998e-06 2024-04-25T22:52:47.459 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.459 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.459 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:47.459 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026099+0000", 2024-04-25T22:52:47.459 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013371450999999999 2024-04-25T22:52:47.459 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.459 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.459 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:47.459 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026147+0000", 2024-04-25T22:52:47.459 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7837999999999998e-05 2024-04-25T22:52:47.459 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.459 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.459 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:47.460 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026254+0000", 2024-04-25T22:52:47.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107314 2024-04-25T22:52:47.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.460 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.460 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:47.460 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026686+0000", 2024-04-25T22:52:47.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000432428 2024-04-25T22:52:47.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.460 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.460 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:47.460 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033873+0000", 2024-04-25T22:52:47.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071864399999999997 2024-04-25T22:52:47.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.460 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.461 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:47.461 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033904+0000", 2024-04-25T22:52:47.461 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1321e-05 2024-04-25T22:52:47.461 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.461 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:47.461 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033950+0000", 2024-04-25T22:52:47.461 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5707999999999997e-05 2024-04-25T22:52:47.461 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:47.461 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:47.461 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:47.461 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.461 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:47.462 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:47.462 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 54.383338876000003, 2024-04-25T22:52:47.462 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01096505, 2024-04-25T22:52:47.462 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:47.462 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:47.462 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:47.462 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:47.462 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.462 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:47.462 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:47.462 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:47.462 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.462 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.463 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:47.463 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:47.463 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:47.463 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.463 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.463 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:47.463 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012737+0000", 2024-04-25T22:52:47.463 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:52:47.463 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.463 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.463 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:47.463 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012739+0000", 2024-04-25T22:52:47.463 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-04-25T22:52:47.463 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.463 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.464 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:47.464 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012743+0000", 2024-04-25T22:52:47.464 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3239999999999996e-06 2024-04-25T22:52:47.464 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.464 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.464 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:47.464 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012746+0000", 2024-04-25T22:52:47.464 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.129e-06 2024-04-25T22:52:47.464 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.464 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.464 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:47.464 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012796+0000", 2024-04-25T22:52:47.464 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9231999999999999e-05 2024-04-25T22:52:47.464 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.465 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.465 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:47.465 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012915+0000", 2024-04-25T22:52:47.465 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119021 2024-04-25T22:52:47.465 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.465 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.465 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:47.465 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013069+0000", 2024-04-25T22:52:47.465 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015463900000000001 2024-04-25T22:52:47.465 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.465 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.465 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:47.465 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019237+0000", 2024-04-25T22:52:47.465 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061680329999999998 2024-04-25T22:52:47.465 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.465 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.466 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:47.466 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023603+0000", 2024-04-25T22:52:47.466 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043655860000000003 2024-04-25T22:52:47.466 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.466 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.466 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:47.466 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023659+0000", 2024-04-25T22:52:47.466 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6484000000000003e-05 2024-04-25T22:52:47.466 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.466 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.466 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:47.466 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023701+0000", 2024-04-25T22:52:47.466 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1761999999999998e-05 2024-04-25T22:52:47.466 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:47.467 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:47.467 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:47.467 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.467 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.467 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:47.467 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:47.467 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 54.383313928, 2024-04-25T22:52:47.467 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011234429000000001, 2024-04-25T22:52:47.467 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:47.467 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:47.467 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:47.467 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:47.467 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.467 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:47.468 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:47.468 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:47.468 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.468 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.468 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:47.468 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:47.468 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:47.468 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.468 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.468 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:47.468 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012762+0000", 2024-04-25T22:52:47.468 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-04-25T22:52:47.468 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.468 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.468 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:47.469 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012765+0000", 2024-04-25T22:52:47.469 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2569999999999999e-06 2024-04-25T22:52:47.469 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.469 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.469 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:47.469 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012783+0000", 2024-04-25T22:52:47.469 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8431999999999999e-05 2024-04-25T22:52:47.469 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.469 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.469 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:47.469 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012799+0000", 2024-04-25T22:52:47.469 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5438999999999999e-05 2024-04-25T22:52:47.469 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.469 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.469 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:47.470 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013826+0000", 2024-04-25T22:52:47.470 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010275060000000001 2024-04-25T22:52:47.470 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.470 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.470 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:47.470 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013913+0000", 2024-04-25T22:52:47.470 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.708e-05 2024-04-25T22:52:47.470 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.470 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.470 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:47.470 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014098+0000", 2024-04-25T22:52:47.470 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018519399999999999 2024-04-25T22:52:47.470 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.470 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.471 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:47.471 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019684+0000", 2024-04-25T22:52:47.471 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055860079999999999 2024-04-25T22:52:47.471 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.471 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.471 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:47.471 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023876+0000", 2024-04-25T22:52:47.471 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041918800000000003 2024-04-25T22:52:47.471 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.471 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.471 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:47.471 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023957+0000", 2024-04-25T22:52:47.471 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1165e-05 2024-04-25T22:52:47.471 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.471 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.472 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:47.472 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023995+0000", 2024-04-25T22:52:47.472 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:52:47.472 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:47.472 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:47.472 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:47.472 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.472 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.472 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:47.472 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:47.472 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 54.383216148999999, 2024-04-25T22:52:47.472 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011131200000000001, 2024-04-25T22:52:47.472 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:47.472 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:47.472 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:47.473 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:47.473 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.473 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:47.473 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:47.473 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:47.473 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.473 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.473 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:47.473 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:47.473 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:47.473 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.473 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.473 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:47.473 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012860+0000", 2024-04-25T22:52:47.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3900000000000004e-07 2024-04-25T22:52:47.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.474 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:47.474 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012865+0000", 2024-04-25T22:52:47.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5609999999999998e-06 2024-04-25T22:52:47.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.474 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:47.474 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012895+0000", 2024-04-25T22:52:47.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9847000000000001e-05 2024-04-25T22:52:47.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.474 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:47.475 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012905+0000", 2024-04-25T22:52:47.475 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.03e-05 2024-04-25T22:52:47.475 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.475 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.475 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:47.475 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015020+0000", 2024-04-25T22:52:47.475 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021142940000000001 2024-04-25T22:52:47.475 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.475 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.475 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:47.475 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015182+0000", 2024-04-25T22:52:47.475 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016248099999999999 2024-04-25T22:52:47.475 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.475 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.475 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:52:47.476 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015357+0000", 2024-04-25T22:52:47.476 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017471000000000001 2024-04-25T22:52:47.476 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.476 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.476 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:47.476 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021021+0000", 2024-04-25T22:52:47.476 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056638340000000004 2024-04-25T22:52:47.476 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.476 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.476 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:47.476 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023712+0000", 2024-04-25T22:52:47.476 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026910380000000002 2024-04-25T22:52:47.476 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.476 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.476 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:47.476 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023763+0000", 2024-04-25T22:52:47.477 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1477999999999997e-05 2024-04-25T22:52:47.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.477 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.477 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:47.477 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023990+0000", 2024-04-25T22:52:47.477 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000226818 2024-04-25T22:52:47.477 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:47.477 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:47.477 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:47.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.477 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.477 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:47.477 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:47.477 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 54.383093053000003, 2024-04-25T22:52:47.478 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011705299000000001, 2024-04-25T22:52:47.478 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:47.478 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:47.478 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:47.478 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:47.478 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.478 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:47.478 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:47.478 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:47.478 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.478 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.478 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:47.478 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:47.479 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:47.479 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.479 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.479 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:47.479 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012983+0000", 2024-04-25T22:52:47.479 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:52:47.479 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.479 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.479 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:47.479 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012986+0000", 2024-04-25T22:52:47.479 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5700000000000001e-06 2024-04-25T22:52:47.479 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.479 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.479 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:47.480 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012993+0000", 2024-04-25T22:52:47.480 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8730000000000001e-06 2024-04-25T22:52:47.480 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.480 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.480 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:47.480 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013000+0000", 2024-04-25T22:52:47.480 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1890000000000001e-06 2024-04-25T22:52:47.480 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.480 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.480 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:47.480 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:52:47.480 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002147866 2024-04-25T22:52:47.480 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.480 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.481 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:47.481 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015351+0000", 2024-04-25T22:52:47.481 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020300799999999999 2024-04-25T22:52:47.481 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.481 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.481 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:47.481 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016260+0000", 2024-04-25T22:52:47.481 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00090926799999999997 2024-04-25T22:52:47.481 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.481 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.481 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:47.481 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022669+0000", 2024-04-25T22:52:47.481 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064082849999999997 2024-04-25T22:52:47.481 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.481 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.482 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:47.482 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024584+0000", 2024-04-25T22:52:47.482 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019151699999999999 2024-04-25T22:52:47.482 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.482 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.482 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:47.482 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024643+0000", 2024-04-25T22:52:47.482 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8888999999999998e-05 2024-04-25T22:52:47.482 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.482 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.482 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:47.482 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024687+0000", 2024-04-25T22:52:47.482 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4444999999999999e-05 2024-04-25T22:52:47.482 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:47.483 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:47.483 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:47.483 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.483 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.483 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:47.483 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:47.483 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 54.383065461999998, 2024-04-25T22:52:47.483 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011249699, 2024-04-25T22:52:47.483 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:47.483 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:47.483 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:47.483 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:47.483 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.483 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:47.484 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:47.484 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:47.484 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.484 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.484 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:47.484 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:47.484 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:47.484 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.484 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.484 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:47.484 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013010+0000", 2024-04-25T22:52:47.484 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2099999999999996e-07 2024-04-25T22:52:47.484 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.484 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.484 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:47.485 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013013+0000", 2024-04-25T22:52:47.485 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1310000000000002e-06 2024-04-25T22:52:47.485 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.485 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.485 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:47.485 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013020+0000", 2024-04-25T22:52:47.485 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3330000000000002e-06 2024-04-25T22:52:47.485 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.485 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.485 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:47.485 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013025+0000", 2024-04-25T22:52:47.485 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6760000000000004e-06 2024-04-25T22:52:47.485 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.485 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.486 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:47.486 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013163+0000", 2024-04-25T22:52:47.486 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013824599999999999 2024-04-25T22:52:47.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.486 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.486 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:47.486 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013504+0000", 2024-04-25T22:52:47.486 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034080299999999998 2024-04-25T22:52:47.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.486 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.486 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:47.486 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013613+0000", 2024-04-25T22:52:47.486 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108705 2024-04-25T22:52:47.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.487 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.487 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:47.487 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015831+0000", 2024-04-25T22:52:47.487 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002217672 2024-04-25T22:52:47.487 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.487 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.487 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:47.487 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024137+0000", 2024-04-25T22:52:47.487 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0083060489999999994 2024-04-25T22:52:47.487 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.487 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.487 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:47.487 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024218+0000", 2024-04-25T22:52:47.488 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1351000000000001e-05 2024-04-25T22:52:47.488 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.488 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.488 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:47.488 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024259+0000", 2024-04-25T22:52:47.488 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1112000000000002e-05 2024-04-25T22:52:47.488 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:47.488 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:47.488 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:47.488 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.488 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.488 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:47.488 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:47.488 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 54.382977736000001, 2024-04-25T22:52:47.488 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020379749999999999, 2024-04-25T22:52:47.489 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:47.489 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:47.489 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:47.489 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:47.489 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.489 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:47.489 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:47.489 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:47.489 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.489 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.489 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:47.489 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:47.489 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:47.490 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.490 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.490 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:47.490 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013098+0000", 2024-04-25T22:52:47.490 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:52:47.490 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.490 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.490 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:47.490 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013105+0000", 2024-04-25T22:52:47.490 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5969999999999997e-06 2024-04-25T22:52:47.490 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.490 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.490 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:47.490 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013190+0000", 2024-04-25T22:52:47.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5618999999999995e-05 2024-04-25T22:52:47.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.491 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:47.491 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013200+0000", 2024-04-25T22:52:47.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5859999999999994e-06 2024-04-25T22:52:47.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.491 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:47.491 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020265+0000", 2024-04-25T22:52:47.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070653349999999998 2024-04-25T22:52:47.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.491 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:47.491 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020454+0000", 2024-04-25T22:52:47.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189316 2024-04-25T22:52:47.492 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.492 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.492 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:47.492 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020586+0000", 2024-04-25T22:52:47.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013195700000000001 2024-04-25T22:52:47.492 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.492 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.492 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:47.492 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023822+0000", 2024-04-25T22:52:47.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032358529999999999 2024-04-25T22:52:47.492 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.492 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.492 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:47.493 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033409+0000", 2024-04-25T22:52:47.493 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095870520000000004 2024-04-25T22:52:47.493 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.493 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.493 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:47.493 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033447+0000", 2024-04-25T22:52:47.493 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7261999999999997e-05 2024-04-25T22:52:47.493 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.493 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.493 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:47.493 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033477+0000", 2024-04-25T22:52:47.493 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0389e-05 2024-04-25T22:52:47.493 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:47.493 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:47.494 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:47.494 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.494 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.494 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:47.494 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:47.494 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 54.382861230000003, 2024-04-25T22:52:47.494 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010857383999999999, 2024-04-25T22:52:47.494 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:47.494 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:47.494 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:47.494 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:47.494 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.494 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:47.495 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:47.495 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:47.495 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.495 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.495 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:47.495 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:47.495 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:47.495 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.495 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.495 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:47.495 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:47.495 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:52:47.495 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.495 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.495 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:47.496 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013218+0000", 2024-04-25T22:52:47.496 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8199999999999998e-06 2024-04-25T22:52:47.496 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.496 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.496 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:47.496 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013226+0000", 2024-04-25T22:52:47.496 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7649999999999993e-06 2024-04-25T22:52:47.496 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.496 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.496 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:47.496 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013259+0000", 2024-04-25T22:52:47.496 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2727e-05 2024-04-25T22:52:47.496 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.496 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.497 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:47.497 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014809+0000", 2024-04-25T22:52:47.497 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001550144 2024-04-25T22:52:47.497 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.497 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.497 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:47.497 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014958+0000", 2024-04-25T22:52:47.497 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014890300000000001 2024-04-25T22:52:47.497 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.497 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.497 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:52:47.497 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015087+0000", 2024-04-25T22:52:47.497 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012939200000000001 2024-04-25T22:52:47.497 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.498 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.498 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:47.498 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020212+0000", 2024-04-25T22:52:47.498 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051248939999999996 2024-04-25T22:52:47.498 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.498 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.498 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:47.498 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023699+0000", 2024-04-25T22:52:47.498 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034873289999999999 2024-04-25T22:52:47.498 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.498 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.498 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:47.498 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024014+0000", 2024-04-25T22:52:47.499 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031473999999999999 2024-04-25T22:52:47.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.499 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.499 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:47.499 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024071+0000", 2024-04-25T22:52:47.499 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7040000000000003e-05 2024-04-25T22:52:47.499 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:47.499 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:47.499 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:47.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.499 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.499 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:47.499 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:47.499 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 54.382806524999999, 2024-04-25T22:52:47.499 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012329677000000001, 2024-04-25T22:52:47.500 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:47.500 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:47.500 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:47.500 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:47.500 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.500 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:47.500 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:47.500 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:47.500 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.500 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.500 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:47.500 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:47.500 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:47.500 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.500 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.501 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:47.501 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013269+0000", 2024-04-25T22:52:47.501 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5000000000000002e-07 2024-04-25T22:52:47.501 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.501 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.501 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:47.501 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:52:47.501 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6909999999999999e-06 2024-04-25T22:52:47.501 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.501 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.501 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:47.501 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013284+0000", 2024-04-25T22:52:47.501 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0963e-05 2024-04-25T22:52:47.501 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.502 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.502 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:47.502 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013361+0000", 2024-04-25T22:52:47.502 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7379999999999994e-05 2024-04-25T22:52:47.502 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.502 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.502 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:47.502 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013448+0000", 2024-04-25T22:52:47.502 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6990000000000006e-05 2024-04-25T22:52:47.502 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.502 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.502 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:47.502 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013632+0000", 2024-04-25T22:52:47.502 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018396800000000001 2024-04-25T22:52:47.503 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.503 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.503 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:47.503 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013800+0000", 2024-04-25T22:52:47.503 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167467 2024-04-25T22:52:47.503 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.503 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.503 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:47.503 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.018570+0000", 2024-04-25T22:52:47.503 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047701460000000003 2024-04-25T22:52:47.503 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.503 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.503 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:47.503 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025507+0000", 2024-04-25T22:52:47.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069372039999999998 2024-04-25T22:52:47.504 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.504 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.504 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:47.504 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025562+0000", 2024-04-25T22:52:47.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4858999999999998e-05 2024-04-25T22:52:47.504 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.504 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.504 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:47.504 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025598+0000", 2024-04-25T22:52:47.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6259e-05 2024-04-25T22:52:47.504 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:47.504 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:47.504 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:47.504 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.504 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.505 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:47.505 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:47.505 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 54.382674651999999, 2024-04-25T22:52:47.505 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020176666999999999, 2024-04-25T22:52:47.505 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:47.505 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:47.505 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:52:47.505 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:47.505 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.505 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:47.505 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:47.505 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:47.505 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.505 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.506 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:47.506 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:47.506 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:47.506 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.506 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.506 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:47.506 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:52:47.506 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-04-25T22:52:47.506 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.506 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.506 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:47.506 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013405+0000", 2024-04-25T22:52:47.506 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0559999999999998e-06 2024-04-25T22:52:47.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.507 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.507 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:47.507 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013422+0000", 2024-04-25T22:52:47.507 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6770999999999999e-05 2024-04-25T22:52:47.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.507 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.507 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:47.507 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013431+0000", 2024-04-25T22:52:47.507 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5019999999999998e-06 2024-04-25T22:52:47.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.507 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.507 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:47.507 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021720+0000", 2024-04-25T22:52:47.507 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082884340000000008 2024-04-25T22:52:47.508 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.508 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.508 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:47.508 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022122+0000", 2024-04-25T22:52:47.508 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000401634 2024-04-25T22:52:47.508 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:47.508 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:47.508 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:47.508 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033577+0000", 2024-04-25T22:52:47.508 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011455435999999999 2024-04-25T22:52:47.508 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:47.508 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:47.508 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:47.508 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:47.509 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:47.509 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:47.510 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:52:47.511 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:47.509+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:47.611 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:47.610+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:47.616 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:47.617 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:52:47.617 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-25T22:52:47.617 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:47.625 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:52:47.712 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:47.711+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:47.727 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:47.727 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:52:47.728 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-25T22:52:47.728 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-25T22:52:47.728 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:47.737 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:52:47.814 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:47.813+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:47.841 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:47.841 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:52:47.841 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:52:47.841 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:52:47.841 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.842 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:52:47.842 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:52:47.842 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 59.872222035, 2024-04-25T22:52:47.842 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:52:47.842 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:47.842 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:47.842 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:47.842 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:47.842 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.842 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:47.842 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:52:47.842 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:47.843 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.843 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.843 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:47.843 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:52:47.843 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:47.843 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.843 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.843 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:47.843 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:52:47.843 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:52:47.843 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.843 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.843 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:47.844 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:52:47.844 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:52:47.844 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.844 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.844 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:47.844 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:52:47.844 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:52:47.844 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.844 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.844 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:47.844 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:52:47.844 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:52:47.845 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.845 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.845 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:47.845 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:52:47.845 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:52:47.845 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.845 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.845 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:47.845 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:52:47.845 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:52:47.845 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.846 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.846 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:47.846 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:52:47.846 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:52:47.846 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.846 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.846 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:47.846 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:52:47.846 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:52:47.846 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:47.846 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:47.846 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:47.846 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.846 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.847 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:110 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'72, mlcod=10'68)", 2024-04-25T22:52:47.847 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:47.847 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 59.871588035000002, 2024-04-25T22:52:47.847 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065316630000000001, 2024-04-25T22:52:47.847 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:47.847 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:47.847 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:47.847 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:47.847 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.847 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:47.847 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:47.847 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:47.847 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.847 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.847 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:47.848 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:47.848 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:47.848 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.848 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.848 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:47.848 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:47.848 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.58e-07 2024-04-25T22:52:47.848 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.848 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.848 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:47.848 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967811+0000", 2024-04-25T22:52:47.848 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.118e-06 2024-04-25T22:52:47.848 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.848 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.849 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:47.849 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967817+0000", 2024-04-25T22:52:47.849 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3709999999999996e-06 2024-04-25T22:52:47.849 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.849 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.849 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:47.849 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967820+0000", 2024-04-25T22:52:47.849 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2210000000000002e-06 2024-04-25T22:52:47.849 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.849 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.850 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:47.850 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967876+0000", 2024-04-25T22:52:47.850 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5507000000000002e-05 2024-04-25T22:52:47.850 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.850 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.850 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:47.850 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967893+0000", 2024-04-25T22:52:47.850 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7812000000000002e-05 2024-04-25T22:52:47.850 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.850 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.851 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:47.851 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974317+0000", 2024-04-25T22:52:47.851 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064237160000000003 2024-04-25T22:52:47.851 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.851 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.851 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:47.851 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:52:47.851 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.156e-05 2024-04-25T22:52:47.851 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:47.851 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:47.851 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:47.851 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.852 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.852 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'68)", 2024-04-25T22:52:47.852 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:47.852 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 59.871170522, 2024-04-25T22:52:47.852 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061292279999999996, 2024-04-25T22:52:47.852 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:47.852 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:47.852 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:47.852 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:47.852 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.852 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:47.853 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:47.853 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:47.853 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.853 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.853 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:47.853 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:47.853 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:47.853 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.853 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.853 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:47.853 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:47.854 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6300000000000001e-07 2024-04-25T22:52:47.854 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.854 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.854 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:47.854 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968228+0000", 2024-04-25T22:52:47.854 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6139999999999999e-06 2024-04-25T22:52:47.854 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.854 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.854 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:47.854 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968235+0000", 2024-04-25T22:52:47.854 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7020000000000001e-06 2024-04-25T22:52:47.854 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.855 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.855 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:47.855 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968238+0000", 2024-04-25T22:52:47.855 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0010000000000002e-06 2024-04-25T22:52:47.855 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.855 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.855 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:47.855 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968297+0000", 2024-04-25T22:52:47.855 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8424999999999997e-05 2024-04-25T22:52:47.855 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.855 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.855 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:47.856 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968316+0000", 2024-04-25T22:52:47.856 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8814999999999999e-05 2024-04-25T22:52:47.856 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.856 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.856 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:47.856 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:52:47.856 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060239439999999998 2024-04-25T22:52:47.856 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.856 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.856 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:47.857 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974354+0000", 2024-04-25T22:52:47.857 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4364e-05 2024-04-25T22:52:47.857 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:47.857 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:47.857 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:47.857 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.857 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.857 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'68)", 2024-04-25T22:52:47.857 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:47.857 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 59.870733520000002, 2024-04-25T22:52:47.857 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005948414, 2024-04-25T22:52:47.858 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:47.858 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:47.858 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:47.858 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:47.858 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.858 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:47.858 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:47.858 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:47.858 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.858 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.859 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:47.859 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:47.859 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:47.859 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.859 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.859 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:47.859 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:47.859 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6199999999999998e-07 2024-04-25T22:52:47.859 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.859 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.860 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:47.860 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968723+0000", 2024-04-25T22:52:47.861 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1148999999999993e-05 2024-04-25T22:52:47.861 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.861 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.861 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:47.861 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968730+0000", 2024-04-25T22:52:47.861 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1749999999999999e-06 2024-04-25T22:52:47.861 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.861 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.861 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:47.861 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968734+0000", 2024-04-25T22:52:47.861 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5200000000000002e-06 2024-04-25T22:52:47.862 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.862 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.862 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:47.862 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968771+0000", 2024-04-25T22:52:47.862 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6851999999999999e-05 2024-04-25T22:52:47.862 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.862 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.862 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:47.862 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968788+0000", 2024-04-25T22:52:47.862 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7027000000000001e-05 2024-04-25T22:52:47.862 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.862 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.863 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:47.863 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974589+0000", 2024-04-25T22:52:47.863 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058013320000000002 2024-04-25T22:52:47.863 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.863 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.863 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:47.863 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974610+0000", 2024-04-25T22:52:47.863 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0897e-05 2024-04-25T22:52:47.863 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:47.863 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:47.863 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:47.863 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.863 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.863 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'68)", 2024-04-25T22:52:47.864 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:47.864 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 59.870163509999998, 2024-04-25T22:52:47.864 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053935750000000003, 2024-04-25T22:52:47.864 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:47.864 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:47.864 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:47.864 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:47.864 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.864 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:47.864 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:47.864 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:47.864 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.864 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.865 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:47.865 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:47.865 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:47.865 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.865 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.865 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:47.865 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:47.865 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.03e-07 2024-04-25T22:52:47.865 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.865 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.865 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:47.865 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969235+0000", 2024-04-25T22:52:47.865 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2399999999999999e-06 2024-04-25T22:52:47.865 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.865 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.866 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:47.866 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969242+0000", 2024-04-25T22:52:47.866 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1269999999999997e-06 2024-04-25T22:52:47.866 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.866 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.866 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:47.866 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969246+0000", 2024-04-25T22:52:47.866 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3840000000000001e-06 2024-04-25T22:52:47.866 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.866 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.866 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:47.866 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969278+0000", 2024-04-25T22:52:47.866 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1868e-05 2024-04-25T22:52:47.867 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.867 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.867 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:47.867 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969295+0000", 2024-04-25T22:52:47.867 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7530999999999999e-05 2024-04-25T22:52:47.867 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.867 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.867 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:47.867 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974611+0000", 2024-04-25T22:52:47.868 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053160789999999996 2024-04-25T22:52:47.868 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.868 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.868 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:47.868 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974625+0000", 2024-04-25T22:52:47.868 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3943e-05 2024-04-25T22:52:47.868 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:47.868 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:47.868 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:47.868 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.868 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.868 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-25T22:52:47.869 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:47.869 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 59.676567601999999, 2024-04-25T22:52:47.869 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054952610000000004, 2024-04-25T22:52:47.869 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:47.869 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:47.869 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:47.869 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:47.869 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.869 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:47.869 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:47.869 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:47.869 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.869 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.870 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:47.870 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:47.870 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:47.870 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.870 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.870 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:47.870 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:47.870 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.68e-07 2024-04-25T22:52:47.870 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.870 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.870 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:47.870 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162898+0000", 2024-04-25T22:52:47.871 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9470999999999999e-05 2024-04-25T22:52:47.871 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.871 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.871 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:47.871 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162906+0000", 2024-04-25T22:52:47.871 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1580000000000005e-06 2024-04-25T22:52:47.871 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.871 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.871 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:47.871 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162911+0000", 2024-04-25T22:52:47.871 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4779999999999999e-06 2024-04-25T22:52:47.871 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.871 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.871 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:47.872 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162952+0000", 2024-04-25T22:52:47.872 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0629e-05 2024-04-25T22:52:47.872 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.872 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.872 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:47.872 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162968+0000", 2024-04-25T22:52:47.872 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6239000000000002e-05 2024-04-25T22:52:47.872 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.872 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.872 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:47.872 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168281+0000", 2024-04-25T22:52:47.872 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053132869999999999 2024-04-25T22:52:47.872 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.873 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.873 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:47.873 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168323+0000", 2024-04-25T22:52:47.873 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1430999999999997e-05 2024-04-25T22:52:47.873 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:47.873 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:47.873 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:47.873 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.873 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.873 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-04-25T22:52:47.873 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:47.873 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 59.246090240000001, 2024-04-25T22:52:47.873 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050872510000000001, 2024-04-25T22:52:47.873 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:47.873 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:47.874 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:47.874 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:47.874 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.874 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:47.874 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:47.874 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:47.874 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.874 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.874 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:47.874 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:47.874 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:47.874 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.875 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.875 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:47.875 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:47.875 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.72e-07 2024-04-25T22:52:47.875 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.875 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.875 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:47.875 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593381+0000", 2024-04-25T22:52:47.875 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5797000000000006e-05 2024-04-25T22:52:47.875 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.875 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.875 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:47.875 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593389+0000", 2024-04-25T22:52:47.876 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8480000000000001e-06 2024-04-25T22:52:47.876 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.876 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.876 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:47.876 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593393+0000", 2024-04-25T22:52:47.876 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4819999999999996e-06 2024-04-25T22:52:47.876 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.876 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.876 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:47.876 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593435+0000", 2024-04-25T22:52:47.876 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1600000000000002e-05 2024-04-25T22:52:47.876 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.876 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.876 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:47.877 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593454+0000", 2024-04-25T22:52:47.877 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8868e-05 2024-04-25T22:52:47.877 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.877 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.877 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:47.877 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598350+0000", 2024-04-25T22:52:47.877 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004895763 2024-04-25T22:52:47.877 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.877 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.877 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:47.877 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598392+0000", 2024-04-25T22:52:47.877 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2521000000000002e-05 2024-04-25T22:52:47.877 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:47.878 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:47.878 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:47.878 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.878 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.878 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:47.878 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:52:47.878 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 54.827726335999998, 2024-04-25T22:52:47.878 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:52:47.878 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:47.878 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:47.878 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:47.878 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:47.878 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.879 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:47.879 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:52:47.879 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:47.879 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.879 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.879 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:47.879 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:52:47.879 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:47.879 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.879 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.879 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:47.879 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:52:47.879 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:52:47.879 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.880 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.880 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:47.880 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:52:47.880 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:52:47.880 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.880 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.880 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:47.880 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:52:47.880 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:52:47.880 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.880 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.880 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:47.880 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:52:47.880 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:52:47.881 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.881 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.881 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:47.881 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:52:47.881 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:52:47.881 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.881 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.881 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:47.881 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:52:47.881 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:52:47.881 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.881 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.881 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:47.881 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:52:47.882 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:52:47.882 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.882 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.882 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:47.882 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:52:47.882 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:52:47.882 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.882 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.882 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:47.882 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:52:47.882 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:52:47.882 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.882 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.883 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:47.883 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:52:47.883 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:52:47.883 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.883 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.883 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:47.883 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:52:47.883 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:52:47.883 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:47.883 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:47.883 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:47.883 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.883 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.883 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:47.884 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:52:47.884 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 54.827051959999999, 2024-04-25T22:52:47.884 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:52:47.884 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:47.884 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:47.884 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:47.884 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:47.884 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.884 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:47.884 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:52:47.884 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:47.884 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.884 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.884 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:47.885 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:52:47.885 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:47.885 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.885 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.885 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:47.885 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:52:47.885 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:52:47.885 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.885 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.885 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:47.885 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:52:47.885 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:52:47.885 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.886 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.886 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:47.886 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:52:47.886 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:52:47.886 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.886 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.886 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:47.886 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:52:47.886 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:52:47.886 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.886 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.886 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:47.886 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:52:47.887 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:52:47.887 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.887 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.887 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:47.887 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:52:47.887 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:52:47.887 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.887 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.887 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:47.887 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:52:47.887 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:52:47.887 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.887 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.887 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:47.887 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:52:47.888 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:52:47.888 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.888 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.888 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:47.888 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:52:47.888 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:52:47.888 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.888 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.888 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:47.888 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:52:47.888 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:52:47.888 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.888 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.888 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:47.889 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:52:47.889 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:52:47.889 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:47.889 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:47.889 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:47.889 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.889 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.889 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:47.889 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:52:47.889 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 54.826542748000001, 2024-04-25T22:52:47.889 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:52:47.889 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:47.889 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:47.889 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:47.890 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:47.890 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.890 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:47.890 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:52:47.890 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:47.890 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.890 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.890 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:47.890 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:52:47.890 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:47.890 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.890 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.890 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:47.891 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:52:47.891 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:52:47.891 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.891 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.891 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:47.891 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:52:47.891 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:52:47.891 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.891 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.891 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:47.891 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:52:47.891 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:52:47.891 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.892 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.892 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:47.892 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:52:47.892 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:52:47.892 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.892 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.892 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:47.892 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:52:47.892 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:52:47.892 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.892 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.892 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:47.892 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:52:47.892 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:52:47.893 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.893 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.893 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:47.893 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:52:47.893 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:52:47.893 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.893 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.893 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:47.893 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:52:47.893 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:52:47.893 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.893 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.893 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:47.893 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:52:47.893 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:52:47.894 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.894 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.894 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:47.894 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:52:47.894 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:52:47.894 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.894 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.894 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:47.894 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:52:47.894 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:52:47.894 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:47.894 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:47.895 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:47.895 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.895 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.895 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:47.895 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:47.895 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 54.826129549999997, 2024-04-25T22:52:47.895 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:52:47.895 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:47.895 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:47.895 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:47.895 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:47.895 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.895 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:47.895 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:47.895 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:47.896 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.896 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.896 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:47.896 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:47.896 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:47.896 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.896 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.896 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:47.896 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:47.896 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:52:47.896 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.896 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.896 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:47.896 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:52:47.897 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:52:47.897 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.897 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.897 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:47.897 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:52:47.897 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:52:47.897 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.897 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.897 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:47.897 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:52:47.897 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:52:47.897 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.897 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.897 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:47.898 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:52:47.898 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:52:47.898 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.898 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.898 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:47.898 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:52:47.898 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:52:47.898 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.898 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.898 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:47.898 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:52:47.898 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:52:47.898 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.899 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.899 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:47.899 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:52:47.899 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:52:47.899 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.899 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.899 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:47.899 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:52:47.899 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:52:47.899 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.899 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.899 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:47.899 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:52:47.900 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:52:47.900 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.900 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.900 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:47.900 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:52:47.900 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:52:47.900 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:47.900 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:47.900 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:47.900 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.900 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.900 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:47.900 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:52:47.900 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 54.826078879999997, 2024-04-25T22:52:47.901 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:52:47.901 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:47.901 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:47.901 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:47.901 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:47.901 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.901 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:47.901 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:52:47.901 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:47.901 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.901 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.901 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:47.901 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:52:47.902 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:47.902 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.902 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.902 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:47.902 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:52:47.902 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:52:47.902 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.902 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.902 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:47.902 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:52:47.902 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:52:47.902 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.902 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.903 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:47.903 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:52:47.903 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:52:47.903 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.903 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.903 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:47.903 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:52:47.903 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:52:47.903 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.903 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.903 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:47.903 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:52:47.903 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:52:47.903 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.903 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.904 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:52:47.904 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:52:47.904 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:52:47.904 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.904 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.904 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:47.904 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:52:47.904 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:52:47.904 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.904 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.904 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:47.904 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:52:47.904 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:52:47.905 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.905 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.905 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:47.905 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:52:47.905 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:52:47.905 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.905 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.905 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:47.905 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:52:47.905 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:52:47.905 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.905 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.905 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:47.905 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:52:47.906 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:52:47.906 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.906 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.906 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:47.906 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:52:47.906 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:52:47.906 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.906 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.906 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:47.906 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:52:47.906 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:52:47.906 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:47.906 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:47.906 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:47.907 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.907 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.907 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:47.907 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:52:47.907 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 54.826042010999998, 2024-04-25T22:52:47.907 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:52:47.907 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:47.907 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:47.907 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:47.907 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:47.907 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.907 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:47.907 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:52:47.907 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:47.908 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.908 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.908 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:47.908 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:52:47.908 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:47.908 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.908 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.908 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:47.908 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:52:47.908 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:52:47.908 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.908 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.908 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:47.908 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:52:47.908 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:52:47.909 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.909 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.909 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:47.909 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:52:47.909 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:52:47.909 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.909 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.909 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:47.909 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:52:47.909 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:52:47.909 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.909 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.909 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:47.909 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:52:47.909 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:52:47.910 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.910 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.910 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:52:47.910 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:52:47.910 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:52:47.910 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.910 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.910 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:47.910 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:52:47.910 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:52:47.910 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.910 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.910 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:47.911 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:52:47.911 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:52:47.911 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.911 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.911 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:47.911 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:52:47.911 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:52:47.911 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.911 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.911 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:47.911 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:52:47.911 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:52:47.911 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.911 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.911 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:47.911 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:52:47.912 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:52:47.912 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.912 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.912 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:47.912 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:52:47.912 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:52:47.912 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.912 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.912 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:47.912 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:52:47.912 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:52:47.912 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:47.912 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:47.912 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:47.913 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.913 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.913 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:47.913 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:52:47.913 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 54.826017045, 2024-04-25T22:52:47.913 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:52:47.913 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:47.913 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:47.913 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:47.913 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:47.913 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.913 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:47.913 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:52:47.913 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:47.914 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.914 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.914 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:47.914 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:52:47.914 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:47.914 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.914 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.914 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:47.914 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:52:47.914 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:52:47.914 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.914 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.914 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:47.915 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:52:47.915 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:52:47.915 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.915 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.915 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:47.915 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:52:47.915 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:52:47.915 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.915 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.915 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:47.915 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:52:47.915 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:52:47.915 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.915 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.915 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:47.916 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:52:47.916 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:52:47.916 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.916 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.916 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:47.916 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:52:47.916 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:52:47.916 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.916 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.916 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:47.916 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:52:47.916 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:52:47.916 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.916 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.917 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:47.917 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:52:47.917 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:52:47.917 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.917 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.917 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:47.917 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:52:47.917 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:52:47.917 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.917 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.917 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:47.917 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:52:47.917 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:52:47.917 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.917 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.918 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:47.918 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:52:47.918 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:52:47.918 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:47.918 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:47.918 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:47.918 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.918 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.918 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:47.918 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:52:47.918 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 54.825980680999997, 2024-04-25T22:52:47.918 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:52:47.918 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:47.919 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:47.919 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:52:47.919 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:47.919 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.919 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:47.919 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:52:47.919 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:47.919 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.919 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.919 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:47.919 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:52:47.919 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:47.919 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.919 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.920 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:47.920 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:52:47.920 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:52:47.920 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.920 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.920 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:47.920 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:52:47.920 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:52:47.920 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.920 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.920 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:47.920 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:52:47.920 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:52:47.920 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.921 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.921 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:47.921 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:52:47.921 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:52:47.921 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.921 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.921 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:47.921 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:52:47.921 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:52:47.921 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.921 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.921 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:52:47.921 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:52:47.921 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:52:47.922 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.922 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.922 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:47.922 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:52:47.922 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:52:47.922 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.922 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.922 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:47.922 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:52:47.922 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:52:47.922 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.922 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.923 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:47.923 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:52:47.923 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:52:47.923 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:47.923 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:47.923 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:47.923 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.923 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.923 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:47.923 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:47.923 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 54.825949600000001, 2024-04-25T22:52:47.923 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:52:47.923 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:47.923 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:47.924 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:52:47.924 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:47.924 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.924 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:47.924 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:47.924 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:47.924 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.924 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.924 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:47.924 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:47.924 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:47.924 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.924 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.925 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:47.925 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:47.925 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:52:47.925 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.925 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.925 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:47.925 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:52:47.925 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:52:47.925 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.925 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.925 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:47.925 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:52:47.925 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:52:47.925 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.925 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.926 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:47.926 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:52:47.926 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:52:47.926 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.926 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.926 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:47.926 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:52:47.926 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:52:47.926 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.926 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.926 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:47.926 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:52:47.926 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:52:47.927 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.927 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.927 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:47.927 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:52:47.927 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:52:47.927 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:47.927 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:47.927 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:47.927 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.927 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.927 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:52:47.927 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:47.927 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 54.825508630999998, 2024-04-25T22:52:47.927 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064881979999999997, 2024-04-25T22:52:47.928 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:47.928 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:47.928 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:47.928 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:47.928 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.928 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:47.928 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:47.928 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:47.928 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.928 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.928 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:47.928 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:47.928 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:47.928 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.928 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.929 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:47.929 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:47.929 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2699999999999999e-07 2024-04-25T22:52:47.929 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.929 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.929 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:47.929 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013898+0000", 2024-04-25T22:52:47.929 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0796e-05 2024-04-25T22:52:47.929 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.929 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.929 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:47.929 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013907+0000", 2024-04-25T22:52:47.929 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5140000000000007e-06 2024-04-25T22:52:47.929 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.930 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.930 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:47.930 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013952+0000", 2024-04-25T22:52:47.930 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4134000000000001e-05 2024-04-25T22:52:47.930 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.930 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.930 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:47.930 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016812+0000", 2024-04-25T22:52:47.930 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028601059999999998 2024-04-25T22:52:47.930 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.930 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.930 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:47.931 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.017052+0000", 2024-04-25T22:52:47.931 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024056500000000001 2024-04-25T22:52:47.931 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.931 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.931 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:47.931 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020350+0000", 2024-04-25T22:52:47.931 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032978320000000001 2024-04-25T22:52:47.931 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.931 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.931 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:47.931 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020375+0000", 2024-04-25T22:52:47.931 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4624e-05 2024-04-25T22:52:47.931 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:47.931 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:47.932 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:47.932 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.932 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.932 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-25T22:52:47.932 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:47.932 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 54.811978185000001, 2024-04-25T22:52:47.932 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058583000000000003, 2024-04-25T22:52:47.932 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:47.932 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:47.932 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:47.932 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:47.932 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.932 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:47.932 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:47.932 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:47.933 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.933 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.933 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:47.933 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:47.933 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:47.933 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.933 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.933 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:47.933 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:47.933 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.41e-07 2024-04-25T22:52:47.933 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.933 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.934 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:47.934 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027428+0000", 2024-04-25T22:52:47.934 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.075e-05 2024-04-25T22:52:47.934 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.934 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.934 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:47.934 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027435+0000", 2024-04-25T22:52:47.934 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3610000000000003e-06 2024-04-25T22:52:47.934 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.934 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.934 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:47.934 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027442+0000", 2024-04-25T22:52:47.934 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0400000000000004e-06 2024-04-25T22:52:47.935 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.935 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.935 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:47.935 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028094+0000", 2024-04-25T22:52:47.935 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00065134800000000005 2024-04-25T22:52:47.935 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.935 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.935 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:47.935 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028107+0000", 2024-04-25T22:52:47.935 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3087e-05 2024-04-25T22:52:47.935 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.935 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.935 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:47.935 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033239+0000", 2024-04-25T22:52:47.936 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051319429999999999 2024-04-25T22:52:47.936 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.936 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.936 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:47.936 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033275+0000", 2024-04-25T22:52:47.936 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6430000000000002e-05 2024-04-25T22:52:47.936 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:47.936 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:47.936 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:47.936 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.936 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.936 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-25T22:52:47.936 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:47.937 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 54.811593348000002, 2024-04-25T22:52:47.937 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005413597, 2024-04-25T22:52:47.937 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:47.937 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:47.937 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:47.937 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:47.937 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.937 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:47.937 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:47.937 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:47.937 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.937 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.937 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:47.937 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:47.938 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:47.938 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.938 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.938 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:47.938 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:47.938 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3799999999999997e-07 2024-04-25T22:52:47.938 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.938 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.938 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:47.938 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027816+0000", 2024-04-25T22:52:47.938 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3230999999999999e-05 2024-04-25T22:52:47.938 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.938 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.939 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:47.939 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027823+0000", 2024-04-25T22:52:47.939 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9039999999999992e-06 2024-04-25T22:52:47.939 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.939 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.939 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:47.939 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027841+0000", 2024-04-25T22:52:47.939 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7651000000000001e-05 2024-04-25T22:52:47.939 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.939 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.939 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:47.939 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027904+0000", 2024-04-25T22:52:47.939 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3058000000000005e-05 2024-04-25T22:52:47.939 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.940 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.940 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:47.940 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027926+0000", 2024-04-25T22:52:47.940 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1450999999999998e-05 2024-04-25T22:52:47.940 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.940 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.940 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:47.940 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033177+0000", 2024-04-25T22:52:47.940 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052508909999999997 2024-04-25T22:52:47.940 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.940 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.940 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:47.940 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033215+0000", 2024-04-25T22:52:47.940 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8872999999999999e-05 2024-04-25T22:52:47.941 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:47.941 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:47.941 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:47.941 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.941 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.941 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 171 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:52:47.941 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:47.941 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 54.811536246000003, 2024-04-25T22:52:47.941 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054322240000000003, 2024-04-25T22:52:47.941 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:47.941 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:47.941 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "reached pg", 2024-04-25T22:52:47.941 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:47.942 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.942 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:47.942 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:47.942 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:47.942 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.942 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.942 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:47.942 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:47.942 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:47.942 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.942 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.942 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:47.942 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:47.943 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7500000000000001e-07 2024-04-25T22:52:47.943 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.943 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.943 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:47.943 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027868+0000", 2024-04-25T22:52:47.943 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5750000000000001e-06 2024-04-25T22:52:47.943 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.943 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.943 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:47.943 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027885+0000", 2024-04-25T22:52:47.943 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7272e-05 2024-04-25T22:52:47.943 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.943 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.943 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:47.944 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027900+0000", 2024-04-25T22:52:47.944 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.502e-05 2024-04-25T22:52:47.944 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.944 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.944 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:47.944 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028381+0000", 2024-04-25T22:52:47.944 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00048039399999999998 2024-04-25T22:52:47.944 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:47.944 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:47.944 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:47.944 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033291+0000", 2024-04-25T22:52:47.944 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049105879999999996 2024-04-25T22:52:47.944 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:47.945 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:47.945 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:47.945 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:47.945 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:47.945 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:47.946 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:52:47.947 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:47.945+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:48.047 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:48.047+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:48.053 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:48.053 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:52:48.054 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-04-25T22:52:48.054 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:48.062 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:52:48.143 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is unset 2024-04-25T22:52:48.148 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:48.147+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:48.165 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:48.165 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:52:48.165 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:52:48.165 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:52:48.165 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:48.174 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:52:48.249 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:48.248+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:48.279 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:48.279 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-04-25T22:52:48.279 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-04-25T22:52:48.279 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:52:48.279 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.279 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:48.279 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:48.279 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 60.311764232999998, 2024-04-25T22:52:48.279 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0103421, 2024-04-25T22:52:48.279 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:48.280 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:48.280 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:48.280 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:48.280 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:48.280 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:48.280 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 115 2024-04-25T22:52:48.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.280 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:48.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:48.280 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:48.280 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:48.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.281 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:48.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:48.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:48.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.281 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:48.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:48.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9500000000000002e-07 2024-04-25T22:52:48.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.281 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:48.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965108+0000", 2024-04-25T22:52:48.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9177999999999994e-05 2024-04-25T22:52:48.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:48.282 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965127+0000", 2024-04-25T22:52:48.282 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8868e-05 2024-04-25T22:52:48.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:48.282 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965133+0000", 2024-04-25T22:52:48.282 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8929999999999999e-06 2024-04-25T22:52:48.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:48.282 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.969991+0000", 2024-04-25T22:52:48.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048573849999999997 2024-04-25T22:52:48.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.283 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:48.283 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970072+0000", 2024-04-25T22:52:48.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0728000000000004e-05 2024-04-25T22:52:48.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.283 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:48.283 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970189+0000", 2024-04-25T22:52:48.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000117778 2024-04-25T22:52:48.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.283 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:48.284 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970946+0000", 2024-04-25T22:52:48.284 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00075704600000000004 2024-04-25T22:52:48.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.284 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.284 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:48.284 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975297+0000", 2024-04-25T22:52:48.284 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004350217 2024-04-25T22:52:48.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.284 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.284 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:48.284 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975343+0000", 2024-04-25T22:52:48.284 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6687999999999998e-05 2024-04-25T22:52:48.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.285 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.285 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:48.285 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975380+0000", 2024-04-25T22:52:48.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6724000000000003e-05 2024-04-25T22:52:48.285 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:48.285 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:48.285 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:48.285 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.285 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.285 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:48.285 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:48.285 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 60.311658201999997, 2024-04-25T22:52:48.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010304384, 2024-04-25T22:52:48.285 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:48.286 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:48.286 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:48.286 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:48.286 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:48.286 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:48.286 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 116 2024-04-25T22:52:48.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.286 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:48.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.286 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:48.286 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:48.286 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:48.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.287 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:48.287 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:48.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:48.287 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.287 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.287 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:48.287 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:48.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5799999999999999e-07 2024-04-25T22:52:48.287 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.287 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.287 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:48.287 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965154+0000", 2024-04-25T22:52:48.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0009e-05 2024-04-25T22:52:48.287 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.288 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.288 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:48.288 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965164+0000", 2024-04-25T22:52:48.288 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8490000000000001e-06 2024-04-25T22:52:48.288 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.288 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.288 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:48.288 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965169+0000", 2024-04-25T22:52:48.288 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0730000000000004e-06 2024-04-25T22:52:48.288 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.288 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.288 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:48.288 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970609+0000", 2024-04-25T22:52:48.288 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054397689999999997 2024-04-25T22:52:48.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.289 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:48.289 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970651+0000", 2024-04-25T22:52:48.289 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1873999999999999e-05 2024-04-25T22:52:48.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.289 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:48.289 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970723+0000", 2024-04-25T22:52:48.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2039999999999995e-05 2024-04-25T22:52:48.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:48.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971358+0000", 2024-04-25T22:52:48.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063489500000000001 2024-04-25T22:52:48.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:48.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975409+0000", 2024-04-25T22:52:48.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040506880000000002 2024-04-25T22:52:48.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.291 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:48.291 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975432+0000", 2024-04-25T22:52:48.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3315999999999998e-05 2024-04-25T22:52:48.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.291 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.291 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:48.291 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975448+0000", 2024-04-25T22:52:48.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6313000000000001e-05 2024-04-25T22:52:48.291 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:48.291 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:48.291 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:48.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.291 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.291 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:48.292 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:48.292 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 60.311623619999999, 2024-04-25T22:52:48.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010384338999999999, 2024-04-25T22:52:48.292 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:48.292 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:48.292 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:48.292 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:48.292 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:48.292 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:48.292 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-04-25T22:52:48.292 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.292 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:48.292 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.292 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:48.293 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:48.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:48.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:48.293 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:48.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:48.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:48.293 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:48.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3600000000000004e-07 2024-04-25T22:52:48.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:48.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965185+0000", 2024-04-25T22:52:48.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.117e-06 2024-04-25T22:52:48.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:48.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965192+0000", 2024-04-25T22:52:48.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3239999999999997e-06 2024-04-25T22:52:48.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:48.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965198+0000", 2024-04-25T22:52:48.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6370000000000004e-06 2024-04-25T22:52:48.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:48.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970973+0000", 2024-04-25T22:52:48.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057748239999999996 2024-04-25T22:52:48.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:48.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971049+0000", 2024-04-25T22:52:48.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6029e-05 2024-04-25T22:52:48.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:48.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971174+0000", 2024-04-25T22:52:48.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012462399999999999 2024-04-25T22:52:48.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.296 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:48.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971553+0000", 2024-04-25T22:52:48.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037896499999999999 2024-04-25T22:52:48.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.296 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:48.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975482+0000", 2024-04-25T22:52:48.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039297459999999996 2024-04-25T22:52:48.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.297 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:48.297 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975529+0000", 2024-04-25T22:52:48.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6387000000000002e-05 2024-04-25T22:52:48.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.297 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:48.297 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975563+0000", 2024-04-25T22:52:48.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4150000000000003e-05 2024-04-25T22:52:48.297 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:48.297 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:48.297 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:48.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.298 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:48.298 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:48.298 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 55.264577297000002, 2024-04-25T22:52:48.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012637705000000001, 2024-04-25T22:52:48.298 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:48.298 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:48.298 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:48.298 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:48.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:48.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:48.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:48.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:48.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:48.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:48.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:48.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012227+0000", 2024-04-25T22:52:48.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.863e-06 2024-04-25T22:52:48.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:48.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012236+0000", 2024-04-25T22:52:48.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1109999999999997e-06 2024-04-25T22:52:48.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:48.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012309+0000", 2024-04-25T22:52:48.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3242000000000001e-05 2024-04-25T22:52:48.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:48.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012324+0000", 2024-04-25T22:52:48.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4837e-05 2024-04-25T22:52:48.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:48.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015060+0000", 2024-04-25T22:52:48.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027363349999999999 2024-04-25T22:52:48.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:48.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015169+0000", 2024-04-25T22:52:48.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108372 2024-04-25T22:52:48.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:48.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015498+0000", 2024-04-25T22:52:48.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032949999999999999 2024-04-25T22:52:48.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:48.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021282+0000", 2024-04-25T22:52:48.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057836429999999998 2024-04-25T22:52:48.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:48.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024709+0000", 2024-04-25T22:52:48.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034271979999999998 2024-04-25T22:52:48.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:48.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024802+0000", 2024-04-25T22:52:48.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2960000000000004e-05 2024-04-25T22:52:48.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.303 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:48.303 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024863+0000", 2024-04-25T22:52:48.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0643999999999997e-05 2024-04-25T22:52:48.303 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:48.303 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:48.303 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:48.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.303 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:48.303 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:48.303 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 55.264453525999997, 2024-04-25T22:52:48.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012979447999999999, 2024-04-25T22:52:48.303 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:48.303 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:48.304 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:48.304 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:48.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:48.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:48.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:48.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:48.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:48.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:48.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:48.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:48.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:52:48.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:48.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012354+0000", 2024-04-25T22:52:48.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7740000000000004e-06 2024-04-25T22:52:48.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:48.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012365+0000", 2024-04-25T22:52:48.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.064e-05 2024-04-25T22:52:48.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:48.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012382+0000", 2024-04-25T22:52:48.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6999000000000001e-05 2024-04-25T22:52:48.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:48.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015958+0000", 2024-04-25T22:52:48.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035765699999999998 2024-04-25T22:52:48.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:48.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016037+0000", 2024-04-25T22:52:48.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8242000000000001e-05 2024-04-25T22:52:48.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:48.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016404+0000", 2024-04-25T22:52:48.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036784300000000002 2024-04-25T22:52:48.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:48.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021294+0000", 2024-04-25T22:52:48.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048890629999999999 2024-04-25T22:52:48.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:48.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024959+0000", 2024-04-25T22:52:48.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036651570000000001 2024-04-25T22:52:48.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:48.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025097+0000", 2024-04-25T22:52:48.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013788099999999999 2024-04-25T22:52:48.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:48.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025328+0000", 2024-04-25T22:52:48.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231492 2024-04-25T22:52:48.308 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:48.308 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:48.309 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:48.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.309 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:48.309 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:48.309 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 55.264365757, 2024-04-25T22:52:48.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013049827, 2024-04-25T22:52:48.309 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:48.309 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:48.309 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:48.309 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:48.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:48.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:48.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:48.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:48.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:48.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:48.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:48.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012437+0000", 2024-04-25T22:52:48.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-04-25T22:52:48.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:48.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012440+0000", 2024-04-25T22:52:48.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7609999999999999e-06 2024-04-25T22:52:48.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:48.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012449+0000", 2024-04-25T22:52:48.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.285e-06 2024-04-25T22:52:48.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:48.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012457+0000", 2024-04-25T22:52:48.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9510000000000006e-06 2024-04-25T22:52:48.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:48.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017106+0000", 2024-04-25T22:52:48.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046494220000000003 2024-04-25T22:52:48.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:48.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017223+0000", 2024-04-25T22:52:48.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116824 2024-04-25T22:52:48.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:48.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017345+0000", 2024-04-25T22:52:48.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122175 2024-04-25T22:52:48.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:48.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021299+0000", 2024-04-25T22:52:48.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039534879999999998 2024-04-25T22:52:48.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:48.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025398+0000", 2024-04-25T22:52:48.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040988960000000003 2024-04-25T22:52:48.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:48.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025439+0000", 2024-04-25T22:52:48.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0915999999999999e-05 2024-04-25T22:52:48.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:48.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025486+0000", 2024-04-25T22:52:48.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7534999999999998e-05 2024-04-25T22:52:48.314 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:48.314 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:48.314 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:48.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.314 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:48.314 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:48.314 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 55.264335606000003, 2024-04-25T22:52:48.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020988041999999998, 2024-04-25T22:52:48.315 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:48.315 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:48.315 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:48.315 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:48.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:48.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:48.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:48.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:48.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:48.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:48.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:48.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:48.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.99e-07 2024-04-25T22:52:48.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:48.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012470+0000", 2024-04-25T22:52:48.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2789999999999999e-06 2024-04-25T22:52:48.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:48.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012477+0000", 2024-04-25T22:52:48.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:52:48.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:48.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012500+0000", 2024-04-25T22:52:48.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2490999999999999e-05 2024-04-25T22:52:48.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:48.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021911+0000", 2024-04-25T22:52:48.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094114160000000006 2024-04-25T22:52:48.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:48.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022000+0000", 2024-04-25T22:52:48.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8601000000000001e-05 2024-04-25T22:52:48.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:48.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022359+0000", 2024-04-25T22:52:48.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035921999999999999 2024-04-25T22:52:48.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:48.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025541+0000", 2024-04-25T22:52:48.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031820619999999998 2024-04-25T22:52:48.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:48.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033375+0000", 2024-04-25T22:52:48.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078338379999999992 2024-04-25T22:52:48.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:48.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033415+0000", 2024-04-25T22:52:48.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9527000000000003e-05 2024-04-25T22:52:48.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:48.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033455+0000", 2024-04-25T22:52:48.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9932000000000003e-05 2024-04-25T22:52:48.319 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:48.319 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:48.320 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:48.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.320 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:48.320 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:48.320 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 55.264280413000002, 2024-04-25T22:52:48.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021043857999999999, 2024-04-25T22:52:48.320 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:48.320 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:48.320 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:48.320 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:48.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:48.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:48.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:48.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:48.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:48.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:48.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:48.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012523+0000", 2024-04-25T22:52:48.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.361e-06 2024-04-25T22:52:48.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:48.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012530+0000", 2024-04-25T22:52:48.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5440000000000004e-06 2024-04-25T22:52:48.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:48.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012541+0000", 2024-04-25T22:52:48.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1745e-05 2024-04-25T22:52:48.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:48.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012551+0000", 2024-04-25T22:52:48.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5789999999999993e-06 2024-04-25T22:52:48.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:48.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022709+0000", 2024-04-25T22:52:48.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010157685 2024-04-25T22:52:48.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:48.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022957+0000", 2024-04-25T22:52:48.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024824599999999998 2024-04-25T22:52:48.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:48.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023443+0000", 2024-04-25T22:52:48.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048578599999999999 2024-04-25T22:52:48.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:48.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025547+0000", 2024-04-25T22:52:48.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021044789999999998 2024-04-25T22:52:48.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:48.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033509+0000", 2024-04-25T22:52:48.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0079622180000000001 2024-04-25T22:52:48.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:48.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033542+0000", 2024-04-25T22:52:48.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3018000000000001e-05 2024-04-25T22:52:48.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:48.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033566+0000", 2024-04-25T22:52:48.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3197000000000002e-05 2024-04-25T22:52:48.325 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:48.325 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:48.325 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:48.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.325 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:48.325 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:48.325 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 55.264240448000002, 2024-04-25T22:52:48.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021122696, 2024-04-25T22:52:48.326 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:48.326 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:48.326 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:48.326 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:48.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:48.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:48.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:48.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:48.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:48.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:48.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:48.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:48.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:52:48.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:48.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012566+0000", 2024-04-25T22:52:48.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-04-25T22:52:48.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:48.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012619+0000", 2024-04-25T22:52:48.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2607e-05 2024-04-25T22:52:48.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:48.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012628+0000", 2024-04-25T22:52:48.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6500000000000008e-06 2024-04-25T22:52:48.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:48.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024024+0000", 2024-04-25T22:52:48.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011396007999999999 2024-04-25T22:52:48.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:48.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024198+0000", 2024-04-25T22:52:48.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000173215 2024-04-25T22:52:48.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:48.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024447+0000", 2024-04-25T22:52:48.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024898500000000002 2024-04-25T22:52:48.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:48.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026431+0000", 2024-04-25T22:52:48.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001984923 2024-04-25T22:52:48.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:48.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033608+0000", 2024-04-25T22:52:48.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071768459999999997 2024-04-25T22:52:48.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:48.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033646+0000", 2024-04-25T22:52:48.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299000000000003e-05 2024-04-25T22:52:48.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:48.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033684+0000", 2024-04-25T22:52:48.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8773000000000003e-05 2024-04-25T22:52:48.331 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:48.331 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:48.331 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:48.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.331 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:48.331 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:48.331 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 55.264151849000001, 2024-04-25T22:52:48.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021175381, 2024-04-25T22:52:48.331 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:48.331 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:48.331 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:48.331 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:48.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:48.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:48.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:48.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:48.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:48.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:48.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:48.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012651+0000", 2024-04-25T22:52:48.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:52:48.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:48.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012656+0000", 2024-04-25T22:52:48.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8899999999999998e-06 2024-04-25T22:52:48.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:48.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012666+0000", 2024-04-25T22:52:48.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0346999999999999e-05 2024-04-25T22:52:48.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:48.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012675+0000", 2024-04-25T22:52:48.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9930000000000001e-06 2024-04-25T22:52:48.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:48.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025661+0000", 2024-04-25T22:52:48.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01298531 2024-04-25T22:52:48.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:48.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025757+0000", 2024-04-25T22:52:48.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5822000000000005e-05 2024-04-25T22:52:48.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:48.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025907+0000", 2024-04-25T22:52:48.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015051499999999999 2024-04-25T22:52:48.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:48.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026435+0000", 2024-04-25T22:52:48.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052762200000000005 2024-04-25T22:52:48.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:48.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033732+0000", 2024-04-25T22:52:48.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072978419999999997 2024-04-25T22:52:48.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:48.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033787+0000", 2024-04-25T22:52:48.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4703999999999997e-05 2024-04-25T22:52:48.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:48.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033826+0000", 2024-04-25T22:52:48.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8458999999999999e-05 2024-04-25T22:52:48.336 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:48.336 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:48.336 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:48.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.337 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:48.337 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:48.337 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 55.264096434999999, 2024-04-25T22:52:48.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021244174000000001, 2024-04-25T22:52:48.337 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:48.337 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:48.337 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:48.337 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:48.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:48.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:48.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:48.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:48.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:48.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:48.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:48.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:48.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:52:48.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:48.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012712+0000", 2024-04-25T22:52:48.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.913e-06 2024-04-25T22:52:48.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:48.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012722+0000", 2024-04-25T22:52:48.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2879999999999998e-06 2024-04-25T22:52:48.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:48.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012727+0000", 2024-04-25T22:52:48.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8429999999999998e-06 2024-04-25T22:52:48.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:48.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026099+0000", 2024-04-25T22:52:48.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013371450999999999 2024-04-25T22:52:48.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:48.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026147+0000", 2024-04-25T22:52:48.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7837999999999998e-05 2024-04-25T22:52:48.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:48.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026254+0000", 2024-04-25T22:52:48.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107314 2024-04-25T22:52:48.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:48.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026686+0000", 2024-04-25T22:52:48.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000432428 2024-04-25T22:52:48.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:48.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033873+0000", 2024-04-25T22:52:48.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071864399999999997 2024-04-25T22:52:48.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:48.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033904+0000", 2024-04-25T22:52:48.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1321e-05 2024-04-25T22:52:48.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:48.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033950+0000", 2024-04-25T22:52:48.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5707999999999997e-05 2024-04-25T22:52:48.342 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:48.342 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:48.342 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:48.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.342 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:48.342 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:48.342 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 55.264066049999997, 2024-04-25T22:52:48.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01096505, 2024-04-25T22:52:48.342 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:48.343 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:48.343 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:48.343 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:48.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:48.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:48.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:48.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:48.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:48.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:48.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:48.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012737+0000", 2024-04-25T22:52:48.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:52:48.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:48.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012739+0000", 2024-04-25T22:52:48.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-04-25T22:52:48.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:48.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012743+0000", 2024-04-25T22:52:48.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3239999999999996e-06 2024-04-25T22:52:48.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:48.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012746+0000", 2024-04-25T22:52:48.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.129e-06 2024-04-25T22:52:48.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:48.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012796+0000", 2024-04-25T22:52:48.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9231999999999999e-05 2024-04-25T22:52:48.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:48.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012915+0000", 2024-04-25T22:52:48.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119021 2024-04-25T22:52:48.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:48.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013069+0000", 2024-04-25T22:52:48.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015463900000000001 2024-04-25T22:52:48.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:48.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019237+0000", 2024-04-25T22:52:48.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061680329999999998 2024-04-25T22:52:48.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:48.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023603+0000", 2024-04-25T22:52:48.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043655860000000003 2024-04-25T22:52:48.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:48.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023659+0000", 2024-04-25T22:52:48.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6484000000000003e-05 2024-04-25T22:52:48.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:48.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023701+0000", 2024-04-25T22:52:48.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1761999999999998e-05 2024-04-25T22:52:48.347 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:48.347 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:48.348 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:48.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.348 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:48.348 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:48.348 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 55.264041102, 2024-04-25T22:52:48.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011234429000000001, 2024-04-25T22:52:48.348 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:48.348 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:48.348 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:48.348 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:48.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:48.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:48.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:48.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:48.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:48.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:48.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:48.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012762+0000", 2024-04-25T22:52:48.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-04-25T22:52:48.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:48.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012765+0000", 2024-04-25T22:52:48.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2569999999999999e-06 2024-04-25T22:52:48.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:48.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012783+0000", 2024-04-25T22:52:48.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8431999999999999e-05 2024-04-25T22:52:48.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:48.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012799+0000", 2024-04-25T22:52:48.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5438999999999999e-05 2024-04-25T22:52:48.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:48.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013826+0000", 2024-04-25T22:52:48.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010275060000000001 2024-04-25T22:52:48.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:48.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013913+0000", 2024-04-25T22:52:48.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.708e-05 2024-04-25T22:52:48.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:48.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014098+0000", 2024-04-25T22:52:48.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018519399999999999 2024-04-25T22:52:48.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:48.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019684+0000", 2024-04-25T22:52:48.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055860079999999999 2024-04-25T22:52:48.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:48.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023876+0000", 2024-04-25T22:52:48.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041918800000000003 2024-04-25T22:52:48.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:48.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023957+0000", 2024-04-25T22:52:48.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1165e-05 2024-04-25T22:52:48.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:48.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023995+0000", 2024-04-25T22:52:48.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:52:48.353 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:48.353 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:48.353 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:48.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.353 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:48.354 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:48.354 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 55.263943322999999, 2024-04-25T22:52:48.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011131200000000001, 2024-04-25T22:52:48.354 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:48.354 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:48.354 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:48.354 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:48.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:48.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:48.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:48.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:48.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:48.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:48.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:48.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012860+0000", 2024-04-25T22:52:48.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3900000000000004e-07 2024-04-25T22:52:48.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:48.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012865+0000", 2024-04-25T22:52:48.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5609999999999998e-06 2024-04-25T22:52:48.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:48.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012895+0000", 2024-04-25T22:52:48.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9847000000000001e-05 2024-04-25T22:52:48.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:48.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012905+0000", 2024-04-25T22:52:48.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.03e-05 2024-04-25T22:52:48.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:48.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015020+0000", 2024-04-25T22:52:48.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021142940000000001 2024-04-25T22:52:48.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:48.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015182+0000", 2024-04-25T22:52:48.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016248099999999999 2024-04-25T22:52:48.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:52:48.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015357+0000", 2024-04-25T22:52:48.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017471000000000001 2024-04-25T22:52:48.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:48.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021021+0000", 2024-04-25T22:52:48.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056638340000000004 2024-04-25T22:52:48.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:48.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023712+0000", 2024-04-25T22:52:48.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026910380000000002 2024-04-25T22:52:48.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:48.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023763+0000", 2024-04-25T22:52:48.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1477999999999997e-05 2024-04-25T22:52:48.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:48.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023990+0000", 2024-04-25T22:52:48.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000226818 2024-04-25T22:52:48.359 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:48.359 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:48.359 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:48.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.359 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:48.359 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:48.359 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 55.263820226999997, 2024-04-25T22:52:48.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011705299000000001, 2024-04-25T22:52:48.359 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:48.360 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:48.360 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:48.360 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:48.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.360 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:48.360 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:48.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:48.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.360 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:48.360 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:48.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:48.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.360 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:48.361 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012983+0000", 2024-04-25T22:52:48.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:52:48.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.361 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:48.361 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012986+0000", 2024-04-25T22:52:48.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5700000000000001e-06 2024-04-25T22:52:48.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.361 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:48.361 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012993+0000", 2024-04-25T22:52:48.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8730000000000001e-06 2024-04-25T22:52:48.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:48.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013000+0000", 2024-04-25T22:52:48.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1890000000000001e-06 2024-04-25T22:52:48.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:48.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:52:48.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002147866 2024-04-25T22:52:48.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:48.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015351+0000", 2024-04-25T22:52:48.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020300799999999999 2024-04-25T22:52:48.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:48.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016260+0000", 2024-04-25T22:52:48.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00090926799999999997 2024-04-25T22:52:48.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:48.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022669+0000", 2024-04-25T22:52:48.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064082849999999997 2024-04-25T22:52:48.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:48.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024584+0000", 2024-04-25T22:52:48.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019151699999999999 2024-04-25T22:52:48.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:48.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024643+0000", 2024-04-25T22:52:48.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8888999999999998e-05 2024-04-25T22:52:48.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:48.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024687+0000", 2024-04-25T22:52:48.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4444999999999999e-05 2024-04-25T22:52:48.364 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:48.365 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:48.365 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:48.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.365 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:48.365 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:48.365 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 55.263792635999998, 2024-04-25T22:52:48.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011249699, 2024-04-25T22:52:48.365 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:48.365 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:48.365 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:48.365 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:48.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:48.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:48.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:48.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:48.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:48.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:48.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:48.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013010+0000", 2024-04-25T22:52:48.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2099999999999996e-07 2024-04-25T22:52:48.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:48.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013013+0000", 2024-04-25T22:52:48.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1310000000000002e-06 2024-04-25T22:52:48.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:48.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013020+0000", 2024-04-25T22:52:48.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3330000000000002e-06 2024-04-25T22:52:48.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:48.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013025+0000", 2024-04-25T22:52:48.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6760000000000004e-06 2024-04-25T22:52:48.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:48.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013163+0000", 2024-04-25T22:52:48.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013824599999999999 2024-04-25T22:52:48.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:48.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013504+0000", 2024-04-25T22:52:48.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034080299999999998 2024-04-25T22:52:48.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:48.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013613+0000", 2024-04-25T22:52:48.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108705 2024-04-25T22:52:48.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:48.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015831+0000", 2024-04-25T22:52:48.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002217672 2024-04-25T22:52:48.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:48.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024137+0000", 2024-04-25T22:52:48.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0083060489999999994 2024-04-25T22:52:48.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:48.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024218+0000", 2024-04-25T22:52:48.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1351000000000001e-05 2024-04-25T22:52:48.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:48.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024259+0000", 2024-04-25T22:52:48.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1112000000000002e-05 2024-04-25T22:52:48.370 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:48.370 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:48.370 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:48.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.371 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:48.371 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:48.371 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 55.263704910000001, 2024-04-25T22:52:48.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020379749999999999, 2024-04-25T22:52:48.371 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:48.371 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:48.371 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:48.371 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:48.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:48.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:48.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:48.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:48.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:48.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:48.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:48.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013098+0000", 2024-04-25T22:52:48.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:52:48.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:48.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013105+0000", 2024-04-25T22:52:48.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5969999999999997e-06 2024-04-25T22:52:48.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:48.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013190+0000", 2024-04-25T22:52:48.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5618999999999995e-05 2024-04-25T22:52:48.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:48.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013200+0000", 2024-04-25T22:52:48.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5859999999999994e-06 2024-04-25T22:52:48.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:48.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020265+0000", 2024-04-25T22:52:48.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070653349999999998 2024-04-25T22:52:48.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:48.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020454+0000", 2024-04-25T22:52:48.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189316 2024-04-25T22:52:48.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:48.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020586+0000", 2024-04-25T22:52:48.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013195700000000001 2024-04-25T22:52:48.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:48.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023822+0000", 2024-04-25T22:52:48.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032358529999999999 2024-04-25T22:52:48.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:48.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033409+0000", 2024-04-25T22:52:48.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095870520000000004 2024-04-25T22:52:48.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:48.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033447+0000", 2024-04-25T22:52:48.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7261999999999997e-05 2024-04-25T22:52:48.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:48.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033477+0000", 2024-04-25T22:52:48.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0389e-05 2024-04-25T22:52:48.376 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:48.376 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:48.376 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:48.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.377 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:48.377 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:48.377 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 55.263588403999997, 2024-04-25T22:52:48.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010857383999999999, 2024-04-25T22:52:48.377 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:48.377 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:48.377 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:48.377 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:48.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:48.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:48.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:48.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:48.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:48.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:48.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:48.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:48.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:52:48.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:48.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013218+0000", 2024-04-25T22:52:48.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8199999999999998e-06 2024-04-25T22:52:48.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:48.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013226+0000", 2024-04-25T22:52:48.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7649999999999993e-06 2024-04-25T22:52:48.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:48.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013259+0000", 2024-04-25T22:52:48.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2727e-05 2024-04-25T22:52:48.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:48.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014809+0000", 2024-04-25T22:52:48.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001550144 2024-04-25T22:52:48.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:48.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014958+0000", 2024-04-25T22:52:48.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014890300000000001 2024-04-25T22:52:48.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:52:48.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015087+0000", 2024-04-25T22:52:48.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012939200000000001 2024-04-25T22:52:48.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:48.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020212+0000", 2024-04-25T22:52:48.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051248939999999996 2024-04-25T22:52:48.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:48.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023699+0000", 2024-04-25T22:52:48.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034873289999999999 2024-04-25T22:52:48.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:48.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024014+0000", 2024-04-25T22:52:48.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031473999999999999 2024-04-25T22:52:48.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:48.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024071+0000", 2024-04-25T22:52:48.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7040000000000003e-05 2024-04-25T22:52:48.382 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:48.382 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:48.382 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:48.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.382 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:48.382 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:48.383 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 55.263533699, 2024-04-25T22:52:48.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012329677000000001, 2024-04-25T22:52:48.383 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:48.383 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:48.383 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:48.383 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:48.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:48.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:48.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:48.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:48.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:48.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:48.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:48.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013269+0000", 2024-04-25T22:52:48.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5000000000000002e-07 2024-04-25T22:52:48.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:48.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:52:48.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6909999999999999e-06 2024-04-25T22:52:48.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:48.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013284+0000", 2024-04-25T22:52:48.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0963e-05 2024-04-25T22:52:48.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:48.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013361+0000", 2024-04-25T22:52:48.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7379999999999994e-05 2024-04-25T22:52:48.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:48.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013448+0000", 2024-04-25T22:52:48.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6990000000000006e-05 2024-04-25T22:52:48.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:48.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013632+0000", 2024-04-25T22:52:48.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018396800000000001 2024-04-25T22:52:48.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:48.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013800+0000", 2024-04-25T22:52:48.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167467 2024-04-25T22:52:48.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:48.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.018570+0000", 2024-04-25T22:52:48.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047701460000000003 2024-04-25T22:52:48.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:48.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025507+0000", 2024-04-25T22:52:48.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069372039999999998 2024-04-25T22:52:48.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:48.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025562+0000", 2024-04-25T22:52:48.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4858999999999998e-05 2024-04-25T22:52:48.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:48.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025598+0000", 2024-04-25T22:52:48.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6259e-05 2024-04-25T22:52:48.388 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:48.388 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:48.388 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:48.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.388 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:48.388 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:48.388 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 55.263401825999999, 2024-04-25T22:52:48.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020176666999999999, 2024-04-25T22:52:48.388 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:48.388 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:48.388 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:52:48.389 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:48.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:48.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:48.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:48.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:48.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:48.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:48.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:48.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:52:48.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-04-25T22:52:48.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:48.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013405+0000", 2024-04-25T22:52:48.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0559999999999998e-06 2024-04-25T22:52:48.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:48.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013422+0000", 2024-04-25T22:52:48.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6770999999999999e-05 2024-04-25T22:52:48.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:48.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013431+0000", 2024-04-25T22:52:48.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5019999999999998e-06 2024-04-25T22:52:48.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:48.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021720+0000", 2024-04-25T22:52:48.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082884340000000008 2024-04-25T22:52:48.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:48.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022122+0000", 2024-04-25T22:52:48.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000401634 2024-04-25T22:52:48.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:48.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:48.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:48.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033577+0000", 2024-04-25T22:52:48.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011455435999999999 2024-04-25T22:52:48.392 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:48.392 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:48.392 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:48.392 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:48.392 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:48.392 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:48.394 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:52:48.394 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:48.393+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:48.494 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:48.493+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:48.501 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:48.501 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:52:48.501 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-25T22:52:48.501 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:48.510 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:52:48.595 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:48.593+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:48.652 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:48.653 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:52:48.653 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-25T22:52:48.653 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-25T22:52:48.653 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:48.661 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:52:48.702 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:48.701+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:48.797 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:48.796+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:48.805 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:48.805 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:52:48.805 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:52:48.805 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:52:48.805 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.806 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:52:48.806 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:52:48.806 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 60.836872767999999, 2024-04-25T22:52:48.806 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:52:48.806 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:48.806 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:48.806 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:48.806 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:48.806 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.806 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:48.806 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:52:48.806 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:48.806 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.807 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.807 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:48.807 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:52:48.807 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:48.807 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.807 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.807 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:48.807 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:52:48.807 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:52:48.807 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.807 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.807 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:48.807 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:52:48.807 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:52:48.808 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.808 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.808 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:48.808 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:52:48.808 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:52:48.808 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.808 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.808 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:48.808 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:52:48.808 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:52:48.808 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.808 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.808 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:48.808 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:52:48.809 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:52:48.809 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.809 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.809 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:48.809 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:52:48.809 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:52:48.809 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.809 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.809 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:48.809 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:52:48.809 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:52:48.809 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.809 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.809 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:48.810 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:52:48.810 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:52:48.810 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:48.810 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:48.810 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:48.810 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.810 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.810 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:110 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'72, mlcod=10'68)", 2024-04-25T22:52:48.810 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:48.810 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 60.836238768000001, 2024-04-25T22:52:48.810 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065316630000000001, 2024-04-25T22:52:48.810 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:48.810 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:48.811 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:48.811 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:48.811 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.811 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:48.811 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:48.811 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:48.811 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.811 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.811 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:48.811 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:48.811 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:48.811 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.811 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.811 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:48.812 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:48.812 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.58e-07 2024-04-25T22:52:48.812 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.812 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.812 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:48.812 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967811+0000", 2024-04-25T22:52:48.812 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.118e-06 2024-04-25T22:52:48.812 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.812 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.812 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:48.812 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967817+0000", 2024-04-25T22:52:48.812 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3709999999999996e-06 2024-04-25T22:52:48.812 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.812 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.812 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:48.813 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967820+0000", 2024-04-25T22:52:48.813 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2210000000000002e-06 2024-04-25T22:52:48.813 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.813 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.813 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:48.813 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967876+0000", 2024-04-25T22:52:48.813 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5507000000000002e-05 2024-04-25T22:52:48.813 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.813 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.813 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:48.813 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967893+0000", 2024-04-25T22:52:48.813 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7812000000000002e-05 2024-04-25T22:52:48.813 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.814 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.814 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:48.814 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974317+0000", 2024-04-25T22:52:48.814 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064237160000000003 2024-04-25T22:52:48.814 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.814 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.814 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:48.814 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:52:48.814 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.156e-05 2024-04-25T22:52:48.814 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:48.814 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:48.814 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:48.814 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.814 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.815 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'68)", 2024-04-25T22:52:48.815 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:48.815 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 60.835821254999999, 2024-04-25T22:52:48.815 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061292279999999996, 2024-04-25T22:52:48.815 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:48.815 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:48.815 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:48.815 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:48.815 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.815 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:48.815 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:48.815 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:48.815 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.815 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.815 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:48.816 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:48.816 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:48.816 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.816 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.816 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:48.816 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:48.816 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6300000000000001e-07 2024-04-25T22:52:48.816 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.816 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.816 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:48.816 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968228+0000", 2024-04-25T22:52:48.816 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6139999999999999e-06 2024-04-25T22:52:48.816 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.817 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.817 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:48.817 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968235+0000", 2024-04-25T22:52:48.817 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7020000000000001e-06 2024-04-25T22:52:48.817 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.817 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.817 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:48.817 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968238+0000", 2024-04-25T22:52:48.817 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0010000000000002e-06 2024-04-25T22:52:48.817 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.817 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.817 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:48.817 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968297+0000", 2024-04-25T22:52:48.817 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8424999999999997e-05 2024-04-25T22:52:48.817 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.818 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.818 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:48.818 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968316+0000", 2024-04-25T22:52:48.818 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8814999999999999e-05 2024-04-25T22:52:48.818 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.818 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.818 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:48.818 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:52:48.818 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060239439999999998 2024-04-25T22:52:48.818 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.818 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.818 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:48.818 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974354+0000", 2024-04-25T22:52:48.819 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4364e-05 2024-04-25T22:52:48.819 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:48.819 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:48.819 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:48.819 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.819 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.819 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'68)", 2024-04-25T22:52:48.819 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:48.819 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 60.835384253000001, 2024-04-25T22:52:48.819 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005948414, 2024-04-25T22:52:48.819 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:48.819 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:48.819 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:48.819 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:48.820 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.820 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:48.820 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:48.820 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:48.820 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.820 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.820 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:48.820 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:48.820 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:48.820 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.820 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.820 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:48.820 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:48.820 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6199999999999998e-07 2024-04-25T22:52:48.821 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.821 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.821 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:48.821 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968723+0000", 2024-04-25T22:52:48.821 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1148999999999993e-05 2024-04-25T22:52:48.821 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.821 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.821 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:48.821 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968730+0000", 2024-04-25T22:52:48.821 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1749999999999999e-06 2024-04-25T22:52:48.821 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.821 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.821 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:48.821 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968734+0000", 2024-04-25T22:52:48.822 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5200000000000002e-06 2024-04-25T22:52:48.822 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.822 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.822 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:48.822 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968771+0000", 2024-04-25T22:52:48.822 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6851999999999999e-05 2024-04-25T22:52:48.822 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.822 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.822 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:48.822 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968788+0000", 2024-04-25T22:52:48.822 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7027000000000001e-05 2024-04-25T22:52:48.822 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.822 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.822 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:48.823 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974589+0000", 2024-04-25T22:52:48.823 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058013320000000002 2024-04-25T22:52:48.823 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.823 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.823 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:48.823 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974610+0000", 2024-04-25T22:52:48.823 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0897e-05 2024-04-25T22:52:48.823 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:48.823 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:48.823 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:48.823 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.823 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.823 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'68)", 2024-04-25T22:52:48.823 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:48.824 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 60.834814242999997, 2024-04-25T22:52:48.824 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053935750000000003, 2024-04-25T22:52:48.824 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:48.824 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:48.824 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:48.824 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:48.824 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.824 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:48.824 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:48.824 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:48.824 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.824 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.824 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:48.824 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:48.825 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:48.825 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.825 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.825 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:48.825 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:48.825 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.03e-07 2024-04-25T22:52:48.825 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.825 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.825 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:48.825 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969235+0000", 2024-04-25T22:52:48.825 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2399999999999999e-06 2024-04-25T22:52:48.825 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.825 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.825 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:48.825 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969242+0000", 2024-04-25T22:52:48.826 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1269999999999997e-06 2024-04-25T22:52:48.826 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.826 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.826 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:48.826 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969246+0000", 2024-04-25T22:52:48.826 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3840000000000001e-06 2024-04-25T22:52:48.826 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.826 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.826 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:48.826 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969278+0000", 2024-04-25T22:52:48.826 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1868e-05 2024-04-25T22:52:48.826 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.826 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.826 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:48.827 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969295+0000", 2024-04-25T22:52:48.827 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7530999999999999e-05 2024-04-25T22:52:48.827 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.827 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.827 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:48.827 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974611+0000", 2024-04-25T22:52:48.827 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053160789999999996 2024-04-25T22:52:48.827 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.827 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.827 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:48.827 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974625+0000", 2024-04-25T22:52:48.827 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3943e-05 2024-04-25T22:52:48.827 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:48.827 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:48.828 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:48.828 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.828 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.828 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-25T22:52:48.828 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:48.828 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 60.641218334999998, 2024-04-25T22:52:48.828 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054952610000000004, 2024-04-25T22:52:48.828 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:48.828 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:48.828 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:48.828 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:48.828 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.828 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:48.828 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:48.828 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:48.829 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.829 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.829 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:48.829 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:48.829 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:48.829 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.829 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.829 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:48.829 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:48.829 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.68e-07 2024-04-25T22:52:48.829 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.829 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.829 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:48.829 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162898+0000", 2024-04-25T22:52:48.830 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9470999999999999e-05 2024-04-25T22:52:48.830 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.830 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.830 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:48.830 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162906+0000", 2024-04-25T22:52:48.830 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1580000000000005e-06 2024-04-25T22:52:48.830 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.830 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.830 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:48.830 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162911+0000", 2024-04-25T22:52:48.830 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4779999999999999e-06 2024-04-25T22:52:48.830 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.830 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.830 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:48.831 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162952+0000", 2024-04-25T22:52:48.831 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0629e-05 2024-04-25T22:52:48.831 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.831 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.831 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:48.831 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162968+0000", 2024-04-25T22:52:48.831 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6239000000000002e-05 2024-04-25T22:52:48.831 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.831 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.831 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:48.831 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168281+0000", 2024-04-25T22:52:48.831 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053132869999999999 2024-04-25T22:52:48.831 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.831 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.832 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:48.832 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168323+0000", 2024-04-25T22:52:48.832 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1430999999999997e-05 2024-04-25T22:52:48.832 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:48.832 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:48.832 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:48.832 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.832 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.832 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-04-25T22:52:48.832 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:48.832 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 60.210740973, 2024-04-25T22:52:48.832 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050872510000000001, 2024-04-25T22:52:48.832 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:48.833 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:48.833 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:48.833 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:48.833 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.833 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:48.833 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:48.833 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:48.833 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.833 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.833 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:48.833 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:48.833 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:48.833 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.833 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.834 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:48.834 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:48.834 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.72e-07 2024-04-25T22:52:48.834 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.834 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.834 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:48.834 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593381+0000", 2024-04-25T22:52:48.834 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5797000000000006e-05 2024-04-25T22:52:48.834 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.834 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.834 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:48.834 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593389+0000", 2024-04-25T22:52:48.834 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8480000000000001e-06 2024-04-25T22:52:48.834 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.835 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.835 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:48.835 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593393+0000", 2024-04-25T22:52:48.835 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4819999999999996e-06 2024-04-25T22:52:48.835 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.835 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.835 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:48.835 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593435+0000", 2024-04-25T22:52:48.835 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1600000000000002e-05 2024-04-25T22:52:48.835 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.835 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.835 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:48.835 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593454+0000", 2024-04-25T22:52:48.835 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8868e-05 2024-04-25T22:52:48.836 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.836 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.836 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:48.836 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598350+0000", 2024-04-25T22:52:48.836 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004895763 2024-04-25T22:52:48.836 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.836 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.836 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:48.836 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598392+0000", 2024-04-25T22:52:48.836 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2521000000000002e-05 2024-04-25T22:52:48.836 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:48.836 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:48.836 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:48.836 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.836 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.837 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:48.837 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:52:48.837 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 55.792377068999997, 2024-04-25T22:52:48.837 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:52:48.837 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:48.837 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:48.837 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:48.837 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:48.837 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.837 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:48.837 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:52:48.837 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:48.837 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.837 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.838 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:48.838 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:52:48.838 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:48.838 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.838 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.838 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:48.838 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:52:48.838 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:52:48.838 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.838 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.838 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:48.838 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:52:48.838 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:52:48.838 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.839 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.839 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:48.839 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:52:48.839 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:52:48.839 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.839 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.839 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:48.839 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:52:48.839 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:52:48.839 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.839 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.839 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:48.839 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:52:48.840 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:52:48.840 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.840 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.840 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:48.840 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:52:48.840 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:52:48.840 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.840 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.840 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:48.840 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:52:48.840 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:52:48.840 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.840 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.840 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:48.840 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:52:48.841 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:52:48.841 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.841 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.841 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:48.841 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:52:48.841 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:52:48.841 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.841 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.841 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:48.841 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:52:48.841 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:52:48.841 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.841 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.841 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:48.842 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:52:48.842 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:52:48.842 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:48.842 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:48.842 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:48.842 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.842 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.842 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:48.842 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:52:48.842 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 55.791702692999998, 2024-04-25T22:52:48.842 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:52:48.842 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:48.842 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:48.843 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:48.843 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:48.843 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.843 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:48.843 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:52:48.843 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:48.843 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.843 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.843 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:48.843 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:52:48.843 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:48.843 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.843 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.843 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:48.844 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:52:48.844 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:52:48.844 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.844 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.844 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:48.844 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:52:48.844 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:52:48.844 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.844 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.844 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:48.844 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:52:48.844 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:52:48.844 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.844 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.844 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:48.845 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:52:48.845 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:52:48.845 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.845 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.845 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:48.845 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:52:48.845 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:52:48.845 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.845 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.845 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:48.845 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:52:48.845 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:52:48.845 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.845 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.846 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:48.846 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:52:48.846 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:52:48.846 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.846 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.846 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:48.846 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:52:48.846 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:52:48.846 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.846 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.846 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:48.846 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:52:48.846 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:52:48.846 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.847 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.847 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:48.847 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:52:48.847 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:52:48.847 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.847 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.847 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:48.847 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:52:48.847 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:52:48.847 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:48.847 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:48.847 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:48.847 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.847 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.848 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:48.848 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:52:48.848 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 55.791193481000001, 2024-04-25T22:52:48.848 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:52:48.848 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:48.848 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:48.848 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:48.848 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:48.848 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.848 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:48.848 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:52:48.848 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:48.848 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.848 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.849 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:48.849 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:52:48.849 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:48.849 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.849 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.849 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:48.849 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:52:48.849 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:52:48.849 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.849 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.849 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:48.849 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:52:48.849 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:52:48.850 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.850 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.850 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:48.850 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:52:48.850 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:52:48.850 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.850 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.850 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:48.850 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:52:48.850 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:52:48.850 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.850 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.850 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:48.851 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:52:48.851 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:52:48.851 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.851 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.851 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:48.851 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:52:48.851 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:52:48.851 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.851 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.851 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:48.851 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:52:48.851 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:52:48.851 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.851 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.852 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:48.852 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:52:48.852 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:52:48.852 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.852 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.852 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:48.852 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:52:48.852 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:52:48.852 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.852 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.852 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:48.852 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:52:48.852 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:52:48.852 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.853 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.853 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:48.853 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:52:48.853 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:52:48.853 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:48.853 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:48.853 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:48.853 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.853 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.853 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:48.853 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:48.853 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 55.790780282999997, 2024-04-25T22:52:48.853 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:52:48.853 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:48.854 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:48.854 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:48.854 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:48.854 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.854 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:48.854 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:48.854 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:48.854 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.854 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.854 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:48.854 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:48.854 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:48.854 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.855 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.855 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:48.855 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:48.855 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:52:48.855 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.855 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.855 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:48.855 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:52:48.855 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:52:48.855 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.855 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.855 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:48.855 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:52:48.856 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:52:48.856 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.856 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.856 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:48.856 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:52:48.856 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:52:48.856 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.856 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.856 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:48.857 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:52:48.857 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:52:48.857 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.857 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.857 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:48.857 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:52:48.857 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:52:48.857 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.858 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.858 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:48.858 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:52:48.858 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:52:48.858 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.858 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.858 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:48.858 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:52:48.858 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:52:48.858 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.859 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.859 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:48.859 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:52:48.859 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:52:48.859 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.859 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.859 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:48.859 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:52:48.859 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:52:48.860 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.860 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.860 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:48.860 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:52:48.860 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:52:48.860 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:48.860 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:48.860 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:48.860 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.861 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.861 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:48.861 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:52:48.861 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 55.790729613000003, 2024-04-25T22:52:48.861 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:52:48.861 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:48.861 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:48.861 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:48.861 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:48.861 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.862 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:48.862 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:52:48.862 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:48.862 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.862 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.862 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:48.862 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:52:48.862 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:48.862 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.863 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.863 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:48.863 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:52:48.863 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:52:48.863 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.863 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.863 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:48.863 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:52:48.863 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:52:48.863 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.863 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.863 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:48.863 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:52:48.863 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:52:48.864 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.864 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.864 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:48.864 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:52:48.864 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:52:48.864 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.864 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.864 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:48.864 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:52:48.864 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:52:48.864 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.864 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.864 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:52:48.864 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:52:48.865 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:52:48.865 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.865 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.865 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:48.865 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:52:48.865 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:52:48.865 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.865 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.865 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:48.865 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:52:48.865 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:52:48.865 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.865 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.865 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:48.866 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:52:48.866 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:52:48.866 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.866 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.866 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:48.866 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:52:48.866 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:52:48.866 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.866 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.866 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:48.866 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:52:48.866 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:52:48.866 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.866 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.867 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:48.867 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:52:48.867 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:52:48.867 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.867 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.867 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:48.867 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:52:48.867 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:52:48.867 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:48.867 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:48.867 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:48.867 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.867 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.867 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:48.868 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:52:48.868 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 55.790692743999998, 2024-04-25T22:52:48.868 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:52:48.868 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:48.868 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:48.868 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:48.868 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:48.868 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.868 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:48.868 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:52:48.868 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:48.868 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.868 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.868 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:48.869 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:52:48.869 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:48.869 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.869 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.869 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:48.869 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:52:48.869 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:52:48.869 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.869 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.869 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:48.869 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:52:48.869 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:52:48.869 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.869 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.870 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:48.870 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:52:48.870 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:52:48.870 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.870 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.870 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:48.870 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:52:48.870 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:52:48.870 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.870 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.870 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:48.870 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:52:48.870 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:52:48.870 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.871 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.871 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:52:48.871 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:52:48.871 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:52:48.871 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.871 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.871 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:48.871 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:52:48.871 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:52:48.871 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.871 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.871 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:48.871 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:52:48.871 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:52:48.872 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.872 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.872 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:48.872 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:52:48.872 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:52:48.872 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.872 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.872 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:48.872 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:52:48.872 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:52:48.872 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.872 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.872 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:48.872 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:52:48.872 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:52:48.873 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.873 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.873 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:48.873 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:52:48.873 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:52:48.873 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.873 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.873 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:48.873 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:52:48.873 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:52:48.873 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:48.873 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:48.873 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:48.873 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.874 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.874 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:48.874 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:52:48.874 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 55.790667778, 2024-04-25T22:52:48.874 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:52:48.874 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:48.874 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:48.874 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:48.874 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:48.874 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.874 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:48.874 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:52:48.874 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:48.874 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.875 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.875 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:48.875 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:52:48.875 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:48.875 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.875 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.875 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:48.875 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:52:48.875 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:52:48.875 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.875 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.875 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:48.875 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:52:48.875 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:52:48.876 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.876 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.876 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:48.876 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:52:48.876 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:52:48.876 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.876 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.876 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:48.876 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:52:48.876 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:52:48.876 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.876 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.876 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:48.876 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:52:48.877 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:52:48.877 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.877 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.877 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:48.877 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:52:48.877 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:52:48.877 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.877 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.877 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:48.877 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:52:48.877 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:52:48.877 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.877 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.877 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:48.878 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:52:48.878 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:52:48.878 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.878 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.878 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:48.878 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:52:48.878 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:52:48.878 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.878 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.878 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:48.878 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:52:48.878 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:52:48.878 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.879 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.879 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:48.879 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:52:48.879 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:52:48.879 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:48.879 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:48.879 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:48.879 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.879 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.879 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:48.879 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:52:48.879 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 55.790631414000003, 2024-04-25T22:52:48.879 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:52:48.879 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:48.880 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:48.880 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:52:48.880 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:48.880 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.880 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:48.880 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:52:48.880 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:48.880 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.880 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.880 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:48.880 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:52:48.880 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:48.880 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.880 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.881 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:48.881 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:52:48.881 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:52:48.881 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.881 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.881 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:48.881 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:52:48.881 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:52:48.881 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.881 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.881 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:48.881 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:52:48.881 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:52:48.882 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.882 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.882 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:48.882 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:52:48.882 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:52:48.882 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.882 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.882 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:48.882 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:52:48.882 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:52:48.882 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.882 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.882 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:52:48.882 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:52:48.883 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:52:48.883 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.883 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.883 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:48.883 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:52:48.883 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:52:48.883 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.883 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.883 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:48.883 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:52:48.883 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:52:48.883 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.883 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.883 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:48.884 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:52:48.884 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:52:48.884 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:48.884 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:48.884 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:48.884 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.884 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.884 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:48.884 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:48.884 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 55.790600333, 2024-04-25T22:52:48.884 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:52:48.884 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:48.884 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:48.884 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:52:48.885 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:48.885 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.885 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:48.885 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:48.885 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:48.885 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.885 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.885 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:48.885 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:48.885 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:48.885 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.885 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.885 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:48.885 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:48.886 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:52:48.886 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.886 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.886 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:48.886 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:52:48.886 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:52:48.886 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.886 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.886 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:48.886 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:52:48.886 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:52:48.886 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.886 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.886 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:48.887 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:52:48.887 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:52:48.887 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.887 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.887 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:48.887 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:52:48.887 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:52:48.887 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.887 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.887 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:48.887 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:52:48.887 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:52:48.887 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.888 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.888 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:48.888 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:52:48.888 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:52:48.888 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:48.888 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:48.888 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:48.888 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.888 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.888 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:52:48.888 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:48.888 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 55.790159363999997, 2024-04-25T22:52:48.888 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064881979999999997, 2024-04-25T22:52:48.888 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:48.888 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:48.889 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:48.889 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:48.889 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.889 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:48.889 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:48.889 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:48.889 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.889 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.889 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:48.889 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:48.889 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:48.889 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.889 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.890 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:48.890 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:48.890 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2699999999999999e-07 2024-04-25T22:52:48.890 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.890 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.890 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:48.890 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013898+0000", 2024-04-25T22:52:48.890 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0796e-05 2024-04-25T22:52:48.890 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.890 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.890 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:48.890 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013907+0000", 2024-04-25T22:52:48.890 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5140000000000007e-06 2024-04-25T22:52:48.890 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.890 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.891 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:48.891 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013952+0000", 2024-04-25T22:52:48.891 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4134000000000001e-05 2024-04-25T22:52:48.891 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.891 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.891 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:48.891 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016812+0000", 2024-04-25T22:52:48.891 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028601059999999998 2024-04-25T22:52:48.891 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.891 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.891 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:48.891 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.017052+0000", 2024-04-25T22:52:48.892 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024056500000000001 2024-04-25T22:52:48.892 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.892 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.892 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:48.892 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020350+0000", 2024-04-25T22:52:48.892 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032978320000000001 2024-04-25T22:52:48.892 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.892 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.892 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:48.892 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020375+0000", 2024-04-25T22:52:48.892 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4624e-05 2024-04-25T22:52:48.892 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:48.892 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:48.892 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:48.893 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.893 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.893 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-25T22:52:48.893 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:48.893 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 55.776628918, 2024-04-25T22:52:48.893 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058583000000000003, 2024-04-25T22:52:48.893 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:48.893 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:48.893 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:48.893 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:48.893 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.893 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:48.893 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:48.893 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:48.894 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.894 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.894 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:48.894 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:48.894 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:48.894 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.894 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.894 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:48.894 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:48.894 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.41e-07 2024-04-25T22:52:48.894 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.894 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.894 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:48.895 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027428+0000", 2024-04-25T22:52:48.895 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.075e-05 2024-04-25T22:52:48.895 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.895 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.895 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:48.895 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027435+0000", 2024-04-25T22:52:48.895 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3610000000000003e-06 2024-04-25T22:52:48.895 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.895 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.895 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:48.895 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027442+0000", 2024-04-25T22:52:48.895 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0400000000000004e-06 2024-04-25T22:52:48.895 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.895 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.895 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:48.896 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028094+0000", 2024-04-25T22:52:48.896 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00065134800000000005 2024-04-25T22:52:48.896 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.896 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.896 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:48.896 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028107+0000", 2024-04-25T22:52:48.896 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3087e-05 2024-04-25T22:52:48.896 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.896 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.896 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:48.896 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033239+0000", 2024-04-25T22:52:48.896 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051319429999999999 2024-04-25T22:52:48.896 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.897 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.897 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:48.897 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033275+0000", 2024-04-25T22:52:48.897 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6430000000000002e-05 2024-04-25T22:52:48.897 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:48.897 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:48.897 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:48.897 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.897 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.897 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-25T22:52:48.897 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:48.897 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 55.776244081000002, 2024-04-25T22:52:48.897 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005413597, 2024-04-25T22:52:48.897 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:48.898 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:48.898 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:48.898 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:48.898 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.898 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:48.898 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:48.898 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:48.898 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.898 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.898 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:48.898 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:48.898 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:48.898 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.899 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.899 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:48.899 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:48.899 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3799999999999997e-07 2024-04-25T22:52:48.899 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.899 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.899 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:48.899 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027816+0000", 2024-04-25T22:52:48.899 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3230999999999999e-05 2024-04-25T22:52:48.899 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.899 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.899 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:48.899 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027823+0000", 2024-04-25T22:52:48.900 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9039999999999992e-06 2024-04-25T22:52:48.900 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.900 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.900 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:48.900 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027841+0000", 2024-04-25T22:52:48.900 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7651000000000001e-05 2024-04-25T22:52:48.900 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.900 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.900 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:48.900 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027904+0000", 2024-04-25T22:52:48.900 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3058000000000005e-05 2024-04-25T22:52:48.900 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.900 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.900 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:48.901 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027926+0000", 2024-04-25T22:52:48.901 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1450999999999998e-05 2024-04-25T22:52:48.901 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.901 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.901 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:48.901 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033177+0000", 2024-04-25T22:52:48.901 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052508909999999997 2024-04-25T22:52:48.901 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.901 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.901 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:48.901 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033215+0000", 2024-04-25T22:52:48.901 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8872999999999999e-05 2024-04-25T22:52:48.901 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:48.901 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:48.901 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:48.902 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.902 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.902 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 171 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:52:48.902 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:48.902 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 55.776186979000002, 2024-04-25T22:52:48.902 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054322240000000003, 2024-04-25T22:52:48.902 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:48.902 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:48.902 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "reached pg", 2024-04-25T22:52:48.902 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:48.902 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.902 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:48.902 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:48.903 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:48.903 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.903 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.903 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:48.903 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:48.903 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:48.903 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.903 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.903 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:48.903 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:48.903 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7500000000000001e-07 2024-04-25T22:52:48.903 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.903 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.903 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:48.904 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027868+0000", 2024-04-25T22:52:48.904 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5750000000000001e-06 2024-04-25T22:52:48.904 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.904 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.904 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:48.904 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027885+0000", 2024-04-25T22:52:48.904 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7272e-05 2024-04-25T22:52:48.904 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.904 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.904 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:48.904 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027900+0000", 2024-04-25T22:52:48.904 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.502e-05 2024-04-25T22:52:48.904 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.904 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.904 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:48.905 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028381+0000", 2024-04-25T22:52:48.905 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00048039399999999998 2024-04-25T22:52:48.905 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:48.905 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:48.905 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:48.905 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033291+0000", 2024-04-25T22:52:48.905 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049105879999999996 2024-04-25T22:52:48.905 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:48.905 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:48.905 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:48.905 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:48.905 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:48.905 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:48.907 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:52:48.907 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:48.906+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:49.008 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:49.007+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:49.016 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:49.016 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:52:49.017 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-04-25T22:52:49.017 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:49.026 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:52:49.109 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:49.108+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:49.126 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:49.127 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:52:49.127 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:52:49.127 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:52:49.127 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:49.135 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:52:49.209 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~6s 2024-04-25T22:52:49.210 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:49.209+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:49.240 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:49.240 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-04-25T22:52:49.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-04-25T22:52:49.240 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:52:49.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.240 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:49.240 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:49.240 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 61.272357937999999, 2024-04-25T22:52:49.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0103421, 2024-04-25T22:52:49.240 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:49.241 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:49.241 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:49.241 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:49.241 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:49.241 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:49.241 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 115 2024-04-25T22:52:49.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.241 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:49.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:49.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:49.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:49.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:49.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:49.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:49.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:49.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:49.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9500000000000002e-07 2024-04-25T22:52:49.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:49.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965108+0000", 2024-04-25T22:52:49.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9177999999999994e-05 2024-04-25T22:52:49.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:49.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965127+0000", 2024-04-25T22:52:49.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8868e-05 2024-04-25T22:52:49.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:49.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965133+0000", 2024-04-25T22:52:49.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8929999999999999e-06 2024-04-25T22:52:49.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:49.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.969991+0000", 2024-04-25T22:52:49.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048573849999999997 2024-04-25T22:52:49.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:49.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970072+0000", 2024-04-25T22:52:49.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0728000000000004e-05 2024-04-25T22:52:49.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:49.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970189+0000", 2024-04-25T22:52:49.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000117778 2024-04-25T22:52:49.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:49.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970946+0000", 2024-04-25T22:52:49.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00075704600000000004 2024-04-25T22:52:49.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:49.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975297+0000", 2024-04-25T22:52:49.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004350217 2024-04-25T22:52:49.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:49.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975343+0000", 2024-04-25T22:52:49.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6687999999999998e-05 2024-04-25T22:52:49.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:49.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975380+0000", 2024-04-25T22:52:49.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6724000000000003e-05 2024-04-25T22:52:49.246 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:49.246 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:49.246 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:49.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.246 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:49.246 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:49.246 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 61.272251906999998, 2024-04-25T22:52:49.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010304384, 2024-04-25T22:52:49.247 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:49.247 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:49.247 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:49.247 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:49.247 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:49.247 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:49.247 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 116 2024-04-25T22:52:49.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.247 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:49.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.247 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:49.247 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:49.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:49.248 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.248 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:49.248 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:49.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:49.248 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.248 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:49.248 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:49.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5799999999999999e-07 2024-04-25T22:52:49.248 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.248 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:49.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965154+0000", 2024-04-25T22:52:49.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0009e-05 2024-04-25T22:52:49.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:49.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965164+0000", 2024-04-25T22:52:49.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8490000000000001e-06 2024-04-25T22:52:49.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:49.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965169+0000", 2024-04-25T22:52:49.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0730000000000004e-06 2024-04-25T22:52:49.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:49.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970609+0000", 2024-04-25T22:52:49.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054397689999999997 2024-04-25T22:52:49.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:49.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970651+0000", 2024-04-25T22:52:49.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1873999999999999e-05 2024-04-25T22:52:49.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:49.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970723+0000", 2024-04-25T22:52:49.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2039999999999995e-05 2024-04-25T22:52:49.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:49.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971358+0000", 2024-04-25T22:52:49.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063489500000000001 2024-04-25T22:52:49.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:49.252 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975409+0000", 2024-04-25T22:52:49.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040506880000000002 2024-04-25T22:52:49.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.252 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:49.252 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975432+0000", 2024-04-25T22:52:49.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3315999999999998e-05 2024-04-25T22:52:49.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.252 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:49.252 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975448+0000", 2024-04-25T22:52:49.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6313000000000001e-05 2024-04-25T22:52:49.252 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:49.252 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:49.253 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:49.253 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.253 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.253 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:49.253 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:49.253 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 61.272217325, 2024-04-25T22:52:49.253 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010384338999999999, 2024-04-25T22:52:49.253 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:49.253 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:49.253 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:49.253 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:49.253 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:49.253 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:49.254 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-04-25T22:52:49.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.254 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:49.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:49.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:49.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:49.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:49.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:49.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:49.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:49.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:49.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3600000000000004e-07 2024-04-25T22:52:49.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:49.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965185+0000", 2024-04-25T22:52:49.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.117e-06 2024-04-25T22:52:49.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:49.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965192+0000", 2024-04-25T22:52:49.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3239999999999997e-06 2024-04-25T22:52:49.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.256 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:49.256 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965198+0000", 2024-04-25T22:52:49.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6370000000000004e-06 2024-04-25T22:52:49.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.256 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:49.256 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970973+0000", 2024-04-25T22:52:49.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057748239999999996 2024-04-25T22:52:49.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.256 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:49.257 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971049+0000", 2024-04-25T22:52:49.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6029e-05 2024-04-25T22:52:49.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.257 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:49.257 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971174+0000", 2024-04-25T22:52:49.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012462399999999999 2024-04-25T22:52:49.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.257 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:49.257 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971553+0000", 2024-04-25T22:52:49.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037896499999999999 2024-04-25T22:52:49.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:49.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975482+0000", 2024-04-25T22:52:49.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039297459999999996 2024-04-25T22:52:49.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:49.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975529+0000", 2024-04-25T22:52:49.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6387000000000002e-05 2024-04-25T22:52:49.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:49.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975563+0000", 2024-04-25T22:52:49.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4150000000000003e-05 2024-04-25T22:52:49.259 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:49.259 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:49.259 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:49.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.259 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:49.259 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:49.259 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 56.225171002000003, 2024-04-25T22:52:49.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012637705000000001, 2024-04-25T22:52:49.259 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:49.259 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:49.259 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:49.259 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:49.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.260 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:49.260 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:49.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:49.260 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.260 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.260 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:49.260 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:49.261 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:49.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.261 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:49.261 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012227+0000", 2024-04-25T22:52:49.261 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.863e-06 2024-04-25T22:52:49.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.261 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:49.261 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012236+0000", 2024-04-25T22:52:49.261 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1109999999999997e-06 2024-04-25T22:52:49.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:49.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012309+0000", 2024-04-25T22:52:49.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3242000000000001e-05 2024-04-25T22:52:49.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:49.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012324+0000", 2024-04-25T22:52:49.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4837e-05 2024-04-25T22:52:49.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:49.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015060+0000", 2024-04-25T22:52:49.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027363349999999999 2024-04-25T22:52:49.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:49.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015169+0000", 2024-04-25T22:52:49.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108372 2024-04-25T22:52:49.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:49.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015498+0000", 2024-04-25T22:52:49.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032949999999999999 2024-04-25T22:52:49.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:49.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021282+0000", 2024-04-25T22:52:49.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057836429999999998 2024-04-25T22:52:49.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:49.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024709+0000", 2024-04-25T22:52:49.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034271979999999998 2024-04-25T22:52:49.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:49.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024802+0000", 2024-04-25T22:52:49.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2960000000000004e-05 2024-04-25T22:52:49.265 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.265 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.265 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:49.265 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024863+0000", 2024-04-25T22:52:49.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0643999999999997e-05 2024-04-25T22:52:49.265 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:49.265 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:49.265 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:49.265 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.265 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.265 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:49.266 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:49.266 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 56.225047230999998, 2024-04-25T22:52:49.266 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012979447999999999, 2024-04-25T22:52:49.266 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:49.266 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:49.266 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:49.266 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:49.266 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.266 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:49.266 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:49.266 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:49.266 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.266 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.267 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:49.267 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:49.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:49.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.267 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:49.267 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:49.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:52:49.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.267 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:49.267 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012354+0000", 2024-04-25T22:52:49.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7740000000000004e-06 2024-04-25T22:52:49.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.268 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.268 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:49.268 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012365+0000", 2024-04-25T22:52:49.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.064e-05 2024-04-25T22:52:49.268 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.268 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.268 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:49.268 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012382+0000", 2024-04-25T22:52:49.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6999000000000001e-05 2024-04-25T22:52:49.268 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.268 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.268 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:49.268 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015958+0000", 2024-04-25T22:52:49.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035765699999999998 2024-04-25T22:52:49.269 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.269 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.269 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:49.269 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016037+0000", 2024-04-25T22:52:49.269 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8242000000000001e-05 2024-04-25T22:52:49.269 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.269 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.269 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:49.269 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016404+0000", 2024-04-25T22:52:49.269 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036784300000000002 2024-04-25T22:52:49.269 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.269 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.269 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:49.269 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021294+0000", 2024-04-25T22:52:49.270 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048890629999999999 2024-04-25T22:52:49.270 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.270 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.270 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:49.270 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024959+0000", 2024-04-25T22:52:49.270 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036651570000000001 2024-04-25T22:52:49.270 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.270 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.270 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:49.271 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025097+0000", 2024-04-25T22:52:49.271 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013788099999999999 2024-04-25T22:52:49.271 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.271 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.271 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:49.271 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025328+0000", 2024-04-25T22:52:49.271 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231492 2024-04-25T22:52:49.271 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:49.271 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:49.271 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:49.271 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.271 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.272 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:49.272 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:49.272 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 56.224959462000001, 2024-04-25T22:52:49.272 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013049827, 2024-04-25T22:52:49.272 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:49.272 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:49.272 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:49.272 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:49.272 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.272 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:49.272 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:49.272 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:49.272 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.273 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.273 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:49.273 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:49.273 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:49.273 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.273 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.273 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:49.273 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012437+0000", 2024-04-25T22:52:49.273 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-04-25T22:52:49.273 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.273 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.273 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:49.273 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012440+0000", 2024-04-25T22:52:49.273 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7609999999999999e-06 2024-04-25T22:52:49.274 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.274 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.274 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:49.274 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012449+0000", 2024-04-25T22:52:49.274 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.285e-06 2024-04-25T22:52:49.274 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.274 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.274 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:49.274 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012457+0000", 2024-04-25T22:52:49.274 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9510000000000006e-06 2024-04-25T22:52:49.274 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.274 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.275 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:49.275 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017106+0000", 2024-04-25T22:52:49.275 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046494220000000003 2024-04-25T22:52:49.275 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.275 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.275 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:49.275 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017223+0000", 2024-04-25T22:52:49.275 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116824 2024-04-25T22:52:49.275 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.275 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.275 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:49.275 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017345+0000", 2024-04-25T22:52:49.275 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122175 2024-04-25T22:52:49.276 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.276 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.276 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:49.276 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021299+0000", 2024-04-25T22:52:49.276 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039534879999999998 2024-04-25T22:52:49.276 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.276 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.276 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:49.276 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025398+0000", 2024-04-25T22:52:49.276 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040988960000000003 2024-04-25T22:52:49.276 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.276 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.276 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:49.276 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025439+0000", 2024-04-25T22:52:49.277 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0915999999999999e-05 2024-04-25T22:52:49.277 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.277 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.277 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:49.277 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025486+0000", 2024-04-25T22:52:49.277 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7534999999999998e-05 2024-04-25T22:52:49.277 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:49.277 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:49.277 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:49.277 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.277 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.277 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:49.277 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:49.277 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 56.224929310999997, 2024-04-25T22:52:49.278 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020988041999999998, 2024-04-25T22:52:49.278 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:49.278 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:49.278 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:49.278 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:49.278 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.278 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:49.278 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:49.278 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:49.278 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.278 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.278 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:49.278 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:49.279 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:49.279 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.279 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.279 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:49.279 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:49.279 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.99e-07 2024-04-25T22:52:49.279 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.279 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.279 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:49.279 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012470+0000", 2024-04-25T22:52:49.279 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2789999999999999e-06 2024-04-25T22:52:49.279 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.279 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:49.280 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012477+0000", 2024-04-25T22:52:49.280 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:52:49.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:49.280 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012500+0000", 2024-04-25T22:52:49.280 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2490999999999999e-05 2024-04-25T22:52:49.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:49.280 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021911+0000", 2024-04-25T22:52:49.280 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094114160000000006 2024-04-25T22:52:49.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.281 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:49.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022000+0000", 2024-04-25T22:52:49.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8601000000000001e-05 2024-04-25T22:52:49.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.281 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:49.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022359+0000", 2024-04-25T22:52:49.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035921999999999999 2024-04-25T22:52:49.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:49.282 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025541+0000", 2024-04-25T22:52:49.282 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031820619999999998 2024-04-25T22:52:49.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:49.282 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033375+0000", 2024-04-25T22:52:49.282 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078338379999999992 2024-04-25T22:52:49.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:49.283 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033415+0000", 2024-04-25T22:52:49.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9527000000000003e-05 2024-04-25T22:52:49.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.283 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:49.283 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033455+0000", 2024-04-25T22:52:49.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9932000000000003e-05 2024-04-25T22:52:49.283 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:49.283 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:49.283 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:49.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.283 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:49.284 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:49.284 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 56.224874118000002, 2024-04-25T22:52:49.284 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021043857999999999, 2024-04-25T22:52:49.284 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:49.284 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:49.284 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:49.284 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:49.284 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.284 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:49.284 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:49.284 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:49.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.284 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.284 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:49.285 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:49.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:49.285 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.285 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.285 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:49.285 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012523+0000", 2024-04-25T22:52:49.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.361e-06 2024-04-25T22:52:49.285 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.285 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.285 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:49.285 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012530+0000", 2024-04-25T22:52:49.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5440000000000004e-06 2024-04-25T22:52:49.285 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.286 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:49.286 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012541+0000", 2024-04-25T22:52:49.286 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1745e-05 2024-04-25T22:52:49.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.286 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:49.286 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012551+0000", 2024-04-25T22:52:49.286 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5789999999999993e-06 2024-04-25T22:52:49.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.286 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:49.286 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022709+0000", 2024-04-25T22:52:49.286 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010157685 2024-04-25T22:52:49.287 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.287 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.287 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:49.287 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022957+0000", 2024-04-25T22:52:49.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024824599999999998 2024-04-25T22:52:49.287 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.287 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.287 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:49.287 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023443+0000", 2024-04-25T22:52:49.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048578599999999999 2024-04-25T22:52:49.287 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.287 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.287 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:49.288 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025547+0000", 2024-04-25T22:52:49.288 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021044789999999998 2024-04-25T22:52:49.288 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.288 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.288 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:49.288 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033509+0000", 2024-04-25T22:52:49.288 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0079622180000000001 2024-04-25T22:52:49.288 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.288 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.288 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:49.288 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033542+0000", 2024-04-25T22:52:49.288 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3018000000000001e-05 2024-04-25T22:52:49.288 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.289 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:49.289 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033566+0000", 2024-04-25T22:52:49.289 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3197000000000002e-05 2024-04-25T22:52:49.289 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:49.289 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:49.289 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:49.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.289 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:49.289 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:49.289 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 56.224834153000003, 2024-04-25T22:52:49.289 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021122696, 2024-04-25T22:52:49.290 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:49.290 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:49.290 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:49.290 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:49.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:49.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:49.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:49.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:49.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:49.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:49.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.291 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.291 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:49.291 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:49.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:52:49.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.291 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.291 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:49.291 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012566+0000", 2024-04-25T22:52:49.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-04-25T22:52:49.292 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.292 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.292 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:49.292 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012619+0000", 2024-04-25T22:52:49.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2607e-05 2024-04-25T22:52:49.292 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.292 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.292 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:49.292 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012628+0000", 2024-04-25T22:52:49.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6500000000000008e-06 2024-04-25T22:52:49.292 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.292 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.292 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:49.293 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024024+0000", 2024-04-25T22:52:49.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011396007999999999 2024-04-25T22:52:49.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:49.293 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024198+0000", 2024-04-25T22:52:49.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000173215 2024-04-25T22:52:49.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:49.293 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024447+0000", 2024-04-25T22:52:49.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024898500000000002 2024-04-25T22:52:49.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:49.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026431+0000", 2024-04-25T22:52:49.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001984923 2024-04-25T22:52:49.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:49.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033608+0000", 2024-04-25T22:52:49.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071768459999999997 2024-04-25T22:52:49.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:49.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033646+0000", 2024-04-25T22:52:49.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299000000000003e-05 2024-04-25T22:52:49.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:49.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033684+0000", 2024-04-25T22:52:49.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8773000000000003e-05 2024-04-25T22:52:49.295 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:49.295 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:49.295 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:49.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.295 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:49.295 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:49.295 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 56.224745554000002, 2024-04-25T22:52:49.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021175381, 2024-04-25T22:52:49.296 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:49.296 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:49.296 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:49.296 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:49.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.296 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:49.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:49.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:49.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.296 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:49.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:49.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:49.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.297 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:49.297 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012651+0000", 2024-04-25T22:52:49.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:52:49.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.297 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:49.297 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012656+0000", 2024-04-25T22:52:49.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8899999999999998e-06 2024-04-25T22:52:49.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.297 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:49.297 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012666+0000", 2024-04-25T22:52:49.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0346999999999999e-05 2024-04-25T22:52:49.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:49.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012675+0000", 2024-04-25T22:52:49.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9930000000000001e-06 2024-04-25T22:52:49.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:49.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025661+0000", 2024-04-25T22:52:49.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01298531 2024-04-25T22:52:49.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:49.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025757+0000", 2024-04-25T22:52:49.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5822000000000005e-05 2024-04-25T22:52:49.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:49.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025907+0000", 2024-04-25T22:52:49.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015051499999999999 2024-04-25T22:52:49.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:49.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026435+0000", 2024-04-25T22:52:49.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052762200000000005 2024-04-25T22:52:49.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:49.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033732+0000", 2024-04-25T22:52:49.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072978419999999997 2024-04-25T22:52:49.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:49.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033787+0000", 2024-04-25T22:52:49.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4703999999999997e-05 2024-04-25T22:52:49.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:49.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033826+0000", 2024-04-25T22:52:49.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8458999999999999e-05 2024-04-25T22:52:49.301 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:49.301 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:49.301 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:49.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.301 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:49.301 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:49.301 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 56.22469014, 2024-04-25T22:52:49.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021244174000000001, 2024-04-25T22:52:49.301 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:49.301 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:49.301 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:49.302 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:49.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:49.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:49.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:49.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:49.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:49.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:49.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:49.303 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:49.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:52:49.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.303 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:49.303 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012712+0000", 2024-04-25T22:52:49.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.913e-06 2024-04-25T22:52:49.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.303 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:49.303 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012722+0000", 2024-04-25T22:52:49.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2879999999999998e-06 2024-04-25T22:52:49.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:49.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012727+0000", 2024-04-25T22:52:49.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8429999999999998e-06 2024-04-25T22:52:49.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:49.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026099+0000", 2024-04-25T22:52:49.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013371450999999999 2024-04-25T22:52:49.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:49.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026147+0000", 2024-04-25T22:52:49.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7837999999999998e-05 2024-04-25T22:52:49.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:49.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026254+0000", 2024-04-25T22:52:49.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107314 2024-04-25T22:52:49.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:49.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026686+0000", 2024-04-25T22:52:49.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000432428 2024-04-25T22:52:49.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:49.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033873+0000", 2024-04-25T22:52:49.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071864399999999997 2024-04-25T22:52:49.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:49.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033904+0000", 2024-04-25T22:52:49.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1321e-05 2024-04-25T22:52:49.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:49.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033950+0000", 2024-04-25T22:52:49.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5707999999999997e-05 2024-04-25T22:52:49.306 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:49.306 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:49.307 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:49.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.307 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:49.307 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:49.307 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 56.224659754999998, 2024-04-25T22:52:49.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01096505, 2024-04-25T22:52:49.307 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:49.307 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:49.307 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:49.307 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:49.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:49.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:49.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:49.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:49.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:49.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:49.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:49.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012737+0000", 2024-04-25T22:52:49.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:52:49.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:49.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012739+0000", 2024-04-25T22:52:49.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-04-25T22:52:49.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:49.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012743+0000", 2024-04-25T22:52:49.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3239999999999996e-06 2024-04-25T22:52:49.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:49.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012746+0000", 2024-04-25T22:52:49.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.129e-06 2024-04-25T22:52:49.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:49.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012796+0000", 2024-04-25T22:52:49.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9231999999999999e-05 2024-04-25T22:52:49.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:49.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012915+0000", 2024-04-25T22:52:49.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119021 2024-04-25T22:52:49.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:49.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013069+0000", 2024-04-25T22:52:49.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015463900000000001 2024-04-25T22:52:49.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:49.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019237+0000", 2024-04-25T22:52:49.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061680329999999998 2024-04-25T22:52:49.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:49.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023603+0000", 2024-04-25T22:52:49.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043655860000000003 2024-04-25T22:52:49.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:49.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023659+0000", 2024-04-25T22:52:49.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6484000000000003e-05 2024-04-25T22:52:49.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:49.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023701+0000", 2024-04-25T22:52:49.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1761999999999998e-05 2024-04-25T22:52:49.313 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:49.313 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:49.313 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:49.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.313 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:49.313 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:49.313 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 56.224634807000001, 2024-04-25T22:52:49.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011234429000000001, 2024-04-25T22:52:49.313 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:49.313 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:49.313 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:49.313 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:49.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:49.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:49.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:49.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:49.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:49.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:49.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:49.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012762+0000", 2024-04-25T22:52:49.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-04-25T22:52:49.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:49.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012765+0000", 2024-04-25T22:52:49.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2569999999999999e-06 2024-04-25T22:52:49.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:49.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012783+0000", 2024-04-25T22:52:49.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8431999999999999e-05 2024-04-25T22:52:49.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:49.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012799+0000", 2024-04-25T22:52:49.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5438999999999999e-05 2024-04-25T22:52:49.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:49.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013826+0000", 2024-04-25T22:52:49.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010275060000000001 2024-04-25T22:52:49.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:49.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013913+0000", 2024-04-25T22:52:49.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.708e-05 2024-04-25T22:52:49.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:49.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014098+0000", 2024-04-25T22:52:49.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018519399999999999 2024-04-25T22:52:49.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:49.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019684+0000", 2024-04-25T22:52:49.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055860079999999999 2024-04-25T22:52:49.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:49.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023876+0000", 2024-04-25T22:52:49.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041918800000000003 2024-04-25T22:52:49.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:49.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023957+0000", 2024-04-25T22:52:49.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1165e-05 2024-04-25T22:52:49.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:49.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023995+0000", 2024-04-25T22:52:49.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:52:49.318 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:49.318 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:49.318 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:49.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.319 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:49.319 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:49.319 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 56.224537028, 2024-04-25T22:52:49.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011131200000000001, 2024-04-25T22:52:49.319 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:49.319 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:49.319 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:49.319 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:49.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:49.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:49.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:49.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:49.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:49.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:49.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:49.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012860+0000", 2024-04-25T22:52:49.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3900000000000004e-07 2024-04-25T22:52:49.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:49.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012865+0000", 2024-04-25T22:52:49.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5609999999999998e-06 2024-04-25T22:52:49.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:49.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012895+0000", 2024-04-25T22:52:49.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9847000000000001e-05 2024-04-25T22:52:49.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:49.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012905+0000", 2024-04-25T22:52:49.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.03e-05 2024-04-25T22:52:49.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:49.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015020+0000", 2024-04-25T22:52:49.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021142940000000001 2024-04-25T22:52:49.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:49.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015182+0000", 2024-04-25T22:52:49.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016248099999999999 2024-04-25T22:52:49.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:52:49.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015357+0000", 2024-04-25T22:52:49.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017471000000000001 2024-04-25T22:52:49.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:49.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021021+0000", 2024-04-25T22:52:49.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056638340000000004 2024-04-25T22:52:49.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:49.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023712+0000", 2024-04-25T22:52:49.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026910380000000002 2024-04-25T22:52:49.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:49.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023763+0000", 2024-04-25T22:52:49.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1477999999999997e-05 2024-04-25T22:52:49.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:49.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023990+0000", 2024-04-25T22:52:49.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000226818 2024-04-25T22:52:49.324 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:49.324 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:49.324 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:49.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.324 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:49.324 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:49.324 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 56.224413931999997, 2024-04-25T22:52:49.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011705299000000001, 2024-04-25T22:52:49.325 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:49.325 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:49.325 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:49.325 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:49.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:49.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:49.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:49.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:49.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:49.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:49.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:49.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012983+0000", 2024-04-25T22:52:49.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:52:49.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:49.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012986+0000", 2024-04-25T22:52:49.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5700000000000001e-06 2024-04-25T22:52:49.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:49.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012993+0000", 2024-04-25T22:52:49.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8730000000000001e-06 2024-04-25T22:52:49.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:49.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013000+0000", 2024-04-25T22:52:49.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1890000000000001e-06 2024-04-25T22:52:49.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:49.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:52:49.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002147866 2024-04-25T22:52:49.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:49.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015351+0000", 2024-04-25T22:52:49.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020300799999999999 2024-04-25T22:52:49.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:49.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016260+0000", 2024-04-25T22:52:49.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00090926799999999997 2024-04-25T22:52:49.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:49.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022669+0000", 2024-04-25T22:52:49.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064082849999999997 2024-04-25T22:52:49.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:49.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024584+0000", 2024-04-25T22:52:49.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019151699999999999 2024-04-25T22:52:49.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:49.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024643+0000", 2024-04-25T22:52:49.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8888999999999998e-05 2024-04-25T22:52:49.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:49.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024687+0000", 2024-04-25T22:52:49.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4444999999999999e-05 2024-04-25T22:52:49.330 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:49.330 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:49.330 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:49.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.330 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:49.330 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:49.330 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 56.224386340999999, 2024-04-25T22:52:49.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011249699, 2024-04-25T22:52:49.330 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:49.330 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:49.330 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:49.331 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:49.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:49.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:49.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:49.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:49.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:49.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:49.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:49.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013010+0000", 2024-04-25T22:52:49.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2099999999999996e-07 2024-04-25T22:52:49.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:49.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013013+0000", 2024-04-25T22:52:49.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1310000000000002e-06 2024-04-25T22:52:49.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:49.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013020+0000", 2024-04-25T22:52:49.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3330000000000002e-06 2024-04-25T22:52:49.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:49.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013025+0000", 2024-04-25T22:52:49.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6760000000000004e-06 2024-04-25T22:52:49.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:49.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013163+0000", 2024-04-25T22:52:49.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013824599999999999 2024-04-25T22:52:49.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:49.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013504+0000", 2024-04-25T22:52:49.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034080299999999998 2024-04-25T22:52:49.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:49.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013613+0000", 2024-04-25T22:52:49.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108705 2024-04-25T22:52:49.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:49.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015831+0000", 2024-04-25T22:52:49.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002217672 2024-04-25T22:52:49.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:49.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024137+0000", 2024-04-25T22:52:49.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0083060489999999994 2024-04-25T22:52:49.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:49.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024218+0000", 2024-04-25T22:52:49.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1351000000000001e-05 2024-04-25T22:52:49.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:49.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024259+0000", 2024-04-25T22:52:49.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1112000000000002e-05 2024-04-25T22:52:49.335 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:49.335 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:49.336 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:49.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.336 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:49.336 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:49.336 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 56.224298615000002, 2024-04-25T22:52:49.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020379749999999999, 2024-04-25T22:52:49.336 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:49.336 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:49.336 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:49.336 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:49.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:49.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:49.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:49.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:49.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:49.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:49.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:49.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013098+0000", 2024-04-25T22:52:49.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:52:49.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:49.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013105+0000", 2024-04-25T22:52:49.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5969999999999997e-06 2024-04-25T22:52:49.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:49.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013190+0000", 2024-04-25T22:52:49.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5618999999999995e-05 2024-04-25T22:52:49.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:49.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013200+0000", 2024-04-25T22:52:49.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5859999999999994e-06 2024-04-25T22:52:49.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:49.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020265+0000", 2024-04-25T22:52:49.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070653349999999998 2024-04-25T22:52:49.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:49.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020454+0000", 2024-04-25T22:52:49.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189316 2024-04-25T22:52:49.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:49.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020586+0000", 2024-04-25T22:52:49.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013195700000000001 2024-04-25T22:52:49.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:49.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023822+0000", 2024-04-25T22:52:49.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032358529999999999 2024-04-25T22:52:49.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:49.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033409+0000", 2024-04-25T22:52:49.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095870520000000004 2024-04-25T22:52:49.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:49.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033447+0000", 2024-04-25T22:52:49.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7261999999999997e-05 2024-04-25T22:52:49.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:49.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033477+0000", 2024-04-25T22:52:49.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0389e-05 2024-04-25T22:52:49.341 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:49.341 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:49.341 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:49.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.341 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:49.341 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:49.342 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 56.224182108999997, 2024-04-25T22:52:49.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010857383999999999, 2024-04-25T22:52:49.342 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:49.342 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:49.342 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:49.342 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:49.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:49.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:49.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:49.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:49.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:49.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:49.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:49.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:49.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:52:49.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:49.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013218+0000", 2024-04-25T22:52:49.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8199999999999998e-06 2024-04-25T22:52:49.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:49.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013226+0000", 2024-04-25T22:52:49.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7649999999999993e-06 2024-04-25T22:52:49.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:49.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013259+0000", 2024-04-25T22:52:49.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2727e-05 2024-04-25T22:52:49.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:49.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014809+0000", 2024-04-25T22:52:49.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001550144 2024-04-25T22:52:49.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:49.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014958+0000", 2024-04-25T22:52:49.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014890300000000001 2024-04-25T22:52:49.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:52:49.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015087+0000", 2024-04-25T22:52:49.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012939200000000001 2024-04-25T22:52:49.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:49.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020212+0000", 2024-04-25T22:52:49.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051248939999999996 2024-04-25T22:52:49.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:49.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023699+0000", 2024-04-25T22:52:49.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034873289999999999 2024-04-25T22:52:49.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:49.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024014+0000", 2024-04-25T22:52:49.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031473999999999999 2024-04-25T22:52:49.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:49.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024071+0000", 2024-04-25T22:52:49.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7040000000000003e-05 2024-04-25T22:52:49.347 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:49.347 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:49.347 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:49.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.347 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:49.347 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:49.347 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 56.224127404000001, 2024-04-25T22:52:49.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012329677000000001, 2024-04-25T22:52:49.347 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:49.348 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:49.348 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:49.348 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:49.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:49.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:49.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:49.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:49.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:49.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:49.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:49.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013269+0000", 2024-04-25T22:52:49.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5000000000000002e-07 2024-04-25T22:52:49.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:49.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:52:49.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6909999999999999e-06 2024-04-25T22:52:49.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:49.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013284+0000", 2024-04-25T22:52:49.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0963e-05 2024-04-25T22:52:49.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:49.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013361+0000", 2024-04-25T22:52:49.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7379999999999994e-05 2024-04-25T22:52:49.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:49.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013448+0000", 2024-04-25T22:52:49.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6990000000000006e-05 2024-04-25T22:52:49.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:49.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013632+0000", 2024-04-25T22:52:49.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018396800000000001 2024-04-25T22:52:49.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:49.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013800+0000", 2024-04-25T22:52:49.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167467 2024-04-25T22:52:49.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:49.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.018570+0000", 2024-04-25T22:52:49.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047701460000000003 2024-04-25T22:52:49.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:49.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025507+0000", 2024-04-25T22:52:49.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069372039999999998 2024-04-25T22:52:49.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:49.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025562+0000", 2024-04-25T22:52:49.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4858999999999998e-05 2024-04-25T22:52:49.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:49.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025598+0000", 2024-04-25T22:52:49.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6259e-05 2024-04-25T22:52:49.352 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:49.352 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:49.353 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:49.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.353 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:49.353 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:49.353 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 56.223995531, 2024-04-25T22:52:49.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020176666999999999, 2024-04-25T22:52:49.353 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:49.353 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:49.353 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:52:49.353 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:49.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:49.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:49.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:49.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:49.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:49.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:49.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:49.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:52:49.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-04-25T22:52:49.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:49.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013405+0000", 2024-04-25T22:52:49.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0559999999999998e-06 2024-04-25T22:52:49.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:49.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013422+0000", 2024-04-25T22:52:49.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6770999999999999e-05 2024-04-25T22:52:49.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:49.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013431+0000", 2024-04-25T22:52:49.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5019999999999998e-06 2024-04-25T22:52:49.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:49.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021720+0000", 2024-04-25T22:52:49.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082884340000000008 2024-04-25T22:52:49.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:49.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022122+0000", 2024-04-25T22:52:49.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000401634 2024-04-25T22:52:49.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:49.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:49.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:49.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033577+0000", 2024-04-25T22:52:49.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011455435999999999 2024-04-25T22:52:49.357 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:49.357 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:49.357 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:49.357 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:49.357 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:49.357 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:49.357 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:52:49.359 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:49.357+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:49.359 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:52:49.460 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:49.459+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:49.466 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:49.466 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:52:49.466 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-25T22:52:49.466 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:49.474 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:52:49.483 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-25T22:52:49.483 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:52:49.483 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:52:49.504 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-25T22:52:49.504 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:52:49.507 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:52:49.507 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:52:49.560 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:49.560+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:49.577 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:49.577 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:49.586 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:52:49.662 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:49.661+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:49.688 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:49.688 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:49.697 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:52:49.762 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:49.761+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:49.801 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:49.801 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:49.810 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:52:49.895 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:49.894+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:49.953 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:49.953 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:49.962 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:52:49.964 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:49.963+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:50.066 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:50.065+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:50.104 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:50.104 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:50.113 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:52:50.160 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-25T22:52:50.167 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:50.166+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:50.216 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:50.216 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:50.225 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:52:50.269 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:50.268+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:50.327 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:50.327 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:50.336 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:52:50.377 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:50.376+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:50.402 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T22:52:50.470 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:50.469+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:50.478 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:50.478 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:50.487 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:52:50.512 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off 2024-04-25T22:52:50.571 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:50.570+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:50.592 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:50.592 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:50.601 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:52:50.613 INFO:teuthology.orchestra.console.smithi164:Power off completed 2024-04-25T22:52:50.687 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:50.686+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:50.743 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:50.744 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:50.752 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:52:50.794 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:50.793+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:50.874 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:50.873+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:50.894 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:50.895 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:50.903 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:52:50.974 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:50.973+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:51.007 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:51.007 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:51.016 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:52:51.075 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:51.074+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:51.117 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:51.118 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:51.126 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:52:51.158 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is set 2024-04-25T22:52:51.210 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:51.209+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:51.268 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:51.268 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:51.277 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:51.275+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:51.277 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:52:51.377 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:51.376+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:51.380 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:51.380 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:51.388 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:52:51.478 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:51.477+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:51.489 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:51.489 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:51.498 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:52:51.508 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:52:51.580 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:51.579+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:51.600 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:51.601 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:51.609 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:52:51.639 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-25T22:52:51.639 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:52:51.639 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:52:51.658 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-25T22:52:51.658 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:52:51.662 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:52:51.662 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:52:51.680 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:51.679+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:51.713 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:51.713 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:52:51.713 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-25T22:52:51.713 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:51.722 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:52:51.781 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:51.780+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:51.865 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:51.866 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:52:51.866 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-25T22:52:51.866 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-25T22:52:51.866 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:51.874 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:52:51.918 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:51.917+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:51.978 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:51.978 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:52:51.979 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:52:51.979 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:52:51.979 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:51.979 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:52:51.979 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:52:51.979 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 64.009477648000001, 2024-04-25T22:52:51.979 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:52:51.979 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:51.979 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:51.979 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:51.980 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:51.980 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:51.980 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:51.980 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:52:51.980 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:51.980 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:51.980 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:51.980 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:51.980 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:52:51.980 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:51.980 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:51.980 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:51.980 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:51.980 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:52:51.981 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:52:51.981 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:51.981 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:51.981 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:51.981 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:52:51.981 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:52:51.981 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:51.981 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:51.981 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:51.981 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:52:51.981 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:52:51.981 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:51.981 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:51.982 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:51.982 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:52:51.982 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:52:51.982 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:51.982 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:51.982 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:51.982 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:52:51.982 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:52:51.982 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:51.982 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:51.982 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:51.982 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:52:51.982 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:52:51.983 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:51.983 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:51.983 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:51.983 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:52:51.983 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:52:51.983 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:51.983 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:51.983 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:51.983 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:52:51.983 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:52:51.983 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:51.984 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:51.984 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:51.984 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:51.984 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:51.984 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:110 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'72, mlcod=10'68)", 2024-04-25T22:52:51.984 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:51.984 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 64.008843647999996, 2024-04-25T22:52:51.984 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065316630000000001, 2024-04-25T22:52:51.984 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:51.984 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:51.984 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:51.984 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:51.984 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:51.985 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:51.985 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:51.985 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:51.985 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:51.985 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:51.985 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:51.985 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:51.985 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:51.985 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:51.985 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:51.985 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:51.985 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:51.985 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.58e-07 2024-04-25T22:52:51.985 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:51.986 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:51.986 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:51.986 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967811+0000", 2024-04-25T22:52:51.986 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.118e-06 2024-04-25T22:52:51.986 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:51.986 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:51.986 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:51.986 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967817+0000", 2024-04-25T22:52:51.986 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3709999999999996e-06 2024-04-25T22:52:51.986 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:51.986 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:51.986 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:51.986 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967820+0000", 2024-04-25T22:52:51.986 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2210000000000002e-06 2024-04-25T22:52:51.987 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:51.987 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:51.987 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:51.987 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967876+0000", 2024-04-25T22:52:51.987 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5507000000000002e-05 2024-04-25T22:52:51.987 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:51.987 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:51.987 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:51.987 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967893+0000", 2024-04-25T22:52:51.987 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7812000000000002e-05 2024-04-25T22:52:51.987 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:51.987 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:51.987 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:51.987 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974317+0000", 2024-04-25T22:52:51.988 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064237160000000003 2024-04-25T22:52:51.988 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:51.988 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:51.988 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:51.988 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:52:51.988 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.156e-05 2024-04-25T22:52:51.988 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:51.988 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:51.988 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:51.988 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:51.988 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:51.989 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'68)", 2024-04-25T22:52:51.989 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:51.989 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 64.008426134999993, 2024-04-25T22:52:51.989 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061292279999999996, 2024-04-25T22:52:51.989 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:51.989 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:51.989 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:51.989 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:51.989 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:51.989 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:51.989 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:51.989 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:51.989 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:51.990 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:51.990 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:51.990 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:51.990 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:51.990 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:51.990 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:51.990 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:51.990 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:51.990 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6300000000000001e-07 2024-04-25T22:52:51.990 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:51.990 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:51.990 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:51.990 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968228+0000", 2024-04-25T22:52:51.991 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6139999999999999e-06 2024-04-25T22:52:51.991 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:51.991 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:51.991 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:51.991 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968235+0000", 2024-04-25T22:52:51.991 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7020000000000001e-06 2024-04-25T22:52:51.991 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:51.991 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:51.991 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:51.991 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968238+0000", 2024-04-25T22:52:51.991 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0010000000000002e-06 2024-04-25T22:52:51.991 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:51.991 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:51.991 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:51.992 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968297+0000", 2024-04-25T22:52:51.992 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8424999999999997e-05 2024-04-25T22:52:51.992 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:51.992 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:51.992 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:51.992 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968316+0000", 2024-04-25T22:52:51.992 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8814999999999999e-05 2024-04-25T22:52:51.992 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:51.992 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:51.992 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:51.992 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:52:51.992 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060239439999999998 2024-04-25T22:52:51.992 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:51.992 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:51.993 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:51.993 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974354+0000", 2024-04-25T22:52:51.993 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4364e-05 2024-04-25T22:52:51.993 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:51.993 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:51.993 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:51.993 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:51.993 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:51.993 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'68)", 2024-04-25T22:52:51.993 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:51.993 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 64.007989132999995, 2024-04-25T22:52:51.993 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005948414, 2024-04-25T22:52:51.993 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:51.994 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:51.994 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:51.994 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:51.994 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:51.994 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:51.994 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:51.994 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:51.994 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:51.994 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:51.994 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:51.994 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:51.994 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:51.994 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:51.995 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:51.995 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:51.995 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:51.995 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6199999999999998e-07 2024-04-25T22:52:51.995 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:51.995 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:51.995 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:51.995 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968723+0000", 2024-04-25T22:52:51.995 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1148999999999993e-05 2024-04-25T22:52:51.995 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:51.995 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:51.995 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:51.995 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968730+0000", 2024-04-25T22:52:51.996 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1749999999999999e-06 2024-04-25T22:52:51.996 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:51.996 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:51.996 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:51.996 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968734+0000", 2024-04-25T22:52:51.996 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5200000000000002e-06 2024-04-25T22:52:51.996 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:51.996 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:51.996 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:51.996 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968771+0000", 2024-04-25T22:52:51.996 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6851999999999999e-05 2024-04-25T22:52:51.996 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:51.996 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:51.997 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:51.997 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968788+0000", 2024-04-25T22:52:51.997 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7027000000000001e-05 2024-04-25T22:52:51.997 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:51.997 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:51.997 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:51.997 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974589+0000", 2024-04-25T22:52:51.997 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058013320000000002 2024-04-25T22:52:51.997 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:51.997 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:51.997 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:51.997 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974610+0000", 2024-04-25T22:52:51.997 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0897e-05 2024-04-25T22:52:51.997 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:51.998 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:51.998 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:51.998 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:51.998 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:51.998 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'68)", 2024-04-25T22:52:51.998 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:51.998 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 64.007419123000005, 2024-04-25T22:52:51.998 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053935750000000003, 2024-04-25T22:52:51.998 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:51.998 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:51.998 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:51.998 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:51.998 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:51.999 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:51.999 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:51.999 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:51.999 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:51.999 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:51.999 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:51.999 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:51.999 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:51.999 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:51.999 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:51.999 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:51.999 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:51.999 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.03e-07 2024-04-25T22:52:51.999 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.000 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.000 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:52.000 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969235+0000", 2024-04-25T22:52:52.000 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2399999999999999e-06 2024-04-25T22:52:52.000 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.000 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.000 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:52.000 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969242+0000", 2024-04-25T22:52:52.000 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1269999999999997e-06 2024-04-25T22:52:52.000 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.000 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.000 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:52.000 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969246+0000", 2024-04-25T22:52:52.001 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3840000000000001e-06 2024-04-25T22:52:52.001 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.001 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.001 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:52.001 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969278+0000", 2024-04-25T22:52:52.001 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1868e-05 2024-04-25T22:52:52.001 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.001 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.001 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:52.001 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969295+0000", 2024-04-25T22:52:52.001 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7530999999999999e-05 2024-04-25T22:52:52.001 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.001 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.001 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:52.002 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974611+0000", 2024-04-25T22:52:52.002 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053160789999999996 2024-04-25T22:52:52.002 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.002 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.002 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:52.002 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974625+0000", 2024-04-25T22:52:52.002 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3943e-05 2024-04-25T22:52:52.002 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.002 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:52.002 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.002 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.002 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.002 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-25T22:52:52.002 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:52.003 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 63.813823214999999, 2024-04-25T22:52:52.003 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054952610000000004, 2024-04-25T22:52:52.003 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:52.003 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:52.003 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:52.003 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:52.003 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.003 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:52.003 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:52.003 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:52.003 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.003 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.003 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:52.004 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:52.004 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:52.004 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.004 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.004 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:52.004 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:52.004 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.68e-07 2024-04-25T22:52:52.004 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.004 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.004 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:52.004 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162898+0000", 2024-04-25T22:52:52.004 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9470999999999999e-05 2024-04-25T22:52:52.004 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.004 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.005 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:52.005 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162906+0000", 2024-04-25T22:52:52.005 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1580000000000005e-06 2024-04-25T22:52:52.005 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.005 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.005 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:52.005 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162911+0000", 2024-04-25T22:52:52.005 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4779999999999999e-06 2024-04-25T22:52:52.005 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.005 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.005 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:52.005 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162952+0000", 2024-04-25T22:52:52.005 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0629e-05 2024-04-25T22:52:52.006 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.006 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.006 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:52.006 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162968+0000", 2024-04-25T22:52:52.006 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6239000000000002e-05 2024-04-25T22:52:52.006 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.006 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.006 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:52.006 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168281+0000", 2024-04-25T22:52:52.006 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053132869999999999 2024-04-25T22:52:52.006 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.006 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.006 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:52.007 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168323+0000", 2024-04-25T22:52:52.007 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1430999999999997e-05 2024-04-25T22:52:52.007 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.007 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:52.007 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.007 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.007 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.007 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-04-25T22:52:52.007 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:52.007 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 63.383345853000002, 2024-04-25T22:52:52.007 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050872510000000001, 2024-04-25T22:52:52.007 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:52.007 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:52.008 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:52.008 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:52.008 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.008 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:52.008 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:52.008 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:52.008 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.008 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.008 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:52.008 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:52.008 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:52.008 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.008 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.008 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:52.009 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:52.009 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.72e-07 2024-04-25T22:52:52.009 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.009 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.009 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:52.009 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593381+0000", 2024-04-25T22:52:52.009 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5797000000000006e-05 2024-04-25T22:52:52.009 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.009 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.009 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:52.009 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593389+0000", 2024-04-25T22:52:52.009 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8480000000000001e-06 2024-04-25T22:52:52.010 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.010 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.010 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:52.010 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593393+0000", 2024-04-25T22:52:52.010 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4819999999999996e-06 2024-04-25T22:52:52.010 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.010 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.010 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:52.010 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593435+0000", 2024-04-25T22:52:52.010 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1600000000000002e-05 2024-04-25T22:52:52.010 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.010 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.010 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:52.011 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593454+0000", 2024-04-25T22:52:52.011 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8868e-05 2024-04-25T22:52:52.011 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.011 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.011 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:52.011 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598350+0000", 2024-04-25T22:52:52.011 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004895763 2024-04-25T22:52:52.011 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.011 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.011 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:52.011 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598392+0000", 2024-04-25T22:52:52.011 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2521000000000002e-05 2024-04-25T22:52:52.011 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.011 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:52.011 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.012 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.012 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.012 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:52.012 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:52:52.012 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 58.964981948999998, 2024-04-25T22:52:52.012 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:52:52.012 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:52.012 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:52.012 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:52.012 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:52.012 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.012 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:52.012 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:52:52.013 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:52.013 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.013 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.013 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:52.013 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:52:52.013 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:52.013 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.013 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.013 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:52.013 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:52:52.013 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:52:52.013 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.013 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.014 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:52.014 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:52:52.014 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:52:52.014 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.014 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.014 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:52.014 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:52:52.014 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:52:52.014 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.014 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.014 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:52.014 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:52:52.014 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:52:52.014 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.015 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.015 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:52.015 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:52:52.015 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:52:52.015 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.015 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.015 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:52.015 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:52:52.015 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:52:52.015 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.015 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.015 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:52.015 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:52:52.016 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:52:52.016 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.016 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.016 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:52.016 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:52:52.016 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:52:52.016 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.016 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.016 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:52.016 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:52:52.016 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:52:52.016 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.016 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.016 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:52.017 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:52:52.017 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:52:52.017 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.017 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.017 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:52.017 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:52:52.017 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:52:52.017 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.017 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:52.017 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.017 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.017 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.017 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:52.017 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:52:52.018 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 58.964307572999999, 2024-04-25T22:52:52.018 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:52:52.018 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:52.018 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:52.018 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:52.018 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:52.018 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.018 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:52.018 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:52:52.018 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:52.018 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.018 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.018 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:52.019 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:52:52.019 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:52.019 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.019 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.019 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:52.019 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:52:52.019 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:52:52.019 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.019 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.019 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:52.019 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:52:52.019 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:52:52.019 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.020 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.020 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:52.020 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:52:52.020 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:52:52.020 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.020 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.020 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:52.020 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:52:52.020 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:52:52.020 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.020 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.020 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:52.020 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:52:52.020 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:52:52.021 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.021 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.021 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:52.021 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:52:52.021 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:52:52.021 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.021 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.021 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:52.021 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:52:52.021 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:52:52.021 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.021 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.021 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:52.022 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:52:52.022 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:52:52.022 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.022 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.022 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:52.022 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:52:52.022 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:52:52.022 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.022 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.022 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:52.022 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:52:52.023 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:52:52.023 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.023 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.023 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:52.023 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:52:52.023 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:52:52.023 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.023 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:52.023 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.023 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.023 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.023 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:52.023 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:52:52.024 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 58.963798361000002, 2024-04-25T22:52:52.024 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:52:52.024 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:52.024 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:52.024 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:52.024 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:52.024 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.024 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:52.024 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:52:52.024 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:52.024 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.024 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.024 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:52.025 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:52:52.025 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:52.025 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.025 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.025 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:52.025 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:52:52.025 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:52:52.025 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.025 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.025 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:52.025 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:52:52.025 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:52:52.025 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.025 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.026 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:52.026 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:52:52.026 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:52:52.026 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.026 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.026 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:52.026 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:52:52.026 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:52:52.026 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.026 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.026 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:52.026 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:52:52.026 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:52:52.027 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.027 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.027 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:52.027 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:52:52.027 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:52:52.027 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.027 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.027 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:52.027 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:52:52.027 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:52:52.027 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.027 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.027 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:52.028 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:52:52.028 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:52:52.028 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.028 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.028 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:52.028 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:52:52.028 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:52:52.028 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.028 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.028 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:52.028 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:52:52.028 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:52:52.028 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.028 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.029 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:52.029 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:52:52.029 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:52:52.029 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.029 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:52.029 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.029 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.029 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.029 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:52.029 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:52.029 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 58.963385162999998, 2024-04-25T22:52:52.029 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:52:52.029 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:52.029 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:52.030 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:52.030 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:52.030 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.030 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:52.030 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:52.030 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:52.030 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.030 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.030 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:52.030 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:52.030 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:52.030 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.030 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.030 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:52.031 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:52.031 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:52:52.031 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.031 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.031 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:52.031 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:52:52.031 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:52:52.031 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.031 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.031 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:52.031 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:52:52.031 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:52:52.031 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.032 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.032 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:52.032 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:52:52.032 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:52:52.032 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.032 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.032 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:52.032 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:52:52.032 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:52:52.032 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.032 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.032 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:52.032 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:52:52.033 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:52:52.033 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.033 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.033 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:52.033 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:52:52.033 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:52:52.033 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.033 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.033 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:52.033 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:52:52.033 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:52:52.033 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.033 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.033 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:52.033 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:52:52.034 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:52:52.034 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.034 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.034 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:52.034 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:52:52.034 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:52:52.034 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.034 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.034 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:52.034 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:52:52.034 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:52:52.034 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.034 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:52.034 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.035 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.035 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.035 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:52.035 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:52:52.035 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 58.963334492999998, 2024-04-25T22:52:52.035 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:52:52.035 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:52.035 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:52.035 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:52.035 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:52.035 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.035 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:52.035 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:52:52.035 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:52.035 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.036 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.036 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:52.036 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:52:52.036 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:52.036 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.036 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.036 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:52.036 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:52:52.036 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:52:52.036 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.036 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.036 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:52.036 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:52:52.036 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:52:52.036 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.037 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.037 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:52.037 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:52:52.037 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:52:52.037 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.037 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.037 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:52.037 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:52:52.037 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:52:52.037 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.037 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.037 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:52.037 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:52:52.038 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:52:52.038 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.038 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.038 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:52:52.038 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:52:52.038 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:52:52.038 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.038 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.038 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:52.038 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:52:52.038 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:52:52.038 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.038 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.038 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:52.039 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:52:52.039 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:52:52.039 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.039 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.039 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:52.039 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:52:52.039 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:52:52.039 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.039 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.039 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:52.039 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:52:52.039 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:52:52.039 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.040 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.040 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:52.040 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:52:52.040 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:52:52.040 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.040 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.040 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:52.040 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:52:52.040 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:52:52.040 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.040 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.040 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:52.040 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:52:52.040 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:52:52.041 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.041 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:52.041 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.041 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.041 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.041 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:52.041 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:52:52.041 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 58.963297623999999, 2024-04-25T22:52:52.041 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:52:52.041 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:52.041 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:52.041 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:52.041 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:52.041 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.041 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:52.042 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:52:52.042 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:52.042 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.042 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.042 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:52.042 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:52:52.042 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:52.042 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.042 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.042 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:52.042 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:52:52.042 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:52:52.042 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.042 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.043 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:52.043 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:52:52.043 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:52:52.043 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.043 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.043 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:52.043 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:52:52.043 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:52:52.043 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.043 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.043 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:52.043 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:52:52.043 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:52:52.044 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.044 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.044 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:52.044 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:52:52.044 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:52:52.044 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.044 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.044 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:52:52.044 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:52:52.044 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:52:52.044 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.044 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.044 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:52.044 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:52:52.044 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:52:52.045 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.045 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.045 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:52.045 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:52:52.045 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:52:52.045 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.045 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.045 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:52.045 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:52:52.045 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:52:52.045 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.045 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.045 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:52.045 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:52:52.046 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:52:52.046 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.046 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.046 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:52.046 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:52:52.046 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:52:52.046 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.046 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.046 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:52.046 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:52:52.046 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:52:52.046 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.046 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.047 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:52.047 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:52:52.047 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:52:52.047 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.047 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:52.047 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.047 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.047 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.047 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:52.047 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:52:52.047 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 58.963272658000001, 2024-04-25T22:52:52.047 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:52:52.047 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:52.048 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:52.048 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:52.048 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:52.048 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.048 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:52.048 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:52:52.048 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:52.048 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.048 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.048 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:52.048 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:52:52.048 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:52.048 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.049 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.049 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:52.049 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:52:52.049 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:52:52.049 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.049 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.049 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:52.049 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:52:52.049 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:52:52.049 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.049 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.049 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:52.049 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:52:52.049 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:52:52.050 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.050 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.050 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:52.050 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:52:52.050 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:52:52.050 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.050 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.050 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:52.050 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:52:52.050 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:52:52.050 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.050 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.051 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:52.051 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:52:52.051 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:52:52.051 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.051 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.051 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:52.051 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:52:52.051 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:52:52.051 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.051 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.051 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:52.051 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:52:52.051 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:52:52.051 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.052 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.052 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:52.052 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:52:52.052 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:52:52.052 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.052 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.052 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:52.052 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:52:52.052 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:52:52.052 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.052 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.052 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:52.052 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:52:52.053 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:52:52.053 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.053 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:52.053 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.053 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.053 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.053 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:52.053 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:52:52.053 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 58.963236293999998, 2024-04-25T22:52:52.053 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:52:52.053 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:52.053 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:52.053 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:52:52.053 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:52.053 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.054 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:52.054 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:52:52.054 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:52.054 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.054 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.054 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:52.054 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:52:52.054 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:52.054 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.054 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.054 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:52.054 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:52:52.054 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:52:52.054 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.055 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.055 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:52.055 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:52:52.055 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:52:52.055 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.055 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.055 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:52.055 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:52:52.055 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:52:52.055 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.055 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.055 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:52.055 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:52:52.055 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:52:52.056 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.056 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.056 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:52.056 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:52:52.056 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:52:52.056 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.056 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.056 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:52:52.056 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:52:52.056 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:52:52.056 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.056 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.056 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:52.056 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:52:52.057 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:52:52.057 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.057 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.057 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:52.057 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:52:52.057 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:52:52.057 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.057 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.057 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:52.057 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:52:52.057 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:52:52.057 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.057 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:52.057 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.057 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.058 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.058 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:52.058 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:52.058 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 58.963205213000002, 2024-04-25T22:52:52.058 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:52:52.058 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:52.058 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:52.058 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:52:52.058 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:52.058 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.058 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:52.058 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:52.058 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:52.058 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.059 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.059 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:52.059 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:52.059 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:52.059 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.059 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.059 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:52.059 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:52.059 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:52:52.059 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.059 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.059 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:52.059 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:52:52.059 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:52:52.060 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.060 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.060 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:52.060 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:52:52.060 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:52:52.060 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.060 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.060 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:52.060 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:52:52.060 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:52:52.060 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.060 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.060 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:52.060 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:52:52.060 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:52:52.061 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.061 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.061 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:52.061 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:52:52.061 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:52:52.061 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.061 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.061 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:52.061 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:52:52.061 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:52:52.061 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.061 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:52.061 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.061 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.061 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.062 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:52:52.062 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:52.062 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 58.962764243999999, 2024-04-25T22:52:52.062 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064881979999999997, 2024-04-25T22:52:52.062 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:52.062 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:52.062 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:52.062 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:52.062 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.062 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:52.062 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:52.062 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:52.062 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.062 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.063 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:52.063 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:52.063 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:52.063 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.063 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.063 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:52.063 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:52.063 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2699999999999999e-07 2024-04-25T22:52:52.063 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.063 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.063 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:52.063 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013898+0000", 2024-04-25T22:52:52.063 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0796e-05 2024-04-25T22:52:52.063 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.063 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.063 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:52.064 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013907+0000", 2024-04-25T22:52:52.064 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5140000000000007e-06 2024-04-25T22:52:52.064 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.064 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.064 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:52.064 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013952+0000", 2024-04-25T22:52:52.064 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4134000000000001e-05 2024-04-25T22:52:52.064 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.064 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.064 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:52.064 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016812+0000", 2024-04-25T22:52:52.064 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028601059999999998 2024-04-25T22:52:52.064 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.064 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.065 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:52.065 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.017052+0000", 2024-04-25T22:52:52.065 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024056500000000001 2024-04-25T22:52:52.065 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.065 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.065 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:52.065 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020350+0000", 2024-04-25T22:52:52.065 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032978320000000001 2024-04-25T22:52:52.065 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.065 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.065 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:52.065 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020375+0000", 2024-04-25T22:52:52.066 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4624e-05 2024-04-25T22:52:52.066 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.066 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:52.066 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.066 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.066 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.066 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-25T22:52:52.066 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:52.066 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 58.949233798000002, 2024-04-25T22:52:52.066 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058583000000000003, 2024-04-25T22:52:52.066 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:52.066 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:52.066 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:52.066 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:52.067 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.067 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:52.067 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:52.067 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:52.067 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.067 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.067 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:52.067 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:52.067 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:52.067 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.067 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.067 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:52.067 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:52.068 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.41e-07 2024-04-25T22:52:52.068 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.068 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.068 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:52.068 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027428+0000", 2024-04-25T22:52:52.068 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.075e-05 2024-04-25T22:52:52.068 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.068 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.068 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:52.068 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027435+0000", 2024-04-25T22:52:52.068 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3610000000000003e-06 2024-04-25T22:52:52.068 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.068 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.068 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:52.069 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027442+0000", 2024-04-25T22:52:52.069 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0400000000000004e-06 2024-04-25T22:52:52.069 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.069 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.069 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:52.069 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028094+0000", 2024-04-25T22:52:52.069 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00065134800000000005 2024-04-25T22:52:52.069 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.069 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.069 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:52.069 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028107+0000", 2024-04-25T22:52:52.069 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3087e-05 2024-04-25T22:52:52.069 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.070 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.070 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:52.070 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033239+0000", 2024-04-25T22:52:52.070 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051319429999999999 2024-04-25T22:52:52.070 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.070 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.070 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:52.070 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033275+0000", 2024-04-25T22:52:52.070 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6430000000000002e-05 2024-04-25T22:52:52.070 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.070 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:52.070 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.070 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.070 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.071 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-25T22:52:52.071 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:52.071 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 58.948848961000003, 2024-04-25T22:52:52.071 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005413597, 2024-04-25T22:52:52.071 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:52.071 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:52.071 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:52.071 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:52.071 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.071 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:52.071 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:52.071 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:52.071 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.071 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.072 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:52.072 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:52.072 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:52.072 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.072 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.072 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:52.072 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:52.072 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3799999999999997e-07 2024-04-25T22:52:52.072 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.072 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.072 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:52.072 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027816+0000", 2024-04-25T22:52:52.072 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3230999999999999e-05 2024-04-25T22:52:52.072 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.073 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.073 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:52.073 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027823+0000", 2024-04-25T22:52:52.073 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9039999999999992e-06 2024-04-25T22:52:52.073 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.073 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.073 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:52.073 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027841+0000", 2024-04-25T22:52:52.073 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7651000000000001e-05 2024-04-25T22:52:52.073 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.073 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.073 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:52.073 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027904+0000", 2024-04-25T22:52:52.073 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3058000000000005e-05 2024-04-25T22:52:52.074 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.074 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.074 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:52.074 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027926+0000", 2024-04-25T22:52:52.074 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1450999999999998e-05 2024-04-25T22:52:52.074 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.074 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.074 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:52.074 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033177+0000", 2024-04-25T22:52:52.074 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052508909999999997 2024-04-25T22:52:52.074 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.074 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.074 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:52.074 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033215+0000", 2024-04-25T22:52:52.075 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8872999999999999e-05 2024-04-25T22:52:52.075 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.075 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:52.075 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.075 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.075 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.075 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 171 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:52:52.075 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:52.075 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 58.948791858999996, 2024-04-25T22:52:52.075 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054322240000000003, 2024-04-25T22:52:52.075 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:52.075 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:52.075 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "reached pg", 2024-04-25T22:52:52.075 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:52.076 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.076 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:52.076 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:52.076 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:52.076 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.076 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.076 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:52.076 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:52.076 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:52.076 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.076 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.076 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:52.076 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:52.077 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7500000000000001e-07 2024-04-25T22:52:52.077 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.077 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.077 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:52.077 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027868+0000", 2024-04-25T22:52:52.077 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5750000000000001e-06 2024-04-25T22:52:52.077 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.077 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.077 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:52.077 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027885+0000", 2024-04-25T22:52:52.077 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7272e-05 2024-04-25T22:52:52.077 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.077 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.078 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:52.078 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027900+0000", 2024-04-25T22:52:52.078 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.502e-05 2024-04-25T22:52:52.078 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.078 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.078 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:52.078 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028381+0000", 2024-04-25T22:52:52.078 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00048039399999999998 2024-04-25T22:52:52.078 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.078 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.078 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:52.078 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033291+0000", 2024-04-25T22:52:52.078 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049105879999999996 2024-04-25T22:52:52.079 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.079 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:52.079 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.079 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.079 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:52.079 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:52.080 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:52:52.081 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:52.079+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:52.181 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:52.181+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:52.184 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:52.184 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:52:52.184 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-04-25T22:52:52.184 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:52.193 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:52:52.282 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:52.282+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:52.295 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:52.295 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:52:52.295 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:52:52.295 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:52:52.295 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:52.304 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:52:52.383 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:52.383+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:52.408 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:52.408 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-04-25T22:52:52.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-04-25T22:52:52.408 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:52:52.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.408 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:52.408 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:52.409 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 64.441369092000002, 2024-04-25T22:52:52.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0103421, 2024-04-25T22:52:52.409 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:52.409 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:52.409 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:52.409 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:52.409 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:52.409 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:52.409 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 115 2024-04-25T22:52:52.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.409 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:52.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:52.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:52.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:52.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:52.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:52.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:52.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:52.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:52.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9500000000000002e-07 2024-04-25T22:52:52.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:52.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965108+0000", 2024-04-25T22:52:52.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9177999999999994e-05 2024-04-25T22:52:52.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:52.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965127+0000", 2024-04-25T22:52:52.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8868e-05 2024-04-25T22:52:52.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:52.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965133+0000", 2024-04-25T22:52:52.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8929999999999999e-06 2024-04-25T22:52:52.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:52.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.969991+0000", 2024-04-25T22:52:52.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048573849999999997 2024-04-25T22:52:52.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:52.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970072+0000", 2024-04-25T22:52:52.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0728000000000004e-05 2024-04-25T22:52:52.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:52.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970189+0000", 2024-04-25T22:52:52.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000117778 2024-04-25T22:52:52.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:52.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970946+0000", 2024-04-25T22:52:52.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00075704600000000004 2024-04-25T22:52:52.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:52.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975297+0000", 2024-04-25T22:52:52.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004350217 2024-04-25T22:52:52.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:52.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975343+0000", 2024-04-25T22:52:52.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6687999999999998e-05 2024-04-25T22:52:52.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:52.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975380+0000", 2024-04-25T22:52:52.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6724000000000003e-05 2024-04-25T22:52:52.415 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:52.415 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:52.415 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:52.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.416 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:52.416 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:52.416 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 64.441263061000001, 2024-04-25T22:52:52.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010304384, 2024-04-25T22:52:52.416 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:52.416 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:52.416 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:52.416 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:52.416 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:52.416 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:52.416 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 116 2024-04-25T22:52:52.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.416 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:52.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:52.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:52.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:52.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:52.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:52.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:52.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:52.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:52.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5799999999999999e-07 2024-04-25T22:52:52.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:52.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965154+0000", 2024-04-25T22:52:52.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0009e-05 2024-04-25T22:52:52.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:52.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965164+0000", 2024-04-25T22:52:52.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8490000000000001e-06 2024-04-25T22:52:52.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:52.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965169+0000", 2024-04-25T22:52:52.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0730000000000004e-06 2024-04-25T22:52:52.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:52.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970609+0000", 2024-04-25T22:52:52.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054397689999999997 2024-04-25T22:52:52.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:52.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970651+0000", 2024-04-25T22:52:52.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1873999999999999e-05 2024-04-25T22:52:52.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.420 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:52.420 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970723+0000", 2024-04-25T22:52:52.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2039999999999995e-05 2024-04-25T22:52:52.420 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.420 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:52.420 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971358+0000", 2024-04-25T22:52:52.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063489500000000001 2024-04-25T22:52:52.420 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.420 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:52.420 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975409+0000", 2024-04-25T22:52:52.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040506880000000002 2024-04-25T22:52:52.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:52.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975432+0000", 2024-04-25T22:52:52.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3315999999999998e-05 2024-04-25T22:52:52.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:52.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975448+0000", 2024-04-25T22:52:52.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6313000000000001e-05 2024-04-25T22:52:52.421 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:52.421 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:52.421 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:52.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.422 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:52.422 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:52.422 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 64.441228479000003, 2024-04-25T22:52:52.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010384338999999999, 2024-04-25T22:52:52.422 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:52.422 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:52.422 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:52.422 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:52.422 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:52.422 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:52.422 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-04-25T22:52:52.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.423 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:52.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:52.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:52.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:52.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:52.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:52.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:52.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:52.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:52.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3600000000000004e-07 2024-04-25T22:52:52.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.424 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:52.424 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965185+0000", 2024-04-25T22:52:52.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.117e-06 2024-04-25T22:52:52.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.424 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:52.424 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965192+0000", 2024-04-25T22:52:52.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3239999999999997e-06 2024-04-25T22:52:52.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.425 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:52.425 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965198+0000", 2024-04-25T22:52:52.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6370000000000004e-06 2024-04-25T22:52:52.425 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.425 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.425 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:52.425 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970973+0000", 2024-04-25T22:52:52.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057748239999999996 2024-04-25T22:52:52.425 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.425 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.425 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:52.425 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971049+0000", 2024-04-25T22:52:52.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6029e-05 2024-04-25T22:52:52.425 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.426 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:52.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971174+0000", 2024-04-25T22:52:52.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012462399999999999 2024-04-25T22:52:52.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.426 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:52.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971553+0000", 2024-04-25T22:52:52.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037896499999999999 2024-04-25T22:52:52.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.426 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:52.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975482+0000", 2024-04-25T22:52:52.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039297459999999996 2024-04-25T22:52:52.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:52.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975529+0000", 2024-04-25T22:52:52.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6387000000000002e-05 2024-04-25T22:52:52.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:52.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975563+0000", 2024-04-25T22:52:52.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4150000000000003e-05 2024-04-25T22:52:52.427 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:52.427 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:52.428 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:52.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.428 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:52.428 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:52.428 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 59.394182155999999, 2024-04-25T22:52:52.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012637705000000001, 2024-04-25T22:52:52.428 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:52.428 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:52.428 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:52.428 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:52.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:52.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:52.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:52.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.429 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.429 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:52.429 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:52.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:52.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.429 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.429 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:52.429 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012227+0000", 2024-04-25T22:52:52.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.863e-06 2024-04-25T22:52:52.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.429 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.429 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:52.429 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012236+0000", 2024-04-25T22:52:52.430 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1109999999999997e-06 2024-04-25T22:52:52.430 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.430 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:52.430 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012309+0000", 2024-04-25T22:52:52.430 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3242000000000001e-05 2024-04-25T22:52:52.430 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.430 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:52.430 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012324+0000", 2024-04-25T22:52:52.430 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4837e-05 2024-04-25T22:52:52.430 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.430 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:52.431 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015060+0000", 2024-04-25T22:52:52.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027363349999999999 2024-04-25T22:52:52.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.431 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:52.431 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015169+0000", 2024-04-25T22:52:52.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108372 2024-04-25T22:52:52.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.431 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:52.431 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015498+0000", 2024-04-25T22:52:52.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032949999999999999 2024-04-25T22:52:52.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:52.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021282+0000", 2024-04-25T22:52:52.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057836429999999998 2024-04-25T22:52:52.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:52.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024709+0000", 2024-04-25T22:52:52.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034271979999999998 2024-04-25T22:52:52.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:52.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024802+0000", 2024-04-25T22:52:52.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2960000000000004e-05 2024-04-25T22:52:52.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.433 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:52.433 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024863+0000", 2024-04-25T22:52:52.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0643999999999997e-05 2024-04-25T22:52:52.433 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:52.433 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:52.433 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:52.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.433 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:52.433 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:52.433 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 59.394058385000001, 2024-04-25T22:52:52.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012979447999999999, 2024-04-25T22:52:52.433 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:52.434 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:52.434 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:52.434 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:52.434 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.434 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:52.434 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:52.434 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:52.434 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.434 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.434 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:52.434 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:52.434 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:52.434 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.435 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:52.435 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:52.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:52:52.435 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.435 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:52.435 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012354+0000", 2024-04-25T22:52:52.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7740000000000004e-06 2024-04-25T22:52:52.435 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.435 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:52.435 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012365+0000", 2024-04-25T22:52:52.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.064e-05 2024-04-25T22:52:52.435 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:52.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012382+0000", 2024-04-25T22:52:52.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6999000000000001e-05 2024-04-25T22:52:52.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:52.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015958+0000", 2024-04-25T22:52:52.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035765699999999998 2024-04-25T22:52:52.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:52.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016037+0000", 2024-04-25T22:52:52.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8242000000000001e-05 2024-04-25T22:52:52.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:52.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016404+0000", 2024-04-25T22:52:52.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036784300000000002 2024-04-25T22:52:52.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:52.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021294+0000", 2024-04-25T22:52:52.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048890629999999999 2024-04-25T22:52:52.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:52.438 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024959+0000", 2024-04-25T22:52:52.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036651570000000001 2024-04-25T22:52:52.438 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.438 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:52.438 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025097+0000", 2024-04-25T22:52:52.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013788099999999999 2024-04-25T22:52:52.438 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.438 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:52.438 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025328+0000", 2024-04-25T22:52:52.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231492 2024-04-25T22:52:52.438 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:52.438 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:52.439 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:52.439 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.439 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.439 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:52.439 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:52.439 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 59.393970615999997, 2024-04-25T22:52:52.439 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013049827, 2024-04-25T22:52:52.439 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:52.439 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:52.439 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:52.439 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:52.439 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.439 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:52.439 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:52.440 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:52.440 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.440 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.440 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:52.440 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:52.440 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:52.440 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.440 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.440 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:52.440 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012437+0000", 2024-04-25T22:52:52.440 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-04-25T22:52:52.440 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.440 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.440 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:52.441 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012440+0000", 2024-04-25T22:52:52.441 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7609999999999999e-06 2024-04-25T22:52:52.441 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.441 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.441 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:52.441 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012449+0000", 2024-04-25T22:52:52.441 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.285e-06 2024-04-25T22:52:52.441 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.441 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.441 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:52.441 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012457+0000", 2024-04-25T22:52:52.441 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9510000000000006e-06 2024-04-25T22:52:52.441 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.441 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.442 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:52.442 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017106+0000", 2024-04-25T22:52:52.442 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046494220000000003 2024-04-25T22:52:52.442 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.442 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.442 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:52.442 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017223+0000", 2024-04-25T22:52:52.442 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116824 2024-04-25T22:52:52.442 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.442 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.442 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:52.442 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017345+0000", 2024-04-25T22:52:52.442 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122175 2024-04-25T22:52:52.443 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.443 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.443 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:52.443 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021299+0000", 2024-04-25T22:52:52.443 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039534879999999998 2024-04-25T22:52:52.443 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.443 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.443 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:52.443 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025398+0000", 2024-04-25T22:52:52.443 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040988960000000003 2024-04-25T22:52:52.443 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.443 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.443 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:52.443 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025439+0000", 2024-04-25T22:52:52.444 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0915999999999999e-05 2024-04-25T22:52:52.444 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.444 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.444 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:52.444 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025486+0000", 2024-04-25T22:52:52.444 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7534999999999998e-05 2024-04-25T22:52:52.444 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:52.444 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:52.444 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:52.444 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.444 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.444 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:52.444 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:52.444 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 59.393940465, 2024-04-25T22:52:52.444 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020988041999999998, 2024-04-25T22:52:52.445 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:52.445 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:52.445 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:52.445 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:52.445 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.445 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:52.445 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:52.445 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:52.445 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.445 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.445 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:52.445 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:52.445 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:52.445 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.446 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.446 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:52.446 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:52.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.99e-07 2024-04-25T22:52:52.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.446 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.446 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:52.446 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012470+0000", 2024-04-25T22:52:52.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2789999999999999e-06 2024-04-25T22:52:52.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.446 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.446 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:52.446 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012477+0000", 2024-04-25T22:52:52.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:52:52.447 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.447 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.447 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:52.447 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012500+0000", 2024-04-25T22:52:52.447 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2490999999999999e-05 2024-04-25T22:52:52.447 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.447 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.447 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:52.447 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021911+0000", 2024-04-25T22:52:52.447 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094114160000000006 2024-04-25T22:52:52.447 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.447 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.447 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:52.448 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022000+0000", 2024-04-25T22:52:52.448 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8601000000000001e-05 2024-04-25T22:52:52.448 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.448 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.448 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:52.448 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022359+0000", 2024-04-25T22:52:52.448 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035921999999999999 2024-04-25T22:52:52.448 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.448 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.448 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:52.448 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025541+0000", 2024-04-25T22:52:52.448 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031820619999999998 2024-04-25T22:52:52.448 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.448 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.449 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:52.449 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033375+0000", 2024-04-25T22:52:52.449 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078338379999999992 2024-04-25T22:52:52.449 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.449 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.449 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:52.449 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033415+0000", 2024-04-25T22:52:52.449 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9527000000000003e-05 2024-04-25T22:52:52.449 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.449 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.449 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:52.449 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033455+0000", 2024-04-25T22:52:52.449 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9932000000000003e-05 2024-04-25T22:52:52.449 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:52.450 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:52.450 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:52.450 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.450 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.450 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:52.450 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:52.450 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 59.393885271999999, 2024-04-25T22:52:52.450 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021043857999999999, 2024-04-25T22:52:52.450 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:52.450 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:52.450 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:52.450 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:52.450 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.450 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:52.451 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:52.451 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:52.451 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.451 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.451 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:52.451 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:52.451 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:52.451 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.451 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.451 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:52.451 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012523+0000", 2024-04-25T22:52:52.451 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.361e-06 2024-04-25T22:52:52.451 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.452 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.452 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:52.452 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012530+0000", 2024-04-25T22:52:52.452 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5440000000000004e-06 2024-04-25T22:52:52.452 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.452 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.452 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:52.452 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012541+0000", 2024-04-25T22:52:52.452 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1745e-05 2024-04-25T22:52:52.452 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.452 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.452 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:52.452 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012551+0000", 2024-04-25T22:52:52.452 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5789999999999993e-06 2024-04-25T22:52:52.453 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.453 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.453 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:52.453 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022709+0000", 2024-04-25T22:52:52.453 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010157685 2024-04-25T22:52:52.453 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.453 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.453 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:52.453 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022957+0000", 2024-04-25T22:52:52.453 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024824599999999998 2024-04-25T22:52:52.453 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.453 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.453 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:52.453 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023443+0000", 2024-04-25T22:52:52.454 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048578599999999999 2024-04-25T22:52:52.454 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.454 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.454 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:52.454 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025547+0000", 2024-04-25T22:52:52.454 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021044789999999998 2024-04-25T22:52:52.454 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.454 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.454 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:52.454 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033509+0000", 2024-04-25T22:52:52.454 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0079622180000000001 2024-04-25T22:52:52.454 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.454 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.454 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:52.455 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033542+0000", 2024-04-25T22:52:52.455 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3018000000000001e-05 2024-04-25T22:52:52.455 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.455 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.455 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:52.455 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033566+0000", 2024-04-25T22:52:52.455 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3197000000000002e-05 2024-04-25T22:52:52.455 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:52.455 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:52.455 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:52.455 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.455 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.455 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:52.455 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:52.456 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 59.393845306999999, 2024-04-25T22:52:52.456 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021122696, 2024-04-25T22:52:52.456 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:52.456 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:52.456 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:52.456 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:52.456 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.456 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:52.456 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:52.456 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:52.456 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.456 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.456 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:52.456 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:52.457 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:52.457 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.457 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.457 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:52.457 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:52.457 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:52:52.457 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.457 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.457 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:52.457 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012566+0000", 2024-04-25T22:52:52.457 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-04-25T22:52:52.457 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.457 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.457 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:52.458 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012619+0000", 2024-04-25T22:52:52.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2607e-05 2024-04-25T22:52:52.458 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.458 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:52.458 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012628+0000", 2024-04-25T22:52:52.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6500000000000008e-06 2024-04-25T22:52:52.458 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.458 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:52.458 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024024+0000", 2024-04-25T22:52:52.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011396007999999999 2024-04-25T22:52:52.458 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.459 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:52.459 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024198+0000", 2024-04-25T22:52:52.459 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000173215 2024-04-25T22:52:52.459 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.459 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.459 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:52.459 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024447+0000", 2024-04-25T22:52:52.459 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024898500000000002 2024-04-25T22:52:52.459 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.459 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.459 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:52.459 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026431+0000", 2024-04-25T22:52:52.459 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001984923 2024-04-25T22:52:52.459 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.460 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.460 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:52.460 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033608+0000", 2024-04-25T22:52:52.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071768459999999997 2024-04-25T22:52:52.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.460 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.460 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:52.460 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033646+0000", 2024-04-25T22:52:52.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299000000000003e-05 2024-04-25T22:52:52.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.460 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.460 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:52.460 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033684+0000", 2024-04-25T22:52:52.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8773000000000003e-05 2024-04-25T22:52:52.461 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:52.461 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:52.461 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:52.461 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.461 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:52.461 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:52.461 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 59.393756707999998, 2024-04-25T22:52:52.461 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021175381, 2024-04-25T22:52:52.461 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:52.461 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:52.461 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:52.461 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:52.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.462 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:52.462 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:52.462 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:52.462 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.462 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.462 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:52.462 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:52.462 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:52.462 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.462 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.462 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:52.462 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012651+0000", 2024-04-25T22:52:52.462 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:52:52.462 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.463 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.463 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:52.463 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012656+0000", 2024-04-25T22:52:52.463 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8899999999999998e-06 2024-04-25T22:52:52.463 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.463 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.463 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:52.463 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012666+0000", 2024-04-25T22:52:52.463 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0346999999999999e-05 2024-04-25T22:52:52.463 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.463 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.463 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:52.463 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012675+0000", 2024-04-25T22:52:52.463 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9930000000000001e-06 2024-04-25T22:52:52.463 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.464 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.464 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:52.464 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025661+0000", 2024-04-25T22:52:52.464 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01298531 2024-04-25T22:52:52.464 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.464 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.464 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:52.464 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025757+0000", 2024-04-25T22:52:52.464 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5822000000000005e-05 2024-04-25T22:52:52.464 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.464 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.464 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:52.465 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025907+0000", 2024-04-25T22:52:52.465 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015051499999999999 2024-04-25T22:52:52.465 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.465 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.465 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:52.465 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026435+0000", 2024-04-25T22:52:52.465 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052762200000000005 2024-04-25T22:52:52.465 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.465 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.465 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:52.465 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033732+0000", 2024-04-25T22:52:52.465 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072978419999999997 2024-04-25T22:52:52.465 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.465 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.466 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:52.466 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033787+0000", 2024-04-25T22:52:52.466 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4703999999999997e-05 2024-04-25T22:52:52.466 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.466 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.466 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:52.466 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033826+0000", 2024-04-25T22:52:52.466 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8458999999999999e-05 2024-04-25T22:52:52.466 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:52.466 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:52.467 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:52.467 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.467 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.467 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:52.467 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:52.467 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 59.393701294000003, 2024-04-25T22:52:52.467 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021244174000000001, 2024-04-25T22:52:52.467 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:52.467 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:52.467 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:52.467 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:52.467 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.467 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:52.467 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:52.468 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:52.468 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.468 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.468 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:52.468 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:52.468 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:52.468 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.468 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.468 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:52.468 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:52.468 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:52:52.468 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.468 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.468 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:52.469 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012712+0000", 2024-04-25T22:52:52.469 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.913e-06 2024-04-25T22:52:52.469 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.469 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.469 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:52.469 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012722+0000", 2024-04-25T22:52:52.469 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2879999999999998e-06 2024-04-25T22:52:52.469 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.469 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.469 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:52.469 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012727+0000", 2024-04-25T22:52:52.469 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8429999999999998e-06 2024-04-25T22:52:52.469 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.469 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.470 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:52.470 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026099+0000", 2024-04-25T22:52:52.470 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013371450999999999 2024-04-25T22:52:52.470 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.470 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.470 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:52.470 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026147+0000", 2024-04-25T22:52:52.470 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7837999999999998e-05 2024-04-25T22:52:52.470 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.470 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.470 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:52.470 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026254+0000", 2024-04-25T22:52:52.470 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107314 2024-04-25T22:52:52.471 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.471 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.471 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:52.471 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026686+0000", 2024-04-25T22:52:52.471 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000432428 2024-04-25T22:52:52.471 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.471 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.471 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:52.471 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033873+0000", 2024-04-25T22:52:52.471 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071864399999999997 2024-04-25T22:52:52.471 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.471 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.471 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:52.471 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033904+0000", 2024-04-25T22:52:52.472 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1321e-05 2024-04-25T22:52:52.472 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.472 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.472 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:52.472 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033950+0000", 2024-04-25T22:52:52.472 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5707999999999997e-05 2024-04-25T22:52:52.472 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:52.472 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:52.472 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:52.472 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.472 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.472 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:52.472 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:52.473 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 59.393670909000001, 2024-04-25T22:52:52.473 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01096505, 2024-04-25T22:52:52.473 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:52.473 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:52.473 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:52.473 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:52.473 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.473 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:52.473 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:52.473 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:52.473 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.473 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.473 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:52.473 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:52.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:52.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.474 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:52.474 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012737+0000", 2024-04-25T22:52:52.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:52:52.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.474 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:52.474 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012739+0000", 2024-04-25T22:52:52.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-04-25T22:52:52.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.475 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:52.475 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012743+0000", 2024-04-25T22:52:52.475 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3239999999999996e-06 2024-04-25T22:52:52.475 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.475 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.475 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:52.475 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012746+0000", 2024-04-25T22:52:52.475 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.129e-06 2024-04-25T22:52:52.475 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.475 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.475 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:52.475 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012796+0000", 2024-04-25T22:52:52.475 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9231999999999999e-05 2024-04-25T22:52:52.476 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.476 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.476 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:52.476 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012915+0000", 2024-04-25T22:52:52.476 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119021 2024-04-25T22:52:52.476 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.476 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.476 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:52.476 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013069+0000", 2024-04-25T22:52:52.476 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015463900000000001 2024-04-25T22:52:52.476 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.476 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.476 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:52.476 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019237+0000", 2024-04-25T22:52:52.477 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061680329999999998 2024-04-25T22:52:52.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.477 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.477 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:52.477 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023603+0000", 2024-04-25T22:52:52.477 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043655860000000003 2024-04-25T22:52:52.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.477 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.477 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:52.477 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023659+0000", 2024-04-25T22:52:52.477 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6484000000000003e-05 2024-04-25T22:52:52.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.477 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.477 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:52.478 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023701+0000", 2024-04-25T22:52:52.478 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1761999999999998e-05 2024-04-25T22:52:52.478 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:52.478 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:52.478 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:52.478 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.478 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.478 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:52.478 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:52.478 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 59.393645960999997, 2024-04-25T22:52:52.478 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011234429000000001, 2024-04-25T22:52:52.478 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:52.478 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:52.478 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:52.479 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:52.479 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.479 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:52.479 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:52.479 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:52.479 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.479 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.479 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:52.479 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:52.479 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:52.479 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.479 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.479 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:52.480 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012762+0000", 2024-04-25T22:52:52.480 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-04-25T22:52:52.480 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.480 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.480 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:52.480 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012765+0000", 2024-04-25T22:52:52.480 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2569999999999999e-06 2024-04-25T22:52:52.480 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.480 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.480 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:52.480 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012783+0000", 2024-04-25T22:52:52.480 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8431999999999999e-05 2024-04-25T22:52:52.480 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.480 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.481 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:52.481 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012799+0000", 2024-04-25T22:52:52.481 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5438999999999999e-05 2024-04-25T22:52:52.481 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.481 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.481 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:52.481 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013826+0000", 2024-04-25T22:52:52.481 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010275060000000001 2024-04-25T22:52:52.481 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.481 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.481 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:52.481 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013913+0000", 2024-04-25T22:52:52.481 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.708e-05 2024-04-25T22:52:52.481 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.482 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.482 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:52.482 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014098+0000", 2024-04-25T22:52:52.482 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018519399999999999 2024-04-25T22:52:52.482 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.482 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.482 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:52.482 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019684+0000", 2024-04-25T22:52:52.482 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055860079999999999 2024-04-25T22:52:52.482 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.482 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.482 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:52.482 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023876+0000", 2024-04-25T22:52:52.483 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041918800000000003 2024-04-25T22:52:52.483 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.483 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.483 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:52.483 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023957+0000", 2024-04-25T22:52:52.483 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1165e-05 2024-04-25T22:52:52.483 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.483 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.483 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:52.483 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023995+0000", 2024-04-25T22:52:52.483 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:52:52.483 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:52.483 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:52.484 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:52.484 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.484 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.484 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:52.484 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:52.484 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 59.393548182000004, 2024-04-25T22:52:52.484 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011131200000000001, 2024-04-25T22:52:52.484 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:52.484 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:52.484 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:52.484 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:52.484 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.484 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:52.484 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:52.485 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:52.485 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.485 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.485 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:52.485 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:52.485 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:52.485 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.485 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.485 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:52.485 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012860+0000", 2024-04-25T22:52:52.485 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3900000000000004e-07 2024-04-25T22:52:52.485 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.485 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.485 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:52.486 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012865+0000", 2024-04-25T22:52:52.486 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5609999999999998e-06 2024-04-25T22:52:52.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.486 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.486 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:52.486 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012895+0000", 2024-04-25T22:52:52.486 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9847000000000001e-05 2024-04-25T22:52:52.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.486 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.486 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:52.486 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012905+0000", 2024-04-25T22:52:52.486 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.03e-05 2024-04-25T22:52:52.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.486 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.487 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:52.487 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015020+0000", 2024-04-25T22:52:52.487 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021142940000000001 2024-04-25T22:52:52.487 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.487 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.487 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:52.487 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015182+0000", 2024-04-25T22:52:52.487 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016248099999999999 2024-04-25T22:52:52.487 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.487 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.487 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:52:52.487 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015357+0000", 2024-04-25T22:52:52.487 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017471000000000001 2024-04-25T22:52:52.487 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.488 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.488 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:52.488 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021021+0000", 2024-04-25T22:52:52.488 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056638340000000004 2024-04-25T22:52:52.488 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.488 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.488 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:52.488 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023712+0000", 2024-04-25T22:52:52.488 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026910380000000002 2024-04-25T22:52:52.488 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.488 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.488 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:52.488 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023763+0000", 2024-04-25T22:52:52.488 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1477999999999997e-05 2024-04-25T22:52:52.489 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.489 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.489 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:52.489 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023990+0000", 2024-04-25T22:52:52.489 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000226818 2024-04-25T22:52:52.489 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:52.489 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:52.489 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:52.489 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.489 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.489 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:52.489 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:52.489 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 59.393425086000001, 2024-04-25T22:52:52.489 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011705299000000001, 2024-04-25T22:52:52.490 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:52.490 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:52.490 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:52.490 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:52.490 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.490 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:52.490 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:52.490 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:52.490 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.490 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.490 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:52.490 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:52.490 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:52.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.491 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:52.491 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012983+0000", 2024-04-25T22:52:52.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:52:52.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.491 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:52.491 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012986+0000", 2024-04-25T22:52:52.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5700000000000001e-06 2024-04-25T22:52:52.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.491 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:52.491 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012993+0000", 2024-04-25T22:52:52.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8730000000000001e-06 2024-04-25T22:52:52.492 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.492 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.492 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:52.492 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013000+0000", 2024-04-25T22:52:52.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1890000000000001e-06 2024-04-25T22:52:52.492 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.492 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.492 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:52.492 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:52:52.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002147866 2024-04-25T22:52:52.492 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.492 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.492 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:52.493 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015351+0000", 2024-04-25T22:52:52.493 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020300799999999999 2024-04-25T22:52:52.493 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.493 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.493 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:52.493 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016260+0000", 2024-04-25T22:52:52.493 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00090926799999999997 2024-04-25T22:52:52.493 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.493 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.493 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:52.493 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022669+0000", 2024-04-25T22:52:52.493 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064082849999999997 2024-04-25T22:52:52.493 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.493 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.494 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:52.494 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024584+0000", 2024-04-25T22:52:52.494 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019151699999999999 2024-04-25T22:52:52.494 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.494 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.494 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:52.494 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024643+0000", 2024-04-25T22:52:52.494 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8888999999999998e-05 2024-04-25T22:52:52.494 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.494 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.494 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:52.494 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024687+0000", 2024-04-25T22:52:52.494 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4444999999999999e-05 2024-04-25T22:52:52.495 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:52.495 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:52.495 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:52.495 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.495 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.495 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:52.495 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:52.495 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 59.393397495000002, 2024-04-25T22:52:52.495 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011249699, 2024-04-25T22:52:52.495 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:52.495 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:52.495 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:52.495 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:52.495 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.496 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:52.496 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:52.496 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:52.496 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.496 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.496 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:52.496 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:52.496 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:52.496 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.496 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.496 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:52.496 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013010+0000", 2024-04-25T22:52:52.496 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2099999999999996e-07 2024-04-25T22:52:52.496 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.497 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.497 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:52.497 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013013+0000", 2024-04-25T22:52:52.497 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1310000000000002e-06 2024-04-25T22:52:52.497 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.497 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.497 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:52.497 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013020+0000", 2024-04-25T22:52:52.497 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3330000000000002e-06 2024-04-25T22:52:52.497 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.497 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.497 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:52.497 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013025+0000", 2024-04-25T22:52:52.497 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6760000000000004e-06 2024-04-25T22:52:52.498 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.498 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.498 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:52.498 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013163+0000", 2024-04-25T22:52:52.498 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013824599999999999 2024-04-25T22:52:52.498 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.498 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.498 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:52.498 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013504+0000", 2024-04-25T22:52:52.498 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034080299999999998 2024-04-25T22:52:52.498 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.498 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.499 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:52.499 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013613+0000", 2024-04-25T22:52:52.499 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108705 2024-04-25T22:52:52.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.499 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.499 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:52.499 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015831+0000", 2024-04-25T22:52:52.499 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002217672 2024-04-25T22:52:52.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.499 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.499 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:52.499 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024137+0000", 2024-04-25T22:52:52.499 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0083060489999999994 2024-04-25T22:52:52.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.500 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.500 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:52.500 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024218+0000", 2024-04-25T22:52:52.500 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1351000000000001e-05 2024-04-25T22:52:52.500 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.500 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.500 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:52.500 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024259+0000", 2024-04-25T22:52:52.500 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1112000000000002e-05 2024-04-25T22:52:52.500 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:52.500 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:52.500 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:52.500 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.501 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.501 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:52.501 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:52.501 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 59.393309768999998, 2024-04-25T22:52:52.501 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020379749999999999, 2024-04-25T22:52:52.501 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:52.501 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:52.501 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:52.501 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:52.501 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.501 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:52.501 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:52.501 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:52.501 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.502 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.502 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:52.502 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:52.502 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:52.502 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.502 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.502 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:52.502 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013098+0000", 2024-04-25T22:52:52.502 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:52:52.502 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.502 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.502 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:52.502 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013105+0000", 2024-04-25T22:52:52.503 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5969999999999997e-06 2024-04-25T22:52:52.503 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.503 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.503 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:52.503 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013190+0000", 2024-04-25T22:52:52.503 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5618999999999995e-05 2024-04-25T22:52:52.503 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.503 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.503 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:52.503 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013200+0000", 2024-04-25T22:52:52.503 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5859999999999994e-06 2024-04-25T22:52:52.503 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.503 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.504 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:52.504 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020265+0000", 2024-04-25T22:52:52.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070653349999999998 2024-04-25T22:52:52.504 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.504 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.504 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:52.504 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020454+0000", 2024-04-25T22:52:52.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189316 2024-04-25T22:52:52.504 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.504 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.504 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:52.504 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020586+0000", 2024-04-25T22:52:52.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013195700000000001 2024-04-25T22:52:52.504 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.505 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.505 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:52.505 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023822+0000", 2024-04-25T22:52:52.505 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032358529999999999 2024-04-25T22:52:52.505 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.505 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.505 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:52.505 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033409+0000", 2024-04-25T22:52:52.505 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095870520000000004 2024-04-25T22:52:52.505 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.505 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.505 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:52.505 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033447+0000", 2024-04-25T22:52:52.505 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7261999999999997e-05 2024-04-25T22:52:52.506 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.506 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.506 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:52.506 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033477+0000", 2024-04-25T22:52:52.506 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0389e-05 2024-04-25T22:52:52.506 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:52.506 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:52.506 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:52.506 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.506 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.506 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:52.506 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:52.506 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 59.393193263000001, 2024-04-25T22:52:52.507 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010857383999999999, 2024-04-25T22:52:52.507 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:52.507 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:52.507 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:52.507 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:52.507 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.507 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:52.507 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:52.507 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:52.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.507 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.507 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:52.507 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:52.507 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:52.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.508 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.508 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:52.508 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:52.508 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:52:52.508 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.508 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.508 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:52.508 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013218+0000", 2024-04-25T22:52:52.508 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8199999999999998e-06 2024-04-25T22:52:52.508 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.508 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.508 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:52.508 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013226+0000", 2024-04-25T22:52:52.509 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7649999999999993e-06 2024-04-25T22:52:52.509 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.509 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.509 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:52.509 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013259+0000", 2024-04-25T22:52:52.509 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2727e-05 2024-04-25T22:52:52.509 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.509 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.509 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:52.509 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014809+0000", 2024-04-25T22:52:52.509 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001550144 2024-04-25T22:52:52.509 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.509 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.509 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:52.510 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014958+0000", 2024-04-25T22:52:52.510 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014890300000000001 2024-04-25T22:52:52.510 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.510 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.510 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:52:52.510 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015087+0000", 2024-04-25T22:52:52.510 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012939200000000001 2024-04-25T22:52:52.510 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.510 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.510 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:52.510 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020212+0000", 2024-04-25T22:52:52.510 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051248939999999996 2024-04-25T22:52:52.510 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.511 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.511 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:52.511 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023699+0000", 2024-04-25T22:52:52.511 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034873289999999999 2024-04-25T22:52:52.511 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.511 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.511 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:52.511 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024014+0000", 2024-04-25T22:52:52.511 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031473999999999999 2024-04-25T22:52:52.511 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.511 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.511 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:52.511 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024071+0000", 2024-04-25T22:52:52.511 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7040000000000003e-05 2024-04-25T22:52:52.512 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:52.512 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:52.512 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:52.512 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.512 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.512 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:52.512 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:52.512 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 59.393138557999997, 2024-04-25T22:52:52.512 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012329677000000001, 2024-04-25T22:52:52.512 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:52.512 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:52.512 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:52.512 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:52.512 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.513 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:52.513 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:52.513 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:52.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.513 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:52.513 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:52.513 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:52.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.513 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:52.513 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013269+0000", 2024-04-25T22:52:52.513 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5000000000000002e-07 2024-04-25T22:52:52.514 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.514 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.514 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:52.514 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:52:52.514 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6909999999999999e-06 2024-04-25T22:52:52.514 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.514 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.514 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:52.514 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013284+0000", 2024-04-25T22:52:52.514 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0963e-05 2024-04-25T22:52:52.514 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.514 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.514 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:52.514 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013361+0000", 2024-04-25T22:52:52.515 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7379999999999994e-05 2024-04-25T22:52:52.515 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.515 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.515 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:52.515 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013448+0000", 2024-04-25T22:52:52.515 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6990000000000006e-05 2024-04-25T22:52:52.515 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.515 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.515 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:52.515 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013632+0000", 2024-04-25T22:52:52.515 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018396800000000001 2024-04-25T22:52:52.515 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.515 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:52.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013800+0000", 2024-04-25T22:52:52.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167467 2024-04-25T22:52:52.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:52.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.018570+0000", 2024-04-25T22:52:52.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047701460000000003 2024-04-25T22:52:52.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:52.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025507+0000", 2024-04-25T22:52:52.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069372039999999998 2024-04-25T22:52:52.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:52.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025562+0000", 2024-04-25T22:52:52.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4858999999999998e-05 2024-04-25T22:52:52.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:52.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025598+0000", 2024-04-25T22:52:52.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6259e-05 2024-04-25T22:52:52.517 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:52.517 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:52.517 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:52.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.518 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:52.518 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:52.518 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 59.393006685000003, 2024-04-25T22:52:52.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020176666999999999, 2024-04-25T22:52:52.518 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:52.518 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:52.518 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:52:52.518 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:52.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.518 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:52.518 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:52.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:52.519 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.519 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.519 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:52.519 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:52.519 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:52.519 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.519 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.519 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:52.519 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:52:52.519 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-04-25T22:52:52.519 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.519 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.519 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:52.520 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013405+0000", 2024-04-25T22:52:52.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0559999999999998e-06 2024-04-25T22:52:52.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:52.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013422+0000", 2024-04-25T22:52:52.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6770999999999999e-05 2024-04-25T22:52:52.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.522 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:52.522 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013431+0000", 2024-04-25T22:52:52.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5019999999999998e-06 2024-04-25T22:52:52.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.522 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:52.522 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021720+0000", 2024-04-25T22:52:52.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082884340000000008 2024-04-25T22:52:52.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.522 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:52.523 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022122+0000", 2024-04-25T22:52:52.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000401634 2024-04-25T22:52:52.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:52.523 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:52.523 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:52.523 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033577+0000", 2024-04-25T22:52:52.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011455435999999999 2024-04-25T22:52:52.523 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:52.523 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:52.523 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:52.523 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:52.523 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:52.523 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:52.525 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:52:52.525 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:52.524+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:52.626 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:52.625+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:52.633 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:52.633 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:52:52.633 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-25T22:52:52.633 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:52.643 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:52:52.728 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:52.727+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:52.786 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:52.787 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:52:52.787 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-25T22:52:52.787 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-25T22:52:52.787 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:52.795 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:52:52.836 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:52.835+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:52.930 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:52.929+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:52.939 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:52.939 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:52:52.939 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:52:52.939 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:52:52.939 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.939 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:52:52.939 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:52:52.939 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 64.970608365000004, 2024-04-25T22:52:52.940 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:52:52.940 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:52.940 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:52.940 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:52.940 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:52.940 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.940 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:52.940 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:52:52.940 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:52.940 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.940 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.940 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:52.940 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:52:52.941 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:52.941 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.941 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.941 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:52.941 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:52:52.941 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:52:52.941 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.941 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.941 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:52.941 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:52:52.941 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:52:52.941 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.941 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.941 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:52.941 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:52:52.942 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:52:52.942 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.942 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.942 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:52.942 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:52:52.942 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:52:52.942 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.942 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.942 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:52.942 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:52:52.942 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:52:52.942 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.942 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.942 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:52.943 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:52:52.943 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:52:52.943 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.943 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.943 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:52.943 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:52:52.943 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:52:52.943 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.943 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.943 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:52.943 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:52:52.943 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:52:52.943 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.943 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:52.944 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.944 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.944 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.944 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:110 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'72, mlcod=10'68)", 2024-04-25T22:52:52.944 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:52.944 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 64.969974364999999, 2024-04-25T22:52:52.944 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065316630000000001, 2024-04-25T22:52:52.944 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:52.944 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:52.944 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:52.944 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:52.944 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.944 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:52.944 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:52.944 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:52.945 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.945 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.945 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:52.945 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:52.945 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:52.945 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.945 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.945 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:52.945 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:52.945 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.58e-07 2024-04-25T22:52:52.945 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.945 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.945 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:52.945 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967811+0000", 2024-04-25T22:52:52.946 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.118e-06 2024-04-25T22:52:52.946 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.946 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.946 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:52.946 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967817+0000", 2024-04-25T22:52:52.946 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3709999999999996e-06 2024-04-25T22:52:52.946 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.946 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.946 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:52.946 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967820+0000", 2024-04-25T22:52:52.946 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2210000000000002e-06 2024-04-25T22:52:52.946 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.946 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.947 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:52.947 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967876+0000", 2024-04-25T22:52:52.947 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5507000000000002e-05 2024-04-25T22:52:52.947 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.947 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.947 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:52.947 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967893+0000", 2024-04-25T22:52:52.947 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7812000000000002e-05 2024-04-25T22:52:52.947 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.947 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.947 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:52.947 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974317+0000", 2024-04-25T22:52:52.947 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064237160000000003 2024-04-25T22:52:52.947 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.948 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.948 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:52.948 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:52:52.948 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.156e-05 2024-04-25T22:52:52.948 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.948 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:52.948 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.948 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.948 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.948 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'68)", 2024-04-25T22:52:52.948 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:52.948 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 64.969556851999997, 2024-04-25T22:52:52.948 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061292279999999996, 2024-04-25T22:52:52.948 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:52.949 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:52.949 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:52.949 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:52.949 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.949 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:52.949 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:52.949 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:52.949 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.949 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.949 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:52.949 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:52.949 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:52.949 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.949 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.949 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:52.949 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:52.950 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6300000000000001e-07 2024-04-25T22:52:52.950 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.950 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.950 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:52.950 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968228+0000", 2024-04-25T22:52:52.950 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6139999999999999e-06 2024-04-25T22:52:52.950 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.950 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.950 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:52.950 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968235+0000", 2024-04-25T22:52:52.950 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7020000000000001e-06 2024-04-25T22:52:52.950 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.950 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.950 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:52.951 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968238+0000", 2024-04-25T22:52:52.951 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0010000000000002e-06 2024-04-25T22:52:52.951 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.951 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.951 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:52.951 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968297+0000", 2024-04-25T22:52:52.951 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8424999999999997e-05 2024-04-25T22:52:52.951 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.951 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.951 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:52.951 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968316+0000", 2024-04-25T22:52:52.951 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8814999999999999e-05 2024-04-25T22:52:52.951 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.951 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.951 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:52.952 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:52:52.952 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060239439999999998 2024-04-25T22:52:52.952 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.952 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.952 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:52.952 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974354+0000", 2024-04-25T22:52:52.952 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4364e-05 2024-04-25T22:52:52.952 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.952 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:52.952 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.952 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.952 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.952 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'68)", 2024-04-25T22:52:52.953 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:52.953 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 64.969119849999998, 2024-04-25T22:52:52.953 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005948414, 2024-04-25T22:52:52.953 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:52.953 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:52.953 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:52.953 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:52.953 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.953 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:52.953 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:52.953 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:52.953 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.953 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.953 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:52.954 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:52.954 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:52.954 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.954 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.954 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:52.954 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:52.954 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6199999999999998e-07 2024-04-25T22:52:52.954 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.954 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.954 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:52.954 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968723+0000", 2024-04-25T22:52:52.954 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1148999999999993e-05 2024-04-25T22:52:52.954 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.955 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.955 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:52.955 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968730+0000", 2024-04-25T22:52:52.955 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1749999999999999e-06 2024-04-25T22:52:52.955 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.955 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.955 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:52.955 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968734+0000", 2024-04-25T22:52:52.955 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5200000000000002e-06 2024-04-25T22:52:52.955 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.955 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.955 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:52.955 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968771+0000", 2024-04-25T22:52:52.956 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6851999999999999e-05 2024-04-25T22:52:52.956 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.956 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.956 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:52.956 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968788+0000", 2024-04-25T22:52:52.956 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7027000000000001e-05 2024-04-25T22:52:52.956 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.956 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.956 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:52.956 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974589+0000", 2024-04-25T22:52:52.956 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058013320000000002 2024-04-25T22:52:52.956 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.956 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.956 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:52.957 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974610+0000", 2024-04-25T22:52:52.957 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0897e-05 2024-04-25T22:52:52.957 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.957 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:52.957 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.957 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.957 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.957 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'68)", 2024-04-25T22:52:52.957 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:52.957 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 64.968549839999994, 2024-04-25T22:52:52.957 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053935750000000003, 2024-04-25T22:52:52.957 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:52.957 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:52.957 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:52.958 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:52.958 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.958 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:52.958 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:52.958 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:52.958 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.958 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.958 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:52.958 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:52.958 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:52.958 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.958 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.959 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:52.959 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:52.959 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.03e-07 2024-04-25T22:52:52.959 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.959 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.959 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:52.959 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969235+0000", 2024-04-25T22:52:52.959 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2399999999999999e-06 2024-04-25T22:52:52.959 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.959 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.959 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:52.959 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969242+0000", 2024-04-25T22:52:52.959 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1269999999999997e-06 2024-04-25T22:52:52.959 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.960 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.960 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:52.960 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969246+0000", 2024-04-25T22:52:52.960 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3840000000000001e-06 2024-04-25T22:52:52.960 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.960 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.960 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:52.960 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969278+0000", 2024-04-25T22:52:52.960 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1868e-05 2024-04-25T22:52:52.960 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.960 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.960 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:52.961 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969295+0000", 2024-04-25T22:52:52.961 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7530999999999999e-05 2024-04-25T22:52:52.961 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.961 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.961 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:52.961 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974611+0000", 2024-04-25T22:52:52.961 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053160789999999996 2024-04-25T22:52:52.961 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.961 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.961 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:52.961 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974625+0000", 2024-04-25T22:52:52.961 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3943e-05 2024-04-25T22:52:52.961 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.961 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:52.962 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.962 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.962 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.962 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-25T22:52:52.962 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:52.962 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 64.774953932000003, 2024-04-25T22:52:52.962 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054952610000000004, 2024-04-25T22:52:52.962 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:52.962 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:52.962 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:52.962 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:52.962 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.962 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:52.963 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:52.963 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:52.963 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.963 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.963 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:52.963 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:52.963 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:52.963 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.963 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.963 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:52.963 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:52.963 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.68e-07 2024-04-25T22:52:52.963 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.963 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.964 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:52.964 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162898+0000", 2024-04-25T22:52:52.964 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9470999999999999e-05 2024-04-25T22:52:52.964 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.964 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.964 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:52.964 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162906+0000", 2024-04-25T22:52:52.964 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1580000000000005e-06 2024-04-25T22:52:52.964 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.964 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.964 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:52.964 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162911+0000", 2024-04-25T22:52:52.964 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4779999999999999e-06 2024-04-25T22:52:52.964 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.965 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.965 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:52.965 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162952+0000", 2024-04-25T22:52:52.965 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0629e-05 2024-04-25T22:52:52.965 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.965 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.965 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:52.965 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162968+0000", 2024-04-25T22:52:52.965 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6239000000000002e-05 2024-04-25T22:52:52.965 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.965 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.965 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:52.965 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168281+0000", 2024-04-25T22:52:52.965 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053132869999999999 2024-04-25T22:52:52.966 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.966 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.966 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:52.966 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168323+0000", 2024-04-25T22:52:52.966 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1430999999999997e-05 2024-04-25T22:52:52.966 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.966 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:52.966 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.966 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.966 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.966 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-04-25T22:52:52.966 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:52.966 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 64.344476569999998, 2024-04-25T22:52:52.966 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050872510000000001, 2024-04-25T22:52:52.967 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:52.967 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:52.967 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:52.967 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:52.967 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.967 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:52.967 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:52.967 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:52.967 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.967 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.967 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:52.967 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:52.967 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:52.968 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.968 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.968 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:52.968 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:52.968 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.72e-07 2024-04-25T22:52:52.968 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.968 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.968 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:52.968 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593381+0000", 2024-04-25T22:52:52.968 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5797000000000006e-05 2024-04-25T22:52:52.968 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.968 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.968 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:52.968 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593389+0000", 2024-04-25T22:52:52.968 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8480000000000001e-06 2024-04-25T22:52:52.969 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.969 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.969 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:52.969 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593393+0000", 2024-04-25T22:52:52.969 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4819999999999996e-06 2024-04-25T22:52:52.969 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.969 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.969 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:52.969 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593435+0000", 2024-04-25T22:52:52.969 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1600000000000002e-05 2024-04-25T22:52:52.969 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.969 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.969 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:52.969 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593454+0000", 2024-04-25T22:52:52.969 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8868e-05 2024-04-25T22:52:52.970 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.970 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.970 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:52.970 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598350+0000", 2024-04-25T22:52:52.970 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004895763 2024-04-25T22:52:52.970 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.970 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.970 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:52.970 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598392+0000", 2024-04-25T22:52:52.970 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2521000000000002e-05 2024-04-25T22:52:52.970 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.970 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:52.970 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.971 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.971 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.971 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:52.971 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:52:52.971 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 59.926112666000002, 2024-04-25T22:52:52.971 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:52:52.971 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:52.971 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:52.971 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:52.971 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:52.971 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.971 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:52.971 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:52:52.972 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:52.972 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.972 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.972 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:52.972 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:52:52.972 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:52.972 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.972 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.972 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:52.972 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:52:52.972 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:52:52.972 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.972 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.972 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:52.973 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:52:52.973 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:52:52.973 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.973 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.973 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:52.973 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:52:52.973 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:52:52.973 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.973 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.973 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:52.973 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:52:52.973 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:52:52.973 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.974 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.974 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:52.974 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:52:52.974 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:52:52.974 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.974 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.974 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:52.974 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:52:52.974 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:52:52.974 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.974 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.974 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:52.974 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:52:52.974 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:52:52.974 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.975 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.975 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:52.975 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:52:52.975 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:52:52.975 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.975 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.975 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:52.975 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:52:52.975 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:52:52.975 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.975 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.975 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:52.975 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:52:52.975 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:52:52.975 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.976 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.976 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:52.976 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:52:52.976 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:52:52.976 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.976 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:52.976 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.976 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.976 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.976 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:52.976 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:52:52.976 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 59.925438290000002, 2024-04-25T22:52:52.976 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:52:52.976 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:52.976 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:52.976 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:52.977 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:52.977 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.977 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:52.977 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:52:52.977 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:52.977 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.977 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.977 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:52.977 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:52:52.977 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:52.977 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.977 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.977 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:52.977 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:52:52.977 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:52:52.978 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.978 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.978 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:52.978 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:52:52.978 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:52:52.978 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.978 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.978 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:52.978 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:52:52.978 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:52:52.978 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.978 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.978 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:52.978 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:52:52.979 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:52:52.979 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.979 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.979 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:52.979 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:52:52.979 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:52:52.979 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.979 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.979 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:52.979 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:52:52.979 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:52:52.979 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.979 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.979 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:52.980 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:52:52.980 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:52:52.980 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.980 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.980 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:52.980 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:52:52.980 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:52:52.980 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.980 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.980 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:52.980 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:52:52.980 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:52:52.980 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.980 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.981 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:52.981 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:52:52.981 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:52:52.981 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.981 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.981 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:52.981 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:52:52.981 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:52:52.981 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.981 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:52.981 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.981 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.981 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.981 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:52.981 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:52:52.982 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 59.924929077999998, 2024-04-25T22:52:52.982 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:52:52.982 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:52.982 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:52.982 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:52.982 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:52.982 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.982 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:52.982 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:52:52.982 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:52.982 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.982 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.982 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:52.983 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:52:52.983 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:52.983 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.983 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.983 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:52.983 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:52:52.983 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:52:52.983 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.983 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.983 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:52.983 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:52:52.983 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:52:52.983 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.983 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.983 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:52.983 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:52:52.984 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:52:52.984 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.984 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.984 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:52.984 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:52:52.984 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:52:52.984 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.984 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.984 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:52.984 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:52:52.984 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:52:52.984 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.984 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.985 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:52.985 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:52:52.985 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:52:52.985 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.985 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.985 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:52.985 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:52:52.985 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:52:52.985 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.985 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.985 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:52.985 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:52:52.985 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:52:52.985 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.986 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.986 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:52.986 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:52:52.986 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:52:52.986 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.986 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.986 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:52.986 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:52:52.986 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:52:52.986 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.986 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.986 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:52.986 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:52:52.987 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:52:52.987 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.987 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:52.987 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.987 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.987 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.987 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:52.987 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:52.987 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 59.924515880000001, 2024-04-25T22:52:52.987 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:52:52.987 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:52.987 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:52.987 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:52.987 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:52.987 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.988 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:52.988 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:52.988 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:52.988 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.988 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.988 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:52.988 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:52.988 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:52.988 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.988 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.988 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:52.988 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:52.988 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:52:52.988 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.989 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.989 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:52.989 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:52:52.989 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:52:52.989 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.989 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.989 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:52.989 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:52:52.989 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:52:52.989 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.989 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.989 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:52.989 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:52:52.989 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:52:52.990 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.990 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.990 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:52.990 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:52:52.990 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:52:52.990 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.990 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.990 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:52.990 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:52:52.990 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:52:52.990 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.990 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.990 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:52.991 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:52:52.991 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:52:52.991 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.991 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.991 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:52.991 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:52:52.991 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:52:52.991 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.991 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.991 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:52.991 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:52:52.991 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:52:52.991 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.991 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.991 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:52.992 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:52:52.992 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:52:52.992 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.992 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.992 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:52.992 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:52:52.992 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:52:52.992 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.992 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:52.992 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.992 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.992 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.992 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:52.992 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:52:52.993 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 59.924465210000001, 2024-04-25T22:52:52.993 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:52:52.993 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:52.993 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:52.993 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:52.993 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:52.993 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.993 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:52.993 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:52:52.993 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:52.993 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.993 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.993 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:52.993 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:52:52.994 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:52.994 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.994 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.994 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:52.994 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:52:52.994 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:52:52.994 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.994 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.994 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:52.994 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:52:52.994 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:52:52.994 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.994 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.995 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:52.995 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:52:52.995 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:52:52.995 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.995 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.995 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:52.995 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:52:52.995 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:52:52.995 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.995 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.995 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:52.995 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:52:52.995 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:52:52.995 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.996 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.996 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:52:52.996 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:52:52.996 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:52:52.996 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.996 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.996 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:52.996 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:52:52.996 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:52:52.996 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.996 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.996 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:52.996 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:52:52.996 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:52:52.997 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.997 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.997 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:52.997 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:52:52.997 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:52:52.997 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.997 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.997 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:52.997 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:52:52.997 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:52:52.997 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.997 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.997 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:52.997 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:52:52.998 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:52:52.998 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.998 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.998 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:52.998 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:52:52.998 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:52:52.998 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.998 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.998 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:52.998 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:52:52.998 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:52:52.998 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.998 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:52.998 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:52.999 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:52.999 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.999 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:52.999 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:52:52.999 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 59.924428341000002, 2024-04-25T22:52:52.999 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:52:52.999 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:52.999 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:52.999 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:52.999 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:52.999 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:52.999 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:52.999 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:52:53.000 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:53.000 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.000 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.000 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:53.000 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:52:53.000 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:53.000 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.000 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.000 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:53.000 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:52:53.000 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:52:53.000 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.000 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.000 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:53.000 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:52:53.001 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:52:53.001 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.001 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.001 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:53.001 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:52:53.001 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:52:53.001 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.001 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.001 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:53.001 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:52:53.001 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:52:53.001 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.001 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.001 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:53.002 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:52:53.002 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:52:53.002 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.002 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.002 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:52:53.002 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:52:53.002 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:52:53.002 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.002 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.002 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:53.002 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:52:53.002 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:52:53.002 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.003 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.003 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:53.003 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:52:53.003 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:52:53.003 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.003 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.003 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:53.003 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:52:53.003 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:52:53.003 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.003 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.003 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:53.003 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:52:53.003 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:52:53.003 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.004 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.004 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:53.004 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:52:53.004 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:52:53.004 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.004 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.004 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:53.004 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:52:53.004 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:52:53.004 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.004 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.004 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:53.004 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:52:53.004 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:52:53.005 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:53.005 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:53.005 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:53.005 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.005 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.005 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:53.005 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:52:53.005 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 59.924403374999997, 2024-04-25T22:52:53.005 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:52:53.005 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:53.005 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:53.005 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:53.005 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:53.005 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.005 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:53.006 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:52:53.006 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:53.006 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.006 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.006 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:53.006 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:52:53.006 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:53.006 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.006 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.006 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:53.006 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:52:53.006 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:52:53.006 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.006 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.007 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:53.007 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:52:53.007 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:52:53.007 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.007 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.007 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:53.007 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:52:53.007 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:52:53.007 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.007 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.007 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:53.007 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:52:53.007 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:52:53.007 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.008 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.008 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:53.008 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:52:53.008 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:52:53.008 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.008 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.008 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:53.008 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:52:53.008 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:52:53.008 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.008 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.008 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:53.008 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:52:53.009 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:52:53.009 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.009 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.009 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:53.009 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:52:53.009 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:52:53.009 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.009 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.009 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:53.009 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:52:53.009 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:52:53.009 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.009 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.009 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:53.010 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:52:53.010 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:52:53.010 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.010 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.010 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:53.010 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:52:53.010 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:52:53.010 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:53.010 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:53.010 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:53.010 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.010 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.010 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:53.011 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:52:53.011 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 59.924367011000001, 2024-04-25T22:52:53.011 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:52:53.011 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:53.011 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:53.011 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:52:53.011 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:53.011 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.011 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:53.011 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:52:53.011 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:53.011 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.011 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.011 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:53.012 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:52:53.012 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:53.012 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.012 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.012 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:53.012 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:52:53.012 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:52:53.012 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.012 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.012 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:53.012 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:52:53.012 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:52:53.012 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.012 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.013 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:53.013 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:52:53.013 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:52:53.013 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.013 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.013 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:53.013 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:52:53.013 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:52:53.013 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.013 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.013 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:53.013 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:52:53.013 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:52:53.013 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.014 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.014 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:52:53.014 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:52:53.014 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:52:53.014 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.014 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.014 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:53.014 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:52:53.014 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:52:53.014 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.014 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.014 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:53.014 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:52:53.014 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:52:53.015 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.015 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.015 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:53.015 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:52:53.015 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:52:53.015 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:53.015 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:53.015 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:53.015 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.015 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.015 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:53.015 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:53.015 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 59.924335929999998, 2024-04-25T22:52:53.016 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:52:53.016 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:53.016 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:53.016 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:52:53.016 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:53.016 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.016 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:53.016 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:53.016 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:53.016 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.016 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.016 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:53.016 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:53.016 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:53.016 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.017 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.017 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:53.017 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:53.017 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:52:53.017 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.017 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.017 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:53.017 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:52:53.017 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:52:53.017 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.017 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.017 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:53.017 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:52:53.018 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:52:53.018 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.018 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.018 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:53.018 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:52:53.018 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:52:53.018 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.018 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.018 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:53.018 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:52:53.018 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:52:53.018 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.018 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.018 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:53.019 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:52:53.019 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:52:53.019 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.019 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.019 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:53.019 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:52:53.019 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:52:53.019 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:53.019 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:53.019 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:53.019 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.019 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.019 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:52:53.019 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:53.020 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 59.923894961000002, 2024-04-25T22:52:53.020 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064881979999999997, 2024-04-25T22:52:53.020 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:53.020 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:53.020 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:53.020 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:53.020 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.020 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:53.020 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:53.020 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:53.020 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.020 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.020 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:53.021 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:53.021 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:53.021 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.021 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.021 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:53.021 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:53.021 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2699999999999999e-07 2024-04-25T22:52:53.021 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.021 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.021 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:53.021 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013898+0000", 2024-04-25T22:52:53.021 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0796e-05 2024-04-25T22:52:53.021 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.021 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.021 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:53.022 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013907+0000", 2024-04-25T22:52:53.022 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5140000000000007e-06 2024-04-25T22:52:53.022 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.022 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.022 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:53.022 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013952+0000", 2024-04-25T22:52:53.022 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4134000000000001e-05 2024-04-25T22:52:53.022 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.022 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.022 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:53.022 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016812+0000", 2024-04-25T22:52:53.022 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028601059999999998 2024-04-25T22:52:53.022 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.023 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.023 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:53.023 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.017052+0000", 2024-04-25T22:52:53.023 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024056500000000001 2024-04-25T22:52:53.023 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.023 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.023 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:53.023 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020350+0000", 2024-04-25T22:52:53.023 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032978320000000001 2024-04-25T22:52:53.023 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.023 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.023 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:53.023 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020375+0000", 2024-04-25T22:52:53.023 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4624e-05 2024-04-25T22:52:53.024 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:53.024 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:53.024 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:53.024 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.024 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.024 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-25T22:52:53.024 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:53.024 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 59.910364514999998, 2024-04-25T22:52:53.024 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058583000000000003, 2024-04-25T22:52:53.024 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:53.024 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:53.024 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:53.024 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:53.024 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.025 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:53.025 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:53.025 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:53.025 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.025 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.025 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:53.025 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:53.025 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:53.025 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.025 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.025 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:53.025 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:53.025 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.41e-07 2024-04-25T22:52:53.025 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.026 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.026 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:53.026 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027428+0000", 2024-04-25T22:52:53.026 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.075e-05 2024-04-25T22:52:53.026 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.026 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.026 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:53.026 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027435+0000", 2024-04-25T22:52:53.026 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3610000000000003e-06 2024-04-25T22:52:53.026 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.026 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.026 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:53.026 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027442+0000", 2024-04-25T22:52:53.026 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0400000000000004e-06 2024-04-25T22:52:53.027 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.027 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.027 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:53.027 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028094+0000", 2024-04-25T22:52:53.027 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00065134800000000005 2024-04-25T22:52:53.027 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.027 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.027 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:53.027 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028107+0000", 2024-04-25T22:52:53.027 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3087e-05 2024-04-25T22:52:53.027 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.027 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.027 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:53.027 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033239+0000", 2024-04-25T22:52:53.028 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051319429999999999 2024-04-25T22:52:53.028 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.028 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.028 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:53.028 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033275+0000", 2024-04-25T22:52:53.028 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6430000000000002e-05 2024-04-25T22:52:53.028 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:53.028 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:53.028 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:53.028 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.028 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.028 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-25T22:52:53.028 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:53.028 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 59.909979677999999, 2024-04-25T22:52:53.029 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005413597, 2024-04-25T22:52:53.029 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:53.029 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:53.029 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:53.029 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:53.029 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.029 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:53.029 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:53.029 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:53.029 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.029 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.029 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:53.029 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:53.029 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:53.030 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.030 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.030 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:53.030 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:53.030 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3799999999999997e-07 2024-04-25T22:52:53.030 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.030 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.030 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:53.030 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027816+0000", 2024-04-25T22:52:53.030 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3230999999999999e-05 2024-04-25T22:52:53.030 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.030 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.030 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:53.030 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027823+0000", 2024-04-25T22:52:53.031 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9039999999999992e-06 2024-04-25T22:52:53.031 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.031 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.031 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:53.031 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027841+0000", 2024-04-25T22:52:53.031 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7651000000000001e-05 2024-04-25T22:52:53.031 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.031 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.031 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:53.031 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027904+0000", 2024-04-25T22:52:53.031 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3058000000000005e-05 2024-04-25T22:52:53.031 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.031 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.031 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:53.032 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027926+0000", 2024-04-25T22:52:53.032 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1450999999999998e-05 2024-04-25T22:52:53.032 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.032 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.032 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:53.032 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033177+0000", 2024-04-25T22:52:53.032 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052508909999999997 2024-04-25T22:52:53.032 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.032 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.032 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:53.032 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033215+0000", 2024-04-25T22:52:53.032 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8872999999999999e-05 2024-04-25T22:52:53.032 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:53.032 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:53.032 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:53.033 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.033 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.033 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 171 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:52:53.033 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:53.033 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 59.909922576, 2024-04-25T22:52:53.033 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054322240000000003, 2024-04-25T22:52:53.033 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:53.033 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:53.033 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "reached pg", 2024-04-25T22:52:53.033 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:53.033 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.033 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:53.033 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:53.033 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:53.034 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.034 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.034 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:53.034 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:53.034 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:53.034 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.034 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.034 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:53.034 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:53.034 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7500000000000001e-07 2024-04-25T22:52:53.034 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.034 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.034 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:53.035 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027868+0000", 2024-04-25T22:52:53.035 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5750000000000001e-06 2024-04-25T22:52:53.035 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.035 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.035 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:53.035 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027885+0000", 2024-04-25T22:52:53.035 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7272e-05 2024-04-25T22:52:53.035 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.035 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.035 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:53.035 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027900+0000", 2024-04-25T22:52:53.035 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.502e-05 2024-04-25T22:52:53.035 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.035 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.036 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:53.036 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028381+0000", 2024-04-25T22:52:53.036 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00048039399999999998 2024-04-25T22:52:53.036 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:53.036 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:53.036 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:53.036 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033291+0000", 2024-04-25T22:52:53.036 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049105879999999996 2024-04-25T22:52:53.036 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:53.036 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:53.036 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:53.036 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:53.036 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:53.036 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:53.038 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:53.037+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:53.038 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:52:53.139 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:53.138+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:53.147 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:53.148 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:52:53.148 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-04-25T22:52:53.148 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:53.156 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:52:53.174 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-25T22:52:53.240 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:53.240+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:53.258 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:53.258 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:52:53.258 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:52:53.258 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:52:53.258 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:53.267 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:52:53.342 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:53.341+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:53.371 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:53.371 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-04-25T22:52:53.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-04-25T22:52:53.371 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:52:53.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.372 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:53.372 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:53.372 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 65.404484083, 2024-04-25T22:52:53.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0103421, 2024-04-25T22:52:53.372 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:53.372 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:53.372 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:53.372 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:53.372 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:53.372 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:53.372 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 115 2024-04-25T22:52:53.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.373 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:53.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:53.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:53.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:53.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:53.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:53.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:53.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:53.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:53.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9500000000000002e-07 2024-04-25T22:52:53.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:53.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965108+0000", 2024-04-25T22:52:53.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9177999999999994e-05 2024-04-25T22:52:53.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:53.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965127+0000", 2024-04-25T22:52:53.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8868e-05 2024-04-25T22:52:53.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:53.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965133+0000", 2024-04-25T22:52:53.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8929999999999999e-06 2024-04-25T22:52:53.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:53.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.969991+0000", 2024-04-25T22:52:53.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048573849999999997 2024-04-25T22:52:53.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:53.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970072+0000", 2024-04-25T22:52:53.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0728000000000004e-05 2024-04-25T22:52:53.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:53.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970189+0000", 2024-04-25T22:52:53.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000117778 2024-04-25T22:52:53.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:53.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970946+0000", 2024-04-25T22:52:53.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00075704600000000004 2024-04-25T22:52:53.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:53.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975297+0000", 2024-04-25T22:52:53.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004350217 2024-04-25T22:52:53.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:53.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975343+0000", 2024-04-25T22:52:53.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6687999999999998e-05 2024-04-25T22:52:53.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:53.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975380+0000", 2024-04-25T22:52:53.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6724000000000003e-05 2024-04-25T22:52:53.377 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:53.377 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:53.377 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:53.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.378 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:53.378 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:53.378 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 65.404378051999998, 2024-04-25T22:52:53.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010304384, 2024-04-25T22:52:53.378 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:53.378 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:53.378 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:53.378 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:53.378 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:53.378 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:53.378 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 116 2024-04-25T22:52:53.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.378 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:53.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:53.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:53.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:53.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:53.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:53.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:53.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:53.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:53.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5799999999999999e-07 2024-04-25T22:52:53.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:53.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965154+0000", 2024-04-25T22:52:53.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0009e-05 2024-04-25T22:52:53.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:53.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965164+0000", 2024-04-25T22:52:53.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8490000000000001e-06 2024-04-25T22:52:53.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:53.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965169+0000", 2024-04-25T22:52:53.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0730000000000004e-06 2024-04-25T22:52:53.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:53.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970609+0000", 2024-04-25T22:52:53.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054397689999999997 2024-04-25T22:52:53.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:53.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970651+0000", 2024-04-25T22:52:53.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1873999999999999e-05 2024-04-25T22:52:53.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:53.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970723+0000", 2024-04-25T22:52:53.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2039999999999995e-05 2024-04-25T22:52:53.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:53.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971358+0000", 2024-04-25T22:52:53.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063489500000000001 2024-04-25T22:52:53.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:53.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975409+0000", 2024-04-25T22:52:53.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040506880000000002 2024-04-25T22:52:53.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:53.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975432+0000", 2024-04-25T22:52:53.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3315999999999998e-05 2024-04-25T22:52:53.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:53.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975448+0000", 2024-04-25T22:52:53.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6313000000000001e-05 2024-04-25T22:52:53.383 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:53.383 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:53.383 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:53.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.384 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:53.384 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:53.384 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 65.404343470000001, 2024-04-25T22:52:53.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010384338999999999, 2024-04-25T22:52:53.384 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:53.384 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:53.384 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:53.384 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:53.384 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:53.384 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:53.384 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-04-25T22:52:53.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.384 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:53.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:53.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:53.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:53.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:53.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:53.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:53.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:53.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:53.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3600000000000004e-07 2024-04-25T22:52:53.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:53.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965185+0000", 2024-04-25T22:52:53.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.117e-06 2024-04-25T22:52:53.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:53.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965192+0000", 2024-04-25T22:52:53.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3239999999999997e-06 2024-04-25T22:52:53.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:53.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965198+0000", 2024-04-25T22:52:53.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6370000000000004e-06 2024-04-25T22:52:53.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:53.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970973+0000", 2024-04-25T22:52:53.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057748239999999996 2024-04-25T22:52:53.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:53.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971049+0000", 2024-04-25T22:52:53.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6029e-05 2024-04-25T22:52:53.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:53.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971174+0000", 2024-04-25T22:52:53.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012462399999999999 2024-04-25T22:52:53.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:53.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971553+0000", 2024-04-25T22:52:53.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037896499999999999 2024-04-25T22:52:53.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:53.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975482+0000", 2024-04-25T22:52:53.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039297459999999996 2024-04-25T22:52:53.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:53.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975529+0000", 2024-04-25T22:52:53.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6387000000000002e-05 2024-04-25T22:52:53.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:53.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975563+0000", 2024-04-25T22:52:53.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4150000000000003e-05 2024-04-25T22:52:53.389 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:53.389 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:53.389 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:53.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.390 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:53.390 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:53.390 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 60.357297146999997, 2024-04-25T22:52:53.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012637705000000001, 2024-04-25T22:52:53.390 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:53.390 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:53.390 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:53.390 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:53.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:53.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:53.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:53.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:53.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:53.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:53.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:53.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012227+0000", 2024-04-25T22:52:53.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.863e-06 2024-04-25T22:52:53.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:53.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012236+0000", 2024-04-25T22:52:53.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1109999999999997e-06 2024-04-25T22:52:53.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:53.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012309+0000", 2024-04-25T22:52:53.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3242000000000001e-05 2024-04-25T22:52:53.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:53.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012324+0000", 2024-04-25T22:52:53.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4837e-05 2024-04-25T22:52:53.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:53.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015060+0000", 2024-04-25T22:52:53.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027363349999999999 2024-04-25T22:52:53.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.393 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:53.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015169+0000", 2024-04-25T22:52:53.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108372 2024-04-25T22:52:53.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.393 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:53.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015498+0000", 2024-04-25T22:52:53.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032949999999999999 2024-04-25T22:52:53.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:53.394 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021282+0000", 2024-04-25T22:52:53.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057836429999999998 2024-04-25T22:52:53.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:53.394 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024709+0000", 2024-04-25T22:52:53.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034271979999999998 2024-04-25T22:52:53.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:53.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024802+0000", 2024-04-25T22:52:53.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2960000000000004e-05 2024-04-25T22:52:53.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:53.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024863+0000", 2024-04-25T22:52:53.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0643999999999997e-05 2024-04-25T22:52:53.395 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:53.395 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:53.395 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:53.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.396 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:53.396 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:53.396 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 60.357173375999999, 2024-04-25T22:52:53.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012979447999999999, 2024-04-25T22:52:53.396 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:53.396 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:53.396 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:53.396 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:53.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:53.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:53.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:53.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:53.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:53.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:53.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:53.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:53.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:52:53.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:53.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012354+0000", 2024-04-25T22:52:53.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7740000000000004e-06 2024-04-25T22:52:53.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:53.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012365+0000", 2024-04-25T22:52:53.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.064e-05 2024-04-25T22:52:53.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:53.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012382+0000", 2024-04-25T22:52:53.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6999000000000001e-05 2024-04-25T22:52:53.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:53.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015958+0000", 2024-04-25T22:52:53.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035765699999999998 2024-04-25T22:52:53.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:53.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016037+0000", 2024-04-25T22:52:53.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8242000000000001e-05 2024-04-25T22:52:53.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:53.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016404+0000", 2024-04-25T22:52:53.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036784300000000002 2024-04-25T22:52:53.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:53.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021294+0000", 2024-04-25T22:52:53.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048890629999999999 2024-04-25T22:52:53.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:53.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024959+0000", 2024-04-25T22:52:53.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036651570000000001 2024-04-25T22:52:53.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:53.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025097+0000", 2024-04-25T22:52:53.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013788099999999999 2024-04-25T22:52:53.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:53.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025328+0000", 2024-04-25T22:52:53.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231492 2024-04-25T22:52:53.401 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:53.401 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:53.401 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:53.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.401 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:53.401 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:53.401 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 60.357085607000002, 2024-04-25T22:52:53.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013049827, 2024-04-25T22:52:53.401 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:53.401 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:53.401 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:53.401 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:53.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:53.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:53.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:53.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:53.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:53.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:53.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012437+0000", 2024-04-25T22:52:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-04-25T22:52:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012440+0000", 2024-04-25T22:52:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7609999999999999e-06 2024-04-25T22:52:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012449+0000", 2024-04-25T22:52:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.285e-06 2024-04-25T22:52:53.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:53.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012457+0000", 2024-04-25T22:52:53.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9510000000000006e-06 2024-04-25T22:52:53.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:53.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017106+0000", 2024-04-25T22:52:53.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046494220000000003 2024-04-25T22:52:53.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:53.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017223+0000", 2024-04-25T22:52:53.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116824 2024-04-25T22:52:53.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:53.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017345+0000", 2024-04-25T22:52:53.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122175 2024-04-25T22:52:53.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:53.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021299+0000", 2024-04-25T22:52:53.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039534879999999998 2024-04-25T22:52:53.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025398+0000", 2024-04-25T22:52:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040988960000000003 2024-04-25T22:52:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025439+0000", 2024-04-25T22:52:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0915999999999999e-05 2024-04-25T22:52:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025486+0000", 2024-04-25T22:52:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7534999999999998e-05 2024-04-25T22:52:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:53.407 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:53.407 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:53.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.407 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:53.407 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:53.407 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 60.357055455999998, 2024-04-25T22:52:53.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020988041999999998, 2024-04-25T22:52:53.407 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:53.407 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:53.407 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:53.407 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:53.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.99e-07 2024-04-25T22:52:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012470+0000", 2024-04-25T22:52:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2789999999999999e-06 2024-04-25T22:52:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012477+0000", 2024-04-25T22:52:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:52:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012500+0000", 2024-04-25T22:52:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2490999999999999e-05 2024-04-25T22:52:53.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:53.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021911+0000", 2024-04-25T22:52:53.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094114160000000006 2024-04-25T22:52:53.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:53.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022000+0000", 2024-04-25T22:52:53.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8601000000000001e-05 2024-04-25T22:52:53.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022359+0000", 2024-04-25T22:52:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035921999999999999 2024-04-25T22:52:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025541+0000", 2024-04-25T22:52:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031820619999999998 2024-04-25T22:52:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033375+0000", 2024-04-25T22:52:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078338379999999992 2024-04-25T22:52:53.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:53.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033415+0000", 2024-04-25T22:52:53.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9527000000000003e-05 2024-04-25T22:52:53.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:53.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033455+0000", 2024-04-25T22:52:53.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9932000000000003e-05 2024-04-25T22:52:53.413 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:53.413 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:53.413 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:53.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.413 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:53.413 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:53.413 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 60.357000263000003, 2024-04-25T22:52:53.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021043857999999999, 2024-04-25T22:52:53.414 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:53.414 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:53.414 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:53.414 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:53.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:53.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012523+0000", 2024-04-25T22:52:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.361e-06 2024-04-25T22:52:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:53.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012530+0000", 2024-04-25T22:52:53.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5440000000000004e-06 2024-04-25T22:52:53.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:53.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012541+0000", 2024-04-25T22:52:53.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1745e-05 2024-04-25T22:52:53.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:53.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012551+0000", 2024-04-25T22:52:53.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5789999999999993e-06 2024-04-25T22:52:53.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022709+0000", 2024-04-25T22:52:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010157685 2024-04-25T22:52:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022957+0000", 2024-04-25T22:52:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024824599999999998 2024-04-25T22:52:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023443+0000", 2024-04-25T22:52:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048578599999999999 2024-04-25T22:52:53.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:53.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025547+0000", 2024-04-25T22:52:53.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021044789999999998 2024-04-25T22:52:53.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:53.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033509+0000", 2024-04-25T22:52:53.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0079622180000000001 2024-04-25T22:52:53.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:53.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033542+0000", 2024-04-25T22:52:53.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3018000000000001e-05 2024-04-25T22:52:53.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:53.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033566+0000", 2024-04-25T22:52:53.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3197000000000002e-05 2024-04-25T22:52:53.419 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:53.419 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:53.419 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:53.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.419 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:53.420 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:53.420 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 60.356960297999997, 2024-04-25T22:52:53.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021122696, 2024-04-25T22:52:53.420 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:53.420 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:53.420 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:53.420 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:53.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.420 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:53.420 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:53.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:53.420 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.420 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:53.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:53.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:53.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:53.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:53.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:52:53.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:53.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012566+0000", 2024-04-25T22:52:53.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-04-25T22:52:53.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:53.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012619+0000", 2024-04-25T22:52:53.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2607e-05 2024-04-25T22:52:53.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:53.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012628+0000", 2024-04-25T22:52:53.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6500000000000008e-06 2024-04-25T22:52:53.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:53.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024024+0000", 2024-04-25T22:52:53.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011396007999999999 2024-04-25T22:52:53.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:53.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024198+0000", 2024-04-25T22:52:53.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000173215 2024-04-25T22:52:53.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:53.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024447+0000", 2024-04-25T22:52:53.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024898500000000002 2024-04-25T22:52:53.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:53.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026431+0000", 2024-04-25T22:52:53.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001984923 2024-04-25T22:52:53.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.424 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:53.424 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033608+0000", 2024-04-25T22:52:53.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071768459999999997 2024-04-25T22:52:53.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.424 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:53.424 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033646+0000", 2024-04-25T22:52:53.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299000000000003e-05 2024-04-25T22:52:53.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.424 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:53.424 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033684+0000", 2024-04-25T22:52:53.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8773000000000003e-05 2024-04-25T22:52:53.425 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:53.425 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:53.425 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:53.425 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.425 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.425 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:53.425 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:53.425 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 60.356871699000003, 2024-04-25T22:52:53.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021175381, 2024-04-25T22:52:53.425 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:53.425 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:53.425 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:53.425 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:53.425 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.425 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:53.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:53.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:53.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.426 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:53.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:53.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:53.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.426 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:53.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012651+0000", 2024-04-25T22:52:53.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:52:53.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:53.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012656+0000", 2024-04-25T22:52:53.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8899999999999998e-06 2024-04-25T22:52:53.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:53.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012666+0000", 2024-04-25T22:52:53.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0346999999999999e-05 2024-04-25T22:52:53.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:53.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012675+0000", 2024-04-25T22:52:53.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9930000000000001e-06 2024-04-25T22:52:53.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:53.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025661+0000", 2024-04-25T22:52:53.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01298531 2024-04-25T22:52:53.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:53.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025757+0000", 2024-04-25T22:52:53.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5822000000000005e-05 2024-04-25T22:52:53.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:53.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025907+0000", 2024-04-25T22:52:53.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015051499999999999 2024-04-25T22:52:53.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.429 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.429 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:53.429 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026435+0000", 2024-04-25T22:52:53.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052762200000000005 2024-04-25T22:52:53.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.429 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.429 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:53.429 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033732+0000", 2024-04-25T22:52:53.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072978419999999997 2024-04-25T22:52:53.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.429 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.429 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:53.430 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033787+0000", 2024-04-25T22:52:53.430 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4703999999999997e-05 2024-04-25T22:52:53.430 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.430 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:53.430 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033826+0000", 2024-04-25T22:52:53.430 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8458999999999999e-05 2024-04-25T22:52:53.430 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:53.430 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:53.430 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:53.430 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.431 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:53.431 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:53.431 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 60.356816285000001, 2024-04-25T22:52:53.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021244174000000001, 2024-04-25T22:52:53.431 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:53.431 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:53.431 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:53.431 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:53.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.431 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:53.431 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:53.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:53.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:53.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:53.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:53.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:53.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:53.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:52:53.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:53.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012712+0000", 2024-04-25T22:52:53.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.913e-06 2024-04-25T22:52:53.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.433 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:53.433 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012722+0000", 2024-04-25T22:52:53.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2879999999999998e-06 2024-04-25T22:52:53.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.433 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:53.433 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012727+0000", 2024-04-25T22:52:53.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8429999999999998e-06 2024-04-25T22:52:53.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.433 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:53.433 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026099+0000", 2024-04-25T22:52:53.434 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013371450999999999 2024-04-25T22:52:53.434 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.434 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.434 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:53.434 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026147+0000", 2024-04-25T22:52:53.434 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7837999999999998e-05 2024-04-25T22:52:53.434 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.434 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.434 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:53.434 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026254+0000", 2024-04-25T22:52:53.434 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107314 2024-04-25T22:52:53.434 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.434 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.435 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:53.435 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026686+0000", 2024-04-25T22:52:53.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000432428 2024-04-25T22:52:53.435 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.435 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:53.435 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033873+0000", 2024-04-25T22:52:53.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071864399999999997 2024-04-25T22:52:53.435 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.435 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:53.435 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033904+0000", 2024-04-25T22:52:53.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1321e-05 2024-04-25T22:52:53.435 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:53.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033950+0000", 2024-04-25T22:52:53.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5707999999999997e-05 2024-04-25T22:52:53.436 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:53.436 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:53.436 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:53.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.436 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:53.436 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:53.436 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 60.356785899999998, 2024-04-25T22:52:53.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01096505, 2024-04-25T22:52:53.436 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:53.436 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:53.437 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:53.437 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:53.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:53.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:53.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:53.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:53.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:53.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:53.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:53.438 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012737+0000", 2024-04-25T22:52:53.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:52:53.438 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.438 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:53.438 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012739+0000", 2024-04-25T22:52:53.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-04-25T22:52:53.438 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.438 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:53.438 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012743+0000", 2024-04-25T22:52:53.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3239999999999996e-06 2024-04-25T22:52:53.438 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.439 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.439 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:53.439 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012746+0000", 2024-04-25T22:52:53.439 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.129e-06 2024-04-25T22:52:53.439 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.439 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.439 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:53.439 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012796+0000", 2024-04-25T22:52:53.439 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9231999999999999e-05 2024-04-25T22:52:53.439 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.439 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.439 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:53.439 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012915+0000", 2024-04-25T22:52:53.440 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119021 2024-04-25T22:52:53.440 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.440 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.440 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:53.440 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013069+0000", 2024-04-25T22:52:53.440 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015463900000000001 2024-04-25T22:52:53.440 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.440 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.440 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:53.440 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019237+0000", 2024-04-25T22:52:53.441 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061680329999999998 2024-04-25T22:52:53.441 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.441 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.441 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:53.441 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023603+0000", 2024-04-25T22:52:53.441 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043655860000000003 2024-04-25T22:52:53.441 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.441 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.441 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:53.442 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023659+0000", 2024-04-25T22:52:53.442 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6484000000000003e-05 2024-04-25T22:52:53.442 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.442 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.442 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:53.442 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023701+0000", 2024-04-25T22:52:53.442 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1761999999999998e-05 2024-04-25T22:52:53.442 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:53.442 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:53.443 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:53.443 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.443 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.443 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:53.443 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:53.443 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 60.356760952000002, 2024-04-25T22:52:53.443 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011234429000000001, 2024-04-25T22:52:53.443 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:53.443 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:53.443 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:53.443 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:53.443 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.443 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:53.443 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:53.444 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:53.444 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.444 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.444 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:53.444 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:53.444 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:53.444 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.444 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.444 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:53.444 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012762+0000", 2024-04-25T22:52:53.444 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-04-25T22:52:53.444 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.444 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.444 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:53.445 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012765+0000", 2024-04-25T22:52:53.445 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2569999999999999e-06 2024-04-25T22:52:53.445 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.445 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.445 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:53.445 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012783+0000", 2024-04-25T22:52:53.445 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8431999999999999e-05 2024-04-25T22:52:53.445 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.445 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.445 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:53.445 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012799+0000", 2024-04-25T22:52:53.445 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5438999999999999e-05 2024-04-25T22:52:53.445 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.445 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.446 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:53.446 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013826+0000", 2024-04-25T22:52:53.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010275060000000001 2024-04-25T22:52:53.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.446 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.446 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:53.446 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013913+0000", 2024-04-25T22:52:53.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.708e-05 2024-04-25T22:52:53.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.446 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.446 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:53.446 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014098+0000", 2024-04-25T22:52:53.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018519399999999999 2024-04-25T22:52:53.447 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.447 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.447 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:53.447 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019684+0000", 2024-04-25T22:52:53.447 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055860079999999999 2024-04-25T22:52:53.447 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.447 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.447 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:53.447 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023876+0000", 2024-04-25T22:52:53.447 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041918800000000003 2024-04-25T22:52:53.447 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.447 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.447 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:53.447 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023957+0000", 2024-04-25T22:52:53.448 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1165e-05 2024-04-25T22:52:53.448 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.448 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.448 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:53.448 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023995+0000", 2024-04-25T22:52:53.448 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:52:53.448 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:53.448 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:53.448 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:53.448 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.448 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.448 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:53.448 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:53.448 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 60.356663173000001, 2024-04-25T22:52:53.449 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011131200000000001, 2024-04-25T22:52:53.449 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:53.449 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:53.449 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:53.449 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:53.449 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.449 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:53.449 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:53.449 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:53.449 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.449 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.449 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:53.449 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:53.449 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:53.450 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.450 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.450 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:53.450 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012860+0000", 2024-04-25T22:52:53.450 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3900000000000004e-07 2024-04-25T22:52:53.450 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.450 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.450 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:53.450 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012865+0000", 2024-04-25T22:52:53.450 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5609999999999998e-06 2024-04-25T22:52:53.450 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.450 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.450 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:53.451 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012895+0000", 2024-04-25T22:52:53.451 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9847000000000001e-05 2024-04-25T22:52:53.451 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.451 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.451 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:53.451 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012905+0000", 2024-04-25T22:52:53.451 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.03e-05 2024-04-25T22:52:53.452 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.452 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.452 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:53.452 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015020+0000", 2024-04-25T22:52:53.452 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021142940000000001 2024-04-25T22:52:53.452 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.452 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.452 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:53.453 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015182+0000", 2024-04-25T22:52:53.453 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016248099999999999 2024-04-25T22:52:53.453 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.453 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.453 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:52:53.453 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015357+0000", 2024-04-25T22:52:53.453 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017471000000000001 2024-04-25T22:52:53.453 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.453 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.453 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:53.453 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021021+0000", 2024-04-25T22:52:53.453 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056638340000000004 2024-04-25T22:52:53.453 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.453 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.454 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:53.454 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023712+0000", 2024-04-25T22:52:53.454 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026910380000000002 2024-04-25T22:52:53.454 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.454 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.454 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:53.454 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023763+0000", 2024-04-25T22:52:53.454 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1477999999999997e-05 2024-04-25T22:52:53.454 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.454 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.454 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:53.454 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023990+0000", 2024-04-25T22:52:53.454 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000226818 2024-04-25T22:52:53.455 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:53.455 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:53.455 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:53.455 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.455 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.455 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:53.455 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:53.455 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 60.356540076999998, 2024-04-25T22:52:53.455 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011705299000000001, 2024-04-25T22:52:53.455 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:53.455 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:53.455 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:53.455 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:53.455 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.456 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:53.456 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:53.456 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:53.456 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.456 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.456 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:53.456 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:53.456 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:53.456 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.456 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.456 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:53.456 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012983+0000", 2024-04-25T22:52:53.457 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:52:53.457 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.457 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.457 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:53.457 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012986+0000", 2024-04-25T22:52:53.457 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5700000000000001e-06 2024-04-25T22:52:53.457 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.457 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.457 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:53.458 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012993+0000", 2024-04-25T22:52:53.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8730000000000001e-06 2024-04-25T22:52:53.458 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.458 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:53.458 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013000+0000", 2024-04-25T22:52:53.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1890000000000001e-06 2024-04-25T22:52:53.458 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.459 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:53.459 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:52:53.459 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002147866 2024-04-25T22:52:53.459 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.459 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.459 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:53.459 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015351+0000", 2024-04-25T22:52:53.459 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020300799999999999 2024-04-25T22:52:53.459 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.459 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.459 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:53.460 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016260+0000", 2024-04-25T22:52:53.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00090926799999999997 2024-04-25T22:52:53.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.460 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.460 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:53.460 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022669+0000", 2024-04-25T22:52:53.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064082849999999997 2024-04-25T22:52:53.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.460 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.460 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:53.460 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024584+0000", 2024-04-25T22:52:53.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019151699999999999 2024-04-25T22:52:53.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.461 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:53.461 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024643+0000", 2024-04-25T22:52:53.461 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8888999999999998e-05 2024-04-25T22:52:53.461 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.461 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:53.461 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024687+0000", 2024-04-25T22:52:53.461 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4444999999999999e-05 2024-04-25T22:52:53.461 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:53.461 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:53.461 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:53.461 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.462 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:53.462 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:53.462 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 60.356512486, 2024-04-25T22:52:53.462 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011249699, 2024-04-25T22:52:53.462 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:53.462 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:53.462 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:53.462 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:53.462 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.462 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:53.462 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:53.462 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:53.462 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.462 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.463 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:53.463 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:53.463 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:53.463 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.463 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.463 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:53.463 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013010+0000", 2024-04-25T22:52:53.463 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2099999999999996e-07 2024-04-25T22:52:53.463 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.463 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.463 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:53.463 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013013+0000", 2024-04-25T22:52:53.463 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1310000000000002e-06 2024-04-25T22:52:53.463 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.464 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.464 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:53.464 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013020+0000", 2024-04-25T22:52:53.464 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3330000000000002e-06 2024-04-25T22:52:53.464 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.464 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.464 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:53.464 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013025+0000", 2024-04-25T22:52:53.464 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6760000000000004e-06 2024-04-25T22:52:53.464 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.464 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.464 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:53.464 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013163+0000", 2024-04-25T22:52:53.465 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013824599999999999 2024-04-25T22:52:53.465 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.465 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.465 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:53.465 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013504+0000", 2024-04-25T22:52:53.465 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034080299999999998 2024-04-25T22:52:53.465 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.465 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.465 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:53.465 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013613+0000", 2024-04-25T22:52:53.465 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108705 2024-04-25T22:52:53.465 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.465 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.466 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:53.466 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015831+0000", 2024-04-25T22:52:53.466 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002217672 2024-04-25T22:52:53.466 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.466 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.466 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:53.466 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024137+0000", 2024-04-25T22:52:53.467 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0083060489999999994 2024-04-25T22:52:53.467 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.467 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.467 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:53.467 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024218+0000", 2024-04-25T22:52:53.467 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1351000000000001e-05 2024-04-25T22:52:53.468 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.468 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.468 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:53.468 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024259+0000", 2024-04-25T22:52:53.468 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1112000000000002e-05 2024-04-25T22:52:53.468 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:53.469 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:53.469 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:53.469 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.469 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.469 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:53.469 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:53.469 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 60.356424760000003, 2024-04-25T22:52:53.469 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020379749999999999, 2024-04-25T22:52:53.469 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:53.469 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:53.470 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:53.470 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:53.470 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.470 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:53.470 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:53.470 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:53.470 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.471 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.471 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:53.471 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:53.471 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:53.471 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.471 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.471 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:53.471 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013098+0000", 2024-04-25T22:52:53.471 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:52:53.471 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.472 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.472 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:53.472 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013105+0000", 2024-04-25T22:52:53.472 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5969999999999997e-06 2024-04-25T22:52:53.472 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.472 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.472 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:53.472 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013190+0000", 2024-04-25T22:52:53.472 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5618999999999995e-05 2024-04-25T22:52:53.472 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.472 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.472 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:53.472 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013200+0000", 2024-04-25T22:52:53.472 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5859999999999994e-06 2024-04-25T22:52:53.473 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.473 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.473 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:53.473 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020265+0000", 2024-04-25T22:52:53.473 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070653349999999998 2024-04-25T22:52:53.473 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.473 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.473 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:53.474 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020454+0000", 2024-04-25T22:52:53.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189316 2024-04-25T22:52:53.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.474 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:53.474 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020586+0000", 2024-04-25T22:52:53.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013195700000000001 2024-04-25T22:52:53.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.474 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:53.474 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023822+0000", 2024-04-25T22:52:53.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032358529999999999 2024-04-25T22:52:53.475 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.475 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.475 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:53.475 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033409+0000", 2024-04-25T22:52:53.475 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095870520000000004 2024-04-25T22:52:53.475 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.475 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.475 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:53.475 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033447+0000", 2024-04-25T22:52:53.475 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7261999999999997e-05 2024-04-25T22:52:53.475 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.475 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.475 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:53.476 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033477+0000", 2024-04-25T22:52:53.476 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0389e-05 2024-04-25T22:52:53.476 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:53.476 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:53.476 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:53.476 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.476 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.476 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:53.476 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:53.476 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 60.356308253999998, 2024-04-25T22:52:53.476 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010857383999999999, 2024-04-25T22:52:53.476 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:53.476 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:53.476 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:53.477 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:53.477 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.477 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:53.477 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:53.477 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:53.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.477 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.477 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:53.477 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:53.477 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:53.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.477 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.477 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:53.477 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:53.478 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:52:53.478 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.478 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.478 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:53.478 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013218+0000", 2024-04-25T22:52:53.478 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8199999999999998e-06 2024-04-25T22:52:53.478 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.478 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.478 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:53.478 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013226+0000", 2024-04-25T22:52:53.478 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7649999999999993e-06 2024-04-25T22:52:53.478 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.478 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.478 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:53.479 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013259+0000", 2024-04-25T22:52:53.479 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2727e-05 2024-04-25T22:52:53.479 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.479 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.479 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:53.479 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014809+0000", 2024-04-25T22:52:53.479 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001550144 2024-04-25T22:52:53.479 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.479 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.479 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:53.479 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014958+0000", 2024-04-25T22:52:53.479 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014890300000000001 2024-04-25T22:52:53.479 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.480 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.480 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:52:53.480 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015087+0000", 2024-04-25T22:52:53.480 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012939200000000001 2024-04-25T22:52:53.480 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.480 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.480 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:53.480 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020212+0000", 2024-04-25T22:52:53.480 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051248939999999996 2024-04-25T22:52:53.480 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.480 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.480 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:53.481 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023699+0000", 2024-04-25T22:52:53.481 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034873289999999999 2024-04-25T22:52:53.481 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.481 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.481 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:53.481 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024014+0000", 2024-04-25T22:52:53.481 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031473999999999999 2024-04-25T22:52:53.481 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.481 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.481 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:53.481 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024071+0000", 2024-04-25T22:52:53.482 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7040000000000003e-05 2024-04-25T22:52:53.482 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:53.482 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:53.482 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:53.482 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.482 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.482 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:53.482 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:53.482 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 60.356253549000002, 2024-04-25T22:52:53.482 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012329677000000001, 2024-04-25T22:52:53.482 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:53.482 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:53.483 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:53.483 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:53.483 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.483 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:53.483 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:53.483 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:53.483 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.483 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.483 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:53.483 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:53.483 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:53.483 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.483 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.483 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:53.483 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013269+0000", 2024-04-25T22:52:53.484 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5000000000000002e-07 2024-04-25T22:52:53.484 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.484 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.484 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:53.484 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:52:53.484 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6909999999999999e-06 2024-04-25T22:52:53.484 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.484 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.484 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:53.485 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013284+0000", 2024-04-25T22:52:53.485 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0963e-05 2024-04-25T22:52:53.485 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.485 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.485 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:53.485 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013361+0000", 2024-04-25T22:52:53.485 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7379999999999994e-05 2024-04-25T22:52:53.485 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.485 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.485 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:53.485 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013448+0000", 2024-04-25T22:52:53.486 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6990000000000006e-05 2024-04-25T22:52:53.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.486 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.486 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:53.486 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013632+0000", 2024-04-25T22:52:53.486 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018396800000000001 2024-04-25T22:52:53.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.486 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.486 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:53.486 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013800+0000", 2024-04-25T22:52:53.486 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167467 2024-04-25T22:52:53.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.486 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.487 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:53.487 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.018570+0000", 2024-04-25T22:52:53.487 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047701460000000003 2024-04-25T22:52:53.487 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.487 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.487 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:53.487 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025507+0000", 2024-04-25T22:52:53.487 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069372039999999998 2024-04-25T22:52:53.487 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.487 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.487 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:53.487 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025562+0000", 2024-04-25T22:52:53.487 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4858999999999998e-05 2024-04-25T22:52:53.487 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.488 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.488 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:53.488 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025598+0000", 2024-04-25T22:52:53.488 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6259e-05 2024-04-25T22:52:53.488 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:53.488 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:53.488 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:53.488 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.488 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.488 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:53.488 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:53.488 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 60.356121676000001, 2024-04-25T22:52:53.488 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020176666999999999, 2024-04-25T22:52:53.488 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:53.489 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:53.489 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:52:53.489 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:53.489 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.489 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:53.489 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:53.489 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:53.489 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.489 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.489 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:53.489 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:53.489 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:53.489 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.489 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.490 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:53.490 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:52:53.490 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-04-25T22:52:53.490 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.490 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.490 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:53.490 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013405+0000", 2024-04-25T22:52:53.490 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0559999999999998e-06 2024-04-25T22:52:53.490 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.490 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.490 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:53.490 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013422+0000", 2024-04-25T22:52:53.490 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6770999999999999e-05 2024-04-25T22:52:53.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.491 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:53.491 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013431+0000", 2024-04-25T22:52:53.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5019999999999998e-06 2024-04-25T22:52:53.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.491 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:53.491 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021720+0000", 2024-04-25T22:52:53.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082884340000000008 2024-04-25T22:52:53.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.491 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:53.491 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022122+0000", 2024-04-25T22:52:53.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000401634 2024-04-25T22:52:53.492 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:53.492 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:53.492 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:53.492 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033577+0000", 2024-04-25T22:52:53.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011455435999999999 2024-04-25T22:52:53.492 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:53.492 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:53.492 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:53.492 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:53.492 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:53.492 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:53.494 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:52:53.494 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:53.493+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:53.595 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:53.593+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:53.599 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:53.599 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:52:53.599 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-25T22:52:53.599 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:53.607 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:52:53.663 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:52:53.695 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:53.695+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:53.750 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:53.750 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:52:53.750 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-25T22:52:53.750 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-25T22:52:53.751 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:53.759 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:52:53.789 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-25T22:52:53.789 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:52:53.789 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:52:53.796 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:53.796+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:53.809 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-25T22:52:53.809 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:52:53.812 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:52:53.812 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:52:53.863 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:53.863 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:53.872 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:52:53.897 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:53.896+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:53.978 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:53.979 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:53.988 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:52:53.998 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:53.998+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:54.091 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:54.091 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:54.099 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:52:54.100 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:54.098+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:54.162 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is set 2024-04-25T22:52:54.200 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:54.199+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:54.201 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:54.202 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:54.211 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:52:54.300 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:54.299+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:54.313 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:54.314 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:54.322 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:52:54.401 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:54.400+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:54.465 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:54.466 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:54.474 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:52:54.518 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:54.517+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:54.576 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:54.576 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:54.585 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:52:54.629 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:54.628+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:54.689 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:54.689 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:54.697 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:52:54.739 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:54.738+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:54.805 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:54.804+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:54.841 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:54.841 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:54.850 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:52:54.934 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:54.933+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:54.991 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:54.992 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:55.000 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:52:55.015 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~12s 2024-04-25T22:52:55.044 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:55.043+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:55.105 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:55.105 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:55.106 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:55.105+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:55.113 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:52:55.207 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:55.207+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:55.255 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:55.256 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:55.264 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:52:55.308 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:55.307+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:55.365 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:55.365 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:55.374 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:52:55.418 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:55.417+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:55.480 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:55.480 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:55.489 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:52:55.510 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:55.509+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:55.610 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:55.609+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:55.632 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:55.632 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:55.641 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:52:55.711 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:55.711+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:55.714 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2024-04-25T22:52:55.714 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-25T22:52:55.714 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-04-25T22:52:55.714 INFO:tasks.thrashosds.thrasher:Setting osd 0 primary_affinity to 0.621584 2024-04-25T22:52:55.714 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 0.6215835690846694 2024-04-25T22:52:55.744 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:55.744 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:55.754 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:52:55.812 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:55.812+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:55.813 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:52:55.857 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:55.857 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:55.866 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:52:55.913 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:55.912+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:55.947 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-25T22:52:55.948 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:52:55.948 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:52:55.967 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:55.968 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:55.969 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-25T22:52:55.969 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:52:55.974 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:52:55.974 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:52:55.976 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:52:56.020 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:56.019+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:56.082 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:56.082 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:52:56.082 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:52:56.082 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:52:56.082 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.082 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:52:56.082 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:52:56.082 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 68.113217425000002, 2024-04-25T22:52:56.082 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:52:56.082 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:56.082 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:56.083 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:56.083 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:56.083 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.083 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:56.083 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:52:56.083 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:56.083 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.083 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.083 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:56.083 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:52:56.083 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:56.083 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.083 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.083 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:56.084 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:52:56.084 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:52:56.084 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.084 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.084 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:56.084 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:52:56.084 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:52:56.084 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.084 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.084 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:56.084 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:52:56.084 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:52:56.084 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.084 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.084 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:56.085 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:52:56.085 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:52:56.085 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.085 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.085 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:56.085 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:52:56.085 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:52:56.085 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.085 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.085 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:56.085 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:52:56.085 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:52:56.085 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.085 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.085 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:56.086 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:52:56.086 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:52:56.086 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.086 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.086 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:56.086 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:52:56.086 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:52:56.086 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:56.086 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:56.086 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:56.086 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.086 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.086 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:110 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'72, mlcod=10'68)", 2024-04-25T22:52:56.086 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:56.087 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 68.112583424999997, 2024-04-25T22:52:56.087 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065316630000000001, 2024-04-25T22:52:56.087 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:56.087 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:56.087 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:56.087 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:56.087 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.087 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:56.087 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:56.087 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:56.087 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.087 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.087 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:56.088 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:56.088 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:56.088 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.088 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.088 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:56.088 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:56.088 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.58e-07 2024-04-25T22:52:56.088 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.088 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.088 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:56.088 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967811+0000", 2024-04-25T22:52:56.088 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.118e-06 2024-04-25T22:52:56.088 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.088 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.089 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:56.089 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967817+0000", 2024-04-25T22:52:56.089 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3709999999999996e-06 2024-04-25T22:52:56.089 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.089 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.089 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:56.089 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967820+0000", 2024-04-25T22:52:56.089 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2210000000000002e-06 2024-04-25T22:52:56.089 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.089 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.089 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:56.089 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967876+0000", 2024-04-25T22:52:56.089 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5507000000000002e-05 2024-04-25T22:52:56.089 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.089 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.090 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:56.090 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967893+0000", 2024-04-25T22:52:56.090 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7812000000000002e-05 2024-04-25T22:52:56.090 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.090 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.090 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:56.090 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974317+0000", 2024-04-25T22:52:56.090 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064237160000000003 2024-04-25T22:52:56.090 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.090 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.090 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:56.090 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:52:56.090 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.156e-05 2024-04-25T22:52:56.091 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:56.091 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:56.091 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:56.091 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.091 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.091 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'68)", 2024-04-25T22:52:56.091 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:56.091 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 68.112165911999995, 2024-04-25T22:52:56.091 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061292279999999996, 2024-04-25T22:52:56.091 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:56.091 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:56.091 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:56.091 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:56.091 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.092 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:56.092 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:56.092 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:56.092 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.092 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.092 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:56.092 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:56.092 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:56.092 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.092 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.092 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:56.092 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:56.092 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6300000000000001e-07 2024-04-25T22:52:56.092 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.092 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.092 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:56.093 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968228+0000", 2024-04-25T22:52:56.093 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6139999999999999e-06 2024-04-25T22:52:56.093 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.093 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.093 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:56.093 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968235+0000", 2024-04-25T22:52:56.093 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7020000000000001e-06 2024-04-25T22:52:56.093 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.093 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.093 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:56.094 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968238+0000", 2024-04-25T22:52:56.094 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0010000000000002e-06 2024-04-25T22:52:56.094 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.094 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.094 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:56.094 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968297+0000", 2024-04-25T22:52:56.094 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8424999999999997e-05 2024-04-25T22:52:56.094 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.094 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.094 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:56.094 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968316+0000", 2024-04-25T22:52:56.094 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8814999999999999e-05 2024-04-25T22:52:56.094 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.094 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.095 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:56.095 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:52:56.095 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060239439999999998 2024-04-25T22:52:56.095 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.095 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.095 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:56.095 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974354+0000", 2024-04-25T22:52:56.095 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4364e-05 2024-04-25T22:52:56.095 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:56.095 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:56.095 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:56.095 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.095 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.095 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'68)", 2024-04-25T22:52:56.095 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:56.096 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 68.111728909999997, 2024-04-25T22:52:56.096 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005948414, 2024-04-25T22:52:56.096 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:56.096 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:56.096 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:56.096 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:56.096 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.096 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:56.096 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:56.096 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:56.096 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.096 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.096 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:56.097 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:56.097 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:56.097 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.097 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.097 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:56.097 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:56.097 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6199999999999998e-07 2024-04-25T22:52:56.097 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.097 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.097 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:56.097 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968723+0000", 2024-04-25T22:52:56.097 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1148999999999993e-05 2024-04-25T22:52:56.098 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.098 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.098 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:56.098 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968730+0000", 2024-04-25T22:52:56.098 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1749999999999999e-06 2024-04-25T22:52:56.098 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.098 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.098 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:56.098 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968734+0000", 2024-04-25T22:52:56.098 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5200000000000002e-06 2024-04-25T22:52:56.098 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.098 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.098 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:56.099 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968771+0000", 2024-04-25T22:52:56.099 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6851999999999999e-05 2024-04-25T22:52:56.099 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.099 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.099 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:56.099 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968788+0000", 2024-04-25T22:52:56.099 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7027000000000001e-05 2024-04-25T22:52:56.099 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.099 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.099 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:56.099 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974589+0000", 2024-04-25T22:52:56.099 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058013320000000002 2024-04-25T22:52:56.099 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.099 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.100 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:56.100 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974610+0000", 2024-04-25T22:52:56.100 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0897e-05 2024-04-25T22:52:56.100 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:56.100 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:56.100 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:56.100 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.100 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.100 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'68)", 2024-04-25T22:52:56.100 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:56.100 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 68.111158900000007, 2024-04-25T22:52:56.100 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053935750000000003, 2024-04-25T22:52:56.100 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:56.100 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:56.100 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:56.101 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:56.101 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.101 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:56.101 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:56.101 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:56.101 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.101 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.101 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:56.101 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:56.101 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:56.101 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.101 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.101 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:56.101 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:56.101 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.03e-07 2024-04-25T22:52:56.102 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.102 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.102 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:56.102 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969235+0000", 2024-04-25T22:52:56.102 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2399999999999999e-06 2024-04-25T22:52:56.102 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.102 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.102 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:56.102 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969242+0000", 2024-04-25T22:52:56.102 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1269999999999997e-06 2024-04-25T22:52:56.102 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.102 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.102 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:56.103 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969246+0000", 2024-04-25T22:52:56.103 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3840000000000001e-06 2024-04-25T22:52:56.103 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.103 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.103 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:56.103 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969278+0000", 2024-04-25T22:52:56.103 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1868e-05 2024-04-25T22:52:56.103 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.103 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.103 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:56.103 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969295+0000", 2024-04-25T22:52:56.103 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7530999999999999e-05 2024-04-25T22:52:56.103 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.104 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.104 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:56.104 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974611+0000", 2024-04-25T22:52:56.104 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053160789999999996 2024-04-25T22:52:56.104 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.104 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.104 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:56.104 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974625+0000", 2024-04-25T22:52:56.104 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3943e-05 2024-04-25T22:52:56.104 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:56.104 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:56.104 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:56.104 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.105 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.105 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-25T22:52:56.105 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:56.105 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 67.917562992000001, 2024-04-25T22:52:56.105 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054952610000000004, 2024-04-25T22:52:56.105 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:56.105 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:56.105 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:56.105 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:56.105 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.105 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:56.105 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:56.105 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:56.105 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.105 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.106 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:56.106 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:56.106 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:56.106 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.106 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.106 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:56.106 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:56.106 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.68e-07 2024-04-25T22:52:56.106 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.106 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.106 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:56.106 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162898+0000", 2024-04-25T22:52:56.106 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9470999999999999e-05 2024-04-25T22:52:56.107 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.107 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.107 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:56.107 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162906+0000", 2024-04-25T22:52:56.107 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1580000000000005e-06 2024-04-25T22:52:56.107 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.107 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.107 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:56.107 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162911+0000", 2024-04-25T22:52:56.107 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4779999999999999e-06 2024-04-25T22:52:56.107 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.107 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.107 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:56.107 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162952+0000", 2024-04-25T22:52:56.108 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0629e-05 2024-04-25T22:52:56.108 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.108 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.108 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:56.108 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162968+0000", 2024-04-25T22:52:56.108 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6239000000000002e-05 2024-04-25T22:52:56.108 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.108 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.108 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:56.108 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168281+0000", 2024-04-25T22:52:56.108 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053132869999999999 2024-04-25T22:52:56.108 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.108 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.108 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:56.109 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168323+0000", 2024-04-25T22:52:56.109 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1430999999999997e-05 2024-04-25T22:52:56.109 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:56.109 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:56.109 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:56.109 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.109 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.109 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-04-25T22:52:56.109 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:56.109 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 67.487085629999996, 2024-04-25T22:52:56.109 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050872510000000001, 2024-04-25T22:52:56.109 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:56.109 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:56.109 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:56.109 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:56.110 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.110 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:56.110 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:56.110 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:56.110 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.110 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.110 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:56.110 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:56.110 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:56.110 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.110 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.110 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:56.110 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:56.110 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.72e-07 2024-04-25T22:52:56.111 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.111 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.111 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:56.111 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593381+0000", 2024-04-25T22:52:56.111 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5797000000000006e-05 2024-04-25T22:52:56.111 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.111 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.111 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:56.111 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593389+0000", 2024-04-25T22:52:56.111 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8480000000000001e-06 2024-04-25T22:52:56.111 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.111 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.111 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:56.111 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593393+0000", 2024-04-25T22:52:56.112 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4819999999999996e-06 2024-04-25T22:52:56.112 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.112 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.112 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:56.112 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593435+0000", 2024-04-25T22:52:56.112 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1600000000000002e-05 2024-04-25T22:52:56.112 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.112 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.112 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:56.112 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593454+0000", 2024-04-25T22:52:56.112 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8868e-05 2024-04-25T22:52:56.112 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.112 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.113 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:56.113 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598350+0000", 2024-04-25T22:52:56.113 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004895763 2024-04-25T22:52:56.113 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.113 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.113 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:56.113 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598392+0000", 2024-04-25T22:52:56.113 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2521000000000002e-05 2024-04-25T22:52:56.113 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:56.113 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:56.113 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:56.113 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.113 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.113 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:56.114 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:52:56.114 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 63.068721726, 2024-04-25T22:52:56.114 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:52:56.114 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:56.114 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:56.114 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:56.114 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:56.114 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.114 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:56.114 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:52:56.114 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:56.114 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.114 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.115 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:56.115 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:52:56.115 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:56.115 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.115 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.115 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:56.115 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:52:56.115 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:52:56.115 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.115 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.115 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:56.115 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:52:56.115 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:52:56.115 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.116 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.116 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:56.116 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:52:56.116 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:52:56.116 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.116 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.116 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:56.116 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:52:56.116 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:52:56.116 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.116 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.116 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:56.116 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:52:56.116 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:52:56.117 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.117 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.117 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:56.117 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:52:56.117 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:52:56.117 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.117 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.117 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:56.117 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:52:56.117 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:52:56.117 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.117 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.117 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:56.117 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:52:56.117 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:52:56.118 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.118 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.118 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:56.118 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:52:56.118 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:52:56.118 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.118 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.118 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:56.118 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:52:56.118 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:52:56.118 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.118 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.118 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:56.119 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:52:56.119 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:52:56.119 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:56.119 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:56.119 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:56.119 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.119 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.119 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:56.119 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:52:56.119 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 63.068047350000001, 2024-04-25T22:52:56.119 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:52:56.119 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:56.120 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:56.120 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:56.120 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:56.120 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.120 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:56.120 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:52:56.120 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:56.120 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.120 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.120 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:56.120 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:52:56.120 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:56.120 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.120 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.121 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:56.121 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:52:56.121 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:52:56.121 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.121 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.121 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:56.121 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:52:56.121 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:52:56.121 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.121 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.121 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:56.121 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:52:56.121 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:52:56.121 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.122 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.122 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:56.122 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:52:56.122 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:52:56.122 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.122 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.122 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:56.122 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:52:56.122 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:52:56.122 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.122 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.122 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:56.122 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:52:56.123 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:52:56.123 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.123 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.123 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:56.123 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:52:56.123 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:52:56.123 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.123 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.123 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:56.123 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:52:56.123 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:52:56.123 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.123 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.123 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:56.124 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:52:56.124 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:52:56.124 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.124 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.124 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:56.124 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:52:56.124 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:52:56.124 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.124 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.124 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:56.124 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:52:56.124 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:52:56.124 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:56.124 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:56.125 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:56.125 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.125 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.125 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:56.125 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:52:56.125 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 63.067538138000003, 2024-04-25T22:52:56.125 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:52:56.125 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:56.125 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:56.125 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:56.125 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:56.125 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.126 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:56.126 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:52:56.126 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:56.126 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.126 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.126 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:56.126 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:52:56.126 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:56.126 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.126 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.126 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:56.126 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:52:56.126 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:52:56.126 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.127 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.127 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:56.127 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:52:56.127 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:52:56.127 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.127 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.127 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:56.127 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:52:56.127 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:52:56.127 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.127 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.127 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:56.127 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:52:56.127 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:52:56.128 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.128 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.128 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:56.128 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:52:56.128 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:52:56.128 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.128 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.128 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:56.128 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:52:56.128 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:52:56.128 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.128 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.128 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:56.128 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:52:56.129 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:52:56.129 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.129 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.129 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:56.129 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:52:56.129 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:52:56.129 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.129 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.129 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:56.129 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:52:56.129 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:52:56.129 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.129 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.129 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:56.130 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:52:56.130 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:52:56.130 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.130 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.130 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:56.130 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:52:56.130 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:52:56.130 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:56.130 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:56.130 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:56.130 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.130 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.130 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:56.130 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:56.131 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 63.067124939999999, 2024-04-25T22:52:56.131 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:52:56.131 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:56.131 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:56.131 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:56.131 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:56.131 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.131 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:56.131 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:56.131 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:56.131 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.131 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.131 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:56.131 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:56.131 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:56.132 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.132 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.132 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:56.132 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:56.132 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:52:56.132 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.132 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.132 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:56.132 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:52:56.132 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:52:56.132 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.132 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.132 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:56.132 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:52:56.133 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:52:56.133 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.133 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.133 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:56.133 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:52:56.133 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:52:56.133 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.133 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.133 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:56.133 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:52:56.133 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:52:56.133 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.133 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.133 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:56.134 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:52:56.134 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:52:56.134 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.134 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.134 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:56.134 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:52:56.134 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:52:56.134 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.134 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.134 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:56.134 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:52:56.134 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:52:56.134 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.135 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.135 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:56.135 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:52:56.135 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:52:56.135 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.135 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.135 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:56.135 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:52:56.135 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:52:56.135 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.135 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.135 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:56.135 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:52:56.135 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:52:56.136 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:56.136 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:56.136 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:56.136 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.136 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.136 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:56.136 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:52:56.136 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 63.067074269999999, 2024-04-25T22:52:56.136 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:52:56.136 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:56.136 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:56.136 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:56.136 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:56.136 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.137 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:56.137 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:52:56.137 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:56.137 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.137 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.137 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:56.137 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:52:56.137 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:56.137 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.137 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.137 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:56.137 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:52:56.137 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:52:56.137 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.138 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.138 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:56.138 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:52:56.138 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:52:56.138 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.138 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.138 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:56.138 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:52:56.138 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:52:56.138 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.138 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.138 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:56.138 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:52:56.138 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:52:56.139 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.139 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.139 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:56.139 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:52:56.139 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:52:56.139 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.139 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.139 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:52:56.139 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:52:56.139 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:52:56.139 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.139 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.139 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:56.140 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:52:56.140 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:52:56.140 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.140 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.140 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:56.140 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:52:56.140 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:52:56.140 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.140 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.140 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:56.140 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:52:56.140 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:52:56.140 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.140 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.141 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:56.141 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:52:56.141 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:52:56.141 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.141 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.141 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:56.141 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:52:56.141 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:52:56.141 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.141 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.141 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:56.141 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:52:56.141 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:52:56.142 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.142 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.142 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:56.142 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:52:56.142 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:52:56.142 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:56.142 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:56.142 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:56.142 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.142 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.142 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:56.142 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:52:56.142 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 63.067037401, 2024-04-25T22:52:56.142 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:52:56.143 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:56.143 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:56.143 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:56.143 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:56.143 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.143 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:56.143 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:52:56.143 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:56.143 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.143 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.143 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:56.143 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:52:56.143 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:56.144 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.144 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.144 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:56.144 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:52:56.144 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:52:56.144 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.144 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.144 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:56.144 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:52:56.144 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:52:56.144 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.144 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.144 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:56.144 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:52:56.144 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:52:56.145 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.145 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.145 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:56.145 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:52:56.145 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:52:56.145 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.145 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.145 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:56.145 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:52:56.145 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:52:56.145 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.145 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.145 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:52:56.146 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:52:56.146 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:52:56.146 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.146 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.146 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:56.146 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:52:56.146 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:52:56.146 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.146 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.146 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:56.146 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:52:56.146 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:52:56.146 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.146 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.147 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:56.147 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:52:56.147 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:52:56.147 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.147 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.147 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:56.147 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:52:56.147 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:52:56.147 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.147 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.147 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:56.147 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:52:56.147 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:52:56.147 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.147 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.148 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:56.148 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:52:56.148 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:52:56.148 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.148 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.148 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:56.148 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:52:56.148 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:52:56.148 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:56.148 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:56.148 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:56.148 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.148 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.149 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:56.149 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:52:56.149 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 63.067012435000002, 2024-04-25T22:52:56.149 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:52:56.149 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:56.149 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:56.149 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:56.149 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:56.149 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.149 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:56.149 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:52:56.149 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:56.149 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.149 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.150 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:56.150 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:52:56.150 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:56.150 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.150 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.150 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:56.150 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:52:56.150 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:52:56.150 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.150 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.150 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:56.150 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:52:56.150 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:52:56.150 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.151 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.151 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:56.151 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:52:56.151 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:52:56.151 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.151 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.151 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:56.151 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:52:56.151 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:52:56.151 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.151 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.151 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:56.151 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:52:56.151 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:52:56.152 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.152 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.152 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:56.152 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:52:56.152 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:52:56.152 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.152 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.152 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:56.152 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:52:56.152 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:52:56.152 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.152 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.152 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:56.152 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:52:56.153 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:52:56.153 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.153 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.153 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:56.153 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:52:56.153 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:52:56.153 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.153 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.153 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:56.153 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:52:56.153 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:52:56.153 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.153 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.153 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:56.154 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:52:56.154 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:52:56.154 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:56.154 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:56.154 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:56.154 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.154 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.154 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:56.154 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:52:56.154 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 63.066976070999999, 2024-04-25T22:52:56.154 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:52:56.154 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:56.154 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:56.154 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:52:56.155 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:56.155 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.155 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:56.155 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:52:56.155 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:56.155 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.155 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.155 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:56.155 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:52:56.155 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:56.155 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.155 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.155 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:56.156 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:52:56.156 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:52:56.156 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.156 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.156 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:56.156 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:52:56.156 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:52:56.156 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.156 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.156 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:56.156 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:52:56.156 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:52:56.156 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.156 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.157 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:56.157 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:52:56.157 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:52:56.157 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.157 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.157 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:56.157 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:52:56.157 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:52:56.157 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.157 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.157 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:52:56.157 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:52:56.157 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:52:56.157 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.157 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.158 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:56.158 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:52:56.158 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:52:56.158 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.158 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.158 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:56.158 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:52:56.158 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:52:56.158 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.158 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.158 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:56.158 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:52:56.158 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:52:56.159 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:56.159 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:56.159 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:56.159 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.159 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.159 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:56.159 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:56.159 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 63.066944990000003, 2024-04-25T22:52:56.159 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:52:56.159 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:56.159 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:56.159 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:52:56.159 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:56.159 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.160 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:56.160 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:56.160 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:56.160 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.160 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.160 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:56.160 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:56.160 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:56.160 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.160 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.160 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:56.160 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:56.160 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:52:56.160 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.160 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.161 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:56.161 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:52:56.161 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:52:56.161 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.161 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.161 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:56.161 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:52:56.161 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:52:56.161 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.161 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.161 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:56.161 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:52:56.161 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:52:56.161 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.161 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.162 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:56.162 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:52:56.162 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:52:56.162 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.162 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.162 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:56.162 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:52:56.162 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:52:56.162 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.162 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.162 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:56.162 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:52:56.162 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:52:56.163 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:56.163 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:56.163 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:56.163 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.163 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.163 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:52:56.163 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:56.163 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 63.066504021, 2024-04-25T22:52:56.163 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064881979999999997, 2024-04-25T22:52:56.163 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:56.163 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:56.163 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:56.163 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:56.163 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.164 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:56.164 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:56.164 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:56.164 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.164 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.164 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:56.164 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:56.164 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:56.164 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.164 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.164 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:56.164 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:56.164 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2699999999999999e-07 2024-04-25T22:52:56.164 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.164 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.165 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:56.165 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013898+0000", 2024-04-25T22:52:56.165 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0796e-05 2024-04-25T22:52:56.165 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.165 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.165 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:56.165 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013907+0000", 2024-04-25T22:52:56.165 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5140000000000007e-06 2024-04-25T22:52:56.165 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.165 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.165 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:56.165 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013952+0000", 2024-04-25T22:52:56.165 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4134000000000001e-05 2024-04-25T22:52:56.166 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.166 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.166 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:56.166 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016812+0000", 2024-04-25T22:52:56.166 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028601059999999998 2024-04-25T22:52:56.166 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.166 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.166 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:56.166 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.017052+0000", 2024-04-25T22:52:56.166 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024056500000000001 2024-04-25T22:52:56.166 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.166 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.166 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:56.167 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020350+0000", 2024-04-25T22:52:56.167 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032978320000000001 2024-04-25T22:52:56.167 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.167 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.167 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:56.167 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020375+0000", 2024-04-25T22:52:56.167 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4624e-05 2024-04-25T22:52:56.167 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:56.167 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:56.167 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:56.167 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.167 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.167 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-25T22:52:56.167 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:56.168 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 63.052973575000003, 2024-04-25T22:52:56.168 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058583000000000003, 2024-04-25T22:52:56.168 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:56.168 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:56.168 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:56.168 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:56.168 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.168 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:56.168 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:56.168 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:56.168 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.168 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.168 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:56.169 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:56.169 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:56.169 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.169 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.169 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:56.169 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:56.169 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.41e-07 2024-04-25T22:52:56.169 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.169 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.169 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:56.169 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027428+0000", 2024-04-25T22:52:56.169 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.075e-05 2024-04-25T22:52:56.169 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.170 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.170 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:56.170 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027435+0000", 2024-04-25T22:52:56.170 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3610000000000003e-06 2024-04-25T22:52:56.170 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.170 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.170 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:56.170 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027442+0000", 2024-04-25T22:52:56.170 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0400000000000004e-06 2024-04-25T22:52:56.170 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.170 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.170 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:56.170 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028094+0000", 2024-04-25T22:52:56.171 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00065134800000000005 2024-04-25T22:52:56.171 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.171 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.171 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:56.171 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028107+0000", 2024-04-25T22:52:56.171 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3087e-05 2024-04-25T22:52:56.171 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.171 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.171 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:56.171 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033239+0000", 2024-04-25T22:52:56.171 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051319429999999999 2024-04-25T22:52:56.171 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.171 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.171 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:56.172 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033275+0000", 2024-04-25T22:52:56.172 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6430000000000002e-05 2024-04-25T22:52:56.172 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:56.172 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:56.172 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:56.172 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.172 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.172 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-25T22:52:56.172 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:56.172 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 63.052588737999997, 2024-04-25T22:52:56.172 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005413597, 2024-04-25T22:52:56.172 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:56.172 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:56.172 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:56.173 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:56.173 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.173 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:56.173 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:56.173 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:56.173 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.173 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.173 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:56.173 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:56.173 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:56.173 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.173 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.173 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:56.173 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:56.174 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3799999999999997e-07 2024-04-25T22:52:56.174 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.174 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.174 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:56.174 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027816+0000", 2024-04-25T22:52:56.174 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3230999999999999e-05 2024-04-25T22:52:56.174 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.174 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.174 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:56.174 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027823+0000", 2024-04-25T22:52:56.174 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9039999999999992e-06 2024-04-25T22:52:56.174 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.174 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.175 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:56.175 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027841+0000", 2024-04-25T22:52:56.175 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7651000000000001e-05 2024-04-25T22:52:56.175 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.175 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.175 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:56.175 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027904+0000", 2024-04-25T22:52:56.175 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3058000000000005e-05 2024-04-25T22:52:56.175 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.175 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.175 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:56.175 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027926+0000", 2024-04-25T22:52:56.175 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1450999999999998e-05 2024-04-25T22:52:56.175 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.176 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.176 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:56.176 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033177+0000", 2024-04-25T22:52:56.176 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052508909999999997 2024-04-25T22:52:56.176 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.176 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.176 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:56.176 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033215+0000", 2024-04-25T22:52:56.176 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8872999999999999e-05 2024-04-25T22:52:56.176 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:56.176 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:56.176 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:56.176 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.176 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.177 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 171 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:52:56.177 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:56.177 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 63.052531635999998, 2024-04-25T22:52:56.177 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054322240000000003, 2024-04-25T22:52:56.177 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:56.177 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:56.177 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "reached pg", 2024-04-25T22:52:56.177 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:56.177 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.177 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:56.177 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:56.177 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:56.177 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.177 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.178 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:56.178 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:56.178 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:56.178 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.178 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.178 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:56.178 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:56.178 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7500000000000001e-07 2024-04-25T22:52:56.178 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.178 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.178 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:56.178 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027868+0000", 2024-04-25T22:52:56.178 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5750000000000001e-06 2024-04-25T22:52:56.178 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.179 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.179 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:56.179 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027885+0000", 2024-04-25T22:52:56.179 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7272e-05 2024-04-25T22:52:56.179 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.179 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.179 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:56.179 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027900+0000", 2024-04-25T22:52:56.179 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.502e-05 2024-04-25T22:52:56.179 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.179 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.179 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:56.179 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028381+0000", 2024-04-25T22:52:56.180 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00048039399999999998 2024-04-25T22:52:56.180 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:56.180 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:56.180 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:56.180 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033291+0000", 2024-04-25T22:52:56.180 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049105879999999996 2024-04-25T22:52:56.180 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:56.180 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:56.180 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:56.180 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:56.180 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:56.180 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:56.181 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-25T22:52:56.182 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:56.181+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:56.183 INFO:teuthology.orchestra.run.smithi052.stderr:set osd.0 primary-affinity to 0.621584 (8407362) 2024-04-25T22:52:56.183 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:52:56.282 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:56.281+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:56.291 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:56.291 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:52:56.291 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-04-25T22:52:56.291 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:56.301 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:52:56.385 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:56.384+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:56.443 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:56.443 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:52:56.443 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:52:56.443 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:52:56.443 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:56.452 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:52:56.484 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:56.483+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:56.585 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:56.585+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:56.595 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:56.595 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-04-25T22:52:56.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-04-25T22:52:56.595 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:52:56.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.595 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:56.595 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:56.595 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 68.628066052999998, 2024-04-25T22:52:56.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0103421, 2024-04-25T22:52:56.595 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:56.595 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:56.596 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:56.596 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:56.596 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:56.596 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:56.596 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 115 2024-04-25T22:52:56.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.596 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:56.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:56.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:56.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:56.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:56.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:56.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:56.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:56.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:56.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9500000000000002e-07 2024-04-25T22:52:56.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:56.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965108+0000", 2024-04-25T22:52:56.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9177999999999994e-05 2024-04-25T22:52:56.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.598 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:56.598 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965127+0000", 2024-04-25T22:52:56.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8868e-05 2024-04-25T22:52:56.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.598 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:56.598 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965133+0000", 2024-04-25T22:52:56.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8929999999999999e-06 2024-04-25T22:52:56.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.598 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:56.598 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.969991+0000", 2024-04-25T22:52:56.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048573849999999997 2024-04-25T22:52:56.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.599 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:56.599 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970072+0000", 2024-04-25T22:52:56.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0728000000000004e-05 2024-04-25T22:52:56.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.599 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:56.599 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970189+0000", 2024-04-25T22:52:56.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000117778 2024-04-25T22:52:56.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:56.600 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970946+0000", 2024-04-25T22:52:56.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00075704600000000004 2024-04-25T22:52:56.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:56.600 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975297+0000", 2024-04-25T22:52:56.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004350217 2024-04-25T22:52:56.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:56.600 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975343+0000", 2024-04-25T22:52:56.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6687999999999998e-05 2024-04-25T22:52:56.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:56.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975380+0000", 2024-04-25T22:52:56.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6724000000000003e-05 2024-04-25T22:52:56.601 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:56.601 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:56.601 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:56.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.601 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:56.601 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:56.601 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 68.627960021999996, 2024-04-25T22:52:56.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010304384, 2024-04-25T22:52:56.601 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:56.602 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:56.602 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:56.602 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:56.602 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:56.602 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:56.602 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 116 2024-04-25T22:52:56.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.602 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:56.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:56.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:56.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:56.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:56.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:56.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:56.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:56.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:56.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5799999999999999e-07 2024-04-25T22:52:56.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:56.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965154+0000", 2024-04-25T22:52:56.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0009e-05 2024-04-25T22:52:56.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:56.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965164+0000", 2024-04-25T22:52:56.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8490000000000001e-06 2024-04-25T22:52:56.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:56.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965169+0000", 2024-04-25T22:52:56.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0730000000000004e-06 2024-04-25T22:52:56.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:56.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970609+0000", 2024-04-25T22:52:56.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054397689999999997 2024-04-25T22:52:56.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:56.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970651+0000", 2024-04-25T22:52:56.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1873999999999999e-05 2024-04-25T22:52:56.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:56.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970723+0000", 2024-04-25T22:52:56.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2039999999999995e-05 2024-04-25T22:52:56.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:56.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971358+0000", 2024-04-25T22:52:56.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063489500000000001 2024-04-25T22:52:56.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:56.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975409+0000", 2024-04-25T22:52:56.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040506880000000002 2024-04-25T22:52:56.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:56.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975432+0000", 2024-04-25T22:52:56.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3315999999999998e-05 2024-04-25T22:52:56.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:56.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975448+0000", 2024-04-25T22:52:56.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6313000000000001e-05 2024-04-25T22:52:56.607 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:56.607 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:56.607 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:56.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.607 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:56.607 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:56.607 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 68.627925439999999, 2024-04-25T22:52:56.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010384338999999999, 2024-04-25T22:52:56.607 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:56.607 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:56.607 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:56.608 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:56.608 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:56.608 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:56.608 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-04-25T22:52:56.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.608 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:56.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:56.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:56.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:56.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:56.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:56.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:56.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:56.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:56.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3600000000000004e-07 2024-04-25T22:52:56.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:56.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965185+0000", 2024-04-25T22:52:56.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.117e-06 2024-04-25T22:52:56.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:56.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965192+0000", 2024-04-25T22:52:56.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3239999999999997e-06 2024-04-25T22:52:56.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:56.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965198+0000", 2024-04-25T22:52:56.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6370000000000004e-06 2024-04-25T22:52:56.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:56.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970973+0000", 2024-04-25T22:52:56.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057748239999999996 2024-04-25T22:52:56.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:56.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971049+0000", 2024-04-25T22:52:56.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6029e-05 2024-04-25T22:52:56.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:56.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971174+0000", 2024-04-25T22:52:56.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012462399999999999 2024-04-25T22:52:56.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:56.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971553+0000", 2024-04-25T22:52:56.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037896499999999999 2024-04-25T22:52:56.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:56.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975482+0000", 2024-04-25T22:52:56.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039297459999999996 2024-04-25T22:52:56.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.613 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:56.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975529+0000", 2024-04-25T22:52:56.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6387000000000002e-05 2024-04-25T22:52:56.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.613 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:56.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975563+0000", 2024-04-25T22:52:56.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4150000000000003e-05 2024-04-25T22:52:56.613 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:56.613 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:56.613 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:56.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.614 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:56.614 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:56.614 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 63.580879117000002, 2024-04-25T22:52:56.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012637705000000001, 2024-04-25T22:52:56.614 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:56.614 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:56.614 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:56.614 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:56.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.614 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:56.614 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:56.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:56.614 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:56.615 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:56.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:56.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:56.615 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012227+0000", 2024-04-25T22:52:56.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.863e-06 2024-04-25T22:52:56.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:56.615 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012236+0000", 2024-04-25T22:52:56.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1109999999999997e-06 2024-04-25T22:52:56.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:56.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012309+0000", 2024-04-25T22:52:56.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3242000000000001e-05 2024-04-25T22:52:56.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:56.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012324+0000", 2024-04-25T22:52:56.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4837e-05 2024-04-25T22:52:56.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:56.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015060+0000", 2024-04-25T22:52:56.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027363349999999999 2024-04-25T22:52:56.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:56.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015169+0000", 2024-04-25T22:52:56.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108372 2024-04-25T22:52:56.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:56.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015498+0000", 2024-04-25T22:52:56.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032949999999999999 2024-04-25T22:52:56.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:56.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021282+0000", 2024-04-25T22:52:56.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057836429999999998 2024-04-25T22:52:56.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:56.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024709+0000", 2024-04-25T22:52:56.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034271979999999998 2024-04-25T22:52:56.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:56.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024802+0000", 2024-04-25T22:52:56.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2960000000000004e-05 2024-04-25T22:52:56.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:56.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024863+0000", 2024-04-25T22:52:56.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0643999999999997e-05 2024-04-25T22:52:56.619 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:56.619 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:56.619 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:56.619 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.619 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:56.619 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:56.619 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 63.580755345999997, 2024-04-25T22:52:56.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012979447999999999, 2024-04-25T22:52:56.619 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:56.619 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:56.619 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:56.619 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:56.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.620 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:56.620 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:56.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:56.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.620 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:56.620 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:56.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:56.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.620 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:56.620 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:56.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:52:56.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:56.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012354+0000", 2024-04-25T22:52:56.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7740000000000004e-06 2024-04-25T22:52:56.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:56.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012365+0000", 2024-04-25T22:52:56.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.064e-05 2024-04-25T22:52:56.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:56.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012382+0000", 2024-04-25T22:52:56.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6999000000000001e-05 2024-04-25T22:52:56.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:56.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015958+0000", 2024-04-25T22:52:56.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035765699999999998 2024-04-25T22:52:56.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:56.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016037+0000", 2024-04-25T22:52:56.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8242000000000001e-05 2024-04-25T22:52:56.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:56.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016404+0000", 2024-04-25T22:52:56.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036784300000000002 2024-04-25T22:52:56.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:56.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021294+0000", 2024-04-25T22:52:56.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048890629999999999 2024-04-25T22:52:56.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:56.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024959+0000", 2024-04-25T22:52:56.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036651570000000001 2024-04-25T22:52:56.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:56.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025097+0000", 2024-04-25T22:52:56.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013788099999999999 2024-04-25T22:52:56.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:56.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025328+0000", 2024-04-25T22:52:56.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231492 2024-04-25T22:52:56.624 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:56.624 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:56.624 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:56.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.624 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:56.625 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:56.625 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 63.580667577, 2024-04-25T22:52:56.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013049827, 2024-04-25T22:52:56.625 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:56.625 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:56.625 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:56.625 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:56.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.625 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:56.625 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:56.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:56.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.625 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:56.626 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:56.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:56.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:56.626 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012437+0000", 2024-04-25T22:52:56.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-04-25T22:52:56.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:56.626 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012440+0000", 2024-04-25T22:52:56.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7609999999999999e-06 2024-04-25T22:52:56.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.627 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:56.627 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012449+0000", 2024-04-25T22:52:56.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.285e-06 2024-04-25T22:52:56.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.627 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:56.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012457+0000", 2024-04-25T22:52:56.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9510000000000006e-06 2024-04-25T22:52:56.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:56.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017106+0000", 2024-04-25T22:52:56.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046494220000000003 2024-04-25T22:52:56.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:56.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017223+0000", 2024-04-25T22:52:56.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116824 2024-04-25T22:52:56.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:56.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017345+0000", 2024-04-25T22:52:56.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122175 2024-04-25T22:52:56.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:56.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021299+0000", 2024-04-25T22:52:56.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039534879999999998 2024-04-25T22:52:56.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.631 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:56.631 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025398+0000", 2024-04-25T22:52:56.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040988960000000003 2024-04-25T22:52:56.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.631 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.631 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:56.631 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025439+0000", 2024-04-25T22:52:56.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0915999999999999e-05 2024-04-25T22:52:56.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.631 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.631 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:56.631 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025486+0000", 2024-04-25T22:52:56.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7534999999999998e-05 2024-04-25T22:52:56.631 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:56.631 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:56.632 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:56.632 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.632 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:56.632 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:56.632 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 63.580637426000003, 2024-04-25T22:52:56.632 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020988041999999998, 2024-04-25T22:52:56.632 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:56.632 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:56.632 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:56.632 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:56.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.632 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:56.632 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:56.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:56.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:56.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:56.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:56.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:56.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:56.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.99e-07 2024-04-25T22:52:56.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:56.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012470+0000", 2024-04-25T22:52:56.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2789999999999999e-06 2024-04-25T22:52:56.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:56.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012477+0000", 2024-04-25T22:52:56.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:52:56.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:56.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012500+0000", 2024-04-25T22:52:56.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2490999999999999e-05 2024-04-25T22:52:56.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.635 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:56.635 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021911+0000", 2024-04-25T22:52:56.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094114160000000006 2024-04-25T22:52:56.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.635 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:56.635 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022000+0000", 2024-04-25T22:52:56.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8601000000000001e-05 2024-04-25T22:52:56.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.635 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:56.635 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022359+0000", 2024-04-25T22:52:56.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035921999999999999 2024-04-25T22:52:56.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.636 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:56.636 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025541+0000", 2024-04-25T22:52:56.636 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031820619999999998 2024-04-25T22:52:56.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.636 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:56.636 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033375+0000", 2024-04-25T22:52:56.636 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078338379999999992 2024-04-25T22:52:56.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.636 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:56.636 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033415+0000", 2024-04-25T22:52:56.636 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9527000000000003e-05 2024-04-25T22:52:56.637 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.637 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.637 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:56.637 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033455+0000", 2024-04-25T22:52:56.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9932000000000003e-05 2024-04-25T22:52:56.637 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:56.637 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:56.637 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:56.637 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.637 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.637 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:56.637 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:56.637 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 63.580582233000001, 2024-04-25T22:52:56.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021043857999999999, 2024-04-25T22:52:56.638 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:56.638 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:56.638 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:56.638 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:56.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.638 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:56.638 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:56.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:56.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.638 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:56.638 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:56.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:56.639 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.639 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.639 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:56.639 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012523+0000", 2024-04-25T22:52:56.639 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.361e-06 2024-04-25T22:52:56.639 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.639 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.639 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:56.639 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012530+0000", 2024-04-25T22:52:56.639 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5440000000000004e-06 2024-04-25T22:52:56.639 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.639 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.639 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:56.639 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012541+0000", 2024-04-25T22:52:56.640 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1745e-05 2024-04-25T22:52:56.640 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.640 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.640 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:56.640 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012551+0000", 2024-04-25T22:52:56.640 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5789999999999993e-06 2024-04-25T22:52:56.640 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.640 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.640 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:56.640 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022709+0000", 2024-04-25T22:52:56.640 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010157685 2024-04-25T22:52:56.640 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.640 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.640 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:56.641 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022957+0000", 2024-04-25T22:52:56.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024824599999999998 2024-04-25T22:52:56.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.641 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:56.641 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023443+0000", 2024-04-25T22:52:56.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048578599999999999 2024-04-25T22:52:56.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.641 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:56.641 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025547+0000", 2024-04-25T22:52:56.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021044789999999998 2024-04-25T22:52:56.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:56.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033509+0000", 2024-04-25T22:52:56.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0079622180000000001 2024-04-25T22:52:56.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:56.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033542+0000", 2024-04-25T22:52:56.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3018000000000001e-05 2024-04-25T22:52:56.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:56.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033566+0000", 2024-04-25T22:52:56.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3197000000000002e-05 2024-04-25T22:52:56.642 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:56.643 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:56.643 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:56.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.643 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:56.643 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:56.643 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 63.580542268000002, 2024-04-25T22:52:56.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021122696, 2024-04-25T22:52:56.643 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:56.643 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:56.643 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:56.643 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:56.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.643 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:56.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:56.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:56.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.644 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.644 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:56.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:56.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:56.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.644 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.644 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:56.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:56.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:52:56.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.644 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.645 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:56.645 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012566+0000", 2024-04-25T22:52:56.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-04-25T22:52:56.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.645 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:56.645 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012619+0000", 2024-04-25T22:52:56.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2607e-05 2024-04-25T22:52:56.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.645 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:56.645 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012628+0000", 2024-04-25T22:52:56.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6500000000000008e-06 2024-04-25T22:52:56.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:56.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024024+0000", 2024-04-25T22:52:56.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011396007999999999 2024-04-25T22:52:56.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:56.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024198+0000", 2024-04-25T22:52:56.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000173215 2024-04-25T22:52:56.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:56.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024447+0000", 2024-04-25T22:52:56.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024898500000000002 2024-04-25T22:52:56.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:56.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026431+0000", 2024-04-25T22:52:56.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001984923 2024-04-25T22:52:56.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:56.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033608+0000", 2024-04-25T22:52:56.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071768459999999997 2024-04-25T22:52:56.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:56.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033646+0000", 2024-04-25T22:52:56.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299000000000003e-05 2024-04-25T22:52:56.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:56.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033684+0000", 2024-04-25T22:52:56.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8773000000000003e-05 2024-04-25T22:52:56.648 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:56.648 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:56.648 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:56.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.648 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:56.648 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:56.649 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 63.580453669000001, 2024-04-25T22:52:56.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021175381, 2024-04-25T22:52:56.649 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:56.649 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:56.649 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:56.649 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:56.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:56.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:56.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:56.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:56.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:56.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:56.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:56.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012651+0000", 2024-04-25T22:52:56.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:52:56.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:56.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012656+0000", 2024-04-25T22:52:56.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8899999999999998e-06 2024-04-25T22:52:56.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:56.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012666+0000", 2024-04-25T22:52:56.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0346999999999999e-05 2024-04-25T22:52:56.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:56.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012675+0000", 2024-04-25T22:52:56.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9930000000000001e-06 2024-04-25T22:52:56.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:56.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025661+0000", 2024-04-25T22:52:56.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01298531 2024-04-25T22:52:56.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:56.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025757+0000", 2024-04-25T22:52:56.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5822000000000005e-05 2024-04-25T22:52:56.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:56.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025907+0000", 2024-04-25T22:52:56.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015051499999999999 2024-04-25T22:52:56.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:56.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026435+0000", 2024-04-25T22:52:56.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052762200000000005 2024-04-25T22:52:56.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:56.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033732+0000", 2024-04-25T22:52:56.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072978419999999997 2024-04-25T22:52:56.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:56.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033787+0000", 2024-04-25T22:52:56.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4703999999999997e-05 2024-04-25T22:52:56.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:56.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033826+0000", 2024-04-25T22:52:56.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8458999999999999e-05 2024-04-25T22:52:56.654 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:56.654 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:56.654 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:56.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.654 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:56.654 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:56.654 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 63.580398254999999, 2024-04-25T22:52:56.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021244174000000001, 2024-04-25T22:52:56.654 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:56.654 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:56.654 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:56.655 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:56.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:56.655 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:56.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:56.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:56.655 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:56.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:56.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:56.655 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:56.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:52:56.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:56.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012712+0000", 2024-04-25T22:52:56.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.913e-06 2024-04-25T22:52:56.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:56.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012722+0000", 2024-04-25T22:52:56.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2879999999999998e-06 2024-04-25T22:52:56.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:56.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012727+0000", 2024-04-25T22:52:56.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8429999999999998e-06 2024-04-25T22:52:56.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:56.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026099+0000", 2024-04-25T22:52:56.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013371450999999999 2024-04-25T22:52:56.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:56.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026147+0000", 2024-04-25T22:52:56.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7837999999999998e-05 2024-04-25T22:52:56.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.658 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:56.658 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026254+0000", 2024-04-25T22:52:56.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107314 2024-04-25T22:52:56.658 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.658 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:56.658 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026686+0000", 2024-04-25T22:52:56.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000432428 2024-04-25T22:52:56.658 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.658 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:56.658 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033873+0000", 2024-04-25T22:52:56.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071864399999999997 2024-04-25T22:52:56.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.659 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:56.659 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033904+0000", 2024-04-25T22:52:56.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1321e-05 2024-04-25T22:52:56.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.659 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:56.659 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033950+0000", 2024-04-25T22:52:56.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5707999999999997e-05 2024-04-25T22:52:56.659 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:56.659 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:56.659 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:56.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.660 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:56.660 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:56.660 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 63.580367870000003, 2024-04-25T22:52:56.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01096505, 2024-04-25T22:52:56.660 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:56.660 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:56.660 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:56.660 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:56.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:56.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:56.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:56.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:56.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:56.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:56.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:56.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012737+0000", 2024-04-25T22:52:56.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:52:56.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:56.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012739+0000", 2024-04-25T22:52:56.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-04-25T22:52:56.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.662 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:56.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012743+0000", 2024-04-25T22:52:56.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3239999999999996e-06 2024-04-25T22:52:56.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.662 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:56.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012746+0000", 2024-04-25T22:52:56.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.129e-06 2024-04-25T22:52:56.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:56.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012796+0000", 2024-04-25T22:52:56.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9231999999999999e-05 2024-04-25T22:52:56.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:56.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012915+0000", 2024-04-25T22:52:56.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119021 2024-04-25T22:52:56.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:56.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013069+0000", 2024-04-25T22:52:56.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015463900000000001 2024-04-25T22:52:56.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:56.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019237+0000", 2024-04-25T22:52:56.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061680329999999998 2024-04-25T22:52:56.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:56.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023603+0000", 2024-04-25T22:52:56.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043655860000000003 2024-04-25T22:52:56.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:56.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023659+0000", 2024-04-25T22:52:56.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6484000000000003e-05 2024-04-25T22:52:56.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.665 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:56.665 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023701+0000", 2024-04-25T22:52:56.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1761999999999998e-05 2024-04-25T22:52:56.665 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:56.665 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:56.665 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:56.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.665 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:56.665 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:56.665 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 63.580342922, 2024-04-25T22:52:56.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011234429000000001, 2024-04-25T22:52:56.666 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:56.666 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:56.666 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:56.666 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:56.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.666 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:56.666 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:56.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:56.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.666 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:56.666 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:56.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:56.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:56.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012762+0000", 2024-04-25T22:52:56.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-04-25T22:52:56.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:56.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012765+0000", 2024-04-25T22:52:56.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2569999999999999e-06 2024-04-25T22:52:56.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:56.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012783+0000", 2024-04-25T22:52:56.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8431999999999999e-05 2024-04-25T22:52:56.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:56.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012799+0000", 2024-04-25T22:52:56.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5438999999999999e-05 2024-04-25T22:52:56.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:56.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013826+0000", 2024-04-25T22:52:56.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010275060000000001 2024-04-25T22:52:56.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:56.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013913+0000", 2024-04-25T22:52:56.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.708e-05 2024-04-25T22:52:56.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:56.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014098+0000", 2024-04-25T22:52:56.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018519399999999999 2024-04-25T22:52:56.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:56.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019684+0000", 2024-04-25T22:52:56.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055860079999999999 2024-04-25T22:52:56.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:56.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023876+0000", 2024-04-25T22:52:56.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041918800000000003 2024-04-25T22:52:56.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:56.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023957+0000", 2024-04-25T22:52:56.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1165e-05 2024-04-25T22:52:56.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.671 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:56.671 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023995+0000", 2024-04-25T22:52:56.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:52:56.671 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:56.671 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:56.671 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:56.671 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.671 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:56.671 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:56.671 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 63.580245142999999, 2024-04-25T22:52:56.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011131200000000001, 2024-04-25T22:52:56.671 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:56.671 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:56.672 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:56.672 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:56.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:56.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:56.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:56.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:56.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:56.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:56.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:56.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012860+0000", 2024-04-25T22:52:56.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3900000000000004e-07 2024-04-25T22:52:56.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:56.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012865+0000", 2024-04-25T22:52:56.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5609999999999998e-06 2024-04-25T22:52:56.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:56.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012895+0000", 2024-04-25T22:52:56.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9847000000000001e-05 2024-04-25T22:52:56.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:56.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012905+0000", 2024-04-25T22:52:56.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.03e-05 2024-04-25T22:52:56.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:56.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015020+0000", 2024-04-25T22:52:56.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021142940000000001 2024-04-25T22:52:56.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:56.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015182+0000", 2024-04-25T22:52:56.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016248099999999999 2024-04-25T22:52:56.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:52:56.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015357+0000", 2024-04-25T22:52:56.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017471000000000001 2024-04-25T22:52:56.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:56.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021021+0000", 2024-04-25T22:52:56.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056638340000000004 2024-04-25T22:52:56.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:56.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023712+0000", 2024-04-25T22:52:56.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026910380000000002 2024-04-25T22:52:56.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.676 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:56.676 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023763+0000", 2024-04-25T22:52:56.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1477999999999997e-05 2024-04-25T22:52:56.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.676 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:56.676 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023990+0000", 2024-04-25T22:52:56.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000226818 2024-04-25T22:52:56.676 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:56.676 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:56.676 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:56.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.677 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:56.677 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:56.677 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 63.580122047000003, 2024-04-25T22:52:56.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011705299000000001, 2024-04-25T22:52:56.677 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:56.677 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:56.677 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:56.677 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:56.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:56.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:56.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:56.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:56.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:56.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:56.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:56.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012983+0000", 2024-04-25T22:52:56.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:52:56.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:56.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012986+0000", 2024-04-25T22:52:56.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5700000000000001e-06 2024-04-25T22:52:56.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:56.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012993+0000", 2024-04-25T22:52:56.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8730000000000001e-06 2024-04-25T22:52:56.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:56.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013000+0000", 2024-04-25T22:52:56.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1890000000000001e-06 2024-04-25T22:52:56.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:56.680 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:52:56.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002147866 2024-04-25T22:52:56.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.680 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:56.680 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015351+0000", 2024-04-25T22:52:56.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020300799999999999 2024-04-25T22:52:56.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.680 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:56.680 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016260+0000", 2024-04-25T22:52:56.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00090926799999999997 2024-04-25T22:52:56.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:56.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022669+0000", 2024-04-25T22:52:56.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064082849999999997 2024-04-25T22:52:56.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:56.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024584+0000", 2024-04-25T22:52:56.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019151699999999999 2024-04-25T22:52:56.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:56.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024643+0000", 2024-04-25T22:52:56.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8888999999999998e-05 2024-04-25T22:52:56.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:56.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024687+0000", 2024-04-25T22:52:56.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4444999999999999e-05 2024-04-25T22:52:56.682 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:56.682 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:56.682 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:56.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.682 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:56.682 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:56.682 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 63.580094455999998, 2024-04-25T22:52:56.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011249699, 2024-04-25T22:52:56.683 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:56.683 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:56.683 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:56.683 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:56.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:56.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:56.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:56.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:56.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:56.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:56.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:56.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013010+0000", 2024-04-25T22:52:56.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2099999999999996e-07 2024-04-25T22:52:56.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:56.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013013+0000", 2024-04-25T22:52:56.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1310000000000002e-06 2024-04-25T22:52:56.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:56.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013020+0000", 2024-04-25T22:52:56.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3330000000000002e-06 2024-04-25T22:52:56.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:56.685 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013025+0000", 2024-04-25T22:52:56.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6760000000000004e-06 2024-04-25T22:52:56.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:56.685 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013163+0000", 2024-04-25T22:52:56.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013824599999999999 2024-04-25T22:52:56.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:56.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013504+0000", 2024-04-25T22:52:56.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034080299999999998 2024-04-25T22:52:56.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.686 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:56.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013613+0000", 2024-04-25T22:52:56.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108705 2024-04-25T22:52:56.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.686 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:56.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015831+0000", 2024-04-25T22:52:56.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002217672 2024-04-25T22:52:56.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:56.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024137+0000", 2024-04-25T22:52:56.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0083060489999999994 2024-04-25T22:52:56.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:56.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024218+0000", 2024-04-25T22:52:56.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1351000000000001e-05 2024-04-25T22:52:56.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:56.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024259+0000", 2024-04-25T22:52:56.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1112000000000002e-05 2024-04-25T22:52:56.688 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:56.688 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:56.688 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:56.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.688 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:56.688 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:56.688 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 63.580006730000001, 2024-04-25T22:52:56.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020379749999999999, 2024-04-25T22:52:56.688 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:56.688 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:56.688 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:56.688 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:56.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:56.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:56.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:56.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:56.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:56.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:56.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:56.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013098+0000", 2024-04-25T22:52:56.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:52:56.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:56.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013105+0000", 2024-04-25T22:52:56.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5969999999999997e-06 2024-04-25T22:52:56.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:56.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013190+0000", 2024-04-25T22:52:56.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5618999999999995e-05 2024-04-25T22:52:56.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:56.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013200+0000", 2024-04-25T22:52:56.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5859999999999994e-06 2024-04-25T22:52:56.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.691 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:56.691 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020265+0000", 2024-04-25T22:52:56.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070653349999999998 2024-04-25T22:52:56.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.691 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:56.691 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020454+0000", 2024-04-25T22:52:56.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189316 2024-04-25T22:52:56.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.691 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:56.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020586+0000", 2024-04-25T22:52:56.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013195700000000001 2024-04-25T22:52:56.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:56.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023822+0000", 2024-04-25T22:52:56.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032358529999999999 2024-04-25T22:52:56.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:56.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033409+0000", 2024-04-25T22:52:56.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095870520000000004 2024-04-25T22:52:56.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.693 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:56.693 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033447+0000", 2024-04-25T22:52:56.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7261999999999997e-05 2024-04-25T22:52:56.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.693 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:56.693 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033477+0000", 2024-04-25T22:52:56.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0389e-05 2024-04-25T22:52:56.693 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:56.693 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:56.693 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:56.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.693 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:56.694 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:56.694 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 63.579890224000003, 2024-04-25T22:52:56.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010857383999999999, 2024-04-25T22:52:56.694 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:56.694 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:56.694 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:56.694 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:56.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:56.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:56.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:56.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:56.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:56.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:56.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:56.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:56.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:52:56.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:56.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013218+0000", 2024-04-25T22:52:56.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8199999999999998e-06 2024-04-25T22:52:56.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.696 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:56.696 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013226+0000", 2024-04-25T22:52:56.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7649999999999993e-06 2024-04-25T22:52:56.696 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.696 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:56.696 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013259+0000", 2024-04-25T22:52:56.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2727e-05 2024-04-25T22:52:56.696 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.696 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:56.696 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014809+0000", 2024-04-25T22:52:56.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001550144 2024-04-25T22:52:56.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:56.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014958+0000", 2024-04-25T22:52:56.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014890300000000001 2024-04-25T22:52:56.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:52:56.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015087+0000", 2024-04-25T22:52:56.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012939200000000001 2024-04-25T22:52:56.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:56.698 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020212+0000", 2024-04-25T22:52:56.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051248939999999996 2024-04-25T22:52:56.698 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.698 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.698 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:56.698 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023699+0000", 2024-04-25T22:52:56.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034873289999999999 2024-04-25T22:52:56.698 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.698 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.698 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:56.698 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024014+0000", 2024-04-25T22:52:56.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031473999999999999 2024-04-25T22:52:56.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:56.699 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024071+0000", 2024-04-25T22:52:56.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7040000000000003e-05 2024-04-25T22:52:56.699 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:56.699 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:56.699 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:56.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.699 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:56.699 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:56.699 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 63.579835519, 2024-04-25T22:52:56.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012329677000000001, 2024-04-25T22:52:56.699 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:56.700 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:56.700 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:56.700 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:56.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:56.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:56.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:56.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:56.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:56.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:56.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:56.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013269+0000", 2024-04-25T22:52:56.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5000000000000002e-07 2024-04-25T22:52:56.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:56.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:52:56.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6909999999999999e-06 2024-04-25T22:52:56.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:56.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013284+0000", 2024-04-25T22:52:56.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0963e-05 2024-04-25T22:52:56.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:56.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013361+0000", 2024-04-25T22:52:56.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7379999999999994e-05 2024-04-25T22:52:56.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:56.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013448+0000", 2024-04-25T22:52:56.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6990000000000006e-05 2024-04-25T22:52:56.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:56.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013632+0000", 2024-04-25T22:52:56.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018396800000000001 2024-04-25T22:52:56.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:56.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013800+0000", 2024-04-25T22:52:56.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167467 2024-04-25T22:52:56.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:56.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.018570+0000", 2024-04-25T22:52:56.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047701460000000003 2024-04-25T22:52:56.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:56.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025507+0000", 2024-04-25T22:52:56.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069372039999999998 2024-04-25T22:52:56.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:56.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025562+0000", 2024-04-25T22:52:56.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4858999999999998e-05 2024-04-25T22:52:56.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:56.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025598+0000", 2024-04-25T22:52:56.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6259e-05 2024-04-25T22:52:56.704 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:56.704 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:56.704 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:56.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.705 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:56.705 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:56.705 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 63.579703645999999, 2024-04-25T22:52:56.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020176666999999999, 2024-04-25T22:52:56.705 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:56.705 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:56.705 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:52:56.705 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:56.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:56.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:56.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:56.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:56.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:56.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:56.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:56.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:52:56.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-04-25T22:52:56.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:56.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013405+0000", 2024-04-25T22:52:56.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0559999999999998e-06 2024-04-25T22:52:56.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:56.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013422+0000", 2024-04-25T22:52:56.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6770999999999999e-05 2024-04-25T22:52:56.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:56.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013431+0000", 2024-04-25T22:52:56.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5019999999999998e-06 2024-04-25T22:52:56.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:56.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021720+0000", 2024-04-25T22:52:56.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082884340000000008 2024-04-25T22:52:56.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:56.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022122+0000", 2024-04-25T22:52:56.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000401634 2024-04-25T22:52:56.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:56.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:56.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:56.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033577+0000", 2024-04-25T22:52:56.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011455435999999999 2024-04-25T22:52:56.709 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:56.709 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:56.709 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:56.709 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:56.709 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:56.709 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:56.711 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:52:56.711 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:56.709+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:56.811 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:56.810+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:56.816 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:56.816 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:52:56.816 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-25T22:52:56.816 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:56.824 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:52:56.912 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:56.911+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:56.966 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:56.966 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:52:56.966 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-25T22:52:56.967 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-25T22:52:56.967 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:56.975 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:52:57.019 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:57.018+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:57.079 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:57.080 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:52:57.080 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:52:57.080 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:52:57.080 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.080 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:52:57.080 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:52:57.080 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 69.110911716000004, 2024-04-25T22:52:57.080 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:52:57.080 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:57.080 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:57.080 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:57.080 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:57.080 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.081 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:57.081 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:52:57.081 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:57.081 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.081 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.081 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:57.081 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:52:57.081 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:57.081 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.081 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.081 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:57.081 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:52:57.081 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:52:57.082 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.082 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.082 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:57.082 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:52:57.082 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:52:57.082 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.082 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.082 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:57.082 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:52:57.082 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:52:57.082 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.082 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.082 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:57.083 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:52:57.083 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:52:57.083 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.083 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.083 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:57.083 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:52:57.083 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:52:57.083 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.083 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.083 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:57.083 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:52:57.083 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:52:57.083 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.083 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.084 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:57.084 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:52:57.084 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:52:57.084 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.084 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.084 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:57.084 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:52:57.084 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:52:57.084 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:57.084 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:57.084 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:57.084 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.084 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.084 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:110 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'72, mlcod=10'68)", 2024-04-25T22:52:57.085 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:57.085 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 69.110277715999999, 2024-04-25T22:52:57.085 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065316630000000001, 2024-04-25T22:52:57.085 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:57.085 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:57.085 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:57.085 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:57.085 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.085 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:57.085 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:57.085 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:57.085 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.085 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.086 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:57.086 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:57.086 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:57.086 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.086 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.086 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:57.086 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:57.086 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.58e-07 2024-04-25T22:52:57.086 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.086 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.086 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:57.086 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967811+0000", 2024-04-25T22:52:57.086 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.118e-06 2024-04-25T22:52:57.086 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.087 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.087 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:57.087 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967817+0000", 2024-04-25T22:52:57.087 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3709999999999996e-06 2024-04-25T22:52:57.087 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.087 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.087 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:57.087 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967820+0000", 2024-04-25T22:52:57.087 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2210000000000002e-06 2024-04-25T22:52:57.087 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.087 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.087 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:57.087 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967876+0000", 2024-04-25T22:52:57.087 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5507000000000002e-05 2024-04-25T22:52:57.088 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.088 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.088 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:57.088 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967893+0000", 2024-04-25T22:52:57.088 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7812000000000002e-05 2024-04-25T22:52:57.088 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.088 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.088 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:57.088 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974317+0000", 2024-04-25T22:52:57.088 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064237160000000003 2024-04-25T22:52:57.088 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.088 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.088 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:57.088 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:52:57.089 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.156e-05 2024-04-25T22:52:57.089 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:57.089 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:57.089 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:57.089 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.089 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.089 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'68)", 2024-04-25T22:52:57.089 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:57.089 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 69.109860202999997, 2024-04-25T22:52:57.089 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061292279999999996, 2024-04-25T22:52:57.089 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:57.089 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:57.089 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:57.089 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:57.090 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.090 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:57.090 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:57.090 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:57.090 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.090 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.090 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:57.090 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:57.090 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:57.090 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.090 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.090 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:57.090 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:57.090 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6300000000000001e-07 2024-04-25T22:52:57.091 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.091 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.091 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:57.091 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968228+0000", 2024-04-25T22:52:57.091 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6139999999999999e-06 2024-04-25T22:52:57.091 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.091 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.091 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:57.091 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968235+0000", 2024-04-25T22:52:57.091 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7020000000000001e-06 2024-04-25T22:52:57.091 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.091 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.091 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:57.091 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968238+0000", 2024-04-25T22:52:57.092 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0010000000000002e-06 2024-04-25T22:52:57.092 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.092 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.092 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:57.092 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968297+0000", 2024-04-25T22:52:57.092 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8424999999999997e-05 2024-04-25T22:52:57.092 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.092 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.092 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:57.092 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968316+0000", 2024-04-25T22:52:57.092 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8814999999999999e-05 2024-04-25T22:52:57.092 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.092 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.092 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:57.093 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:52:57.093 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060239439999999998 2024-04-25T22:52:57.093 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.093 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.093 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:57.093 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974354+0000", 2024-04-25T22:52:57.093 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4364e-05 2024-04-25T22:52:57.093 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:57.093 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:57.093 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:57.093 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.093 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.093 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'68)", 2024-04-25T22:52:57.093 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:57.094 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 69.109423200999998, 2024-04-25T22:52:57.094 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005948414, 2024-04-25T22:52:57.094 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:57.094 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:57.094 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:57.094 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:57.094 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.094 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:57.094 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:57.094 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:57.094 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.094 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.094 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:57.095 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:57.095 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:57.095 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.095 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.095 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:57.095 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:57.095 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6199999999999998e-07 2024-04-25T22:52:57.095 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.095 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.095 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:57.095 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968723+0000", 2024-04-25T22:52:57.095 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1148999999999993e-05 2024-04-25T22:52:57.095 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.096 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.096 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:57.096 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968730+0000", 2024-04-25T22:52:57.096 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1749999999999999e-06 2024-04-25T22:52:57.096 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.096 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.096 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:57.096 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968734+0000", 2024-04-25T22:52:57.096 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5200000000000002e-06 2024-04-25T22:52:57.096 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.096 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.096 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:57.096 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968771+0000", 2024-04-25T22:52:57.096 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6851999999999999e-05 2024-04-25T22:52:57.097 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.097 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.097 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:57.097 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968788+0000", 2024-04-25T22:52:57.097 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7027000000000001e-05 2024-04-25T22:52:57.097 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.097 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.097 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:57.097 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974589+0000", 2024-04-25T22:52:57.097 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058013320000000002 2024-04-25T22:52:57.097 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.097 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.097 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:57.097 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974610+0000", 2024-04-25T22:52:57.098 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0897e-05 2024-04-25T22:52:57.098 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:57.098 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:57.098 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:57.098 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.098 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.098 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'68)", 2024-04-25T22:52:57.098 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:57.098 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 69.108853190999994, 2024-04-25T22:52:57.098 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053935750000000003, 2024-04-25T22:52:57.098 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:57.098 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:57.098 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:57.098 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:57.099 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.099 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:57.099 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:57.099 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:57.099 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.099 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.099 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:57.099 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:57.099 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:57.099 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.099 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.099 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:57.099 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:57.099 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.03e-07 2024-04-25T22:52:57.100 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.100 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.100 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:57.100 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969235+0000", 2024-04-25T22:52:57.100 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2399999999999999e-06 2024-04-25T22:52:57.100 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.100 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.100 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:57.100 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969242+0000", 2024-04-25T22:52:57.100 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1269999999999997e-06 2024-04-25T22:52:57.100 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.100 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.100 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:57.100 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969246+0000", 2024-04-25T22:52:57.100 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3840000000000001e-06 2024-04-25T22:52:57.101 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.101 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.101 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:57.101 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969278+0000", 2024-04-25T22:52:57.101 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1868e-05 2024-04-25T22:52:57.101 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.101 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.101 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:57.101 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969295+0000", 2024-04-25T22:52:57.101 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7530999999999999e-05 2024-04-25T22:52:57.101 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.101 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.101 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:57.102 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974611+0000", 2024-04-25T22:52:57.102 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053160789999999996 2024-04-25T22:52:57.102 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.102 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.102 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:57.102 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974625+0000", 2024-04-25T22:52:57.102 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3943e-05 2024-04-25T22:52:57.102 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:57.102 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:57.102 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:57.102 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.102 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.102 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-25T22:52:57.103 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:57.103 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 68.915257283000003, 2024-04-25T22:52:57.103 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054952610000000004, 2024-04-25T22:52:57.103 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:57.103 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:57.103 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:57.103 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:57.103 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.103 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:57.103 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:57.103 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:57.103 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.103 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.103 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:57.104 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:57.104 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:57.104 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.104 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.104 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:57.104 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:57.104 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.68e-07 2024-04-25T22:52:57.104 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.104 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.104 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:57.104 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162898+0000", 2024-04-25T22:52:57.104 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9470999999999999e-05 2024-04-25T22:52:57.104 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.104 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.105 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:57.105 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162906+0000", 2024-04-25T22:52:57.105 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1580000000000005e-06 2024-04-25T22:52:57.105 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.105 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.105 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:57.105 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162911+0000", 2024-04-25T22:52:57.105 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4779999999999999e-06 2024-04-25T22:52:57.105 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.105 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.105 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:57.105 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162952+0000", 2024-04-25T22:52:57.105 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0629e-05 2024-04-25T22:52:57.105 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.106 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.106 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:57.106 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162968+0000", 2024-04-25T22:52:57.106 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6239000000000002e-05 2024-04-25T22:52:57.106 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.106 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.106 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:57.106 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168281+0000", 2024-04-25T22:52:57.106 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053132869999999999 2024-04-25T22:52:57.106 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.106 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.106 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:57.106 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168323+0000", 2024-04-25T22:52:57.106 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1430999999999997e-05 2024-04-25T22:52:57.107 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:57.107 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:57.107 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:57.107 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.107 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.107 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-04-25T22:52:57.107 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:57.107 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 68.484779920999998, 2024-04-25T22:52:57.107 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050872510000000001, 2024-04-25T22:52:57.107 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:57.107 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:57.107 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:57.107 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:57.107 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.108 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:57.108 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:57.108 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:57.108 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.108 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.108 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:57.108 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:57.108 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:57.108 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.108 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.108 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:57.108 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:57.108 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.72e-07 2024-04-25T22:52:57.109 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.109 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.109 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:57.109 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593381+0000", 2024-04-25T22:52:57.109 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5797000000000006e-05 2024-04-25T22:52:57.109 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.109 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.109 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:57.109 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593389+0000", 2024-04-25T22:52:57.109 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8480000000000001e-06 2024-04-25T22:52:57.109 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.109 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.109 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:57.110 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593393+0000", 2024-04-25T22:52:57.110 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4819999999999996e-06 2024-04-25T22:52:57.110 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.110 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.110 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:57.110 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593435+0000", 2024-04-25T22:52:57.110 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1600000000000002e-05 2024-04-25T22:52:57.110 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.110 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.110 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:57.110 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593454+0000", 2024-04-25T22:52:57.110 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8868e-05 2024-04-25T22:52:57.110 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.111 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.111 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:57.111 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598350+0000", 2024-04-25T22:52:57.111 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004895763 2024-04-25T22:52:57.111 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.111 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.111 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:57.111 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598392+0000", 2024-04-25T22:52:57.111 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2521000000000002e-05 2024-04-25T22:52:57.111 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:57.111 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:57.111 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:57.111 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.112 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.112 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:57.112 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:52:57.112 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 64.066416016999995, 2024-04-25T22:52:57.112 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:52:57.112 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:57.112 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:57.112 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:57.112 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:57.112 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.112 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:57.112 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:52:57.112 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:57.112 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.113 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.113 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:57.113 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:52:57.113 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:57.113 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.113 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.113 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:57.113 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:52:57.113 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:52:57.113 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.113 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.113 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:57.113 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:52:57.113 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:52:57.114 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.114 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.114 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:57.114 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:52:57.114 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:52:57.114 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.114 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.114 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:57.114 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:52:57.114 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:52:57.114 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.114 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.114 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:57.114 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:52:57.115 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:52:57.115 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.115 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.115 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:57.115 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:52:57.115 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:52:57.115 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.115 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.115 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:57.115 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:52:57.115 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:52:57.115 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.115 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.115 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:57.116 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:52:57.116 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:52:57.116 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.116 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.116 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:57.116 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:52:57.116 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:52:57.116 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.116 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.116 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:57.116 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:52:57.116 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:52:57.116 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.116 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.117 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:57.117 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:52:57.117 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:52:57.117 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:57.117 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:57.117 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:57.117 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.117 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.117 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:57.117 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:52:57.117 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 64.065741641000002, 2024-04-25T22:52:57.117 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:52:57.117 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:57.117 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:57.118 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:57.118 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:57.118 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.118 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:57.118 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:52:57.118 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:57.118 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.118 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.118 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:57.118 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:52:57.118 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:57.118 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.118 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.118 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:57.119 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:52:57.119 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:52:57.119 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.119 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.119 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:57.119 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:52:57.119 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:52:57.119 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.119 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.119 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:57.119 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:52:57.119 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:52:57.119 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.119 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.120 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:57.120 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:52:57.120 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:52:57.120 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.120 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.120 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:57.120 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:52:57.120 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:52:57.120 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.120 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.120 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:57.120 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:52:57.120 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:52:57.120 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.121 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.121 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:57.121 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:52:57.121 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:52:57.121 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.121 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.121 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:57.121 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:52:57.121 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:52:57.121 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.121 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.121 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:57.121 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:52:57.121 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:52:57.121 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.122 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.122 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:57.122 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:52:57.122 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:52:57.122 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.122 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.122 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:57.122 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:52:57.122 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:52:57.122 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:57.122 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:57.122 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:57.123 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.123 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.123 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:57.123 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:52:57.123 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 64.065232429000005, 2024-04-25T22:52:57.123 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:52:57.123 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:57.123 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:57.123 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:57.123 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:57.123 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.123 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:57.123 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:52:57.123 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:57.124 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.124 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.124 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:57.124 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:52:57.124 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:57.124 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.124 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.124 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:57.124 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:52:57.124 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:52:57.124 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.124 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.124 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:57.125 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:52:57.125 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:52:57.125 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.125 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.125 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:57.125 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:52:57.125 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:52:57.125 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.125 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.125 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:57.125 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:52:57.125 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:52:57.125 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.125 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.126 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:57.126 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:52:57.126 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:52:57.126 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.126 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.126 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:57.126 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:52:57.126 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:52:57.126 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.126 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.126 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:57.126 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:52:57.126 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:52:57.126 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.127 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.127 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:57.127 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:52:57.127 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:52:57.127 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.127 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.127 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:57.127 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:52:57.127 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:52:57.127 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.127 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.127 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:57.127 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:52:57.128 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:52:57.128 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.128 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.128 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:57.128 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:52:57.128 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:52:57.128 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:57.128 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:57.128 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:57.128 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.128 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.128 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:57.128 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:57.128 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 64.064819231000001, 2024-04-25T22:52:57.129 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:52:57.129 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:57.129 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:57.129 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:57.129 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:57.129 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.129 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:57.129 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:57.129 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:57.129 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.129 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.129 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:57.129 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:57.129 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:57.130 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.130 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.130 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:57.130 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:57.130 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:52:57.130 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.130 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.130 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:57.130 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:52:57.130 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:52:57.130 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.130 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.130 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:57.131 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:52:57.131 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:52:57.131 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.131 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.131 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:57.131 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:52:57.131 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:52:57.131 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.131 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.131 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:57.131 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:52:57.131 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:52:57.131 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.131 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.132 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:57.132 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:52:57.132 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:52:57.132 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.132 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.132 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:57.132 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:52:57.132 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:52:57.132 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.132 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.132 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:57.132 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:52:57.132 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:52:57.132 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.133 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.133 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:57.133 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:52:57.133 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:52:57.133 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.133 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.133 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:57.133 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:52:57.133 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:52:57.133 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.133 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.133 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:57.133 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:52:57.133 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:52:57.134 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:57.134 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:57.134 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:57.134 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.134 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.134 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:57.134 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:52:57.134 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 64.064768560999994, 2024-04-25T22:52:57.134 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:52:57.134 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:57.134 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:57.134 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:57.134 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:57.134 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.135 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:57.135 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:52:57.135 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:57.135 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.135 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.135 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:57.135 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:52:57.135 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:57.135 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.135 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.135 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:57.135 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:52:57.135 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:52:57.135 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.136 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.136 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:57.136 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:52:57.136 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:52:57.136 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.136 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.136 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:57.136 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:52:57.136 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:52:57.136 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.136 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.136 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:57.136 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:52:57.137 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:52:57.137 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.137 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.137 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:57.137 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:52:57.137 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:52:57.137 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.137 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.137 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:52:57.137 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:52:57.137 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:52:57.137 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.137 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.138 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:57.138 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:52:57.138 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:52:57.138 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.138 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.138 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:57.138 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:52:57.138 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:52:57.138 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.138 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.138 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:57.138 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:52:57.138 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:52:57.139 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.139 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.139 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:57.139 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:52:57.139 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:52:57.139 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.139 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.139 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:57.139 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:52:57.139 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:52:57.139 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.139 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.139 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:57.140 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:52:57.140 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:52:57.140 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.140 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.140 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:57.140 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:52:57.140 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:52:57.140 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:57.140 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:57.140 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:57.140 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.140 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.140 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:57.141 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:52:57.141 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 64.064731691999995, 2024-04-25T22:52:57.141 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:52:57.141 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:57.141 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:57.141 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:57.141 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:57.141 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.141 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:57.141 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:52:57.141 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:57.141 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.141 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.141 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:57.142 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:52:57.142 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:57.142 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.142 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.142 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:57.142 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:52:57.142 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:52:57.142 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.142 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.142 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:57.142 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:52:57.142 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:52:57.142 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.143 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.143 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:57.143 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:52:57.143 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:52:57.143 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.143 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.143 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:57.143 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:52:57.143 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:52:57.143 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.143 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.143 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:57.143 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:52:57.144 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:52:57.144 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.144 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.144 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:52:57.144 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:52:57.144 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:52:57.144 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.144 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.144 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:57.144 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:52:57.144 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:52:57.144 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.144 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.144 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:57.145 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:52:57.145 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:52:57.145 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.145 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.145 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:57.145 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:52:57.145 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:52:57.145 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.145 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.145 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:57.145 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:52:57.145 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:52:57.145 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.145 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.146 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:57.146 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:52:57.146 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:52:57.146 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.146 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.146 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:57.146 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:52:57.146 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:52:57.146 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.146 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.146 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:57.146 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:52:57.146 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:52:57.146 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:57.147 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:57.147 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:57.147 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.147 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.147 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:57.147 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:52:57.147 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 64.064706725999997, 2024-04-25T22:52:57.147 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:52:57.147 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:57.147 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:57.147 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:57.147 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:57.147 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.147 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:57.148 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:52:57.148 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:57.148 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.148 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.148 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:57.148 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:52:57.148 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:57.148 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.148 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.148 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:57.148 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:52:57.148 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:52:57.148 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.148 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.149 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:57.149 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:52:57.149 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:52:57.149 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.149 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.149 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:57.149 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:52:57.149 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:52:57.149 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.149 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.149 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:57.149 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:52:57.149 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:52:57.149 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.150 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.150 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:57.150 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:52:57.150 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:52:57.150 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.150 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.150 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:57.150 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:52:57.150 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:52:57.150 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.150 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.150 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:57.150 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:52:57.151 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:52:57.151 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.151 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.151 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:57.151 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:52:57.151 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:52:57.151 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.151 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.151 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:57.151 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:52:57.151 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:52:57.151 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.151 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.151 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:57.152 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:52:57.152 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:52:57.152 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.152 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.152 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:57.152 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:52:57.152 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:52:57.152 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:57.152 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:57.152 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:57.152 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.152 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.152 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:57.152 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:52:57.153 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 64.064670362000001, 2024-04-25T22:52:57.153 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:52:57.153 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:57.153 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:57.153 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:52:57.153 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:57.153 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.153 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:57.153 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:52:57.153 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:57.153 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.153 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.153 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:57.153 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:52:57.154 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:57.154 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.154 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.154 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:57.154 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:52:57.154 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:52:57.154 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.154 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.154 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:57.154 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:52:57.154 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:52:57.154 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.154 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.154 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:57.155 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:52:57.155 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:52:57.155 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.155 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.155 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:57.155 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:52:57.155 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:52:57.155 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.155 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.155 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:57.155 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:52:57.155 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:52:57.155 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.155 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.156 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:52:57.156 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:52:57.156 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:52:57.156 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.156 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.156 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:57.156 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:52:57.156 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:52:57.156 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.156 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.156 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:57.156 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:52:57.156 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:52:57.157 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.157 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.157 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:57.157 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:52:57.157 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:52:57.157 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:57.157 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:57.157 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:57.157 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.157 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.157 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:57.157 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:57.157 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 64.064639280999998, 2024-04-25T22:52:57.157 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:52:57.158 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:57.158 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:57.158 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:52:57.158 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:57.158 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.158 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:57.158 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:57.158 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:57.158 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.158 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.158 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:57.158 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:57.159 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:57.159 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.159 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.159 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:57.159 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:57.159 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:52:57.159 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.159 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.159 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:57.159 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:52:57.159 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:52:57.159 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.159 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.159 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:57.160 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:52:57.160 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:52:57.160 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.160 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.160 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:57.160 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:52:57.160 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:52:57.160 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.160 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.160 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:57.160 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:52:57.160 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:52:57.160 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.160 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.161 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:57.161 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:52:57.161 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:52:57.161 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.161 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.161 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:57.161 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:52:57.161 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:52:57.161 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:57.161 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:57.161 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:57.161 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.161 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.161 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:52:57.162 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:57.162 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 64.064198312000002, 2024-04-25T22:52:57.162 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064881979999999997, 2024-04-25T22:52:57.162 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:57.162 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:57.162 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:57.162 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:57.162 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.162 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:57.162 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:57.162 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:57.162 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.162 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.162 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:57.163 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:57.163 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:57.163 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.163 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.163 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:57.163 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:57.163 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2699999999999999e-07 2024-04-25T22:52:57.163 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.163 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.163 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:57.163 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013898+0000", 2024-04-25T22:52:57.163 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0796e-05 2024-04-25T22:52:57.163 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.163 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.164 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:57.164 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013907+0000", 2024-04-25T22:52:57.164 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5140000000000007e-06 2024-04-25T22:52:57.164 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.164 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.164 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:57.164 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013952+0000", 2024-04-25T22:52:57.164 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4134000000000001e-05 2024-04-25T22:52:57.164 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.164 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.164 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:57.164 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016812+0000", 2024-04-25T22:52:57.164 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028601059999999998 2024-04-25T22:52:57.164 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.165 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.165 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:57.165 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.017052+0000", 2024-04-25T22:52:57.165 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024056500000000001 2024-04-25T22:52:57.165 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.165 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.165 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:57.165 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020350+0000", 2024-04-25T22:52:57.165 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032978320000000001 2024-04-25T22:52:57.165 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.165 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.165 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:57.165 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020375+0000", 2024-04-25T22:52:57.165 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4624e-05 2024-04-25T22:52:57.166 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:57.166 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:57.166 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:57.166 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.166 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.166 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-25T22:52:57.166 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:57.166 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 64.050667865999998, 2024-04-25T22:52:57.166 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058583000000000003, 2024-04-25T22:52:57.166 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:57.166 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:57.166 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:57.167 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:57.167 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.167 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:57.167 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:57.167 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:57.167 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.167 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.167 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:57.167 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:57.167 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:57.167 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.167 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.167 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:57.167 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:57.168 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.41e-07 2024-04-25T22:52:57.168 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.168 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.168 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:57.168 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027428+0000", 2024-04-25T22:52:57.168 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.075e-05 2024-04-25T22:52:57.168 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.168 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.168 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:57.168 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027435+0000", 2024-04-25T22:52:57.168 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3610000000000003e-06 2024-04-25T22:52:57.168 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.168 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.169 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:57.169 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027442+0000", 2024-04-25T22:52:57.169 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0400000000000004e-06 2024-04-25T22:52:57.169 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.169 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.169 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:57.169 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028094+0000", 2024-04-25T22:52:57.169 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00065134800000000005 2024-04-25T22:52:57.169 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.169 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.169 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:57.169 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028107+0000", 2024-04-25T22:52:57.169 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3087e-05 2024-04-25T22:52:57.169 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.170 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.170 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:57.170 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033239+0000", 2024-04-25T22:52:57.170 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051319429999999999 2024-04-25T22:52:57.170 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.170 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.170 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:57.170 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033275+0000", 2024-04-25T22:52:57.170 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6430000000000002e-05 2024-04-25T22:52:57.170 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:57.170 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:57.170 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:57.170 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.170 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.171 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-25T22:52:57.171 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:57.171 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 64.050283028999999, 2024-04-25T22:52:57.171 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005413597, 2024-04-25T22:52:57.171 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:57.171 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:57.171 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:57.171 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:57.171 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.171 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:57.171 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:57.171 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:57.171 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.172 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.172 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:57.172 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:57.172 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:57.172 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.172 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.172 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:57.172 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:57.172 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3799999999999997e-07 2024-04-25T22:52:57.172 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.172 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.172 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:57.172 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027816+0000", 2024-04-25T22:52:57.172 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3230999999999999e-05 2024-04-25T22:52:57.173 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.173 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.173 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:57.173 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027823+0000", 2024-04-25T22:52:57.173 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9039999999999992e-06 2024-04-25T22:52:57.173 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.173 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.173 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:57.173 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027841+0000", 2024-04-25T22:52:57.173 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7651000000000001e-05 2024-04-25T22:52:57.173 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.173 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.173 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:57.173 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027904+0000", 2024-04-25T22:52:57.174 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3058000000000005e-05 2024-04-25T22:52:57.174 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.174 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.174 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:57.174 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027926+0000", 2024-04-25T22:52:57.174 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1450999999999998e-05 2024-04-25T22:52:57.174 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.174 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.174 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:57.174 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033177+0000", 2024-04-25T22:52:57.174 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052508909999999997 2024-04-25T22:52:57.174 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.174 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.174 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:57.175 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033215+0000", 2024-04-25T22:52:57.175 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8872999999999999e-05 2024-04-25T22:52:57.175 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:57.175 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:57.175 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:57.175 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.175 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.175 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 171 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:52:57.175 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:57.175 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 64.050225927, 2024-04-25T22:52:57.175 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054322240000000003, 2024-04-25T22:52:57.175 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:57.175 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:57.175 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "reached pg", 2024-04-25T22:52:57.176 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:57.176 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.176 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:57.176 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:57.176 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:57.176 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.176 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.176 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:57.176 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:57.176 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:57.176 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.176 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.176 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:57.176 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:57.177 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7500000000000001e-07 2024-04-25T22:52:57.177 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.177 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.177 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:57.177 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027868+0000", 2024-04-25T22:52:57.177 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5750000000000001e-06 2024-04-25T22:52:57.177 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.177 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.177 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:57.177 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027885+0000", 2024-04-25T22:52:57.177 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7272e-05 2024-04-25T22:52:57.177 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.177 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.177 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:57.178 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027900+0000", 2024-04-25T22:52:57.178 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.502e-05 2024-04-25T22:52:57.178 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.178 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.178 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:57.178 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028381+0000", 2024-04-25T22:52:57.178 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00048039399999999998 2024-04-25T22:52:57.178 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:57.178 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.178 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:57.178 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033291+0000", 2024-04-25T22:52:57.178 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049105879999999996 2024-04-25T22:52:57.178 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:57.178 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:57.179 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:57.179 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:57.179 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:57.179 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:57.180 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is unset 2024-04-25T22:52:57.181 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:52:57.181 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:57.179+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:57.282 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:57.281+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:57.286 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:57.286 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:52:57.286 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-04-25T22:52:57.286 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:57.295 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:52:57.382 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:57.381+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:57.397 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:57.398 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:52:57.398 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:52:57.398 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:52:57.398 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:57.407 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:52:57.483 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:57.482+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:57.511 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:52:57.511 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-04-25T22:52:57.511 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-04-25T22:52:57.511 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:52:57.511 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.512 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:57.512 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:57.512 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 69.544447270000006, 2024-04-25T22:52:57.512 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0103421, 2024-04-25T22:52:57.512 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:57.512 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:57.512 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:57.512 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:57.512 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:57.512 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:57.512 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 115 2024-04-25T22:52:57.512 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.512 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:57.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.513 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:57.513 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:57.513 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:57.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.513 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:57.513 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:57.513 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:57.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.513 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:57.513 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:52:57.513 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9500000000000002e-07 2024-04-25T22:52:57.514 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.514 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.514 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:57.514 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965108+0000", 2024-04-25T22:52:57.514 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9177999999999994e-05 2024-04-25T22:52:57.514 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.514 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.514 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:57.514 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965127+0000", 2024-04-25T22:52:57.514 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8868e-05 2024-04-25T22:52:57.514 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.514 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.514 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:57.514 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965133+0000", 2024-04-25T22:52:57.515 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8929999999999999e-06 2024-04-25T22:52:57.515 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.515 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.515 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:57.515 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.969991+0000", 2024-04-25T22:52:57.515 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048573849999999997 2024-04-25T22:52:57.515 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.515 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.515 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:57.515 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970072+0000", 2024-04-25T22:52:57.515 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0728000000000004e-05 2024-04-25T22:52:57.515 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.515 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.515 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:57.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970189+0000", 2024-04-25T22:52:57.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000117778 2024-04-25T22:52:57.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:57.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970946+0000", 2024-04-25T22:52:57.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00075704600000000004 2024-04-25T22:52:57.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:57.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975297+0000", 2024-04-25T22:52:57.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004350217 2024-04-25T22:52:57.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:57.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975343+0000", 2024-04-25T22:52:57.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6687999999999998e-05 2024-04-25T22:52:57.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:57.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975380+0000", 2024-04-25T22:52:57.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6724000000000003e-05 2024-04-25T22:52:57.517 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:57.517 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:57.517 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:57.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.517 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:57.518 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:57.518 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 69.544341239000005, 2024-04-25T22:52:57.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010304384, 2024-04-25T22:52:57.518 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:57.518 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:57.518 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:57.518 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:57.518 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:57.518 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:57.518 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 116 2024-04-25T22:52:57.518 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.518 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:57.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.519 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:57.519 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:57.519 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:57.519 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.519 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.519 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:57.519 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:57.519 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:57.520 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.520 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:57.520 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:52:57.520 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5799999999999999e-07 2024-04-25T22:52:57.520 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.520 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:57.520 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965154+0000", 2024-04-25T22:52:57.520 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0009e-05 2024-04-25T22:52:57.520 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.520 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:57.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965164+0000", 2024-04-25T22:52:57.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8490000000000001e-06 2024-04-25T22:52:57.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:57.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965169+0000", 2024-04-25T22:52:57.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0730000000000004e-06 2024-04-25T22:52:57.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:57.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970609+0000", 2024-04-25T22:52:57.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054397689999999997 2024-04-25T22:52:57.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:57.522 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970651+0000", 2024-04-25T22:52:57.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1873999999999999e-05 2024-04-25T22:52:57.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.522 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:57.522 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970723+0000", 2024-04-25T22:52:57.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2039999999999995e-05 2024-04-25T22:52:57.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.522 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:57.522 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971358+0000", 2024-04-25T22:52:57.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063489500000000001 2024-04-25T22:52:57.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.523 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:57.523 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975409+0000", 2024-04-25T22:52:57.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040506880000000002 2024-04-25T22:52:57.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.523 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.523 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:57.523 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975432+0000", 2024-04-25T22:52:57.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3315999999999998e-05 2024-04-25T22:52:57.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.523 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.523 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:57.523 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975448+0000", 2024-04-25T22:52:57.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6313000000000001e-05 2024-04-25T22:52:57.523 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:57.523 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:57.524 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:57.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.524 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:52:57.524 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:57.524 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 69.544306657000007, 2024-04-25T22:52:57.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010384338999999999, 2024-04-25T22:52:57.524 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:57.524 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:57.524 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:57.524 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:52:57.524 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:52:57.524 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:52:57.525 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-04-25T22:52:57.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.525 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:57.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:57.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:57.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:57.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:57.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:57.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:57.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:57.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:52:57.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3600000000000004e-07 2024-04-25T22:52:57.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.527 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:57.527 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965185+0000", 2024-04-25T22:52:57.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.117e-06 2024-04-25T22:52:57.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.527 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:57.527 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965192+0000", 2024-04-25T22:52:57.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3239999999999997e-06 2024-04-25T22:52:57.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.527 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:57.527 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965198+0000", 2024-04-25T22:52:57.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6370000000000004e-06 2024-04-25T22:52:57.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.528 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:57.528 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970973+0000", 2024-04-25T22:52:57.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057748239999999996 2024-04-25T22:52:57.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.528 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:57.528 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971049+0000", 2024-04-25T22:52:57.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6029e-05 2024-04-25T22:52:57.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:57.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971174+0000", 2024-04-25T22:52:57.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012462399999999999 2024-04-25T22:52:57.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:57.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971553+0000", 2024-04-25T22:52:57.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037896499999999999 2024-04-25T22:52:57.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:57.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975482+0000", 2024-04-25T22:52:57.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039297459999999996 2024-04-25T22:52:57.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:57.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975529+0000", 2024-04-25T22:52:57.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6387000000000002e-05 2024-04-25T22:52:57.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:57.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975563+0000", 2024-04-25T22:52:57.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4150000000000003e-05 2024-04-25T22:52:57.531 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:57.531 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:57.531 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:57.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.532 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:57.532 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:57.532 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 64.497260334000003, 2024-04-25T22:52:57.532 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012637705000000001, 2024-04-25T22:52:57.532 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:57.532 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:57.532 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:57.532 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:57.532 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.532 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:57.532 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:57.532 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:57.532 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.532 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.533 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:57.533 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:52:57.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:57.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.533 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:57.533 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012227+0000", 2024-04-25T22:52:57.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.863e-06 2024-04-25T22:52:57.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.533 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:57.533 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012236+0000", 2024-04-25T22:52:57.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1109999999999997e-06 2024-04-25T22:52:57.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:57.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012309+0000", 2024-04-25T22:52:57.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3242000000000001e-05 2024-04-25T22:52:57.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:57.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012324+0000", 2024-04-25T22:52:57.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4837e-05 2024-04-25T22:52:57.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:57.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015060+0000", 2024-04-25T22:52:57.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027363349999999999 2024-04-25T22:52:57.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:57.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015169+0000", 2024-04-25T22:52:57.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108372 2024-04-25T22:52:57.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:57.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015498+0000", 2024-04-25T22:52:57.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032949999999999999 2024-04-25T22:52:57.536 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:57.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021282+0000", 2024-04-25T22:52:57.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057836429999999998 2024-04-25T22:52:57.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:57.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024709+0000", 2024-04-25T22:52:57.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034271979999999998 2024-04-25T22:52:57.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:57.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024802+0000", 2024-04-25T22:52:57.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2960000000000004e-05 2024-04-25T22:52:57.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.538 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:57.538 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024863+0000", 2024-04-25T22:52:57.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0643999999999997e-05 2024-04-25T22:52:57.538 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:57.538 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:57.538 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:57.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.538 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:57.538 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:57.538 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 64.497136562999998, 2024-04-25T22:52:57.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012979447999999999, 2024-04-25T22:52:57.539 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:57.539 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:57.539 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:57.539 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:57.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:57.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:57.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:57.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:57.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:57.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:57.540 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.540 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:57.540 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:52:57.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:52:57.540 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.540 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:57.540 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012354+0000", 2024-04-25T22:52:57.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7740000000000004e-06 2024-04-25T22:52:57.540 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.540 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:57.540 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012365+0000", 2024-04-25T22:52:57.541 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.064e-05 2024-04-25T22:52:57.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.541 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.541 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:57.541 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012382+0000", 2024-04-25T22:52:57.541 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6999000000000001e-05 2024-04-25T22:52:57.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.541 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.541 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:57.541 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015958+0000", 2024-04-25T22:52:57.541 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035765699999999998 2024-04-25T22:52:57.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.541 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.541 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:57.542 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016037+0000", 2024-04-25T22:52:57.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8242000000000001e-05 2024-04-25T22:52:57.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.542 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:57.542 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016404+0000", 2024-04-25T22:52:57.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036784300000000002 2024-04-25T22:52:57.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.542 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:57.542 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021294+0000", 2024-04-25T22:52:57.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048890629999999999 2024-04-25T22:52:57.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:57.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024959+0000", 2024-04-25T22:52:57.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036651570000000001 2024-04-25T22:52:57.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:57.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025097+0000", 2024-04-25T22:52:57.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013788099999999999 2024-04-25T22:52:57.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:57.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025328+0000", 2024-04-25T22:52:57.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231492 2024-04-25T22:52:57.544 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:57.545 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:57.545 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:57.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.546 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:57.546 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:57.546 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 64.497048793999994, 2024-04-25T22:52:57.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013049827, 2024-04-25T22:52:57.546 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:57.546 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:57.546 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:57.546 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:57.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.546 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:57.546 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:57.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:57.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.548 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:57.548 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:52:57.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:57.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.548 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:57.548 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012437+0000", 2024-04-25T22:52:57.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-04-25T22:52:57.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.548 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:57.548 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012440+0000", 2024-04-25T22:52:57.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7609999999999999e-06 2024-04-25T22:52:57.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:57.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012449+0000", 2024-04-25T22:52:57.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.285e-06 2024-04-25T22:52:57.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:57.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012457+0000", 2024-04-25T22:52:57.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9510000000000006e-06 2024-04-25T22:52:57.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:57.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017106+0000", 2024-04-25T22:52:57.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046494220000000003 2024-04-25T22:52:57.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:57.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017223+0000", 2024-04-25T22:52:57.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116824 2024-04-25T22:52:57.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:57.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017345+0000", 2024-04-25T22:52:57.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122175 2024-04-25T22:52:57.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:57.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021299+0000", 2024-04-25T22:52:57.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039534879999999998 2024-04-25T22:52:57.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:57.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025398+0000", 2024-04-25T22:52:57.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040988960000000003 2024-04-25T22:52:57.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:57.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025439+0000", 2024-04-25T22:52:57.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0915999999999999e-05 2024-04-25T22:52:57.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:57.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025486+0000", 2024-04-25T22:52:57.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7534999999999998e-05 2024-04-25T22:52:57.552 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:57.552 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:57.552 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:57.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.552 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:57.552 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:57.552 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 64.497018643000004, 2024-04-25T22:52:57.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020988041999999998, 2024-04-25T22:52:57.552 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:57.553 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:57.553 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:57.553 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:57.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:57.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:57.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:57.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:57.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:57.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:57.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:57.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:52:57.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.99e-07 2024-04-25T22:52:57.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:57.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012470+0000", 2024-04-25T22:52:57.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2789999999999999e-06 2024-04-25T22:52:57.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:57.555 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012477+0000", 2024-04-25T22:52:57.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:52:57.555 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.555 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:57.555 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012500+0000", 2024-04-25T22:52:57.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2490999999999999e-05 2024-04-25T22:52:57.555 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.555 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:57.555 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021911+0000", 2024-04-25T22:52:57.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094114160000000006 2024-04-25T22:52:57.555 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:57.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022000+0000", 2024-04-25T22:52:57.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8601000000000001e-05 2024-04-25T22:52:57.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:57.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022359+0000", 2024-04-25T22:52:57.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035921999999999999 2024-04-25T22:52:57.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:57.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025541+0000", 2024-04-25T22:52:57.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031820619999999998 2024-04-25T22:52:57.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.557 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:57.557 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033375+0000", 2024-04-25T22:52:57.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078338379999999992 2024-04-25T22:52:57.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.557 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:57.557 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033415+0000", 2024-04-25T22:52:57.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9527000000000003e-05 2024-04-25T22:52:57.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.557 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:57.557 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033455+0000", 2024-04-25T22:52:57.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9932000000000003e-05 2024-04-25T22:52:57.558 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:57.558 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:57.558 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:57.558 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.558 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.558 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:57.558 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:57.558 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 64.496963449999996, 2024-04-25T22:52:57.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021043857999999999, 2024-04-25T22:52:57.558 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:57.558 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:57.558 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:57.558 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:57.558 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.559 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:57.559 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:57.559 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:57.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.559 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:57.559 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:52:57.559 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:57.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.559 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:57.559 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012523+0000", 2024-04-25T22:52:57.559 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.361e-06 2024-04-25T22:52:57.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.560 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.560 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:57.560 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012530+0000", 2024-04-25T22:52:57.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5440000000000004e-06 2024-04-25T22:52:57.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.560 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.560 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:57.560 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012541+0000", 2024-04-25T22:52:57.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1745e-05 2024-04-25T22:52:57.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.560 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.560 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:57.560 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012551+0000", 2024-04-25T22:52:57.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5789999999999993e-06 2024-04-25T22:52:57.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:57.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022709+0000", 2024-04-25T22:52:57.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010157685 2024-04-25T22:52:57.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:57.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022957+0000", 2024-04-25T22:52:57.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024824599999999998 2024-04-25T22:52:57.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:57.562 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023443+0000", 2024-04-25T22:52:57.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048578599999999999 2024-04-25T22:52:57.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.562 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.562 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:57.562 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025547+0000", 2024-04-25T22:52:57.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021044789999999998 2024-04-25T22:52:57.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.562 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.562 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:57.562 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033509+0000", 2024-04-25T22:52:57.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0079622180000000001 2024-04-25T22:52:57.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.563 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.563 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:57.563 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033542+0000", 2024-04-25T22:52:57.563 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3018000000000001e-05 2024-04-25T22:52:57.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.563 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.563 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:57.563 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033566+0000", 2024-04-25T22:52:57.563 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3197000000000002e-05 2024-04-25T22:52:57.563 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:57.563 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:57.563 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:57.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.563 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.564 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:57.564 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:57.564 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 64.496923484999996, 2024-04-25T22:52:57.564 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021122696, 2024-04-25T22:52:57.564 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:57.564 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:57.564 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:57.564 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:57.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.564 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:57.564 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:57.564 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:57.564 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:57.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:57.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:57.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:57.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:52:57.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:52:57.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:57.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012566+0000", 2024-04-25T22:52:57.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-04-25T22:52:57.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:57.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012619+0000", 2024-04-25T22:52:57.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2607e-05 2024-04-25T22:52:57.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:57.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012628+0000", 2024-04-25T22:52:57.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6500000000000008e-06 2024-04-25T22:52:57.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:57.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024024+0000", 2024-04-25T22:52:57.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011396007999999999 2024-04-25T22:52:57.567 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.567 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.567 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:57.567 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024198+0000", 2024-04-25T22:52:57.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000173215 2024-04-25T22:52:57.567 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.567 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.567 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:57.567 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024447+0000", 2024-04-25T22:52:57.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024898500000000002 2024-04-25T22:52:57.567 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.567 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.567 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:57.568 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026431+0000", 2024-04-25T22:52:57.568 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001984923 2024-04-25T22:52:57.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.568 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:57.568 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033608+0000", 2024-04-25T22:52:57.568 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071768459999999997 2024-04-25T22:52:57.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.568 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:57.568 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033646+0000", 2024-04-25T22:52:57.568 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299000000000003e-05 2024-04-25T22:52:57.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.569 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:57.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033684+0000", 2024-04-25T22:52:57.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8773000000000003e-05 2024-04-25T22:52:57.569 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:57.569 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:57.569 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:57.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.569 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:57.569 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:57.569 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 64.496834886000002, 2024-04-25T22:52:57.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021175381, 2024-04-25T22:52:57.569 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:57.569 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:57.570 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:57.570 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:57.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:57.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:57.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:57.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:57.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:52:57.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:57.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:57.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012651+0000", 2024-04-25T22:52:57.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:52:57.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:57.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012656+0000", 2024-04-25T22:52:57.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8899999999999998e-06 2024-04-25T22:52:57.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:57.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012666+0000", 2024-04-25T22:52:57.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0346999999999999e-05 2024-04-25T22:52:57.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.572 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.572 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:57.572 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012675+0000", 2024-04-25T22:52:57.572 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9930000000000001e-06 2024-04-25T22:52:57.572 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.572 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.572 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:57.572 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025661+0000", 2024-04-25T22:52:57.572 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01298531 2024-04-25T22:52:57.572 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.572 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.572 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:57.572 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025757+0000", 2024-04-25T22:52:57.572 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5822000000000005e-05 2024-04-25T22:52:57.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:57.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025907+0000", 2024-04-25T22:52:57.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015051499999999999 2024-04-25T22:52:57.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:57.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026435+0000", 2024-04-25T22:52:57.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052762200000000005 2024-04-25T22:52:57.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:57.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033732+0000", 2024-04-25T22:52:57.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072978419999999997 2024-04-25T22:52:57.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:57.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033787+0000", 2024-04-25T22:52:57.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4703999999999997e-05 2024-04-25T22:52:57.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:57.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033826+0000", 2024-04-25T22:52:57.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8458999999999999e-05 2024-04-25T22:52:57.574 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:57.574 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:57.575 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:57.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.575 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:57.575 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:57.575 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 64.496779472, 2024-04-25T22:52:57.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021244174000000001, 2024-04-25T22:52:57.575 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:57.575 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:57.575 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:57.575 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:57.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:57.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:57.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:57.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.576 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:57.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:57.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:57.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.576 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:57.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:52:57.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:52:57.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:57.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012712+0000", 2024-04-25T22:52:57.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.913e-06 2024-04-25T22:52:57.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:57.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012722+0000", 2024-04-25T22:52:57.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2879999999999998e-06 2024-04-25T22:52:57.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:57.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012727+0000", 2024-04-25T22:52:57.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8429999999999998e-06 2024-04-25T22:52:57.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:57.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026099+0000", 2024-04-25T22:52:57.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013371450999999999 2024-04-25T22:52:57.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:57.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026147+0000", 2024-04-25T22:52:57.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7837999999999998e-05 2024-04-25T22:52:57.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:57.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026254+0000", 2024-04-25T22:52:57.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107314 2024-04-25T22:52:57.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:57.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026686+0000", 2024-04-25T22:52:57.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000432428 2024-04-25T22:52:57.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:57.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033873+0000", 2024-04-25T22:52:57.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071864399999999997 2024-04-25T22:52:57.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:57.580 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033904+0000", 2024-04-25T22:52:57.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1321e-05 2024-04-25T22:52:57.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.580 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:57.580 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033950+0000", 2024-04-25T22:52:57.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5707999999999997e-05 2024-04-25T22:52:57.580 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:57.580 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:57.580 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:57.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.580 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:57.581 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:57.581 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 64.496749086999998, 2024-04-25T22:52:57.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01096505, 2024-04-25T22:52:57.581 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:57.581 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:57.581 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:57.581 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:57.581 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.581 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:57.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:57.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:57.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.581 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.581 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:57.582 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:52:57.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:57.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:57.582 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012737+0000", 2024-04-25T22:52:57.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:52:57.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:57.582 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012739+0000", 2024-04-25T22:52:57.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-04-25T22:52:57.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:57.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012743+0000", 2024-04-25T22:52:57.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3239999999999996e-06 2024-04-25T22:52:57.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:57.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012746+0000", 2024-04-25T22:52:57.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.129e-06 2024-04-25T22:52:57.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:57.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012796+0000", 2024-04-25T22:52:57.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9231999999999999e-05 2024-04-25T22:52:57.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:57.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012915+0000", 2024-04-25T22:52:57.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119021 2024-04-25T22:52:57.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:57.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013069+0000", 2024-04-25T22:52:57.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015463900000000001 2024-04-25T22:52:57.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:57.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019237+0000", 2024-04-25T22:52:57.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061680329999999998 2024-04-25T22:52:57.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:57.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023603+0000", 2024-04-25T22:52:57.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043655860000000003 2024-04-25T22:52:57.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:57.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023659+0000", 2024-04-25T22:52:57.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6484000000000003e-05 2024-04-25T22:52:57.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.586 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:57.586 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023701+0000", 2024-04-25T22:52:57.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1761999999999998e-05 2024-04-25T22:52:57.586 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:57.586 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:57.586 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:57.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.586 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:57.586 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:57.586 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 64.496724138999994, 2024-04-25T22:52:57.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011234429000000001, 2024-04-25T22:52:57.586 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:57.587 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:57.587 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:57.587 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:57.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.587 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:57.587 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:57.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:57.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.587 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:57.587 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:52:57.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:57.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:57.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012762+0000", 2024-04-25T22:52:57.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-04-25T22:52:57.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:57.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012765+0000", 2024-04-25T22:52:57.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2569999999999999e-06 2024-04-25T22:52:57.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:57.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012783+0000", 2024-04-25T22:52:57.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8431999999999999e-05 2024-04-25T22:52:57.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:57.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012799+0000", 2024-04-25T22:52:57.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5438999999999999e-05 2024-04-25T22:52:57.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:57.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013826+0000", 2024-04-25T22:52:57.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010275060000000001 2024-04-25T22:52:57.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:57.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013913+0000", 2024-04-25T22:52:57.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.708e-05 2024-04-25T22:52:57.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.590 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.590 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:57.590 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014098+0000", 2024-04-25T22:52:57.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018519399999999999 2024-04-25T22:52:57.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.590 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.590 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:57.590 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019684+0000", 2024-04-25T22:52:57.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055860079999999999 2024-04-25T22:52:57.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.590 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.590 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:57.591 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023876+0000", 2024-04-25T22:52:57.591 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041918800000000003 2024-04-25T22:52:57.591 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.591 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.591 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:57.591 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023957+0000", 2024-04-25T22:52:57.591 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1165e-05 2024-04-25T22:52:57.591 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.591 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.591 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:57.591 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023995+0000", 2024-04-25T22:52:57.591 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:52:57.591 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:57.591 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:57.592 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:57.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.592 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.592 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:57.592 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:57.592 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 64.496626359999993, 2024-04-25T22:52:57.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011131200000000001, 2024-04-25T22:52:57.592 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:57.592 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:57.592 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:57.592 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:57.592 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.592 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:57.592 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:57.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:57.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.593 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:57.593 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:52:57.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:57.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.593 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:57.593 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012860+0000", 2024-04-25T22:52:57.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3900000000000004e-07 2024-04-25T22:52:57.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.593 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:57.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012865+0000", 2024-04-25T22:52:57.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5609999999999998e-06 2024-04-25T22:52:57.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:57.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012895+0000", 2024-04-25T22:52:57.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9847000000000001e-05 2024-04-25T22:52:57.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:57.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012905+0000", 2024-04-25T22:52:57.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.03e-05 2024-04-25T22:52:57.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.595 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:57.595 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015020+0000", 2024-04-25T22:52:57.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021142940000000001 2024-04-25T22:52:57.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.595 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:57.595 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015182+0000", 2024-04-25T22:52:57.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016248099999999999 2024-04-25T22:52:57.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.595 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:52:57.595 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015357+0000", 2024-04-25T22:52:57.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017471000000000001 2024-04-25T22:52:57.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:57.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021021+0000", 2024-04-25T22:52:57.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056638340000000004 2024-04-25T22:52:57.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:57.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023712+0000", 2024-04-25T22:52:57.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026910380000000002 2024-04-25T22:52:57.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:57.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023763+0000", 2024-04-25T22:52:57.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1477999999999997e-05 2024-04-25T22:52:57.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:57.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023990+0000", 2024-04-25T22:52:57.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000226818 2024-04-25T22:52:57.597 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:57.597 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:57.597 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:57.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.597 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:57.597 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:57.597 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 64.496503263999998, 2024-04-25T22:52:57.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011705299000000001, 2024-04-25T22:52:57.598 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:57.598 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:57.598 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:57.598 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:57.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.598 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:57.598 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:57.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:57.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.598 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:57.598 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:52:57.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:57.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.599 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:57.599 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012983+0000", 2024-04-25T22:52:57.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:52:57.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.599 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:57.599 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012986+0000", 2024-04-25T22:52:57.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5700000000000001e-06 2024-04-25T22:52:57.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.599 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:57.599 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012993+0000", 2024-04-25T22:52:57.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8730000000000001e-06 2024-04-25T22:52:57.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:57.600 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013000+0000", 2024-04-25T22:52:57.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1890000000000001e-06 2024-04-25T22:52:57.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:57.600 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:52:57.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002147866 2024-04-25T22:52:57.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:57.600 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015351+0000", 2024-04-25T22:52:57.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020300799999999999 2024-04-25T22:52:57.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:57.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016260+0000", 2024-04-25T22:52:57.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00090926799999999997 2024-04-25T22:52:57.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:57.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022669+0000", 2024-04-25T22:52:57.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064082849999999997 2024-04-25T22:52:57.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:57.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024584+0000", 2024-04-25T22:52:57.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019151699999999999 2024-04-25T22:52:57.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:57.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024643+0000", 2024-04-25T22:52:57.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8888999999999998e-05 2024-04-25T22:52:57.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:57.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024687+0000", 2024-04-25T22:52:57.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4444999999999999e-05 2024-04-25T22:52:57.602 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:57.603 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:57.603 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:57.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.603 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:57.603 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:57.603 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 64.496475673000006, 2024-04-25T22:52:57.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011249699, 2024-04-25T22:52:57.603 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:57.603 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:57.603 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:57.603 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:57.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:57.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:57.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:57.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:57.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:52:57.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:57.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:57.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013010+0000", 2024-04-25T22:52:57.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2099999999999996e-07 2024-04-25T22:52:57.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:57.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013013+0000", 2024-04-25T22:52:57.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1310000000000002e-06 2024-04-25T22:52:57.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:57.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013020+0000", 2024-04-25T22:52:57.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3330000000000002e-06 2024-04-25T22:52:57.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:57.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013025+0000", 2024-04-25T22:52:57.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6760000000000004e-06 2024-04-25T22:52:57.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:57.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013163+0000", 2024-04-25T22:52:57.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013824599999999999 2024-04-25T22:52:57.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:57.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013504+0000", 2024-04-25T22:52:57.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034080299999999998 2024-04-25T22:52:57.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:57.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013613+0000", 2024-04-25T22:52:57.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108705 2024-04-25T22:52:57.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.607 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:57.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015831+0000", 2024-04-25T22:52:57.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002217672 2024-04-25T22:52:57.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.607 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:57.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024137+0000", 2024-04-25T22:52:57.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0083060489999999994 2024-04-25T22:52:57.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.607 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:57.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024218+0000", 2024-04-25T22:52:57.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1351000000000001e-05 2024-04-25T22:52:57.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:57.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024259+0000", 2024-04-25T22:52:57.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1112000000000002e-05 2024-04-25T22:52:57.608 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:57.608 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:57.608 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:57.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.608 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:57.608 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:57.608 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 64.496387947000002, 2024-04-25T22:52:57.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020379749999999999, 2024-04-25T22:52:57.609 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:57.609 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:57.609 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:57.609 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:57.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:57.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:57.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:57.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:57.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:52:57.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:57.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:57.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013098+0000", 2024-04-25T22:52:57.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:52:57.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:57.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013105+0000", 2024-04-25T22:52:57.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5969999999999997e-06 2024-04-25T22:52:57.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:57.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013190+0000", 2024-04-25T22:52:57.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5618999999999995e-05 2024-04-25T22:52:57.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:57.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013200+0000", 2024-04-25T22:52:57.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5859999999999994e-06 2024-04-25T22:52:57.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:57.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020265+0000", 2024-04-25T22:52:57.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070653349999999998 2024-04-25T22:52:57.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:57.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020454+0000", 2024-04-25T22:52:57.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189316 2024-04-25T22:52:57.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:57.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020586+0000", 2024-04-25T22:52:57.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013195700000000001 2024-04-25T22:52:57.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:57.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023822+0000", 2024-04-25T22:52:57.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032358529999999999 2024-04-25T22:52:57.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.613 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:57.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033409+0000", 2024-04-25T22:52:57.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095870520000000004 2024-04-25T22:52:57.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.613 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:57.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033447+0000", 2024-04-25T22:52:57.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7261999999999997e-05 2024-04-25T22:52:57.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.613 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:57.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033477+0000", 2024-04-25T22:52:57.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0389e-05 2024-04-25T22:52:57.614 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:57.614 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:57.614 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:57.614 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.614 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:57.614 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:57.614 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 64.496271441000005, 2024-04-25T22:52:57.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010857383999999999, 2024-04-25T22:52:57.614 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:57.614 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:57.614 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:57.614 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:57.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:57.615 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:57.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:57.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:57.615 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:57.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:57.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:57.615 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:52:57.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:52:57.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:57.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013218+0000", 2024-04-25T22:52:57.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8199999999999998e-06 2024-04-25T22:52:57.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:57.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013226+0000", 2024-04-25T22:52:57.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7649999999999993e-06 2024-04-25T22:52:57.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:57.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013259+0000", 2024-04-25T22:52:57.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2727e-05 2024-04-25T22:52:57.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:57.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014809+0000", 2024-04-25T22:52:57.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001550144 2024-04-25T22:52:57.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:57.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014958+0000", 2024-04-25T22:52:57.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014890300000000001 2024-04-25T22:52:57.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:52:57.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015087+0000", 2024-04-25T22:52:57.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012939200000000001 2024-04-25T22:52:57.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:57.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020212+0000", 2024-04-25T22:52:57.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051248939999999996 2024-04-25T22:52:57.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:57.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023699+0000", 2024-04-25T22:52:57.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034873289999999999 2024-04-25T22:52:57.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.619 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:57.619 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024014+0000", 2024-04-25T22:52:57.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031473999999999999 2024-04-25T22:52:57.619 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.619 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:57.619 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024071+0000", 2024-04-25T22:52:57.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7040000000000003e-05 2024-04-25T22:52:57.619 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:57.619 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:57.619 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:57.619 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.620 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:57.620 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:57.620 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 64.496216735999994, 2024-04-25T22:52:57.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012329677000000001, 2024-04-25T22:52:57.620 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:57.620 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:57.620 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:57.620 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:57.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.620 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:57.620 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:57.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:57.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:57.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:52:57.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:57.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:57.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013269+0000", 2024-04-25T22:52:57.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5000000000000002e-07 2024-04-25T22:52:57.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:57.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:52:57.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6909999999999999e-06 2024-04-25T22:52:57.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:57.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013284+0000", 2024-04-25T22:52:57.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0963e-05 2024-04-25T22:52:57.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:57.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013361+0000", 2024-04-25T22:52:57.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7379999999999994e-05 2024-04-25T22:52:57.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:57.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013448+0000", 2024-04-25T22:52:57.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6990000000000006e-05 2024-04-25T22:52:57.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:57.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013632+0000", 2024-04-25T22:52:57.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018396800000000001 2024-04-25T22:52:57.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:52:57.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013800+0000", 2024-04-25T22:52:57.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167467 2024-04-25T22:52:57.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:52:57.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.018570+0000", 2024-04-25T22:52:57.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047701460000000003 2024-04-25T22:52:57.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:57.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025507+0000", 2024-04-25T22:52:57.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069372039999999998 2024-04-25T22:52:57.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:52:57.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025562+0000", 2024-04-25T22:52:57.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4858999999999998e-05 2024-04-25T22:52:57.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:57.625 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025598+0000", 2024-04-25T22:52:57.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6259e-05 2024-04-25T22:52:57.625 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:57.625 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:57.625 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:57.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.625 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:57.625 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:57.625 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 64.496084862999993, 2024-04-25T22:52:57.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020176666999999999, 2024-04-25T22:52:57.625 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:52:57.625 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:52:57.626 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:52:57.626 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:52:57.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:52:57.626 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:57.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:57.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:52:57.626 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:52:57.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:52:57.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:52:57.627 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:52:57.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-04-25T22:52:57.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.627 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:52:57.627 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013405+0000", 2024-04-25T22:52:57.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0559999999999998e-06 2024-04-25T22:52:57.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.627 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:52:57.627 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013422+0000", 2024-04-25T22:52:57.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6770999999999999e-05 2024-04-25T22:52:57.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:52:57.628 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013431+0000", 2024-04-25T22:52:57.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5019999999999998e-06 2024-04-25T22:52:57.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:52:57.628 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021720+0000", 2024-04-25T22:52:57.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082884340000000008 2024-04-25T22:52:57.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:52:57.628 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022122+0000", 2024-04-25T22:52:57.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000401634 2024-04-25T22:52:57.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:52:57.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:52:57.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:52:57.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033577+0000", 2024-04-25T22:52:57.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011455435999999999 2024-04-25T22:52:57.629 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:57.629 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:57.629 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:57.629 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:52:57.629 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:52:57.629 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:52:57.631 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:52:57.631 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:57.630+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:57.731 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:57.731+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:57.736 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:57.736 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:52:57.736 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-25T22:52:57.736 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:57.745 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:52:57.832 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:57.831+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:57.846 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:57.847 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:52:57.847 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-25T22:52:57.847 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-25T22:52:57.847 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:57.855 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:52:57.933 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:57.932+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:57.976 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:52:57.999 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:52:57.999 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:52:57.999 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:52:57.999 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:52:57.999 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:57.999 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:52:57.999 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:52:57.999 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 70.030365979999999, 2024-04-25T22:52:57.999 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:52:57.999 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:58.000 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:58.000 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:58.000 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:58.000 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.000 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:58.000 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:52:58.000 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:58.000 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.000 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.000 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:58.000 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:52:58.000 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:58.000 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.000 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.001 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:58.001 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:52:58.001 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:52:58.001 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.001 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.001 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:58.001 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:52:58.001 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:52:58.001 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.001 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.001 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:58.001 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:52:58.001 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:52:58.002 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.002 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.002 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:58.002 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:52:58.002 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:52:58.002 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.002 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.002 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:58.002 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:52:58.002 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:52:58.002 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.002 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.002 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:58.002 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:52:58.003 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:52:58.003 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.003 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.003 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:58.003 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:52:58.003 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:52:58.003 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.003 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.003 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:58.003 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:52:58.003 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:52:58.003 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:58.003 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:58.004 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:58.004 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.004 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.004 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:110 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'72, mlcod=10'68)", 2024-04-25T22:52:58.004 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:58.004 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 70.029731979999994, 2024-04-25T22:52:58.004 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065316630000000001, 2024-04-25T22:52:58.004 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:58.004 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:58.004 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:58.004 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:58.004 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.004 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:58.005 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:58.005 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:58.005 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.005 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.005 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:58.005 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:58.005 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:58.005 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.005 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.005 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:58.005 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:52:58.005 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.58e-07 2024-04-25T22:52:58.005 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.005 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.006 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:58.006 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967811+0000", 2024-04-25T22:52:58.006 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.118e-06 2024-04-25T22:52:58.006 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.006 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.006 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:58.006 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967817+0000", 2024-04-25T22:52:58.006 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3709999999999996e-06 2024-04-25T22:52:58.006 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.006 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.006 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:58.006 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967820+0000", 2024-04-25T22:52:58.006 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2210000000000002e-06 2024-04-25T22:52:58.007 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.007 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.007 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:58.007 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967876+0000", 2024-04-25T22:52:58.007 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5507000000000002e-05 2024-04-25T22:52:58.007 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.007 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.007 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:58.007 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967893+0000", 2024-04-25T22:52:58.007 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7812000000000002e-05 2024-04-25T22:52:58.007 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.007 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.007 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:58.007 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974317+0000", 2024-04-25T22:52:58.008 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064237160000000003 2024-04-25T22:52:58.008 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.008 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.008 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:58.008 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:52:58.008 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.156e-05 2024-04-25T22:52:58.008 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:58.008 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:58.008 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:58.008 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.008 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.008 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'68)", 2024-04-25T22:52:58.008 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:58.008 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 70.029314467000006, 2024-04-25T22:52:58.009 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061292279999999996, 2024-04-25T22:52:58.009 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:58.009 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:58.009 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:58.009 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:58.009 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.009 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:58.009 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:58.009 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:58.009 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.009 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.009 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:58.009 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:58.009 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:58.010 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.010 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.010 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:58.010 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:52:58.010 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6300000000000001e-07 2024-04-25T22:52:58.010 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.010 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.010 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:58.010 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968228+0000", 2024-04-25T22:52:58.010 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6139999999999999e-06 2024-04-25T22:52:58.010 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.010 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.010 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:58.011 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968235+0000", 2024-04-25T22:52:58.011 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7020000000000001e-06 2024-04-25T22:52:58.011 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.011 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.011 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:58.011 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968238+0000", 2024-04-25T22:52:58.011 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0010000000000002e-06 2024-04-25T22:52:58.011 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.011 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.011 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:58.011 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968297+0000", 2024-04-25T22:52:58.011 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8424999999999997e-05 2024-04-25T22:52:58.011 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.011 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.012 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:58.012 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968316+0000", 2024-04-25T22:52:58.012 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8814999999999999e-05 2024-04-25T22:52:58.012 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.012 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.012 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:58.012 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:52:58.012 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060239439999999998 2024-04-25T22:52:58.012 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.012 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.012 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:58.012 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974354+0000", 2024-04-25T22:52:58.013 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4364e-05 2024-04-25T22:52:58.013 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:58.013 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:58.013 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:58.013 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.013 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.013 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'68)", 2024-04-25T22:52:58.013 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:58.013 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 70.028877464999994, 2024-04-25T22:52:58.013 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005948414, 2024-04-25T22:52:58.013 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:58.013 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:58.013 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:58.013 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:58.014 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.014 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:58.014 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:58.014 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:58.014 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.014 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.014 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:58.014 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:58.014 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:58.014 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.014 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.014 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:58.014 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:52:58.015 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6199999999999998e-07 2024-04-25T22:52:58.015 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.015 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.015 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:58.015 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968723+0000", 2024-04-25T22:52:58.015 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1148999999999993e-05 2024-04-25T22:52:58.015 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.015 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.015 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:58.015 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968730+0000", 2024-04-25T22:52:58.015 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1749999999999999e-06 2024-04-25T22:52:58.015 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.015 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.016 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:58.016 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968734+0000", 2024-04-25T22:52:58.016 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5200000000000002e-06 2024-04-25T22:52:58.016 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.016 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.016 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:58.016 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968771+0000", 2024-04-25T22:52:58.016 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6851999999999999e-05 2024-04-25T22:52:58.016 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.016 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.016 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:58.016 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968788+0000", 2024-04-25T22:52:58.016 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7027000000000001e-05 2024-04-25T22:52:58.016 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.017 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.017 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:58.017 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974589+0000", 2024-04-25T22:52:58.017 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058013320000000002 2024-04-25T22:52:58.017 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.017 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.017 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:58.017 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974610+0000", 2024-04-25T22:52:58.017 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0897e-05 2024-04-25T22:52:58.017 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:58.017 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:58.017 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:58.017 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.018 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.018 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'68)", 2024-04-25T22:52:58.018 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:58.018 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 70.028307455000004, 2024-04-25T22:52:58.018 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053935750000000003, 2024-04-25T22:52:58.018 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:58.018 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:58.018 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:58.018 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:58.018 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.018 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:58.018 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:58.018 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:58.018 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.019 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.019 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:58.019 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:58.019 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:58.019 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.019 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.019 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:58.019 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:52:58.019 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.03e-07 2024-04-25T22:52:58.019 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.019 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.019 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:58.019 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969235+0000", 2024-04-25T22:52:58.019 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2399999999999999e-06 2024-04-25T22:52:58.020 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.020 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.020 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:58.020 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969242+0000", 2024-04-25T22:52:58.020 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1269999999999997e-06 2024-04-25T22:52:58.020 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.020 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.020 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:58.020 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969246+0000", 2024-04-25T22:52:58.020 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3840000000000001e-06 2024-04-25T22:52:58.020 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.020 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.020 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:58.020 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969278+0000", 2024-04-25T22:52:58.021 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1868e-05 2024-04-25T22:52:58.021 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.021 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.021 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:58.021 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969295+0000", 2024-04-25T22:52:58.021 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7530999999999999e-05 2024-04-25T22:52:58.021 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.021 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.021 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:58.021 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974611+0000", 2024-04-25T22:52:58.021 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053160789999999996 2024-04-25T22:52:58.021 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.021 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.022 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:58.022 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974625+0000", 2024-04-25T22:52:58.022 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3943e-05 2024-04-25T22:52:58.022 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:58.022 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:58.022 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:58.022 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.022 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.022 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-25T22:52:58.022 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:58.022 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 69.834711546999998, 2024-04-25T22:52:58.022 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054952610000000004, 2024-04-25T22:52:58.022 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:58.023 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:58.023 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:58.023 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:58.023 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.023 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:58.023 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:58.023 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:58.023 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.023 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.023 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:58.023 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:58.023 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:58.023 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.023 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.023 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:58.024 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:52:58.024 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.68e-07 2024-04-25T22:52:58.024 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.024 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.024 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:58.024 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162898+0000", 2024-04-25T22:52:58.024 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9470999999999999e-05 2024-04-25T22:52:58.024 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.024 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.024 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:58.024 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162906+0000", 2024-04-25T22:52:58.024 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1580000000000005e-06 2024-04-25T22:52:58.024 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.024 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.024 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:58.025 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162911+0000", 2024-04-25T22:52:58.025 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4779999999999999e-06 2024-04-25T22:52:58.025 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.025 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.025 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:58.025 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162952+0000", 2024-04-25T22:52:58.025 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0629e-05 2024-04-25T22:52:58.025 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.025 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.025 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:58.025 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162968+0000", 2024-04-25T22:52:58.025 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6239000000000002e-05 2024-04-25T22:52:58.025 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.025 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.026 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:58.026 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168281+0000", 2024-04-25T22:52:58.026 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053132869999999999 2024-04-25T22:52:58.026 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.026 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.026 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:58.026 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168323+0000", 2024-04-25T22:52:58.026 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1430999999999997e-05 2024-04-25T22:52:58.026 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:58.026 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:58.026 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:58.026 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.026 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.027 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-04-25T22:52:58.027 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:58.027 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 69.404234185000007, 2024-04-25T22:52:58.027 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050872510000000001, 2024-04-25T22:52:58.027 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:58.027 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:58.027 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:58.027 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:58.027 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.027 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:58.027 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:58.027 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:58.028 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.028 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.028 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:58.028 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:58.028 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:58.028 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.028 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.028 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:58.028 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:52:58.028 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.72e-07 2024-04-25T22:52:58.028 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.028 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.028 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:58.028 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593381+0000", 2024-04-25T22:52:58.029 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5797000000000006e-05 2024-04-25T22:52:58.029 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.029 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.029 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:58.029 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593389+0000", 2024-04-25T22:52:58.029 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8480000000000001e-06 2024-04-25T22:52:58.029 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.029 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.029 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:58.029 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593393+0000", 2024-04-25T22:52:58.029 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4819999999999996e-06 2024-04-25T22:52:58.029 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.029 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.030 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:58.030 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593435+0000", 2024-04-25T22:52:58.030 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1600000000000002e-05 2024-04-25T22:52:58.030 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.030 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.030 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:58.030 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593454+0000", 2024-04-25T22:52:58.030 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8868e-05 2024-04-25T22:52:58.030 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.030 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.030 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:58.030 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598350+0000", 2024-04-25T22:52:58.030 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004895763 2024-04-25T22:52:58.031 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.031 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.031 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:58.031 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598392+0000", 2024-04-25T22:52:58.031 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2521000000000002e-05 2024-04-25T22:52:58.031 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:58.031 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:58.031 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:58.031 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.031 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.031 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:58.031 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:52:58.031 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 64.985870281000004, 2024-04-25T22:52:58.032 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:52:58.032 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:58.032 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:58.032 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:58.032 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:58.032 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.032 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:58.032 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:52:58.032 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:58.032 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.032 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.032 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:58.032 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:52:58.032 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:58.032 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.033 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.033 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:58.033 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:52:58.033 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:52:58.033 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.033 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.033 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:58.033 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:52:58.033 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:52:58.033 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.033 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.033 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:58.033 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:52:58.033 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:52:58.034 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.034 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.034 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:58.034 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:52:58.034 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:52:58.034 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.034 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.034 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:58.034 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:52:58.034 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:52:58.034 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.034 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.034 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:58.035 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:52:58.035 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:52:58.035 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.035 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.035 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:58.035 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:52:58.035 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:52:58.035 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.035 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.035 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:58.035 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:52:58.035 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:52:58.036 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.036 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.036 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:58.036 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:52:58.036 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:52:58.036 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.036 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.036 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:58.036 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:52:58.036 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:52:58.036 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.036 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.036 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:58.036 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:52:58.037 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:52:58.037 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:58.037 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:58.037 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:58.037 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.037 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.037 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:58.037 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:52:58.037 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 64.985195904999998, 2024-04-25T22:52:58.037 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:52:58.037 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:58.037 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:58.037 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:58.037 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:58.038 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.038 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:58.038 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:52:58.038 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:58.038 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.038 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.038 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:58.038 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:52:58.038 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:58.038 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.038 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.038 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:58.038 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:52:58.038 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:52:58.039 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.039 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.039 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:58.039 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:52:58.039 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:52:58.039 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.039 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.039 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:58.039 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:52:58.039 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:52:58.039 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.039 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.039 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:58.039 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:52:58.040 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:52:58.040 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.040 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.040 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:58.040 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:52:58.040 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:52:58.040 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.040 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.040 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:58.040 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:52:58.040 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:52:58.040 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.040 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.040 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:58.041 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:52:58.041 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:52:58.041 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.041 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.041 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:58.041 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:52:58.041 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:52:58.041 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.041 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.041 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:58.041 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:52:58.041 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:52:58.041 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.041 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.042 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:58.042 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:52:58.042 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:52:58.042 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.042 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.042 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:58.042 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:52:58.042 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:52:58.042 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:58.042 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:58.042 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:58.042 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.042 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.043 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:58.043 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:52:58.043 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 64.984686693, 2024-04-25T22:52:58.043 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:52:58.043 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:58.043 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:58.043 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:58.043 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:58.043 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.043 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:58.043 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:52:58.043 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:58.043 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.044 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.044 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:58.044 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:52:58.044 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:58.044 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.044 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.044 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:58.044 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:52:58.044 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:52:58.044 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.044 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.044 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:58.044 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:52:58.044 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:52:58.045 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.045 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.045 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:58.045 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:52:58.045 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:52:58.045 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.045 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.045 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:58.045 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:52:58.045 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:52:58.045 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.045 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.045 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:58.045 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:52:58.046 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:52:58.046 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.046 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.046 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:58.046 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:52:58.046 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:52:58.046 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.046 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.046 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:58.046 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:52:58.046 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:52:58.046 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.046 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.047 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:58.047 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:52:58.047 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:52:58.047 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.047 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.047 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:58.047 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:52:58.047 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:52:58.047 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.047 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.047 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:58.047 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:52:58.047 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:52:58.047 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.048 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.048 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:58.048 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:52:58.048 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:52:58.048 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:58.048 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:58.048 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:58.048 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.048 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.048 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:58.048 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:58.048 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 64.984273494999997, 2024-04-25T22:52:58.048 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:52:58.049 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:58.049 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:58.049 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:58.049 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:58.049 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.049 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:58.049 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:58.049 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:58.049 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.049 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.049 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:58.049 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:58.049 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:58.049 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.049 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.050 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:58.050 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:52:58.050 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:52:58.050 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.050 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.050 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:58.050 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:52:58.050 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:52:58.050 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.050 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.050 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:58.050 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:52:58.050 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:52:58.051 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.051 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.051 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:58.051 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:52:58.051 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:52:58.051 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.051 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.051 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:58.051 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:52:58.051 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:52:58.051 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.051 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.051 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:58.051 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:52:58.052 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:52:58.052 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.052 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.052 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:58.052 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:52:58.052 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:52:58.052 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.052 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.052 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:58.052 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:52:58.052 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:52:58.052 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.052 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.052 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:58.053 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:52:58.053 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:52:58.053 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.053 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.053 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:58.053 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:52:58.053 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:52:58.053 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.053 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.053 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:58.053 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:52:58.053 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:52:58.053 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:58.054 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:58.054 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:58.054 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.054 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.054 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:58.054 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:52:58.054 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 64.984222825000003, 2024-04-25T22:52:58.054 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:52:58.054 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:58.054 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:58.054 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:58.054 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:58.054 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.054 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:58.055 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:52:58.055 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:58.055 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.055 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.055 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:58.055 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:52:58.055 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:58.055 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.055 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.055 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:58.055 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:52:58.055 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:52:58.055 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.055 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.056 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:58.056 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:52:58.056 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:52:58.056 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.056 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.056 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:58.056 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:52:58.056 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:52:58.056 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.056 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.056 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:58.056 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:52:58.056 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:52:58.057 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.057 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.057 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:58.057 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:52:58.057 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:52:58.057 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.057 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.057 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:52:58.057 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:52:58.057 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:52:58.057 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.057 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.057 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:58.057 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:52:58.058 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:52:58.058 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.058 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.058 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:58.058 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:52:58.058 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:52:58.058 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.058 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.058 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:58.058 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:52:58.058 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:52:58.058 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.061 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.061 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:58.061 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:52:58.061 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:52:58.061 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.061 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.062 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:58.062 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:52:58.062 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:52:58.062 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.062 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.062 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:58.062 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:52:58.062 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:52:58.062 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.062 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.062 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:58.062 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:52:58.062 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:52:58.062 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:58.063 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:58.063 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:58.063 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.063 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.063 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:58.063 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:52:58.063 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 64.984185956000005, 2024-04-25T22:52:58.063 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:52:58.063 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:58.063 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:58.063 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:58.063 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:58.063 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.063 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:58.064 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:52:58.064 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:58.064 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.064 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.064 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:58.064 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:52:58.064 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:58.064 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.064 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.064 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:58.064 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:52:58.064 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:52:58.064 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.065 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.065 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:58.065 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:52:58.065 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:52:58.065 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.065 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.065 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:58.065 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:52:58.065 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:52:58.065 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.065 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.065 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:58.065 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:52:58.065 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:52:58.066 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.066 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.066 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:58.066 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:52:58.066 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:52:58.066 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.066 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.066 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:52:58.066 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:52:58.066 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:52:58.066 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.066 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.066 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:58.067 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:52:58.067 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:52:58.067 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.067 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.067 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:58.067 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:52:58.067 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:52:58.067 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.067 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.067 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:58.067 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:52:58.067 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:52:58.067 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.067 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.068 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:58.068 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:52:58.068 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:52:58.068 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.068 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.068 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:58.068 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:52:58.068 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:52:58.068 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.068 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.068 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:58.068 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:52:58.068 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:52:58.068 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.068 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.069 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:58.069 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:52:58.069 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:52:58.069 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:58.069 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:58.069 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:58.069 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.069 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.069 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:58.069 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:52:58.069 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 64.984160990000007, 2024-04-25T22:52:58.069 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:52:58.069 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:58.070 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:58.070 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:58.070 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:58.070 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.070 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:58.070 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:52:58.070 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:58.070 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.070 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.070 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:58.070 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:52:58.070 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:58.070 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.070 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.071 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:58.071 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:52:58.071 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:52:58.071 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.071 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.071 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:58.071 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:52:58.071 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:52:58.071 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.071 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.071 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:58.071 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:52:58.071 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:52:58.071 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.072 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.072 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:58.072 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:52:58.072 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:52:58.072 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.072 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.072 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:58.072 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:52:58.072 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:52:58.072 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.072 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.072 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:58.072 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:52:58.073 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:52:58.073 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.073 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.073 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:52:58.073 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:52:58.073 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:52:58.073 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.073 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.073 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:52:58.073 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:52:58.073 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:52:58.073 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.073 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.073 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:52:58.074 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:52:58.074 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:52:58.074 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.074 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.074 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:58.074 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:52:58.074 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:52:58.074 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.074 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.074 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:58.074 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:52:58.074 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:52:58.074 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:58.075 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:58.075 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:58.075 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.075 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.075 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:58.075 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:52:58.075 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 64.984124625999996, 2024-04-25T22:52:58.075 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:52:58.075 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:58.075 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:58.075 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:52:58.075 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:58.075 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.076 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:58.076 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:52:58.076 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:58.076 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.076 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.076 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:58.076 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:52:58.076 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:58.076 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.076 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.076 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:58.076 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:52:58.076 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:52:58.076 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.077 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.077 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:58.077 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:52:58.077 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:52:58.077 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.077 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.077 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:58.077 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:52:58.077 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:52:58.077 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.077 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.077 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:58.077 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:52:58.077 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:52:58.078 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.078 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.078 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:58.078 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:52:58.078 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:52:58.078 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.078 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.078 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:52:58.078 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:52:58.078 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:52:58.078 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.078 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.078 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:58.079 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:52:58.079 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:52:58.079 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.079 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.079 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:58.079 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:52:58.079 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:52:58.079 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.079 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.079 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:58.079 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:52:58.079 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:52:58.079 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:58.079 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:58.080 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:58.080 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.080 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.080 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:52:58.080 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:58.080 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 64.984093544999993, 2024-04-25T22:52:58.080 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:52:58.080 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:58.080 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:58.080 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:52:58.080 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:58.080 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.081 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:58.081 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:58.081 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:58.081 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.081 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.081 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:58.081 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:58.081 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:58.081 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.081 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.081 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:58.081 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:52:58.081 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:52:58.081 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.082 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.082 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:58.082 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:52:58.082 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:52:58.082 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.082 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.082 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:58.082 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:52:58.082 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:52:58.082 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.082 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.082 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:58.082 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:52:58.082 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:52:58.083 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.083 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.083 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:58.083 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:52:58.083 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:52:58.083 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.083 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.083 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:58.083 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:52:58.083 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:52:58.083 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.083 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.083 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:58.084 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:52:58.084 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:52:58.084 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:58.084 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:58.084 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:58.084 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.084 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.084 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:52:58.084 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:58.084 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 64.983652575999997, 2024-04-25T22:52:58.084 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064881979999999997, 2024-04-25T22:52:58.084 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:58.084 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:58.085 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:58.085 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:58.085 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.085 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:58.085 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:58.085 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:58.085 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.085 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.085 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:58.085 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:58.085 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:58.085 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.085 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.085 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:58.086 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:52:58.086 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2699999999999999e-07 2024-04-25T22:52:58.086 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.086 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.086 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:58.086 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013898+0000", 2024-04-25T22:52:58.086 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0796e-05 2024-04-25T22:52:58.086 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.086 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.086 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:58.086 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013907+0000", 2024-04-25T22:52:58.086 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5140000000000007e-06 2024-04-25T22:52:58.086 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.086 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.087 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:58.087 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013952+0000", 2024-04-25T22:52:58.087 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4134000000000001e-05 2024-04-25T22:52:58.087 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.087 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.087 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:58.087 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016812+0000", 2024-04-25T22:52:58.087 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028601059999999998 2024-04-25T22:52:58.087 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.087 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.087 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:58.087 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.017052+0000", 2024-04-25T22:52:58.087 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024056500000000001 2024-04-25T22:52:58.088 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.088 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.088 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:58.088 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020350+0000", 2024-04-25T22:52:58.088 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032978320000000001 2024-04-25T22:52:58.088 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.088 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.088 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:58.088 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020375+0000", 2024-04-25T22:52:58.088 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4624e-05 2024-04-25T22:52:58.088 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:58.088 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:58.088 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:58.088 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.089 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.089 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-25T22:52:58.089 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:58.089 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 64.970122129999993, 2024-04-25T22:52:58.089 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058583000000000003, 2024-04-25T22:52:58.089 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:58.089 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:58.089 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:58.089 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:58.089 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.089 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:58.089 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:58.089 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:58.089 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.090 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.090 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:58.090 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:58.090 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:58.090 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.090 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.090 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:58.090 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:52:58.090 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.41e-07 2024-04-25T22:52:58.090 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.090 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.090 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:58.090 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027428+0000", 2024-04-25T22:52:58.091 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.075e-05 2024-04-25T22:52:58.091 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.091 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.091 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:58.091 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027435+0000", 2024-04-25T22:52:58.091 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3610000000000003e-06 2024-04-25T22:52:58.091 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.091 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.091 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:58.091 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027442+0000", 2024-04-25T22:52:58.091 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0400000000000004e-06 2024-04-25T22:52:58.091 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.091 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.091 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:58.092 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028094+0000", 2024-04-25T22:52:58.092 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00065134800000000005 2024-04-25T22:52:58.092 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.092 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.092 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:58.092 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028107+0000", 2024-04-25T22:52:58.092 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3087e-05 2024-04-25T22:52:58.092 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.092 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.092 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:58.092 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033239+0000", 2024-04-25T22:52:58.092 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051319429999999999 2024-04-25T22:52:58.092 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.093 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.093 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:58.093 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033275+0000", 2024-04-25T22:52:58.093 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6430000000000002e-05 2024-04-25T22:52:58.093 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:58.093 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:58.093 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:58.093 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.093 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.093 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-25T22:52:58.093 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:58.093 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 64.969737292999994, 2024-04-25T22:52:58.093 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005413597, 2024-04-25T22:52:58.093 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:58.094 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:58.094 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:52:58.094 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:58.094 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.094 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:58.094 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:58.094 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:58.094 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.094 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.094 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:58.094 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:58.094 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:58.094 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.094 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.095 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:58.095 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:52:58.095 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3799999999999997e-07 2024-04-25T22:52:58.095 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.095 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.095 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:58.095 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027816+0000", 2024-04-25T22:52:58.095 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3230999999999999e-05 2024-04-25T22:52:58.095 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.095 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.095 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:58.095 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027823+0000", 2024-04-25T22:52:58.095 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9039999999999992e-06 2024-04-25T22:52:58.096 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.096 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.096 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:58.096 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027841+0000", 2024-04-25T22:52:58.096 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7651000000000001e-05 2024-04-25T22:52:58.096 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.096 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.096 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:58.096 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027904+0000", 2024-04-25T22:52:58.096 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3058000000000005e-05 2024-04-25T22:52:58.096 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.096 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.096 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:52:58.096 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027926+0000", 2024-04-25T22:52:58.097 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1450999999999998e-05 2024-04-25T22:52:58.097 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.097 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.097 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:52:58.097 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033177+0000", 2024-04-25T22:52:58.097 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052508909999999997 2024-04-25T22:52:58.097 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.097 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.097 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:58.097 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033215+0000", 2024-04-25T22:52:58.097 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8872999999999999e-05 2024-04-25T22:52:58.097 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:58.097 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:58.097 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:58.098 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.098 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.098 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 171 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:52:58.098 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:58.098 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 64.969680190999995, 2024-04-25T22:52:58.098 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054322240000000003, 2024-04-25T22:52:58.098 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:52:58.098 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:52:58.098 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "reached pg", 2024-04-25T22:52:58.098 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:52:58.098 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.098 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:52:58.098 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:58.098 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:58.099 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.099 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.099 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:52:58.099 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:58.099 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:52:58.099 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.099 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.099 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:52:58.099 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:52:58.099 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7500000000000001e-07 2024-04-25T22:52:58.099 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.099 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.099 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:52:58.100 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027868+0000", 2024-04-25T22:52:58.100 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5750000000000001e-06 2024-04-25T22:52:58.100 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.100 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.100 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:52:58.100 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027885+0000", 2024-04-25T22:52:58.100 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7272e-05 2024-04-25T22:52:58.100 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.100 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.100 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:52:58.100 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027900+0000", 2024-04-25T22:52:58.100 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.502e-05 2024-04-25T22:52:58.100 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.100 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.101 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:52:58.101 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028381+0000", 2024-04-25T22:52:58.101 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00048039399999999998 2024-04-25T22:52:58.101 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:52:58.101 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:52:58.101 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:52:58.101 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033291+0000", 2024-04-25T22:52:58.101 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049105879999999996 2024-04-25T22:52:58.101 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:58.101 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:58.101 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:58.101 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:52:58.101 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:52:58.101 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:52:58.103 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-25T22:52:58.103 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:58.102+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:58.103 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:52:58.104 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:52:58.104 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:52:58.121 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-25T22:52:58.121 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:52:58.124 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:52:58.124 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:52:58.204 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:58.203+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:58.214 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:58.214 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:58.223 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:52:58.305 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:58.304+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:58.324 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:58.325 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:58.333 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:52:58.406 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:58.406+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:58.476 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:58.476 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:58.484 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:52:58.508 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:58.507+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:58.586 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:58.586 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:58.595 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:52:58.608 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:58.608+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:58.696 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:58.697 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:58.705 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:52:58.749 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:58.748+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:58.808 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:58.808 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:58.809 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:58.809+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:58.818 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:52:58.910 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:58.910+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:58.920 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:58.920 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:58.929 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:52:59.011 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:59.010+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:59.031 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:59.031 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:59.039 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:52:59.112 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:59.112+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:59.182 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:59.182 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:59.188 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-25T22:52:59.190 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:52:59.213 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:59.212+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:59.292 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:59.292 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:59.301 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:52:59.313 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:59.313+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:59.404 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:59.404 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:59.412 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:52:59.414 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:59.413+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:59.514 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:59.514 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:59.515 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:59.514+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:59.523 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:52:59.615 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:59.614+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:59.626 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:59.626 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:59.635 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:52:59.716 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:52:59.715+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:52:59.738 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:59.738 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:59.747 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:52:59.819 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:59.818+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:52:59.888 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:52:59.888 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:52:59.897 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:52:59.941 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:52:59.940+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:00.001 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:00.001 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:00.009 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:00.050 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:00.049+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:00.123 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:00.121+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:00.125 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:53:00.152 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:00.153 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:00.161 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:00.184 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is unset 2024-04-25T22:53:00.245 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:00.244+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:00.285 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-25T22:53:00.285 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:53:00.285 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:53:00.303 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-25T22:53:00.303 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:53:00.305 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:00.305 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:53:00.305 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:53:00.305 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:53:00.305 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.305 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:53:00.305 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:00.306 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 72.336760885000004, 2024-04-25T22:53:00.306 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:53:00.306 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:00.306 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:00.306 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:00.306 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:00.306 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.306 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:00.306 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:00.306 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:00.306 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.306 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.307 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:00.307 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:00.307 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:00.307 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.307 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.307 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:00.307 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:53:00.307 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:53:00.307 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.307 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.307 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:00.307 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:53:00.308 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:53:00.308 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.308 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.308 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:00.308 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:53:00.308 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:53:00.308 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.308 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.308 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:00.308 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:53:00.308 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:53:00.308 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.308 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.309 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:00.309 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:53:00.309 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:53:00.309 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.309 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.309 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:00.309 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:53:00.309 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:53:00.310 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.310 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.310 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:00.310 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:53:00.310 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:53:00.310 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.310 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.310 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:00.310 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:53:00.310 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:53:00.310 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:00.310 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:00.311 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:00.311 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.311 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.311 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:110 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'72, mlcod=10'68)", 2024-04-25T22:53:00.311 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:00.311 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 72.336126884999999, 2024-04-25T22:53:00.311 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065316630000000001, 2024-04-25T22:53:00.311 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:00.311 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:00.311 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:00.311 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:00.311 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.311 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:00.311 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:00.312 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:00.312 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.312 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.312 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:00.312 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:00.312 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:00.312 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.312 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.312 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:00.312 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:00.312 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.58e-07 2024-04-25T22:53:00.313 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.313 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.313 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:00.313 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967811+0000", 2024-04-25T22:53:00.313 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.118e-06 2024-04-25T22:53:00.313 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.313 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.313 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:00.313 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967817+0000", 2024-04-25T22:53:00.313 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3709999999999996e-06 2024-04-25T22:53:00.313 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.313 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.314 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:00.314 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967820+0000", 2024-04-25T22:53:00.314 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2210000000000002e-06 2024-04-25T22:53:00.314 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.314 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.314 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:00.314 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967876+0000", 2024-04-25T22:53:00.314 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5507000000000002e-05 2024-04-25T22:53:00.314 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.314 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.314 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:00.314 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967893+0000", 2024-04-25T22:53:00.314 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7812000000000002e-05 2024-04-25T22:53:00.314 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.315 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.315 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:00.315 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974317+0000", 2024-04-25T22:53:00.315 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064237160000000003 2024-04-25T22:53:00.315 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.315 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.315 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:00.315 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:53:00.315 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.156e-05 2024-04-25T22:53:00.315 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:00.315 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:00.315 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:00.315 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.316 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.316 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'68)", 2024-04-25T22:53:00.316 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:00.316 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 72.335709371999997, 2024-04-25T22:53:00.316 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061292279999999996, 2024-04-25T22:53:00.316 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:00.316 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:00.316 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:00.316 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:00.316 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.316 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:00.316 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:00.316 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:00.316 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.317 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.317 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:00.317 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:00.317 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:00.317 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.317 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.317 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:00.317 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:00.317 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6300000000000001e-07 2024-04-25T22:53:00.317 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.317 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.317 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:00.317 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968228+0000", 2024-04-25T22:53:00.318 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6139999999999999e-06 2024-04-25T22:53:00.318 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.318 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.318 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:00.318 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968235+0000", 2024-04-25T22:53:00.318 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7020000000000001e-06 2024-04-25T22:53:00.318 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.318 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.318 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:00.318 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968238+0000", 2024-04-25T22:53:00.318 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0010000000000002e-06 2024-04-25T22:53:00.318 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.318 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.319 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:00.319 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968297+0000", 2024-04-25T22:53:00.319 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8424999999999997e-05 2024-04-25T22:53:00.319 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.319 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.319 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:00.319 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968316+0000", 2024-04-25T22:53:00.319 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8814999999999999e-05 2024-04-25T22:53:00.319 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.319 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.320 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:00.320 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:53:00.320 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060239439999999998 2024-04-25T22:53:00.320 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.320 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.320 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:00.320 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974354+0000", 2024-04-25T22:53:00.320 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4364e-05 2024-04-25T22:53:00.320 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:00.320 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:00.320 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:00.320 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.320 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.321 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'68)", 2024-04-25T22:53:00.321 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:00.321 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 72.335272369999998, 2024-04-25T22:53:00.321 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005948414, 2024-04-25T22:53:00.321 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:00.321 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:00.321 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:00.321 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:00.321 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.321 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:00.321 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:00.321 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:00.321 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.322 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.322 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:00.322 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:00.322 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:00.322 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.322 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.322 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:00.322 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:00.322 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6199999999999998e-07 2024-04-25T22:53:00.322 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.322 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.322 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:00.323 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968723+0000", 2024-04-25T22:53:00.323 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1148999999999993e-05 2024-04-25T22:53:00.323 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.323 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.323 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:00.323 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968730+0000", 2024-04-25T22:53:00.323 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1749999999999999e-06 2024-04-25T22:53:00.323 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.323 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.323 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:00.323 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968734+0000", 2024-04-25T22:53:00.323 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5200000000000002e-06 2024-04-25T22:53:00.323 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.324 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.324 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:00.324 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968771+0000", 2024-04-25T22:53:00.324 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6851999999999999e-05 2024-04-25T22:53:00.324 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.324 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.324 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:00.324 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968788+0000", 2024-04-25T22:53:00.324 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7027000000000001e-05 2024-04-25T22:53:00.324 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.324 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.324 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:00.324 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974589+0000", 2024-04-25T22:53:00.324 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058013320000000002 2024-04-25T22:53:00.325 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.325 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.325 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:00.325 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974610+0000", 2024-04-25T22:53:00.325 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0897e-05 2024-04-25T22:53:00.325 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:00.325 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:00.325 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:00.325 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.325 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.325 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'68)", 2024-04-25T22:53:00.325 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:00.325 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 72.334702359999994, 2024-04-25T22:53:00.326 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053935750000000003, 2024-04-25T22:53:00.326 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:00.326 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:00.326 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:00.326 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:00.326 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.326 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:00.326 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:00.326 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:00.326 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.326 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.326 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:00.326 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:00.326 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:00.327 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.327 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.327 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:00.327 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:00.327 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.03e-07 2024-04-25T22:53:00.327 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.327 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.327 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:00.327 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969235+0000", 2024-04-25T22:53:00.327 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2399999999999999e-06 2024-04-25T22:53:00.327 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.327 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.327 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:00.327 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969242+0000", 2024-04-25T22:53:00.328 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1269999999999997e-06 2024-04-25T22:53:00.328 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.328 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.328 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:00.328 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969246+0000", 2024-04-25T22:53:00.328 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3840000000000001e-06 2024-04-25T22:53:00.328 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.328 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.328 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:00.328 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969278+0000", 2024-04-25T22:53:00.328 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1868e-05 2024-04-25T22:53:00.328 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.329 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.329 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:00.329 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969295+0000", 2024-04-25T22:53:00.329 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7530999999999999e-05 2024-04-25T22:53:00.329 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.329 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.329 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:00.329 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974611+0000", 2024-04-25T22:53:00.329 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053160789999999996 2024-04-25T22:53:00.329 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.329 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.329 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:00.329 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974625+0000", 2024-04-25T22:53:00.329 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3943e-05 2024-04-25T22:53:00.329 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:00.330 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:00.330 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:00.330 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.330 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.330 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-25T22:53:00.330 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:00.330 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 72.141106452000002, 2024-04-25T22:53:00.330 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054952610000000004, 2024-04-25T22:53:00.330 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:00.330 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:00.330 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:00.330 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:00.330 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.331 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:00.331 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:00.331 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:00.331 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.331 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.331 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:00.331 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:00.331 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:00.331 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.331 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.331 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:00.331 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:00.331 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.68e-07 2024-04-25T22:53:00.332 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.332 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.332 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:00.332 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162898+0000", 2024-04-25T22:53:00.332 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9470999999999999e-05 2024-04-25T22:53:00.332 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.332 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.332 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:00.332 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162906+0000", 2024-04-25T22:53:00.332 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1580000000000005e-06 2024-04-25T22:53:00.332 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.332 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.332 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:00.332 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162911+0000", 2024-04-25T22:53:00.333 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4779999999999999e-06 2024-04-25T22:53:00.333 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.333 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.333 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:00.333 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162952+0000", 2024-04-25T22:53:00.333 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0629e-05 2024-04-25T22:53:00.333 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.333 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.333 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:00.333 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162968+0000", 2024-04-25T22:53:00.333 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6239000000000002e-05 2024-04-25T22:53:00.333 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.333 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.333 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:00.334 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168281+0000", 2024-04-25T22:53:00.334 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053132869999999999 2024-04-25T22:53:00.334 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.334 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.334 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:00.334 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168323+0000", 2024-04-25T22:53:00.334 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1430999999999997e-05 2024-04-25T22:53:00.334 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:00.334 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:00.334 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:00.334 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.334 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.334 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-04-25T22:53:00.334 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:00.335 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 71.710629089999998, 2024-04-25T22:53:00.335 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050872510000000001, 2024-04-25T22:53:00.335 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:00.335 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:00.335 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:00.335 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:00.335 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.335 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:00.335 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:00.335 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:00.335 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.335 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.335 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:00.335 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:00.336 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:00.336 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.336 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.336 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:00.336 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:00.336 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.72e-07 2024-04-25T22:53:00.336 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.336 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.336 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:00.336 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593381+0000", 2024-04-25T22:53:00.336 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5797000000000006e-05 2024-04-25T22:53:00.336 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.336 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.337 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:00.337 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593389+0000", 2024-04-25T22:53:00.337 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8480000000000001e-06 2024-04-25T22:53:00.337 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.337 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.337 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:00.337 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593393+0000", 2024-04-25T22:53:00.337 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4819999999999996e-06 2024-04-25T22:53:00.337 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.337 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.337 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:00.337 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593435+0000", 2024-04-25T22:53:00.337 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1600000000000002e-05 2024-04-25T22:53:00.337 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.338 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.338 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:00.338 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593454+0000", 2024-04-25T22:53:00.338 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8868e-05 2024-04-25T22:53:00.338 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.338 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.338 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:00.338 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598350+0000", 2024-04-25T22:53:00.338 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004895763 2024-04-25T22:53:00.338 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.338 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.338 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:00.338 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598392+0000", 2024-04-25T22:53:00.339 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2521000000000002e-05 2024-04-25T22:53:00.339 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:00.339 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:00.339 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:00.339 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.339 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.339 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:00.339 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:00.339 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 67.292265185999995, 2024-04-25T22:53:00.339 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:53:00.339 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:00.339 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:00.339 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:00.339 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:00.340 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.340 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:00.340 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:00.340 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:00.340 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.340 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.340 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:00.340 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:00.340 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:00.340 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.341 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.341 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:00.341 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:53:00.341 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:53:00.341 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.341 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.341 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:00.341 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:53:00.341 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:53:00.341 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.341 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.341 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:00.341 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:53:00.342 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:53:00.342 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.342 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.342 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:00.342 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:53:00.342 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:53:00.342 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.342 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.342 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:00.342 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:53:00.342 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:53:00.342 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.342 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.343 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:00.343 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:53:00.343 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:53:00.343 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.343 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.343 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:00.343 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:53:00.343 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:53:00.343 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.343 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.343 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:00.343 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:53:00.343 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:53:00.343 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.344 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.344 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:00.344 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:53:00.344 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:53:00.344 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.344 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.344 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:00.344 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:53:00.344 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:53:00.344 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.344 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.344 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:00.344 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:53:00.345 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:53:00.345 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:00.345 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:00.345 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:00.345 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.345 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.345 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:00.345 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:00.345 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 67.291590810000002, 2024-04-25T22:53:00.345 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:53:00.345 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:00.345 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:00.345 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:00.345 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:00.346 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.346 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:00.346 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:00.346 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:00.346 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.346 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.346 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:00.346 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:00.346 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:00.346 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.346 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.346 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:00.346 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:53:00.347 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:53:00.347 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.347 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.347 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:00.347 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:53:00.347 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:53:00.347 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.347 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.347 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:00.347 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:53:00.347 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:53:00.347 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.347 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.348 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:00.348 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:53:00.348 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:53:00.348 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.348 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.348 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:00.348 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:53:00.348 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:53:00.348 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.348 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.348 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:00.348 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:53:00.348 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:53:00.348 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.349 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.349 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:00.349 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:53:00.349 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:53:00.349 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.349 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.349 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:00.349 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:53:00.349 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:53:00.349 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.349 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.349 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:00.349 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:53:00.349 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:53:00.350 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.350 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.350 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:00.350 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:53:00.350 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:53:00.350 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.350 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.350 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:00.350 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:53:00.350 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:53:00.350 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:00.350 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:00.351 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:00.351 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.351 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.351 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:00.351 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:00.351 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 67.291081598000005, 2024-04-25T22:53:00.351 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:53:00.351 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:00.351 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:00.351 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:00.351 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:00.351 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.351 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:00.351 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:00.352 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:00.352 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.352 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.352 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:00.352 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:00.352 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:00.352 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.352 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.352 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:00.352 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:53:00.352 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:53:00.352 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.352 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.353 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:00.353 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:53:00.353 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:53:00.353 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.353 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.353 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:00.353 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:53:00.353 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:53:00.353 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.354 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.354 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:00.354 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:53:00.354 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:53:00.354 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.354 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.354 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:00.354 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:53:00.354 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:53:00.354 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.354 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.354 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:00.354 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:53:00.355 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:53:00.355 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.355 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.355 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:00.355 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:53:00.355 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:53:00.355 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.355 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.355 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:00.355 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:53:00.355 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:53:00.355 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.355 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.356 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:00.356 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:53:00.356 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:53:00.356 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.356 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.356 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:00.356 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:53:00.356 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:53:00.356 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.356 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.356 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:00.356 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:53:00.356 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:53:00.357 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:00.357 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:00.357 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:00.357 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.357 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.357 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:00.357 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:00.357 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 67.290668400000001, 2024-04-25T22:53:00.357 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:53:00.357 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:00.357 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:00.357 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:00.357 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:00.357 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.358 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:00.358 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:00.358 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:00.358 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.358 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.358 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:00.358 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:00.358 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:00.358 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.358 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.358 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:00.358 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:00.358 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:53:00.359 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.359 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.359 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:00.359 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:00.359 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:53:00.359 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.359 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.359 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:00.359 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:53:00.359 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:53:00.359 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.359 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.359 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:00.360 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:53:00.360 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:53:00.360 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.360 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.360 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:00.360 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:53:00.360 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:53:00.360 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.360 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.360 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:00.360 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:53:00.360 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:53:00.360 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.360 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.361 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:00.361 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:53:00.361 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:53:00.361 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.361 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.361 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:00.361 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:53:00.361 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:53:00.361 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.361 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.361 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:00.361 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:53:00.361 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:53:00.361 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.362 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.362 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:00.362 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:53:00.362 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:53:00.362 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.362 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.362 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:00.362 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:53:00.362 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:53:00.362 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:00.363 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:00.363 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:00.363 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.363 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.363 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:00.363 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:00.363 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 67.290617729999994, 2024-04-25T22:53:00.363 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:53:00.363 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:00.363 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:00.363 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:00.363 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:00.363 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.363 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:00.364 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:00.364 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:00.364 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.364 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.364 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:00.364 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:00.364 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:00.364 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.364 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.364 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:00.364 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:53:00.364 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:53:00.364 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.364 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.365 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:00.365 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:53:00.365 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:53:00.365 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.365 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.365 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:00.365 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:53:00.365 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:53:00.365 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.365 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.365 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:00.365 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:53:00.365 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:53:00.366 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.366 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.366 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:00.366 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:53:00.366 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:53:00.366 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.366 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.366 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:00.366 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:53:00.366 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:53:00.366 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.366 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.367 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:00.367 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:53:00.367 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:53:00.367 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.367 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.367 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:00.367 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:53:00.367 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:53:00.367 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.367 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.367 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:00.367 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:53:00.367 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:53:00.367 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.368 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.368 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:00.368 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:53:00.368 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:53:00.368 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.368 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.368 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:00.368 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:53:00.368 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:53:00.368 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.368 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.368 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:00.369 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:53:00.369 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:53:00.369 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.369 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.369 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:00.369 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:53:00.369 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:53:00.369 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:00.369 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:00.369 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:00.369 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.369 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.369 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:00.369 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:00.370 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 67.290580860999995, 2024-04-25T22:53:00.370 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:53:00.370 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:00.370 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:00.370 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:00.370 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:00.370 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.370 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:00.370 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:00.370 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:00.370 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.370 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.370 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:00.371 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:00.371 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:00.371 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.371 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.371 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:00.371 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:53:00.371 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:53:00.371 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.371 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.371 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:00.371 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:53:00.371 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:53:00.371 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.371 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.371 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:00.372 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:53:00.372 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:53:00.372 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.372 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.372 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:00.372 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:53:00.372 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:53:00.372 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.372 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.372 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:00.372 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:53:00.372 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:53:00.372 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.372 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.373 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:53:00.373 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:53:00.373 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:53:00.373 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.373 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.373 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:00.373 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:53:00.373 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:53:00.373 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.373 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.373 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:00.373 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:53:00.373 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:53:00.374 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.374 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.374 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:00.374 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:53:00.374 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:53:00.374 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.374 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.374 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:00.374 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:53:00.374 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:53:00.374 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.374 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.375 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:00.375 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:53:00.375 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:53:00.375 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.375 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.375 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:00.375 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:53:00.375 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:53:00.375 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.375 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.375 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:00.375 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:53:00.375 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:53:00.375 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:00.376 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:00.376 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:00.376 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.376 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.376 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:00.376 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:00.376 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 67.290555894999997, 2024-04-25T22:53:00.376 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:53:00.376 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:00.376 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:00.376 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:00.376 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:00.376 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.376 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:00.377 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:00.377 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:00.377 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.377 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.377 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:00.377 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:00.377 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:00.377 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.377 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.377 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:00.377 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:53:00.377 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:53:00.377 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.378 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.378 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:00.378 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:53:00.378 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:53:00.378 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.378 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.378 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:00.378 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:00.378 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:53:00.378 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.378 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.378 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:00.378 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:53:00.379 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:53:00.379 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.379 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.379 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:00.379 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:53:00.379 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:53:00.379 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.379 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.379 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:00.379 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:53:00.379 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:53:00.379 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.379 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.380 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:00.380 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:53:00.380 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:53:00.380 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.380 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.380 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:00.380 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:53:00.380 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:53:00.380 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.380 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.380 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:00.380 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:53:00.380 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:53:00.381 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.381 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.381 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:00.381 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:53:00.381 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:53:00.381 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.381 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.381 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:00.381 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:53:00.381 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:53:00.381 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:00.381 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:00.381 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:00.381 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.382 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.382 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:00.382 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:00.382 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 67.290519531000001, 2024-04-25T22:53:00.382 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:53:00.382 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:00.382 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:00.382 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:00.382 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:00.382 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.382 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:00.382 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:00.382 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:00.383 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.383 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.383 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:00.383 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:00.383 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:00.383 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.383 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.383 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:00.383 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:53:00.383 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:53:00.383 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.383 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.383 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:00.383 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:53:00.384 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:53:00.384 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.384 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.384 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:00.384 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:53:00.384 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:53:00.384 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.384 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.384 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:00.384 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:53:00.384 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:53:00.384 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.384 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.384 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:00.385 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:53:00.385 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:53:00.385 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.385 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.385 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:00.385 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:53:00.385 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:53:00.385 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.385 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.385 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:00.385 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:53:00.385 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:53:00.385 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.386 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.386 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:00.386 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:53:00.386 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:53:00.386 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.386 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.386 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:00.386 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:53:00.386 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:53:00.386 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:00.386 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:00.386 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:00.386 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.386 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.387 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:00.387 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:00.387 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 67.290488449999998, 2024-04-25T22:53:00.387 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:53:00.387 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:00.387 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:00.387 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:00.387 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:00.387 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.387 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:00.387 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:00.387 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:00.387 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.387 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.388 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:00.388 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:00.388 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:00.388 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.388 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.388 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:00.388 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:00.388 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:00.388 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.388 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.388 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:00.388 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:53:00.389 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:53:00.389 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.389 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.389 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:00.389 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:53:00.389 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:53:00.389 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.389 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.389 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:00.389 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:53:00.389 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:53:00.389 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.389 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.389 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:00.390 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:53:00.390 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:53:00.390 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.390 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.390 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:00.390 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:53:00.390 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:53:00.390 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.390 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.390 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:00.390 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:53:00.390 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:53:00.390 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:00.390 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:00.391 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:00.391 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.391 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.391 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:53:00.391 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:00.391 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 67.290047481000002, 2024-04-25T22:53:00.391 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064881979999999997, 2024-04-25T22:53:00.391 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:00.391 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:00.391 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:00.391 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:00.391 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.391 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:00.391 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:00.392 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:00.392 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.392 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.392 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:00.392 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:00.392 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:00.392 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.392 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.392 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:00.392 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:00.392 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2699999999999999e-07 2024-04-25T22:53:00.392 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.392 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.393 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:00.393 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013898+0000", 2024-04-25T22:53:00.393 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0796e-05 2024-04-25T22:53:00.393 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.393 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.393 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:00.393 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013907+0000", 2024-04-25T22:53:00.393 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5140000000000007e-06 2024-04-25T22:53:00.393 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.393 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.393 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:00.394 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013952+0000", 2024-04-25T22:53:00.394 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4134000000000001e-05 2024-04-25T22:53:00.394 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.394 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.394 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:00.394 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016812+0000", 2024-04-25T22:53:00.394 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028601059999999998 2024-04-25T22:53:00.394 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.394 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.394 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:00.394 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.017052+0000", 2024-04-25T22:53:00.394 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024056500000000001 2024-04-25T22:53:00.394 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.395 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.395 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:00.395 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020350+0000", 2024-04-25T22:53:00.395 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032978320000000001 2024-04-25T22:53:00.395 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.395 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.395 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:00.395 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020375+0000", 2024-04-25T22:53:00.395 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4624e-05 2024-04-25T22:53:00.395 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:00.395 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:00.395 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:00.396 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.396 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.396 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-25T22:53:00.396 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:00.396 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 67.276517034999998, 2024-04-25T22:53:00.396 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058583000000000003, 2024-04-25T22:53:00.396 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:00.396 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:00.396 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:00.396 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:00.396 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.396 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:00.396 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:00.396 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:00.396 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.397 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.397 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:00.397 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:00.397 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:00.397 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.397 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.397 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:00.397 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:00.397 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.41e-07 2024-04-25T22:53:00.397 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.397 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.397 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:00.397 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027428+0000", 2024-04-25T22:53:00.397 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.075e-05 2024-04-25T22:53:00.398 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.398 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.398 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:00.398 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027435+0000", 2024-04-25T22:53:00.398 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3610000000000003e-06 2024-04-25T22:53:00.398 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.398 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.398 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:00.398 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027442+0000", 2024-04-25T22:53:00.398 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0400000000000004e-06 2024-04-25T22:53:00.398 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.398 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.398 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:00.399 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028094+0000", 2024-04-25T22:53:00.399 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00065134800000000005 2024-04-25T22:53:00.399 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.399 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.399 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:00.399 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028107+0000", 2024-04-25T22:53:00.399 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3087e-05 2024-04-25T22:53:00.399 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.399 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.399 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:00.399 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033239+0000", 2024-04-25T22:53:00.399 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051319429999999999 2024-04-25T22:53:00.399 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.400 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.400 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:00.400 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033275+0000", 2024-04-25T22:53:00.400 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6430000000000002e-05 2024-04-25T22:53:00.400 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:00.400 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:00.400 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:00.400 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.400 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.400 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-25T22:53:00.400 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:00.400 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 67.276132197999999, 2024-04-25T22:53:00.400 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005413597, 2024-04-25T22:53:00.400 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:00.401 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:00.401 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:00.401 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:00.401 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.401 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:00.401 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:00.401 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:00.401 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.401 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.401 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:00.401 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:00.401 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:00.401 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.401 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.402 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:00.402 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:00.402 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3799999999999997e-07 2024-04-25T22:53:00.402 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.402 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.402 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:00.402 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027816+0000", 2024-04-25T22:53:00.402 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3230999999999999e-05 2024-04-25T22:53:00.402 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.402 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.402 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:00.402 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027823+0000", 2024-04-25T22:53:00.402 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9039999999999992e-06 2024-04-25T22:53:00.402 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.403 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.403 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:00.403 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027841+0000", 2024-04-25T22:53:00.403 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7651000000000001e-05 2024-04-25T22:53:00.403 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.403 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.403 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:00.403 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027904+0000", 2024-04-25T22:53:00.403 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3058000000000005e-05 2024-04-25T22:53:00.403 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.403 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.403 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:00.403 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027926+0000", 2024-04-25T22:53:00.404 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1450999999999998e-05 2024-04-25T22:53:00.404 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.404 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.404 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:00.404 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033177+0000", 2024-04-25T22:53:00.404 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052508909999999997 2024-04-25T22:53:00.404 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.404 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.404 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:00.404 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033215+0000", 2024-04-25T22:53:00.404 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8872999999999999e-05 2024-04-25T22:53:00.404 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:00.404 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:00.404 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:00.405 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.405 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.405 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 171 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:53:00.405 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:00.405 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 67.276075096, 2024-04-25T22:53:00.405 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054322240000000003, 2024-04-25T22:53:00.405 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:00.405 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:00.405 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "reached pg", 2024-04-25T22:53:00.405 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:00.405 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.405 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:00.405 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:00.406 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:00.406 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.406 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.406 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:00.406 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:00.406 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:00.406 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.406 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.406 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:00.406 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:00.406 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7500000000000001e-07 2024-04-25T22:53:00.406 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.406 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.407 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:00.407 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027868+0000", 2024-04-25T22:53:00.407 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5750000000000001e-06 2024-04-25T22:53:00.407 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.407 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.407 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:00.407 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027885+0000", 2024-04-25T22:53:00.407 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7272e-05 2024-04-25T22:53:00.407 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.407 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.407 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:00.407 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027900+0000", 2024-04-25T22:53:00.407 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.502e-05 2024-04-25T22:53:00.407 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.407 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.407 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:00.408 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028381+0000", 2024-04-25T22:53:00.408 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00048039399999999998 2024-04-25T22:53:00.408 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:00.408 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:00.408 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:00.408 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033291+0000", 2024-04-25T22:53:00.408 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049105879999999996 2024-04-25T22:53:00.408 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:00.408 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:00.408 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:00.408 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:00.408 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:00.408 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:00.410 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:53:00.411 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:53:00.411 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:00.408+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:00.411 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:00.511 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:00.510+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:00.516 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:00.516 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:00.516 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-04-25T22:53:00.516 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:00.525 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:00.611 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:00.611+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:00.627 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:00.627 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:00.627 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:53:00.627 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:53:00.627 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:00.636 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:00.713 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:00.712+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:00.780 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:00.780 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-04-25T22:53:00.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-04-25T22:53:00.780 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:53:00.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.780 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:00.781 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:00.781 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 72.813302019999995, 2024-04-25T22:53:00.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0103421, 2024-04-25T22:53:00.781 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:00.781 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:00.781 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:00.781 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:00.781 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:00.781 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:00.781 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 115 2024-04-25T22:53:00.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.781 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:00.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:00.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:00.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:00.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:00.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:00.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:00.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:00.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:00.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9500000000000002e-07 2024-04-25T22:53:00.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:00.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965108+0000", 2024-04-25T22:53:00.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9177999999999994e-05 2024-04-25T22:53:00.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:00.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965127+0000", 2024-04-25T22:53:00.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8868e-05 2024-04-25T22:53:00.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:00.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965133+0000", 2024-04-25T22:53:00.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8929999999999999e-06 2024-04-25T22:53:00.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:00.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.969991+0000", 2024-04-25T22:53:00.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048573849999999997 2024-04-25T22:53:00.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:00.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970072+0000", 2024-04-25T22:53:00.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0728000000000004e-05 2024-04-25T22:53:00.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:00.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970189+0000", 2024-04-25T22:53:00.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000117778 2024-04-25T22:53:00.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:00.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970946+0000", 2024-04-25T22:53:00.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00075704600000000004 2024-04-25T22:53:00.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:00.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975297+0000", 2024-04-25T22:53:00.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004350217 2024-04-25T22:53:00.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:00.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975343+0000", 2024-04-25T22:53:00.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6687999999999998e-05 2024-04-25T22:53:00.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:00.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975380+0000", 2024-04-25T22:53:00.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6724000000000003e-05 2024-04-25T22:53:00.786 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:00.786 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:00.786 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:00.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.786 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:00.787 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:00.787 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 72.813195988999993, 2024-04-25T22:53:00.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010304384, 2024-04-25T22:53:00.787 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:00.787 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:00.787 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:00.787 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:00.787 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:00.787 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:00.787 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 116 2024-04-25T22:53:00.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.787 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:00.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:00.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:00.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:00.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:00.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:00.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:00.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:00.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:00.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5799999999999999e-07 2024-04-25T22:53:00.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:00.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965154+0000", 2024-04-25T22:53:00.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0009e-05 2024-04-25T22:53:00.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:00.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965164+0000", 2024-04-25T22:53:00.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8490000000000001e-06 2024-04-25T22:53:00.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:00.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965169+0000", 2024-04-25T22:53:00.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0730000000000004e-06 2024-04-25T22:53:00.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:00.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970609+0000", 2024-04-25T22:53:00.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054397689999999997 2024-04-25T22:53:00.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:00.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970651+0000", 2024-04-25T22:53:00.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1873999999999999e-05 2024-04-25T22:53:00.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:00.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970723+0000", 2024-04-25T22:53:00.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2039999999999995e-05 2024-04-25T22:53:00.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:00.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971358+0000", 2024-04-25T22:53:00.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063489500000000001 2024-04-25T22:53:00.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:00.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975409+0000", 2024-04-25T22:53:00.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040506880000000002 2024-04-25T22:53:00.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:00.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975432+0000", 2024-04-25T22:53:00.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3315999999999998e-05 2024-04-25T22:53:00.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:00.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975448+0000", 2024-04-25T22:53:00.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6313000000000001e-05 2024-04-25T22:53:00.792 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:00.792 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:00.793 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:00.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.793 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:00.793 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:00.793 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 72.813161406999996, 2024-04-25T22:53:00.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010384338999999999, 2024-04-25T22:53:00.793 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:00.793 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:00.793 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:00.793 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:00.793 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:00.793 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:00.793 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-04-25T22:53:00.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.794 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:00.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:00.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:00.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:00.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:00.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:00.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:00.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:00.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:00.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3600000000000004e-07 2024-04-25T22:53:00.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:00.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965185+0000", 2024-04-25T22:53:00.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.117e-06 2024-04-25T22:53:00.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:00.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965192+0000", 2024-04-25T22:53:00.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3239999999999997e-06 2024-04-25T22:53:00.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:00.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965198+0000", 2024-04-25T22:53:00.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6370000000000004e-06 2024-04-25T22:53:00.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:00.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970973+0000", 2024-04-25T22:53:00.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057748239999999996 2024-04-25T22:53:00.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:00.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971049+0000", 2024-04-25T22:53:00.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6029e-05 2024-04-25T22:53:00.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:00.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971174+0000", 2024-04-25T22:53:00.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012462399999999999 2024-04-25T22:53:00.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:00.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971553+0000", 2024-04-25T22:53:00.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037896499999999999 2024-04-25T22:53:00.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:00.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975482+0000", 2024-04-25T22:53:00.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039297459999999996 2024-04-25T22:53:00.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:00.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975529+0000", 2024-04-25T22:53:00.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6387000000000002e-05 2024-04-25T22:53:00.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:00.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975563+0000", 2024-04-25T22:53:00.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4150000000000003e-05 2024-04-25T22:53:00.798 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:00.798 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:00.799 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:00.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.799 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:00.799 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:00.799 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 67.766115084000006, 2024-04-25T22:53:00.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012637705000000001, 2024-04-25T22:53:00.799 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:00.799 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:00.799 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:00.799 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:00.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:00.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:00.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:00.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:00.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:00.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:00.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:00.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012227+0000", 2024-04-25T22:53:00.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.863e-06 2024-04-25T22:53:00.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:00.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012236+0000", 2024-04-25T22:53:00.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1109999999999997e-06 2024-04-25T22:53:00.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:00.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012309+0000", 2024-04-25T22:53:00.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3242000000000001e-05 2024-04-25T22:53:00.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:00.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012324+0000", 2024-04-25T22:53:00.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4837e-05 2024-04-25T22:53:00.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:00.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015060+0000", 2024-04-25T22:53:00.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027363349999999999 2024-04-25T22:53:00.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:00.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015169+0000", 2024-04-25T22:53:00.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108372 2024-04-25T22:53:00.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:00.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015498+0000", 2024-04-25T22:53:00.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032949999999999999 2024-04-25T22:53:00.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:00.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021282+0000", 2024-04-25T22:53:00.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057836429999999998 2024-04-25T22:53:00.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:00.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024709+0000", 2024-04-25T22:53:00.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034271979999999998 2024-04-25T22:53:00.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:00.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024802+0000", 2024-04-25T22:53:00.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2960000000000004e-05 2024-04-25T22:53:00.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:00.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024863+0000", 2024-04-25T22:53:00.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0643999999999997e-05 2024-04-25T22:53:00.804 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:00.804 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:00.804 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:00.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.804 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:00.804 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:00.804 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 67.765991313000001, 2024-04-25T22:53:00.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012979447999999999, 2024-04-25T22:53:00.805 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:00.805 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:00.805 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:00.805 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:00.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:00.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:00.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:00.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:00.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:00.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:00.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:00.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:00.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:53:00.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:00.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012354+0000", 2024-04-25T22:53:00.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7740000000000004e-06 2024-04-25T22:53:00.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:00.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012365+0000", 2024-04-25T22:53:00.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.064e-05 2024-04-25T22:53:00.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:00.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012382+0000", 2024-04-25T22:53:00.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6999000000000001e-05 2024-04-25T22:53:00.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:00.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015958+0000", 2024-04-25T22:53:00.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035765699999999998 2024-04-25T22:53:00.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:00.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016037+0000", 2024-04-25T22:53:00.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8242000000000001e-05 2024-04-25T22:53:00.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:00.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016404+0000", 2024-04-25T22:53:00.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036784300000000002 2024-04-25T22:53:00.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:00.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021294+0000", 2024-04-25T22:53:00.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048890629999999999 2024-04-25T22:53:00.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:00.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024959+0000", 2024-04-25T22:53:00.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036651570000000001 2024-04-25T22:53:00.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:00.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025097+0000", 2024-04-25T22:53:00.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013788099999999999 2024-04-25T22:53:00.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:00.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025328+0000", 2024-04-25T22:53:00.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231492 2024-04-25T22:53:00.810 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:00.810 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:00.810 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:00.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.810 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:00.810 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:00.810 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 67.765903543999997, 2024-04-25T22:53:00.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013049827, 2024-04-25T22:53:00.810 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:00.810 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:00.810 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:00.811 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:00.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:00.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:00.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:00.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:00.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:00.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:00.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:00.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012437+0000", 2024-04-25T22:53:00.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-04-25T22:53:00.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:00.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012440+0000", 2024-04-25T22:53:00.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7609999999999999e-06 2024-04-25T22:53:00.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:00.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012449+0000", 2024-04-25T22:53:00.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.285e-06 2024-04-25T22:53:00.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:00.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012457+0000", 2024-04-25T22:53:00.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9510000000000006e-06 2024-04-25T22:53:00.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:00.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017106+0000", 2024-04-25T22:53:00.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046494220000000003 2024-04-25T22:53:00.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:00.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017223+0000", 2024-04-25T22:53:00.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116824 2024-04-25T22:53:00.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:00.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017345+0000", 2024-04-25T22:53:00.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122175 2024-04-25T22:53:00.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:00.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021299+0000", 2024-04-25T22:53:00.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039534879999999998 2024-04-25T22:53:00.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:00.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025398+0000", 2024-04-25T22:53:00.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040988960000000003 2024-04-25T22:53:00.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:00.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025439+0000", 2024-04-25T22:53:00.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0915999999999999e-05 2024-04-25T22:53:00.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:00.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025486+0000", 2024-04-25T22:53:00.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7534999999999998e-05 2024-04-25T22:53:00.815 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:00.815 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:00.815 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:00.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.816 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:00.816 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:00.816 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 67.765873393000007, 2024-04-25T22:53:00.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020988041999999998, 2024-04-25T22:53:00.816 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:00.816 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:00.816 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:00.816 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:00.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:00.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:00.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:00.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:00.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:00.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:00.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:00.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:00.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.99e-07 2024-04-25T22:53:00.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:00.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012470+0000", 2024-04-25T22:53:00.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2789999999999999e-06 2024-04-25T22:53:00.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:00.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012477+0000", 2024-04-25T22:53:00.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:53:00.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:00.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012500+0000", 2024-04-25T22:53:00.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2490999999999999e-05 2024-04-25T22:53:00.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:00.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021911+0000", 2024-04-25T22:53:00.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094114160000000006 2024-04-25T22:53:00.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:00.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022000+0000", 2024-04-25T22:53:00.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8601000000000001e-05 2024-04-25T22:53:00.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:00.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022359+0000", 2024-04-25T22:53:00.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035921999999999999 2024-04-25T22:53:00.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:00.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025541+0000", 2024-04-25T22:53:00.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031820619999999998 2024-04-25T22:53:00.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:00.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033375+0000", 2024-04-25T22:53:00.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078338379999999992 2024-04-25T22:53:00.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:00.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033415+0000", 2024-04-25T22:53:00.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9527000000000003e-05 2024-04-25T22:53:00.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:00.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033455+0000", 2024-04-25T22:53:00.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9932000000000003e-05 2024-04-25T22:53:00.821 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:00.821 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:00.821 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:00.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.821 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:00.821 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:00.821 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 67.765818199999998, 2024-04-25T22:53:00.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021043857999999999, 2024-04-25T22:53:00.821 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:00.821 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:00.822 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:00.822 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:00.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.822 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:00.822 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:00.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:00.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.822 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:00.822 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:00.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:00.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:00.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012523+0000", 2024-04-25T22:53:00.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.361e-06 2024-04-25T22:53:00.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:00.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012530+0000", 2024-04-25T22:53:00.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5440000000000004e-06 2024-04-25T22:53:00.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:00.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012541+0000", 2024-04-25T22:53:00.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1745e-05 2024-04-25T22:53:00.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:00.824 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012551+0000", 2024-04-25T22:53:00.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5789999999999993e-06 2024-04-25T22:53:00.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:00.824 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022709+0000", 2024-04-25T22:53:00.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010157685 2024-04-25T22:53:00.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:00.824 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022957+0000", 2024-04-25T22:53:00.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024824599999999998 2024-04-25T22:53:00.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:00.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023443+0000", 2024-04-25T22:53:00.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048578599999999999 2024-04-25T22:53:00.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:00.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025547+0000", 2024-04-25T22:53:00.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021044789999999998 2024-04-25T22:53:00.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:00.826 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033509+0000", 2024-04-25T22:53:00.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0079622180000000001 2024-04-25T22:53:00.826 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.826 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.826 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:00.826 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033542+0000", 2024-04-25T22:53:00.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3018000000000001e-05 2024-04-25T22:53:00.826 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.826 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.826 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:00.826 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033566+0000", 2024-04-25T22:53:00.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3197000000000002e-05 2024-04-25T22:53:00.826 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:00.827 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:00.827 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:00.827 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.827 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:00.827 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:00.827 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 67.765778234999999, 2024-04-25T22:53:00.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021122696, 2024-04-25T22:53:00.827 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:00.827 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:00.827 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:00.827 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:00.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.827 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:00.828 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:00.828 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:00.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.828 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:00.828 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:00.828 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:00.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.828 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:00.828 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:00.828 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:53:00.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.829 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:00.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012566+0000", 2024-04-25T22:53:00.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-04-25T22:53:00.829 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.829 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:00.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012619+0000", 2024-04-25T22:53:00.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2607e-05 2024-04-25T22:53:00.829 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.829 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:00.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012628+0000", 2024-04-25T22:53:00.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6500000000000008e-06 2024-04-25T22:53:00.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.830 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:00.830 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024024+0000", 2024-04-25T22:53:00.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011396007999999999 2024-04-25T22:53:00.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.830 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:00.830 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024198+0000", 2024-04-25T22:53:00.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000173215 2024-04-25T22:53:00.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.830 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:00.831 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024447+0000", 2024-04-25T22:53:00.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024898500000000002 2024-04-25T22:53:00.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.831 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.831 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:00.831 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026431+0000", 2024-04-25T22:53:00.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001984923 2024-04-25T22:53:00.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.831 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.831 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:00.831 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033608+0000", 2024-04-25T22:53:00.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071768459999999997 2024-04-25T22:53:00.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.831 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.832 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:00.832 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033646+0000", 2024-04-25T22:53:00.832 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299000000000003e-05 2024-04-25T22:53:00.832 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.832 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:00.832 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033684+0000", 2024-04-25T22:53:00.832 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8773000000000003e-05 2024-04-25T22:53:00.832 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:00.832 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:00.832 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:00.832 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.832 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:00.833 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:00.833 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 67.765689636000005, 2024-04-25T22:53:00.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021175381, 2024-04-25T22:53:00.833 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:00.833 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:00.833 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:00.833 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:00.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.833 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:00.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:00.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:00.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.833 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:00.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:00.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:00.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:00.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012651+0000", 2024-04-25T22:53:00.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:53:00.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:00.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012656+0000", 2024-04-25T22:53:00.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8899999999999998e-06 2024-04-25T22:53:00.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:00.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012666+0000", 2024-04-25T22:53:00.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0346999999999999e-05 2024-04-25T22:53:00.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:00.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012675+0000", 2024-04-25T22:53:00.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9930000000000001e-06 2024-04-25T22:53:00.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:00.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025661+0000", 2024-04-25T22:53:00.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01298531 2024-04-25T22:53:00.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.836 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:00.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025757+0000", 2024-04-25T22:53:00.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5822000000000005e-05 2024-04-25T22:53:00.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.836 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:00.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025907+0000", 2024-04-25T22:53:00.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015051499999999999 2024-04-25T22:53:00.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.836 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:00.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026435+0000", 2024-04-25T22:53:00.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052762200000000005 2024-04-25T22:53:00.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:00.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033732+0000", 2024-04-25T22:53:00.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072978419999999997 2024-04-25T22:53:00.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:00.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033787+0000", 2024-04-25T22:53:00.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4703999999999997e-05 2024-04-25T22:53:00.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:00.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033826+0000", 2024-04-25T22:53:00.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8458999999999999e-05 2024-04-25T22:53:00.838 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:00.838 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:00.838 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:00.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.838 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:00.838 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:00.838 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 67.765634222000003, 2024-04-25T22:53:00.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021244174000000001, 2024-04-25T22:53:00.838 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:00.838 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:00.839 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:00.839 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:00.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:00.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:00.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:00.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:00.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:00.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:00.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:00.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:00.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:00.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:00.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012712+0000", 2024-04-25T22:53:00.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.913e-06 2024-04-25T22:53:00.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:00.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012722+0000", 2024-04-25T22:53:00.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2879999999999998e-06 2024-04-25T22:53:00.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:00.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012727+0000", 2024-04-25T22:53:00.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8429999999999998e-06 2024-04-25T22:53:00.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:00.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026099+0000", 2024-04-25T22:53:00.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013371450999999999 2024-04-25T22:53:00.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:00.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026147+0000", 2024-04-25T22:53:00.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7837999999999998e-05 2024-04-25T22:53:00.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:00.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026254+0000", 2024-04-25T22:53:00.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107314 2024-04-25T22:53:00.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:00.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026686+0000", 2024-04-25T22:53:00.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000432428 2024-04-25T22:53:00.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:00.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033873+0000", 2024-04-25T22:53:00.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071864399999999997 2024-04-25T22:53:00.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:00.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033904+0000", 2024-04-25T22:53:00.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1321e-05 2024-04-25T22:53:00.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:00.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033950+0000", 2024-04-25T22:53:00.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5707999999999997e-05 2024-04-25T22:53:00.843 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:00.843 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:00.843 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:00.844 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.844 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:00.844 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:00.844 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 67.765603837, 2024-04-25T22:53:00.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01096505, 2024-04-25T22:53:00.844 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:00.844 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:00.844 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:00.844 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:00.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.844 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:00.844 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:00.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:00.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:00.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:00.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:00.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:00.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012737+0000", 2024-04-25T22:53:00.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:00.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:00.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012739+0000", 2024-04-25T22:53:00.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-04-25T22:53:00.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:00.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012743+0000", 2024-04-25T22:53:00.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3239999999999996e-06 2024-04-25T22:53:00.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:00.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012746+0000", 2024-04-25T22:53:00.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.129e-06 2024-04-25T22:53:00.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:00.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012796+0000", 2024-04-25T22:53:00.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9231999999999999e-05 2024-04-25T22:53:00.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:00.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012915+0000", 2024-04-25T22:53:00.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119021 2024-04-25T22:53:00.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:00.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013069+0000", 2024-04-25T22:53:00.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015463900000000001 2024-04-25T22:53:00.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:00.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019237+0000", 2024-04-25T22:53:00.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061680329999999998 2024-04-25T22:53:00.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:00.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023603+0000", 2024-04-25T22:53:00.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043655860000000003 2024-04-25T22:53:00.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:00.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023659+0000", 2024-04-25T22:53:00.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6484000000000003e-05 2024-04-25T22:53:00.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.849 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:00.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023701+0000", 2024-04-25T22:53:00.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1761999999999998e-05 2024-04-25T22:53:00.849 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:00.849 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:00.849 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:00.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.849 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:00.849 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:00.849 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 67.765578888999997, 2024-04-25T22:53:00.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011234429000000001, 2024-04-25T22:53:00.849 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:00.850 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:00.850 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:00.850 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:00.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.850 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:00.850 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:00.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:00.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.850 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:00.850 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:00.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:00.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:00.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012762+0000", 2024-04-25T22:53:00.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-04-25T22:53:00.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:00.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012765+0000", 2024-04-25T22:53:00.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2569999999999999e-06 2024-04-25T22:53:00.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:00.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012783+0000", 2024-04-25T22:53:00.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8431999999999999e-05 2024-04-25T22:53:00.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:00.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012799+0000", 2024-04-25T22:53:00.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5438999999999999e-05 2024-04-25T22:53:00.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:00.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013826+0000", 2024-04-25T22:53:00.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010275060000000001 2024-04-25T22:53:00.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:00.853 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013913+0000", 2024-04-25T22:53:00.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.708e-05 2024-04-25T22:53:00.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.853 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:00.853 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014098+0000", 2024-04-25T22:53:00.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018519399999999999 2024-04-25T22:53:00.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.853 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:00.853 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019684+0000", 2024-04-25T22:53:00.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055860079999999999 2024-04-25T22:53:00.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.854 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:00.854 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023876+0000", 2024-04-25T22:53:00.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041918800000000003 2024-04-25T22:53:00.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.854 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:00.854 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023957+0000", 2024-04-25T22:53:00.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1165e-05 2024-04-25T22:53:00.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.854 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:00.854 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023995+0000", 2024-04-25T22:53:00.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:53:00.854 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:00.855 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:00.855 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:00.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.855 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:00.855 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:00.855 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 67.765481109999996, 2024-04-25T22:53:00.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011131200000000001, 2024-04-25T22:53:00.855 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:00.855 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:00.855 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:00.855 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:00.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:00.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:00.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:00.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:00.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:00.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:00.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:00.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012860+0000", 2024-04-25T22:53:00.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3900000000000004e-07 2024-04-25T22:53:00.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.857 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:00.857 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012865+0000", 2024-04-25T22:53:00.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5609999999999998e-06 2024-04-25T22:53:00.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.857 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:00.857 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012895+0000", 2024-04-25T22:53:00.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9847000000000001e-05 2024-04-25T22:53:00.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.857 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:00.857 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012905+0000", 2024-04-25T22:53:00.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.03e-05 2024-04-25T22:53:00.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.858 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:00.858 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015020+0000", 2024-04-25T22:53:00.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021142940000000001 2024-04-25T22:53:00.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.858 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:00.858 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015182+0000", 2024-04-25T22:53:00.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016248099999999999 2024-04-25T22:53:00.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.858 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:00.858 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015357+0000", 2024-04-25T22:53:00.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017471000000000001 2024-04-25T22:53:00.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:00.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021021+0000", 2024-04-25T22:53:00.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056638340000000004 2024-04-25T22:53:00.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:00.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023712+0000", 2024-04-25T22:53:00.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026910380000000002 2024-04-25T22:53:00.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:00.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023763+0000", 2024-04-25T22:53:00.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1477999999999997e-05 2024-04-25T22:53:00.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:00.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023990+0000", 2024-04-25T22:53:00.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000226818 2024-04-25T22:53:00.860 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:00.860 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:00.860 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:00.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.860 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:00.860 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:00.861 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 67.765358014, 2024-04-25T22:53:00.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011705299000000001, 2024-04-25T22:53:00.861 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:00.861 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:00.861 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:00.861 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:00.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:00.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:00.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:00.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:00.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:00.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:00.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:00.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012983+0000", 2024-04-25T22:53:00.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:53:00.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:00.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012986+0000", 2024-04-25T22:53:00.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5700000000000001e-06 2024-04-25T22:53:00.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:00.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012993+0000", 2024-04-25T22:53:00.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8730000000000001e-06 2024-04-25T22:53:00.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:00.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013000+0000", 2024-04-25T22:53:00.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1890000000000001e-06 2024-04-25T22:53:00.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:00.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:53:00.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002147866 2024-04-25T22:53:00.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.864 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:00.864 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015351+0000", 2024-04-25T22:53:00.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020300799999999999 2024-04-25T22:53:00.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.864 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:00.864 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016260+0000", 2024-04-25T22:53:00.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00090926799999999997 2024-04-25T22:53:00.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.864 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:00.864 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022669+0000", 2024-04-25T22:53:00.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064082849999999997 2024-04-25T22:53:00.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:00.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024584+0000", 2024-04-25T22:53:00.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019151699999999999 2024-04-25T22:53:00.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:00.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024643+0000", 2024-04-25T22:53:00.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8888999999999998e-05 2024-04-25T22:53:00.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.866 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:00.866 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024687+0000", 2024-04-25T22:53:00.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4444999999999999e-05 2024-04-25T22:53:00.866 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:00.866 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:00.866 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:00.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.866 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:00.866 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:00.866 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 67.765330422999995, 2024-04-25T22:53:00.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011249699, 2024-04-25T22:53:00.866 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:00.866 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:00.867 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:00.867 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:00.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.867 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:00.867 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:00.867 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:00.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.867 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:00.867 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:00.867 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:00.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.868 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:00.868 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013010+0000", 2024-04-25T22:53:00.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2099999999999996e-07 2024-04-25T22:53:00.868 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.868 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.868 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:00.868 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013013+0000", 2024-04-25T22:53:00.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1310000000000002e-06 2024-04-25T22:53:00.868 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.868 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.868 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:00.868 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013020+0000", 2024-04-25T22:53:00.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3330000000000002e-06 2024-04-25T22:53:00.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.869 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.869 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:00.869 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013025+0000", 2024-04-25T22:53:00.869 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6760000000000004e-06 2024-04-25T22:53:00.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.869 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.869 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:00.869 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013163+0000", 2024-04-25T22:53:00.869 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013824599999999999 2024-04-25T22:53:00.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.869 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.869 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:00.869 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013504+0000", 2024-04-25T22:53:00.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034080299999999998 2024-04-25T22:53:00.870 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.870 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.870 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:00.870 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013613+0000", 2024-04-25T22:53:00.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108705 2024-04-25T22:53:00.870 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.870 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.870 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:00.870 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015831+0000", 2024-04-25T22:53:00.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002217672 2024-04-25T22:53:00.870 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.870 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.871 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:00.871 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024137+0000", 2024-04-25T22:53:00.871 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0083060489999999994 2024-04-25T22:53:00.871 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.871 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.871 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:00.871 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024218+0000", 2024-04-25T22:53:00.871 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1351000000000001e-05 2024-04-25T22:53:00.871 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.871 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.871 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:00.871 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024259+0000", 2024-04-25T22:53:00.871 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1112000000000002e-05 2024-04-25T22:53:00.871 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:00.871 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:00.872 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:00.872 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.872 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.872 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:00.872 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:00.872 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 67.765242697000005, 2024-04-25T22:53:00.872 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020379749999999999, 2024-04-25T22:53:00.872 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:00.872 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:00.872 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:00.872 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:00.872 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.872 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:00.873 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:00.873 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:00.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.873 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.873 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:00.873 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:00.873 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:00.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.873 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.873 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:00.873 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013098+0000", 2024-04-25T22:53:00.873 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:53:00.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.873 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.874 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:00.874 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013105+0000", 2024-04-25T22:53:00.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5969999999999997e-06 2024-04-25T22:53:00.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.874 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:00.874 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013190+0000", 2024-04-25T22:53:00.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5618999999999995e-05 2024-04-25T22:53:00.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.874 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:00.874 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013200+0000", 2024-04-25T22:53:00.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5859999999999994e-06 2024-04-25T22:53:00.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.875 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:00.875 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020265+0000", 2024-04-25T22:53:00.875 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070653349999999998 2024-04-25T22:53:00.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.875 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:00.875 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020454+0000", 2024-04-25T22:53:00.875 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189316 2024-04-25T22:53:00.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.875 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:00.875 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020586+0000", 2024-04-25T22:53:00.876 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013195700000000001 2024-04-25T22:53:00.876 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.876 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.876 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:00.876 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023822+0000", 2024-04-25T22:53:00.876 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032358529999999999 2024-04-25T22:53:00.876 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.876 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.876 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:00.876 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033409+0000", 2024-04-25T22:53:00.876 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095870520000000004 2024-04-25T22:53:00.876 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.876 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.876 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:00.876 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033447+0000", 2024-04-25T22:53:00.877 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7261999999999997e-05 2024-04-25T22:53:00.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.877 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:00.877 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033477+0000", 2024-04-25T22:53:00.877 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0389e-05 2024-04-25T22:53:00.877 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:00.877 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:00.877 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:00.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.877 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:00.877 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:00.878 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 67.765126190999993, 2024-04-25T22:53:00.878 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010857383999999999, 2024-04-25T22:53:00.878 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:00.878 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:00.878 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:00.878 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:00.878 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.878 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:00.878 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:00.878 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:00.878 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.878 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.878 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:00.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:00.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:00.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:00.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:00.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:00.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:00.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013218+0000", 2024-04-25T22:53:00.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8199999999999998e-06 2024-04-25T22:53:00.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.880 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:00.880 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013226+0000", 2024-04-25T22:53:00.880 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7649999999999993e-06 2024-04-25T22:53:00.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.880 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.880 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:00.880 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013259+0000", 2024-04-25T22:53:00.880 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2727e-05 2024-04-25T22:53:00.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.880 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.880 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:00.880 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014809+0000", 2024-04-25T22:53:00.880 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001550144 2024-04-25T22:53:00.881 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.881 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.881 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:00.881 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014958+0000", 2024-04-25T22:53:00.881 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014890300000000001 2024-04-25T22:53:00.881 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.881 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.881 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:00.881 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015087+0000", 2024-04-25T22:53:00.881 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012939200000000001 2024-04-25T22:53:00.881 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.881 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.881 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:00.882 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020212+0000", 2024-04-25T22:53:00.882 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051248939999999996 2024-04-25T22:53:00.882 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.882 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.882 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:00.882 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023699+0000", 2024-04-25T22:53:00.882 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034873289999999999 2024-04-25T22:53:00.882 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.882 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.882 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:00.882 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024014+0000", 2024-04-25T22:53:00.882 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031473999999999999 2024-04-25T22:53:00.882 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.883 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:00.883 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024071+0000", 2024-04-25T22:53:00.883 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7040000000000003e-05 2024-04-25T22:53:00.883 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:00.883 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:00.883 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:00.883 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.883 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:00.883 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:00.883 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 67.765071485999997, 2024-04-25T22:53:00.883 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012329677000000001, 2024-04-25T22:53:00.883 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:00.884 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:00.884 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:00.884 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:00.884 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.884 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:00.884 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:00.884 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:00.884 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.884 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.884 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:00.884 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:00.884 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:00.884 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.884 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.885 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:00.885 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013269+0000", 2024-04-25T22:53:00.885 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5000000000000002e-07 2024-04-25T22:53:00.885 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.885 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.885 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:00.885 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:00.885 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6909999999999999e-06 2024-04-25T22:53:00.885 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.885 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.885 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:00.885 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013284+0000", 2024-04-25T22:53:00.885 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0963e-05 2024-04-25T22:53:00.885 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.885 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.886 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:00.886 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013361+0000", 2024-04-25T22:53:00.886 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7379999999999994e-05 2024-04-25T22:53:00.886 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.886 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.886 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:00.886 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013448+0000", 2024-04-25T22:53:00.886 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6990000000000006e-05 2024-04-25T22:53:00.886 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.886 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.886 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:00.886 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013632+0000", 2024-04-25T22:53:00.886 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018396800000000001 2024-04-25T22:53:00.887 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.887 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.887 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:00.887 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013800+0000", 2024-04-25T22:53:00.887 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167467 2024-04-25T22:53:00.887 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.887 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.887 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:00.887 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.018570+0000", 2024-04-25T22:53:00.887 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047701460000000003 2024-04-25T22:53:00.887 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.887 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.887 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:00.887 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025507+0000", 2024-04-25T22:53:00.888 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069372039999999998 2024-04-25T22:53:00.888 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.888 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.888 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:00.888 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025562+0000", 2024-04-25T22:53:00.888 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4858999999999998e-05 2024-04-25T22:53:00.888 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.888 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.888 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:00.888 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025598+0000", 2024-04-25T22:53:00.888 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6259e-05 2024-04-25T22:53:00.888 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:00.888 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:00.888 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:00.889 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.889 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.889 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:00.889 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:00.889 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 67.764939612999996, 2024-04-25T22:53:00.889 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020176666999999999, 2024-04-25T22:53:00.889 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:00.889 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:00.889 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:53:00.889 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:00.889 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.889 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:00.889 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:00.890 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:00.890 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.890 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.890 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:00.890 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:00.890 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:00.890 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.890 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.890 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:00.890 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:00.890 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-04-25T22:53:00.890 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.890 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.891 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:00.891 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013405+0000", 2024-04-25T22:53:00.891 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0559999999999998e-06 2024-04-25T22:53:00.891 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.891 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.891 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:00.891 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013422+0000", 2024-04-25T22:53:00.891 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6770999999999999e-05 2024-04-25T22:53:00.891 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.891 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.891 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:00.891 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013431+0000", 2024-04-25T22:53:00.891 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5019999999999998e-06 2024-04-25T22:53:00.891 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.892 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.892 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:00.892 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021720+0000", 2024-04-25T22:53:00.892 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082884340000000008 2024-04-25T22:53:00.892 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.892 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.892 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:00.892 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022122+0000", 2024-04-25T22:53:00.892 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000401634 2024-04-25T22:53:00.892 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:00.892 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:00.892 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:00.892 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033577+0000", 2024-04-25T22:53:00.892 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011455435999999999 2024-04-25T22:53:00.893 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:00.893 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:00.893 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:00.893 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:00.893 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:00.893 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:00.894 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:00.894+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:00.895 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:00.994 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~18s 2024-04-25T22:53:00.995 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:00.994+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:01.002 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:01.002 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:01.002 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-25T22:53:01.002 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:01.011 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:01.096 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:01.095+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:01.153 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:01.153 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:01.153 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-25T22:53:01.154 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-25T22:53:01.154 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:01.162 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:01.184 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2024-04-25T22:53:01.185 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-25T22:53:01.185 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-04-25T22:53:01.185 INFO:tasks.thrashosds.thrasher:Setting osd 1 primary_affinity to 1.000000 2024-04-25T22:53:01.185 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-04-25T22:53:01.197 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:01.196+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:01.298 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:01.297+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:01.305 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:01.305 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:53:01.305 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:53:01.305 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:53:01.305 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.306 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:53:01.306 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:01.306 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 73.336664507999998, 2024-04-25T22:53:01.306 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:53:01.306 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:01.306 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:01.306 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:01.306 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:01.306 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.307 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:01.307 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:01.307 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:01.307 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.307 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.307 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:01.307 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:01.307 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:01.307 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.307 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.307 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:01.307 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:53:01.308 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:53:01.308 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.308 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.308 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:01.308 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:53:01.308 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:53:01.308 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.308 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.308 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:01.308 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:53:01.308 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:53:01.308 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.308 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.309 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:01.309 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:53:01.309 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:53:01.309 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.309 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.309 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:01.309 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:53:01.309 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:53:01.309 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.309 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.309 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:01.309 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:53:01.310 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:53:01.310 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.310 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.310 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:01.310 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:53:01.310 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:53:01.310 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.310 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.310 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:01.310 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:53:01.310 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:53:01.310 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:01.311 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:01.311 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:01.311 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.311 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.311 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:110 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'72, mlcod=10'68)", 2024-04-25T22:53:01.311 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:01.311 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 73.336030507999993, 2024-04-25T22:53:01.311 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065316630000000001, 2024-04-25T22:53:01.311 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:01.311 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:01.311 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:01.311 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:01.312 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.312 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:01.312 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:01.312 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:01.312 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.312 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.312 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:01.312 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:01.312 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:01.312 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.312 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.312 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:01.312 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:01.313 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.58e-07 2024-04-25T22:53:01.313 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.313 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.313 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:01.313 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967811+0000", 2024-04-25T22:53:01.313 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.118e-06 2024-04-25T22:53:01.313 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.313 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.313 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:01.313 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967817+0000", 2024-04-25T22:53:01.313 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3709999999999996e-06 2024-04-25T22:53:01.313 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.313 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.313 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:01.313 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967820+0000", 2024-04-25T22:53:01.314 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2210000000000002e-06 2024-04-25T22:53:01.314 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.314 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.314 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:01.314 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967876+0000", 2024-04-25T22:53:01.314 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5507000000000002e-05 2024-04-25T22:53:01.314 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.314 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.314 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:01.314 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967893+0000", 2024-04-25T22:53:01.314 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7812000000000002e-05 2024-04-25T22:53:01.314 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.314 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.315 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:01.315 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974317+0000", 2024-04-25T22:53:01.315 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064237160000000003 2024-04-25T22:53:01.315 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.315 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.315 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:01.315 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:53:01.315 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.156e-05 2024-04-25T22:53:01.315 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:01.315 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:01.315 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:01.315 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.315 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.316 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'68)", 2024-04-25T22:53:01.316 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:01.316 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 73.335612995000005, 2024-04-25T22:53:01.316 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061292279999999996, 2024-04-25T22:53:01.316 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:01.316 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:01.316 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:01.316 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:01.316 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.316 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:01.316 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:01.316 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:01.317 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.317 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.317 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:01.317 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:01.317 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:01.317 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.317 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.317 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:01.317 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:01.317 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6300000000000001e-07 2024-04-25T22:53:01.317 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.317 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.317 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:01.318 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968228+0000", 2024-04-25T22:53:01.318 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6139999999999999e-06 2024-04-25T22:53:01.318 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.318 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.318 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:01.318 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968235+0000", 2024-04-25T22:53:01.318 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7020000000000001e-06 2024-04-25T22:53:01.318 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.318 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.318 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:01.319 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968238+0000", 2024-04-25T22:53:01.319 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0010000000000002e-06 2024-04-25T22:53:01.319 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.319 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.319 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:01.319 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968297+0000", 2024-04-25T22:53:01.319 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8424999999999997e-05 2024-04-25T22:53:01.319 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.319 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.319 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:01.319 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968316+0000", 2024-04-25T22:53:01.319 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8814999999999999e-05 2024-04-25T22:53:01.320 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.320 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.320 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:01.320 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:53:01.320 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060239439999999998 2024-04-25T22:53:01.320 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.320 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.320 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:01.320 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974354+0000", 2024-04-25T22:53:01.320 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4364e-05 2024-04-25T22:53:01.320 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:01.320 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:01.320 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:01.321 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.321 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.321 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'68)", 2024-04-25T22:53:01.321 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:01.321 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 73.335175993000007, 2024-04-25T22:53:01.321 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005948414, 2024-04-25T22:53:01.321 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:01.321 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:01.321 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:01.321 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:01.321 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.321 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:01.321 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:01.322 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:01.322 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.322 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.322 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:01.322 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:01.322 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:01.322 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.322 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.322 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:01.322 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:01.322 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6199999999999998e-07 2024-04-25T22:53:01.322 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.323 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.323 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:01.323 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968723+0000", 2024-04-25T22:53:01.323 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1148999999999993e-05 2024-04-25T22:53:01.323 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.323 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.323 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:01.323 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968730+0000", 2024-04-25T22:53:01.323 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1749999999999999e-06 2024-04-25T22:53:01.323 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.323 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.323 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:01.323 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968734+0000", 2024-04-25T22:53:01.323 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5200000000000002e-06 2024-04-25T22:53:01.324 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.324 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.324 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:01.324 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968771+0000", 2024-04-25T22:53:01.324 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6851999999999999e-05 2024-04-25T22:53:01.324 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.324 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.324 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:01.324 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968788+0000", 2024-04-25T22:53:01.324 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7027000000000001e-05 2024-04-25T22:53:01.324 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.324 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.324 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:01.324 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974589+0000", 2024-04-25T22:53:01.325 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058013320000000002 2024-04-25T22:53:01.325 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.325 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.325 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:01.325 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974610+0000", 2024-04-25T22:53:01.325 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0897e-05 2024-04-25T22:53:01.325 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:01.325 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:01.325 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:01.326 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.326 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.326 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'68)", 2024-04-25T22:53:01.326 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:01.326 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 73.334605983000003, 2024-04-25T22:53:01.326 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053935750000000003, 2024-04-25T22:53:01.326 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:01.326 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:01.326 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:01.326 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:01.327 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.327 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:01.327 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:01.327 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:01.327 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.327 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.327 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:01.327 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:01.327 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:01.327 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.327 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.327 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:01.327 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:01.327 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.03e-07 2024-04-25T22:53:01.328 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.328 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.328 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:01.328 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969235+0000", 2024-04-25T22:53:01.328 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2399999999999999e-06 2024-04-25T22:53:01.328 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.328 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.328 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:01.328 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969242+0000", 2024-04-25T22:53:01.328 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1269999999999997e-06 2024-04-25T22:53:01.328 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.328 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.328 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:01.328 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969246+0000", 2024-04-25T22:53:01.329 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3840000000000001e-06 2024-04-25T22:53:01.329 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.329 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.329 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:01.329 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969278+0000", 2024-04-25T22:53:01.329 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1868e-05 2024-04-25T22:53:01.329 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.329 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.329 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:01.329 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969295+0000", 2024-04-25T22:53:01.329 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7530999999999999e-05 2024-04-25T22:53:01.329 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.329 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.329 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:01.330 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974611+0000", 2024-04-25T22:53:01.330 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053160789999999996 2024-04-25T22:53:01.330 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.330 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.330 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:01.330 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974625+0000", 2024-04-25T22:53:01.330 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3943e-05 2024-04-25T22:53:01.330 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:01.330 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:01.330 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:01.330 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.330 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.331 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-25T22:53:01.331 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:01.331 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 73.141010074999997, 2024-04-25T22:53:01.331 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054952610000000004, 2024-04-25T22:53:01.331 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:01.331 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:01.331 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:01.331 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:01.331 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.331 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:01.331 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:01.331 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:01.331 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.331 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.332 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:01.332 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:01.332 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:01.332 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.332 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.332 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:01.332 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:01.332 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.68e-07 2024-04-25T22:53:01.332 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.332 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.332 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:01.332 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162898+0000", 2024-04-25T22:53:01.333 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9470999999999999e-05 2024-04-25T22:53:01.333 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.333 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.333 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:01.333 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162906+0000", 2024-04-25T22:53:01.333 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1580000000000005e-06 2024-04-25T22:53:01.333 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.333 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.333 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:01.333 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162911+0000", 2024-04-25T22:53:01.333 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4779999999999999e-06 2024-04-25T22:53:01.333 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.333 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.333 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:01.334 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162952+0000", 2024-04-25T22:53:01.334 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0629e-05 2024-04-25T22:53:01.334 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.334 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.334 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:01.334 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162968+0000", 2024-04-25T22:53:01.334 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6239000000000002e-05 2024-04-25T22:53:01.334 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.334 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.334 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:01.335 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168281+0000", 2024-04-25T22:53:01.335 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053132869999999999 2024-04-25T22:53:01.335 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.335 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.335 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:01.335 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168323+0000", 2024-04-25T22:53:01.335 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1430999999999997e-05 2024-04-25T22:53:01.335 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:01.335 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:01.335 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:01.335 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.335 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.335 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-04-25T22:53:01.336 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:01.336 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 72.710532713000006, 2024-04-25T22:53:01.336 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050872510000000001, 2024-04-25T22:53:01.336 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:01.336 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:01.336 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:01.336 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:01.336 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.336 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:01.336 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:01.336 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:01.336 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.336 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.336 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:01.336 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:01.337 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:01.337 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.337 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.337 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:01.337 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:01.337 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.72e-07 2024-04-25T22:53:01.337 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.337 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.337 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:01.337 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593381+0000", 2024-04-25T22:53:01.337 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5797000000000006e-05 2024-04-25T22:53:01.337 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.338 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.338 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:01.338 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593389+0000", 2024-04-25T22:53:01.338 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8480000000000001e-06 2024-04-25T22:53:01.338 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.338 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.338 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:01.338 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593393+0000", 2024-04-25T22:53:01.338 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4819999999999996e-06 2024-04-25T22:53:01.338 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.338 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.338 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:01.339 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593435+0000", 2024-04-25T22:53:01.339 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1600000000000002e-05 2024-04-25T22:53:01.339 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.339 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.339 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:01.339 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593454+0000", 2024-04-25T22:53:01.339 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8868e-05 2024-04-25T22:53:01.339 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.339 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.339 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:01.339 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598350+0000", 2024-04-25T22:53:01.339 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004895763 2024-04-25T22:53:01.339 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.339 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.340 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:01.340 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598392+0000", 2024-04-25T22:53:01.340 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2521000000000002e-05 2024-04-25T22:53:01.340 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:01.340 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:01.340 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:01.341 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.341 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.341 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:01.341 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:01.341 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 68.292168809000003, 2024-04-25T22:53:01.342 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:53:01.342 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:01.342 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:01.342 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:01.342 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:01.342 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.342 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:01.342 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:01.342 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:01.342 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.342 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.342 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:01.342 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:01.343 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:01.343 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.343 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.343 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:01.343 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:53:01.343 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:53:01.343 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.343 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.343 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:01.343 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:53:01.343 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:53:01.343 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.343 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.343 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:01.344 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:53:01.344 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:53:01.344 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.344 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.344 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:01.344 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:53:01.344 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:53:01.344 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.344 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.344 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:01.344 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:53:01.345 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:53:01.345 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.345 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.345 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:01.345 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:53:01.345 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:53:01.345 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.345 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.345 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:01.345 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:53:01.345 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:53:01.345 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.345 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.345 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:01.346 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:53:01.346 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:53:01.346 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.346 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.346 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:01.346 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:53:01.346 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:53:01.346 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.346 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.346 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:01.346 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:53:01.346 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:53:01.346 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.347 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.347 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:01.347 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:53:01.347 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:53:01.347 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:01.347 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:01.347 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:01.347 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.347 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.347 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:01.347 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:01.347 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 68.291494432999997, 2024-04-25T22:53:01.348 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:53:01.348 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:01.348 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:01.348 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:01.348 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:01.348 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.348 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:01.348 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:01.348 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:01.348 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.348 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.348 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:01.348 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:01.349 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:01.349 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.349 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.349 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:01.349 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:53:01.349 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:53:01.349 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.349 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.349 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:01.349 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:53:01.349 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:53:01.349 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.349 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.350 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:01.350 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:53:01.350 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:53:01.350 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.350 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.350 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:01.350 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:53:01.350 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:53:01.350 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.350 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.350 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:01.350 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:53:01.351 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:53:01.351 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.351 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.351 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:01.351 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:53:01.351 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:53:01.351 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.351 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.351 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:01.351 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:53:01.351 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:53:01.351 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.352 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.352 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:01.352 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:53:01.352 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:53:01.352 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.352 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.352 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:01.352 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:53:01.352 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:53:01.352 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.352 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.352 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:01.353 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:53:01.353 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:53:01.353 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.353 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.353 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:01.353 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:53:01.353 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:53:01.353 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:01.353 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:01.353 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:01.353 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.353 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.353 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:01.353 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:01.354 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 68.290985221, 2024-04-25T22:53:01.354 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:53:01.354 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:01.354 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:01.354 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:01.354 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:01.354 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.354 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:01.354 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:01.354 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:01.354 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.354 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.354 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:01.355 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:01.355 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:01.355 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.355 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.355 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:01.355 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:53:01.355 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:53:01.355 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.355 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.355 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:01.355 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:53:01.355 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:53:01.356 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.356 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.356 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:01.356 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:53:01.356 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:53:01.356 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.356 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.356 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:01.356 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:53:01.356 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:53:01.356 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.356 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.356 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:01.356 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:53:01.357 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:53:01.357 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.357 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.357 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:01.357 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:53:01.357 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:53:01.357 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.357 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.357 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:01.357 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:53:01.357 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:53:01.357 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.357 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.357 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:01.358 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:53:01.358 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:53:01.358 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.358 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.358 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:01.358 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:53:01.358 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:53:01.358 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.358 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.358 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:01.358 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:53:01.358 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:53:01.358 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.359 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.359 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:01.359 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:53:01.359 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:53:01.359 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:01.359 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:01.359 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:01.359 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.359 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.359 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:01.359 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:01.359 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 68.290572022999996, 2024-04-25T22:53:01.359 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:53:01.359 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:01.360 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:01.360 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:01.360 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:01.360 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.360 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:01.360 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:01.360 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:01.360 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.360 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.360 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:01.361 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:01.361 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:01.361 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.361 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.361 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:01.361 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:01.361 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:53:01.361 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.361 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.361 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:01.361 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:01.362 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:53:01.362 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.362 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.362 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:01.362 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:53:01.362 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:53:01.362 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.362 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.362 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:01.362 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:53:01.362 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:53:01.362 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.362 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.362 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:01.363 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:53:01.363 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:53:01.363 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.363 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.363 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:01.363 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:53:01.363 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:53:01.363 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.363 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.363 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:01.363 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:53:01.363 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:53:01.363 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.363 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.364 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:01.364 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:53:01.364 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:53:01.364 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.364 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.364 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:01.364 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:53:01.364 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:53:01.364 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.364 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.364 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:01.364 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:53:01.364 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:53:01.365 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.365 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.365 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:01.365 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:53:01.365 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:53:01.365 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:01.365 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:01.365 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:01.365 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.365 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.365 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:01.366 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:01.366 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 68.290521353000003, 2024-04-25T22:53:01.366 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:53:01.366 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:01.366 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:01.366 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:01.366 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:01.366 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.366 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:01.366 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:01.366 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:01.366 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.366 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.366 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:01.367 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:01.367 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:01.367 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.367 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.367 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:01.367 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:53:01.367 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:53:01.367 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.367 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.367 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:01.367 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:53:01.367 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:53:01.367 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.368 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.368 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:01.368 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:53:01.368 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:53:01.368 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.368 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.368 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:01.368 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:53:01.368 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:53:01.368 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.368 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.368 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:01.368 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:53:01.368 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:53:01.369 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.369 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.369 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:01.369 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:53:01.369 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:53:01.369 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.369 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.369 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:01.369 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:53:01.369 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:53:01.369 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.369 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.369 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:01.369 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:53:01.370 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:53:01.370 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.370 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.370 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:01.370 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:53:01.370 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:53:01.370 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.370 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.370 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:01.370 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:53:01.370 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:53:01.370 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.371 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.371 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:01.371 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:53:01.371 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:53:01.371 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.371 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.371 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:01.371 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:53:01.371 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:53:01.371 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.371 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.371 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:01.371 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:53:01.372 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:53:01.372 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:01.372 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:01.372 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:01.372 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.372 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.372 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:01.372 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:01.372 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 68.290484484000004, 2024-04-25T22:53:01.372 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:53:01.372 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:01.372 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:01.372 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:01.372 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:01.373 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.373 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:01.373 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:01.373 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:01.373 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.373 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.373 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:01.373 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:01.373 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:01.373 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.373 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.373 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:01.374 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:53:01.374 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:53:01.374 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.374 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.374 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:01.374 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:53:01.374 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:53:01.374 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.374 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.374 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:01.374 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:53:01.374 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:53:01.374 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.375 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.375 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:01.375 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:53:01.375 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:53:01.375 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.375 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.375 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:01.375 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:53:01.375 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:53:01.375 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.375 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.375 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:53:01.375 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:53:01.376 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:53:01.376 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.376 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.376 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:01.376 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:53:01.376 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:53:01.376 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.376 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.376 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:01.376 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:53:01.376 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:53:01.376 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.376 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.376 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:01.377 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:53:01.377 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:53:01.377 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.377 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.377 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:01.377 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:53:01.377 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:53:01.377 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.377 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.377 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:01.377 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:53:01.377 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:53:01.377 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.377 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.377 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:01.378 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:53:01.378 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:53:01.378 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.378 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.378 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:01.378 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:53:01.378 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:53:01.378 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:01.378 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:01.378 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:01.378 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.378 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.378 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:01.378 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:01.379 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 68.290459518000006, 2024-04-25T22:53:01.379 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:53:01.379 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:01.379 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:01.379 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:01.379 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:01.379 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.379 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:01.379 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:01.379 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:01.379 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.379 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.379 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:01.379 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:01.380 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:01.380 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.380 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.380 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:01.380 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:53:01.380 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:53:01.380 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.380 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.380 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:01.380 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:53:01.380 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:53:01.380 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.380 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.380 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:01.381 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:01.381 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:53:01.381 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.381 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.381 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:01.381 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:53:01.381 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:53:01.381 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.381 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.381 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:01.381 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:53:01.381 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:53:01.381 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.382 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.382 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:01.382 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:53:01.382 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:53:01.382 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.382 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.382 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:01.382 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:53:01.382 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:53:01.383 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.383 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.383 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:01.383 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:53:01.383 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:53:01.383 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.384 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.384 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:01.384 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:53:01.384 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:53:01.384 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.384 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.384 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:01.385 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:53:01.385 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:53:01.385 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.385 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.385 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:01.385 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:53:01.385 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:53:01.386 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:01.386 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:01.386 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:01.386 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.386 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.386 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:01.386 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:01.387 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 68.290423153999996, 2024-04-25T22:53:01.387 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:53:01.387 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:01.387 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:01.387 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:01.387 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:01.387 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.388 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:01.388 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:01.388 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:01.388 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.388 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.388 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:01.389 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:01.389 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:01.389 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.389 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.389 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:01.389 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:53:01.390 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:53:01.390 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.390 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.390 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:01.390 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:53:01.390 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:53:01.390 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.390 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.390 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:01.390 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:53:01.391 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:53:01.391 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.391 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.391 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:01.391 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:53:01.391 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:53:01.391 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.391 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.391 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:01.391 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:53:01.391 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:53:01.391 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.392 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.392 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:01.392 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:53:01.392 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:53:01.392 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.392 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.392 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:01.392 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:53:01.392 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:53:01.392 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.392 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.392 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:01.392 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:53:01.392 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:53:01.393 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.393 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.393 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:01.393 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:53:01.393 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:53:01.393 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:01.393 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:01.393 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:01.393 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.393 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.393 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:01.394 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:01.394 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 68.290392073000007, 2024-04-25T22:53:01.394 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:53:01.394 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:01.394 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:01.394 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:01.394 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:01.394 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.394 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:01.394 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:01.394 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:01.394 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.395 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.395 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:01.395 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:01.395 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:01.395 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.395 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.395 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:01.395 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:01.395 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:01.395 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.395 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.395 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:01.395 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:53:01.396 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:53:01.396 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.396 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.396 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:01.396 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:53:01.396 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:53:01.396 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.396 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.396 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:01.396 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:53:01.396 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:53:01.396 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.396 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.396 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:01.397 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:53:01.397 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:53:01.397 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.397 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.397 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:01.397 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:53:01.397 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:53:01.397 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.397 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.397 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:01.397 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:53:01.397 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:53:01.397 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:01.397 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:01.398 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:01.398 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.398 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.398 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:53:01.398 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:01.398 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 68.289951103999996, 2024-04-25T22:53:01.398 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064881979999999997, 2024-04-25T22:53:01.398 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:01.398 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:01.398 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:01.399 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:01.399 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.399 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:01.399 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:01.399 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:01.399 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.399 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.399 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:01.399 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:01.399 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:01.399 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.399 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.399 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:01.400 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:01.400 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2699999999999999e-07 2024-04-25T22:53:01.400 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.400 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.400 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:01.400 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013898+0000", 2024-04-25T22:53:01.401 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0796e-05 2024-04-25T22:53:01.401 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.401 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.401 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:01.401 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013907+0000", 2024-04-25T22:53:01.402 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5140000000000007e-06 2024-04-25T22:53:01.402 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.402 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.402 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:01.402 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013952+0000", 2024-04-25T22:53:01.403 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4134000000000001e-05 2024-04-25T22:53:01.403 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.403 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.403 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:01.403 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016812+0000", 2024-04-25T22:53:01.403 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028601059999999998 2024-04-25T22:53:01.403 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.403 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.403 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:01.403 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.017052+0000", 2024-04-25T22:53:01.403 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024056500000000001 2024-04-25T22:53:01.403 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.404 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.404 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:01.404 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020350+0000", 2024-04-25T22:53:01.404 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032978320000000001 2024-04-25T22:53:01.404 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.405 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.405 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:01.405 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020375+0000", 2024-04-25T22:53:01.405 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4624e-05 2024-04-25T22:53:01.405 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:01.405 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:01.405 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:01.405 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.405 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.405 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-25T22:53:01.405 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:01.405 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 68.276420658000006, 2024-04-25T22:53:01.406 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058583000000000003, 2024-04-25T22:53:01.406 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:01.406 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:01.406 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:01.406 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:01.406 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.406 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:01.406 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:01.406 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:01.406 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.406 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.406 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:01.406 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:01.407 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:01.407 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.407 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.407 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:01.407 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:01.407 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.41e-07 2024-04-25T22:53:01.407 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.407 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.407 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:01.407 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027428+0000", 2024-04-25T22:53:01.407 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.075e-05 2024-04-25T22:53:01.407 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.407 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.407 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:01.408 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027435+0000", 2024-04-25T22:53:01.408 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3610000000000003e-06 2024-04-25T22:53:01.408 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.408 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.408 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:01.408 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027442+0000", 2024-04-25T22:53:01.408 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0400000000000004e-06 2024-04-25T22:53:01.408 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.408 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.408 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:01.408 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028094+0000", 2024-04-25T22:53:01.408 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00065134800000000005 2024-04-25T22:53:01.408 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.408 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.409 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:01.409 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028107+0000", 2024-04-25T22:53:01.409 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3087e-05 2024-04-25T22:53:01.409 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.409 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.409 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:01.409 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033239+0000", 2024-04-25T22:53:01.409 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051319429999999999 2024-04-25T22:53:01.409 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.409 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.409 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:01.409 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033275+0000", 2024-04-25T22:53:01.409 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6430000000000002e-05 2024-04-25T22:53:01.409 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:01.410 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:01.410 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:01.410 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.410 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.410 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-25T22:53:01.410 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:01.410 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 68.276035820999994, 2024-04-25T22:53:01.410 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005413597, 2024-04-25T22:53:01.410 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:01.410 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:01.410 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:01.410 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:01.411 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.411 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:01.411 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:01.411 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:01.411 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.411 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.411 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:01.411 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:01.411 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:01.412 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.412 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.412 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:01.412 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:01.412 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3799999999999997e-07 2024-04-25T22:53:01.412 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.412 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.412 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:01.412 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027816+0000", 2024-04-25T22:53:01.412 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3230999999999999e-05 2024-04-25T22:53:01.412 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.413 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.413 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:01.413 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027823+0000", 2024-04-25T22:53:01.413 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9039999999999992e-06 2024-04-25T22:53:01.413 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.413 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.413 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:01.413 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027841+0000", 2024-04-25T22:53:01.413 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7651000000000001e-05 2024-04-25T22:53:01.413 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.413 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.413 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:01.413 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027904+0000", 2024-04-25T22:53:01.413 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3058000000000005e-05 2024-04-25T22:53:01.413 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.414 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.414 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:01.414 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027926+0000", 2024-04-25T22:53:01.414 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1450999999999998e-05 2024-04-25T22:53:01.414 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.414 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.414 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:01.414 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033177+0000", 2024-04-25T22:53:01.414 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052508909999999997 2024-04-25T22:53:01.414 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.415 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.415 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:01.415 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033215+0000", 2024-04-25T22:53:01.415 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8872999999999999e-05 2024-04-25T22:53:01.415 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:01.415 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:01.415 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:01.415 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.415 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.415 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 171 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:53:01.415 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:01.415 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 68.275978718999994, 2024-04-25T22:53:01.415 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054322240000000003, 2024-04-25T22:53:01.416 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:01.416 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:01.416 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "reached pg", 2024-04-25T22:53:01.416 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:01.416 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.416 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:01.416 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:01.416 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:01.416 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.416 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.416 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:01.416 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:01.417 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:01.417 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.417 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.417 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:01.417 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:01.417 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7500000000000001e-07 2024-04-25T22:53:01.417 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.418 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.418 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:01.418 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027868+0000", 2024-04-25T22:53:01.418 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5750000000000001e-06 2024-04-25T22:53:01.418 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.418 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.418 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:01.418 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027885+0000", 2024-04-25T22:53:01.418 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7272e-05 2024-04-25T22:53:01.418 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.418 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.419 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:01.419 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027900+0000", 2024-04-25T22:53:01.419 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.502e-05 2024-04-25T22:53:01.419 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.419 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.419 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:01.419 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028381+0000", 2024-04-25T22:53:01.419 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00048039399999999998 2024-04-25T22:53:01.419 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:01.419 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:01.419 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:01.420 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033291+0000", 2024-04-25T22:53:01.420 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049105879999999996 2024-04-25T22:53:01.420 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:01.420 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:01.420 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:01.420 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:01.420 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:01.420 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:01.422 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:01.422 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:01.421+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:01.523 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:01.522+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:01.528 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:01.528 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:01.528 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-04-25T22:53:01.529 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:01.537 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:01.624 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:01.623+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:01.640 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:01.640 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:01.640 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:53:01.640 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:53:01.640 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:01.650 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:01.725 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:01.724+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:01.797 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:01.797 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-04-25T22:53:01.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-04-25T22:53:01.797 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:53:01.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.798 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:01.798 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:01.798 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 73.829421667000005, 2024-04-25T22:53:01.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0103421, 2024-04-25T22:53:01.798 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:01.798 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:01.799 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:01.799 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:01.799 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:01.799 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:01.799 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 115 2024-04-25T22:53:01.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.799 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:01.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:01.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:01.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:01.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:01.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:01.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:01.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:01.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:01.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9500000000000002e-07 2024-04-25T22:53:01.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:01.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965108+0000", 2024-04-25T22:53:01.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9177999999999994e-05 2024-04-25T22:53:01.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:01.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965127+0000", 2024-04-25T22:53:01.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8868e-05 2024-04-25T22:53:01.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:01.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965133+0000", 2024-04-25T22:53:01.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8929999999999999e-06 2024-04-25T22:53:01.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:01.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.969991+0000", 2024-04-25T22:53:01.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048573849999999997 2024-04-25T22:53:01.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:01.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970072+0000", 2024-04-25T22:53:01.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0728000000000004e-05 2024-04-25T22:53:01.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:01.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970189+0000", 2024-04-25T22:53:01.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000117778 2024-04-25T22:53:01.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:01.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970946+0000", 2024-04-25T22:53:01.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00075704600000000004 2024-04-25T22:53:01.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:01.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975297+0000", 2024-04-25T22:53:01.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004350217 2024-04-25T22:53:01.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:01.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975343+0000", 2024-04-25T22:53:01.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6687999999999998e-05 2024-04-25T22:53:01.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:01.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975380+0000", 2024-04-25T22:53:01.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6724000000000003e-05 2024-04-25T22:53:01.805 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:01.805 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:01.805 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:01.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.806 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:01.806 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:01.806 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 73.829315636000004, 2024-04-25T22:53:01.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010304384, 2024-04-25T22:53:01.806 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:01.806 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:01.806 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:01.806 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:01.806 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:01.806 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:01.807 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 116 2024-04-25T22:53:01.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.807 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:01.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:01.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:01.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:01.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:01.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:01.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:01.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:01.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:01.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5799999999999999e-07 2024-04-25T22:53:01.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:01.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965154+0000", 2024-04-25T22:53:01.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0009e-05 2024-04-25T22:53:01.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:01.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965164+0000", 2024-04-25T22:53:01.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8490000000000001e-06 2024-04-25T22:53:01.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:01.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965169+0000", 2024-04-25T22:53:01.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0730000000000004e-06 2024-04-25T22:53:01.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:01.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970609+0000", 2024-04-25T22:53:01.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054397689999999997 2024-04-25T22:53:01.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:01.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970651+0000", 2024-04-25T22:53:01.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1873999999999999e-05 2024-04-25T22:53:01.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:01.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970723+0000", 2024-04-25T22:53:01.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2039999999999995e-05 2024-04-25T22:53:01.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:01.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971358+0000", 2024-04-25T22:53:01.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063489500000000001 2024-04-25T22:53:01.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:01.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975409+0000", 2024-04-25T22:53:01.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040506880000000002 2024-04-25T22:53:01.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:01.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975432+0000", 2024-04-25T22:53:01.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3315999999999998e-05 2024-04-25T22:53:01.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:01.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975448+0000", 2024-04-25T22:53:01.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6313000000000001e-05 2024-04-25T22:53:01.812 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:01.812 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:01.813 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:01.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.813 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:01.813 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:01.813 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 73.829281054000006, 2024-04-25T22:53:01.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010384338999999999, 2024-04-25T22:53:01.813 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:01.813 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:01.813 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:01.813 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:01.813 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:01.813 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:01.814 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-04-25T22:53:01.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.814 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:01.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:01.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:01.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:01.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:01.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:01.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:01.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:01.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:01.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3600000000000004e-07 2024-04-25T22:53:01.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:01.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965185+0000", 2024-04-25T22:53:01.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.117e-06 2024-04-25T22:53:01.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:01.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965192+0000", 2024-04-25T22:53:01.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3239999999999997e-06 2024-04-25T22:53:01.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:01.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965198+0000", 2024-04-25T22:53:01.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6370000000000004e-06 2024-04-25T22:53:01.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:01.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970973+0000", 2024-04-25T22:53:01.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057748239999999996 2024-04-25T22:53:01.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:01.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971049+0000", 2024-04-25T22:53:01.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6029e-05 2024-04-25T22:53:01.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:01.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971174+0000", 2024-04-25T22:53:01.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012462399999999999 2024-04-25T22:53:01.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:01.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971553+0000", 2024-04-25T22:53:01.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037896499999999999 2024-04-25T22:53:01.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:01.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975482+0000", 2024-04-25T22:53:01.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039297459999999996 2024-04-25T22:53:01.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:01.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975529+0000", 2024-04-25T22:53:01.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6387000000000002e-05 2024-04-25T22:53:01.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:01.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975563+0000", 2024-04-25T22:53:01.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4150000000000003e-05 2024-04-25T22:53:01.819 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:01.819 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:01.819 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:01.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.819 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:01.819 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:01.819 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 68.782234731000003, 2024-04-25T22:53:01.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012637705000000001, 2024-04-25T22:53:01.819 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:01.819 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:01.819 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:01.820 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:01.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:01.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:01.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:01.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:01.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:01.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:01.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:01.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012227+0000", 2024-04-25T22:53:01.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.863e-06 2024-04-25T22:53:01.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:01.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012236+0000", 2024-04-25T22:53:01.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1109999999999997e-06 2024-04-25T22:53:01.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:01.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012309+0000", 2024-04-25T22:53:01.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3242000000000001e-05 2024-04-25T22:53:01.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.822 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:01.822 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012324+0000", 2024-04-25T22:53:01.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4837e-05 2024-04-25T22:53:01.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:01.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015060+0000", 2024-04-25T22:53:01.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027363349999999999 2024-04-25T22:53:01.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:01.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015169+0000", 2024-04-25T22:53:01.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108372 2024-04-25T22:53:01.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:01.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015498+0000", 2024-04-25T22:53:01.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032949999999999999 2024-04-25T22:53:01.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:01.824 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021282+0000", 2024-04-25T22:53:01.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057836429999999998 2024-04-25T22:53:01.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:01.824 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024709+0000", 2024-04-25T22:53:01.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034271979999999998 2024-04-25T22:53:01.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:01.824 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024802+0000", 2024-04-25T22:53:01.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2960000000000004e-05 2024-04-25T22:53:01.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:01.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024863+0000", 2024-04-25T22:53:01.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0643999999999997e-05 2024-04-25T22:53:01.825 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:01.825 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:01.825 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:01.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.825 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:01.825 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:01.825 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 68.782110959999997, 2024-04-25T22:53:01.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012979447999999999, 2024-04-25T22:53:01.826 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:01.826 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:01.826 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:01.826 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:01.826 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.826 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:01.826 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:01.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:01.826 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.826 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.826 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:01.826 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:01.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:01.827 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.827 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:01.827 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:01.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:53:01.827 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.828 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:01.828 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012354+0000", 2024-04-25T22:53:01.828 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7740000000000004e-06 2024-04-25T22:53:01.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.828 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:01.828 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012365+0000", 2024-04-25T22:53:01.828 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.064e-05 2024-04-25T22:53:01.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.829 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:01.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012382+0000", 2024-04-25T22:53:01.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6999000000000001e-05 2024-04-25T22:53:01.829 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.829 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:01.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015958+0000", 2024-04-25T22:53:01.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035765699999999998 2024-04-25T22:53:01.829 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.829 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:01.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016037+0000", 2024-04-25T22:53:01.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8242000000000001e-05 2024-04-25T22:53:01.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.830 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:01.830 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016404+0000", 2024-04-25T22:53:01.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036784300000000002 2024-04-25T22:53:01.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.830 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:01.830 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021294+0000", 2024-04-25T22:53:01.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048890629999999999 2024-04-25T22:53:01.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.830 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:01.831 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024959+0000", 2024-04-25T22:53:01.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036651570000000001 2024-04-25T22:53:01.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.831 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.831 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:01.831 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025097+0000", 2024-04-25T22:53:01.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013788099999999999 2024-04-25T22:53:01.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.831 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.831 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:01.831 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025328+0000", 2024-04-25T22:53:01.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231492 2024-04-25T22:53:01.831 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:01.831 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:01.832 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:01.832 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.832 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:01.832 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:01.832 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 68.782023190999993, 2024-04-25T22:53:01.832 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013049827, 2024-04-25T22:53:01.832 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:01.832 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:01.832 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:01.832 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:01.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.833 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:01.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:01.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:01.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.833 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:01.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:01.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:01.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:01.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012437+0000", 2024-04-25T22:53:01.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-04-25T22:53:01.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:01.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012440+0000", 2024-04-25T22:53:01.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7609999999999999e-06 2024-04-25T22:53:01.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:01.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012449+0000", 2024-04-25T22:53:01.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.285e-06 2024-04-25T22:53:01.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:01.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012457+0000", 2024-04-25T22:53:01.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9510000000000006e-06 2024-04-25T22:53:01.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:01.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017106+0000", 2024-04-25T22:53:01.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046494220000000003 2024-04-25T22:53:01.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.836 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:01.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017223+0000", 2024-04-25T22:53:01.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116824 2024-04-25T22:53:01.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.836 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:01.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017345+0000", 2024-04-25T22:53:01.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122175 2024-04-25T22:53:01.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.836 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:01.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021299+0000", 2024-04-25T22:53:01.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039534879999999998 2024-04-25T22:53:01.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:01.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025398+0000", 2024-04-25T22:53:01.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040988960000000003 2024-04-25T22:53:01.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:01.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025439+0000", 2024-04-25T22:53:01.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0915999999999999e-05 2024-04-25T22:53:01.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:01.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025486+0000", 2024-04-25T22:53:01.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7534999999999998e-05 2024-04-25T22:53:01.838 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:01.838 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:01.838 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:01.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.838 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:01.838 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:01.838 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 68.781993040000003, 2024-04-25T22:53:01.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020988041999999998, 2024-04-25T22:53:01.838 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:01.838 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:01.838 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:01.839 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:01.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:01.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:01.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:01.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:01.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:01.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:01.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:01.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:01.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.99e-07 2024-04-25T22:53:01.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:01.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012470+0000", 2024-04-25T22:53:01.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2789999999999999e-06 2024-04-25T22:53:01.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:01.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012477+0000", 2024-04-25T22:53:01.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:53:01.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:01.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012500+0000", 2024-04-25T22:53:01.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2490999999999999e-05 2024-04-25T22:53:01.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:01.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021911+0000", 2024-04-25T22:53:01.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094114160000000006 2024-04-25T22:53:01.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:01.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022000+0000", 2024-04-25T22:53:01.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8601000000000001e-05 2024-04-25T22:53:01.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:01.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022359+0000", 2024-04-25T22:53:01.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035921999999999999 2024-04-25T22:53:01.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:01.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025541+0000", 2024-04-25T22:53:01.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031820619999999998 2024-04-25T22:53:01.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:01.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033375+0000", 2024-04-25T22:53:01.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078338379999999992 2024-04-25T22:53:01.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:01.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033415+0000", 2024-04-25T22:53:01.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9527000000000003e-05 2024-04-25T22:53:01.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:01.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033455+0000", 2024-04-25T22:53:01.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9932000000000003e-05 2024-04-25T22:53:01.843 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:01.843 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:01.843 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:01.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.844 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:01.844 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:01.844 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 68.781937846999995, 2024-04-25T22:53:01.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021043857999999999, 2024-04-25T22:53:01.844 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:01.844 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:01.844 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:01.844 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:01.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.844 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:01.844 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:01.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:01.844 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:01.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:01.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:01.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:01.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012523+0000", 2024-04-25T22:53:01.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.361e-06 2024-04-25T22:53:01.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:01.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012530+0000", 2024-04-25T22:53:01.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5440000000000004e-06 2024-04-25T22:53:01.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:01.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012541+0000", 2024-04-25T22:53:01.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1745e-05 2024-04-25T22:53:01.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:01.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012551+0000", 2024-04-25T22:53:01.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5789999999999993e-06 2024-04-25T22:53:01.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:01.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022709+0000", 2024-04-25T22:53:01.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010157685 2024-04-25T22:53:01.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:01.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022957+0000", 2024-04-25T22:53:01.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024824599999999998 2024-04-25T22:53:01.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:01.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023443+0000", 2024-04-25T22:53:01.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048578599999999999 2024-04-25T22:53:01.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:01.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025547+0000", 2024-04-25T22:53:01.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021044789999999998 2024-04-25T22:53:01.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:01.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033509+0000", 2024-04-25T22:53:01.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0079622180000000001 2024-04-25T22:53:01.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:01.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033542+0000", 2024-04-25T22:53:01.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3018000000000001e-05 2024-04-25T22:53:01.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.849 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:01.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033566+0000", 2024-04-25T22:53:01.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3197000000000002e-05 2024-04-25T22:53:01.849 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:01.849 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:01.849 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:01.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.849 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:01.849 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:01.849 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 68.781897881999996, 2024-04-25T22:53:01.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021122696, 2024-04-25T22:53:01.849 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:01.850 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:01.850 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:01.850 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:01.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.850 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:01.850 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:01.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:01.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.850 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:01.850 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:01.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:01.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.850 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:01.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:01.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:53:01.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:01.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012566+0000", 2024-04-25T22:53:01.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-04-25T22:53:01.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:01.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012619+0000", 2024-04-25T22:53:01.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2607e-05 2024-04-25T22:53:01.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:01.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012628+0000", 2024-04-25T22:53:01.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6500000000000008e-06 2024-04-25T22:53:01.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:01.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024024+0000", 2024-04-25T22:53:01.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011396007999999999 2024-04-25T22:53:01.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:01.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024198+0000", 2024-04-25T22:53:01.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000173215 2024-04-25T22:53:01.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:01.853 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024447+0000", 2024-04-25T22:53:01.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024898500000000002 2024-04-25T22:53:01.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.853 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:01.853 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026431+0000", 2024-04-25T22:53:01.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001984923 2024-04-25T22:53:01.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.853 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:01.853 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033608+0000", 2024-04-25T22:53:01.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071768459999999997 2024-04-25T22:53:01.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.854 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:01.854 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033646+0000", 2024-04-25T22:53:01.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299000000000003e-05 2024-04-25T22:53:01.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.854 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:01.854 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033684+0000", 2024-04-25T22:53:01.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8773000000000003e-05 2024-04-25T22:53:01.854 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:01.854 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:01.854 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:01.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.855 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:01.855 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:01.855 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 68.781809283000001, 2024-04-25T22:53:01.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021175381, 2024-04-25T22:53:01.855 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:01.855 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:01.855 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:01.855 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:01.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:01.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:01.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:01.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:01.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:01.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:01.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:01.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012651+0000", 2024-04-25T22:53:01.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:53:01.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:01.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012656+0000", 2024-04-25T22:53:01.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8899999999999998e-06 2024-04-25T22:53:01.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:01.857 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012666+0000", 2024-04-25T22:53:01.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0346999999999999e-05 2024-04-25T22:53:01.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.857 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:01.857 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012675+0000", 2024-04-25T22:53:01.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9930000000000001e-06 2024-04-25T22:53:01.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.857 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:01.857 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025661+0000", 2024-04-25T22:53:01.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01298531 2024-04-25T22:53:01.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.857 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:01.858 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025757+0000", 2024-04-25T22:53:01.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5822000000000005e-05 2024-04-25T22:53:01.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.858 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:01.858 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025907+0000", 2024-04-25T22:53:01.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015051499999999999 2024-04-25T22:53:01.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.858 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:01.858 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026435+0000", 2024-04-25T22:53:01.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052762200000000005 2024-04-25T22:53:01.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:01.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033732+0000", 2024-04-25T22:53:01.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072978419999999997 2024-04-25T22:53:01.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:01.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033787+0000", 2024-04-25T22:53:01.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4703999999999997e-05 2024-04-25T22:53:01.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:01.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033826+0000", 2024-04-25T22:53:01.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8458999999999999e-05 2024-04-25T22:53:01.860 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:01.860 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:01.860 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:01.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.860 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:01.860 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:01.860 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 68.781753868999999, 2024-04-25T22:53:01.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021244174000000001, 2024-04-25T22:53:01.860 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:01.860 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:01.860 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:01.860 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:01.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:01.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:01.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:01.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:01.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:01.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:01.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:01.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:01.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:01.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:01.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012712+0000", 2024-04-25T22:53:01.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.913e-06 2024-04-25T22:53:01.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:01.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012722+0000", 2024-04-25T22:53:01.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2879999999999998e-06 2024-04-25T22:53:01.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:01.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012727+0000", 2024-04-25T22:53:01.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8429999999999998e-06 2024-04-25T22:53:01.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:01.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026099+0000", 2024-04-25T22:53:01.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013371450999999999 2024-04-25T22:53:01.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:01.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026147+0000", 2024-04-25T22:53:01.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7837999999999998e-05 2024-04-25T22:53:01.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:01.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026254+0000", 2024-04-25T22:53:01.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107314 2024-04-25T22:53:01.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.864 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:01.864 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026686+0000", 2024-04-25T22:53:01.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000432428 2024-04-25T22:53:01.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.864 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:01.864 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033873+0000", 2024-04-25T22:53:01.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071864399999999997 2024-04-25T22:53:01.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.864 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:01.864 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033904+0000", 2024-04-25T22:53:01.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1321e-05 2024-04-25T22:53:01.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:01.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033950+0000", 2024-04-25T22:53:01.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5707999999999997e-05 2024-04-25T22:53:01.865 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:01.865 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:01.865 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:01.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.865 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:01.865 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:01.865 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 68.781723483999997, 2024-04-25T22:53:01.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01096505, 2024-04-25T22:53:01.866 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:01.866 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:01.866 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:01.866 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:01.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.866 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:01.866 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:01.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:01.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.866 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:01.866 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:01.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:01.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.867 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:01.867 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012737+0000", 2024-04-25T22:53:01.867 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:01.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.867 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:01.867 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012739+0000", 2024-04-25T22:53:01.867 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-04-25T22:53:01.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.867 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:01.867 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012743+0000", 2024-04-25T22:53:01.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3239999999999996e-06 2024-04-25T22:53:01.868 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.868 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.868 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:01.868 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012746+0000", 2024-04-25T22:53:01.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.129e-06 2024-04-25T22:53:01.868 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.868 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.868 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:01.868 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012796+0000", 2024-04-25T22:53:01.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9231999999999999e-05 2024-04-25T22:53:01.868 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.868 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.868 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:01.868 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012915+0000", 2024-04-25T22:53:01.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119021 2024-04-25T22:53:01.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.869 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.869 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:01.869 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013069+0000", 2024-04-25T22:53:01.869 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015463900000000001 2024-04-25T22:53:01.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.869 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.869 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:01.869 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019237+0000", 2024-04-25T22:53:01.869 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061680329999999998 2024-04-25T22:53:01.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.869 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.869 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:01.869 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023603+0000", 2024-04-25T22:53:01.869 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043655860000000003 2024-04-25T22:53:01.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.870 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.870 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:01.870 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023659+0000", 2024-04-25T22:53:01.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6484000000000003e-05 2024-04-25T22:53:01.870 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.870 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.870 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:01.870 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023701+0000", 2024-04-25T22:53:01.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1761999999999998e-05 2024-04-25T22:53:01.870 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:01.870 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:01.870 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:01.870 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.871 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.871 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:01.871 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:01.871 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 68.781698535999993, 2024-04-25T22:53:01.871 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011234429000000001, 2024-04-25T22:53:01.871 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:01.871 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:01.871 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:01.871 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:01.871 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.871 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:01.871 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:01.871 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:01.872 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.872 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.872 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:01.872 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:01.872 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:01.872 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.872 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.872 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:01.872 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012762+0000", 2024-04-25T22:53:01.872 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-04-25T22:53:01.872 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.872 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.872 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:01.873 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012765+0000", 2024-04-25T22:53:01.873 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2569999999999999e-06 2024-04-25T22:53:01.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.873 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.873 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:01.873 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012783+0000", 2024-04-25T22:53:01.873 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8431999999999999e-05 2024-04-25T22:53:01.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.873 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.873 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:01.873 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012799+0000", 2024-04-25T22:53:01.873 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5438999999999999e-05 2024-04-25T22:53:01.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.873 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.874 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:01.874 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013826+0000", 2024-04-25T22:53:01.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010275060000000001 2024-04-25T22:53:01.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.874 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:01.874 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013913+0000", 2024-04-25T22:53:01.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.708e-05 2024-04-25T22:53:01.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.874 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:01.874 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014098+0000", 2024-04-25T22:53:01.875 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018519399999999999 2024-04-25T22:53:01.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.875 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:01.875 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019684+0000", 2024-04-25T22:53:01.875 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055860079999999999 2024-04-25T22:53:01.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.875 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:01.875 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023876+0000", 2024-04-25T22:53:01.875 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041918800000000003 2024-04-25T22:53:01.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.875 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:01.876 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023957+0000", 2024-04-25T22:53:01.876 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1165e-05 2024-04-25T22:53:01.876 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.876 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.876 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:01.876 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023995+0000", 2024-04-25T22:53:01.876 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:53:01.876 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:01.876 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:01.876 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:01.876 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.876 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.876 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:01.877 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:01.877 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 68.781600757000007, 2024-04-25T22:53:01.877 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011131200000000001, 2024-04-25T22:53:01.877 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:01.877 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:01.877 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:01.877 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:01.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.877 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:01.877 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:01.877 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:01.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.877 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:01.878 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:01.878 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:01.878 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.878 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.878 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:01.878 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012860+0000", 2024-04-25T22:53:01.878 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3900000000000004e-07 2024-04-25T22:53:01.878 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.878 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.878 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:01.878 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012865+0000", 2024-04-25T22:53:01.878 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5609999999999998e-06 2024-04-25T22:53:01.878 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.878 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:01.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012895+0000", 2024-04-25T22:53:01.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9847000000000001e-05 2024-04-25T22:53:01.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:01.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012905+0000", 2024-04-25T22:53:01.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.03e-05 2024-04-25T22:53:01.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:01.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015020+0000", 2024-04-25T22:53:01.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021142940000000001 2024-04-25T22:53:01.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.880 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.880 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:01.880 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015182+0000", 2024-04-25T22:53:01.880 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016248099999999999 2024-04-25T22:53:01.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.880 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.880 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:01.880 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015357+0000", 2024-04-25T22:53:01.880 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017471000000000001 2024-04-25T22:53:01.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.880 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.880 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:01.880 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021021+0000", 2024-04-25T22:53:01.881 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056638340000000004 2024-04-25T22:53:01.881 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.881 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.881 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:01.881 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023712+0000", 2024-04-25T22:53:01.881 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026910380000000002 2024-04-25T22:53:01.881 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.881 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.881 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:01.881 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023763+0000", 2024-04-25T22:53:01.881 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1477999999999997e-05 2024-04-25T22:53:01.881 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.881 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.881 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:01.882 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023990+0000", 2024-04-25T22:53:01.882 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000226818 2024-04-25T22:53:01.882 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:01.882 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:01.882 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:01.882 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.882 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.882 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:01.882 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:01.882 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 68.781477660999997, 2024-04-25T22:53:01.882 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011705299000000001, 2024-04-25T22:53:01.882 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:01.882 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:01.883 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:01.883 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:01.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.883 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:01.883 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:01.883 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:01.883 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.883 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:01.883 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:01.883 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:01.883 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.883 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:01.883 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012983+0000", 2024-04-25T22:53:01.884 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:53:01.884 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.884 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.884 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:01.884 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012986+0000", 2024-04-25T22:53:01.884 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5700000000000001e-06 2024-04-25T22:53:01.884 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.884 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.884 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:01.884 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012993+0000", 2024-04-25T22:53:01.884 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8730000000000001e-06 2024-04-25T22:53:01.884 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.884 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.884 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:01.885 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013000+0000", 2024-04-25T22:53:01.885 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1890000000000001e-06 2024-04-25T22:53:01.885 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.885 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.885 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:01.885 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:53:01.885 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002147866 2024-04-25T22:53:01.885 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.885 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.885 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:01.885 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015351+0000", 2024-04-25T22:53:01.885 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020300799999999999 2024-04-25T22:53:01.885 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.885 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.886 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:01.886 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016260+0000", 2024-04-25T22:53:01.886 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00090926799999999997 2024-04-25T22:53:01.886 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.886 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.886 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:01.886 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022669+0000", 2024-04-25T22:53:01.886 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064082849999999997 2024-04-25T22:53:01.886 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.886 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.886 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:01.886 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024584+0000", 2024-04-25T22:53:01.887 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019151699999999999 2024-04-25T22:53:01.887 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.887 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.887 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:01.887 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024643+0000", 2024-04-25T22:53:01.887 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8888999999999998e-05 2024-04-25T22:53:01.887 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.887 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.887 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:01.887 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024687+0000", 2024-04-25T22:53:01.887 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4444999999999999e-05 2024-04-25T22:53:01.887 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:01.887 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:01.887 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:01.888 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.888 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.888 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:01.888 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:01.888 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 68.781450070000005, 2024-04-25T22:53:01.888 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011249699, 2024-04-25T22:53:01.888 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:01.888 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:01.888 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:01.888 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:01.888 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.888 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:01.888 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:01.888 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:01.889 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.889 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.889 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:01.889 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:01.889 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:01.889 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.889 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.889 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:01.889 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013010+0000", 2024-04-25T22:53:01.889 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2099999999999996e-07 2024-04-25T22:53:01.889 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.889 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.889 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:01.889 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013013+0000", 2024-04-25T22:53:01.890 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1310000000000002e-06 2024-04-25T22:53:01.890 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.890 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.890 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:01.890 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013020+0000", 2024-04-25T22:53:01.890 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3330000000000002e-06 2024-04-25T22:53:01.890 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.890 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.890 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:01.890 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013025+0000", 2024-04-25T22:53:01.890 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6760000000000004e-06 2024-04-25T22:53:01.890 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.890 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.891 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:01.891 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013163+0000", 2024-04-25T22:53:01.891 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013824599999999999 2024-04-25T22:53:01.891 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.891 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.891 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:01.891 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013504+0000", 2024-04-25T22:53:01.891 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034080299999999998 2024-04-25T22:53:01.891 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.891 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.891 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:01.891 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013613+0000", 2024-04-25T22:53:01.891 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108705 2024-04-25T22:53:01.891 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.892 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.892 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:01.892 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015831+0000", 2024-04-25T22:53:01.892 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002217672 2024-04-25T22:53:01.892 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.892 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.892 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:01.892 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024137+0000", 2024-04-25T22:53:01.892 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0083060489999999994 2024-04-25T22:53:01.892 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.892 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.892 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:01.892 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024218+0000", 2024-04-25T22:53:01.892 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1351000000000001e-05 2024-04-25T22:53:01.893 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.893 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.893 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:01.893 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024259+0000", 2024-04-25T22:53:01.893 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1112000000000002e-05 2024-04-25T22:53:01.893 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:01.893 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:01.893 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:01.893 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.893 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.893 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:01.893 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:01.893 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 68.781362344000001, 2024-04-25T22:53:01.893 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020379749999999999, 2024-04-25T22:53:01.894 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:01.894 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:01.894 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:01.894 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:01.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.894 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:01.894 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:01.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:01.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.894 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:01.894 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:01.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:01.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.895 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:01.895 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013098+0000", 2024-04-25T22:53:01.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:53:01.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.895 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:01.895 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013105+0000", 2024-04-25T22:53:01.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5969999999999997e-06 2024-04-25T22:53:01.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.895 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:01.895 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013190+0000", 2024-04-25T22:53:01.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5618999999999995e-05 2024-04-25T22:53:01.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.896 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.896 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:01.896 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013200+0000", 2024-04-25T22:53:01.896 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5859999999999994e-06 2024-04-25T22:53:01.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.896 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.896 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:01.896 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020265+0000", 2024-04-25T22:53:01.896 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070653349999999998 2024-04-25T22:53:01.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.896 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.896 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:01.896 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020454+0000", 2024-04-25T22:53:01.897 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189316 2024-04-25T22:53:01.897 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.897 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.897 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:01.897 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020586+0000", 2024-04-25T22:53:01.897 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013195700000000001 2024-04-25T22:53:01.897 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.897 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.897 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:01.897 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023822+0000", 2024-04-25T22:53:01.897 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032358529999999999 2024-04-25T22:53:01.897 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.897 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.897 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:01.898 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033409+0000", 2024-04-25T22:53:01.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095870520000000004 2024-04-25T22:53:01.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.898 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:01.898 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033447+0000", 2024-04-25T22:53:01.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7261999999999997e-05 2024-04-25T22:53:01.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.898 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:01.898 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033477+0000", 2024-04-25T22:53:01.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0389e-05 2024-04-25T22:53:01.898 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:01.898 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:01.899 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:01.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.899 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:01.899 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:01.899 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 68.781245838000004, 2024-04-25T22:53:01.899 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010857383999999999, 2024-04-25T22:53:01.899 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:01.899 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:01.899 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:01.899 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:01.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.899 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:01.899 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:01.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:01.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.900 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:01.900 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:01.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:01.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.900 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:01.900 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:01.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:01.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.900 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:01.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013218+0000", 2024-04-25T22:53:01.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8199999999999998e-06 2024-04-25T22:53:01.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.901 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:01.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013226+0000", 2024-04-25T22:53:01.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7649999999999993e-06 2024-04-25T22:53:01.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.901 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:01.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013259+0000", 2024-04-25T22:53:01.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2727e-05 2024-04-25T22:53:01.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.902 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:01.902 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014809+0000", 2024-04-25T22:53:01.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001550144 2024-04-25T22:53:01.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.902 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:01.902 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014958+0000", 2024-04-25T22:53:01.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014890300000000001 2024-04-25T22:53:01.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.902 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:01.902 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015087+0000", 2024-04-25T22:53:01.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012939200000000001 2024-04-25T22:53:01.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:01.903 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020212+0000", 2024-04-25T22:53:01.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051248939999999996 2024-04-25T22:53:01.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:01.903 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023699+0000", 2024-04-25T22:53:01.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034873289999999999 2024-04-25T22:53:01.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:01.903 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024014+0000", 2024-04-25T22:53:01.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031473999999999999 2024-04-25T22:53:01.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.904 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:01.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024071+0000", 2024-04-25T22:53:01.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7040000000000003e-05 2024-04-25T22:53:01.904 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:01.904 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:01.904 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:01.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.904 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:01.904 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:01.905 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 68.781191132999993, 2024-04-25T22:53:01.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012329677000000001, 2024-04-25T22:53:01.905 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:01.905 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:01.905 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:01.905 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:01.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:01.905 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:01.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:01.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:01.905 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:01.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:01.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.906 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:01.906 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013269+0000", 2024-04-25T22:53:01.906 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5000000000000002e-07 2024-04-25T22:53:01.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.906 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:01.906 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:01.906 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6909999999999999e-06 2024-04-25T22:53:01.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.906 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:01.907 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013284+0000", 2024-04-25T22:53:01.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0963e-05 2024-04-25T22:53:01.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.907 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:01.907 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013361+0000", 2024-04-25T22:53:01.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7379999999999994e-05 2024-04-25T22:53:01.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.907 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:01.907 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013448+0000", 2024-04-25T22:53:01.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6990000000000006e-05 2024-04-25T22:53:01.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.907 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:01.908 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013632+0000", 2024-04-25T22:53:01.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018396800000000001 2024-04-25T22:53:01.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.908 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.908 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:01.908 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013800+0000", 2024-04-25T22:53:01.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167467 2024-04-25T22:53:01.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.908 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.908 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:01.908 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.018570+0000", 2024-04-25T22:53:01.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047701460000000003 2024-04-25T22:53:01.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.908 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:01.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025507+0000", 2024-04-25T22:53:01.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069372039999999998 2024-04-25T22:53:01.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:01.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025562+0000", 2024-04-25T22:53:01.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4858999999999998e-05 2024-04-25T22:53:01.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:01.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025598+0000", 2024-04-25T22:53:01.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6259e-05 2024-04-25T22:53:01.909 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:01.910 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:01.910 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:01.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.910 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:01.910 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:01.910 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 68.781059260000006, 2024-04-25T22:53:01.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020176666999999999, 2024-04-25T22:53:01.910 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:01.910 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:01.910 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:53:01.910 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:01.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:01.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:01.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:01.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:01.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:01.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:01.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:01.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:01.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-04-25T22:53:01.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.912 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:01.912 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013405+0000", 2024-04-25T22:53:01.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0559999999999998e-06 2024-04-25T22:53:01.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.912 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:01.912 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013422+0000", 2024-04-25T22:53:01.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6770999999999999e-05 2024-04-25T22:53:01.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.912 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:01.912 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013431+0000", 2024-04-25T22:53:01.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5019999999999998e-06 2024-04-25T22:53:01.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.913 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.913 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:01.913 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021720+0000", 2024-04-25T22:53:01.913 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082884340000000008 2024-04-25T22:53:01.913 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.913 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.913 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:01.913 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022122+0000", 2024-04-25T22:53:01.913 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000401634 2024-04-25T22:53:01.913 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:01.913 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:01.913 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:01.913 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033577+0000", 2024-04-25T22:53:01.913 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011455435999999999 2024-04-25T22:53:01.914 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:01.914 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:01.914 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:01.914 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:01.914 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:01.914 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:01.916 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:01.916 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:01.914+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:02.016 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:02.016+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:02.021 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:02.021 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:02.021 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-25T22:53:02.021 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:02.029 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:02.117 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:02.116+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:02.131 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:02.131 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:02.131 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-25T22:53:02.131 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-25T22:53:02.131 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:02.139 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:02.181 INFO:teuthology.orchestra.run.smithi052.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-04-25T22:53:02.199 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-25T22:53:02.218 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:02.217+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:02.245 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:02.245 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:53:02.245 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:53:02.245 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:53:02.245 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.245 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:53:02.245 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:02.246 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 74.276567084000007, 2024-04-25T22:53:02.246 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:53:02.246 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:02.246 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:02.246 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:02.246 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:02.246 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.246 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:02.246 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:02.246 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:02.246 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.246 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.246 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:02.247 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:02.247 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:02.247 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.247 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.247 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:02.247 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:53:02.247 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:53:02.247 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.247 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.247 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:02.247 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:53:02.247 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:53:02.247 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.248 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.248 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:02.248 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:53:02.248 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:53:02.248 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.248 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.248 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:02.248 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:53:02.248 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:53:02.248 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.248 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.248 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:02.248 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:53:02.248 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:53:02.248 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.249 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.249 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:02.249 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:53:02.249 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:53:02.249 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.249 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.249 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:02.249 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:53:02.249 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:53:02.249 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.249 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.249 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:02.249 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:53:02.250 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:53:02.250 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:02.250 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:02.250 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:02.250 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.250 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.250 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:110 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'72, mlcod=10'68)", 2024-04-25T22:53:02.250 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:02.250 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 74.275933084000002, 2024-04-25T22:53:02.250 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065316630000000001, 2024-04-25T22:53:02.250 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:02.250 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:02.250 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:02.251 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:02.251 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.251 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:02.251 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:02.251 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:02.251 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.251 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.251 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:02.251 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:02.251 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:02.251 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.251 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.251 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:02.252 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:02.252 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.58e-07 2024-04-25T22:53:02.252 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.252 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.252 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:02.252 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967811+0000", 2024-04-25T22:53:02.252 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.118e-06 2024-04-25T22:53:02.252 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.252 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.252 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:02.252 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967817+0000", 2024-04-25T22:53:02.252 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3709999999999996e-06 2024-04-25T22:53:02.252 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.253 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.253 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:02.253 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967820+0000", 2024-04-25T22:53:02.253 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2210000000000002e-06 2024-04-25T22:53:02.253 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.253 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.253 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:02.253 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967876+0000", 2024-04-25T22:53:02.253 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5507000000000002e-05 2024-04-25T22:53:02.253 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.253 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.253 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:02.253 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967893+0000", 2024-04-25T22:53:02.253 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7812000000000002e-05 2024-04-25T22:53:02.254 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.254 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.254 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:02.254 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974317+0000", 2024-04-25T22:53:02.254 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064237160000000003 2024-04-25T22:53:02.254 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.254 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.254 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:02.254 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:53:02.254 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.156e-05 2024-04-25T22:53:02.254 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:02.254 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:02.254 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:02.255 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.255 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.255 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'68)", 2024-04-25T22:53:02.255 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:02.255 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 74.275515571, 2024-04-25T22:53:02.255 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061292279999999996, 2024-04-25T22:53:02.255 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:02.255 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:02.255 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:02.255 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:02.255 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.255 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:02.255 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:02.255 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:02.256 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.256 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.256 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:02.256 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:02.256 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:02.256 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.256 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.256 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:02.256 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:02.256 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6300000000000001e-07 2024-04-25T22:53:02.256 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.256 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.256 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:02.256 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968228+0000", 2024-04-25T22:53:02.257 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6139999999999999e-06 2024-04-25T22:53:02.257 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.257 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.257 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:02.257 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968235+0000", 2024-04-25T22:53:02.257 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7020000000000001e-06 2024-04-25T22:53:02.257 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.257 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.257 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:02.257 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968238+0000", 2024-04-25T22:53:02.257 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0010000000000002e-06 2024-04-25T22:53:02.257 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.257 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.257 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:02.258 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968297+0000", 2024-04-25T22:53:02.258 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8424999999999997e-05 2024-04-25T22:53:02.258 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.258 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.258 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:02.258 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968316+0000", 2024-04-25T22:53:02.258 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8814999999999999e-05 2024-04-25T22:53:02.258 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.258 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.258 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:02.258 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:53:02.258 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060239439999999998 2024-04-25T22:53:02.258 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.259 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.259 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:02.259 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974354+0000", 2024-04-25T22:53:02.259 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4364e-05 2024-04-25T22:53:02.259 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:02.259 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:02.259 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:02.259 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.259 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.259 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'68)", 2024-04-25T22:53:02.259 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:02.259 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 74.275078569000001, 2024-04-25T22:53:02.259 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005948414, 2024-04-25T22:53:02.260 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:02.260 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:02.260 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:02.260 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:02.260 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.260 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:02.260 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:02.260 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:02.260 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.260 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.260 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:02.260 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:02.260 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:02.260 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.261 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.261 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:02.261 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:02.261 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6199999999999998e-07 2024-04-25T22:53:02.261 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.261 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.261 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:02.261 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968723+0000", 2024-04-25T22:53:02.261 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1148999999999993e-05 2024-04-25T22:53:02.261 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.261 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.261 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:02.261 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968730+0000", 2024-04-25T22:53:02.262 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1749999999999999e-06 2024-04-25T22:53:02.262 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.262 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.262 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:02.262 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968734+0000", 2024-04-25T22:53:02.262 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5200000000000002e-06 2024-04-25T22:53:02.262 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.262 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.262 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:02.262 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968771+0000", 2024-04-25T22:53:02.262 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6851999999999999e-05 2024-04-25T22:53:02.262 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.262 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.263 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:02.263 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968788+0000", 2024-04-25T22:53:02.263 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7027000000000001e-05 2024-04-25T22:53:02.263 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.263 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.263 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:02.263 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974589+0000", 2024-04-25T22:53:02.263 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058013320000000002 2024-04-25T22:53:02.263 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.263 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.263 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:02.263 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974610+0000", 2024-04-25T22:53:02.263 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0897e-05 2024-04-25T22:53:02.263 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:02.264 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:02.264 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:02.264 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.264 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.264 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'68)", 2024-04-25T22:53:02.264 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:02.264 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 74.274508558999997, 2024-04-25T22:53:02.264 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053935750000000003, 2024-04-25T22:53:02.264 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:02.264 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:02.264 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:02.264 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:02.264 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.265 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:02.265 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:02.265 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:02.265 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.265 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.265 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:02.265 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:02.265 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:02.265 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.265 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.265 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:02.265 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:02.265 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.03e-07 2024-04-25T22:53:02.265 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.266 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.266 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:02.266 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969235+0000", 2024-04-25T22:53:02.266 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2399999999999999e-06 2024-04-25T22:53:02.266 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.266 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.266 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:02.266 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969242+0000", 2024-04-25T22:53:02.266 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1269999999999997e-06 2024-04-25T22:53:02.266 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.266 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.266 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:02.266 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969246+0000", 2024-04-25T22:53:02.267 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3840000000000001e-06 2024-04-25T22:53:02.267 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.267 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.267 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:02.267 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969278+0000", 2024-04-25T22:53:02.267 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1868e-05 2024-04-25T22:53:02.267 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.267 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.267 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:02.267 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969295+0000", 2024-04-25T22:53:02.267 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7530999999999999e-05 2024-04-25T22:53:02.267 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.267 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.268 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:02.268 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974611+0000", 2024-04-25T22:53:02.268 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053160789999999996 2024-04-25T22:53:02.268 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.268 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.268 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:02.268 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974625+0000", 2024-04-25T22:53:02.268 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3943e-05 2024-04-25T22:53:02.268 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:02.268 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:02.268 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:02.268 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.268 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.269 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-25T22:53:02.269 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:02.269 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 74.080912651000006, 2024-04-25T22:53:02.269 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054952610000000004, 2024-04-25T22:53:02.269 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:02.269 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:02.269 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:02.269 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:02.269 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.269 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:02.269 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:02.269 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:02.269 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.270 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.270 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:02.270 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:02.270 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:02.270 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.270 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.270 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:02.270 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:02.270 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.68e-07 2024-04-25T22:53:02.270 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.270 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.270 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:02.270 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162898+0000", 2024-04-25T22:53:02.271 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9470999999999999e-05 2024-04-25T22:53:02.271 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.271 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.271 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:02.271 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162906+0000", 2024-04-25T22:53:02.271 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1580000000000005e-06 2024-04-25T22:53:02.271 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.271 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.271 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:02.271 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162911+0000", 2024-04-25T22:53:02.271 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4779999999999999e-06 2024-04-25T22:53:02.271 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.271 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.272 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:02.272 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162952+0000", 2024-04-25T22:53:02.272 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0629e-05 2024-04-25T22:53:02.272 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.272 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.272 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:02.272 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162968+0000", 2024-04-25T22:53:02.272 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6239000000000002e-05 2024-04-25T22:53:02.272 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.272 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.272 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:02.272 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168281+0000", 2024-04-25T22:53:02.272 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053132869999999999 2024-04-25T22:53:02.273 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.273 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.273 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:02.273 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168323+0000", 2024-04-25T22:53:02.273 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1430999999999997e-05 2024-04-25T22:53:02.273 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:02.273 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:02.273 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:02.273 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.273 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.273 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-04-25T22:53:02.273 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:02.273 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 73.650435289000001, 2024-04-25T22:53:02.273 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050872510000000001, 2024-04-25T22:53:02.274 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:02.274 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:02.274 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:02.274 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:02.274 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.274 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:02.274 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:02.274 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:02.274 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.274 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.274 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:02.274 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:02.274 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:02.275 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.275 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.275 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:02.275 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:02.275 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.72e-07 2024-04-25T22:53:02.275 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.275 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.275 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:02.275 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593381+0000", 2024-04-25T22:53:02.275 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5797000000000006e-05 2024-04-25T22:53:02.275 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.275 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.275 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:02.276 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593389+0000", 2024-04-25T22:53:02.276 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8480000000000001e-06 2024-04-25T22:53:02.276 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.276 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.276 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:02.276 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593393+0000", 2024-04-25T22:53:02.276 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4819999999999996e-06 2024-04-25T22:53:02.276 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.276 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.276 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:02.276 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593435+0000", 2024-04-25T22:53:02.276 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1600000000000002e-05 2024-04-25T22:53:02.276 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.276 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.277 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:02.277 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593454+0000", 2024-04-25T22:53:02.277 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8868e-05 2024-04-25T22:53:02.277 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.277 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.277 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:02.277 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598350+0000", 2024-04-25T22:53:02.277 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004895763 2024-04-25T22:53:02.277 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.277 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.277 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:02.277 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598392+0000", 2024-04-25T22:53:02.277 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2521000000000002e-05 2024-04-25T22:53:02.278 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:02.278 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:02.278 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:02.278 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.278 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.278 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:02.278 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:02.278 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 69.232071384999998, 2024-04-25T22:53:02.278 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:53:02.278 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:02.278 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:02.278 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:02.278 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:02.279 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.279 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:02.279 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:02.279 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:02.279 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.279 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.279 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:02.279 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:02.279 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:02.279 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.279 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.279 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:02.279 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:53:02.280 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:53:02.280 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.280 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.280 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:02.280 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:53:02.280 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:53:02.280 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.280 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.280 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:02.280 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:53:02.280 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:53:02.280 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.280 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.280 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:02.281 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:53:02.281 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:53:02.281 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.281 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.281 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:02.281 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:53:02.281 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:53:02.281 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.281 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.281 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:02.281 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:53:02.281 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:53:02.281 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.282 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.282 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:02.282 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:53:02.282 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:53:02.282 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.282 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.282 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:02.282 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:53:02.282 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:53:02.282 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.282 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.282 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:02.282 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:53:02.283 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:53:02.283 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.283 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.283 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:02.283 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:53:02.283 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:53:02.283 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.283 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.283 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:02.283 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:53:02.283 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:53:02.283 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:02.283 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:02.284 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:02.284 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.284 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.284 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:02.284 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:02.284 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 69.231397009000005, 2024-04-25T22:53:02.284 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:53:02.284 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:02.284 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:02.284 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:02.284 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:02.284 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.284 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:02.284 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:02.285 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:02.285 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.285 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.285 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:02.285 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:02.285 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:02.285 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.285 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.285 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:02.285 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:53:02.285 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:53:02.285 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.285 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.285 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:02.286 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:53:02.286 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:53:02.286 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.286 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.286 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:02.286 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:53:02.286 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:53:02.286 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.286 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.286 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:02.286 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:53:02.286 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:53:02.286 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.287 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.287 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:02.287 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:53:02.287 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:53:02.287 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.287 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.287 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:02.287 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:53:02.287 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:53:02.287 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.287 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.287 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:02.287 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:53:02.288 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:53:02.288 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.288 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.288 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:02.288 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:53:02.288 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:53:02.288 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.288 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.288 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:02.288 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:53:02.288 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:53:02.288 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.288 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.289 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:02.289 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:53:02.289 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:53:02.289 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.289 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.289 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:02.289 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:53:02.289 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:53:02.289 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:02.289 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:02.289 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:02.289 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.289 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.289 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:02.290 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:02.290 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 69.230887796999994, 2024-04-25T22:53:02.290 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:53:02.290 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:02.290 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:02.290 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:02.290 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:02.290 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.290 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:02.290 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:02.290 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:02.290 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.290 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.291 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:02.291 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:02.291 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:02.291 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.291 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.291 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:02.291 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:53:02.291 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:53:02.291 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.291 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.291 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:02.291 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:53:02.291 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:53:02.291 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.292 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.292 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:02.292 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:53:02.292 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:53:02.292 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.292 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.292 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:02.292 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:53:02.292 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:53:02.292 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.292 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.292 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:02.292 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:53:02.292 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:53:02.293 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.293 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.293 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:02.293 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:53:02.293 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:53:02.293 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.293 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.293 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:02.293 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:53:02.293 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:53:02.293 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.293 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.294 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:02.294 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:53:02.294 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:53:02.294 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.294 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.294 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:02.294 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:53:02.294 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:53:02.294 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.294 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.294 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:02.294 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:53:02.295 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:53:02.295 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.295 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.295 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:02.295 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:53:02.295 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:53:02.295 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:02.295 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:02.295 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:02.295 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.295 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.295 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:02.295 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:02.296 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 69.230474599000004, 2024-04-25T22:53:02.296 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:53:02.296 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:02.296 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:02.296 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:02.296 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:02.296 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.296 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:02.296 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:02.296 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:02.296 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.296 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.296 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:02.296 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:02.297 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:02.297 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.297 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.297 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:02.297 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:02.297 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:53:02.297 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.297 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.297 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:02.297 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:02.297 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:53:02.297 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.297 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.298 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:02.298 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:53:02.298 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:53:02.298 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.298 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.298 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:02.298 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:53:02.298 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:53:02.298 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.298 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.298 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:02.298 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:53:02.298 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:53:02.299 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.299 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.299 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:02.299 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:53:02.299 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:53:02.299 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.299 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.299 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:02.299 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:53:02.299 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:53:02.299 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.299 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.299 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:02.300 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:53:02.300 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:53:02.300 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.300 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.300 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:02.300 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:53:02.300 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:53:02.300 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.300 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.300 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:02.300 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:53:02.300 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:53:02.300 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.301 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.301 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:02.301 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:53:02.301 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:53:02.301 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:02.301 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:02.301 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:02.301 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.301 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.301 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:02.301 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:02.301 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 69.230423928999997, 2024-04-25T22:53:02.301 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:53:02.302 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:02.302 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:02.302 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:02.302 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:02.302 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.302 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:02.302 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:02.302 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:02.302 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.302 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.302 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:02.302 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:02.303 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:02.303 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.303 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.303 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:02.303 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:53:02.303 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:53:02.303 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.303 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.303 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:02.303 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:53:02.303 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:53:02.303 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.303 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.303 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:02.304 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:53:02.304 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:53:02.304 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.304 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.304 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:02.304 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:53:02.304 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:53:02.304 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.304 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.304 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:02.304 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:53:02.304 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:53:02.305 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.305 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.305 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:02.305 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:53:02.305 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:53:02.305 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.305 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.305 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:02.305 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:53:02.305 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:53:02.305 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.305 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.305 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:02.306 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:53:02.306 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:53:02.306 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.306 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.306 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:02.306 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:53:02.306 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:53:02.306 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.306 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.306 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:02.306 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:53:02.306 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:53:02.306 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.307 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.307 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:02.307 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:53:02.307 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:53:02.307 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.307 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.307 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:02.307 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:53:02.307 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:53:02.307 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.307 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.307 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:02.307 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:53:02.308 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:53:02.308 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:02.308 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:02.308 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:02.308 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.308 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.308 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:02.308 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:02.308 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 69.230387059999998, 2024-04-25T22:53:02.308 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:53:02.308 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:02.308 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:02.308 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:02.308 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:02.309 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.309 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:02.309 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:02.309 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:02.309 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.309 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.309 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:02.309 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:02.309 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:02.309 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.309 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.309 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:02.309 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:53:02.310 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:53:02.310 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.310 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.310 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:02.310 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:53:02.310 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:53:02.310 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.310 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.310 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:02.310 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:53:02.310 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:53:02.310 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.310 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.311 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:02.311 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:53:02.311 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:53:02.311 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.311 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.311 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:02.311 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:53:02.311 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:53:02.311 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.311 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.311 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:53:02.311 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:53:02.311 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:53:02.311 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.312 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.312 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:02.312 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:53:02.312 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:53:02.312 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.312 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.312 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:02.312 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:53:02.312 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:53:02.312 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.312 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.312 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:02.312 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:53:02.312 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:53:02.313 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.313 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.313 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:02.313 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:53:02.313 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:53:02.313 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.313 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.313 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:02.313 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:53:02.313 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:53:02.313 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.313 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.313 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:02.313 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:53:02.314 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:53:02.314 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.314 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.314 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:02.314 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:53:02.314 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:53:02.314 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:02.314 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:02.314 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:02.314 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.314 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.314 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:02.315 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:02.315 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 69.230362094, 2024-04-25T22:53:02.315 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:53:02.315 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:02.315 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:02.315 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:02.315 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:02.315 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.315 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:02.315 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:02.315 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:02.315 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.315 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.316 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:02.316 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:02.316 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:02.316 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.316 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.316 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:02.316 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:53:02.316 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:53:02.316 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.316 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.316 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:02.316 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:53:02.316 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:53:02.317 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.317 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.317 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:02.317 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:02.317 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:53:02.317 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.317 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.317 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:02.317 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:53:02.317 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:53:02.317 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.317 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.317 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:02.317 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:53:02.318 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:53:02.318 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.318 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.318 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:02.318 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:53:02.318 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:53:02.318 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.318 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.318 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:02.318 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:53:02.318 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:53:02.318 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.319 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.319 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:02.319 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:53:02.319 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:53:02.319 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.319 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.319 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:02.319 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:53:02.319 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:53:02.319 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.319 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.319 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:02.319 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:53:02.319 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:53:02.320 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.320 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.320 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:02.320 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:53:02.320 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:53:02.320 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:02.320 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:02.320 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:02.320 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.320 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.320 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:02.320 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:02.320 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 69.230325730000004, 2024-04-25T22:53:02.320 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:53:02.321 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:02.321 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:02.321 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:02.321 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:02.321 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.321 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:02.321 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:02.321 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:02.321 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.321 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.321 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:02.321 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:02.321 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:02.322 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.322 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.322 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:02.322 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:53:02.322 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:53:02.322 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.322 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.322 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:02.322 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:53:02.322 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:53:02.322 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.322 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.322 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:02.323 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:53:02.323 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:53:02.323 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.323 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.323 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:02.323 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:53:02.323 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:53:02.323 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.323 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.323 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:02.323 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:53:02.323 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:53:02.323 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.323 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.324 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:02.324 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:53:02.324 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:53:02.324 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.324 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.324 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:02.324 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:53:02.324 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:53:02.324 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.324 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.324 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:02.324 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:53:02.324 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:53:02.325 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.325 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.325 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:02.325 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:53:02.325 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:53:02.325 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:02.325 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:02.325 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:02.325 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.325 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.325 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:02.325 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:02.325 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 69.230294649000001, 2024-04-25T22:53:02.326 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:53:02.326 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:02.326 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:02.326 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:02.326 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:02.326 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.326 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:02.326 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:02.326 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:02.326 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.326 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.326 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:02.326 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:02.327 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:02.327 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.327 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.327 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:02.327 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:02.327 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:02.327 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.327 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.327 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:02.327 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:53:02.327 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:53:02.327 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.327 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.328 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:02.328 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:53:02.328 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:53:02.328 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.328 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.328 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:02.328 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:53:02.328 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:53:02.328 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.328 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.328 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:02.328 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:53:02.328 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:53:02.328 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.329 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.329 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:02.329 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:53:02.329 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:53:02.329 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.329 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.329 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:02.329 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:53:02.329 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:53:02.329 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:02.329 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:02.329 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:02.329 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.330 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.330 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:53:02.330 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:02.330 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 69.229853680000005, 2024-04-25T22:53:02.330 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064881979999999997, 2024-04-25T22:53:02.330 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:02.330 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:02.330 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:02.330 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:02.330 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.330 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:02.330 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:02.330 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:02.330 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.331 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.331 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:02.331 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:02.331 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:02.331 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.331 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.331 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:02.331 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:02.331 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2699999999999999e-07 2024-04-25T22:53:02.331 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.331 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.331 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:02.331 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013898+0000", 2024-04-25T22:53:02.331 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0796e-05 2024-04-25T22:53:02.332 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.332 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.332 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:02.332 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013907+0000", 2024-04-25T22:53:02.332 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5140000000000007e-06 2024-04-25T22:53:02.332 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.332 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.332 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:02.332 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013952+0000", 2024-04-25T22:53:02.332 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4134000000000001e-05 2024-04-25T22:53:02.332 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.332 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.332 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:02.333 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016812+0000", 2024-04-25T22:53:02.333 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028601059999999998 2024-04-25T22:53:02.333 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.333 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.333 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:02.333 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.017052+0000", 2024-04-25T22:53:02.333 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024056500000000001 2024-04-25T22:53:02.333 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.333 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.333 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:02.333 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020350+0000", 2024-04-25T22:53:02.333 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032978320000000001 2024-04-25T22:53:02.333 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.333 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.334 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:02.334 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020375+0000", 2024-04-25T22:53:02.334 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4624e-05 2024-04-25T22:53:02.334 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:02.334 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:02.334 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:02.334 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.334 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.334 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-25T22:53:02.334 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:02.334 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 69.216323234000001, 2024-04-25T22:53:02.334 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058583000000000003, 2024-04-25T22:53:02.334 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:02.335 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:02.335 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:02.335 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:02.335 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.335 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:02.335 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:02.335 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:02.335 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.335 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.335 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:02.335 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:02.335 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:02.335 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.336 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.336 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:02.336 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:02.336 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.41e-07 2024-04-25T22:53:02.336 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.336 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.336 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:02.336 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027428+0000", 2024-04-25T22:53:02.336 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.075e-05 2024-04-25T22:53:02.336 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.336 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.336 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:02.336 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027435+0000", 2024-04-25T22:53:02.336 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3610000000000003e-06 2024-04-25T22:53:02.337 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.337 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.337 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:02.337 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027442+0000", 2024-04-25T22:53:02.337 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0400000000000004e-06 2024-04-25T22:53:02.337 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.337 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.337 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:02.337 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028094+0000", 2024-04-25T22:53:02.337 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00065134800000000005 2024-04-25T22:53:02.337 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.337 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.337 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:02.338 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028107+0000", 2024-04-25T22:53:02.338 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3087e-05 2024-04-25T22:53:02.338 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.338 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.338 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:02.338 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033239+0000", 2024-04-25T22:53:02.338 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051319429999999999 2024-04-25T22:53:02.338 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.338 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.338 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:02.338 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033275+0000", 2024-04-25T22:53:02.338 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6430000000000002e-05 2024-04-25T22:53:02.338 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:02.339 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:02.339 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:02.339 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.339 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.339 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-25T22:53:02.339 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:02.339 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 69.215938397000002, 2024-04-25T22:53:02.339 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005413597, 2024-04-25T22:53:02.339 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:02.339 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:02.339 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:02.339 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:02.339 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.340 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:02.340 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:02.340 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:02.340 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.340 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.340 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:02.340 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:02.340 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:02.340 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.340 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.340 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:02.340 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:02.340 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3799999999999997e-07 2024-04-25T22:53:02.341 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.341 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.341 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:02.341 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027816+0000", 2024-04-25T22:53:02.341 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3230999999999999e-05 2024-04-25T22:53:02.341 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.341 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.341 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:02.341 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027823+0000", 2024-04-25T22:53:02.341 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9039999999999992e-06 2024-04-25T22:53:02.341 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.341 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.341 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:02.341 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027841+0000", 2024-04-25T22:53:02.342 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7651000000000001e-05 2024-04-25T22:53:02.342 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.342 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.342 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:02.342 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027904+0000", 2024-04-25T22:53:02.342 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3058000000000005e-05 2024-04-25T22:53:02.342 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.342 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.342 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:02.342 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027926+0000", 2024-04-25T22:53:02.342 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1450999999999998e-05 2024-04-25T22:53:02.342 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.343 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.343 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:02.343 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033177+0000", 2024-04-25T22:53:02.343 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052508909999999997 2024-04-25T22:53:02.343 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.343 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.343 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:02.343 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033215+0000", 2024-04-25T22:53:02.343 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8872999999999999e-05 2024-04-25T22:53:02.343 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:02.343 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:02.343 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:02.343 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.343 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.344 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 171 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:53:02.344 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:02.344 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 69.215881295000003, 2024-04-25T22:53:02.344 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054322240000000003, 2024-04-25T22:53:02.344 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:02.344 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:02.344 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "reached pg", 2024-04-25T22:53:02.344 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:02.344 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.344 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:02.344 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:02.344 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:02.344 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.345 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.345 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:02.345 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:02.345 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:02.345 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.345 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.345 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:02.345 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:02.345 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7500000000000001e-07 2024-04-25T22:53:02.345 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.345 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.345 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:02.345 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027868+0000", 2024-04-25T22:53:02.345 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5750000000000001e-06 2024-04-25T22:53:02.346 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.346 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.346 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:02.346 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027885+0000", 2024-04-25T22:53:02.346 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7272e-05 2024-04-25T22:53:02.346 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.346 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.346 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:02.346 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027900+0000", 2024-04-25T22:53:02.346 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.502e-05 2024-04-25T22:53:02.346 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.346 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.346 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:02.347 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028381+0000", 2024-04-25T22:53:02.347 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00048039399999999998 2024-04-25T22:53:02.347 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:02.347 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:02.347 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:02.347 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033291+0000", 2024-04-25T22:53:02.347 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049105879999999996 2024-04-25T22:53:02.347 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:02.347 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:02.347 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:02.347 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:02.347 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:02.347 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:02.349 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:02.348+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:02.349 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:02.411 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:53:02.450 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:02.450+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:02.456 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:02.456 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:02.456 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-04-25T22:53:02.456 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:02.464 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:02.551 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:02.551+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:02.564 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-25T22:53:02.564 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:53:02.564 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:53:02.566 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:02.569 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:02.576 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:02.582 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-25T22:53:02.583 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:53:02.586 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:53:02.587 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:53:02.652 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:02.651+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:02.677 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:02.677 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:02.686 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:02.753 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:02.752+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:02.791 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:02.791 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:02.801 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:02.853 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:02.852+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:02.903 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:03.003 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:03.004 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:03.005 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:03.004+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:03.105 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:03.104+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:03.147 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:03.147 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:03.156 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:03.185 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is set 2024-04-25T22:53:03.205 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:03.205+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:03.260 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:03.260 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:03.268 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:03.312 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:03.311+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:03.370 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:03.370 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:03.379 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:03.407 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:03.406+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:03.508 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:03.507+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:03.521 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:03.521 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:03.530 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:03.608 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:03.608+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:03.633 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:03.633 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:03.641 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:03.709 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:03.708+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:03.744 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:03.744 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:03.753 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:03.839 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:03.838+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:03.896 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:03.896 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:03.904 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:03.950 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:03.949+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:04.009 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:04.009 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:04.011 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:04.010+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:04.017 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:04.111 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:04.111+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:04.162 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:04.163 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:04.169 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:04.212 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:04.212+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:04.310 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:04.311 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:04.313 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:04.312+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:04.320 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:04.414 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:04.412+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:04.424 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:04.425 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:04.434 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:04.515 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:04.514+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:04.576 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:04.577 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:04.585 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:04.587 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:53:04.615 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:04.615+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:04.687 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:04.688 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:04.696 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:04.717 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:04.716+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:04.730 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-25T22:53:04.731 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:53:04.731 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:53:04.749 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-25T22:53:04.749 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:53:04.752 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:53:04.752 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:53:04.800 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:04.800 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:04.800 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-04-25T22:53:04.800 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:04.810 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:04.817 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:04.817+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:04.915 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:04.916 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:04.916 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:53:04.916 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:53:04.916 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:04.918 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:04.918+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:04.925 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:05.019 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:05.018+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:05.029 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:05.030 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-04-25T22:53:05.030 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-04-25T22:53:05.030 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:53:05.030 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.030 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:05.030 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:05.030 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 77.062736036000004, 2024-04-25T22:53:05.030 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0103421, 2024-04-25T22:53:05.030 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:05.030 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:05.030 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:05.031 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:05.031 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:05.031 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:05.031 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 115 2024-04-25T22:53:05.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.031 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:05.031 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.031 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:05.031 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:05.032 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:05.032 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.032 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.032 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:05.032 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:05.032 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:05.032 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.032 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.032 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:05.032 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:05.032 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9500000000000002e-07 2024-04-25T22:53:05.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.033 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:05.033 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965108+0000", 2024-04-25T22:53:05.033 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9177999999999994e-05 2024-04-25T22:53:05.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.033 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:05.033 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965127+0000", 2024-04-25T22:53:05.033 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8868e-05 2024-04-25T22:53:05.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.033 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:05.033 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965133+0000", 2024-04-25T22:53:05.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8929999999999999e-06 2024-04-25T22:53:05.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.034 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:05.034 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.969991+0000", 2024-04-25T22:53:05.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048573849999999997 2024-04-25T22:53:05.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.034 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:05.034 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970072+0000", 2024-04-25T22:53:05.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0728000000000004e-05 2024-04-25T22:53:05.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.034 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:05.035 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970189+0000", 2024-04-25T22:53:05.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000117778 2024-04-25T22:53:05.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.035 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.035 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:05.035 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970946+0000", 2024-04-25T22:53:05.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00075704600000000004 2024-04-25T22:53:05.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.035 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.035 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:05.035 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975297+0000", 2024-04-25T22:53:05.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004350217 2024-04-25T22:53:05.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.035 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.036 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:05.036 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975343+0000", 2024-04-25T22:53:05.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6687999999999998e-05 2024-04-25T22:53:05.036 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.036 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:05.036 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975380+0000", 2024-04-25T22:53:05.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6724000000000003e-05 2024-04-25T22:53:05.036 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:05.036 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:05.036 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:05.036 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.037 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:05.037 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:05.037 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 77.062630005000003, 2024-04-25T22:53:05.037 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010304384, 2024-04-25T22:53:05.037 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:05.037 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:05.037 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:05.037 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:05.037 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:05.037 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:05.037 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 116 2024-04-25T22:53:05.037 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.037 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:05.037 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:05.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:05.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:05.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:05.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:05.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:05.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:05.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:05.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5799999999999999e-07 2024-04-25T22:53:05.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:05.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965154+0000", 2024-04-25T22:53:05.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0009e-05 2024-04-25T22:53:05.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:05.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965164+0000", 2024-04-25T22:53:05.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8490000000000001e-06 2024-04-25T22:53:05.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:05.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965169+0000", 2024-04-25T22:53:05.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0730000000000004e-06 2024-04-25T22:53:05.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:05.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970609+0000", 2024-04-25T22:53:05.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054397689999999997 2024-04-25T22:53:05.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.041 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:05.041 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970651+0000", 2024-04-25T22:53:05.041 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1873999999999999e-05 2024-04-25T22:53:05.041 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.041 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.041 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:05.041 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970723+0000", 2024-04-25T22:53:05.041 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2039999999999995e-05 2024-04-25T22:53:05.041 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.041 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.041 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:05.041 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971358+0000", 2024-04-25T22:53:05.041 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063489500000000001 2024-04-25T22:53:05.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.042 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:05.042 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975409+0000", 2024-04-25T22:53:05.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040506880000000002 2024-04-25T22:53:05.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.042 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:05.042 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975432+0000", 2024-04-25T22:53:05.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3315999999999998e-05 2024-04-25T22:53:05.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.042 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:05.043 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975448+0000", 2024-04-25T22:53:05.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6313000000000001e-05 2024-04-25T22:53:05.043 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:05.043 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:05.043 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:05.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.043 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:05.043 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:05.043 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 77.062595423000005, 2024-04-25T22:53:05.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010384338999999999, 2024-04-25T22:53:05.043 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:05.043 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:05.044 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:05.044 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:05.044 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:05.044 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:05.044 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-04-25T22:53:05.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.044 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:05.044 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.044 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:05.044 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:05.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:05.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.044 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:05.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:05.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:05.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:05.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:05.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3600000000000004e-07 2024-04-25T22:53:05.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:05.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965185+0000", 2024-04-25T22:53:05.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.117e-06 2024-04-25T22:53:05.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.046 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:05.046 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965192+0000", 2024-04-25T22:53:05.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3239999999999997e-06 2024-04-25T22:53:05.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.046 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:05.046 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965198+0000", 2024-04-25T22:53:05.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6370000000000004e-06 2024-04-25T22:53:05.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:05.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970973+0000", 2024-04-25T22:53:05.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057748239999999996 2024-04-25T22:53:05.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:05.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971049+0000", 2024-04-25T22:53:05.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6029e-05 2024-04-25T22:53:05.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.048 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:05.048 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971174+0000", 2024-04-25T22:53:05.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012462399999999999 2024-04-25T22:53:05.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.048 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:05.048 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971553+0000", 2024-04-25T22:53:05.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037896499999999999 2024-04-25T22:53:05.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:05.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975482+0000", 2024-04-25T22:53:05.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039297459999999996 2024-04-25T22:53:05.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:05.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975529+0000", 2024-04-25T22:53:05.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6387000000000002e-05 2024-04-25T22:53:05.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:05.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975563+0000", 2024-04-25T22:53:05.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4150000000000003e-05 2024-04-25T22:53:05.050 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:05.050 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:05.050 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:05.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.050 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:05.050 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:05.050 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 72.015549100000001, 2024-04-25T22:53:05.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012637705000000001, 2024-04-25T22:53:05.050 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:05.051 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:05.051 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:05.051 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:05.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:05.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:05.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:05.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:05.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:05.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:05.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:05.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012227+0000", 2024-04-25T22:53:05.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.863e-06 2024-04-25T22:53:05.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:05.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012236+0000", 2024-04-25T22:53:05.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1109999999999997e-06 2024-04-25T22:53:05.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:05.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012309+0000", 2024-04-25T22:53:05.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3242000000000001e-05 2024-04-25T22:53:05.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.053 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:05.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012324+0000", 2024-04-25T22:53:05.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4837e-05 2024-04-25T22:53:05.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.053 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:05.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015060+0000", 2024-04-25T22:53:05.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027363349999999999 2024-04-25T22:53:05.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.053 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:05.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015169+0000", 2024-04-25T22:53:05.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108372 2024-04-25T22:53:05.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:05.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015498+0000", 2024-04-25T22:53:05.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032949999999999999 2024-04-25T22:53:05.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:05.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021282+0000", 2024-04-25T22:53:05.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057836429999999998 2024-04-25T22:53:05.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:05.055 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024709+0000", 2024-04-25T22:53:05.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034271979999999998 2024-04-25T22:53:05.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.055 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:05.055 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024802+0000", 2024-04-25T22:53:05.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2960000000000004e-05 2024-04-25T22:53:05.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.055 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:05.055 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024863+0000", 2024-04-25T22:53:05.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0643999999999997e-05 2024-04-25T22:53:05.055 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:05.055 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:05.056 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:05.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.056 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:05.056 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:05.056 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 72.015425328999996, 2024-04-25T22:53:05.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012979447999999999, 2024-04-25T22:53:05.056 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:05.056 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:05.056 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:05.056 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:05.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:05.056 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:05.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:05.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.057 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:05.057 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:05.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:05.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.057 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:05.057 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:05.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:53:05.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.057 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:05.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012354+0000", 2024-04-25T22:53:05.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7740000000000004e-06 2024-04-25T22:53:05.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:05.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012365+0000", 2024-04-25T22:53:05.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.064e-05 2024-04-25T22:53:05.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:05.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012382+0000", 2024-04-25T22:53:05.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6999000000000001e-05 2024-04-25T22:53:05.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:05.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015958+0000", 2024-04-25T22:53:05.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035765699999999998 2024-04-25T22:53:05.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:05.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016037+0000", 2024-04-25T22:53:05.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8242000000000001e-05 2024-04-25T22:53:05.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:05.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016404+0000", 2024-04-25T22:53:05.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036784300000000002 2024-04-25T22:53:05.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:05.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021294+0000", 2024-04-25T22:53:05.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048890629999999999 2024-04-25T22:53:05.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:05.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024959+0000", 2024-04-25T22:53:05.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036651570000000001 2024-04-25T22:53:05.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:05.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025097+0000", 2024-04-25T22:53:05.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013788099999999999 2024-04-25T22:53:05.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:05.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025328+0000", 2024-04-25T22:53:05.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231492 2024-04-25T22:53:05.061 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:05.061 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:05.061 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:05.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.061 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:05.062 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:05.062 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 72.015337560000006, 2024-04-25T22:53:05.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013049827, 2024-04-25T22:53:05.062 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:05.062 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:05.062 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:05.062 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:05.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:05.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:05.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:05.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:05.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:05.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:05.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:05.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012437+0000", 2024-04-25T22:53:05.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-04-25T22:53:05.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:05.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012440+0000", 2024-04-25T22:53:05.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7609999999999999e-06 2024-04-25T22:53:05.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.064 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:05.064 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012449+0000", 2024-04-25T22:53:05.064 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.285e-06 2024-04-25T22:53:05.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.064 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:05.064 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012457+0000", 2024-04-25T22:53:05.064 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9510000000000006e-06 2024-04-25T22:53:05.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.064 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:05.064 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017106+0000", 2024-04-25T22:53:05.064 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046494220000000003 2024-04-25T22:53:05.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:05.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017223+0000", 2024-04-25T22:53:05.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116824 2024-04-25T22:53:05.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:05.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017345+0000", 2024-04-25T22:53:05.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122175 2024-04-25T22:53:05.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:05.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021299+0000", 2024-04-25T22:53:05.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039534879999999998 2024-04-25T22:53:05.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:05.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025398+0000", 2024-04-25T22:53:05.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040988960000000003 2024-04-25T22:53:05.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:05.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025439+0000", 2024-04-25T22:53:05.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0915999999999999e-05 2024-04-25T22:53:05.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:05.067 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025486+0000", 2024-04-25T22:53:05.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7534999999999998e-05 2024-04-25T22:53:05.067 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:05.067 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:05.067 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:05.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.067 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:05.067 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:05.067 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 72.015307409000002, 2024-04-25T22:53:05.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020988041999999998, 2024-04-25T22:53:05.067 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:05.067 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:05.067 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:05.068 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:05.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.068 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:05.068 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:05.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:05.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.068 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:05.068 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:05.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:05.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.068 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:05.068 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:05.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.99e-07 2024-04-25T22:53:05.069 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:05.069 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012470+0000", 2024-04-25T22:53:05.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2789999999999999e-06 2024-04-25T22:53:05.069 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:05.069 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012477+0000", 2024-04-25T22:53:05.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:53:05.069 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:05.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012500+0000", 2024-04-25T22:53:05.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2490999999999999e-05 2024-04-25T22:53:05.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:05.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021911+0000", 2024-04-25T22:53:05.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094114160000000006 2024-04-25T22:53:05.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:05.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022000+0000", 2024-04-25T22:53:05.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8601000000000001e-05 2024-04-25T22:53:05.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:05.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022359+0000", 2024-04-25T22:53:05.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035921999999999999 2024-04-25T22:53:05.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:05.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025541+0000", 2024-04-25T22:53:05.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031820619999999998 2024-04-25T22:53:05.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:05.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033375+0000", 2024-04-25T22:53:05.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078338379999999992 2024-04-25T22:53:05.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:05.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033415+0000", 2024-04-25T22:53:05.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9527000000000003e-05 2024-04-25T22:53:05.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:05.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033455+0000", 2024-04-25T22:53:05.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9932000000000003e-05 2024-04-25T22:53:05.072 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:05.072 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:05.072 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:05.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.072 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:05.073 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:05.073 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 72.015252215999993, 2024-04-25T22:53:05.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021043857999999999, 2024-04-25T22:53:05.073 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:05.073 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:05.073 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:05.073 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:05.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:05.073 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:05.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:05.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:05.074 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:05.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:05.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.074 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:05.074 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012523+0000", 2024-04-25T22:53:05.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.361e-06 2024-04-25T22:53:05.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.074 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:05.074 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012530+0000", 2024-04-25T22:53:05.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5440000000000004e-06 2024-04-25T22:53:05.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:05.075 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012541+0000", 2024-04-25T22:53:05.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1745e-05 2024-04-25T22:53:05.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:05.075 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012551+0000", 2024-04-25T22:53:05.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5789999999999993e-06 2024-04-25T22:53:05.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:05.075 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022709+0000", 2024-04-25T22:53:05.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010157685 2024-04-25T22:53:05.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.076 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:05.076 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022957+0000", 2024-04-25T22:53:05.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024824599999999998 2024-04-25T22:53:05.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.076 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:05.076 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023443+0000", 2024-04-25T22:53:05.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048578599999999999 2024-04-25T22:53:05.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.076 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:05.076 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025547+0000", 2024-04-25T22:53:05.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021044789999999998 2024-04-25T22:53:05.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.077 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:05.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033509+0000", 2024-04-25T22:53:05.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0079622180000000001 2024-04-25T22:53:05.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.077 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:05.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033542+0000", 2024-04-25T22:53:05.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3018000000000001e-05 2024-04-25T22:53:05.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:05.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033566+0000", 2024-04-25T22:53:05.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3197000000000002e-05 2024-04-25T22:53:05.078 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:05.078 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:05.078 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:05.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.078 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:05.078 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:05.078 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 72.015212250999994, 2024-04-25T22:53:05.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021122696, 2024-04-25T22:53:05.078 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:05.078 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:05.079 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:05.079 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:05.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:05.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:05.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:05.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:05.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:05.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:05.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:05.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:05.080 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:53:05.080 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.080 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.080 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:05.080 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012566+0000", 2024-04-25T22:53:05.080 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-04-25T22:53:05.080 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.080 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.080 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:05.080 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012619+0000", 2024-04-25T22:53:05.080 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2607e-05 2024-04-25T22:53:05.080 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.080 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.080 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:05.081 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012628+0000", 2024-04-25T22:53:05.081 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6500000000000008e-06 2024-04-25T22:53:05.081 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.081 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.081 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:05.081 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024024+0000", 2024-04-25T22:53:05.081 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011396007999999999 2024-04-25T22:53:05.081 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.081 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.081 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:05.081 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024198+0000", 2024-04-25T22:53:05.081 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000173215 2024-04-25T22:53:05.081 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.081 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.082 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:05.082 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024447+0000", 2024-04-25T22:53:05.082 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024898500000000002 2024-04-25T22:53:05.082 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.082 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.082 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:05.082 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026431+0000", 2024-04-25T22:53:05.082 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001984923 2024-04-25T22:53:05.082 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.082 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.082 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:05.082 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033608+0000", 2024-04-25T22:53:05.082 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071768459999999997 2024-04-25T22:53:05.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.083 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.083 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:05.083 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033646+0000", 2024-04-25T22:53:05.083 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299000000000003e-05 2024-04-25T22:53:05.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.083 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.083 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:05.083 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033684+0000", 2024-04-25T22:53:05.083 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8773000000000003e-05 2024-04-25T22:53:05.083 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:05.083 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:05.083 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:05.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.084 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:05.084 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:05.084 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 72.015123652, 2024-04-25T22:53:05.084 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021175381, 2024-04-25T22:53:05.084 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:05.084 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:05.084 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:05.084 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:05.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.084 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:05.084 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:05.084 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:05.084 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.085 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.085 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:05.085 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:05.085 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:05.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.085 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.085 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:05.085 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012651+0000", 2024-04-25T22:53:05.085 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:53:05.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.085 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.085 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:05.085 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012656+0000", 2024-04-25T22:53:05.085 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8899999999999998e-06 2024-04-25T22:53:05.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.086 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.086 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:05.086 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012666+0000", 2024-04-25T22:53:05.086 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0346999999999999e-05 2024-04-25T22:53:05.086 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.086 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.086 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:05.086 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012675+0000", 2024-04-25T22:53:05.086 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9930000000000001e-06 2024-04-25T22:53:05.086 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.086 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.086 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:05.086 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025661+0000", 2024-04-25T22:53:05.086 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01298531 2024-04-25T22:53:05.087 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.087 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.087 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:05.087 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025757+0000", 2024-04-25T22:53:05.087 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5822000000000005e-05 2024-04-25T22:53:05.087 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.087 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.087 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:05.087 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025907+0000", 2024-04-25T22:53:05.087 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015051499999999999 2024-04-25T22:53:05.087 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.087 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.087 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:05.087 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026435+0000", 2024-04-25T22:53:05.088 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052762200000000005 2024-04-25T22:53:05.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.088 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.088 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:05.088 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033732+0000", 2024-04-25T22:53:05.088 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072978419999999997 2024-04-25T22:53:05.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.088 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.088 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:05.088 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033787+0000", 2024-04-25T22:53:05.088 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4703999999999997e-05 2024-04-25T22:53:05.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.089 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.089 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:05.089 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033826+0000", 2024-04-25T22:53:05.089 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8458999999999999e-05 2024-04-25T22:53:05.089 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:05.089 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:05.089 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:05.089 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.089 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.089 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:05.089 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:05.089 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 72.015068237999998, 2024-04-25T22:53:05.089 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021244174000000001, 2024-04-25T22:53:05.089 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:05.090 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:05.090 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:05.090 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:05.090 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.090 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:05.090 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:05.090 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:05.090 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.090 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.090 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:05.090 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:05.090 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:05.091 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.091 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.091 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:05.091 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:05.091 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:05.091 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.091 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.091 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:05.091 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012712+0000", 2024-04-25T22:53:05.091 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.913e-06 2024-04-25T22:53:05.091 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.091 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.091 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:05.092 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012722+0000", 2024-04-25T22:53:05.092 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2879999999999998e-06 2024-04-25T22:53:05.092 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.092 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.092 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:05.092 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012727+0000", 2024-04-25T22:53:05.092 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8429999999999998e-06 2024-04-25T22:53:05.092 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.092 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.092 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:05.092 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026099+0000", 2024-04-25T22:53:05.092 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013371450999999999 2024-04-25T22:53:05.092 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.092 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.092 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:05.093 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026147+0000", 2024-04-25T22:53:05.093 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7837999999999998e-05 2024-04-25T22:53:05.093 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.093 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.093 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:05.093 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026254+0000", 2024-04-25T22:53:05.093 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107314 2024-04-25T22:53:05.093 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.093 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.093 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:05.093 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026686+0000", 2024-04-25T22:53:05.093 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000432428 2024-04-25T22:53:05.093 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.094 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.094 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:05.094 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033873+0000", 2024-04-25T22:53:05.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071864399999999997 2024-04-25T22:53:05.094 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.094 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.094 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:05.094 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033904+0000", 2024-04-25T22:53:05.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1321e-05 2024-04-25T22:53:05.094 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.094 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.094 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:05.094 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033950+0000", 2024-04-25T22:53:05.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5707999999999997e-05 2024-04-25T22:53:05.095 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:05.095 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:05.095 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:05.095 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.095 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.095 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:05.095 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:05.095 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 72.015037852999995, 2024-04-25T22:53:05.095 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01096505, 2024-04-25T22:53:05.095 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:05.095 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:05.095 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:05.095 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:05.095 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.095 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:05.096 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:05.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:05.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.096 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:05.096 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:05.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:05.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.096 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:05.096 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012737+0000", 2024-04-25T22:53:05.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:05.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.097 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:05.097 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012739+0000", 2024-04-25T22:53:05.097 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-04-25T22:53:05.097 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.097 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:05.097 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012743+0000", 2024-04-25T22:53:05.097 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3239999999999996e-06 2024-04-25T22:53:05.097 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.097 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:05.097 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012746+0000", 2024-04-25T22:53:05.097 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.129e-06 2024-04-25T22:53:05.097 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.098 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:05.098 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012796+0000", 2024-04-25T22:53:05.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9231999999999999e-05 2024-04-25T22:53:05.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.098 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:05.098 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012915+0000", 2024-04-25T22:53:05.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119021 2024-04-25T22:53:05.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.098 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:05.098 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013069+0000", 2024-04-25T22:53:05.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015463900000000001 2024-04-25T22:53:05.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.099 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:05.099 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019237+0000", 2024-04-25T22:53:05.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061680329999999998 2024-04-25T22:53:05.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.099 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:05.099 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023603+0000", 2024-04-25T22:53:05.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043655860000000003 2024-04-25T22:53:05.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.099 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:05.099 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023659+0000", 2024-04-25T22:53:05.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6484000000000003e-05 2024-04-25T22:53:05.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.100 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:05.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023701+0000", 2024-04-25T22:53:05.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1761999999999998e-05 2024-04-25T22:53:05.100 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:05.100 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:05.100 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:05.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.100 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:05.100 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:05.100 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 72.015012905000006, 2024-04-25T22:53:05.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011234429000000001, 2024-04-25T22:53:05.100 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:05.100 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:05.101 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:05.101 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:05.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:05.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:05.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:05.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:05.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:05.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:05.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:05.102 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012762+0000", 2024-04-25T22:53:05.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-04-25T22:53:05.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:05.102 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012765+0000", 2024-04-25T22:53:05.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2569999999999999e-06 2024-04-25T22:53:05.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:05.102 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012783+0000", 2024-04-25T22:53:05.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8431999999999999e-05 2024-04-25T22:53:05.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:05.103 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012799+0000", 2024-04-25T22:53:05.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5438999999999999e-05 2024-04-25T22:53:05.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.103 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:05.103 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013826+0000", 2024-04-25T22:53:05.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010275060000000001 2024-04-25T22:53:05.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.103 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:05.103 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013913+0000", 2024-04-25T22:53:05.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.708e-05 2024-04-25T22:53:05.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.104 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:05.104 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014098+0000", 2024-04-25T22:53:05.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018519399999999999 2024-04-25T22:53:05.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.104 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:05.104 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019684+0000", 2024-04-25T22:53:05.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055860079999999999 2024-04-25T22:53:05.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.104 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:05.104 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023876+0000", 2024-04-25T22:53:05.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041918800000000003 2024-04-25T22:53:05.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:05.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023957+0000", 2024-04-25T22:53:05.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1165e-05 2024-04-25T22:53:05.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:05.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023995+0000", 2024-04-25T22:53:05.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:53:05.105 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:05.105 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:05.105 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:05.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.106 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:05.106 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:05.106 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 72.014915126000005, 2024-04-25T22:53:05.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011131200000000001, 2024-04-25T22:53:05.106 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:05.106 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:05.106 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:05.106 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:05.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:05.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:05.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:05.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:05.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:05.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:05.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:05.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012860+0000", 2024-04-25T22:53:05.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3900000000000004e-07 2024-04-25T22:53:05.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:05.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012865+0000", 2024-04-25T22:53:05.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5609999999999998e-06 2024-04-25T22:53:05.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.108 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:05.108 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012895+0000", 2024-04-25T22:53:05.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9847000000000001e-05 2024-04-25T22:53:05.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.108 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:05.108 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012905+0000", 2024-04-25T22:53:05.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.03e-05 2024-04-25T22:53:05.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.108 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:05.108 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015020+0000", 2024-04-25T22:53:05.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021142940000000001 2024-04-25T22:53:05.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:05.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015182+0000", 2024-04-25T22:53:05.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016248099999999999 2024-04-25T22:53:05.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:05.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015357+0000", 2024-04-25T22:53:05.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017471000000000001 2024-04-25T22:53:05.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:05.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021021+0000", 2024-04-25T22:53:05.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056638340000000004 2024-04-25T22:53:05.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:05.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023712+0000", 2024-04-25T22:53:05.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026910380000000002 2024-04-25T22:53:05.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:05.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023763+0000", 2024-04-25T22:53:05.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1477999999999997e-05 2024-04-25T22:53:05.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.111 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:05.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023990+0000", 2024-04-25T22:53:05.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000226818 2024-04-25T22:53:05.111 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:05.111 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:05.111 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:05.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.111 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:05.111 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:05.111 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 72.014792029999995, 2024-04-25T22:53:05.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011705299000000001, 2024-04-25T22:53:05.111 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:05.112 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:05.112 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:05.112 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:05.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:05.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:05.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:05.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:05.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:05.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:05.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.113 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:05.113 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012983+0000", 2024-04-25T22:53:05.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:53:05.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.113 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:05.113 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012986+0000", 2024-04-25T22:53:05.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5700000000000001e-06 2024-04-25T22:53:05.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.113 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:05.113 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012993+0000", 2024-04-25T22:53:05.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8730000000000001e-06 2024-04-25T22:53:05.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:05.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013000+0000", 2024-04-25T22:53:05.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1890000000000001e-06 2024-04-25T22:53:05.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:05.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:53:05.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002147866 2024-04-25T22:53:05.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:05.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015351+0000", 2024-04-25T22:53:05.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020300799999999999 2024-04-25T22:53:05.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:05.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016260+0000", 2024-04-25T22:53:05.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00090926799999999997 2024-04-25T22:53:05.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:05.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022669+0000", 2024-04-25T22:53:05.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064082849999999997 2024-04-25T22:53:05.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:05.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024584+0000", 2024-04-25T22:53:05.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019151699999999999 2024-04-25T22:53:05.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:05.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024643+0000", 2024-04-25T22:53:05.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8888999999999998e-05 2024-04-25T22:53:05.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:05.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024687+0000", 2024-04-25T22:53:05.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4444999999999999e-05 2024-04-25T22:53:05.116 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:05.116 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:05.116 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:05.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.117 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:05.117 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:05.117 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 72.014764439000004, 2024-04-25T22:53:05.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011249699, 2024-04-25T22:53:05.117 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:05.117 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:05.117 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:05.117 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:05.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.117 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:05.117 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:05.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:05.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:05.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:05.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:05.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:05.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013010+0000", 2024-04-25T22:53:05.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2099999999999996e-07 2024-04-25T22:53:05.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:05.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013013+0000", 2024-04-25T22:53:05.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1310000000000002e-06 2024-04-25T22:53:05.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:05.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013020+0000", 2024-04-25T22:53:05.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3330000000000002e-06 2024-04-25T22:53:05.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:05.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013025+0000", 2024-04-25T22:53:05.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6760000000000004e-06 2024-04-25T22:53:05.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:05.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013163+0000", 2024-04-25T22:53:05.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013824599999999999 2024-04-25T22:53:05.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:05.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013504+0000", 2024-04-25T22:53:05.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034080299999999998 2024-04-25T22:53:05.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:05.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013613+0000", 2024-04-25T22:53:05.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108705 2024-04-25T22:53:05.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:05.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015831+0000", 2024-04-25T22:53:05.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002217672 2024-04-25T22:53:05.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:05.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024137+0000", 2024-04-25T22:53:05.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0083060489999999994 2024-04-25T22:53:05.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:05.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024218+0000", 2024-04-25T22:53:05.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1351000000000001e-05 2024-04-25T22:53:05.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:05.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024259+0000", 2024-04-25T22:53:05.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1112000000000002e-05 2024-04-25T22:53:05.122 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:05.122 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:05.122 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:05.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.122 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:05.122 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:05.122 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 72.014676713, 2024-04-25T22:53:05.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020379749999999999, 2024-04-25T22:53:05.122 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:05.123 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:05.123 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:05.123 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:05.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:05.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:05.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:05.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:05.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:05.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:05.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:05.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013098+0000", 2024-04-25T22:53:05.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:53:05.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:05.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013105+0000", 2024-04-25T22:53:05.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5969999999999997e-06 2024-04-25T22:53:05.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:05.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013190+0000", 2024-04-25T22:53:05.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5618999999999995e-05 2024-04-25T22:53:05.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:05.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013200+0000", 2024-04-25T22:53:05.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5859999999999994e-06 2024-04-25T22:53:05.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:05.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020265+0000", 2024-04-25T22:53:05.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070653349999999998 2024-04-25T22:53:05.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:05.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020454+0000", 2024-04-25T22:53:05.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189316 2024-04-25T22:53:05.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:05.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020586+0000", 2024-04-25T22:53:05.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013195700000000001 2024-04-25T22:53:05.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:05.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023822+0000", 2024-04-25T22:53:05.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032358529999999999 2024-04-25T22:53:05.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:05.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033409+0000", 2024-04-25T22:53:05.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095870520000000004 2024-04-25T22:53:05.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:05.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033447+0000", 2024-04-25T22:53:05.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7261999999999997e-05 2024-04-25T22:53:05.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:05.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033477+0000", 2024-04-25T22:53:05.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0389e-05 2024-04-25T22:53:05.127 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:05.127 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:05.127 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:05.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.127 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:05.128 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:05.128 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 72.014560207000002, 2024-04-25T22:53:05.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010857383999999999, 2024-04-25T22:53:05.128 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:05.128 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:05.128 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:05.128 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:05.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:05.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:05.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:05.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:05.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:05.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:05.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:05.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:05.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:05.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:05.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013218+0000", 2024-04-25T22:53:05.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8199999999999998e-06 2024-04-25T22:53:05.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:05.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013226+0000", 2024-04-25T22:53:05.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7649999999999993e-06 2024-04-25T22:53:05.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:05.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013259+0000", 2024-04-25T22:53:05.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2727e-05 2024-04-25T22:53:05.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:05.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014809+0000", 2024-04-25T22:53:05.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001550144 2024-04-25T22:53:05.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:05.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014958+0000", 2024-04-25T22:53:05.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014890300000000001 2024-04-25T22:53:05.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:05.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015087+0000", 2024-04-25T22:53:05.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012939200000000001 2024-04-25T22:53:05.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:05.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020212+0000", 2024-04-25T22:53:05.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051248939999999996 2024-04-25T22:53:05.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:05.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023699+0000", 2024-04-25T22:53:05.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034873289999999999 2024-04-25T22:53:05.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:05.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024014+0000", 2024-04-25T22:53:05.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031473999999999999 2024-04-25T22:53:05.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:05.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024071+0000", 2024-04-25T22:53:05.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7040000000000003e-05 2024-04-25T22:53:05.133 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:05.133 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:05.133 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:05.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.133 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:05.133 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:05.133 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 72.014505502000006, 2024-04-25T22:53:05.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012329677000000001, 2024-04-25T22:53:05.133 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:05.133 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:05.133 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:05.133 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:05.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:05.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:05.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:05.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:05.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:05.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:05.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:05.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013269+0000", 2024-04-25T22:53:05.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5000000000000002e-07 2024-04-25T22:53:05.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:05.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:05.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6909999999999999e-06 2024-04-25T22:53:05.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:05.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013284+0000", 2024-04-25T22:53:05.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0963e-05 2024-04-25T22:53:05.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:05.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013361+0000", 2024-04-25T22:53:05.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7379999999999994e-05 2024-04-25T22:53:05.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:05.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013448+0000", 2024-04-25T22:53:05.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6990000000000006e-05 2024-04-25T22:53:05.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:05.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013632+0000", 2024-04-25T22:53:05.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018396800000000001 2024-04-25T22:53:05.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:05.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013800+0000", 2024-04-25T22:53:05.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167467 2024-04-25T22:53:05.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:05.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.018570+0000", 2024-04-25T22:53:05.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047701460000000003 2024-04-25T22:53:05.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:05.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025507+0000", 2024-04-25T22:53:05.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069372039999999998 2024-04-25T22:53:05.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:05.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025562+0000", 2024-04-25T22:53:05.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4858999999999998e-05 2024-04-25T22:53:05.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:05.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025598+0000", 2024-04-25T22:53:05.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6259e-05 2024-04-25T22:53:05.138 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:05.138 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:05.138 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:05.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.138 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:05.138 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:05.138 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 72.014373629000005, 2024-04-25T22:53:05.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020176666999999999, 2024-04-25T22:53:05.139 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:05.139 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:05.139 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:53:05.139 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:05.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.139 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:05.139 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:05.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:05.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.139 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:05.139 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:05.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:05.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:05.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:05.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-04-25T22:53:05.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:05.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013405+0000", 2024-04-25T22:53:05.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0559999999999998e-06 2024-04-25T22:53:05.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:05.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013422+0000", 2024-04-25T22:53:05.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6770999999999999e-05 2024-04-25T22:53:05.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:05.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013431+0000", 2024-04-25T22:53:05.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5019999999999998e-06 2024-04-25T22:53:05.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:05.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021720+0000", 2024-04-25T22:53:05.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082884340000000008 2024-04-25T22:53:05.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:05.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022122+0000", 2024-04-25T22:53:05.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000401634 2024-04-25T22:53:05.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:05.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:05.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:05.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033577+0000", 2024-04-25T22:53:05.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011455435999999999 2024-04-25T22:53:05.142 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:05.142 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:05.142 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:05.142 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:05.142 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:05.142 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:05.144 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:05.144 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:05.143+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:05.201 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-25T22:53:05.244 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:05.243+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:05.248 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:05.248 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:05.248 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-25T22:53:05.249 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:05.257 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:05.345 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:05.344+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:05.399 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:05.399 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:05.399 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-25T22:53:05.399 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-25T22:53:05.399 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:05.408 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:05.446 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:05.446+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:05.547 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:05.546+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:05.551 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:05.551 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:53:05.551 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:53:05.551 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:53:05.551 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.551 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:53:05.552 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:05.552 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 77.582825150000005, 2024-04-25T22:53:05.552 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:53:05.552 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:05.552 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:05.552 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:05.552 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:05.552 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.552 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:05.552 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:05.552 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:05.552 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.552 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.553 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:05.553 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:05.553 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:05.553 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.553 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.553 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:05.553 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:53:05.553 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:53:05.553 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.553 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.553 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:05.553 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:53:05.553 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:53:05.553 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.554 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.554 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:05.554 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:53:05.554 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:53:05.554 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.554 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.554 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:05.554 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:53:05.554 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:53:05.554 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.554 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.554 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:05.554 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:53:05.554 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:53:05.555 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.555 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.555 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:05.555 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:53:05.555 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:53:05.555 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.555 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.555 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:05.555 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:53:05.555 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:53:05.555 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.555 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.555 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:05.556 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:53:05.556 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:53:05.556 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:05.556 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:05.556 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:05.556 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.556 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.556 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:110 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'72, mlcod=10'68)", 2024-04-25T22:53:05.556 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:05.556 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 77.58219115, 2024-04-25T22:53:05.556 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065316630000000001, 2024-04-25T22:53:05.556 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:05.556 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:05.556 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:05.556 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:05.557 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.557 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:05.557 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:05.557 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:05.557 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.557 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.557 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:05.557 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:05.557 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:05.557 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.557 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.557 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:05.557 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:05.557 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.58e-07 2024-04-25T22:53:05.558 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.558 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.558 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:05.558 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967811+0000", 2024-04-25T22:53:05.558 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.118e-06 2024-04-25T22:53:05.558 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.558 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.558 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:05.558 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967817+0000", 2024-04-25T22:53:05.558 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3709999999999996e-06 2024-04-25T22:53:05.558 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.558 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.558 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:05.559 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967820+0000", 2024-04-25T22:53:05.559 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2210000000000002e-06 2024-04-25T22:53:05.559 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.559 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.559 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:05.559 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967876+0000", 2024-04-25T22:53:05.559 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5507000000000002e-05 2024-04-25T22:53:05.559 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.559 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.559 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:05.559 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967893+0000", 2024-04-25T22:53:05.559 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7812000000000002e-05 2024-04-25T22:53:05.559 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.559 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.560 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:05.560 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974317+0000", 2024-04-25T22:53:05.560 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064237160000000003 2024-04-25T22:53:05.560 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.560 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.560 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:05.560 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:53:05.560 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.156e-05 2024-04-25T22:53:05.560 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:05.560 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:05.560 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:05.560 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.560 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.560 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'68)", 2024-04-25T22:53:05.561 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:05.561 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 77.581773636999998, 2024-04-25T22:53:05.561 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061292279999999996, 2024-04-25T22:53:05.561 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:05.561 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:05.561 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:05.561 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:05.561 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.561 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:05.561 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:05.561 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:05.561 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.561 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.561 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:05.562 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:05.562 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:05.562 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.562 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.562 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:05.562 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:05.562 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6300000000000001e-07 2024-04-25T22:53:05.562 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.562 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.562 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:05.562 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968228+0000", 2024-04-25T22:53:05.562 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6139999999999999e-06 2024-04-25T22:53:05.562 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.563 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.563 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:05.563 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968235+0000", 2024-04-25T22:53:05.563 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7020000000000001e-06 2024-04-25T22:53:05.563 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.563 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.563 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:05.563 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968238+0000", 2024-04-25T22:53:05.563 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0010000000000002e-06 2024-04-25T22:53:05.563 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.563 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.563 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:05.563 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968297+0000", 2024-04-25T22:53:05.563 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8424999999999997e-05 2024-04-25T22:53:05.563 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.564 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.564 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:05.564 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968316+0000", 2024-04-25T22:53:05.564 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8814999999999999e-05 2024-04-25T22:53:05.564 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.564 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.564 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:05.564 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:53:05.564 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060239439999999998 2024-04-25T22:53:05.564 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.564 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.564 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:05.564 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974354+0000", 2024-04-25T22:53:05.564 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4364e-05 2024-04-25T22:53:05.565 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:05.565 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:05.565 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:05.565 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.565 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.565 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'68)", 2024-04-25T22:53:05.565 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:05.565 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 77.581336635, 2024-04-25T22:53:05.565 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005948414, 2024-04-25T22:53:05.565 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:05.565 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:05.565 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:05.565 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:05.566 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.566 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:05.566 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:05.566 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:05.566 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.566 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.566 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:05.566 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:05.566 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:05.566 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.566 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.566 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:05.566 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:05.566 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6199999999999998e-07 2024-04-25T22:53:05.567 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.567 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.567 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:05.567 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968723+0000", 2024-04-25T22:53:05.567 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1148999999999993e-05 2024-04-25T22:53:05.567 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.567 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.567 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:05.567 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968730+0000", 2024-04-25T22:53:05.567 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1749999999999999e-06 2024-04-25T22:53:05.567 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.567 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.567 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:05.567 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968734+0000", 2024-04-25T22:53:05.568 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5200000000000002e-06 2024-04-25T22:53:05.568 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.568 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.568 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:05.568 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968771+0000", 2024-04-25T22:53:05.568 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6851999999999999e-05 2024-04-25T22:53:05.568 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.568 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.568 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:05.568 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968788+0000", 2024-04-25T22:53:05.568 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7027000000000001e-05 2024-04-25T22:53:05.568 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.568 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.568 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:05.569 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974589+0000", 2024-04-25T22:53:05.569 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058013320000000002 2024-04-25T22:53:05.569 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.569 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.569 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:05.569 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974610+0000", 2024-04-25T22:53:05.569 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0897e-05 2024-04-25T22:53:05.569 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:05.569 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:05.569 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:05.569 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.569 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.569 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'68)", 2024-04-25T22:53:05.569 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:05.570 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 77.580766624999995, 2024-04-25T22:53:05.570 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053935750000000003, 2024-04-25T22:53:05.570 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:05.570 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:05.570 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:05.570 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:05.570 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.570 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:05.570 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:05.570 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:05.570 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.570 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.570 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:05.571 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:05.571 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:05.571 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.571 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.571 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:05.571 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:05.571 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.03e-07 2024-04-25T22:53:05.571 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.571 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.571 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:05.571 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969235+0000", 2024-04-25T22:53:05.571 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2399999999999999e-06 2024-04-25T22:53:05.571 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.571 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.572 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:05.572 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969242+0000", 2024-04-25T22:53:05.572 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1269999999999997e-06 2024-04-25T22:53:05.572 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.572 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.572 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:05.572 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969246+0000", 2024-04-25T22:53:05.572 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3840000000000001e-06 2024-04-25T22:53:05.572 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.572 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.572 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:05.572 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969278+0000", 2024-04-25T22:53:05.572 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1868e-05 2024-04-25T22:53:05.572 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.573 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.573 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:05.573 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969295+0000", 2024-04-25T22:53:05.573 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7530999999999999e-05 2024-04-25T22:53:05.573 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.573 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.573 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:05.573 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974611+0000", 2024-04-25T22:53:05.573 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053160789999999996 2024-04-25T22:53:05.573 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.573 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.573 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:05.573 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974625+0000", 2024-04-25T22:53:05.573 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3943e-05 2024-04-25T22:53:05.573 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:05.574 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:05.574 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:05.574 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.574 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.574 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-25T22:53:05.574 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:05.574 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 77.387170717000004, 2024-04-25T22:53:05.574 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054952610000000004, 2024-04-25T22:53:05.574 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:05.574 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:05.574 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:05.574 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:05.574 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.575 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:05.575 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:05.575 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:05.575 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.575 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.575 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:05.575 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:05.575 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:05.575 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.575 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.575 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:05.575 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:05.575 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.68e-07 2024-04-25T22:53:05.575 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.576 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.576 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:05.576 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162898+0000", 2024-04-25T22:53:05.576 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9470999999999999e-05 2024-04-25T22:53:05.576 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.576 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.576 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:05.576 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162906+0000", 2024-04-25T22:53:05.576 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1580000000000005e-06 2024-04-25T22:53:05.576 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.576 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.576 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:05.576 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162911+0000", 2024-04-25T22:53:05.576 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4779999999999999e-06 2024-04-25T22:53:05.577 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.577 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.577 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:05.577 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162952+0000", 2024-04-25T22:53:05.577 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0629e-05 2024-04-25T22:53:05.577 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.577 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.577 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:05.577 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162968+0000", 2024-04-25T22:53:05.577 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6239000000000002e-05 2024-04-25T22:53:05.577 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.577 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.577 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:05.577 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168281+0000", 2024-04-25T22:53:05.577 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053132869999999999 2024-04-25T22:53:05.578 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.578 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.578 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:05.578 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168323+0000", 2024-04-25T22:53:05.578 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1430999999999997e-05 2024-04-25T22:53:05.578 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:05.578 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:05.578 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:05.578 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.578 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.578 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-04-25T22:53:05.578 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:05.578 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 76.956693354999999, 2024-04-25T22:53:05.579 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050872510000000001, 2024-04-25T22:53:05.579 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:05.579 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:05.579 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:05.579 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:05.579 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.579 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:05.579 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:05.579 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:05.579 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.579 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.579 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:05.579 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:05.579 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:05.580 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.580 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.580 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:05.580 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:05.580 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.72e-07 2024-04-25T22:53:05.580 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.580 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.580 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:05.580 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593381+0000", 2024-04-25T22:53:05.580 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5797000000000006e-05 2024-04-25T22:53:05.580 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.580 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.580 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:05.580 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593389+0000", 2024-04-25T22:53:05.581 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8480000000000001e-06 2024-04-25T22:53:05.581 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.581 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.581 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:05.581 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593393+0000", 2024-04-25T22:53:05.581 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4819999999999996e-06 2024-04-25T22:53:05.581 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.581 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.581 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:05.581 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593435+0000", 2024-04-25T22:53:05.581 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1600000000000002e-05 2024-04-25T22:53:05.581 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.581 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.581 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:05.582 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593454+0000", 2024-04-25T22:53:05.582 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8868e-05 2024-04-25T22:53:05.582 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.582 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.582 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:05.582 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598350+0000", 2024-04-25T22:53:05.582 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004895763 2024-04-25T22:53:05.582 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.582 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.582 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:05.582 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598392+0000", 2024-04-25T22:53:05.582 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2521000000000002e-05 2024-04-25T22:53:05.582 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:05.583 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:05.583 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:05.583 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.583 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.583 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:05.583 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:05.583 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 72.538329450999996, 2024-04-25T22:53:05.583 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:53:05.583 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:05.583 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:05.583 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:05.583 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:05.583 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.583 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:05.583 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:05.584 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:05.584 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.584 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.584 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:05.584 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:05.584 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:05.584 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.584 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.584 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:05.584 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:53:05.584 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:53:05.584 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.584 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.584 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:05.585 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:53:05.585 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:53:05.585 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.585 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.585 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:05.585 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:53:05.585 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:53:05.585 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.585 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.585 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:05.585 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:53:05.585 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:53:05.585 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.585 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.586 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:05.586 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:53:05.586 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:53:05.586 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.586 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.586 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:05.586 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:53:05.586 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:53:05.586 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.586 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.586 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:05.586 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:53:05.586 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:53:05.586 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.587 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.587 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:05.587 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:53:05.587 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:53:05.587 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.587 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.587 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:05.587 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:53:05.587 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:53:05.587 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.587 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.587 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:05.587 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:53:05.587 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:53:05.588 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.588 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.588 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:05.588 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:53:05.588 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:53:05.588 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:05.588 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:05.588 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:05.588 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.588 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.588 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:05.588 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:05.588 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 72.537655075000004, 2024-04-25T22:53:05.588 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:53:05.589 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:05.589 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:05.589 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:05.589 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:05.589 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.589 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:05.589 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:05.589 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:05.589 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.589 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.589 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:05.589 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:05.589 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:05.589 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.590 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.590 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:05.590 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:53:05.590 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:53:05.590 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.590 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.590 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:05.590 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:53:05.590 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:53:05.590 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.590 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.590 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:05.590 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:53:05.590 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:53:05.591 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.591 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.591 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:05.591 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:53:05.591 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:53:05.591 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.591 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.591 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:05.591 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:53:05.591 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:53:05.591 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.591 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.591 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:05.591 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:53:05.592 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:53:05.592 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.592 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.592 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:05.592 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:53:05.592 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:53:05.592 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.592 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.592 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:05.592 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:53:05.592 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:53:05.592 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.592 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.593 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:05.593 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:53:05.593 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:53:05.593 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.593 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.593 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:05.593 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:53:05.593 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:53:05.593 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.593 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.593 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:05.593 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:53:05.593 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:53:05.593 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:05.594 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:05.594 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:05.594 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.594 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.594 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:05.594 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:05.594 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 72.537145863000006, 2024-04-25T22:53:05.594 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:53:05.594 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:05.594 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:05.594 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:05.594 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:05.595 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.595 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:05.595 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:05.595 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:05.595 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.595 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.595 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:05.595 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:05.595 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:05.595 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.595 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.595 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:05.595 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:53:05.595 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:53:05.596 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.596 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.596 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:05.596 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:53:05.596 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:53:05.596 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.596 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.596 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:05.596 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:53:05.596 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:53:05.596 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.596 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.596 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:05.596 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:53:05.597 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:53:05.597 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.597 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.597 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:05.597 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:53:05.597 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:53:05.597 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.597 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.597 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:05.597 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:53:05.597 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:53:05.597 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.597 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.597 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:05.597 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:53:05.598 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:53:05.598 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.598 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.598 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:05.598 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:53:05.598 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:53:05.598 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.598 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.598 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:05.598 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:53:05.598 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:53:05.598 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.598 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.599 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:05.599 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:53:05.599 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:53:05.599 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.599 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.599 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:05.599 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:53:05.599 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:53:05.599 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:05.599 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:05.599 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:05.599 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.599 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.599 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:05.600 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:05.600 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 72.536732665000002, 2024-04-25T22:53:05.600 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:53:05.600 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:05.600 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:05.600 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:05.600 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:05.600 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.600 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:05.600 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:05.600 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:05.600 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.600 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.600 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:05.601 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:05.601 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:05.601 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.601 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.601 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:05.601 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:05.601 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:53:05.601 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.601 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.601 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:05.601 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:05.601 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:53:05.601 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.601 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.602 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:05.602 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:53:05.602 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:53:05.602 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.602 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.602 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:05.602 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:53:05.602 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:53:05.602 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.602 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.602 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:05.602 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:53:05.602 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:53:05.603 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.603 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.603 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:05.603 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:53:05.603 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:53:05.603 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.603 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.603 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:05.603 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:53:05.603 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:53:05.603 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.603 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.603 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:05.603 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:53:05.604 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:53:05.604 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.604 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.604 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:05.604 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:53:05.604 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:53:05.604 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.604 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.604 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:05.604 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:53:05.604 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:53:05.604 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.604 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.604 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:05.605 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:53:05.605 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:53:05.605 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:05.605 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:05.605 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:05.605 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.605 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.605 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:05.605 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:05.605 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 72.536681994999995, 2024-04-25T22:53:05.605 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:53:05.605 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:05.605 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:05.606 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:05.606 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:05.606 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.606 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:05.606 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:05.606 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:05.606 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.606 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.606 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:05.606 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:05.606 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:05.606 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.606 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.606 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:05.607 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:53:05.607 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:53:05.607 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.607 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.607 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:05.607 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:53:05.607 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:53:05.607 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.607 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.607 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:05.607 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:53:05.607 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:53:05.607 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.608 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.608 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:05.608 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:53:05.608 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:53:05.608 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.608 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.608 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:05.608 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:53:05.608 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:53:05.608 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.608 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.608 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:05.609 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:53:05.609 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:53:05.609 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.609 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.609 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:05.609 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:53:05.609 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:53:05.609 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.609 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.609 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:05.609 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:53:05.609 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:53:05.609 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.610 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.610 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:05.610 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:53:05.610 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:53:05.610 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.610 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.610 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:05.610 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:53:05.610 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:53:05.610 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.610 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.610 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:05.610 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:53:05.611 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:53:05.611 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.611 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.611 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:05.611 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:53:05.611 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:53:05.611 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.611 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.611 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:05.611 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:53:05.611 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:53:05.611 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:05.611 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:05.611 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:05.611 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.612 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.612 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:05.612 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:05.612 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 72.536645125999996, 2024-04-25T22:53:05.612 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:53:05.612 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:05.612 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:05.612 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:05.612 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:05.612 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.612 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:05.612 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:05.612 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:05.612 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.612 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.613 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:05.613 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:05.613 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:05.613 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.613 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.613 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:05.613 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:53:05.613 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:53:05.613 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.613 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.613 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:05.613 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:53:05.613 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:53:05.614 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.614 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.614 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:05.614 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:53:05.614 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:53:05.614 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.614 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.614 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:05.614 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:53:05.614 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:53:05.614 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.614 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.614 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:05.614 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:53:05.615 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:53:05.615 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.615 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.615 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:53:05.615 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:53:05.615 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:53:05.615 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.615 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.615 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:05.615 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:53:05.615 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:53:05.615 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.615 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.615 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:05.616 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:53:05.616 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:53:05.616 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.616 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.616 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:05.616 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:53:05.616 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:53:05.616 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.616 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.616 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:05.616 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:53:05.616 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:53:05.616 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.616 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.617 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:05.617 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:53:05.617 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:53:05.617 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.617 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.617 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:05.617 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:53:05.617 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:53:05.617 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.617 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.617 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:05.617 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:53:05.617 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:53:05.617 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:05.618 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:05.618 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:05.618 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.618 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.618 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:05.618 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:05.618 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 72.536620159999998, 2024-04-25T22:53:05.618 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:53:05.618 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:05.618 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:05.618 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:05.618 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:05.618 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.618 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:05.619 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:05.619 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:05.619 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.619 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.619 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:05.619 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:05.619 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:05.619 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.619 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.619 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:05.619 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:53:05.619 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:53:05.619 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.619 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.620 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:05.620 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:53:05.620 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:53:05.620 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.620 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.620 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:05.620 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:05.620 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:53:05.620 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.620 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.620 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:05.620 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:53:05.620 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:53:05.620 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.621 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.621 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:05.621 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:53:05.621 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:53:05.621 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.621 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.621 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:05.621 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:53:05.621 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:53:05.621 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.621 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.621 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:05.621 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:53:05.621 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:53:05.622 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.622 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.622 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:05.622 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:53:05.622 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:53:05.622 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.622 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.622 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:05.622 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:53:05.622 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:53:05.622 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.622 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.622 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:05.623 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:53:05.623 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:53:05.623 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.623 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.623 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:05.623 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:53:05.623 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:53:05.623 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:05.623 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:05.623 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:05.623 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.623 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.623 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:05.623 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:05.623 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 72.536583796000002, 2024-04-25T22:53:05.623 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:53:05.624 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:05.624 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:05.624 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:05.624 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:05.624 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.624 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:05.624 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:05.624 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:05.624 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.624 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.624 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:05.624 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:05.624 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:05.625 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.625 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.625 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:05.625 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:53:05.625 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:53:05.625 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.625 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.625 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:05.625 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:53:05.625 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:53:05.625 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.625 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.625 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:05.625 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:53:05.626 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:53:05.626 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.626 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.626 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:05.626 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:53:05.626 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:53:05.626 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.626 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.626 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:05.626 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:53:05.626 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:53:05.626 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.626 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.627 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:05.627 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:53:05.627 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:53:05.627 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.627 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.627 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:05.627 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:53:05.627 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:53:05.627 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.627 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.627 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:05.627 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:53:05.627 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:53:05.627 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.627 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.628 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:05.628 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:53:05.628 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:53:05.628 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:05.628 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:05.628 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:05.628 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.628 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.628 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:05.628 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:05.628 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 72.536552714999999, 2024-04-25T22:53:05.628 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:53:05.628 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:05.628 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:05.629 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:05.629 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:05.629 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.629 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:05.629 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:05.629 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:05.629 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.629 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.629 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:05.629 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:05.629 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:05.629 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.629 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.629 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:05.629 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:05.630 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:05.630 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.630 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.630 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:05.630 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:53:05.630 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:53:05.630 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.630 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.630 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:05.630 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:53:05.630 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:53:05.630 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.630 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.631 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:05.631 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:53:05.631 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:53:05.631 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.631 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.631 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:05.631 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:53:05.631 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:53:05.631 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.631 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.631 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:05.631 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:53:05.631 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:53:05.632 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.632 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.632 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:05.632 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:53:05.632 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:53:05.632 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:05.632 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:05.632 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:05.632 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.632 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.632 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:53:05.632 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:05.632 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 72.536111746000003, 2024-04-25T22:53:05.632 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064881979999999997, 2024-04-25T22:53:05.633 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:05.633 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:05.633 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:05.633 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:05.633 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.633 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:05.633 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:05.633 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:05.633 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.633 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.633 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:05.633 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:05.633 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:05.633 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.633 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.634 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:05.634 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:05.634 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2699999999999999e-07 2024-04-25T22:53:05.634 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.634 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.634 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:05.634 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013898+0000", 2024-04-25T22:53:05.634 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0796e-05 2024-04-25T22:53:05.634 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.634 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.634 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:05.634 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013907+0000", 2024-04-25T22:53:05.634 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5140000000000007e-06 2024-04-25T22:53:05.634 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.635 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.635 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:05.635 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013952+0000", 2024-04-25T22:53:05.635 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4134000000000001e-05 2024-04-25T22:53:05.635 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.635 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.635 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:05.635 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016812+0000", 2024-04-25T22:53:05.635 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028601059999999998 2024-04-25T22:53:05.635 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.635 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.635 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:05.635 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.017052+0000", 2024-04-25T22:53:05.635 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024056500000000001 2024-04-25T22:53:05.635 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.636 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.636 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:05.636 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020350+0000", 2024-04-25T22:53:05.636 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032978320000000001 2024-04-25T22:53:05.636 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.636 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.636 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:05.636 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020375+0000", 2024-04-25T22:53:05.636 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4624e-05 2024-04-25T22:53:05.636 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:05.636 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:05.636 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:05.636 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.636 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.636 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-25T22:53:05.637 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:05.637 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 72.522581299999999, 2024-04-25T22:53:05.637 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058583000000000003, 2024-04-25T22:53:05.637 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:05.637 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:05.637 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:05.637 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:05.637 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.637 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:05.637 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:05.637 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:05.637 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.637 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.637 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:05.637 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:05.637 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:05.638 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.638 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.638 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:05.638 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:05.638 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.41e-07 2024-04-25T22:53:05.638 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.638 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.638 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:05.638 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027428+0000", 2024-04-25T22:53:05.638 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.075e-05 2024-04-25T22:53:05.638 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.638 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.638 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:05.638 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027435+0000", 2024-04-25T22:53:05.639 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3610000000000003e-06 2024-04-25T22:53:05.639 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.639 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.639 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:05.639 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027442+0000", 2024-04-25T22:53:05.639 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0400000000000004e-06 2024-04-25T22:53:05.639 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.639 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.639 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:05.639 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028094+0000", 2024-04-25T22:53:05.639 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00065134800000000005 2024-04-25T22:53:05.639 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.639 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.639 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:05.639 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028107+0000", 2024-04-25T22:53:05.640 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3087e-05 2024-04-25T22:53:05.640 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.640 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.640 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:05.640 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033239+0000", 2024-04-25T22:53:05.640 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051319429999999999 2024-04-25T22:53:05.640 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.640 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.640 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:05.640 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033275+0000", 2024-04-25T22:53:05.640 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6430000000000002e-05 2024-04-25T22:53:05.640 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:05.641 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:05.641 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:05.641 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.641 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.641 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-25T22:53:05.641 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:05.641 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 72.522196463, 2024-04-25T22:53:05.641 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005413597, 2024-04-25T22:53:05.641 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:05.641 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:05.641 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:05.641 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:05.641 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.641 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:05.641 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:05.642 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:05.642 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.642 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.642 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:05.642 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:05.642 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:05.642 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.642 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.642 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:05.642 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:05.642 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3799999999999997e-07 2024-04-25T22:53:05.642 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.642 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.643 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:05.643 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027816+0000", 2024-04-25T22:53:05.643 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3230999999999999e-05 2024-04-25T22:53:05.643 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.643 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.643 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:05.643 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027823+0000", 2024-04-25T22:53:05.643 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9039999999999992e-06 2024-04-25T22:53:05.643 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.643 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.643 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:05.643 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027841+0000", 2024-04-25T22:53:05.643 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7651000000000001e-05 2024-04-25T22:53:05.643 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.643 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.643 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:05.644 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027904+0000", 2024-04-25T22:53:05.644 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3058000000000005e-05 2024-04-25T22:53:05.644 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.644 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.644 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:05.644 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027926+0000", 2024-04-25T22:53:05.644 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1450999999999998e-05 2024-04-25T22:53:05.644 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.644 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.644 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:05.644 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033177+0000", 2024-04-25T22:53:05.644 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052508909999999997 2024-04-25T22:53:05.644 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.644 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.644 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:05.645 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033215+0000", 2024-04-25T22:53:05.645 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8872999999999999e-05 2024-04-25T22:53:05.645 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:05.645 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:05.645 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:05.645 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.645 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.645 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 171 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:53:05.645 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:05.645 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 72.522139361000001, 2024-04-25T22:53:05.645 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054322240000000003, 2024-04-25T22:53:05.645 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:05.645 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:05.645 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "reached pg", 2024-04-25T22:53:05.645 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:05.645 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.646 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:05.646 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:05.646 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:05.646 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.646 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.646 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:05.646 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:05.646 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:05.646 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.646 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.646 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:05.646 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:05.646 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7500000000000001e-07 2024-04-25T22:53:05.646 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.647 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.647 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:05.647 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027868+0000", 2024-04-25T22:53:05.647 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5750000000000001e-06 2024-04-25T22:53:05.647 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.647 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.647 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:05.647 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027885+0000", 2024-04-25T22:53:05.647 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7272e-05 2024-04-25T22:53:05.647 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.647 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.647 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:05.647 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027900+0000", 2024-04-25T22:53:05.647 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.502e-05 2024-04-25T22:53:05.647 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.647 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.648 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:05.648 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028381+0000", 2024-04-25T22:53:05.648 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00048039399999999998 2024-04-25T22:53:05.648 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:05.648 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:05.648 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:05.648 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033291+0000", 2024-04-25T22:53:05.648 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049105879999999996 2024-04-25T22:53:05.648 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:05.648 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:05.648 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:05.648 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:05.648 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:05.648 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:05.650 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:05.650 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:05.649+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:05.750 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:05.750+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:05.754 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:05.754 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:05.755 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-04-25T22:53:05.755 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:05.763 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:05.852 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:05.851+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:05.865 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:05.865 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:05.865 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:53:05.865 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:53:05.865 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:05.874 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:05.952 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:05.952+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:06.017 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:06.017 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-04-25T22:53:06.017 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-04-25T22:53:06.017 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:53:06.017 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.018 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:06.018 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:06.018 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.050603105999997, 2024-04-25T22:53:06.018 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0103421, 2024-04-25T22:53:06.018 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:06.018 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:06.018 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:06.018 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:06.018 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:06.018 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:06.018 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 115 2024-04-25T22:53:06.018 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.018 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:06.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.019 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:06.019 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:06.019 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:06.019 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.019 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.019 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:06.019 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:06.019 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:06.019 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.019 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.019 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:06.019 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:06.019 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9500000000000002e-07 2024-04-25T22:53:06.019 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.019 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.019 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:06.020 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965108+0000", 2024-04-25T22:53:06.020 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9177999999999994e-05 2024-04-25T22:53:06.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.020 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:06.020 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965127+0000", 2024-04-25T22:53:06.020 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8868e-05 2024-04-25T22:53:06.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.020 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:06.020 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965133+0000", 2024-04-25T22:53:06.020 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8929999999999999e-06 2024-04-25T22:53:06.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.021 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:06.021 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.969991+0000", 2024-04-25T22:53:06.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048573849999999997 2024-04-25T22:53:06.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.021 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:06.021 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970072+0000", 2024-04-25T22:53:06.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0728000000000004e-05 2024-04-25T22:53:06.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.021 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:06.021 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970189+0000", 2024-04-25T22:53:06.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000117778 2024-04-25T22:53:06.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.022 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:06.022 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970946+0000", 2024-04-25T22:53:06.022 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00075704600000000004 2024-04-25T22:53:06.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.022 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.022 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:06.022 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975297+0000", 2024-04-25T22:53:06.022 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004350217 2024-04-25T22:53:06.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.022 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.022 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:06.022 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975343+0000", 2024-04-25T22:53:06.023 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6687999999999998e-05 2024-04-25T22:53:06.023 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.023 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.023 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:06.023 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975380+0000", 2024-04-25T22:53:06.023 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6724000000000003e-05 2024-04-25T22:53:06.023 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:06.023 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:06.023 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:06.023 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.023 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.023 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:06.023 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:06.023 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.050497074999996, 2024-04-25T22:53:06.023 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010304384, 2024-04-25T22:53:06.024 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:06.024 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:06.024 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:06.024 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:06.024 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:06.024 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:06.024 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 116 2024-04-25T22:53:06.024 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.024 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:06.024 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.024 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:06.024 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:06.024 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:06.025 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.025 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.025 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:06.025 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:06.025 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:06.025 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.025 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.025 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:06.025 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:06.025 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5799999999999999e-07 2024-04-25T22:53:06.025 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.025 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.025 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:06.025 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965154+0000", 2024-04-25T22:53:06.025 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0009e-05 2024-04-25T22:53:06.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:06.026 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965164+0000", 2024-04-25T22:53:06.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8490000000000001e-06 2024-04-25T22:53:06.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:06.026 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965169+0000", 2024-04-25T22:53:06.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0730000000000004e-06 2024-04-25T22:53:06.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.027 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:06.027 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970609+0000", 2024-04-25T22:53:06.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054397689999999997 2024-04-25T22:53:06.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.027 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.027 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:06.027 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970651+0000", 2024-04-25T22:53:06.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1873999999999999e-05 2024-04-25T22:53:06.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.027 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.027 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:06.027 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970723+0000", 2024-04-25T22:53:06.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2039999999999995e-05 2024-04-25T22:53:06.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.028 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:06.028 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971358+0000", 2024-04-25T22:53:06.028 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063489500000000001 2024-04-25T22:53:06.028 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.028 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:06.028 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975409+0000", 2024-04-25T22:53:06.028 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040506880000000002 2024-04-25T22:53:06.028 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.028 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:06.028 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975432+0000", 2024-04-25T22:53:06.028 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3315999999999998e-05 2024-04-25T22:53:06.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.029 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.029 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:06.029 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975448+0000", 2024-04-25T22:53:06.029 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6313000000000001e-05 2024-04-25T22:53:06.029 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:06.029 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:06.029 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:06.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.029 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.029 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:06.029 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:06.029 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.050462492999998, 2024-04-25T22:53:06.030 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010384338999999999, 2024-04-25T22:53:06.030 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:06.030 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:06.030 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:06.030 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:06.030 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:06.030 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:06.030 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-04-25T22:53:06.030 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.030 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:06.030 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.030 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:06.030 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:06.031 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:06.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.031 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.031 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:06.031 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:06.031 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:06.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.031 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.031 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:06.031 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:06.031 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3600000000000004e-07 2024-04-25T22:53:06.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.032 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.032 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:06.032 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965185+0000", 2024-04-25T22:53:06.032 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.117e-06 2024-04-25T22:53:06.032 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.032 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.032 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:06.032 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965192+0000", 2024-04-25T22:53:06.032 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3239999999999997e-06 2024-04-25T22:53:06.032 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.032 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.032 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:06.032 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965198+0000", 2024-04-25T22:53:06.032 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6370000000000004e-06 2024-04-25T22:53:06.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.033 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:06.033 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970973+0000", 2024-04-25T22:53:06.033 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057748239999999996 2024-04-25T22:53:06.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.033 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:06.033 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971049+0000", 2024-04-25T22:53:06.033 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6029e-05 2024-04-25T22:53:06.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.033 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:06.034 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971174+0000", 2024-04-25T22:53:06.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012462399999999999 2024-04-25T22:53:06.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.034 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:06.034 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971553+0000", 2024-04-25T22:53:06.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037896499999999999 2024-04-25T22:53:06.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.034 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:06.034 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975482+0000", 2024-04-25T22:53:06.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039297459999999996 2024-04-25T22:53:06.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.035 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.035 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:06.035 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975529+0000", 2024-04-25T22:53:06.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6387000000000002e-05 2024-04-25T22:53:06.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.035 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.035 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:06.035 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975563+0000", 2024-04-25T22:53:06.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4150000000000003e-05 2024-04-25T22:53:06.035 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:06.035 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:06.035 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:06.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.036 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:06.037 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:06.037 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 73.003416169999994, 2024-04-25T22:53:06.037 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012637705000000001, 2024-04-25T22:53:06.037 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:06.037 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:06.037 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:06.037 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:06.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:06.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:06.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:06.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:06.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:06.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:06.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:06.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012227+0000", 2024-04-25T22:53:06.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.863e-06 2024-04-25T22:53:06.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:06.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012236+0000", 2024-04-25T22:53:06.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1109999999999997e-06 2024-04-25T22:53:06.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:06.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012309+0000", 2024-04-25T22:53:06.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3242000000000001e-05 2024-04-25T22:53:06.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:06.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012324+0000", 2024-04-25T22:53:06.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4837e-05 2024-04-25T22:53:06.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:06.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015060+0000", 2024-04-25T22:53:06.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027363349999999999 2024-04-25T22:53:06.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:06.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015169+0000", 2024-04-25T22:53:06.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108372 2024-04-25T22:53:06.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:06.041 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015498+0000", 2024-04-25T22:53:06.041 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032949999999999999 2024-04-25T22:53:06.041 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.041 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.041 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:06.041 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021282+0000", 2024-04-25T22:53:06.041 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057836429999999998 2024-04-25T22:53:06.041 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.041 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.041 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:06.041 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024709+0000", 2024-04-25T22:53:06.041 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034271979999999998 2024-04-25T22:53:06.041 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.041 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.041 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:06.042 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024802+0000", 2024-04-25T22:53:06.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2960000000000004e-05 2024-04-25T22:53:06.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.042 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:06.042 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024863+0000", 2024-04-25T22:53:06.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0643999999999997e-05 2024-04-25T22:53:06.042 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:06.042 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:06.042 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:06.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.042 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:06.042 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:06.043 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 73.003292399000003, 2024-04-25T22:53:06.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012979447999999999, 2024-04-25T22:53:06.043 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:06.043 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:06.043 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:06.043 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:06.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.043 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:06.043 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:06.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:06.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.043 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:06.043 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:06.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:06.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.044 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.044 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:06.044 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:06.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:53:06.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.044 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.044 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:06.044 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012354+0000", 2024-04-25T22:53:06.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7740000000000004e-06 2024-04-25T22:53:06.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.044 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.044 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:06.044 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012365+0000", 2024-04-25T22:53:06.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.064e-05 2024-04-25T22:53:06.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:06.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012382+0000", 2024-04-25T22:53:06.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6999000000000001e-05 2024-04-25T22:53:06.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:06.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015958+0000", 2024-04-25T22:53:06.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035765699999999998 2024-04-25T22:53:06.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:06.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016037+0000", 2024-04-25T22:53:06.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8242000000000001e-05 2024-04-25T22:53:06.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.046 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:06.046 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016404+0000", 2024-04-25T22:53:06.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036784300000000002 2024-04-25T22:53:06.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.046 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:06.046 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021294+0000", 2024-04-25T22:53:06.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048890629999999999 2024-04-25T22:53:06.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.046 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:06.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024959+0000", 2024-04-25T22:53:06.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036651570000000001 2024-04-25T22:53:06.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:06.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025097+0000", 2024-04-25T22:53:06.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013788099999999999 2024-04-25T22:53:06.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:06.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025328+0000", 2024-04-25T22:53:06.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231492 2024-04-25T22:53:06.047 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:06.047 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:06.047 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:06.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.048 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:06.048 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:06.048 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 73.003204629999999, 2024-04-25T22:53:06.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013049827, 2024-04-25T22:53:06.048 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:06.048 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:06.048 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:06.048 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:06.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.048 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:06.048 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:06.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:06.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:06.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:06.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:06.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:06.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012437+0000", 2024-04-25T22:53:06.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-04-25T22:53:06.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:06.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012440+0000", 2024-04-25T22:53:06.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7609999999999999e-06 2024-04-25T22:53:06.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:06.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012449+0000", 2024-04-25T22:53:06.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.285e-06 2024-04-25T22:53:06.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:06.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012457+0000", 2024-04-25T22:53:06.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9510000000000006e-06 2024-04-25T22:53:06.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:06.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017106+0000", 2024-04-25T22:53:06.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046494220000000003 2024-04-25T22:53:06.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:06.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017223+0000", 2024-04-25T22:53:06.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116824 2024-04-25T22:53:06.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:06.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017345+0000", 2024-04-25T22:53:06.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122175 2024-04-25T22:53:06.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:06.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021299+0000", 2024-04-25T22:53:06.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039534879999999998 2024-04-25T22:53:06.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:06.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025398+0000", 2024-04-25T22:53:06.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040988960000000003 2024-04-25T22:53:06.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:06.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025439+0000", 2024-04-25T22:53:06.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0915999999999999e-05 2024-04-25T22:53:06.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:06.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025486+0000", 2024-04-25T22:53:06.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7534999999999998e-05 2024-04-25T22:53:06.053 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:06.053 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:06.053 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:06.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.053 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:06.053 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:06.053 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 73.003174478999995, 2024-04-25T22:53:06.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020988041999999998, 2024-04-25T22:53:06.053 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:06.053 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:06.053 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:06.053 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:06.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:06.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:06.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:06.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:06.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:06.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:06.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:06.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:06.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.99e-07 2024-04-25T22:53:06.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.055 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:06.055 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012470+0000", 2024-04-25T22:53:06.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2789999999999999e-06 2024-04-25T22:53:06.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.055 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:06.055 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012477+0000", 2024-04-25T22:53:06.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:53:06.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:06.056 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012500+0000", 2024-04-25T22:53:06.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2490999999999999e-05 2024-04-25T22:53:06.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:06.056 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021911+0000", 2024-04-25T22:53:06.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094114160000000006 2024-04-25T22:53:06.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:06.056 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022000+0000", 2024-04-25T22:53:06.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8601000000000001e-05 2024-04-25T22:53:06.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.057 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:06.057 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022359+0000", 2024-04-25T22:53:06.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035921999999999999 2024-04-25T22:53:06.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.057 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:06.057 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025541+0000", 2024-04-25T22:53:06.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031820619999999998 2024-04-25T22:53:06.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.057 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:06.057 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033375+0000", 2024-04-25T22:53:06.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078338379999999992 2024-04-25T22:53:06.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:06.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033415+0000", 2024-04-25T22:53:06.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9527000000000003e-05 2024-04-25T22:53:06.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:06.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033455+0000", 2024-04-25T22:53:06.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9932000000000003e-05 2024-04-25T22:53:06.058 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:06.058 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:06.059 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:06.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.059 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:06.059 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:06.059 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 73.003119286, 2024-04-25T22:53:06.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021043857999999999, 2024-04-25T22:53:06.059 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:06.059 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:06.059 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:06.059 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:06.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:06.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:06.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:06.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:06.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:06.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:06.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:06.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012523+0000", 2024-04-25T22:53:06.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.361e-06 2024-04-25T22:53:06.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:06.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012530+0000", 2024-04-25T22:53:06.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5440000000000004e-06 2024-04-25T22:53:06.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:06.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012541+0000", 2024-04-25T22:53:06.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1745e-05 2024-04-25T22:53:06.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:06.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012551+0000", 2024-04-25T22:53:06.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5789999999999993e-06 2024-04-25T22:53:06.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:06.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022709+0000", 2024-04-25T22:53:06.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010157685 2024-04-25T22:53:06.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:06.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022957+0000", 2024-04-25T22:53:06.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024824599999999998 2024-04-25T22:53:06.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:06.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023443+0000", 2024-04-25T22:53:06.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048578599999999999 2024-04-25T22:53:06.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:06.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025547+0000", 2024-04-25T22:53:06.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021044789999999998 2024-04-25T22:53:06.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:06.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033509+0000", 2024-04-25T22:53:06.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0079622180000000001 2024-04-25T22:53:06.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.064 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:06.064 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033542+0000", 2024-04-25T22:53:06.064 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3018000000000001e-05 2024-04-25T22:53:06.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.064 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:06.064 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033566+0000", 2024-04-25T22:53:06.064 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3197000000000002e-05 2024-04-25T22:53:06.064 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:06.064 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:06.064 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:06.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.064 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:06.064 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:06.065 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 73.003079321000001, 2024-04-25T22:53:06.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021122696, 2024-04-25T22:53:06.065 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:06.065 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:06.065 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:06.065 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:06.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:06.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:06.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:06.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:06.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:06.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:06.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:06.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:06.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:53:06.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:06.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012566+0000", 2024-04-25T22:53:06.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-04-25T22:53:06.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:06.067 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012619+0000", 2024-04-25T22:53:06.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2607e-05 2024-04-25T22:53:06.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.067 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:06.067 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012628+0000", 2024-04-25T22:53:06.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6500000000000008e-06 2024-04-25T22:53:06.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.067 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:06.067 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024024+0000", 2024-04-25T22:53:06.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011396007999999999 2024-04-25T22:53:06.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.068 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:06.068 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024198+0000", 2024-04-25T22:53:06.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000173215 2024-04-25T22:53:06.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.068 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:06.068 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024447+0000", 2024-04-25T22:53:06.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024898500000000002 2024-04-25T22:53:06.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.068 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:06.068 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026431+0000", 2024-04-25T22:53:06.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001984923 2024-04-25T22:53:06.069 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:06.069 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033608+0000", 2024-04-25T22:53:06.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071768459999999997 2024-04-25T22:53:06.069 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:06.069 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033646+0000", 2024-04-25T22:53:06.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299000000000003e-05 2024-04-25T22:53:06.069 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:06.069 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033684+0000", 2024-04-25T22:53:06.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8773000000000003e-05 2024-04-25T22:53:06.070 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:06.070 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:06.070 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:06.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.070 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:06.070 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:06.070 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 73.002990722000007, 2024-04-25T22:53:06.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021175381, 2024-04-25T22:53:06.070 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:06.070 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:06.070 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:06.071 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:06.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:06.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:06.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:06.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:06.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:06.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:06.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:06.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012651+0000", 2024-04-25T22:53:06.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:53:06.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:06.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012656+0000", 2024-04-25T22:53:06.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8899999999999998e-06 2024-04-25T22:53:06.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:06.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012666+0000", 2024-04-25T22:53:06.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0346999999999999e-05 2024-04-25T22:53:06.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:06.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012675+0000", 2024-04-25T22:53:06.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9930000000000001e-06 2024-04-25T22:53:06.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:06.073 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025661+0000", 2024-04-25T22:53:06.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01298531 2024-04-25T22:53:06.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:06.073 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025757+0000", 2024-04-25T22:53:06.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5822000000000005e-05 2024-04-25T22:53:06.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:06.073 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025907+0000", 2024-04-25T22:53:06.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015051499999999999 2024-04-25T22:53:06.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.074 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:06.074 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026435+0000", 2024-04-25T22:53:06.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052762200000000005 2024-04-25T22:53:06.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.074 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:06.074 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033732+0000", 2024-04-25T22:53:06.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072978419999999997 2024-04-25T22:53:06.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:06.075 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033787+0000", 2024-04-25T22:53:06.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4703999999999997e-05 2024-04-25T22:53:06.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:06.075 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033826+0000", 2024-04-25T22:53:06.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8458999999999999e-05 2024-04-25T22:53:06.075 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:06.075 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:06.075 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:06.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.076 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:06.076 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:06.076 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 73.002935308000005, 2024-04-25T22:53:06.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021244174000000001, 2024-04-25T22:53:06.076 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:06.076 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:06.076 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:06.076 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:06.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.076 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:06.076 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:06.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:06.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.077 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:06.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:06.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:06.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.077 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:06.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:06.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:06.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.077 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:06.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012712+0000", 2024-04-25T22:53:06.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.913e-06 2024-04-25T22:53:06.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:06.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012722+0000", 2024-04-25T22:53:06.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2879999999999998e-06 2024-04-25T22:53:06.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:06.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012727+0000", 2024-04-25T22:53:06.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8429999999999998e-06 2024-04-25T22:53:06.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:06.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026099+0000", 2024-04-25T22:53:06.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013371450999999999 2024-04-25T22:53:06.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:06.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026147+0000", 2024-04-25T22:53:06.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7837999999999998e-05 2024-04-25T22:53:06.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:06.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026254+0000", 2024-04-25T22:53:06.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107314 2024-04-25T22:53:06.080 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.080 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.080 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:06.080 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026686+0000", 2024-04-25T22:53:06.080 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000432428 2024-04-25T22:53:06.080 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.080 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.080 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:06.080 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033873+0000", 2024-04-25T22:53:06.080 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071864399999999997 2024-04-25T22:53:06.080 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.080 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.080 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:06.080 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033904+0000", 2024-04-25T22:53:06.081 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1321e-05 2024-04-25T22:53:06.081 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.081 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.081 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:06.081 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033950+0000", 2024-04-25T22:53:06.081 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5707999999999997e-05 2024-04-25T22:53:06.081 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:06.081 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:06.081 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:06.081 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.081 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.081 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:06.081 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:06.081 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 73.002904923000003, 2024-04-25T22:53:06.081 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01096505, 2024-04-25T22:53:06.082 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:06.082 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:06.082 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:06.082 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:06.082 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.082 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:06.082 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:06.082 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:06.082 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.082 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.082 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:06.082 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:06.083 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:06.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.083 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.083 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:06.083 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012737+0000", 2024-04-25T22:53:06.083 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:06.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.083 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.083 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:06.083 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012739+0000", 2024-04-25T22:53:06.083 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-04-25T22:53:06.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.083 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.083 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:06.084 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012743+0000", 2024-04-25T22:53:06.084 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3239999999999996e-06 2024-04-25T22:53:06.084 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.084 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:06.084 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012746+0000", 2024-04-25T22:53:06.084 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.129e-06 2024-04-25T22:53:06.084 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.084 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:06.084 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012796+0000", 2024-04-25T22:53:06.084 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9231999999999999e-05 2024-04-25T22:53:06.084 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.085 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:06.085 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012915+0000", 2024-04-25T22:53:06.085 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119021 2024-04-25T22:53:06.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.085 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.085 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:06.085 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013069+0000", 2024-04-25T22:53:06.085 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015463900000000001 2024-04-25T22:53:06.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.085 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.085 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:06.085 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019237+0000", 2024-04-25T22:53:06.085 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061680329999999998 2024-04-25T22:53:06.086 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.086 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.086 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:06.086 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023603+0000", 2024-04-25T22:53:06.086 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043655860000000003 2024-04-25T22:53:06.086 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.086 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.086 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:06.086 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023659+0000", 2024-04-25T22:53:06.086 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6484000000000003e-05 2024-04-25T22:53:06.086 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.086 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.086 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:06.086 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023701+0000", 2024-04-25T22:53:06.087 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1761999999999998e-05 2024-04-25T22:53:06.087 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:06.087 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:06.087 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:06.087 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.087 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.087 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:06.087 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:06.087 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 73.002879974999999, 2024-04-25T22:53:06.087 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011234429000000001, 2024-04-25T22:53:06.087 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:06.087 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:06.087 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:06.087 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:06.088 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.088 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:06.088 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:06.088 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:06.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.088 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.088 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:06.088 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:06.088 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:06.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.088 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.088 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:06.088 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012762+0000", 2024-04-25T22:53:06.088 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-04-25T22:53:06.089 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.089 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.089 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:06.089 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012765+0000", 2024-04-25T22:53:06.089 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2569999999999999e-06 2024-04-25T22:53:06.089 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.089 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.089 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:06.089 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012783+0000", 2024-04-25T22:53:06.089 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8431999999999999e-05 2024-04-25T22:53:06.089 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.089 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.089 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:06.089 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012799+0000", 2024-04-25T22:53:06.090 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5438999999999999e-05 2024-04-25T22:53:06.090 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.090 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.090 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:06.090 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013826+0000", 2024-04-25T22:53:06.090 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010275060000000001 2024-04-25T22:53:06.090 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.090 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.090 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:06.090 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013913+0000", 2024-04-25T22:53:06.090 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.708e-05 2024-04-25T22:53:06.090 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.090 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.090 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:06.091 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014098+0000", 2024-04-25T22:53:06.091 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018519399999999999 2024-04-25T22:53:06.091 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.091 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.091 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:06.091 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019684+0000", 2024-04-25T22:53:06.091 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055860079999999999 2024-04-25T22:53:06.091 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.091 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.091 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:06.091 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023876+0000", 2024-04-25T22:53:06.091 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041918800000000003 2024-04-25T22:53:06.091 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.092 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.092 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:06.092 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023957+0000", 2024-04-25T22:53:06.092 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1165e-05 2024-04-25T22:53:06.092 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.092 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.092 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:06.092 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023995+0000", 2024-04-25T22:53:06.092 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:53:06.092 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:06.092 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:06.092 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:06.092 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.092 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.093 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:06.093 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:06.093 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 73.002782195999998, 2024-04-25T22:53:06.093 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011131200000000001, 2024-04-25T22:53:06.093 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:06.093 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:06.093 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:06.093 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:06.093 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.093 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:06.093 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:06.093 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:06.093 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.094 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.094 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:06.094 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:06.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:06.094 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.094 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.094 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:06.094 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012860+0000", 2024-04-25T22:53:06.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3900000000000004e-07 2024-04-25T22:53:06.094 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.094 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.094 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:06.094 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012865+0000", 2024-04-25T22:53:06.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5609999999999998e-06 2024-04-25T22:53:06.095 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.095 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.095 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:06.095 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012895+0000", 2024-04-25T22:53:06.095 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9847000000000001e-05 2024-04-25T22:53:06.095 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.095 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.095 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:06.095 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012905+0000", 2024-04-25T22:53:06.095 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.03e-05 2024-04-25T22:53:06.095 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.095 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.095 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:06.095 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015020+0000", 2024-04-25T22:53:06.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021142940000000001 2024-04-25T22:53:06.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.096 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:06.096 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015182+0000", 2024-04-25T22:53:06.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016248099999999999 2024-04-25T22:53:06.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.096 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:06.096 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015357+0000", 2024-04-25T22:53:06.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017471000000000001 2024-04-25T22:53:06.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.096 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:06.096 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021021+0000", 2024-04-25T22:53:06.097 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056638340000000004 2024-04-25T22:53:06.097 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.097 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:06.097 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023712+0000", 2024-04-25T22:53:06.097 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026910380000000002 2024-04-25T22:53:06.097 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.097 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:06.097 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023763+0000", 2024-04-25T22:53:06.097 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1477999999999997e-05 2024-04-25T22:53:06.097 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.097 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:06.098 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023990+0000", 2024-04-25T22:53:06.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000226818 2024-04-25T22:53:06.098 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:06.098 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:06.098 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:06.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.098 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:06.098 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:06.098 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 73.002659100000002, 2024-04-25T22:53:06.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011705299000000001, 2024-04-25T22:53:06.098 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:06.098 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:06.099 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:06.099 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:06.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.099 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:06.099 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:06.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:06.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.099 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:06.099 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:06.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:06.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.099 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:06.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012983+0000", 2024-04-25T22:53:06.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:53:06.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.100 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:06.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012986+0000", 2024-04-25T22:53:06.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5700000000000001e-06 2024-04-25T22:53:06.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.100 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:06.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012993+0000", 2024-04-25T22:53:06.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8730000000000001e-06 2024-04-25T22:53:06.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:06.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013000+0000", 2024-04-25T22:53:06.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1890000000000001e-06 2024-04-25T22:53:06.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:06.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:53:06.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002147866 2024-04-25T22:53:06.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:06.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015351+0000", 2024-04-25T22:53:06.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020300799999999999 2024-04-25T22:53:06.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:06.102 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016260+0000", 2024-04-25T22:53:06.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00090926799999999997 2024-04-25T22:53:06.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:06.102 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022669+0000", 2024-04-25T22:53:06.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064082849999999997 2024-04-25T22:53:06.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:06.102 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024584+0000", 2024-04-25T22:53:06.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019151699999999999 2024-04-25T22:53:06.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.103 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:06.103 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024643+0000", 2024-04-25T22:53:06.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8888999999999998e-05 2024-04-25T22:53:06.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.103 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:06.103 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024687+0000", 2024-04-25T22:53:06.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4444999999999999e-05 2024-04-25T22:53:06.103 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:06.103 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:06.103 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:06.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.104 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:06.104 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:06.104 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 73.002631508999997, 2024-04-25T22:53:06.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011249699, 2024-04-25T22:53:06.104 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:06.104 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:06.104 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:06.104 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:06.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.104 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:06.104 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:06.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:06.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:06.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:06.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:06.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:06.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013010+0000", 2024-04-25T22:53:06.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2099999999999996e-07 2024-04-25T22:53:06.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:06.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013013+0000", 2024-04-25T22:53:06.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1310000000000002e-06 2024-04-25T22:53:06.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:06.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013020+0000", 2024-04-25T22:53:06.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3330000000000002e-06 2024-04-25T22:53:06.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:06.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013025+0000", 2024-04-25T22:53:06.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6760000000000004e-06 2024-04-25T22:53:06.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:06.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013163+0000", 2024-04-25T22:53:06.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013824599999999999 2024-04-25T22:53:06.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:06.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013504+0000", 2024-04-25T22:53:06.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034080299999999998 2024-04-25T22:53:06.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:06.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013613+0000", 2024-04-25T22:53:06.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108705 2024-04-25T22:53:06.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.108 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:06.108 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015831+0000", 2024-04-25T22:53:06.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002217672 2024-04-25T22:53:06.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.108 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:06.108 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024137+0000", 2024-04-25T22:53:06.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0083060489999999994 2024-04-25T22:53:06.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.108 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:06.108 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024218+0000", 2024-04-25T22:53:06.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1351000000000001e-05 2024-04-25T22:53:06.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:06.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024259+0000", 2024-04-25T22:53:06.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1112000000000002e-05 2024-04-25T22:53:06.109 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:06.109 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:06.109 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:06.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.109 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:06.109 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:06.109 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 73.002543782999993, 2024-04-25T22:53:06.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020379749999999999, 2024-04-25T22:53:06.110 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:06.110 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:06.110 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:06.110 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:06.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:06.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:06.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:06.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:06.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:06.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:06.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.111 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:06.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013098+0000", 2024-04-25T22:53:06.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:53:06.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.111 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:06.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013105+0000", 2024-04-25T22:53:06.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5969999999999997e-06 2024-04-25T22:53:06.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.111 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:06.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013190+0000", 2024-04-25T22:53:06.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5618999999999995e-05 2024-04-25T22:53:06.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:06.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013200+0000", 2024-04-25T22:53:06.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5859999999999994e-06 2024-04-25T22:53:06.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:06.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020265+0000", 2024-04-25T22:53:06.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070653349999999998 2024-04-25T22:53:06.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:06.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020454+0000", 2024-04-25T22:53:06.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189316 2024-04-25T22:53:06.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.113 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:06.113 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020586+0000", 2024-04-25T22:53:06.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013195700000000001 2024-04-25T22:53:06.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.113 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:06.113 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023822+0000", 2024-04-25T22:53:06.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032358529999999999 2024-04-25T22:53:06.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:06.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033409+0000", 2024-04-25T22:53:06.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095870520000000004 2024-04-25T22:53:06.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:06.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033447+0000", 2024-04-25T22:53:06.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7261999999999997e-05 2024-04-25T22:53:06.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:06.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033477+0000", 2024-04-25T22:53:06.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0389e-05 2024-04-25T22:53:06.114 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:06.115 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:06.115 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:06.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.115 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:06.115 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:06.115 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 73.002427276999995, 2024-04-25T22:53:06.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010857383999999999, 2024-04-25T22:53:06.115 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:06.115 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:06.115 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:06.115 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:06.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:06.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:06.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:06.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:06.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:06.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:06.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:06.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:06.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:06.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.117 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:06.117 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013218+0000", 2024-04-25T22:53:06.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8199999999999998e-06 2024-04-25T22:53:06.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.117 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:06.117 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013226+0000", 2024-04-25T22:53:06.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7649999999999993e-06 2024-04-25T22:53:06.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.117 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:06.117 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013259+0000", 2024-04-25T22:53:06.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2727e-05 2024-04-25T22:53:06.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:06.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014809+0000", 2024-04-25T22:53:06.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001550144 2024-04-25T22:53:06.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:06.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014958+0000", 2024-04-25T22:53:06.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014890300000000001 2024-04-25T22:53:06.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:06.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015087+0000", 2024-04-25T22:53:06.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012939200000000001 2024-04-25T22:53:06.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:06.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020212+0000", 2024-04-25T22:53:06.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051248939999999996 2024-04-25T22:53:06.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:06.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023699+0000", 2024-04-25T22:53:06.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034873289999999999 2024-04-25T22:53:06.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:06.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024014+0000", 2024-04-25T22:53:06.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031473999999999999 2024-04-25T22:53:06.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:06.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024071+0000", 2024-04-25T22:53:06.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7040000000000003e-05 2024-04-25T22:53:06.120 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:06.120 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:06.120 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:06.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.120 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:06.120 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:06.120 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 73.002372571999999, 2024-04-25T22:53:06.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012329677000000001, 2024-04-25T22:53:06.121 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:06.121 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:06.121 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:06.121 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:06.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:06.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:06.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:06.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:06.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:06.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:06.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:06.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013269+0000", 2024-04-25T22:53:06.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5000000000000002e-07 2024-04-25T22:53:06.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:06.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:06.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6909999999999999e-06 2024-04-25T22:53:06.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:06.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013284+0000", 2024-04-25T22:53:06.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0963e-05 2024-04-25T22:53:06.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:06.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013361+0000", 2024-04-25T22:53:06.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7379999999999994e-05 2024-04-25T22:53:06.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:06.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013448+0000", 2024-04-25T22:53:06.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6990000000000006e-05 2024-04-25T22:53:06.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:06.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013632+0000", 2024-04-25T22:53:06.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018396800000000001 2024-04-25T22:53:06.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:06.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013800+0000", 2024-04-25T22:53:06.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167467 2024-04-25T22:53:06.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:06.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.018570+0000", 2024-04-25T22:53:06.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047701460000000003 2024-04-25T22:53:06.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:06.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025507+0000", 2024-04-25T22:53:06.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069372039999999998 2024-04-25T22:53:06.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:06.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025562+0000", 2024-04-25T22:53:06.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4858999999999998e-05 2024-04-25T22:53:06.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:06.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025598+0000", 2024-04-25T22:53:06.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6259e-05 2024-04-25T22:53:06.125 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:06.126 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:06.126 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:06.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.126 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:06.126 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:06.126 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 73.002240698999998, 2024-04-25T22:53:06.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020176666999999999, 2024-04-25T22:53:06.126 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:06.126 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:06.126 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:53:06.126 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:06.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:06.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:06.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:06.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:06.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:06.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:06.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:06.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:06.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-04-25T22:53:06.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:06.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013405+0000", 2024-04-25T22:53:06.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0559999999999998e-06 2024-04-25T22:53:06.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:06.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013422+0000", 2024-04-25T22:53:06.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6770999999999999e-05 2024-04-25T22:53:06.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:06.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013431+0000", 2024-04-25T22:53:06.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5019999999999998e-06 2024-04-25T22:53:06.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:06.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021720+0000", 2024-04-25T22:53:06.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082884340000000008 2024-04-25T22:53:06.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:06.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022122+0000", 2024-04-25T22:53:06.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000401634 2024-04-25T22:53:06.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:06.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:06.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:06.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033577+0000", 2024-04-25T22:53:06.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011455435999999999 2024-04-25T22:53:06.130 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:06.130 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:06.130 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:06.130 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:06.130 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:06.130 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:06.132 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:06.132 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:06.131+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:06.199 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is set 2024-04-25T22:53:06.232 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:06.231+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:06.241 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:06.241 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:06.241 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-25T22:53:06.241 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:06.250 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:06.334 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:06.333+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:06.392 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:06.392 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:06.392 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-25T22:53:06.392 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-25T22:53:06.392 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:06.401 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:06.434 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:06.433+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:06.535 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:06.534+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:06.545 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:06.545 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:53:06.545 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:53:06.545 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:53:06.545 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.546 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:53:06.546 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:06.546 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 78.576721859000003, 2024-04-25T22:53:06.546 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:53:06.546 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:06.546 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:06.546 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:06.546 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:06.546 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.546 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:06.546 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:06.546 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:06.547 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.547 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.547 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:06.547 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:06.547 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:06.547 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.547 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.547 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:06.547 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:53:06.547 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:53:06.547 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.547 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.547 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:06.547 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:53:06.548 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:53:06.548 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.548 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.548 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:06.548 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:53:06.548 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:53:06.548 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.548 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.548 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:06.548 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:53:06.548 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:53:06.548 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.548 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.549 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:06.549 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:53:06.549 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:53:06.549 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.549 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.549 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:06.549 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:53:06.549 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:53:06.549 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.549 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.549 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:06.549 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:53:06.549 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:53:06.549 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.550 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.550 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:06.550 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:53:06.550 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:53:06.550 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:06.550 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:06.550 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:06.550 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.550 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.550 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:110 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'72, mlcod=10'68)", 2024-04-25T22:53:06.550 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:06.550 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 78.576087858999998, 2024-04-25T22:53:06.550 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065316630000000001, 2024-04-25T22:53:06.551 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:06.551 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:06.551 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:06.551 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:06.551 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.551 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:06.551 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:06.551 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:06.551 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.551 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.551 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:06.551 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:06.551 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:06.551 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.551 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.552 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:06.552 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:06.552 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.58e-07 2024-04-25T22:53:06.552 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.552 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.552 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:06.552 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967811+0000", 2024-04-25T22:53:06.552 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.118e-06 2024-04-25T22:53:06.552 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.552 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.552 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:06.552 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967817+0000", 2024-04-25T22:53:06.552 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3709999999999996e-06 2024-04-25T22:53:06.552 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.552 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.553 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:06.553 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967820+0000", 2024-04-25T22:53:06.553 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2210000000000002e-06 2024-04-25T22:53:06.553 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.553 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.553 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:06.553 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967876+0000", 2024-04-25T22:53:06.553 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5507000000000002e-05 2024-04-25T22:53:06.553 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.553 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.553 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:06.553 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967893+0000", 2024-04-25T22:53:06.553 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7812000000000002e-05 2024-04-25T22:53:06.553 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.554 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.554 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:06.554 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974317+0000", 2024-04-25T22:53:06.554 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064237160000000003 2024-04-25T22:53:06.554 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.554 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.554 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:06.554 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:53:06.554 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.156e-05 2024-04-25T22:53:06.554 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:06.554 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:06.554 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:06.554 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.555 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.555 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'68)", 2024-04-25T22:53:06.555 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:06.555 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 78.575670345999995, 2024-04-25T22:53:06.555 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061292279999999996, 2024-04-25T22:53:06.555 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:06.555 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:06.555 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:06.555 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:06.555 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.555 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:06.555 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:06.555 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:06.555 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.556 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.556 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:06.556 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:06.556 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:06.556 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.556 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.556 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:06.556 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:06.556 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6300000000000001e-07 2024-04-25T22:53:06.556 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.556 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.556 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:06.556 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968228+0000", 2024-04-25T22:53:06.557 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6139999999999999e-06 2024-04-25T22:53:06.557 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.557 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.557 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:06.557 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968235+0000", 2024-04-25T22:53:06.557 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7020000000000001e-06 2024-04-25T22:53:06.557 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.557 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.557 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:06.557 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968238+0000", 2024-04-25T22:53:06.557 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0010000000000002e-06 2024-04-25T22:53:06.557 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.557 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.557 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:06.558 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968297+0000", 2024-04-25T22:53:06.558 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8424999999999997e-05 2024-04-25T22:53:06.558 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.558 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.558 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:06.558 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968316+0000", 2024-04-25T22:53:06.558 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8814999999999999e-05 2024-04-25T22:53:06.558 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.558 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.558 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:06.558 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:53:06.558 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060239439999999998 2024-04-25T22:53:06.558 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.559 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.559 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:06.559 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974354+0000", 2024-04-25T22:53:06.559 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4364e-05 2024-04-25T22:53:06.559 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:06.559 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:06.559 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:06.559 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.559 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.559 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'68)", 2024-04-25T22:53:06.559 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:06.559 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 78.575233343999997, 2024-04-25T22:53:06.559 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005948414, 2024-04-25T22:53:06.559 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:06.560 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:06.560 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:06.560 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:06.560 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.560 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:06.560 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:06.560 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:06.560 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.560 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.560 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:06.560 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:06.560 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:06.560 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.561 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.561 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:06.561 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:06.561 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6199999999999998e-07 2024-04-25T22:53:06.561 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.561 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.561 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:06.561 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968723+0000", 2024-04-25T22:53:06.561 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1148999999999993e-05 2024-04-25T22:53:06.561 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.561 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.561 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:06.561 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968730+0000", 2024-04-25T22:53:06.561 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1749999999999999e-06 2024-04-25T22:53:06.561 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.562 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.562 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:06.562 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968734+0000", 2024-04-25T22:53:06.562 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5200000000000002e-06 2024-04-25T22:53:06.562 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.562 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.562 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:06.562 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968771+0000", 2024-04-25T22:53:06.562 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6851999999999999e-05 2024-04-25T22:53:06.562 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.562 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.562 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:06.563 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968788+0000", 2024-04-25T22:53:06.563 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7027000000000001e-05 2024-04-25T22:53:06.563 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.563 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.563 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:06.563 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974589+0000", 2024-04-25T22:53:06.563 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058013320000000002 2024-04-25T22:53:06.563 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.563 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.563 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:06.563 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974610+0000", 2024-04-25T22:53:06.563 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0897e-05 2024-04-25T22:53:06.563 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:06.564 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:06.564 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:06.564 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.564 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.564 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'68)", 2024-04-25T22:53:06.564 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:06.564 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 78.574663333999993, 2024-04-25T22:53:06.564 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053935750000000003, 2024-04-25T22:53:06.564 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:06.564 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:06.564 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:06.564 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:06.564 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.564 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:06.565 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:06.565 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:06.565 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.565 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.565 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:06.565 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:06.565 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:06.565 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.565 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.565 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:06.565 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:06.565 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.03e-07 2024-04-25T22:53:06.565 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.565 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.565 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:06.566 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969235+0000", 2024-04-25T22:53:06.566 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2399999999999999e-06 2024-04-25T22:53:06.566 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.566 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.566 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:06.566 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969242+0000", 2024-04-25T22:53:06.566 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1269999999999997e-06 2024-04-25T22:53:06.566 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.566 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.566 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:06.566 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969246+0000", 2024-04-25T22:53:06.566 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3840000000000001e-06 2024-04-25T22:53:06.566 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.566 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.567 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:06.567 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969278+0000", 2024-04-25T22:53:06.567 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1868e-05 2024-04-25T22:53:06.567 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.567 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.567 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:06.567 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969295+0000", 2024-04-25T22:53:06.567 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7530999999999999e-05 2024-04-25T22:53:06.567 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.567 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.567 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:06.567 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974611+0000", 2024-04-25T22:53:06.567 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053160789999999996 2024-04-25T22:53:06.567 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.568 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.568 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:06.568 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974625+0000", 2024-04-25T22:53:06.568 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3943e-05 2024-04-25T22:53:06.568 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:06.568 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:06.568 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:06.568 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.568 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.568 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-25T22:53:06.568 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:06.568 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 78.381067426000001, 2024-04-25T22:53:06.568 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054952610000000004, 2024-04-25T22:53:06.568 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:06.569 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:06.569 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:06.569 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:06.569 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.569 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:06.569 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:06.569 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:06.569 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.569 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.569 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:06.569 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:06.569 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:06.569 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.569 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.570 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:06.570 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:06.570 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.68e-07 2024-04-25T22:53:06.570 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.570 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.570 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:06.570 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162898+0000", 2024-04-25T22:53:06.570 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9470999999999999e-05 2024-04-25T22:53:06.570 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.570 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.570 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:06.570 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162906+0000", 2024-04-25T22:53:06.570 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1580000000000005e-06 2024-04-25T22:53:06.571 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.571 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.571 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:06.571 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162911+0000", 2024-04-25T22:53:06.571 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4779999999999999e-06 2024-04-25T22:53:06.571 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.571 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.571 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:06.571 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162952+0000", 2024-04-25T22:53:06.571 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0629e-05 2024-04-25T22:53:06.571 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.571 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.571 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:06.572 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162968+0000", 2024-04-25T22:53:06.572 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6239000000000002e-05 2024-04-25T22:53:06.572 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.572 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.572 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:06.572 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168281+0000", 2024-04-25T22:53:06.572 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053132869999999999 2024-04-25T22:53:06.572 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.572 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.572 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:06.572 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168323+0000", 2024-04-25T22:53:06.572 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1430999999999997e-05 2024-04-25T22:53:06.572 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:06.572 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:06.573 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:06.573 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.573 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.573 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-04-25T22:53:06.573 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:06.573 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 77.950590063999996, 2024-04-25T22:53:06.573 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050872510000000001, 2024-04-25T22:53:06.573 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:06.573 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:06.573 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:06.573 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:06.573 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.573 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:06.573 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:06.573 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:06.574 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.574 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.574 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:06.574 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:06.574 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:06.574 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.574 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.574 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:06.574 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:06.574 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.72e-07 2024-04-25T22:53:06.574 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.574 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.574 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:06.575 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593381+0000", 2024-04-25T22:53:06.575 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5797000000000006e-05 2024-04-25T22:53:06.575 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.575 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.575 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:06.575 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593389+0000", 2024-04-25T22:53:06.575 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8480000000000001e-06 2024-04-25T22:53:06.575 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.575 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.575 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:06.575 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593393+0000", 2024-04-25T22:53:06.575 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4819999999999996e-06 2024-04-25T22:53:06.575 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.576 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.576 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:06.576 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593435+0000", 2024-04-25T22:53:06.576 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1600000000000002e-05 2024-04-25T22:53:06.576 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.576 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.576 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:06.576 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593454+0000", 2024-04-25T22:53:06.576 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8868e-05 2024-04-25T22:53:06.576 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.576 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.576 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:06.576 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598350+0000", 2024-04-25T22:53:06.576 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004895763 2024-04-25T22:53:06.577 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.577 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.577 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:06.577 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598392+0000", 2024-04-25T22:53:06.577 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2521000000000002e-05 2024-04-25T22:53:06.577 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:06.577 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:06.577 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:06.577 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.577 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.577 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:06.577 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:06.577 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 73.532226159999993, 2024-04-25T22:53:06.577 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:53:06.578 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:06.578 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:06.578 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:06.578 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:06.578 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.578 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:06.578 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:06.578 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:06.578 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.578 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.578 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:06.578 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:06.578 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:06.578 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.579 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.579 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:06.579 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:53:06.579 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:53:06.579 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.579 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.579 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:06.579 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:53:06.579 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:53:06.579 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.579 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.579 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:06.579 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:53:06.579 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:53:06.580 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.580 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.580 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:06.580 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:53:06.580 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:53:06.580 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.580 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.580 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:06.580 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:53:06.580 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:53:06.580 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.580 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.580 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:06.580 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:53:06.581 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:53:06.581 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.581 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.581 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:06.581 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:53:06.581 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:53:06.581 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.581 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.581 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:06.581 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:53:06.581 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:53:06.581 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.581 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.581 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:06.582 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:53:06.582 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:53:06.582 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.582 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.582 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:06.582 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:53:06.582 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:53:06.582 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.582 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.582 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:06.582 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:53:06.582 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:53:06.582 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:06.583 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:06.583 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:06.583 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.583 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.583 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:06.583 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:06.583 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 73.531551784000001, 2024-04-25T22:53:06.583 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:53:06.583 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:06.583 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:06.583 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:06.583 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:06.583 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.583 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:06.584 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:06.584 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:06.584 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.584 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.584 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:06.584 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:06.584 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:06.584 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.584 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.584 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:06.584 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:53:06.584 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:53:06.584 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.585 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.585 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:06.585 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:53:06.585 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:53:06.585 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.585 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.585 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:06.585 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:53:06.585 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:53:06.585 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.585 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.585 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:06.585 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:53:06.586 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:53:06.586 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.586 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.586 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:06.586 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:53:06.586 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:53:06.586 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.586 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.586 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:06.586 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:53:06.586 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:53:06.586 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.586 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.587 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:06.587 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:53:06.587 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:53:06.587 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.587 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.587 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:06.587 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:53:06.587 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:53:06.587 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.587 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.587 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:06.587 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:53:06.587 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:53:06.588 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.588 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.588 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:06.588 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:53:06.588 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:53:06.588 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.588 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.588 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:06.588 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:53:06.588 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:53:06.588 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:06.588 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:06.588 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:06.588 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.589 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.589 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:06.589 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:06.589 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 73.531042572000004, 2024-04-25T22:53:06.589 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:53:06.589 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:06.589 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:06.589 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:06.589 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:06.589 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.589 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:06.589 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:06.589 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:06.589 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.590 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.590 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:06.590 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:06.590 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:06.590 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.590 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.590 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:06.590 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:53:06.590 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:53:06.590 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.590 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.590 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:06.590 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:53:06.590 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:53:06.591 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.591 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.591 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:06.591 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:53:06.591 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:53:06.591 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.591 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.591 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:06.591 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:53:06.591 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:53:06.591 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.591 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.591 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:06.592 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:53:06.592 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:53:06.592 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.592 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.592 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:06.592 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:53:06.592 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:53:06.592 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.592 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.592 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:06.592 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:53:06.592 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:53:06.592 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.592 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.592 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:06.593 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:53:06.593 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:53:06.593 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.593 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.593 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:06.593 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:53:06.593 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:53:06.593 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.593 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.593 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:06.593 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:53:06.593 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:53:06.593 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.594 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.594 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:06.594 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:53:06.594 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:53:06.594 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:06.594 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:06.594 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:06.594 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.594 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.594 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:06.594 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:06.594 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 73.530629374, 2024-04-25T22:53:06.594 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:53:06.595 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:06.595 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:06.595 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:06.595 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:06.595 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.595 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:06.595 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:06.595 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:06.595 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.595 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.595 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:06.595 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:06.595 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:06.595 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.596 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.596 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:06.596 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:06.596 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:53:06.596 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.596 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.596 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:06.596 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:06.596 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:53:06.596 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.596 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.596 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:06.596 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:53:06.596 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:53:06.597 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.597 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.597 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:06.597 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:53:06.597 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:53:06.597 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.597 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.597 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:06.597 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:53:06.597 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:53:06.597 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.597 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.597 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:06.597 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:53:06.598 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:53:06.598 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.598 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.598 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:06.598 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:53:06.598 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:53:06.598 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.598 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.598 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:06.598 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:53:06.598 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:53:06.598 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.598 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.599 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:06.599 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:53:06.599 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:53:06.599 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.599 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.599 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:06.599 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:53:06.599 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:53:06.599 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.599 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.599 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:06.599 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:53:06.599 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:53:06.599 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:06.600 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:06.600 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:06.600 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.600 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.600 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:06.600 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:06.600 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 73.530578704000007, 2024-04-25T22:53:06.600 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:53:06.600 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:06.600 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:06.600 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:06.600 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:06.600 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.600 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:06.601 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:06.601 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:06.601 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.601 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.601 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:06.601 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:06.601 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:06.601 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.601 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.601 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:06.601 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:53:06.601 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:53:06.601 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.601 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.602 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:06.602 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:53:06.602 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:53:06.602 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.602 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.602 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:06.602 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:53:06.602 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:53:06.602 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.602 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.602 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:06.602 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:53:06.602 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:53:06.603 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.603 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.603 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:06.603 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:53:06.603 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:53:06.603 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.603 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.603 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:06.603 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:53:06.603 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:53:06.603 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.603 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.603 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:06.604 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:53:06.604 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:53:06.604 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.604 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.604 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:06.604 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:53:06.604 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:53:06.604 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.604 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.604 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:06.604 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:53:06.604 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:53:06.604 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.604 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.605 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:06.605 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:53:06.605 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:53:06.605 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.605 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.605 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:06.605 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:53:06.605 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:53:06.605 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.605 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.605 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:06.605 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:53:06.605 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:53:06.606 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.606 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.606 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:06.606 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:53:06.606 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:53:06.606 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:06.606 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:06.606 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:06.606 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.606 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.606 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:06.606 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:06.606 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 73.530541834999994, 2024-04-25T22:53:06.606 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:53:06.607 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:06.607 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:06.607 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:06.607 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:06.607 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.607 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:06.607 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:06.607 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:06.607 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.607 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.607 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:06.607 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:06.607 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:06.607 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.608 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.608 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:06.608 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:53:06.608 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:53:06.608 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.608 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.608 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:06.608 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:53:06.608 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:53:06.608 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.608 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.608 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:06.608 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:53:06.608 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:53:06.609 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.609 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.609 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:06.609 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:53:06.609 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:53:06.609 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.609 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.609 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:06.609 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:53:06.609 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:53:06.609 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.609 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.609 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:53:06.609 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:53:06.610 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:53:06.610 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.610 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.610 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:06.610 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:53:06.610 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:53:06.610 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.610 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.610 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:06.610 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:53:06.610 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:53:06.610 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.610 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.611 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:06.611 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:53:06.611 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:53:06.611 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.611 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.611 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:06.611 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:53:06.611 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:53:06.611 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.611 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.611 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:06.611 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:53:06.611 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:53:06.611 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.612 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.612 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:06.612 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:53:06.612 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:53:06.612 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.612 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.612 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:06.612 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:53:06.612 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:53:06.612 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:06.612 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:06.612 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:06.612 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.612 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.613 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:06.613 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:06.613 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 73.530516868999996, 2024-04-25T22:53:06.613 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:53:06.613 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:06.613 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:06.613 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:06.613 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:06.613 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.613 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:06.613 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:06.613 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:06.613 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.613 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.614 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:06.614 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:06.614 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:06.614 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.614 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.614 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:06.614 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:53:06.614 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:53:06.614 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.614 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.614 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:06.614 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:53:06.614 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:53:06.615 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.615 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.615 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:06.615 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:06.615 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:53:06.615 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.615 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.615 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:06.615 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:53:06.615 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:53:06.615 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.616 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.616 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:06.616 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:53:06.616 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:53:06.616 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.616 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.616 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:06.616 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:53:06.616 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:53:06.616 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.616 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.616 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:06.616 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:53:06.617 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:53:06.617 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.617 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.617 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:06.617 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:53:06.617 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:53:06.617 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.617 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.617 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:06.617 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:53:06.617 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:53:06.617 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.617 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.618 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:06.618 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:53:06.618 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:53:06.618 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.618 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.618 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:06.618 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:53:06.618 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:53:06.618 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:06.618 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:06.618 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:06.618 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.618 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.619 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:06.619 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:06.619 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 73.530480505, 2024-04-25T22:53:06.619 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:53:06.619 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:06.619 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:06.619 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:06.619 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:06.619 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.619 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:06.619 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:06.619 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:06.619 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.619 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.620 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:06.620 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:06.620 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:06.620 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.620 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.620 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:06.620 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:53:06.620 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:53:06.620 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.620 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.620 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:06.620 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:53:06.620 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:53:06.621 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.621 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.621 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:06.621 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:53:06.621 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:53:06.621 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.621 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.621 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:06.621 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:53:06.621 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:53:06.621 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.621 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.621 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:06.622 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:53:06.622 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:53:06.622 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.622 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.622 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:06.622 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:53:06.622 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:53:06.622 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.622 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.622 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:06.622 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:53:06.622 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:53:06.622 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.623 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.623 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:06.623 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:53:06.623 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:53:06.623 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.623 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.623 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:06.623 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:53:06.623 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:53:06.623 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:06.623 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:06.623 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:06.623 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.624 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.624 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:06.624 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:06.624 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 73.530449423999997, 2024-04-25T22:53:06.624 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:53:06.624 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:06.624 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:06.624 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:06.624 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:06.624 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.624 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:06.624 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:06.624 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:06.624 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.625 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.625 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:06.625 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:06.625 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:06.625 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.625 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.625 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:06.625 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:06.625 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:06.625 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.625 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.625 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:06.625 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:53:06.626 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:53:06.626 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.626 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.626 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:06.626 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:53:06.626 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:53:06.626 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.626 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.626 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:06.626 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:53:06.626 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:53:06.626 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.626 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.627 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:06.627 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:53:06.627 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:53:06.627 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.627 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.627 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:06.627 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:53:06.627 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:53:06.627 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.627 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.627 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:06.627 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:53:06.627 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:53:06.627 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:06.628 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:06.628 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:06.628 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.628 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.628 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:53:06.628 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:06.628 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 73.530008455000001, 2024-04-25T22:53:06.628 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064881979999999997, 2024-04-25T22:53:06.628 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:06.628 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:06.628 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:06.628 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:06.628 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.629 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:06.629 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:06.629 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:06.629 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.629 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.629 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:06.629 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:06.629 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:06.629 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.629 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.629 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:06.629 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:06.629 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2699999999999999e-07 2024-04-25T22:53:06.629 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.630 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.630 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:06.630 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013898+0000", 2024-04-25T22:53:06.630 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0796e-05 2024-04-25T22:53:06.630 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.630 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.630 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:06.630 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013907+0000", 2024-04-25T22:53:06.630 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5140000000000007e-06 2024-04-25T22:53:06.630 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.630 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.630 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:06.630 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013952+0000", 2024-04-25T22:53:06.631 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4134000000000001e-05 2024-04-25T22:53:06.631 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.631 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.631 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:06.631 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016812+0000", 2024-04-25T22:53:06.631 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028601059999999998 2024-04-25T22:53:06.631 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.631 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.631 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:06.631 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.017052+0000", 2024-04-25T22:53:06.631 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024056500000000001 2024-04-25T22:53:06.631 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.631 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.632 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:06.632 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020350+0000", 2024-04-25T22:53:06.632 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032978320000000001 2024-04-25T22:53:06.632 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.632 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.632 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:06.632 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020375+0000", 2024-04-25T22:53:06.632 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4624e-05 2024-04-25T22:53:06.632 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:06.632 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:06.632 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:06.632 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.632 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.633 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-25T22:53:06.633 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:06.633 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 73.516478008999997, 2024-04-25T22:53:06.633 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058583000000000003, 2024-04-25T22:53:06.633 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:06.633 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:06.633 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:06.633 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:06.633 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.633 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:06.633 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:06.633 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:06.633 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.633 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.634 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:06.634 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:06.634 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:06.634 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.634 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.634 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:06.634 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:06.634 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.41e-07 2024-04-25T22:53:06.634 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.634 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.634 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:06.634 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027428+0000", 2024-04-25T22:53:06.634 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.075e-05 2024-04-25T22:53:06.634 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.635 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.635 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:06.635 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027435+0000", 2024-04-25T22:53:06.635 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3610000000000003e-06 2024-04-25T22:53:06.635 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.635 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.635 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:06.635 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027442+0000", 2024-04-25T22:53:06.635 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0400000000000004e-06 2024-04-25T22:53:06.635 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.635 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.635 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:06.635 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028094+0000", 2024-04-25T22:53:06.636 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00065134800000000005 2024-04-25T22:53:06.636 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.636 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.636 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:06.636 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028107+0000", 2024-04-25T22:53:06.636 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3087e-05 2024-04-25T22:53:06.636 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.636 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.636 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:06.636 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033239+0000", 2024-04-25T22:53:06.636 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051319429999999999 2024-04-25T22:53:06.636 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.636 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.636 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:06.637 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033275+0000", 2024-04-25T22:53:06.637 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6430000000000002e-05 2024-04-25T22:53:06.637 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:06.637 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:06.637 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:06.637 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.637 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.637 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-25T22:53:06.637 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:06.637 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 73.516093171999998, 2024-04-25T22:53:06.637 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005413597, 2024-04-25T22:53:06.637 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:06.637 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:06.637 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:06.638 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:06.638 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.638 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:06.638 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:06.638 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:06.638 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.638 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.638 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:06.638 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:06.638 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:06.638 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.638 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.638 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:06.639 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:06.639 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3799999999999997e-07 2024-04-25T22:53:06.639 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.639 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.639 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:06.639 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027816+0000", 2024-04-25T22:53:06.639 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3230999999999999e-05 2024-04-25T22:53:06.639 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.639 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.639 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:06.639 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027823+0000", 2024-04-25T22:53:06.639 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9039999999999992e-06 2024-04-25T22:53:06.639 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.639 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.640 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:06.640 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027841+0000", 2024-04-25T22:53:06.640 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7651000000000001e-05 2024-04-25T22:53:06.640 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.640 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.640 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:06.640 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027904+0000", 2024-04-25T22:53:06.640 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3058000000000005e-05 2024-04-25T22:53:06.640 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.640 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.640 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:06.640 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027926+0000", 2024-04-25T22:53:06.640 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1450999999999998e-05 2024-04-25T22:53:06.640 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.641 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.641 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:06.641 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033177+0000", 2024-04-25T22:53:06.641 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052508909999999997 2024-04-25T22:53:06.641 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.641 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.641 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:06.641 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033215+0000", 2024-04-25T22:53:06.641 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8872999999999999e-05 2024-04-25T22:53:06.641 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:06.641 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:06.641 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:06.641 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.641 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.642 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 171 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:53:06.642 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:06.642 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 73.516036069999998, 2024-04-25T22:53:06.642 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054322240000000003, 2024-04-25T22:53:06.642 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:06.642 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:06.642 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "reached pg", 2024-04-25T22:53:06.642 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:06.642 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.642 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:06.642 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:06.642 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:06.642 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.643 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.643 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:06.643 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:06.643 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:06.643 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.643 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.643 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:06.643 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:06.643 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7500000000000001e-07 2024-04-25T22:53:06.643 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.643 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.643 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:06.643 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027868+0000", 2024-04-25T22:53:06.643 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5750000000000001e-06 2024-04-25T22:53:06.643 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.644 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.644 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:06.644 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027885+0000", 2024-04-25T22:53:06.644 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7272e-05 2024-04-25T22:53:06.644 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.644 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.644 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:06.644 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027900+0000", 2024-04-25T22:53:06.644 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.502e-05 2024-04-25T22:53:06.644 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.644 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.644 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:06.644 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028381+0000", 2024-04-25T22:53:06.645 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00048039399999999998 2024-04-25T22:53:06.645 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:06.645 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:06.645 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:06.645 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033291+0000", 2024-04-25T22:53:06.645 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049105879999999996 2024-04-25T22:53:06.645 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:06.645 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:06.645 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:06.645 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:06.645 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:06.645 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:06.647 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:06.646+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:06.647 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:06.747 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:06.747+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:06.752 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:06.752 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:06.753 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-04-25T22:53:06.753 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:06.753 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:53:06.761 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:06.848 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~24s 2024-04-25T22:53:06.848 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:06.847+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:06.894 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-25T22:53:06.895 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:53:06.895 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:53:06.904 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:06.904 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:06.913 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:06.913 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-25T22:53:06.914 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:53:06.918 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:53:06.918 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:53:06.949 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:06.949+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:07.050 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:07.049+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:07.054 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:07.054 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:07.063 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:07.151 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:07.150+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:07.168 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:07.168 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:07.177 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:07.196 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2024-04-25T22:53:07.196 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-25T22:53:07.196 INFO:tasks.thrashosds.thrasher:Reviving osd 1 2024-04-25T22:53:07.196 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.1 doing powercycle of ubuntu@smithi164.front.sepia.ceph.com 2024-04-25T22:53:07.196 INFO:teuthology.orchestra.console.smithi164:Power on 2024-04-25T22:53:07.197 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-25T22:53:07.220 DEBUG:teuthology.orchestra.console.smithi164:power on output: Chassis Power Control: Up/On 2024-04-25T22:53:07.220 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T22:53:07.243 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off 2024-04-25T22:53:07.252 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:07.252+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:07.280 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:07.280 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:07.289 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:07.354 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:07.353+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:07.391 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:07.391 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:07.401 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:07.455 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:07.455+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:07.504 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:07.504 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:07.513 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:07.556 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:07.556+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:07.616 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:07.616 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:07.625 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:07.657 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:07.657+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:07.727 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:07.727 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:07.736 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:07.779 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:07.778+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:07.838 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:07.838 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:07.847 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:07.888 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:07.888+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:07.959 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:07.959+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:07.989 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:07.990 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:07.998 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:08.060 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:08.059+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:08.101 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:08.101 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:08.110 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:08.161 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:08.160+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:08.214 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:08.214 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:08.217 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-25T22:53:08.222 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:08.264 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:08.263+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:08.363 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:08.362+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:08.364 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:08.365 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:08.374 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:08.463 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:08.463+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:08.516 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:08.517 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:08.525 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:08.567 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:08.566+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:08.627 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:08.628 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:08.637 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:08.680 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:08.680+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:08.739 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:08.739 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:08.747 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:08.766 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:08.765+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:08.867 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:08.867+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:08.890 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:08.890 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:08.899 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:08.919 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:53:08.968 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:08.968+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:09.002 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:09.002 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:09.011 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:09.070 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:09.069+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:09.110 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-25T22:53:09.111 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:53:09.111 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:53:09.113 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:09.113 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:09.114 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:53:09.114 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:53:09.114 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:09.123 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:09.142 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-25T22:53:09.143 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:53:09.146 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:53:09.147 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:53:09.170 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:09.169+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:09.206 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is unset 2024-04-25T22:53:09.228 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:09.228 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-04-25T22:53:09.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-04-25T22:53:09.229 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:53:09.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.229 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:09.229 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:09.229 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 81.261764806000002, 2024-04-25T22:53:09.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0103421, 2024-04-25T22:53:09.229 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:09.229 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:09.229 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:09.229 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:09.229 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:09.230 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:09.230 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 115 2024-04-25T22:53:09.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.230 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:09.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:09.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:09.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:09.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:09.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:09.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:09.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:09.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:09.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9500000000000002e-07 2024-04-25T22:53:09.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:09.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965108+0000", 2024-04-25T22:53:09.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9177999999999994e-05 2024-04-25T22:53:09.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:09.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965127+0000", 2024-04-25T22:53:09.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8868e-05 2024-04-25T22:53:09.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:09.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965133+0000", 2024-04-25T22:53:09.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8929999999999999e-06 2024-04-25T22:53:09.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:09.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.969991+0000", 2024-04-25T22:53:09.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048573849999999997 2024-04-25T22:53:09.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:09.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970072+0000", 2024-04-25T22:53:09.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0728000000000004e-05 2024-04-25T22:53:09.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:09.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970189+0000", 2024-04-25T22:53:09.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000117778 2024-04-25T22:53:09.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:09.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970946+0000", 2024-04-25T22:53:09.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00075704600000000004 2024-04-25T22:53:09.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:09.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975297+0000", 2024-04-25T22:53:09.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004350217 2024-04-25T22:53:09.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:09.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975343+0000", 2024-04-25T22:53:09.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6687999999999998e-05 2024-04-25T22:53:09.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:09.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975380+0000", 2024-04-25T22:53:09.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6724000000000003e-05 2024-04-25T22:53:09.235 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:09.235 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:09.235 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:09.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.235 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:09.235 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:09.235 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 81.261658775000001, 2024-04-25T22:53:09.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010304384, 2024-04-25T22:53:09.235 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:09.235 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:09.235 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:09.235 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:09.236 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:09.236 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:09.236 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 116 2024-04-25T22:53:09.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.236 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:09.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:09.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:09.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:09.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:09.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:09.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:09.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:09.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:09.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5799999999999999e-07 2024-04-25T22:53:09.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:09.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965154+0000", 2024-04-25T22:53:09.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0009e-05 2024-04-25T22:53:09.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:09.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965164+0000", 2024-04-25T22:53:09.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8490000000000001e-06 2024-04-25T22:53:09.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:09.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965169+0000", 2024-04-25T22:53:09.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0730000000000004e-06 2024-04-25T22:53:09.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:09.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970609+0000", 2024-04-25T22:53:09.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054397689999999997 2024-04-25T22:53:09.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:09.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970651+0000", 2024-04-25T22:53:09.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1873999999999999e-05 2024-04-25T22:53:09.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:09.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970723+0000", 2024-04-25T22:53:09.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2039999999999995e-05 2024-04-25T22:53:09.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:09.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971358+0000", 2024-04-25T22:53:09.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063489500000000001 2024-04-25T22:53:09.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:09.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975409+0000", 2024-04-25T22:53:09.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040506880000000002 2024-04-25T22:53:09.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:09.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975432+0000", 2024-04-25T22:53:09.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3315999999999998e-05 2024-04-25T22:53:09.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:09.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975448+0000", 2024-04-25T22:53:09.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6313000000000001e-05 2024-04-25T22:53:09.241 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:09.241 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:09.241 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:09.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.241 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:09.241 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:09.241 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 81.261624193000003, 2024-04-25T22:53:09.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010384338999999999, 2024-04-25T22:53:09.241 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:09.241 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:09.241 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:09.241 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:09.241 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:09.242 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:09.242 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-04-25T22:53:09.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.242 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:09.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:09.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:09.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:09.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:09.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:09.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:09.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:09.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:09.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3600000000000004e-07 2024-04-25T22:53:09.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:09.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965185+0000", 2024-04-25T22:53:09.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.117e-06 2024-04-25T22:53:09.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:09.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965192+0000", 2024-04-25T22:53:09.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3239999999999997e-06 2024-04-25T22:53:09.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:09.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965198+0000", 2024-04-25T22:53:09.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6370000000000004e-06 2024-04-25T22:53:09.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:09.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970973+0000", 2024-04-25T22:53:09.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057748239999999996 2024-04-25T22:53:09.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:09.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971049+0000", 2024-04-25T22:53:09.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6029e-05 2024-04-25T22:53:09.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:09.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971174+0000", 2024-04-25T22:53:09.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012462399999999999 2024-04-25T22:53:09.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:09.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971553+0000", 2024-04-25T22:53:09.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037896499999999999 2024-04-25T22:53:09.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:09.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975482+0000", 2024-04-25T22:53:09.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039297459999999996 2024-04-25T22:53:09.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:09.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975529+0000", 2024-04-25T22:53:09.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6387000000000002e-05 2024-04-25T22:53:09.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:09.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975563+0000", 2024-04-25T22:53:09.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4150000000000003e-05 2024-04-25T22:53:09.247 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:09.247 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:09.247 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:09.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.247 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:09.247 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:09.247 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 76.214577869999999, 2024-04-25T22:53:09.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012637705000000001, 2024-04-25T22:53:09.247 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:09.247 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:09.247 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:09.247 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:09.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.248 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:09.248 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:09.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:09.248 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.248 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:09.248 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:09.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:09.248 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.248 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:09.248 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012227+0000", 2024-04-25T22:53:09.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.863e-06 2024-04-25T22:53:09.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:09.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012236+0000", 2024-04-25T22:53:09.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1109999999999997e-06 2024-04-25T22:53:09.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:09.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012309+0000", 2024-04-25T22:53:09.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3242000000000001e-05 2024-04-25T22:53:09.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:09.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012324+0000", 2024-04-25T22:53:09.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4837e-05 2024-04-25T22:53:09.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:09.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015060+0000", 2024-04-25T22:53:09.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027363349999999999 2024-04-25T22:53:09.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:09.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015169+0000", 2024-04-25T22:53:09.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108372 2024-04-25T22:53:09.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:09.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015498+0000", 2024-04-25T22:53:09.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032949999999999999 2024-04-25T22:53:09.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:09.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021282+0000", 2024-04-25T22:53:09.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057836429999999998 2024-04-25T22:53:09.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:09.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024709+0000", 2024-04-25T22:53:09.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034271979999999998 2024-04-25T22:53:09.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.252 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:09.252 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024802+0000", 2024-04-25T22:53:09.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2960000000000004e-05 2024-04-25T22:53:09.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.252 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:09.252 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024863+0000", 2024-04-25T22:53:09.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0643999999999997e-05 2024-04-25T22:53:09.252 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:09.252 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:09.252 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:09.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.252 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:09.253 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:09.253 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 76.214454098999994, 2024-04-25T22:53:09.253 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012979447999999999, 2024-04-25T22:53:09.253 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:09.253 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:09.253 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:09.253 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:09.253 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.253 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:09.253 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:09.253 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:09.253 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.253 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.253 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:09.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:09.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:09.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:09.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:09.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:53:09.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:09.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012354+0000", 2024-04-25T22:53:09.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7740000000000004e-06 2024-04-25T22:53:09.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:09.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012365+0000", 2024-04-25T22:53:09.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.064e-05 2024-04-25T22:53:09.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:09.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012382+0000", 2024-04-25T22:53:09.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6999000000000001e-05 2024-04-25T22:53:09.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:09.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015958+0000", 2024-04-25T22:53:09.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035765699999999998 2024-04-25T22:53:09.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.256 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:09.256 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016037+0000", 2024-04-25T22:53:09.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8242000000000001e-05 2024-04-25T22:53:09.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.256 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:09.256 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016404+0000", 2024-04-25T22:53:09.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036784300000000002 2024-04-25T22:53:09.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.256 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:09.256 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021294+0000", 2024-04-25T22:53:09.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048890629999999999 2024-04-25T22:53:09.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.257 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:09.257 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024959+0000", 2024-04-25T22:53:09.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036651570000000001 2024-04-25T22:53:09.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.257 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:09.257 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025097+0000", 2024-04-25T22:53:09.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013788099999999999 2024-04-25T22:53:09.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.257 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:09.257 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025328+0000", 2024-04-25T22:53:09.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231492 2024-04-25T22:53:09.258 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:09.258 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:09.258 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:09.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.258 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:09.258 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:09.258 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 76.214366330000004, 2024-04-25T22:53:09.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013049827, 2024-04-25T22:53:09.258 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:09.258 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:09.258 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:09.259 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:09.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.259 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:09.259 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:09.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:09.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.259 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:09.259 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:09.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:09.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.259 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:09.259 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012437+0000", 2024-04-25T22:53:09.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-04-25T22:53:09.260 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.260 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.260 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:09.260 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012440+0000", 2024-04-25T22:53:09.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7609999999999999e-06 2024-04-25T22:53:09.260 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.260 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.260 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:09.260 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012449+0000", 2024-04-25T22:53:09.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.285e-06 2024-04-25T22:53:09.260 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.260 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.260 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:09.261 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012457+0000", 2024-04-25T22:53:09.261 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9510000000000006e-06 2024-04-25T22:53:09.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.261 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:09.261 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017106+0000", 2024-04-25T22:53:09.261 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046494220000000003 2024-04-25T22:53:09.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.261 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:09.261 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017223+0000", 2024-04-25T22:53:09.261 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116824 2024-04-25T22:53:09.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:09.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017345+0000", 2024-04-25T22:53:09.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122175 2024-04-25T22:53:09.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:09.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021299+0000", 2024-04-25T22:53:09.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039534879999999998 2024-04-25T22:53:09.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:09.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025398+0000", 2024-04-25T22:53:09.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040988960000000003 2024-04-25T22:53:09.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:09.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025439+0000", 2024-04-25T22:53:09.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0915999999999999e-05 2024-04-25T22:53:09.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:09.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025486+0000", 2024-04-25T22:53:09.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7534999999999998e-05 2024-04-25T22:53:09.263 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:09.263 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:09.263 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:09.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.264 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:09.264 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:09.264 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 76.214336179, 2024-04-25T22:53:09.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020988041999999998, 2024-04-25T22:53:09.264 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:09.264 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:09.264 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:09.264 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:09.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:09.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:09.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:09.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.265 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:09.265 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:09.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:09.265 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.265 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.265 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:09.265 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:09.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.99e-07 2024-04-25T22:53:09.265 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.265 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.265 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:09.265 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012470+0000", 2024-04-25T22:53:09.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2789999999999999e-06 2024-04-25T22:53:09.265 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.266 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.266 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:09.266 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012477+0000", 2024-04-25T22:53:09.266 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:53:09.266 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.266 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.266 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:09.266 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012500+0000", 2024-04-25T22:53:09.266 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2490999999999999e-05 2024-04-25T22:53:09.266 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.266 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.266 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:09.266 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021911+0000", 2024-04-25T22:53:09.266 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094114160000000006 2024-04-25T22:53:09.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.267 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:09.267 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022000+0000", 2024-04-25T22:53:09.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8601000000000001e-05 2024-04-25T22:53:09.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.267 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:09.267 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022359+0000", 2024-04-25T22:53:09.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035921999999999999 2024-04-25T22:53:09.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.267 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:09.267 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025541+0000", 2024-04-25T22:53:09.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031820619999999998 2024-04-25T22:53:09.268 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.268 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.268 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:09.268 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033375+0000", 2024-04-25T22:53:09.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078338379999999992 2024-04-25T22:53:09.268 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.268 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.268 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:09.268 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033415+0000", 2024-04-25T22:53:09.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9527000000000003e-05 2024-04-25T22:53:09.268 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.268 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.269 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:09.269 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033455+0000", 2024-04-25T22:53:09.269 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9932000000000003e-05 2024-04-25T22:53:09.269 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:09.269 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:09.269 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:09.269 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.269 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.269 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:09.269 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:09.269 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 76.214280986000006, 2024-04-25T22:53:09.269 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021043857999999999, 2024-04-25T22:53:09.269 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:09.269 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:09.270 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:09.270 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:09.270 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.270 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:09.270 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:09.270 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:09.270 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.270 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.270 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:09.270 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:09.270 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:09.270 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.270 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.271 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:09.271 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012523+0000", 2024-04-25T22:53:09.271 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.361e-06 2024-04-25T22:53:09.271 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.271 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.271 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:09.271 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012530+0000", 2024-04-25T22:53:09.271 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5440000000000004e-06 2024-04-25T22:53:09.271 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.271 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.271 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:09.271 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012541+0000", 2024-04-25T22:53:09.271 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1745e-05 2024-04-25T22:53:09.271 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.272 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.272 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:09.272 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012551+0000", 2024-04-25T22:53:09.272 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5789999999999993e-06 2024-04-25T22:53:09.272 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.272 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.272 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:09.272 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022709+0000", 2024-04-25T22:53:09.272 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010157685 2024-04-25T22:53:09.272 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.272 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.272 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:09.272 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022957+0000", 2024-04-25T22:53:09.272 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024824599999999998 2024-04-25T22:53:09.273 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.273 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.273 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:09.273 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023443+0000", 2024-04-25T22:53:09.273 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048578599999999999 2024-04-25T22:53:09.273 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.273 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.273 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:09.273 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025547+0000", 2024-04-25T22:53:09.273 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021044789999999998 2024-04-25T22:53:09.273 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.273 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.273 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:09.273 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033509+0000", 2024-04-25T22:53:09.274 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0079622180000000001 2024-04-25T22:53:09.274 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.274 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.274 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:09.274 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033542+0000", 2024-04-25T22:53:09.274 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3018000000000001e-05 2024-04-25T22:53:09.274 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.274 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.274 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:09.274 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033566+0000", 2024-04-25T22:53:09.274 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3197000000000002e-05 2024-04-25T22:53:09.274 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:09.274 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:09.274 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:09.275 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.275 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.275 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:09.275 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:09.275 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 76.214241021000007, 2024-04-25T22:53:09.275 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021122696, 2024-04-25T22:53:09.275 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:09.275 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:09.275 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:09.275 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:09.275 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.275 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:09.275 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:09.275 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:09.276 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.276 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.276 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:09.276 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:09.276 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:09.276 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.276 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.276 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:09.276 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:09.276 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:53:09.276 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.276 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.276 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:09.276 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012566+0000", 2024-04-25T22:53:09.277 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-04-25T22:53:09.277 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.277 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.277 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:09.277 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012619+0000", 2024-04-25T22:53:09.277 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2607e-05 2024-04-25T22:53:09.277 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.277 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.277 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:09.277 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012628+0000", 2024-04-25T22:53:09.277 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6500000000000008e-06 2024-04-25T22:53:09.277 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.277 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.277 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:09.278 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024024+0000", 2024-04-25T22:53:09.278 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011396007999999999 2024-04-25T22:53:09.278 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.278 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.278 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:09.278 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024198+0000", 2024-04-25T22:53:09.278 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000173215 2024-04-25T22:53:09.278 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.278 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.278 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:09.278 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024447+0000", 2024-04-25T22:53:09.278 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024898500000000002 2024-04-25T22:53:09.278 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.279 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.279 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:09.279 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026431+0000", 2024-04-25T22:53:09.279 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001984923 2024-04-25T22:53:09.279 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.279 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.279 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:09.279 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033608+0000", 2024-04-25T22:53:09.279 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071768459999999997 2024-04-25T22:53:09.279 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.279 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.279 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:09.279 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033646+0000", 2024-04-25T22:53:09.279 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299000000000003e-05 2024-04-25T22:53:09.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:09.280 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033684+0000", 2024-04-25T22:53:09.280 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8773000000000003e-05 2024-04-25T22:53:09.280 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:09.280 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:09.280 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:09.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.280 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:09.280 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:09.280 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 76.214152421999998, 2024-04-25T22:53:09.280 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021175381, 2024-04-25T22:53:09.281 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:09.281 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:09.281 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:09.281 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:09.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.281 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:09.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:09.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:09.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.281 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:09.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:09.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:09.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:09.282 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012651+0000", 2024-04-25T22:53:09.282 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:53:09.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:09.282 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012656+0000", 2024-04-25T22:53:09.282 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8899999999999998e-06 2024-04-25T22:53:09.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:09.282 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012666+0000", 2024-04-25T22:53:09.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0346999999999999e-05 2024-04-25T22:53:09.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.283 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:09.283 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012675+0000", 2024-04-25T22:53:09.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9930000000000001e-06 2024-04-25T22:53:09.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.283 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:09.283 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025661+0000", 2024-04-25T22:53:09.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01298531 2024-04-25T22:53:09.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.283 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:09.284 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025757+0000", 2024-04-25T22:53:09.284 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5822000000000005e-05 2024-04-25T22:53:09.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.284 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.284 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:09.284 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025907+0000", 2024-04-25T22:53:09.284 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015051499999999999 2024-04-25T22:53:09.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.284 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.284 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:09.284 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026435+0000", 2024-04-25T22:53:09.284 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052762200000000005 2024-04-25T22:53:09.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.285 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.285 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:09.285 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033732+0000", 2024-04-25T22:53:09.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072978419999999997 2024-04-25T22:53:09.285 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.285 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.285 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:09.285 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033787+0000", 2024-04-25T22:53:09.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4703999999999997e-05 2024-04-25T22:53:09.285 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.285 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.285 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:09.285 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033826+0000", 2024-04-25T22:53:09.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8458999999999999e-05 2024-04-25T22:53:09.286 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:09.286 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:09.286 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:09.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.286 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:09.286 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:09.286 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 76.214097007999996, 2024-04-25T22:53:09.286 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021244174000000001, 2024-04-25T22:53:09.286 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:09.286 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:09.286 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:09.286 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:09.287 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.287 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:09.287 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:09.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:09.287 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.287 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.287 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:09.287 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:09.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:09.287 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.287 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.287 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:09.287 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:09.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:09.288 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.288 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.288 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:09.288 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012712+0000", 2024-04-25T22:53:09.288 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.913e-06 2024-04-25T22:53:09.288 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.288 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.288 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:09.288 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012722+0000", 2024-04-25T22:53:09.288 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2879999999999998e-06 2024-04-25T22:53:09.288 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.288 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.288 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:09.288 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012727+0000", 2024-04-25T22:53:09.289 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8429999999999998e-06 2024-04-25T22:53:09.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.289 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:09.289 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026099+0000", 2024-04-25T22:53:09.289 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013371450999999999 2024-04-25T22:53:09.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.289 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:09.289 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026147+0000", 2024-04-25T22:53:09.289 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7837999999999998e-05 2024-04-25T22:53:09.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:09.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026254+0000", 2024-04-25T22:53:09.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107314 2024-04-25T22:53:09.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:09.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026686+0000", 2024-04-25T22:53:09.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000432428 2024-04-25T22:53:09.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:09.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033873+0000", 2024-04-25T22:53:09.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071864399999999997 2024-04-25T22:53:09.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.291 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.291 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:09.291 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033904+0000", 2024-04-25T22:53:09.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1321e-05 2024-04-25T22:53:09.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.291 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.291 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:09.291 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033950+0000", 2024-04-25T22:53:09.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5707999999999997e-05 2024-04-25T22:53:09.291 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:09.291 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:09.291 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:09.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.292 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.292 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:09.292 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:09.292 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 76.214066622999994, 2024-04-25T22:53:09.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01096505, 2024-04-25T22:53:09.292 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:09.292 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:09.292 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:09.292 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:09.292 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.292 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:09.292 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:09.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:09.292 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:09.293 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:09.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:09.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:09.293 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012737+0000", 2024-04-25T22:53:09.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:09.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:09.293 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012739+0000", 2024-04-25T22:53:09.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-04-25T22:53:09.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:09.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012743+0000", 2024-04-25T22:53:09.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3239999999999996e-06 2024-04-25T22:53:09.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:09.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012746+0000", 2024-04-25T22:53:09.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.129e-06 2024-04-25T22:53:09.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:09.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012796+0000", 2024-04-25T22:53:09.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9231999999999999e-05 2024-04-25T22:53:09.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:09.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012915+0000", 2024-04-25T22:53:09.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119021 2024-04-25T22:53:09.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:09.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013069+0000", 2024-04-25T22:53:09.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015463900000000001 2024-04-25T22:53:09.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:09.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019237+0000", 2024-04-25T22:53:09.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061680329999999998 2024-04-25T22:53:09.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.296 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:09.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023603+0000", 2024-04-25T22:53:09.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043655860000000003 2024-04-25T22:53:09.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.296 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:09.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023659+0000", 2024-04-25T22:53:09.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6484000000000003e-05 2024-04-25T22:53:09.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.297 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:09.297 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023701+0000", 2024-04-25T22:53:09.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1761999999999998e-05 2024-04-25T22:53:09.297 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:09.297 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:09.297 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:09.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.297 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:09.297 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:09.297 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 76.214041675000004, 2024-04-25T22:53:09.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011234429000000001, 2024-04-25T22:53:09.297 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:09.298 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:09.298 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:09.298 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:09.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:09.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:09.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:09.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:09.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:09.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:09.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:09.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012762+0000", 2024-04-25T22:53:09.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-04-25T22:53:09.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:09.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012765+0000", 2024-04-25T22:53:09.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2569999999999999e-06 2024-04-25T22:53:09.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:09.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012783+0000", 2024-04-25T22:53:09.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8431999999999999e-05 2024-04-25T22:53:09.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:09.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012799+0000", 2024-04-25T22:53:09.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5438999999999999e-05 2024-04-25T22:53:09.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:09.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013826+0000", 2024-04-25T22:53:09.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010275060000000001 2024-04-25T22:53:09.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:09.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013913+0000", 2024-04-25T22:53:09.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.708e-05 2024-04-25T22:53:09.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:09.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014098+0000", 2024-04-25T22:53:09.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018519399999999999 2024-04-25T22:53:09.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:09.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019684+0000", 2024-04-25T22:53:09.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055860079999999999 2024-04-25T22:53:09.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:09.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023876+0000", 2024-04-25T22:53:09.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041918800000000003 2024-04-25T22:53:09.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:09.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023957+0000", 2024-04-25T22:53:09.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1165e-05 2024-04-25T22:53:09.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:09.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023995+0000", 2024-04-25T22:53:09.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:53:09.302 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:09.303 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:09.303 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:09.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.303 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:09.303 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:09.303 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 76.213943896000004, 2024-04-25T22:53:09.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011131200000000001, 2024-04-25T22:53:09.303 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:09.303 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:09.303 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:09.303 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:09.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.303 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:09.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:09.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:09.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:09.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:09.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:09.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:09.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012860+0000", 2024-04-25T22:53:09.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3900000000000004e-07 2024-04-25T22:53:09.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:09.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012865+0000", 2024-04-25T22:53:09.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5609999999999998e-06 2024-04-25T22:53:09.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:09.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012895+0000", 2024-04-25T22:53:09.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9847000000000001e-05 2024-04-25T22:53:09.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:09.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012905+0000", 2024-04-25T22:53:09.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.03e-05 2024-04-25T22:53:09.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:09.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015020+0000", 2024-04-25T22:53:09.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021142940000000001 2024-04-25T22:53:09.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:09.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015182+0000", 2024-04-25T22:53:09.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016248099999999999 2024-04-25T22:53:09.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:09.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015357+0000", 2024-04-25T22:53:09.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017471000000000001 2024-04-25T22:53:09.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:09.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021021+0000", 2024-04-25T22:53:09.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056638340000000004 2024-04-25T22:53:09.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:09.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023712+0000", 2024-04-25T22:53:09.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026910380000000002 2024-04-25T22:53:09.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:09.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023763+0000", 2024-04-25T22:53:09.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1477999999999997e-05 2024-04-25T22:53:09.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:09.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023990+0000", 2024-04-25T22:53:09.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000226818 2024-04-25T22:53:09.308 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:09.308 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:09.308 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:09.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.308 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:09.308 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:09.309 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 76.213820799999993, 2024-04-25T22:53:09.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011705299000000001, 2024-04-25T22:53:09.309 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:09.309 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:09.309 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:09.309 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:09.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:09.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:09.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:09.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:09.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:09.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:09.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:09.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012983+0000", 2024-04-25T22:53:09.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:53:09.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:09.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012986+0000", 2024-04-25T22:53:09.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5700000000000001e-06 2024-04-25T22:53:09.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:09.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012993+0000", 2024-04-25T22:53:09.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8730000000000001e-06 2024-04-25T22:53:09.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:09.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013000+0000", 2024-04-25T22:53:09.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1890000000000001e-06 2024-04-25T22:53:09.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:09.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:53:09.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002147866 2024-04-25T22:53:09.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:09.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015351+0000", 2024-04-25T22:53:09.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020300799999999999 2024-04-25T22:53:09.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:09.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016260+0000", 2024-04-25T22:53:09.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00090926799999999997 2024-04-25T22:53:09.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:09.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022669+0000", 2024-04-25T22:53:09.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064082849999999997 2024-04-25T22:53:09.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:09.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024584+0000", 2024-04-25T22:53:09.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019151699999999999 2024-04-25T22:53:09.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:09.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024643+0000", 2024-04-25T22:53:09.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8888999999999998e-05 2024-04-25T22:53:09.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:09.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024687+0000", 2024-04-25T22:53:09.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4444999999999999e-05 2024-04-25T22:53:09.315 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:09.315 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:09.315 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:09.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.315 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:09.315 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:09.316 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 76.213793209000002, 2024-04-25T22:53:09.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011249699, 2024-04-25T22:53:09.316 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:09.316 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:09.316 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:09.316 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:09.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:09.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:09.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:09.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:09.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:09.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:09.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:09.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013010+0000", 2024-04-25T22:53:09.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2099999999999996e-07 2024-04-25T22:53:09.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:09.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013013+0000", 2024-04-25T22:53:09.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1310000000000002e-06 2024-04-25T22:53:09.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:09.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013020+0000", 2024-04-25T22:53:09.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3330000000000002e-06 2024-04-25T22:53:09.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:09.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013025+0000", 2024-04-25T22:53:09.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6760000000000004e-06 2024-04-25T22:53:09.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:09.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013163+0000", 2024-04-25T22:53:09.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013824599999999999 2024-04-25T22:53:09.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:09.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013504+0000", 2024-04-25T22:53:09.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034080299999999998 2024-04-25T22:53:09.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:09.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013613+0000", 2024-04-25T22:53:09.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108705 2024-04-25T22:53:09.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:09.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015831+0000", 2024-04-25T22:53:09.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002217672 2024-04-25T22:53:09.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:09.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024137+0000", 2024-04-25T22:53:09.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0083060489999999994 2024-04-25T22:53:09.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:09.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024218+0000", 2024-04-25T22:53:09.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1351000000000001e-05 2024-04-25T22:53:09.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:09.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024259+0000", 2024-04-25T22:53:09.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1112000000000002e-05 2024-04-25T22:53:09.321 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:09.321 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:09.321 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:09.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.321 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:09.321 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:09.321 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 76.213705482999998, 2024-04-25T22:53:09.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020379749999999999, 2024-04-25T22:53:09.321 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:09.321 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:09.321 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:09.321 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:09.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:09.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:09.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:09.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:09.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:09.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:09.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:09.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013098+0000", 2024-04-25T22:53:09.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:53:09.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:09.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013105+0000", 2024-04-25T22:53:09.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5969999999999997e-06 2024-04-25T22:53:09.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:09.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013190+0000", 2024-04-25T22:53:09.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5618999999999995e-05 2024-04-25T22:53:09.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:09.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013200+0000", 2024-04-25T22:53:09.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5859999999999994e-06 2024-04-25T22:53:09.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:09.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020265+0000", 2024-04-25T22:53:09.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070653349999999998 2024-04-25T22:53:09.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:09.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020454+0000", 2024-04-25T22:53:09.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189316 2024-04-25T22:53:09.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:09.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020586+0000", 2024-04-25T22:53:09.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013195700000000001 2024-04-25T22:53:09.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:09.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023822+0000", 2024-04-25T22:53:09.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032358529999999999 2024-04-25T22:53:09.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:09.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033409+0000", 2024-04-25T22:53:09.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095870520000000004 2024-04-25T22:53:09.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:09.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033447+0000", 2024-04-25T22:53:09.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7261999999999997e-05 2024-04-25T22:53:09.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:09.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033477+0000", 2024-04-25T22:53:09.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0389e-05 2024-04-25T22:53:09.326 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:09.326 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:09.326 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:09.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.327 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:09.327 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:09.327 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 76.213588977000001, 2024-04-25T22:53:09.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010857383999999999, 2024-04-25T22:53:09.327 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:09.327 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:09.327 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:09.327 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:09.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:09.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:09.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:09.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:09.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:09.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:09.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:09.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:09.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:09.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:09.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013218+0000", 2024-04-25T22:53:09.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8199999999999998e-06 2024-04-25T22:53:09.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:09.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013226+0000", 2024-04-25T22:53:09.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7649999999999993e-06 2024-04-25T22:53:09.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:09.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013259+0000", 2024-04-25T22:53:09.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2727e-05 2024-04-25T22:53:09.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:09.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014809+0000", 2024-04-25T22:53:09.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001550144 2024-04-25T22:53:09.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:09.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014958+0000", 2024-04-25T22:53:09.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014890300000000001 2024-04-25T22:53:09.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:09.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015087+0000", 2024-04-25T22:53:09.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012939200000000001 2024-04-25T22:53:09.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:09.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020212+0000", 2024-04-25T22:53:09.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051248939999999996 2024-04-25T22:53:09.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:09.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023699+0000", 2024-04-25T22:53:09.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034873289999999999 2024-04-25T22:53:09.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:09.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024014+0000", 2024-04-25T22:53:09.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031473999999999999 2024-04-25T22:53:09.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:09.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024071+0000", 2024-04-25T22:53:09.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7040000000000003e-05 2024-04-25T22:53:09.332 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:09.332 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:09.332 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:09.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.332 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:09.332 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:09.332 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 76.213534272000004, 2024-04-25T22:53:09.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012329677000000001, 2024-04-25T22:53:09.333 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:09.333 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:09.333 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:09.333 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:09.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:09.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:09.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:09.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:09.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:09.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:09.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:09.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013269+0000", 2024-04-25T22:53:09.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5000000000000002e-07 2024-04-25T22:53:09.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:09.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:09.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6909999999999999e-06 2024-04-25T22:53:09.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:09.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013284+0000", 2024-04-25T22:53:09.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0963e-05 2024-04-25T22:53:09.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:09.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013361+0000", 2024-04-25T22:53:09.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7379999999999994e-05 2024-04-25T22:53:09.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:09.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013448+0000", 2024-04-25T22:53:09.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6990000000000006e-05 2024-04-25T22:53:09.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:09.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013632+0000", 2024-04-25T22:53:09.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018396800000000001 2024-04-25T22:53:09.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:09.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013800+0000", 2024-04-25T22:53:09.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167467 2024-04-25T22:53:09.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:09.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.018570+0000", 2024-04-25T22:53:09.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047701460000000003 2024-04-25T22:53:09.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:09.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025507+0000", 2024-04-25T22:53:09.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069372039999999998 2024-04-25T22:53:09.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:09.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025562+0000", 2024-04-25T22:53:09.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4858999999999998e-05 2024-04-25T22:53:09.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:09.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025598+0000", 2024-04-25T22:53:09.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6259e-05 2024-04-25T22:53:09.337 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:09.337 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:09.338 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:09.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.338 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:09.338 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:09.338 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 76.213402399000003, 2024-04-25T22:53:09.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020176666999999999, 2024-04-25T22:53:09.338 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:09.338 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:09.338 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:53:09.338 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:09.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:09.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:09.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:09.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:09.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:09.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:09.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:09.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:09.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-04-25T22:53:09.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:09.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013405+0000", 2024-04-25T22:53:09.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0559999999999998e-06 2024-04-25T22:53:09.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:09.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013422+0000", 2024-04-25T22:53:09.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6770999999999999e-05 2024-04-25T22:53:09.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:09.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013431+0000", 2024-04-25T22:53:09.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5019999999999998e-06 2024-04-25T22:53:09.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:09.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021720+0000", 2024-04-25T22:53:09.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082884340000000008 2024-04-25T22:53:09.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:09.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022122+0000", 2024-04-25T22:53:09.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000401634 2024-04-25T22:53:09.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:09.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:09.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:09.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033577+0000", 2024-04-25T22:53:09.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011455435999999999 2024-04-25T22:53:09.341 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:09.342 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:09.342 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:09.342 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:09.342 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:09.342 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:09.343 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:09.344 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:09.343+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:09.444 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:09.444+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:09.450 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:09.451 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:09.451 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-25T22:53:09.451 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:09.459 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:09.545 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:09.545+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:09.561 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:09.561 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:09.561 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-25T22:53:09.561 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-25T22:53:09.561 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:09.570 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:09.647 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:09.646+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:09.714 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:09.714 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:53:09.715 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:53:09.715 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:53:09.715 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.715 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:53:09.715 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:09.715 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 81.745771782999995, 2024-04-25T22:53:09.715 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:53:09.715 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:09.715 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:09.715 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:09.715 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:09.715 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.715 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:09.715 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:09.716 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:09.716 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.716 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.716 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:09.716 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:09.716 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:09.716 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.716 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.716 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:09.716 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:53:09.716 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:53:09.716 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.716 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.716 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:09.717 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:53:09.717 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:53:09.717 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.717 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.717 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:09.717 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:53:09.717 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:53:09.717 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.717 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.717 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:09.717 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:53:09.717 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:53:09.717 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.717 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.718 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:09.718 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:53:09.718 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:53:09.718 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.718 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.718 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:09.718 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:53:09.718 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:53:09.718 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.718 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.718 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:09.718 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:53:09.718 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:53:09.719 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.719 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.719 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:09.719 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:53:09.719 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:53:09.719 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:09.719 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:09.721 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:09.721 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.721 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.721 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:110 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'72, mlcod=10'68)", 2024-04-25T22:53:09.721 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:09.722 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 81.745137783000004, 2024-04-25T22:53:09.722 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065316630000000001, 2024-04-25T22:53:09.722 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:09.722 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:09.722 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:09.722 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:09.722 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.722 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:09.722 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:09.722 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:09.722 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.722 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.722 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:09.723 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:09.723 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:09.723 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.723 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.723 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:09.723 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:09.723 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.58e-07 2024-04-25T22:53:09.723 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.723 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.723 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:09.723 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967811+0000", 2024-04-25T22:53:09.723 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.118e-06 2024-04-25T22:53:09.723 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.723 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.723 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:09.724 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967817+0000", 2024-04-25T22:53:09.724 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3709999999999996e-06 2024-04-25T22:53:09.724 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.724 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.724 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:09.724 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967820+0000", 2024-04-25T22:53:09.724 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2210000000000002e-06 2024-04-25T22:53:09.724 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.724 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.724 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:09.724 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967876+0000", 2024-04-25T22:53:09.724 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5507000000000002e-05 2024-04-25T22:53:09.724 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.724 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.725 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:09.725 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967893+0000", 2024-04-25T22:53:09.725 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7812000000000002e-05 2024-04-25T22:53:09.725 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.725 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.725 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:09.725 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974317+0000", 2024-04-25T22:53:09.725 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064237160000000003 2024-04-25T22:53:09.725 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.725 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.725 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:09.725 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:53:09.725 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.156e-05 2024-04-25T22:53:09.725 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:09.726 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:09.726 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:09.726 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.726 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.726 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'68)", 2024-04-25T22:53:09.726 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:09.726 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 81.744720270000002, 2024-04-25T22:53:09.726 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061292279999999996, 2024-04-25T22:53:09.726 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:09.726 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:09.726 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:09.726 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:09.726 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.726 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:09.726 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:09.727 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:09.727 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.727 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.727 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:09.727 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:09.727 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:09.727 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.727 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.727 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:09.727 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:09.727 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6300000000000001e-07 2024-04-25T22:53:09.727 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.727 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.727 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:09.727 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968228+0000", 2024-04-25T22:53:09.727 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6139999999999999e-06 2024-04-25T22:53:09.728 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.728 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.728 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:09.728 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968235+0000", 2024-04-25T22:53:09.728 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7020000000000001e-06 2024-04-25T22:53:09.728 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.728 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.728 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:09.728 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968238+0000", 2024-04-25T22:53:09.728 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0010000000000002e-06 2024-04-25T22:53:09.728 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.728 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.728 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:09.728 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968297+0000", 2024-04-25T22:53:09.728 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8424999999999997e-05 2024-04-25T22:53:09.729 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.729 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.729 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:09.729 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968316+0000", 2024-04-25T22:53:09.729 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8814999999999999e-05 2024-04-25T22:53:09.729 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.729 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.729 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:09.729 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:53:09.729 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060239439999999998 2024-04-25T22:53:09.729 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.729 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.729 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:09.729 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974354+0000", 2024-04-25T22:53:09.730 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4364e-05 2024-04-25T22:53:09.730 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:09.730 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:09.730 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:09.730 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.730 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.730 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'68)", 2024-04-25T22:53:09.730 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:09.730 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 81.744283268000004, 2024-04-25T22:53:09.730 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005948414, 2024-04-25T22:53:09.730 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:09.730 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:09.730 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:09.730 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:09.731 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.731 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:09.731 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:09.731 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:09.731 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.731 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.731 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:09.731 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:09.731 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:09.731 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.731 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.731 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:09.731 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:09.731 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6199999999999998e-07 2024-04-25T22:53:09.732 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.732 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.732 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:09.732 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968723+0000", 2024-04-25T22:53:09.732 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1148999999999993e-05 2024-04-25T22:53:09.732 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.732 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.732 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:09.732 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968730+0000", 2024-04-25T22:53:09.732 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1749999999999999e-06 2024-04-25T22:53:09.732 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.732 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.732 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:09.732 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968734+0000", 2024-04-25T22:53:09.732 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5200000000000002e-06 2024-04-25T22:53:09.733 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.733 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.733 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:09.733 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968771+0000", 2024-04-25T22:53:09.733 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6851999999999999e-05 2024-04-25T22:53:09.733 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.733 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.733 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:09.733 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968788+0000", 2024-04-25T22:53:09.733 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7027000000000001e-05 2024-04-25T22:53:09.733 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.733 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.733 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:09.734 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974589+0000", 2024-04-25T22:53:09.734 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058013320000000002 2024-04-25T22:53:09.734 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.734 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.734 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:09.734 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974610+0000", 2024-04-25T22:53:09.734 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0897e-05 2024-04-25T22:53:09.734 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:09.734 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:09.734 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:09.734 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.734 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.734 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'68)", 2024-04-25T22:53:09.735 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:09.735 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 81.743713258, 2024-04-25T22:53:09.735 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053935750000000003, 2024-04-25T22:53:09.735 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:09.735 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:09.735 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:09.735 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:09.735 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.735 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:09.735 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:09.735 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:09.735 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.735 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.735 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:09.736 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:09.736 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:09.736 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.736 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.736 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:09.736 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:09.736 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.03e-07 2024-04-25T22:53:09.736 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.736 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.736 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:09.736 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969235+0000", 2024-04-25T22:53:09.736 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2399999999999999e-06 2024-04-25T22:53:09.736 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.737 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.737 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:09.737 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969242+0000", 2024-04-25T22:53:09.737 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1269999999999997e-06 2024-04-25T22:53:09.737 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.737 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.737 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:09.737 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969246+0000", 2024-04-25T22:53:09.737 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3840000000000001e-06 2024-04-25T22:53:09.737 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.737 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.737 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:09.737 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969278+0000", 2024-04-25T22:53:09.737 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1868e-05 2024-04-25T22:53:09.738 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.738 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.738 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:09.738 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969295+0000", 2024-04-25T22:53:09.738 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7530999999999999e-05 2024-04-25T22:53:09.738 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.738 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.738 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:09.738 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974611+0000", 2024-04-25T22:53:09.738 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053160789999999996 2024-04-25T22:53:09.738 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.738 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.738 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:09.738 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974625+0000", 2024-04-25T22:53:09.739 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3943e-05 2024-04-25T22:53:09.739 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:09.739 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:09.739 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:09.739 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.739 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.739 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-25T22:53:09.739 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:09.739 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 81.550117349999994, 2024-04-25T22:53:09.739 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054952610000000004, 2024-04-25T22:53:09.739 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:09.739 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:09.739 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:09.739 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:09.739 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.740 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:09.740 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:09.740 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:09.740 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.740 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.740 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:09.740 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:09.740 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:09.740 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.740 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.740 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:09.740 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:09.740 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.68e-07 2024-04-25T22:53:09.740 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.740 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.741 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:09.741 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162898+0000", 2024-04-25T22:53:09.741 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9470999999999999e-05 2024-04-25T22:53:09.741 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.741 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.741 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:09.741 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162906+0000", 2024-04-25T22:53:09.741 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1580000000000005e-06 2024-04-25T22:53:09.741 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.741 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.741 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:09.741 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162911+0000", 2024-04-25T22:53:09.741 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4779999999999999e-06 2024-04-25T22:53:09.741 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.741 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.742 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:09.742 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162952+0000", 2024-04-25T22:53:09.742 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0629e-05 2024-04-25T22:53:09.742 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.742 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.742 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:09.742 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162968+0000", 2024-04-25T22:53:09.742 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6239000000000002e-05 2024-04-25T22:53:09.742 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.742 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.742 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:09.742 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168281+0000", 2024-04-25T22:53:09.742 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053132869999999999 2024-04-25T22:53:09.743 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.743 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.743 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:09.743 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168323+0000", 2024-04-25T22:53:09.743 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1430999999999997e-05 2024-04-25T22:53:09.743 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:09.743 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:09.743 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:09.743 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.743 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.743 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-04-25T22:53:09.743 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:09.743 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 81.119639988000003, 2024-04-25T22:53:09.743 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050872510000000001, 2024-04-25T22:53:09.743 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:09.744 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:09.744 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:09.744 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:09.744 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.744 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:09.744 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:09.744 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:09.744 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.744 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.744 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:09.744 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:09.744 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:09.744 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.744 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.744 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:09.744 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:09.745 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.72e-07 2024-04-25T22:53:09.745 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.745 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.745 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:09.745 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593381+0000", 2024-04-25T22:53:09.745 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5797000000000006e-05 2024-04-25T22:53:09.745 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.745 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.745 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:09.745 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593389+0000", 2024-04-25T22:53:09.745 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8480000000000001e-06 2024-04-25T22:53:09.745 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.745 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.745 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:09.746 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593393+0000", 2024-04-25T22:53:09.746 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4819999999999996e-06 2024-04-25T22:53:09.746 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.746 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.746 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:09.746 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593435+0000", 2024-04-25T22:53:09.746 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1600000000000002e-05 2024-04-25T22:53:09.746 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.746 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.746 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:09.746 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593454+0000", 2024-04-25T22:53:09.746 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8868e-05 2024-04-25T22:53:09.746 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.747 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.747 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:09.747 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598350+0000", 2024-04-25T22:53:09.747 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004895763 2024-04-25T22:53:09.747 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.747 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.747 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:09.747 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598392+0000", 2024-04-25T22:53:09.747 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2521000000000002e-05 2024-04-25T22:53:09.747 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:09.747 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:09.747 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:09.748 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.748 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.748 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:09.748 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:09.748 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 76.701276084, 2024-04-25T22:53:09.748 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:53:09.748 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:09.748 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:09.748 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:09.748 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:09.748 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.748 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:09.748 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:09.748 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:09.748 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.749 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.749 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:09.749 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:09.749 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:09.749 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.749 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.749 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:09.749 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:53:09.749 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:53:09.749 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.749 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.749 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:09.749 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:53:09.749 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:53:09.750 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.750 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.750 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:09.750 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:53:09.750 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:53:09.750 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.750 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.750 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:09.750 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:53:09.750 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:53:09.750 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.750 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.750 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:09.750 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:53:09.751 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:53:09.751 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.751 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.751 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:09.751 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:53:09.751 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:53:09.751 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.751 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.751 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:09.751 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:53:09.751 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:53:09.751 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.751 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.751 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:09.751 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:53:09.751 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:53:09.752 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.752 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.752 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:09.752 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:53:09.752 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:53:09.752 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.752 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.752 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:09.752 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:53:09.752 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:53:09.752 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.752 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.752 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:09.752 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:53:09.752 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:53:09.753 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:09.753 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:09.753 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:09.753 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.753 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.753 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:09.753 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:09.753 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 76.700601707999994, 2024-04-25T22:53:09.753 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:53:09.753 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:09.753 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:09.753 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:09.753 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:09.753 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.753 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:09.754 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:09.754 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:09.754 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.754 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.754 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:09.754 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:09.754 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:09.754 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.754 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.754 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:09.754 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:53:09.754 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:53:09.754 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.754 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.755 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:09.755 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:53:09.755 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:53:09.755 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.755 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.755 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:09.755 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:53:09.755 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:53:09.755 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.755 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.755 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:09.755 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:53:09.755 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:53:09.756 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.756 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.756 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:09.756 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:53:09.756 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:53:09.756 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.756 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.756 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:09.756 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:53:09.756 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:53:09.756 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.756 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.756 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:09.756 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:53:09.757 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:53:09.757 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.757 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.757 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:09.757 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:53:09.757 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:53:09.757 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.757 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.757 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:09.757 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:53:09.757 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:53:09.757 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.757 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.757 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:09.757 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:53:09.758 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:53:09.758 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.758 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.758 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:09.758 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:53:09.758 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:53:09.758 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:09.758 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:09.758 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:09.758 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.758 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.758 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:09.758 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:09.758 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 76.700092495999996, 2024-04-25T22:53:09.759 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:53:09.759 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:09.759 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:09.759 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:09.759 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:09.759 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.759 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:09.759 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:09.759 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:09.759 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.759 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.759 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:09.759 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:09.759 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:09.760 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.760 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.760 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:09.760 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:53:09.760 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:53:09.760 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.760 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.760 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:09.760 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:53:09.760 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:53:09.760 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.760 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.760 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:09.761 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:53:09.761 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:53:09.761 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.761 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.761 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:09.761 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:53:09.761 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:53:09.761 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.761 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.761 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:09.761 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:53:09.761 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:53:09.761 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.761 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.761 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:09.762 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:53:09.762 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:53:09.762 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.762 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.762 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:09.762 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:53:09.762 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:53:09.762 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.762 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.762 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:09.762 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:53:09.762 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:53:09.762 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.763 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.763 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:09.763 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:53:09.763 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:53:09.763 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.763 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.763 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:09.763 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:53:09.763 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:53:09.763 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.763 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.763 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:09.763 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:53:09.763 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:53:09.764 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:09.764 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:09.764 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:09.764 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.764 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.764 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:09.764 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:09.764 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 76.699679298000007, 2024-04-25T22:53:09.764 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:53:09.764 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:09.764 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:09.764 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:09.764 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:09.764 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.764 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:09.764 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:09.765 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:09.765 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.765 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.765 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:09.765 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:09.765 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:09.765 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.765 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.765 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:09.765 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:09.765 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:53:09.765 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.765 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.766 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:09.766 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:09.766 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:53:09.766 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.766 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.766 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:09.766 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:53:09.766 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:53:09.766 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.766 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.766 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:09.766 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:53:09.766 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:53:09.766 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.766 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.767 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:09.767 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:53:09.767 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:53:09.767 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.767 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.767 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:09.767 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:53:09.767 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:53:09.767 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.767 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.767 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:09.767 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:53:09.767 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:53:09.767 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.767 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.767 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:09.768 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:53:09.768 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:53:09.768 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.768 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.768 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:09.768 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:53:09.768 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:53:09.768 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.768 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.768 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:09.768 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:53:09.768 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:53:09.768 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.768 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.768 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:09.768 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:53:09.769 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:53:09.769 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:09.769 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:09.769 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:09.769 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.769 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.769 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:09.769 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:09.769 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 76.699628627999999, 2024-04-25T22:53:09.769 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:53:09.769 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:09.769 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:09.769 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:09.769 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:09.769 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.770 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:09.770 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:09.770 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:09.770 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.770 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.770 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:09.770 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:09.770 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:09.770 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.770 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.770 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:09.770 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:53:09.770 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:53:09.771 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.771 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.771 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:09.771 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:53:09.771 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:53:09.771 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.771 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.771 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:09.771 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:53:09.771 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:53:09.771 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.771 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.771 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:09.772 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:53:09.772 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:53:09.772 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.772 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.772 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:09.772 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:53:09.772 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:53:09.772 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.772 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.772 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:09.772 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:53:09.772 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:53:09.772 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.772 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.773 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:09.773 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:53:09.773 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:53:09.773 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.773 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.773 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:09.773 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:53:09.773 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:53:09.773 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.773 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.773 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:09.773 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:53:09.773 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:53:09.773 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.774 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.774 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:09.774 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:53:09.774 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:53:09.774 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.774 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.774 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:09.774 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:53:09.774 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:53:09.774 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.774 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.774 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:09.774 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:53:09.775 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:53:09.775 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.775 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.775 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:09.775 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:53:09.775 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:53:09.775 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:09.775 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:09.775 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:09.775 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.775 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.775 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:09.775 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:09.775 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 76.699591759, 2024-04-25T22:53:09.775 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:53:09.776 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:09.776 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:09.776 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:09.776 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:09.776 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.776 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:09.776 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:09.776 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:09.776 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.776 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.776 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:09.776 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:09.776 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:09.776 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.776 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.777 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:09.777 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:53:09.777 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:53:09.777 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.777 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.777 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:09.777 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:53:09.777 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:53:09.777 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.777 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.777 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:09.777 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:53:09.777 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:53:09.778 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.778 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.778 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:09.778 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:53:09.778 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:53:09.778 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.778 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.778 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:09.778 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:53:09.778 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:53:09.778 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.778 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.778 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:53:09.778 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:53:09.778 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:53:09.779 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.779 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.779 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:09.779 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:53:09.779 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:53:09.779 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.779 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.779 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:09.779 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:53:09.779 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:53:09.779 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.779 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.779 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:09.779 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:53:09.779 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:53:09.779 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.780 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.780 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:09.780 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:53:09.780 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:53:09.780 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.780 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.780 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:09.780 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:53:09.780 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:53:09.780 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.780 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.780 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:09.780 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:53:09.780 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:53:09.780 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.780 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.781 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:09.781 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:53:09.781 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:53:09.781 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:09.781 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:09.781 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:09.781 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.781 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.781 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:09.781 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:09.781 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 76.699566793000002, 2024-04-25T22:53:09.781 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:53:09.781 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:09.781 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:09.781 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:09.781 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:09.782 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.782 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:09.782 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:09.782 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:09.782 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.782 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.782 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:09.782 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:09.782 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:09.782 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.782 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.782 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:09.782 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:53:09.782 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:53:09.783 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.783 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.783 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:09.783 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:53:09.783 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:53:09.783 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.783 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.783 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:09.783 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:09.783 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:53:09.783 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.783 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.783 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:09.783 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:53:09.783 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:53:09.783 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.784 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.784 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:09.784 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:53:09.784 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:53:09.784 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.784 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.784 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:09.784 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:53:09.784 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:53:09.784 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.784 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.784 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:09.784 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:53:09.784 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:53:09.785 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.785 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.785 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:09.785 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:53:09.785 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:53:09.785 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.785 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.785 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:09.785 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:53:09.785 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:53:09.785 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.785 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.785 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:09.785 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:53:09.785 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:53:09.785 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.786 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.786 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:09.786 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:53:09.786 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:53:09.786 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:09.786 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:09.786 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:09.786 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.786 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.786 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:09.786 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:09.786 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 76.699530429000006, 2024-04-25T22:53:09.786 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:53:09.786 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:09.787 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:09.787 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:09.787 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:09.787 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.787 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:09.787 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:09.787 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:09.787 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.787 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.787 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:09.787 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:09.787 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:09.787 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.787 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.787 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:09.787 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:53:09.788 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:53:09.788 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.788 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.788 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:09.788 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:53:09.788 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:53:09.788 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.788 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.788 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:09.788 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:53:09.788 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:53:09.788 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.788 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.788 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:09.788 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:53:09.789 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:53:09.789 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.789 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.789 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:09.789 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:53:09.789 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:53:09.789 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.789 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.789 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:09.789 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:53:09.789 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:53:09.789 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.789 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.789 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:09.789 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:53:09.789 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:53:09.790 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.790 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.790 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:09.790 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:53:09.790 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:53:09.790 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.790 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.790 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:09.790 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:53:09.790 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:53:09.790 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:09.790 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:09.790 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:09.791 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.791 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.791 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:09.791 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:09.791 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 76.699499348000003, 2024-04-25T22:53:09.791 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:53:09.791 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:09.791 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:09.791 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:09.791 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:09.791 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.791 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:09.791 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:09.791 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:09.791 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.791 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.792 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:09.792 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:09.792 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:09.792 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.792 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.792 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:09.792 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:09.792 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:09.792 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.792 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.792 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:09.792 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:53:09.792 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:53:09.792 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.792 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.792 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:09.793 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:53:09.793 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:53:09.793 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.793 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.793 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:09.793 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:53:09.793 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:53:09.793 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.793 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.793 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:09.793 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:53:09.793 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:53:09.793 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.793 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.793 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:09.794 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:53:09.794 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:53:09.794 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.794 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.794 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:09.794 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:53:09.794 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:53:09.794 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:09.794 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:09.794 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:09.794 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.794 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.794 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:53:09.794 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:09.794 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 76.699058378999993, 2024-04-25T22:53:09.795 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064881979999999997, 2024-04-25T22:53:09.795 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:09.795 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:09.795 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:09.795 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:09.795 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.795 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:09.795 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:09.795 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:09.795 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.795 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.795 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:09.795 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:09.795 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:09.796 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.796 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.796 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:09.796 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:09.796 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2699999999999999e-07 2024-04-25T22:53:09.796 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.796 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.796 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:09.796 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013898+0000", 2024-04-25T22:53:09.796 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0796e-05 2024-04-25T22:53:09.796 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.796 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.796 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:09.796 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013907+0000", 2024-04-25T22:53:09.796 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5140000000000007e-06 2024-04-25T22:53:09.797 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.797 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.797 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:09.797 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013952+0000", 2024-04-25T22:53:09.797 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4134000000000001e-05 2024-04-25T22:53:09.797 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.797 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.797 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:09.797 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016812+0000", 2024-04-25T22:53:09.797 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028601059999999998 2024-04-25T22:53:09.797 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.797 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.797 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:09.797 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.017052+0000", 2024-04-25T22:53:09.797 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024056500000000001 2024-04-25T22:53:09.798 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.798 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.798 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:09.798 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020350+0000", 2024-04-25T22:53:09.798 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032978320000000001 2024-04-25T22:53:09.798 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.798 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.798 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:09.798 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020375+0000", 2024-04-25T22:53:09.798 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4624e-05 2024-04-25T22:53:09.798 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:09.798 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:09.798 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:09.798 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.799 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.799 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-25T22:53:09.799 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:09.799 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 76.685527933000003, 2024-04-25T22:53:09.799 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058583000000000003, 2024-04-25T22:53:09.799 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:09.799 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:09.799 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:09.799 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:09.799 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.799 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:09.799 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:09.799 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:09.799 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.800 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.800 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:09.800 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:09.800 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:09.800 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.800 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.800 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:09.800 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:09.800 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.41e-07 2024-04-25T22:53:09.800 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.800 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.800 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:09.800 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027428+0000", 2024-04-25T22:53:09.800 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.075e-05 2024-04-25T22:53:09.801 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.801 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.801 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:09.801 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027435+0000", 2024-04-25T22:53:09.801 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3610000000000003e-06 2024-04-25T22:53:09.801 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.801 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.801 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:09.801 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027442+0000", 2024-04-25T22:53:09.801 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0400000000000004e-06 2024-04-25T22:53:09.801 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.801 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.801 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:09.801 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028094+0000", 2024-04-25T22:53:09.802 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00065134800000000005 2024-04-25T22:53:09.802 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.802 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.802 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:09.802 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028107+0000", 2024-04-25T22:53:09.802 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3087e-05 2024-04-25T22:53:09.802 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.802 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.802 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:09.802 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033239+0000", 2024-04-25T22:53:09.802 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051319429999999999 2024-04-25T22:53:09.802 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.802 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.802 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:09.803 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033275+0000", 2024-04-25T22:53:09.803 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6430000000000002e-05 2024-04-25T22:53:09.803 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:09.803 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:09.803 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:09.803 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.803 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.803 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-25T22:53:09.803 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:09.803 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 76.685143096000004, 2024-04-25T22:53:09.803 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005413597, 2024-04-25T22:53:09.803 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:09.803 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:09.803 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:09.804 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:09.804 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.804 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:09.804 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:09.804 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:09.804 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.804 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.804 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:09.804 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:09.804 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:09.804 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.804 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.804 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:09.804 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:09.805 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3799999999999997e-07 2024-04-25T22:53:09.805 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.805 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.805 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:09.805 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027816+0000", 2024-04-25T22:53:09.805 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3230999999999999e-05 2024-04-25T22:53:09.805 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.805 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.805 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:09.805 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027823+0000", 2024-04-25T22:53:09.805 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9039999999999992e-06 2024-04-25T22:53:09.805 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.805 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.805 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:09.806 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027841+0000", 2024-04-25T22:53:09.806 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7651000000000001e-05 2024-04-25T22:53:09.806 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.806 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.806 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:09.806 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027904+0000", 2024-04-25T22:53:09.806 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3058000000000005e-05 2024-04-25T22:53:09.806 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.806 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.806 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:09.806 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027926+0000", 2024-04-25T22:53:09.806 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1450999999999998e-05 2024-04-25T22:53:09.806 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.807 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.807 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:09.807 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033177+0000", 2024-04-25T22:53:09.807 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052508909999999997 2024-04-25T22:53:09.807 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.807 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.807 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:09.807 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033215+0000", 2024-04-25T22:53:09.807 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8872999999999999e-05 2024-04-25T22:53:09.807 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:09.807 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:09.807 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:09.807 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.807 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.807 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 171 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:53:09.808 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:09.808 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 76.685085994000005, 2024-04-25T22:53:09.808 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054322240000000003, 2024-04-25T22:53:09.808 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:09.808 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:09.808 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "reached pg", 2024-04-25T22:53:09.808 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:09.808 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.808 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:09.808 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:09.808 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:09.808 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.808 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.808 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:09.808 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:09.808 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:09.809 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.809 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.809 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:09.809 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:09.809 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7500000000000001e-07 2024-04-25T22:53:09.809 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.809 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.809 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:09.809 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027868+0000", 2024-04-25T22:53:09.809 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5750000000000001e-06 2024-04-25T22:53:09.809 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.809 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.809 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:09.809 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027885+0000", 2024-04-25T22:53:09.810 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7272e-05 2024-04-25T22:53:09.810 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.810 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.810 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:09.810 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027900+0000", 2024-04-25T22:53:09.810 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.502e-05 2024-04-25T22:53:09.810 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.810 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.810 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:09.810 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028381+0000", 2024-04-25T22:53:09.810 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00048039399999999998 2024-04-25T22:53:09.810 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:09.810 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:09.811 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:09.811 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033291+0000", 2024-04-25T22:53:09.811 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049105879999999996 2024-04-25T22:53:09.811 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:09.811 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:09.811 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:09.811 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:09.811 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:09.811 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:09.813 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:09.813 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:09.812+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:09.913 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:09.913+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:09.922 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:09.922 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:09.922 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-04-25T22:53:09.922 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:09.931 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:10.014 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:10.014+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:10.074 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:10.075 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:10.075 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:53:10.075 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:53:10.075 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:10.083 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:10.115 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:10.115+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:10.188 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:10.188 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-04-25T22:53:10.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-04-25T22:53:10.188 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:53:10.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.188 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:10.188 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:10.188 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 82.221067093000002, 2024-04-25T22:53:10.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0103421, 2024-04-25T22:53:10.188 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:10.189 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:10.189 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:10.189 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:10.189 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:10.189 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:10.189 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 115 2024-04-25T22:53:10.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.189 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:10.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:10.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:10.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:10.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:10.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:10.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:10.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:10.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:10.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9500000000000002e-07 2024-04-25T22:53:10.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:10.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965108+0000", 2024-04-25T22:53:10.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9177999999999994e-05 2024-04-25T22:53:10.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:10.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965127+0000", 2024-04-25T22:53:10.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8868e-05 2024-04-25T22:53:10.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:10.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965133+0000", 2024-04-25T22:53:10.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8929999999999999e-06 2024-04-25T22:53:10.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:10.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.969991+0000", 2024-04-25T22:53:10.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048573849999999997 2024-04-25T22:53:10.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:10.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970072+0000", 2024-04-25T22:53:10.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0728000000000004e-05 2024-04-25T22:53:10.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:10.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970189+0000", 2024-04-25T22:53:10.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000117778 2024-04-25T22:53:10.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.193 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:10.193 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970946+0000", 2024-04-25T22:53:10.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00075704600000000004 2024-04-25T22:53:10.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.193 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:10.193 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975297+0000", 2024-04-25T22:53:10.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004350217 2024-04-25T22:53:10.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.193 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:10.193 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975343+0000", 2024-04-25T22:53:10.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6687999999999998e-05 2024-04-25T22:53:10.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.194 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:10.194 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975380+0000", 2024-04-25T22:53:10.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6724000000000003e-05 2024-04-25T22:53:10.194 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:10.194 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:10.194 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:10.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.194 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:10.194 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:10.194 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 82.220961062000001, 2024-04-25T22:53:10.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010304384, 2024-04-25T22:53:10.194 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:10.194 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:10.195 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:10.195 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:10.195 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:10.195 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:10.195 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 116 2024-04-25T22:53:10.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.195 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:10.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:10.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:10.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:10.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:10.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:10.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:10.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:10.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:10.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5799999999999999e-07 2024-04-25T22:53:10.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:10.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965154+0000", 2024-04-25T22:53:10.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0009e-05 2024-04-25T22:53:10.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:10.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965164+0000", 2024-04-25T22:53:10.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8490000000000001e-06 2024-04-25T22:53:10.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:10.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965169+0000", 2024-04-25T22:53:10.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0730000000000004e-06 2024-04-25T22:53:10.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:10.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970609+0000", 2024-04-25T22:53:10.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054397689999999997 2024-04-25T22:53:10.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:10.198 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970651+0000", 2024-04-25T22:53:10.198 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1873999999999999e-05 2024-04-25T22:53:10.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.198 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:10.198 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970723+0000", 2024-04-25T22:53:10.198 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2039999999999995e-05 2024-04-25T22:53:10.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.198 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:10.198 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971358+0000", 2024-04-25T22:53:10.198 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063489500000000001 2024-04-25T22:53:10.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:10.199 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975409+0000", 2024-04-25T22:53:10.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040506880000000002 2024-04-25T22:53:10.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:10.199 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975432+0000", 2024-04-25T22:53:10.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3315999999999998e-05 2024-04-25T22:53:10.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:10.200 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975448+0000", 2024-04-25T22:53:10.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6313000000000001e-05 2024-04-25T22:53:10.200 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:10.200 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:10.200 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:10.200 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.200 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.200 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:10.200 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:10.200 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 82.220926480000003, 2024-04-25T22:53:10.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010384338999999999, 2024-04-25T22:53:10.200 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:10.200 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:10.200 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:10.201 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:10.201 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:10.201 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:10.201 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-04-25T22:53:10.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.201 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:10.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:10.201 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:10.201 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:10.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:10.202 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:10.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:10.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.202 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.202 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:10.202 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:10.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3600000000000004e-07 2024-04-25T22:53:10.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.202 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.202 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:10.202 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965185+0000", 2024-04-25T22:53:10.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.117e-06 2024-04-25T22:53:10.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:10.203 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965192+0000", 2024-04-25T22:53:10.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3239999999999997e-06 2024-04-25T22:53:10.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:10.203 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965198+0000", 2024-04-25T22:53:10.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6370000000000004e-06 2024-04-25T22:53:10.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:10.203 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970973+0000", 2024-04-25T22:53:10.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057748239999999996 2024-04-25T22:53:10.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:10.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971049+0000", 2024-04-25T22:53:10.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6029e-05 2024-04-25T22:53:10.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:10.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971174+0000", 2024-04-25T22:53:10.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012462399999999999 2024-04-25T22:53:10.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:10.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971553+0000", 2024-04-25T22:53:10.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037896499999999999 2024-04-25T22:53:10.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:10.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975482+0000", 2024-04-25T22:53:10.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039297459999999996 2024-04-25T22:53:10.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:10.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975529+0000", 2024-04-25T22:53:10.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6387000000000002e-05 2024-04-25T22:53:10.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:10.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975563+0000", 2024-04-25T22:53:10.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4150000000000003e-05 2024-04-25T22:53:10.205 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:10.206 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:10.206 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:10.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.206 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:10.206 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:10.206 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 77.173880156999999, 2024-04-25T22:53:10.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012637705000000001, 2024-04-25T22:53:10.206 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:10.206 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:10.206 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:10.206 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:10.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.207 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:10.207 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:10.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:10.207 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.207 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:10.207 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:10.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:10.207 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.207 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:10.207 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012227+0000", 2024-04-25T22:53:10.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.863e-06 2024-04-25T22:53:10.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:10.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012236+0000", 2024-04-25T22:53:10.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1109999999999997e-06 2024-04-25T22:53:10.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:10.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012309+0000", 2024-04-25T22:53:10.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3242000000000001e-05 2024-04-25T22:53:10.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:10.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012324+0000", 2024-04-25T22:53:10.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4837e-05 2024-04-25T22:53:10.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:10.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015060+0000", 2024-04-25T22:53:10.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027363349999999999 2024-04-25T22:53:10.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:10.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015169+0000", 2024-04-25T22:53:10.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108372 2024-04-25T22:53:10.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:10.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015498+0000", 2024-04-25T22:53:10.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032949999999999999 2024-04-25T22:53:10.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:10.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021282+0000", 2024-04-25T22:53:10.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057836429999999998 2024-04-25T22:53:10.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:10.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024709+0000", 2024-04-25T22:53:10.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034271979999999998 2024-04-25T22:53:10.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:10.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024802+0000", 2024-04-25T22:53:10.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2960000000000004e-05 2024-04-25T22:53:10.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:10.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024863+0000", 2024-04-25T22:53:10.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0643999999999997e-05 2024-04-25T22:53:10.211 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:10.211 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:10.212 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:10.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.212 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:10.212 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:10.212 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 77.173756385999994, 2024-04-25T22:53:10.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012979447999999999, 2024-04-25T22:53:10.212 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:10.212 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:10.212 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:10.212 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:10.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:10.212 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:10.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:10.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.213 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:10.213 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:10.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:10.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.213 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:10.213 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:10.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:53:10.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.213 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:10.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012354+0000", 2024-04-25T22:53:10.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7740000000000004e-06 2024-04-25T22:53:10.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:10.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012365+0000", 2024-04-25T22:53:10.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.064e-05 2024-04-25T22:53:10.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:10.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012382+0000", 2024-04-25T22:53:10.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6999000000000001e-05 2024-04-25T22:53:10.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:10.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015958+0000", 2024-04-25T22:53:10.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035765699999999998 2024-04-25T22:53:10.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:10.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016037+0000", 2024-04-25T22:53:10.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8242000000000001e-05 2024-04-25T22:53:10.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:10.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016404+0000", 2024-04-25T22:53:10.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036784300000000002 2024-04-25T22:53:10.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:10.216 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021294+0000", 2024-04-25T22:53:10.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048890629999999999 2024-04-25T22:53:10.216 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.216 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:10.216 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024959+0000", 2024-04-25T22:53:10.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036651570000000001 2024-04-25T22:53:10.216 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.216 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:10.216 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025097+0000", 2024-04-25T22:53:10.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013788099999999999 2024-04-25T22:53:10.216 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:10.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025328+0000", 2024-04-25T22:53:10.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231492 2024-04-25T22:53:10.217 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:10.217 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:10.217 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:10.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.217 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:10.217 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:10.217 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 77.173668617000004, 2024-04-25T22:53:10.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013049827, 2024-04-25T22:53:10.217 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:10.217 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:10.217 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:10.217 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:10.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:10.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:10.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:10.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:10.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:10.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:10.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:10.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012437+0000", 2024-04-25T22:53:10.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-04-25T22:53:10.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:10.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012440+0000", 2024-04-25T22:53:10.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7609999999999999e-06 2024-04-25T22:53:10.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:10.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012449+0000", 2024-04-25T22:53:10.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.285e-06 2024-04-25T22:53:10.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:10.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012457+0000", 2024-04-25T22:53:10.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9510000000000006e-06 2024-04-25T22:53:10.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:10.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017106+0000", 2024-04-25T22:53:10.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046494220000000003 2024-04-25T22:53:10.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:10.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017223+0000", 2024-04-25T22:53:10.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116824 2024-04-25T22:53:10.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:10.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017345+0000", 2024-04-25T22:53:10.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122175 2024-04-25T22:53:10.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:10.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021299+0000", 2024-04-25T22:53:10.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039534879999999998 2024-04-25T22:53:10.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:10.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025398+0000", 2024-04-25T22:53:10.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040988960000000003 2024-04-25T22:53:10.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:10.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025439+0000", 2024-04-25T22:53:10.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0915999999999999e-05 2024-04-25T22:53:10.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:10.222 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025486+0000", 2024-04-25T22:53:10.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7534999999999998e-05 2024-04-25T22:53:10.222 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:10.222 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:10.222 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:10.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.222 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:10.222 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:10.222 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 77.173638466, 2024-04-25T22:53:10.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020988041999999998, 2024-04-25T22:53:10.223 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:10.223 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:10.223 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:10.223 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:10.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:10.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:10.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:10.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:10.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:10.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:10.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:10.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:10.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.99e-07 2024-04-25T22:53:10.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:10.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012470+0000", 2024-04-25T22:53:10.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2789999999999999e-06 2024-04-25T22:53:10.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:10.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012477+0000", 2024-04-25T22:53:10.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:53:10.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:10.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012500+0000", 2024-04-25T22:53:10.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2490999999999999e-05 2024-04-25T22:53:10.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:10.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021911+0000", 2024-04-25T22:53:10.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094114160000000006 2024-04-25T22:53:10.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:10.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022000+0000", 2024-04-25T22:53:10.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8601000000000001e-05 2024-04-25T22:53:10.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:10.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022359+0000", 2024-04-25T22:53:10.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035921999999999999 2024-04-25T22:53:10.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:10.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025541+0000", 2024-04-25T22:53:10.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031820619999999998 2024-04-25T22:53:10.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:10.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033375+0000", 2024-04-25T22:53:10.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078338379999999992 2024-04-25T22:53:10.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:10.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033415+0000", 2024-04-25T22:53:10.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9527000000000003e-05 2024-04-25T22:53:10.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:10.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033455+0000", 2024-04-25T22:53:10.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9932000000000003e-05 2024-04-25T22:53:10.227 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:10.227 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:10.227 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:10.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.228 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:10.228 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:10.228 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 77.173583273000006, 2024-04-25T22:53:10.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021043857999999999, 2024-04-25T22:53:10.228 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:10.228 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:10.228 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:10.228 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:10.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.228 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:10.228 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:10.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:10.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.228 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:10.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:10.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:10.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:10.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012523+0000", 2024-04-25T22:53:10.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.361e-06 2024-04-25T22:53:10.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:10.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012530+0000", 2024-04-25T22:53:10.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5440000000000004e-06 2024-04-25T22:53:10.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:10.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012541+0000", 2024-04-25T22:53:10.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1745e-05 2024-04-25T22:53:10.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:10.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012551+0000", 2024-04-25T22:53:10.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5789999999999993e-06 2024-04-25T22:53:10.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:10.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022709+0000", 2024-04-25T22:53:10.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010157685 2024-04-25T22:53:10.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:10.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022957+0000", 2024-04-25T22:53:10.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024824599999999998 2024-04-25T22:53:10.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:10.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023443+0000", 2024-04-25T22:53:10.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048578599999999999 2024-04-25T22:53:10.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:10.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025547+0000", 2024-04-25T22:53:10.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021044789999999998 2024-04-25T22:53:10.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:10.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033509+0000", 2024-04-25T22:53:10.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0079622180000000001 2024-04-25T22:53:10.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:10.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033542+0000", 2024-04-25T22:53:10.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3018000000000001e-05 2024-04-25T22:53:10.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:10.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033566+0000", 2024-04-25T22:53:10.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3197000000000002e-05 2024-04-25T22:53:10.233 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:10.233 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:10.233 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:10.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.233 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:10.233 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:10.233 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 77.173543308000006, 2024-04-25T22:53:10.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021122696, 2024-04-25T22:53:10.233 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:10.233 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:10.234 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:10.234 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:10.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:10.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:10.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:10.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:10.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:10.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:10.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:10.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:10.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:53:10.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:10.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012566+0000", 2024-04-25T22:53:10.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-04-25T22:53:10.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:10.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012619+0000", 2024-04-25T22:53:10.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2607e-05 2024-04-25T22:53:10.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:10.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012628+0000", 2024-04-25T22:53:10.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6500000000000008e-06 2024-04-25T22:53:10.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:10.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024024+0000", 2024-04-25T22:53:10.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011396007999999999 2024-04-25T22:53:10.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:10.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024198+0000", 2024-04-25T22:53:10.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000173215 2024-04-25T22:53:10.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:10.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024447+0000", 2024-04-25T22:53:10.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024898500000000002 2024-04-25T22:53:10.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:10.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026431+0000", 2024-04-25T22:53:10.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001984923 2024-04-25T22:53:10.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:10.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033608+0000", 2024-04-25T22:53:10.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071768459999999997 2024-04-25T22:53:10.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:10.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033646+0000", 2024-04-25T22:53:10.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299000000000003e-05 2024-04-25T22:53:10.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:10.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033684+0000", 2024-04-25T22:53:10.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8773000000000003e-05 2024-04-25T22:53:10.238 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:10.238 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:10.238 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:10.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.239 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:10.239 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:10.239 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 77.173454708999998, 2024-04-25T22:53:10.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021175381, 2024-04-25T22:53:10.239 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:10.239 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:10.239 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:10.239 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:10.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:10.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:10.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:10.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:10.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:10.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:10.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:10.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012651+0000", 2024-04-25T22:53:10.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:53:10.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:10.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012656+0000", 2024-04-25T22:53:10.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8899999999999998e-06 2024-04-25T22:53:10.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:10.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012666+0000", 2024-04-25T22:53:10.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0346999999999999e-05 2024-04-25T22:53:10.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:10.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012675+0000", 2024-04-25T22:53:10.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9930000000000001e-06 2024-04-25T22:53:10.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:10.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025661+0000", 2024-04-25T22:53:10.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01298531 2024-04-25T22:53:10.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:10.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025757+0000", 2024-04-25T22:53:10.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5822000000000005e-05 2024-04-25T22:53:10.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:10.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025907+0000", 2024-04-25T22:53:10.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015051499999999999 2024-04-25T22:53:10.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:10.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026435+0000", 2024-04-25T22:53:10.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052762200000000005 2024-04-25T22:53:10.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:10.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033732+0000", 2024-04-25T22:53:10.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072978419999999997 2024-04-25T22:53:10.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:10.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033787+0000", 2024-04-25T22:53:10.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4703999999999997e-05 2024-04-25T22:53:10.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:10.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033826+0000", 2024-04-25T22:53:10.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8458999999999999e-05 2024-04-25T22:53:10.244 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:10.244 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:10.244 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:10.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.244 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:10.244 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:10.244 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 77.173399294999996, 2024-04-25T22:53:10.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021244174000000001, 2024-04-25T22:53:10.244 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:10.244 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:10.244 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:10.244 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:10.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:10.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:10.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:10.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:10.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:10.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:10.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:10.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:10.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:10.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:10.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012712+0000", 2024-04-25T22:53:10.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.913e-06 2024-04-25T22:53:10.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:10.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012722+0000", 2024-04-25T22:53:10.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2879999999999998e-06 2024-04-25T22:53:10.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.247 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:10.247 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012727+0000", 2024-04-25T22:53:10.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8429999999999998e-06 2024-04-25T22:53:10.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.247 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:10.247 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026099+0000", 2024-04-25T22:53:10.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013371450999999999 2024-04-25T22:53:10.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.247 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:10.247 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026147+0000", 2024-04-25T22:53:10.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7837999999999998e-05 2024-04-25T22:53:10.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.248 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:10.248 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026254+0000", 2024-04-25T22:53:10.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107314 2024-04-25T22:53:10.248 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.248 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:10.248 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026686+0000", 2024-04-25T22:53:10.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000432428 2024-04-25T22:53:10.248 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.248 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:10.248 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033873+0000", 2024-04-25T22:53:10.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071864399999999997 2024-04-25T22:53:10.248 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:10.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033904+0000", 2024-04-25T22:53:10.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1321e-05 2024-04-25T22:53:10.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:10.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033950+0000", 2024-04-25T22:53:10.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5707999999999997e-05 2024-04-25T22:53:10.249 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:10.249 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:10.249 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:10.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.250 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:10.250 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:10.250 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 77.173368909999994, 2024-04-25T22:53:10.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01096505, 2024-04-25T22:53:10.250 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:10.250 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:10.250 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:10.250 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:10.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:10.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:10.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:10.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:10.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:10.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:10.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:10.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012737+0000", 2024-04-25T22:53:10.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:10.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.252 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:10.252 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012739+0000", 2024-04-25T22:53:10.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-04-25T22:53:10.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.252 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:10.252 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012743+0000", 2024-04-25T22:53:10.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3239999999999996e-06 2024-04-25T22:53:10.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.252 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:10.252 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012746+0000", 2024-04-25T22:53:10.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.129e-06 2024-04-25T22:53:10.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.253 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.253 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:10.253 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012796+0000", 2024-04-25T22:53:10.253 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9231999999999999e-05 2024-04-25T22:53:10.253 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.253 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.253 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:10.253 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012915+0000", 2024-04-25T22:53:10.253 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119021 2024-04-25T22:53:10.253 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.253 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.253 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:10.253 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013069+0000", 2024-04-25T22:53:10.253 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015463900000000001 2024-04-25T22:53:10.253 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:10.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019237+0000", 2024-04-25T22:53:10.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061680329999999998 2024-04-25T22:53:10.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:10.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023603+0000", 2024-04-25T22:53:10.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043655860000000003 2024-04-25T22:53:10.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:10.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023659+0000", 2024-04-25T22:53:10.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6484000000000003e-05 2024-04-25T22:53:10.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:10.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023701+0000", 2024-04-25T22:53:10.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1761999999999998e-05 2024-04-25T22:53:10.255 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:10.255 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:10.255 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:10.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.255 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:10.255 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:10.255 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 77.173343962000004, 2024-04-25T22:53:10.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011234429000000001, 2024-04-25T22:53:10.256 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:10.256 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:10.256 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:10.256 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:10.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.256 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:10.256 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:10.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:10.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.256 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:10.256 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:10.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:10.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.257 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:10.257 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012762+0000", 2024-04-25T22:53:10.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-04-25T22:53:10.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.257 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:10.257 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012765+0000", 2024-04-25T22:53:10.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2569999999999999e-06 2024-04-25T22:53:10.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.257 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:10.257 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012783+0000", 2024-04-25T22:53:10.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8431999999999999e-05 2024-04-25T22:53:10.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:10.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012799+0000", 2024-04-25T22:53:10.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5438999999999999e-05 2024-04-25T22:53:10.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:10.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013826+0000", 2024-04-25T22:53:10.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010275060000000001 2024-04-25T22:53:10.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.259 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:10.259 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013913+0000", 2024-04-25T22:53:10.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.708e-05 2024-04-25T22:53:10.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.259 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:10.259 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014098+0000", 2024-04-25T22:53:10.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018519399999999999 2024-04-25T22:53:10.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.259 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:10.259 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019684+0000", 2024-04-25T22:53:10.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055860079999999999 2024-04-25T22:53:10.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.260 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.260 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:10.260 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023876+0000", 2024-04-25T22:53:10.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041918800000000003 2024-04-25T22:53:10.260 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.260 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.260 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:10.260 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023957+0000", 2024-04-25T22:53:10.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1165e-05 2024-04-25T22:53:10.260 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.260 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.260 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:10.260 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023995+0000", 2024-04-25T22:53:10.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:53:10.260 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:10.261 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:10.261 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:10.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.261 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:10.261 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:10.261 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 77.173246183000003, 2024-04-25T22:53:10.261 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011131200000000001, 2024-04-25T22:53:10.261 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:10.261 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:10.261 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:10.261 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:10.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.261 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:10.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:10.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:10.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:10.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:10.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:10.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:10.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012860+0000", 2024-04-25T22:53:10.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3900000000000004e-07 2024-04-25T22:53:10.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:10.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012865+0000", 2024-04-25T22:53:10.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5609999999999998e-06 2024-04-25T22:53:10.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:10.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012895+0000", 2024-04-25T22:53:10.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9847000000000001e-05 2024-04-25T22:53:10.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:10.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012905+0000", 2024-04-25T22:53:10.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.03e-05 2024-04-25T22:53:10.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:10.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015020+0000", 2024-04-25T22:53:10.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021142940000000001 2024-04-25T22:53:10.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:10.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015182+0000", 2024-04-25T22:53:10.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016248099999999999 2024-04-25T22:53:10.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:10.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015357+0000", 2024-04-25T22:53:10.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017471000000000001 2024-04-25T22:53:10.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.265 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.265 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:10.265 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021021+0000", 2024-04-25T22:53:10.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056638340000000004 2024-04-25T22:53:10.265 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.265 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.265 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:10.265 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023712+0000", 2024-04-25T22:53:10.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026910380000000002 2024-04-25T22:53:10.265 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.265 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.265 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:10.265 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023763+0000", 2024-04-25T22:53:10.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1477999999999997e-05 2024-04-25T22:53:10.265 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.266 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.266 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:10.266 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023990+0000", 2024-04-25T22:53:10.266 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000226818 2024-04-25T22:53:10.266 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:10.266 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:10.266 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:10.266 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.266 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.266 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:10.266 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:10.266 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 77.173123086999993, 2024-04-25T22:53:10.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011705299000000001, 2024-04-25T22:53:10.267 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:10.267 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:10.267 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:10.267 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:10.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.267 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:10.267 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:10.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:10.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.267 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:10.267 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:10.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:10.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.268 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:10.268 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012983+0000", 2024-04-25T22:53:10.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:53:10.268 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.268 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.268 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:10.268 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012986+0000", 2024-04-25T22:53:10.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5700000000000001e-06 2024-04-25T22:53:10.268 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.268 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.268 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:10.268 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012993+0000", 2024-04-25T22:53:10.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8730000000000001e-06 2024-04-25T22:53:10.268 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.268 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.268 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:10.269 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013000+0000", 2024-04-25T22:53:10.269 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1890000000000001e-06 2024-04-25T22:53:10.269 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.269 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.269 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:10.269 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:53:10.269 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002147866 2024-04-25T22:53:10.269 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.269 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.269 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:10.269 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015351+0000", 2024-04-25T22:53:10.269 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020300799999999999 2024-04-25T22:53:10.269 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.270 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.270 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:10.270 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016260+0000", 2024-04-25T22:53:10.270 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00090926799999999997 2024-04-25T22:53:10.270 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.270 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.270 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:10.270 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022669+0000", 2024-04-25T22:53:10.270 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064082849999999997 2024-04-25T22:53:10.270 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.270 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.270 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:10.270 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024584+0000", 2024-04-25T22:53:10.270 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019151699999999999 2024-04-25T22:53:10.271 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.271 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.271 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:10.271 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024643+0000", 2024-04-25T22:53:10.271 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8888999999999998e-05 2024-04-25T22:53:10.271 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.271 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.271 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:10.271 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024687+0000", 2024-04-25T22:53:10.271 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4444999999999999e-05 2024-04-25T22:53:10.271 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:10.271 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:10.271 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:10.271 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.271 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.271 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:10.272 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:10.272 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 77.173095496000002, 2024-04-25T22:53:10.272 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011249699, 2024-04-25T22:53:10.272 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:10.272 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:10.272 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:10.272 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:10.272 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.272 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:10.272 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:10.272 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:10.272 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.272 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.272 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:10.272 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:10.272 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:10.273 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.273 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.273 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:10.273 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013010+0000", 2024-04-25T22:53:10.273 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2099999999999996e-07 2024-04-25T22:53:10.273 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.273 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.273 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:10.273 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013013+0000", 2024-04-25T22:53:10.273 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1310000000000002e-06 2024-04-25T22:53:10.273 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.273 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.273 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:10.274 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013020+0000", 2024-04-25T22:53:10.274 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3330000000000002e-06 2024-04-25T22:53:10.274 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.274 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.274 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:10.274 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013025+0000", 2024-04-25T22:53:10.274 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6760000000000004e-06 2024-04-25T22:53:10.274 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.274 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.274 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:10.274 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013163+0000", 2024-04-25T22:53:10.274 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013824599999999999 2024-04-25T22:53:10.274 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.274 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.275 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:10.275 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013504+0000", 2024-04-25T22:53:10.275 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034080299999999998 2024-04-25T22:53:10.275 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.275 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.275 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:10.275 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013613+0000", 2024-04-25T22:53:10.275 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108705 2024-04-25T22:53:10.275 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.275 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.275 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:10.275 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015831+0000", 2024-04-25T22:53:10.275 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002217672 2024-04-25T22:53:10.275 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.276 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.276 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:10.276 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024137+0000", 2024-04-25T22:53:10.276 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0083060489999999994 2024-04-25T22:53:10.276 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.276 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.276 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:10.276 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024218+0000", 2024-04-25T22:53:10.276 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1351000000000001e-05 2024-04-25T22:53:10.276 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.276 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.276 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:10.276 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024259+0000", 2024-04-25T22:53:10.277 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1112000000000002e-05 2024-04-25T22:53:10.277 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:10.277 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:10.277 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:10.277 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.277 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.277 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:10.277 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:10.277 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 77.173007769999998, 2024-04-25T22:53:10.277 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020379749999999999, 2024-04-25T22:53:10.277 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:10.277 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:10.277 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:10.277 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:10.278 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.278 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:10.278 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:10.278 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:10.278 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.278 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.278 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:10.278 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:10.278 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:10.278 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.278 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.278 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:10.278 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013098+0000", 2024-04-25T22:53:10.278 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:53:10.279 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.279 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.279 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:10.279 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013105+0000", 2024-04-25T22:53:10.279 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5969999999999997e-06 2024-04-25T22:53:10.279 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.279 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.279 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:10.279 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013190+0000", 2024-04-25T22:53:10.279 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5618999999999995e-05 2024-04-25T22:53:10.279 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.279 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.279 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:10.279 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013200+0000", 2024-04-25T22:53:10.280 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5859999999999994e-06 2024-04-25T22:53:10.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:10.280 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020265+0000", 2024-04-25T22:53:10.280 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070653349999999998 2024-04-25T22:53:10.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:10.280 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020454+0000", 2024-04-25T22:53:10.280 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189316 2024-04-25T22:53:10.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:10.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020586+0000", 2024-04-25T22:53:10.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013195700000000001 2024-04-25T22:53:10.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.281 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:10.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023822+0000", 2024-04-25T22:53:10.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032358529999999999 2024-04-25T22:53:10.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.281 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:10.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033409+0000", 2024-04-25T22:53:10.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095870520000000004 2024-04-25T22:53:10.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:10.282 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033447+0000", 2024-04-25T22:53:10.282 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7261999999999997e-05 2024-04-25T22:53:10.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:10.282 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033477+0000", 2024-04-25T22:53:10.282 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0389e-05 2024-04-25T22:53:10.282 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:10.282 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:10.282 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:10.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.282 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:10.283 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:10.283 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 77.172891264, 2024-04-25T22:53:10.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010857383999999999, 2024-04-25T22:53:10.283 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:10.283 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:10.283 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:10.283 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:10.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.283 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:10.283 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:10.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:10.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.284 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.284 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:10.284 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:10.284 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:10.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.284 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.284 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:10.284 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:10.284 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:10.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.284 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.284 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:10.284 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013218+0000", 2024-04-25T22:53:10.284 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8199999999999998e-06 2024-04-25T22:53:10.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.285 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.285 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:10.285 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013226+0000", 2024-04-25T22:53:10.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7649999999999993e-06 2024-04-25T22:53:10.285 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.285 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.285 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:10.285 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013259+0000", 2024-04-25T22:53:10.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2727e-05 2024-04-25T22:53:10.285 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.285 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.285 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:10.285 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014809+0000", 2024-04-25T22:53:10.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001550144 2024-04-25T22:53:10.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.286 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:10.286 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014958+0000", 2024-04-25T22:53:10.286 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014890300000000001 2024-04-25T22:53:10.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.286 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:10.286 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015087+0000", 2024-04-25T22:53:10.286 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012939200000000001 2024-04-25T22:53:10.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.286 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:10.286 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020212+0000", 2024-04-25T22:53:10.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051248939999999996 2024-04-25T22:53:10.287 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.287 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.287 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:10.287 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023699+0000", 2024-04-25T22:53:10.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034873289999999999 2024-04-25T22:53:10.287 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.287 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.287 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:10.287 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024014+0000", 2024-04-25T22:53:10.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031473999999999999 2024-04-25T22:53:10.287 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.287 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.287 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:10.287 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024071+0000", 2024-04-25T22:53:10.288 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7040000000000003e-05 2024-04-25T22:53:10.288 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:10.288 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:10.288 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:10.288 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.288 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.288 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:10.288 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:10.288 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 77.172836559000004, 2024-04-25T22:53:10.288 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012329677000000001, 2024-04-25T22:53:10.288 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:10.288 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:10.288 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:10.288 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:10.288 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.288 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:10.289 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:10.289 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:10.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.289 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:10.289 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:10.289 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:10.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.289 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:10.289 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013269+0000", 2024-04-25T22:53:10.289 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5000000000000002e-07 2024-04-25T22:53:10.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.289 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:10.289 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:10.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6909999999999999e-06 2024-04-25T22:53:10.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:10.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013284+0000", 2024-04-25T22:53:10.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0963e-05 2024-04-25T22:53:10.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:10.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013361+0000", 2024-04-25T22:53:10.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7379999999999994e-05 2024-04-25T22:53:10.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:10.291 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013448+0000", 2024-04-25T22:53:10.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6990000000000006e-05 2024-04-25T22:53:10.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.291 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.291 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:10.291 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013632+0000", 2024-04-25T22:53:10.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018396800000000001 2024-04-25T22:53:10.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.291 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.291 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:10.291 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013800+0000", 2024-04-25T22:53:10.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167467 2024-04-25T22:53:10.292 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.292 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.292 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:10.292 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.018570+0000", 2024-04-25T22:53:10.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047701460000000003 2024-04-25T22:53:10.292 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.292 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.292 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:10.292 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025507+0000", 2024-04-25T22:53:10.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069372039999999998 2024-04-25T22:53:10.292 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.292 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.292 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:10.292 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025562+0000", 2024-04-25T22:53:10.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4858999999999998e-05 2024-04-25T22:53:10.292 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:10.293 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025598+0000", 2024-04-25T22:53:10.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6259e-05 2024-04-25T22:53:10.293 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:10.293 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:10.293 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:10.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.293 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:10.293 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:10.293 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 77.172704686000003, 2024-04-25T22:53:10.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020176666999999999, 2024-04-25T22:53:10.294 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:10.294 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:10.294 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:53:10.294 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:10.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:10.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:10.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:10.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:10.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:10.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:10.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:10.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:10.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-04-25T22:53:10.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:10.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013405+0000", 2024-04-25T22:53:10.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0559999999999998e-06 2024-04-25T22:53:10.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:10.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013422+0000", 2024-04-25T22:53:10.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6770999999999999e-05 2024-04-25T22:53:10.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.296 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:10.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013431+0000", 2024-04-25T22:53:10.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5019999999999998e-06 2024-04-25T22:53:10.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.296 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:10.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021720+0000", 2024-04-25T22:53:10.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082884340000000008 2024-04-25T22:53:10.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.296 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:10.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022122+0000", 2024-04-25T22:53:10.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000401634 2024-04-25T22:53:10.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:10.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:10.297 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:10.297 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033577+0000", 2024-04-25T22:53:10.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011455435999999999 2024-04-25T22:53:10.297 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:10.297 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:10.297 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:10.297 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:10.297 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:10.297 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:10.299 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:10.299 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:10.297+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:10.399 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:10.399+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:10.409 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:10.409 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:10.409 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-25T22:53:10.409 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:10.418 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:10.500 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:10.500+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:10.563 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:10.563 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:10.564 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-25T22:53:10.564 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-25T22:53:10.564 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:10.572 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:10.601 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:10.600+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:10.676 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:10.676 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:53:10.676 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:53:10.676 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:53:10.676 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.676 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:53:10.676 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:10.676 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 82.706936713000005, 2024-04-25T22:53:10.676 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:53:10.677 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:10.677 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:10.677 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:10.677 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:10.677 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.677 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:10.677 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:10.677 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:10.677 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.677 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.677 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:10.678 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:10.678 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:10.678 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.678 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.678 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:10.678 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:53:10.678 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:53:10.678 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.678 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.678 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:10.678 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:53:10.678 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:53:10.678 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.679 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.679 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:10.679 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:53:10.679 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:53:10.679 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.679 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.679 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:10.679 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:53:10.679 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:53:10.679 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.679 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.679 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:10.679 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:53:10.679 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:53:10.680 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.680 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.680 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:10.680 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:53:10.680 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:53:10.680 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.680 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.680 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:10.680 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:53:10.680 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:53:10.680 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.681 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.681 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:10.681 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:53:10.681 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:53:10.681 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:10.681 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:10.681 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:10.681 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.682 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.682 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:110 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'72, mlcod=10'68)", 2024-04-25T22:53:10.682 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:10.682 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 82.706302712999999, 2024-04-25T22:53:10.682 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065316630000000001, 2024-04-25T22:53:10.682 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:10.682 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:10.682 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:10.682 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:10.682 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.682 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:10.682 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:10.683 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:10.683 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.683 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.683 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:10.683 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:10.683 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:10.683 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.683 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.683 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:10.683 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:10.683 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.58e-07 2024-04-25T22:53:10.683 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.683 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.683 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:10.684 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967811+0000", 2024-04-25T22:53:10.684 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.118e-06 2024-04-25T22:53:10.684 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.684 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.684 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:10.684 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967817+0000", 2024-04-25T22:53:10.684 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3709999999999996e-06 2024-04-25T22:53:10.684 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.684 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.684 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:10.684 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967820+0000", 2024-04-25T22:53:10.684 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2210000000000002e-06 2024-04-25T22:53:10.684 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.684 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.685 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:10.685 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967876+0000", 2024-04-25T22:53:10.685 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5507000000000002e-05 2024-04-25T22:53:10.685 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.685 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.685 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:10.685 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967893+0000", 2024-04-25T22:53:10.685 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7812000000000002e-05 2024-04-25T22:53:10.685 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.685 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.685 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:10.685 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974317+0000", 2024-04-25T22:53:10.685 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064237160000000003 2024-04-25T22:53:10.685 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.686 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.686 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:10.686 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:53:10.686 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.156e-05 2024-04-25T22:53:10.686 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:10.686 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:10.686 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:10.686 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.686 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.686 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'68)", 2024-04-25T22:53:10.686 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:10.686 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 82.705885199999997, 2024-04-25T22:53:10.686 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061292279999999996, 2024-04-25T22:53:10.686 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:10.687 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:10.687 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:10.687 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:10.687 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.687 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:10.687 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:10.687 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:10.687 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.687 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.687 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:10.687 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:10.687 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:10.687 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.687 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.688 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:10.688 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:10.688 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6300000000000001e-07 2024-04-25T22:53:10.688 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.688 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.688 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:10.688 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968228+0000", 2024-04-25T22:53:10.688 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6139999999999999e-06 2024-04-25T22:53:10.688 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.688 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.688 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:10.688 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968235+0000", 2024-04-25T22:53:10.688 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7020000000000001e-06 2024-04-25T22:53:10.688 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.688 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.689 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:10.689 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968238+0000", 2024-04-25T22:53:10.689 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0010000000000002e-06 2024-04-25T22:53:10.689 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.689 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.689 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:10.689 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968297+0000", 2024-04-25T22:53:10.689 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8424999999999997e-05 2024-04-25T22:53:10.689 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.689 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.689 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:10.689 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968316+0000", 2024-04-25T22:53:10.689 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8814999999999999e-05 2024-04-25T22:53:10.689 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.690 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.690 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:10.690 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:53:10.690 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060239439999999998 2024-04-25T22:53:10.690 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.690 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.690 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:10.690 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974354+0000", 2024-04-25T22:53:10.690 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4364e-05 2024-04-25T22:53:10.690 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:10.690 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:10.690 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:10.690 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.690 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.691 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'68)", 2024-04-25T22:53:10.691 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:10.691 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 82.705448197999999, 2024-04-25T22:53:10.691 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005948414, 2024-04-25T22:53:10.691 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:10.691 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:10.691 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:10.691 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:10.691 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.691 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:10.691 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:10.691 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:10.691 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.692 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.692 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:10.692 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:10.692 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:10.692 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.692 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.692 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:10.692 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:10.692 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6199999999999998e-07 2024-04-25T22:53:10.692 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.692 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.692 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:10.693 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968723+0000", 2024-04-25T22:53:10.693 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1148999999999993e-05 2024-04-25T22:53:10.693 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.693 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.693 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:10.693 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968730+0000", 2024-04-25T22:53:10.693 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1749999999999999e-06 2024-04-25T22:53:10.693 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.693 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.693 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:10.693 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968734+0000", 2024-04-25T22:53:10.693 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5200000000000002e-06 2024-04-25T22:53:10.693 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.693 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.694 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:10.694 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968771+0000", 2024-04-25T22:53:10.694 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6851999999999999e-05 2024-04-25T22:53:10.694 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.694 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.694 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:10.694 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968788+0000", 2024-04-25T22:53:10.694 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7027000000000001e-05 2024-04-25T22:53:10.694 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.694 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.694 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:10.694 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974589+0000", 2024-04-25T22:53:10.694 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058013320000000002 2024-04-25T22:53:10.694 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.695 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.695 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:10.695 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974610+0000", 2024-04-25T22:53:10.695 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0897e-05 2024-04-25T22:53:10.695 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:10.695 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:10.695 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:10.695 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.695 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.695 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'68)", 2024-04-25T22:53:10.695 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:10.695 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 82.704878187999995, 2024-04-25T22:53:10.695 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053935750000000003, 2024-04-25T22:53:10.696 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:10.696 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:10.696 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:10.696 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:10.696 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.696 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:10.696 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:10.696 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:10.696 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.697 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.697 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:10.697 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:10.697 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:10.697 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.697 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.697 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:10.697 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:10.697 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.03e-07 2024-04-25T22:53:10.697 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.697 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.697 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:10.697 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969235+0000", 2024-04-25T22:53:10.697 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2399999999999999e-06 2024-04-25T22:53:10.698 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.698 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.698 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:10.698 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969242+0000", 2024-04-25T22:53:10.698 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1269999999999997e-06 2024-04-25T22:53:10.698 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.698 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.698 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:10.698 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969246+0000", 2024-04-25T22:53:10.699 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3840000000000001e-06 2024-04-25T22:53:10.699 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.699 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.699 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:10.699 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969278+0000", 2024-04-25T22:53:10.699 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1868e-05 2024-04-25T22:53:10.699 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.699 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.699 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:10.699 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969295+0000", 2024-04-25T22:53:10.699 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7530999999999999e-05 2024-04-25T22:53:10.699 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.699 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.699 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:10.699 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974611+0000", 2024-04-25T22:53:10.700 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053160789999999996 2024-04-25T22:53:10.700 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.700 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.700 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:10.700 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974625+0000", 2024-04-25T22:53:10.700 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3943e-05 2024-04-25T22:53:10.700 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:10.700 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:10.700 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:10.700 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.700 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.700 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-25T22:53:10.700 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:10.700 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 82.511282280000003, 2024-04-25T22:53:10.701 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054952610000000004, 2024-04-25T22:53:10.701 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:10.701 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:10.701 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:10.701 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:10.701 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.701 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:10.701 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:10.701 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:10.701 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.701 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.701 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:10.701 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:10.701 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:10.701 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.702 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.702 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:10.702 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:10.702 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.68e-07 2024-04-25T22:53:10.702 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.702 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.702 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:10.702 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162898+0000", 2024-04-25T22:53:10.702 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9470999999999999e-05 2024-04-25T22:53:10.702 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.703 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.703 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:10.703 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162906+0000", 2024-04-25T22:53:10.703 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1580000000000005e-06 2024-04-25T22:53:10.703 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.703 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.703 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:10.703 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162911+0000", 2024-04-25T22:53:10.703 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4779999999999999e-06 2024-04-25T22:53:10.703 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.703 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.703 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:10.703 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162952+0000", 2024-04-25T22:53:10.704 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0629e-05 2024-04-25T22:53:10.704 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.704 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.704 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:10.704 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162968+0000", 2024-04-25T22:53:10.704 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6239000000000002e-05 2024-04-25T22:53:10.704 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.704 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.704 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:10.704 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168281+0000", 2024-04-25T22:53:10.704 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053132869999999999 2024-04-25T22:53:10.705 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.705 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.705 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:10.705 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168323+0000", 2024-04-25T22:53:10.705 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1430999999999997e-05 2024-04-25T22:53:10.705 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:10.705 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:10.705 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:10.705 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.706 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.706 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-04-25T22:53:10.706 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:10.706 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 82.080804917999998, 2024-04-25T22:53:10.706 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050872510000000001, 2024-04-25T22:53:10.706 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:10.706 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:10.706 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:10.706 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:10.706 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.706 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:10.707 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:10.707 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:10.707 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.707 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.707 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:10.707 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:10.707 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:10.707 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.707 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.707 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:10.707 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:10.707 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.72e-07 2024-04-25T22:53:10.708 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.708 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.708 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:10.708 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593381+0000", 2024-04-25T22:53:10.708 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5797000000000006e-05 2024-04-25T22:53:10.708 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.708 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.708 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:10.708 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593389+0000", 2024-04-25T22:53:10.708 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8480000000000001e-06 2024-04-25T22:53:10.708 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.708 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.708 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:10.708 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593393+0000", 2024-04-25T22:53:10.709 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4819999999999996e-06 2024-04-25T22:53:10.709 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.709 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.709 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:10.709 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593435+0000", 2024-04-25T22:53:10.709 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1600000000000002e-05 2024-04-25T22:53:10.709 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.709 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.709 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:10.709 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593454+0000", 2024-04-25T22:53:10.709 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8868e-05 2024-04-25T22:53:10.709 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.709 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.709 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:10.710 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598350+0000", 2024-04-25T22:53:10.710 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004895763 2024-04-25T22:53:10.710 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.710 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.710 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:10.710 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598392+0000", 2024-04-25T22:53:10.710 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2521000000000002e-05 2024-04-25T22:53:10.710 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:10.710 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:10.710 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:10.710 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.710 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.711 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:10.711 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:10.711 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 77.662441013999995, 2024-04-25T22:53:10.711 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:53:10.711 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:10.711 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:10.711 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:10.711 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:10.711 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.711 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:10.711 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:10.711 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:10.711 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.711 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.712 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:10.712 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:10.712 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:10.712 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.712 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.712 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:10.712 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:53:10.712 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:53:10.712 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.712 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.712 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:10.712 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:53:10.712 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:53:10.712 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.712 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.712 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:10.713 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:53:10.713 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:53:10.713 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.713 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.713 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:10.713 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:53:10.713 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:53:10.713 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.713 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.713 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:10.714 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:53:10.714 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:53:10.714 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.714 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.714 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:10.714 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:53:10.714 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:53:10.714 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.714 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.714 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:10.714 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:53:10.714 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:53:10.714 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.714 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.715 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:10.715 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:53:10.715 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:53:10.715 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.715 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.715 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:10.715 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:53:10.715 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:53:10.715 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.715 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.715 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:10.715 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:53:10.715 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:53:10.715 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.716 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.716 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:10.716 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:53:10.716 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:53:10.716 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:10.716 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:10.716 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:10.716 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.716 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.716 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:10.716 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:10.717 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 77.661766638000003, 2024-04-25T22:53:10.717 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:53:10.717 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:10.717 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:10.717 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:10.717 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:10.717 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.717 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:10.718 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:10.718 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:10.718 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.718 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.718 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:10.718 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:10.718 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:10.718 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.718 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.718 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:10.718 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:53:10.718 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:53:10.719 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.719 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.719 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:10.719 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:53:10.719 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:53:10.719 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.719 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.719 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:10.719 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:53:10.719 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:53:10.719 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.719 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.719 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:10.719 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:53:10.720 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:53:10.720 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.720 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.720 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:10.720 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:53:10.720 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:53:10.720 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.720 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.720 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:10.720 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:53:10.720 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:53:10.720 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.720 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.720 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:10.721 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:53:10.721 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:53:10.721 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.721 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.721 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:10.721 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:53:10.721 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:53:10.721 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.721 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.721 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:10.721 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:53:10.721 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:53:10.721 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.722 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.722 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:10.722 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:53:10.722 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:53:10.722 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.722 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.722 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:10.722 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:53:10.722 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:53:10.722 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:10.722 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:10.723 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:10.723 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.723 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.723 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:10.723 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:10.723 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 77.661257426000006, 2024-04-25T22:53:10.723 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:53:10.723 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:10.723 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:10.723 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:10.723 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:10.723 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.724 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:10.724 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:10.724 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:10.724 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.724 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.724 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:10.724 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:10.724 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:10.724 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.724 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.724 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:10.724 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:53:10.725 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:53:10.725 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.725 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.725 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:10.725 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:53:10.725 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:53:10.725 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.725 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.725 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:10.725 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:53:10.725 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:53:10.725 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.725 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.725 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:10.726 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:53:10.726 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:53:10.726 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.726 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.726 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:10.726 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:53:10.726 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:53:10.726 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.726 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.726 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:10.726 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:53:10.726 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:53:10.727 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.727 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.727 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:10.727 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:53:10.727 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:53:10.727 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.727 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.727 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:10.727 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:53:10.727 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:53:10.727 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.727 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.728 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:10.728 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:53:10.728 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:53:10.728 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.728 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.728 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:10.728 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:53:10.728 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:53:10.728 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.728 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.728 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:10.728 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:53:10.728 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:53:10.729 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:10.729 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:10.729 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:10.729 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.729 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.729 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:10.729 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:10.729 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 77.660844228000002, 2024-04-25T22:53:10.729 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:53:10.729 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:10.729 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:10.730 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:10.730 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:10.730 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.730 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:10.730 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:10.730 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:10.730 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.730 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.730 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:10.730 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:10.730 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:10.730 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.730 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.731 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:10.731 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:10.731 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:53:10.731 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.731 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.731 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:10.731 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:10.731 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:53:10.731 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.731 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.731 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:10.731 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:53:10.731 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:53:10.731 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.732 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.732 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:10.732 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:53:10.732 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:53:10.732 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.732 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.732 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:10.732 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:53:10.732 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:53:10.732 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.732 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.732 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:10.732 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:53:10.732 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:53:10.733 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.733 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.733 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:10.733 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:53:10.733 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:53:10.733 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.733 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.733 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:10.733 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:53:10.733 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:53:10.733 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.733 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.734 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:10.734 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:53:10.734 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:53:10.734 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.734 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.734 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:10.734 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:53:10.734 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:53:10.734 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.734 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.734 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:10.734 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:53:10.734 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:53:10.735 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:10.735 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:10.735 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:10.735 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.735 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.735 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:10.735 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:10.735 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 77.660793557999995, 2024-04-25T22:53:10.735 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:53:10.735 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:10.735 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:10.735 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:10.735 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:10.735 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.736 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:10.736 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:10.736 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:10.736 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.736 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.736 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:10.736 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:10.736 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:10.736 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.736 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.736 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:10.737 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:53:10.737 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:53:10.737 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.737 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.737 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:10.737 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:53:10.737 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:53:10.737 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.737 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.737 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:10.737 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:53:10.737 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:53:10.737 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.737 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.738 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:10.738 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:53:10.738 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:53:10.738 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.738 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.738 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:10.738 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:53:10.738 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:53:10.738 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.738 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.739 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:10.739 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:53:10.739 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:53:10.739 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.739 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.739 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:10.739 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:53:10.739 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:53:10.739 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.739 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.739 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:10.739 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:53:10.739 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:53:10.739 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.740 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.740 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:10.740 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:53:10.740 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:53:10.740 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.740 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.740 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:10.740 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:53:10.740 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:53:10.740 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.740 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.740 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:10.740 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:53:10.741 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:53:10.741 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.741 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.741 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:10.741 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:53:10.741 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:53:10.741 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.741 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.741 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:10.741 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:53:10.741 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:53:10.741 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:10.741 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:10.741 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:10.741 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.742 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.742 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:10.742 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:10.742 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 77.660756688999996, 2024-04-25T22:53:10.742 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:53:10.742 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:10.742 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:10.742 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:10.742 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:10.742 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.742 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:10.742 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:10.742 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:10.743 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.743 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.743 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:10.743 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:10.743 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:10.743 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.743 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.743 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:10.743 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:53:10.743 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:53:10.743 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.743 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.743 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:10.744 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:53:10.744 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:53:10.744 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.744 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.744 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:10.744 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:53:10.744 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:53:10.744 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.744 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.744 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:10.744 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:53:10.744 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:53:10.744 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.745 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.745 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:10.745 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:53:10.745 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:53:10.745 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.745 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.745 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:53:10.745 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:53:10.745 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:53:10.745 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.745 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.745 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:10.745 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:53:10.745 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:53:10.746 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.746 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.746 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:10.746 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:53:10.746 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:53:10.746 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.746 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.746 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:10.746 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:53:10.746 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:53:10.746 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.746 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.747 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:10.747 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:53:10.747 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:53:10.747 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.747 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.747 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:10.747 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:53:10.747 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:53:10.747 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.747 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.747 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:10.747 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:53:10.748 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:53:10.748 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.748 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.748 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:10.748 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:53:10.748 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:53:10.748 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:10.748 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:10.748 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:10.748 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.748 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.748 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:10.749 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:10.749 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 77.660731722999998, 2024-04-25T22:53:10.749 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:53:10.749 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:10.749 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:10.749 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:10.749 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:10.749 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.749 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:10.749 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:10.749 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:10.749 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.749 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.750 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:10.750 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:10.750 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:10.750 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.750 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.750 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:10.750 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:53:10.750 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:53:10.750 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.750 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.750 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:10.750 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:53:10.750 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:53:10.751 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.751 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.751 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:10.751 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:10.751 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:53:10.751 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.751 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.751 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:10.751 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:53:10.751 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:53:10.751 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.751 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.751 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:10.751 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:53:10.752 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:53:10.752 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.752 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.752 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:10.752 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:53:10.752 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:53:10.752 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.752 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.752 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:10.752 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:53:10.752 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:53:10.752 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.752 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.753 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:10.753 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:53:10.753 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:53:10.753 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.753 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.753 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:10.753 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:53:10.753 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:53:10.753 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.753 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.753 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:10.753 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:53:10.753 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:53:10.753 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.754 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.754 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:10.754 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:53:10.754 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:53:10.754 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:10.754 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:10.754 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:10.754 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.754 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.754 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:10.754 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:10.755 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 77.660695359000002, 2024-04-25T22:53:10.755 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:53:10.755 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:10.755 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:10.755 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:10.755 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:10.755 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.755 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:10.755 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:10.755 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:10.755 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.755 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.756 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:10.756 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:10.756 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:10.756 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.756 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.756 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:10.756 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:53:10.756 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:53:10.756 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.756 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.756 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:10.756 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:53:10.756 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:53:10.757 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.757 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.757 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:10.757 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:53:10.757 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:53:10.757 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.757 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.757 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:10.757 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:53:10.757 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:53:10.757 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.757 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.757 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:10.757 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:53:10.757 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:53:10.758 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.758 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.758 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:10.758 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:53:10.758 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:53:10.758 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.758 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.758 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:10.758 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:53:10.758 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:53:10.758 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.758 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.758 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:10.759 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:53:10.759 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:53:10.759 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.759 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.759 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:10.759 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:53:10.759 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:53:10.759 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:10.759 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:10.759 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:10.759 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.759 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.759 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:10.759 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:10.760 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 77.660664277999999, 2024-04-25T22:53:10.760 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:53:10.760 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:10.760 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:10.760 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:10.760 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:10.760 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.760 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:10.760 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:10.760 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:10.760 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.760 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.760 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:10.760 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:10.761 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:10.761 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.761 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.761 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:10.761 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:10.761 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:10.761 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.761 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.761 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:10.761 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:53:10.761 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:53:10.762 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.762 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.762 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:10.762 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:53:10.762 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:53:10.762 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.762 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.762 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:10.762 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:53:10.762 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:53:10.762 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.762 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.763 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:10.763 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:53:10.763 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:53:10.763 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.763 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.763 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:10.763 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:53:10.763 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:53:10.763 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.763 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.763 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:10.763 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:53:10.763 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:53:10.763 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:10.764 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:10.764 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:10.764 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.764 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.764 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:53:10.764 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:10.764 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 77.660223309000003, 2024-04-25T22:53:10.764 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064881979999999997, 2024-04-25T22:53:10.764 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:10.764 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:10.764 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:10.764 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:10.765 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.765 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:10.765 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:10.765 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:10.765 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.765 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.766 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:10.766 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:10.766 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:10.766 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.766 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.766 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:10.766 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:10.766 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2699999999999999e-07 2024-04-25T22:53:10.766 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.766 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.766 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:10.766 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013898+0000", 2024-04-25T22:53:10.767 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0796e-05 2024-04-25T22:53:10.767 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.767 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.767 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:10.767 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013907+0000", 2024-04-25T22:53:10.767 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5140000000000007e-06 2024-04-25T22:53:10.767 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.767 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.767 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:10.767 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013952+0000", 2024-04-25T22:53:10.767 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4134000000000001e-05 2024-04-25T22:53:10.767 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.768 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.768 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:10.768 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016812+0000", 2024-04-25T22:53:10.768 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028601059999999998 2024-04-25T22:53:10.768 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.768 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.768 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:10.768 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.017052+0000", 2024-04-25T22:53:10.768 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024056500000000001 2024-04-25T22:53:10.768 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.768 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.768 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:10.768 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020350+0000", 2024-04-25T22:53:10.769 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032978320000000001 2024-04-25T22:53:10.769 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.769 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.769 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:10.769 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020375+0000", 2024-04-25T22:53:10.769 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4624e-05 2024-04-25T22:53:10.769 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:10.769 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:10.769 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:10.769 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.769 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.769 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-25T22:53:10.769 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:10.769 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 77.646692862999998, 2024-04-25T22:53:10.770 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058583000000000003, 2024-04-25T22:53:10.770 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:10.770 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:10.770 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:10.770 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:10.770 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.770 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:10.770 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:10.770 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:10.770 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.770 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.770 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:10.771 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:10.771 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:10.771 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.771 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.771 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:10.771 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:10.771 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.41e-07 2024-04-25T22:53:10.771 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.771 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.771 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:10.771 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027428+0000", 2024-04-25T22:53:10.771 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.075e-05 2024-04-25T22:53:10.771 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.771 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.771 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:10.772 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027435+0000", 2024-04-25T22:53:10.772 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3610000000000003e-06 2024-04-25T22:53:10.772 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.772 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.772 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:10.772 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027442+0000", 2024-04-25T22:53:10.772 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0400000000000004e-06 2024-04-25T22:53:10.772 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.772 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.772 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:10.772 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028094+0000", 2024-04-25T22:53:10.772 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00065134800000000005 2024-04-25T22:53:10.772 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.772 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.773 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:10.773 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028107+0000", 2024-04-25T22:53:10.773 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3087e-05 2024-04-25T22:53:10.773 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.773 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.773 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:10.773 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033239+0000", 2024-04-25T22:53:10.773 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051319429999999999 2024-04-25T22:53:10.773 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.774 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.774 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:10.774 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033275+0000", 2024-04-25T22:53:10.774 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6430000000000002e-05 2024-04-25T22:53:10.774 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:10.775 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:10.775 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:10.775 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.775 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.775 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-25T22:53:10.775 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:10.775 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 77.646308026, 2024-04-25T22:53:10.775 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005413597, 2024-04-25T22:53:10.775 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:10.775 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:10.776 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:10.776 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:10.776 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.776 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:10.776 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:10.776 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:10.776 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.776 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.776 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:10.776 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:10.776 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:10.776 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.776 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.777 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:10.777 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:10.777 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3799999999999997e-07 2024-04-25T22:53:10.777 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.777 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.777 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:10.777 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027816+0000", 2024-04-25T22:53:10.777 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3230999999999999e-05 2024-04-25T22:53:10.777 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.777 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.777 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:10.777 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027823+0000", 2024-04-25T22:53:10.778 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9039999999999992e-06 2024-04-25T22:53:10.778 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.778 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.778 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:10.778 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027841+0000", 2024-04-25T22:53:10.778 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7651000000000001e-05 2024-04-25T22:53:10.778 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.778 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.778 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:10.778 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027904+0000", 2024-04-25T22:53:10.778 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3058000000000005e-05 2024-04-25T22:53:10.778 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.778 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.779 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:10.779 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027926+0000", 2024-04-25T22:53:10.779 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1450999999999998e-05 2024-04-25T22:53:10.779 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.779 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.779 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:10.779 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033177+0000", 2024-04-25T22:53:10.779 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052508909999999997 2024-04-25T22:53:10.779 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.779 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.779 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:10.779 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033215+0000", 2024-04-25T22:53:10.779 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8872999999999999e-05 2024-04-25T22:53:10.780 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:10.780 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:10.780 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:10.780 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.780 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.780 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 171 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:53:10.780 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:10.780 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 77.646250924, 2024-04-25T22:53:10.780 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054322240000000003, 2024-04-25T22:53:10.780 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:10.780 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:10.780 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "reached pg", 2024-04-25T22:53:10.780 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:10.781 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.781 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:10.781 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:10.781 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:10.781 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.781 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.781 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:10.781 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:10.781 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:10.781 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.781 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.781 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:10.782 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:10.782 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7500000000000001e-07 2024-04-25T22:53:10.782 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.782 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.782 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:10.782 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027868+0000", 2024-04-25T22:53:10.782 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5750000000000001e-06 2024-04-25T22:53:10.782 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.782 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.782 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:10.783 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027885+0000", 2024-04-25T22:53:10.783 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7272e-05 2024-04-25T22:53:10.783 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.783 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.783 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:10.783 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027900+0000", 2024-04-25T22:53:10.783 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.502e-05 2024-04-25T22:53:10.783 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.783 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.783 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:10.783 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028381+0000", 2024-04-25T22:53:10.783 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00048039399999999998 2024-04-25T22:53:10.783 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:10.784 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:10.784 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:10.784 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033291+0000", 2024-04-25T22:53:10.784 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049105879999999996 2024-04-25T22:53:10.784 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:10.784 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:10.784 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:10.784 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:10.784 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:10.784 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:10.786 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:10.785+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:10.786 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:10.887 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:10.887+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:10.891 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:10.892 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:10.892 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-04-25T22:53:10.892 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:10.901 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:10.987 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:10.987+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:11.003 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:11.003 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:11.003 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:53:11.003 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:53:11.003 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:11.011 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:11.088 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:11.088+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:11.148 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:53:11.155 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:11.155 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-04-25T22:53:11.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-04-25T22:53:11.155 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:53:11.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.155 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:11.155 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:11.155 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 83.188192505000004, 2024-04-25T22:53:11.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0103421, 2024-04-25T22:53:11.155 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:11.155 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:11.155 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:11.156 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:11.156 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:11.156 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:11.156 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 115 2024-04-25T22:53:11.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.156 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:11.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:11.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:11.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:11.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:11.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:11.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:11.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:11.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:11.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9500000000000002e-07 2024-04-25T22:53:11.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:11.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965108+0000", 2024-04-25T22:53:11.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9177999999999994e-05 2024-04-25T22:53:11.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:11.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965127+0000", 2024-04-25T22:53:11.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8868e-05 2024-04-25T22:53:11.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:11.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965133+0000", 2024-04-25T22:53:11.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8929999999999999e-06 2024-04-25T22:53:11.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:11.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.969991+0000", 2024-04-25T22:53:11.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048573849999999997 2024-04-25T22:53:11.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:11.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970072+0000", 2024-04-25T22:53:11.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0728000000000004e-05 2024-04-25T22:53:11.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:11.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970189+0000", 2024-04-25T22:53:11.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000117778 2024-04-25T22:53:11.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:11.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970946+0000", 2024-04-25T22:53:11.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00075704600000000004 2024-04-25T22:53:11.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:11.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975297+0000", 2024-04-25T22:53:11.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004350217 2024-04-25T22:53:11.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:11.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975343+0000", 2024-04-25T22:53:11.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6687999999999998e-05 2024-04-25T22:53:11.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:11.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975380+0000", 2024-04-25T22:53:11.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6724000000000003e-05 2024-04-25T22:53:11.161 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:11.161 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:11.161 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:11.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.161 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:11.161 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:11.161 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 83.188086474000002, 2024-04-25T22:53:11.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010304384, 2024-04-25T22:53:11.161 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:11.161 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:11.161 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:11.161 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:11.162 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:11.162 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:11.162 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 116 2024-04-25T22:53:11.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.162 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:11.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:11.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:11.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:11.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:11.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:11.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:11.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:11.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:11.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5799999999999999e-07 2024-04-25T22:53:11.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:11.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965154+0000", 2024-04-25T22:53:11.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0009e-05 2024-04-25T22:53:11.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:11.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965164+0000", 2024-04-25T22:53:11.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8490000000000001e-06 2024-04-25T22:53:11.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:11.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965169+0000", 2024-04-25T22:53:11.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0730000000000004e-06 2024-04-25T22:53:11.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:11.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970609+0000", 2024-04-25T22:53:11.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054397689999999997 2024-04-25T22:53:11.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:11.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970651+0000", 2024-04-25T22:53:11.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1873999999999999e-05 2024-04-25T22:53:11.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:11.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970723+0000", 2024-04-25T22:53:11.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2039999999999995e-05 2024-04-25T22:53:11.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:11.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971358+0000", 2024-04-25T22:53:11.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063489500000000001 2024-04-25T22:53:11.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:11.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975409+0000", 2024-04-25T22:53:11.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040506880000000002 2024-04-25T22:53:11.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:11.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975432+0000", 2024-04-25T22:53:11.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3315999999999998e-05 2024-04-25T22:53:11.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:11.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975448+0000", 2024-04-25T22:53:11.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6313000000000001e-05 2024-04-25T22:53:11.166 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:11.166 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:11.166 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:11.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.166 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:11.167 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:11.167 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 83.188051892000004, 2024-04-25T22:53:11.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010384338999999999, 2024-04-25T22:53:11.167 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:11.167 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:11.167 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:11.167 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:11.167 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:11.167 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:11.167 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-04-25T22:53:11.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.167 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:11.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:11.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:11.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:11.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:11.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:11.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:11.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:11.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:11.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3600000000000004e-07 2024-04-25T22:53:11.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:11.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965185+0000", 2024-04-25T22:53:11.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.117e-06 2024-04-25T22:53:11.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:11.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965192+0000", 2024-04-25T22:53:11.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3239999999999997e-06 2024-04-25T22:53:11.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:11.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965198+0000", 2024-04-25T22:53:11.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6370000000000004e-06 2024-04-25T22:53:11.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:11.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970973+0000", 2024-04-25T22:53:11.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057748239999999996 2024-04-25T22:53:11.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:11.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971049+0000", 2024-04-25T22:53:11.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6029e-05 2024-04-25T22:53:11.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:11.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971174+0000", 2024-04-25T22:53:11.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012462399999999999 2024-04-25T22:53:11.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:11.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971553+0000", 2024-04-25T22:53:11.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037896499999999999 2024-04-25T22:53:11.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:11.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975482+0000", 2024-04-25T22:53:11.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039297459999999996 2024-04-25T22:53:11.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:11.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975529+0000", 2024-04-25T22:53:11.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6387000000000002e-05 2024-04-25T22:53:11.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:11.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975563+0000", 2024-04-25T22:53:11.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4150000000000003e-05 2024-04-25T22:53:11.172 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:11.172 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:11.172 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:11.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.172 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:11.172 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:11.172 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.141005569000001, 2024-04-25T22:53:11.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012637705000000001, 2024-04-25T22:53:11.172 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:11.173 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:11.173 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:11.173 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:11.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:11.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:11.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:11.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:11.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:11.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:11.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:11.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012227+0000", 2024-04-25T22:53:11.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.863e-06 2024-04-25T22:53:11.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:11.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012236+0000", 2024-04-25T22:53:11.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1109999999999997e-06 2024-04-25T22:53:11.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:11.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012309+0000", 2024-04-25T22:53:11.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3242000000000001e-05 2024-04-25T22:53:11.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:11.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012324+0000", 2024-04-25T22:53:11.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4837e-05 2024-04-25T22:53:11.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:11.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015060+0000", 2024-04-25T22:53:11.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027363349999999999 2024-04-25T22:53:11.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:11.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015169+0000", 2024-04-25T22:53:11.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108372 2024-04-25T22:53:11.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:11.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015498+0000", 2024-04-25T22:53:11.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032949999999999999 2024-04-25T22:53:11.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:11.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021282+0000", 2024-04-25T22:53:11.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057836429999999998 2024-04-25T22:53:11.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:11.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024709+0000", 2024-04-25T22:53:11.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034271979999999998 2024-04-25T22:53:11.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:11.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024802+0000", 2024-04-25T22:53:11.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2960000000000004e-05 2024-04-25T22:53:11.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:11.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024863+0000", 2024-04-25T22:53:11.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0643999999999997e-05 2024-04-25T22:53:11.177 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:11.177 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:11.178 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:11.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.178 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:11.178 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:11.178 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.140881797999995, 2024-04-25T22:53:11.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012979447999999999, 2024-04-25T22:53:11.178 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:11.178 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:11.178 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:11.178 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:11.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:11.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:11.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:11.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:11.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:11.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:11.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:11.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:11.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:53:11.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:11.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012354+0000", 2024-04-25T22:53:11.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7740000000000004e-06 2024-04-25T22:53:11.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:11.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012365+0000", 2024-04-25T22:53:11.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.064e-05 2024-04-25T22:53:11.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:11.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012382+0000", 2024-04-25T22:53:11.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6999000000000001e-05 2024-04-25T22:53:11.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:11.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015958+0000", 2024-04-25T22:53:11.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035765699999999998 2024-04-25T22:53:11.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:11.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016037+0000", 2024-04-25T22:53:11.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8242000000000001e-05 2024-04-25T22:53:11.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:11.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016404+0000", 2024-04-25T22:53:11.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036784300000000002 2024-04-25T22:53:11.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:11.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021294+0000", 2024-04-25T22:53:11.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048890629999999999 2024-04-25T22:53:11.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:11.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024959+0000", 2024-04-25T22:53:11.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036651570000000001 2024-04-25T22:53:11.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:11.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025097+0000", 2024-04-25T22:53:11.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013788099999999999 2024-04-25T22:53:11.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:11.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025328+0000", 2024-04-25T22:53:11.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231492 2024-04-25T22:53:11.183 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:11.183 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:11.183 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:11.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.183 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:11.183 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:11.183 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.140794029000006, 2024-04-25T22:53:11.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013049827, 2024-04-25T22:53:11.183 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:11.184 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:11.184 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:11.184 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:11.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:11.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:11.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:11.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:11.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:11.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:11.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:11.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012437+0000", 2024-04-25T22:53:11.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-04-25T22:53:11.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:11.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012440+0000", 2024-04-25T22:53:11.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7609999999999999e-06 2024-04-25T22:53:11.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:11.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012449+0000", 2024-04-25T22:53:11.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.285e-06 2024-04-25T22:53:11.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:11.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012457+0000", 2024-04-25T22:53:11.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9510000000000006e-06 2024-04-25T22:53:11.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:11.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017106+0000", 2024-04-25T22:53:11.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046494220000000003 2024-04-25T22:53:11.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:11.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017223+0000", 2024-04-25T22:53:11.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116824 2024-04-25T22:53:11.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:11.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017345+0000", 2024-04-25T22:53:11.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122175 2024-04-25T22:53:11.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:11.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021299+0000", 2024-04-25T22:53:11.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039534879999999998 2024-04-25T22:53:11.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:11.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025398+0000", 2024-04-25T22:53:11.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040988960000000003 2024-04-25T22:53:11.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:11.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025439+0000", 2024-04-25T22:53:11.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0915999999999999e-05 2024-04-25T22:53:11.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:11.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025486+0000", 2024-04-25T22:53:11.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7534999999999998e-05 2024-04-25T22:53:11.188 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:11.188 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:11.188 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:11.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.189 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:11.189 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:11.189 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.140763878000001, 2024-04-25T22:53:11.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020988041999999998, 2024-04-25T22:53:11.189 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:11.189 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:11.189 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:11.189 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:11.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:11.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:11.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:11.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:11.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:11.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:11.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:11.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:11.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.99e-07 2024-04-25T22:53:11.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:11.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012470+0000", 2024-04-25T22:53:11.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2789999999999999e-06 2024-04-25T22:53:11.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:11.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012477+0000", 2024-04-25T22:53:11.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:53:11.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:11.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012500+0000", 2024-04-25T22:53:11.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2490999999999999e-05 2024-04-25T22:53:11.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:11.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021911+0000", 2024-04-25T22:53:11.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094114160000000006 2024-04-25T22:53:11.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:11.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022000+0000", 2024-04-25T22:53:11.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8601000000000001e-05 2024-04-25T22:53:11.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:11.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022359+0000", 2024-04-25T22:53:11.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035921999999999999 2024-04-25T22:53:11.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:11.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025541+0000", 2024-04-25T22:53:11.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031820619999999998 2024-04-25T22:53:11.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.193 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:11.193 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033375+0000", 2024-04-25T22:53:11.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078338379999999992 2024-04-25T22:53:11.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.193 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:11.193 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033415+0000", 2024-04-25T22:53:11.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9527000000000003e-05 2024-04-25T22:53:11.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.193 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:11.193 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033455+0000", 2024-04-25T22:53:11.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9932000000000003e-05 2024-04-25T22:53:11.193 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:11.194 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:11.194 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:11.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.194 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:11.194 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:11.194 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.140708685000007, 2024-04-25T22:53:11.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021043857999999999, 2024-04-25T22:53:11.194 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:11.194 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:11.194 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:11.194 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:11.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:11.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:11.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:11.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:11.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:11.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:11.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:11.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012523+0000", 2024-04-25T22:53:11.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.361e-06 2024-04-25T22:53:11.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:11.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012530+0000", 2024-04-25T22:53:11.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5440000000000004e-06 2024-04-25T22:53:11.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:11.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012541+0000", 2024-04-25T22:53:11.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1745e-05 2024-04-25T22:53:11.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:11.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012551+0000", 2024-04-25T22:53:11.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5789999999999993e-06 2024-04-25T22:53:11.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:11.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022709+0000", 2024-04-25T22:53:11.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010157685 2024-04-25T22:53:11.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:11.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022957+0000", 2024-04-25T22:53:11.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024824599999999998 2024-04-25T22:53:11.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:11.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023443+0000", 2024-04-25T22:53:11.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048578599999999999 2024-04-25T22:53:11.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.198 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:11.198 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025547+0000", 2024-04-25T22:53:11.198 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021044789999999998 2024-04-25T22:53:11.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.198 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:11.198 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033509+0000", 2024-04-25T22:53:11.198 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0079622180000000001 2024-04-25T22:53:11.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.198 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:11.199 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033542+0000", 2024-04-25T22:53:11.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3018000000000001e-05 2024-04-25T22:53:11.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:11.199 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033566+0000", 2024-04-25T22:53:11.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3197000000000002e-05 2024-04-25T22:53:11.199 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:11.199 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:11.199 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:11.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.199 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:11.199 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:11.199 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.140668719999994, 2024-04-25T22:53:11.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021122696, 2024-04-25T22:53:11.200 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:11.200 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:11.200 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:11.200 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:11.200 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.200 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:11.200 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:11.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:11.200 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.200 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.200 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:11.200 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:11.201 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:11.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:11.201 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:11.201 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:53:11.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:11.201 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012566+0000", 2024-04-25T22:53:11.201 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-04-25T22:53:11.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:11.201 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012619+0000", 2024-04-25T22:53:11.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2607e-05 2024-04-25T22:53:11.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.202 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.202 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:11.202 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012628+0000", 2024-04-25T22:53:11.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6500000000000008e-06 2024-04-25T22:53:11.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.202 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.202 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:11.202 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024024+0000", 2024-04-25T22:53:11.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011396007999999999 2024-04-25T22:53:11.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.202 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.202 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:11.203 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024198+0000", 2024-04-25T22:53:11.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000173215 2024-04-25T22:53:11.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:11.203 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024447+0000", 2024-04-25T22:53:11.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024898500000000002 2024-04-25T22:53:11.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:11.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026431+0000", 2024-04-25T22:53:11.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001984923 2024-04-25T22:53:11.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:11.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033608+0000", 2024-04-25T22:53:11.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071768459999999997 2024-04-25T22:53:11.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:11.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033646+0000", 2024-04-25T22:53:11.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299000000000003e-05 2024-04-25T22:53:11.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:11.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033684+0000", 2024-04-25T22:53:11.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8773000000000003e-05 2024-04-25T22:53:11.205 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:11.205 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:11.205 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:11.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.205 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:11.205 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:11.206 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.140580120999999, 2024-04-25T22:53:11.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021175381, 2024-04-25T22:53:11.206 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:11.206 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:11.206 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:11.206 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:11.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:11.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:11.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:11.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:11.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:11.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:11.207 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.207 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:11.207 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012651+0000", 2024-04-25T22:53:11.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:53:11.207 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.207 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:11.207 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012656+0000", 2024-04-25T22:53:11.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8899999999999998e-06 2024-04-25T22:53:11.207 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.207 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:11.207 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012666+0000", 2024-04-25T22:53:11.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0346999999999999e-05 2024-04-25T22:53:11.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:11.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012675+0000", 2024-04-25T22:53:11.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9930000000000001e-06 2024-04-25T22:53:11.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:11.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025661+0000", 2024-04-25T22:53:11.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01298531 2024-04-25T22:53:11.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:11.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025757+0000", 2024-04-25T22:53:11.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5822000000000005e-05 2024-04-25T22:53:11.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:11.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025907+0000", 2024-04-25T22:53:11.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015051499999999999 2024-04-25T22:53:11.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:11.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026435+0000", 2024-04-25T22:53:11.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052762200000000005 2024-04-25T22:53:11.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:11.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033732+0000", 2024-04-25T22:53:11.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072978419999999997 2024-04-25T22:53:11.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:11.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033787+0000", 2024-04-25T22:53:11.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4703999999999997e-05 2024-04-25T22:53:11.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:11.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033826+0000", 2024-04-25T22:53:11.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8458999999999999e-05 2024-04-25T22:53:11.210 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:11.210 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:11.211 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:11.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.211 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:11.211 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:11.211 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.140524706999997, 2024-04-25T22:53:11.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021244174000000001, 2024-04-25T22:53:11.211 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:11.211 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:11.211 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:11.211 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:11.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:11.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:11.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:11.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:11.212 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:11.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:11.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:11.212 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:11.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:11.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:11.213 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012712+0000", 2024-04-25T22:53:11.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.913e-06 2024-04-25T22:53:11.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.213 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:11.213 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012722+0000", 2024-04-25T22:53:11.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2879999999999998e-06 2024-04-25T22:53:11.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.213 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:11.213 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012727+0000", 2024-04-25T22:53:11.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8429999999999998e-06 2024-04-25T22:53:11.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.213 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:11.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026099+0000", 2024-04-25T22:53:11.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013371450999999999 2024-04-25T22:53:11.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:11.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026147+0000", 2024-04-25T22:53:11.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7837999999999998e-05 2024-04-25T22:53:11.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:11.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026254+0000", 2024-04-25T22:53:11.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107314 2024-04-25T22:53:11.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:11.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026686+0000", 2024-04-25T22:53:11.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000432428 2024-04-25T22:53:11.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:11.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033873+0000", 2024-04-25T22:53:11.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071864399999999997 2024-04-25T22:53:11.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:11.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033904+0000", 2024-04-25T22:53:11.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1321e-05 2024-04-25T22:53:11.216 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.216 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:11.216 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033950+0000", 2024-04-25T22:53:11.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5707999999999997e-05 2024-04-25T22:53:11.216 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:11.216 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:11.216 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:11.216 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.216 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:11.216 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:11.216 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.140494321999995, 2024-04-25T22:53:11.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01096505, 2024-04-25T22:53:11.217 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:11.217 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:11.217 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:11.217 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:11.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:11.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:11.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:11.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:11.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:11.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:11.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:11.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012737+0000", 2024-04-25T22:53:11.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:11.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:11.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012739+0000", 2024-04-25T22:53:11.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-04-25T22:53:11.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:11.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012743+0000", 2024-04-25T22:53:11.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3239999999999996e-06 2024-04-25T22:53:11.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:11.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012746+0000", 2024-04-25T22:53:11.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.129e-06 2024-04-25T22:53:11.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:11.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012796+0000", 2024-04-25T22:53:11.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9231999999999999e-05 2024-04-25T22:53:11.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:11.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012915+0000", 2024-04-25T22:53:11.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119021 2024-04-25T22:53:11.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:11.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013069+0000", 2024-04-25T22:53:11.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015463900000000001 2024-04-25T22:53:11.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:11.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019237+0000", 2024-04-25T22:53:11.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061680329999999998 2024-04-25T22:53:11.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:11.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023603+0000", 2024-04-25T22:53:11.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043655860000000003 2024-04-25T22:53:11.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:11.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023659+0000", 2024-04-25T22:53:11.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6484000000000003e-05 2024-04-25T22:53:11.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:11.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023701+0000", 2024-04-25T22:53:11.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1761999999999998e-05 2024-04-25T22:53:11.221 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:11.222 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:11.222 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:11.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.222 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:11.222 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:11.222 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.140469374000006, 2024-04-25T22:53:11.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011234429000000001, 2024-04-25T22:53:11.222 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:11.222 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:11.222 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:11.222 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:11.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:11.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:11.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:11.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:11.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:11.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:11.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:11.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012762+0000", 2024-04-25T22:53:11.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-04-25T22:53:11.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:11.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012765+0000", 2024-04-25T22:53:11.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2569999999999999e-06 2024-04-25T22:53:11.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:11.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012783+0000", 2024-04-25T22:53:11.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8431999999999999e-05 2024-04-25T22:53:11.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:11.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012799+0000", 2024-04-25T22:53:11.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5438999999999999e-05 2024-04-25T22:53:11.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:11.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013826+0000", 2024-04-25T22:53:11.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010275060000000001 2024-04-25T22:53:11.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:11.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013913+0000", 2024-04-25T22:53:11.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.708e-05 2024-04-25T22:53:11.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:11.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014098+0000", 2024-04-25T22:53:11.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018519399999999999 2024-04-25T22:53:11.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:11.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019684+0000", 2024-04-25T22:53:11.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055860079999999999 2024-04-25T22:53:11.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:11.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023876+0000", 2024-04-25T22:53:11.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041918800000000003 2024-04-25T22:53:11.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:11.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023957+0000", 2024-04-25T22:53:11.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1165e-05 2024-04-25T22:53:11.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:11.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023995+0000", 2024-04-25T22:53:11.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:53:11.227 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:11.227 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:11.227 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:11.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.227 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:11.227 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:11.227 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.140371595000005, 2024-04-25T22:53:11.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011131200000000001, 2024-04-25T22:53:11.228 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:11.228 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:11.228 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:11.228 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:11.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.228 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:11.228 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:11.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:11.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.228 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:11.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:11.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:11.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:11.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012860+0000", 2024-04-25T22:53:11.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3900000000000004e-07 2024-04-25T22:53:11.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:11.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012865+0000", 2024-04-25T22:53:11.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5609999999999998e-06 2024-04-25T22:53:11.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:11.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012895+0000", 2024-04-25T22:53:11.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9847000000000001e-05 2024-04-25T22:53:11.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:11.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012905+0000", 2024-04-25T22:53:11.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.03e-05 2024-04-25T22:53:11.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:11.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015020+0000", 2024-04-25T22:53:11.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021142940000000001 2024-04-25T22:53:11.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:11.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015182+0000", 2024-04-25T22:53:11.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016248099999999999 2024-04-25T22:53:11.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:11.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015357+0000", 2024-04-25T22:53:11.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017471000000000001 2024-04-25T22:53:11.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:11.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021021+0000", 2024-04-25T22:53:11.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056638340000000004 2024-04-25T22:53:11.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:11.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023712+0000", 2024-04-25T22:53:11.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026910380000000002 2024-04-25T22:53:11.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:11.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023763+0000", 2024-04-25T22:53:11.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1477999999999997e-05 2024-04-25T22:53:11.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:11.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023990+0000", 2024-04-25T22:53:11.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000226818 2024-04-25T22:53:11.232 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:11.233 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:11.233 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:11.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.233 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:11.233 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:11.233 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.140248498999995, 2024-04-25T22:53:11.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011705299000000001, 2024-04-25T22:53:11.233 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:11.233 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:11.233 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:11.233 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:11.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:11.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:11.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:11.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:11.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:11.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:11.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:11.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012983+0000", 2024-04-25T22:53:11.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:53:11.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:11.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012986+0000", 2024-04-25T22:53:11.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5700000000000001e-06 2024-04-25T22:53:11.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:11.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012993+0000", 2024-04-25T22:53:11.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8730000000000001e-06 2024-04-25T22:53:11.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:11.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013000+0000", 2024-04-25T22:53:11.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1890000000000001e-06 2024-04-25T22:53:11.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:11.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:53:11.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002147866 2024-04-25T22:53:11.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:11.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015351+0000", 2024-04-25T22:53:11.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020300799999999999 2024-04-25T22:53:11.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:11.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016260+0000", 2024-04-25T22:53:11.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00090926799999999997 2024-04-25T22:53:11.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:11.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022669+0000", 2024-04-25T22:53:11.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064082849999999997 2024-04-25T22:53:11.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:11.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024584+0000", 2024-04-25T22:53:11.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019151699999999999 2024-04-25T22:53:11.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:11.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024643+0000", 2024-04-25T22:53:11.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8888999999999998e-05 2024-04-25T22:53:11.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:11.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024687+0000", 2024-04-25T22:53:11.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4444999999999999e-05 2024-04-25T22:53:11.239 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:11.239 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:11.239 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:11.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.239 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:11.239 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:11.239 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.140220908000003, 2024-04-25T22:53:11.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011249699, 2024-04-25T22:53:11.239 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:11.239 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:11.239 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:11.239 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:11.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:11.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:11.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:11.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:11.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:11.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:11.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:11.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013010+0000", 2024-04-25T22:53:11.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2099999999999996e-07 2024-04-25T22:53:11.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:11.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013013+0000", 2024-04-25T22:53:11.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1310000000000002e-06 2024-04-25T22:53:11.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:11.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013020+0000", 2024-04-25T22:53:11.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3330000000000002e-06 2024-04-25T22:53:11.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:11.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013025+0000", 2024-04-25T22:53:11.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6760000000000004e-06 2024-04-25T22:53:11.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:11.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013163+0000", 2024-04-25T22:53:11.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013824599999999999 2024-04-25T22:53:11.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:11.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013504+0000", 2024-04-25T22:53:11.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034080299999999998 2024-04-25T22:53:11.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:11.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013613+0000", 2024-04-25T22:53:11.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108705 2024-04-25T22:53:11.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:11.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015831+0000", 2024-04-25T22:53:11.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002217672 2024-04-25T22:53:11.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:11.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024137+0000", 2024-04-25T22:53:11.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0083060489999999994 2024-04-25T22:53:11.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:11.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024218+0000", 2024-04-25T22:53:11.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1351000000000001e-05 2024-04-25T22:53:11.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:11.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024259+0000", 2024-04-25T22:53:11.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1112000000000002e-05 2024-04-25T22:53:11.244 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:11.244 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:11.244 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:11.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.244 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:11.244 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:11.245 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.140133182, 2024-04-25T22:53:11.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020379749999999999, 2024-04-25T22:53:11.245 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:11.245 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:11.245 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:11.245 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:11.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:11.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:11.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:11.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:11.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:11.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:11.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:11.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013098+0000", 2024-04-25T22:53:11.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:53:11.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:11.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013105+0000", 2024-04-25T22:53:11.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5969999999999997e-06 2024-04-25T22:53:11.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.247 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:11.247 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013190+0000", 2024-04-25T22:53:11.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5618999999999995e-05 2024-04-25T22:53:11.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.247 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:11.247 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013200+0000", 2024-04-25T22:53:11.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5859999999999994e-06 2024-04-25T22:53:11.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.247 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:11.248 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020265+0000", 2024-04-25T22:53:11.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070653349999999998 2024-04-25T22:53:11.248 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.248 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:11.248 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020454+0000", 2024-04-25T22:53:11.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189316 2024-04-25T22:53:11.248 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.248 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:11.248 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020586+0000", 2024-04-25T22:53:11.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013195700000000001 2024-04-25T22:53:11.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:11.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023822+0000", 2024-04-25T22:53:11.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032358529999999999 2024-04-25T22:53:11.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:11.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033409+0000", 2024-04-25T22:53:11.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095870520000000004 2024-04-25T22:53:11.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:11.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033447+0000", 2024-04-25T22:53:11.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7261999999999997e-05 2024-04-25T22:53:11.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:11.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033477+0000", 2024-04-25T22:53:11.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0389e-05 2024-04-25T22:53:11.250 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:11.250 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:11.250 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:11.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.251 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:11.251 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:11.251 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.140016676000002, 2024-04-25T22:53:11.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010857383999999999, 2024-04-25T22:53:11.251 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:11.251 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:11.251 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:11.251 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:11.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:11.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:11.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:11.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.252 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:11.252 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:11.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:11.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.252 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:11.252 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:11.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:11.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.252 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:11.252 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013218+0000", 2024-04-25T22:53:11.253 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8199999999999998e-06 2024-04-25T22:53:11.253 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.253 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.253 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:11.253 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013226+0000", 2024-04-25T22:53:11.253 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7649999999999993e-06 2024-04-25T22:53:11.253 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.253 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.253 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:11.253 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013259+0000", 2024-04-25T22:53:11.253 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2727e-05 2024-04-25T22:53:11.253 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.253 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.253 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:11.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014809+0000", 2024-04-25T22:53:11.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001550144 2024-04-25T22:53:11.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:11.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014958+0000", 2024-04-25T22:53:11.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014890300000000001 2024-04-25T22:53:11.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:11.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015087+0000", 2024-04-25T22:53:11.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012939200000000001 2024-04-25T22:53:11.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:11.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020212+0000", 2024-04-25T22:53:11.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051248939999999996 2024-04-25T22:53:11.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:11.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023699+0000", 2024-04-25T22:53:11.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034873289999999999 2024-04-25T22:53:11.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:11.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024014+0000", 2024-04-25T22:53:11.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031473999999999999 2024-04-25T22:53:11.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.256 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:11.256 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024071+0000", 2024-04-25T22:53:11.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7040000000000003e-05 2024-04-25T22:53:11.256 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:11.256 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:11.256 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:11.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.256 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:11.256 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:11.256 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.139961971000005, 2024-04-25T22:53:11.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012329677000000001, 2024-04-25T22:53:11.256 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:11.256 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:11.257 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:11.257 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:11.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.257 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:11.257 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:11.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:11.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.257 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:11.257 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:11.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:11.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.257 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:11.257 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013269+0000", 2024-04-25T22:53:11.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5000000000000002e-07 2024-04-25T22:53:11.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:11.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:11.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6909999999999999e-06 2024-04-25T22:53:11.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:11.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013284+0000", 2024-04-25T22:53:11.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0963e-05 2024-04-25T22:53:11.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:11.259 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013361+0000", 2024-04-25T22:53:11.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7379999999999994e-05 2024-04-25T22:53:11.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.259 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:11.259 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013448+0000", 2024-04-25T22:53:11.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6990000000000006e-05 2024-04-25T22:53:11.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.259 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:11.259 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013632+0000", 2024-04-25T22:53:11.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018396800000000001 2024-04-25T22:53:11.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.260 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:11.260 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013800+0000", 2024-04-25T22:53:11.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167467 2024-04-25T22:53:11.260 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.261 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:11.261 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.018570+0000", 2024-04-25T22:53:11.261 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047701460000000003 2024-04-25T22:53:11.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.261 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:11.261 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025507+0000", 2024-04-25T22:53:11.261 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069372039999999998 2024-04-25T22:53:11.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.261 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:11.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025562+0000", 2024-04-25T22:53:11.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4858999999999998e-05 2024-04-25T22:53:11.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:11.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025598+0000", 2024-04-25T22:53:11.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6259e-05 2024-04-25T22:53:11.262 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:11.262 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:11.262 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:11.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.263 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:11.263 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:11.263 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.139830098000004, 2024-04-25T22:53:11.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020176666999999999, 2024-04-25T22:53:11.263 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:11.263 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:11.263 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:53:11.263 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:11.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:11.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:11.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:11.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:11.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:11.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:11.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:11.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:11.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-04-25T22:53:11.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:11.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013405+0000", 2024-04-25T22:53:11.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0559999999999998e-06 2024-04-25T22:53:11.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.265 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.265 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:11.265 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013422+0000", 2024-04-25T22:53:11.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6770999999999999e-05 2024-04-25T22:53:11.265 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.265 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.265 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:11.265 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013431+0000", 2024-04-25T22:53:11.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5019999999999998e-06 2024-04-25T22:53:11.265 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.265 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.265 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:11.265 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021720+0000", 2024-04-25T22:53:11.266 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082884340000000008 2024-04-25T22:53:11.266 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.266 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.266 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:11.266 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022122+0000", 2024-04-25T22:53:11.266 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000401634 2024-04-25T22:53:11.266 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:11.266 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:11.266 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:11.266 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033577+0000", 2024-04-25T22:53:11.266 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011455435999999999 2024-04-25T22:53:11.266 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:11.267 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:11.267 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:11.267 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:11.267 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:11.267 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:11.267 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-25T22:53:11.268 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T22:53:11.278 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:11.268+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:11.279 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:11.294 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-25T22:53:11.294 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:53:11.294 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:53:11.329 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-25T22:53:11.329 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:53:11.333 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:53:11.333 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:53:11.369 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:11.369+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:11.379 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off 2024-04-25T22:53:11.389 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:11.389 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:11.398 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:11.470 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:11.469+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:11.542 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:11.542 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:11.550 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:11.594 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:11.594+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:11.654 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:11.654 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:11.662 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:11.703 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:11.703+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:11.765 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:11.765 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:11.772 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:11.771+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:11.773 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:11.873 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:11.872+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:11.915 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:11.916 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:11.924 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:11.974 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:11.974+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:12.066 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:12.066 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:12.074 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:12.076 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:12.076+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:12.177 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:12.177+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:12.183 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:12.183 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:12.193 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:12.212 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is unset 2024-04-25T22:53:12.278 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:12.277+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:12.296 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:12.296 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:12.305 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:12.379 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:12.379+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:12.408 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:12.408 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:12.417 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:12.480 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:12.480+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:12.520 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:12.520 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:12.528 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:12.580 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:12.580+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:12.629 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:12.629 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:12.637 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:12.655 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~29s 2024-04-25T22:53:12.682 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:12.681+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:12.739 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:12.739 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:12.747 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:12.791 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:12.791+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:12.851 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:12.851 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:12.860 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:12.901 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:12.901+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:12.985 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:12.984+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:13.003 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:13.003 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:13.011 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:13.086 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:13.086+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:13.114 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:13.114 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:13.123 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:13.187 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:13.187+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:13.226 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:13.226 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:13.234 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:13.288 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:13.288+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:13.335 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:53:13.335 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:13.336 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:13.343 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:13.389 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:13.388+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:13.445 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:13.445 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:13.453 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:13.483 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-25T22:53:13.484 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:53:13.484 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:53:13.497 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:13.497+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:13.517 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-25T22:53:13.517 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:53:13.520 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:53:13.521 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:53:13.555 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:13.556 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:13.556 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-25T22:53:13.556 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:13.564 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:13.605 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:13.605+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:13.693 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:13.692+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:13.706 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:13.706 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:13.706 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-25T22:53:13.706 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-25T22:53:13.706 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:13.716 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:13.800 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:13.800+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:13.859 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:13.860 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:53:13.860 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:53:13.860 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:53:13.860 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.860 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:53:13.860 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:13.860 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 85.890919627000002, 2024-04-25T22:53:13.860 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:53:13.860 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:13.860 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:13.860 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:13.861 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:13.861 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.861 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:13.861 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:13.861 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:13.861 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.861 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.861 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:13.861 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:13.861 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:13.861 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.861 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.861 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:13.862 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:53:13.862 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:53:13.862 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.862 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.862 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:13.862 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:53:13.862 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:53:13.862 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.862 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.862 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:13.862 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:53:13.862 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:53:13.863 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.863 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.863 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:13.863 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:53:13.863 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:53:13.863 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.863 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.863 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:13.863 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:53:13.863 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:53:13.863 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.863 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.863 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:13.864 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:53:13.864 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:53:13.864 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.864 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.864 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:13.864 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:53:13.864 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:53:13.864 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.864 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.864 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:13.864 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:53:13.864 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:53:13.865 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:13.865 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:13.865 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:13.865 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.865 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.865 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:110 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'72, mlcod=10'68)", 2024-04-25T22:53:13.865 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:13.865 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 85.890285626999997, 2024-04-25T22:53:13.865 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065316630000000001, 2024-04-25T22:53:13.865 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:13.865 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:13.865 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:13.866 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:13.866 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.866 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:13.866 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:13.866 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:13.866 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.866 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.866 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:13.866 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:13.866 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:13.866 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.866 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.866 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:13.867 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:13.867 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.58e-07 2024-04-25T22:53:13.867 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.867 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.867 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:13.867 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967811+0000", 2024-04-25T22:53:13.867 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.118e-06 2024-04-25T22:53:13.867 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.867 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.867 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:13.867 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967817+0000", 2024-04-25T22:53:13.867 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3709999999999996e-06 2024-04-25T22:53:13.867 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.868 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.868 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:13.868 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967820+0000", 2024-04-25T22:53:13.868 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2210000000000002e-06 2024-04-25T22:53:13.868 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.868 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.868 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:13.868 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967876+0000", 2024-04-25T22:53:13.868 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5507000000000002e-05 2024-04-25T22:53:13.868 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.868 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.868 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:13.868 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967893+0000", 2024-04-25T22:53:13.869 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7812000000000002e-05 2024-04-25T22:53:13.869 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.869 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.869 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:13.869 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974317+0000", 2024-04-25T22:53:13.869 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064237160000000003 2024-04-25T22:53:13.869 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.869 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.869 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:13.869 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:53:13.869 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.156e-05 2024-04-25T22:53:13.869 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:13.869 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:13.869 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:13.870 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.870 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.870 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'68)", 2024-04-25T22:53:13.870 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:13.870 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 85.889868113999995, 2024-04-25T22:53:13.870 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061292279999999996, 2024-04-25T22:53:13.870 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:13.870 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:13.870 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:13.870 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:13.870 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.871 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:13.871 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:13.871 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:13.871 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.871 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.871 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:13.871 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:13.871 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:13.871 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.871 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.871 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:13.871 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:13.872 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6300000000000001e-07 2024-04-25T22:53:13.872 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.872 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.872 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:13.872 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968228+0000", 2024-04-25T22:53:13.872 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6139999999999999e-06 2024-04-25T22:53:13.872 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.872 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.872 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:13.872 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968235+0000", 2024-04-25T22:53:13.872 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7020000000000001e-06 2024-04-25T22:53:13.872 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.872 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.872 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:13.872 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968238+0000", 2024-04-25T22:53:13.873 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0010000000000002e-06 2024-04-25T22:53:13.873 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.873 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.873 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:13.873 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968297+0000", 2024-04-25T22:53:13.873 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8424999999999997e-05 2024-04-25T22:53:13.873 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.873 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.873 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:13.873 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968316+0000", 2024-04-25T22:53:13.873 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8814999999999999e-05 2024-04-25T22:53:13.873 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.873 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.873 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:13.874 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:53:13.874 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060239439999999998 2024-04-25T22:53:13.874 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.874 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.874 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:13.874 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974354+0000", 2024-04-25T22:53:13.874 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4364e-05 2024-04-25T22:53:13.874 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:13.874 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:13.875 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:13.875 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.875 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.875 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'68)", 2024-04-25T22:53:13.875 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:13.875 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 85.889431111999997, 2024-04-25T22:53:13.875 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005948414, 2024-04-25T22:53:13.875 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:13.875 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:13.875 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:13.875 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:13.876 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.876 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:13.876 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:13.876 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:13.876 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.876 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.876 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:13.876 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:13.876 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:13.876 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.877 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.877 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:13.877 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:13.877 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6199999999999998e-07 2024-04-25T22:53:13.877 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.877 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.877 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:13.877 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968723+0000", 2024-04-25T22:53:13.877 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1148999999999993e-05 2024-04-25T22:53:13.877 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.877 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.877 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:13.877 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968730+0000", 2024-04-25T22:53:13.878 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1749999999999999e-06 2024-04-25T22:53:13.878 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.878 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.878 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:13.878 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968734+0000", 2024-04-25T22:53:13.878 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5200000000000002e-06 2024-04-25T22:53:13.878 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.878 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.879 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:13.879 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968771+0000", 2024-04-25T22:53:13.879 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6851999999999999e-05 2024-04-25T22:53:13.879 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.879 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.879 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:13.879 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968788+0000", 2024-04-25T22:53:13.880 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7027000000000001e-05 2024-04-25T22:53:13.880 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.880 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.880 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:13.880 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974589+0000", 2024-04-25T22:53:13.880 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058013320000000002 2024-04-25T22:53:13.881 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.881 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.881 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:13.881 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974610+0000", 2024-04-25T22:53:13.881 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0897e-05 2024-04-25T22:53:13.881 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:13.881 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:13.881 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:13.881 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.881 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.881 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'68)", 2024-04-25T22:53:13.882 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:13.882 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 85.888861102000007, 2024-04-25T22:53:13.882 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053935750000000003, 2024-04-25T22:53:13.882 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:13.882 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:13.882 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:13.882 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:13.882 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.882 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:13.882 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:13.882 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:13.882 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.883 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.883 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:13.883 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:13.883 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:13.883 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.883 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.883 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:13.883 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:13.883 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.03e-07 2024-04-25T22:53:13.883 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.883 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.883 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:13.883 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969235+0000", 2024-04-25T22:53:13.883 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2399999999999999e-06 2024-04-25T22:53:13.883 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.884 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.884 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:13.884 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969242+0000", 2024-04-25T22:53:13.884 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1269999999999997e-06 2024-04-25T22:53:13.884 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.884 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.884 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:13.884 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969246+0000", 2024-04-25T22:53:13.884 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3840000000000001e-06 2024-04-25T22:53:13.884 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.884 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.884 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:13.884 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969278+0000", 2024-04-25T22:53:13.884 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1868e-05 2024-04-25T22:53:13.885 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.885 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.885 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:13.885 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969295+0000", 2024-04-25T22:53:13.885 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7530999999999999e-05 2024-04-25T22:53:13.885 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.885 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.885 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:13.885 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974611+0000", 2024-04-25T22:53:13.885 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053160789999999996 2024-04-25T22:53:13.885 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.885 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.885 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:13.885 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974625+0000", 2024-04-25T22:53:13.886 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3943e-05 2024-04-25T22:53:13.886 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:13.886 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:13.886 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:13.886 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.886 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.886 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-25T22:53:13.886 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:13.886 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 85.695265194000001, 2024-04-25T22:53:13.886 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054952610000000004, 2024-04-25T22:53:13.886 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:13.886 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:13.887 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:13.887 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:13.887 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.887 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:13.887 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:13.887 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:13.887 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.887 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.887 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:13.887 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:13.887 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:13.888 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.888 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.888 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:13.888 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:13.889 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.68e-07 2024-04-25T22:53:13.889 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.889 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.889 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:13.889 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162898+0000", 2024-04-25T22:53:13.889 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9470999999999999e-05 2024-04-25T22:53:13.889 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.890 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.890 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:13.890 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162906+0000", 2024-04-25T22:53:13.890 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1580000000000005e-06 2024-04-25T22:53:13.890 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.890 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.891 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:13.891 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162911+0000", 2024-04-25T22:53:13.891 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4779999999999999e-06 2024-04-25T22:53:13.891 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.891 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.891 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:13.892 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162952+0000", 2024-04-25T22:53:13.892 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0629e-05 2024-04-25T22:53:13.892 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.892 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.892 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:13.892 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162968+0000", 2024-04-25T22:53:13.892 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6239000000000002e-05 2024-04-25T22:53:13.893 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.893 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.893 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:13.893 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168281+0000", 2024-04-25T22:53:13.893 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053132869999999999 2024-04-25T22:53:13.893 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.893 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.893 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:13.894 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168323+0000", 2024-04-25T22:53:13.894 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1430999999999997e-05 2024-04-25T22:53:13.894 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:13.894 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:13.894 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:13.894 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.895 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.895 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-04-25T22:53:13.895 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:13.895 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 85.264787831999996, 2024-04-25T22:53:13.895 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050872510000000001, 2024-04-25T22:53:13.895 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:13.896 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:13.896 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:13.896 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:13.896 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.896 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:13.896 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:13.897 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:13.897 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.897 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.897 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:13.897 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:13.898 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:13.898 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.898 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.898 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:13.898 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:13.898 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.72e-07 2024-04-25T22:53:13.899 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.899 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.899 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:13.899 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593381+0000", 2024-04-25T22:53:13.899 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5797000000000006e-05 2024-04-25T22:53:13.900 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.900 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.900 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:13.900 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593389+0000", 2024-04-25T22:53:13.900 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8480000000000001e-06 2024-04-25T22:53:13.900 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.901 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.901 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:13.901 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593393+0000", 2024-04-25T22:53:13.901 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4819999999999996e-06 2024-04-25T22:53:13.901 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.902 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.902 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:13.902 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593435+0000", 2024-04-25T22:53:13.902 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1600000000000002e-05 2024-04-25T22:53:13.902 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.902 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.903 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:13.903 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593454+0000", 2024-04-25T22:53:13.903 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8868e-05 2024-04-25T22:53:13.903 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.903 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.904 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:13.904 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598350+0000", 2024-04-25T22:53:13.904 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004895763 2024-04-25T22:53:13.904 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.904 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.904 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:13.905 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598392+0000", 2024-04-25T22:53:13.905 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2521000000000002e-05 2024-04-25T22:53:13.905 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:13.905 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:13.905 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:13.905 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.906 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.906 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:13.906 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:13.906 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 80.846423927999993, 2024-04-25T22:53:13.906 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:53:13.907 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:13.907 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:13.907 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:13.907 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:13.907 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.907 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:13.908 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:13.908 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:13.908 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.908 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.908 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:13.908 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:13.909 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:13.909 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.909 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.909 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:13.909 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:53:13.910 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:53:13.910 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.910 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.910 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:13.910 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:53:13.911 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:53:13.911 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.911 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.911 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:13.911 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:53:13.912 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:53:13.912 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.912 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.912 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:13.912 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:53:13.912 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:53:13.913 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.913 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.913 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:13.913 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:53:13.913 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:53:13.914 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.914 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.914 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:13.914 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:53:13.914 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:53:13.915 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.915 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.915 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:13.915 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:53:13.915 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:53:13.915 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.916 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.916 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:13.916 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:53:13.916 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:53:13.916 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.916 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.917 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:13.917 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:53:13.917 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:53:13.917 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.917 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.918 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:13.918 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:53:13.918 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:53:13.918 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.918 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.919 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:13.919 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:53:13.919 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:53:13.919 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:13.919 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:13.919 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:13.920 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.920 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.920 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:13.920 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:13.920 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 80.845749552000001, 2024-04-25T22:53:13.920 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:53:13.921 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:13.921 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:13.921 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:13.921 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:13.921 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.922 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:13.922 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:13.922 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:13.922 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.922 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.922 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:13.923 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:13.923 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:13.923 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.923 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.923 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:13.924 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:53:13.924 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:53:13.924 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.924 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.924 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:13.924 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:53:13.925 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:53:13.925 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.925 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.925 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:13.925 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:53:13.925 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:53:13.926 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.926 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.926 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:13.926 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:53:13.926 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:53:13.926 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.927 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.927 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:13.927 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:53:13.927 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:53:13.927 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.927 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.928 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:13.928 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:53:13.928 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:53:13.928 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.928 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.929 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:13.929 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:53:13.929 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:53:13.929 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.929 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.930 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:13.930 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:53:13.930 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:53:13.930 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.930 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.930 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:13.931 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:53:13.931 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:53:13.931 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.931 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.931 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:13.932 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:53:13.932 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:53:13.932 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.932 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.932 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:13.933 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:53:13.933 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:53:13.933 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:13.933 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:13.933 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:13.933 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.934 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.934 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:13.934 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:13.934 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 80.845240340000004, 2024-04-25T22:53:13.934 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:53:13.934 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:13.935 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:13.935 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:13.935 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:13.935 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.935 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:13.935 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:13.936 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:13.936 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.936 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.936 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:13.936 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:13.936 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:13.937 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.937 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.937 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:13.937 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:53:13.937 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:53:13.937 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.937 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.938 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:13.938 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:53:13.938 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:53:13.938 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.938 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.938 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:13.939 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:53:13.939 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:53:13.939 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.939 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.939 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:13.939 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:53:13.939 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:53:13.939 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.939 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.939 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:13.940 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:53:13.940 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:53:13.940 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.940 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.940 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:13.940 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:53:13.940 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:53:13.941 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.941 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.941 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:13.941 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:53:13.941 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:53:13.941 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.941 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.941 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:13.941 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:53:13.941 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:53:13.941 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.941 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.942 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:13.942 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:53:13.942 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:53:13.942 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.942 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.942 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:13.943 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:53:13.943 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:53:13.943 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.943 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.943 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:13.943 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:53:13.944 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:53:13.944 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:13.944 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:13.944 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:13.944 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.944 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.945 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:13.945 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:13.945 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 80.844827142, 2024-04-25T22:53:13.945 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:53:13.945 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:13.945 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:13.946 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:13.946 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:13.946 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.946 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:13.946 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:13.946 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:13.947 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.947 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.947 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:13.947 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:13.947 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:13.947 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.947 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.947 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:13.947 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:13.947 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:53:13.948 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.948 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.948 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:13.948 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:13.948 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:53:13.948 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.948 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.948 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:13.948 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:53:13.949 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:53:13.949 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.949 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.949 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:13.949 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:53:13.949 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:53:13.950 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.950 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.950 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:13.950 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:53:13.950 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:53:13.950 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.950 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.950 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:13.950 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:53:13.951 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:53:13.951 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.951 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.951 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:13.951 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:53:13.951 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:53:13.951 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.951 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.952 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:13.952 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:53:13.952 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:53:13.952 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.952 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.952 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:13.952 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:53:13.952 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:53:13.952 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.953 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.953 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:13.953 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:53:13.953 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:53:13.953 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.953 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.953 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:13.953 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:53:13.953 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:53:13.954 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:13.954 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:13.954 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:13.954 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.954 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.954 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:13.954 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:13.954 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 80.844776472000007, 2024-04-25T22:53:13.954 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:53:13.954 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:13.954 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:13.955 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:13.955 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:13.955 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.955 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:13.955 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:13.955 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:13.955 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.955 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.955 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:13.955 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:13.955 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:13.955 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.955 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.955 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:13.956 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:53:13.956 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:53:13.956 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.956 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.956 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:13.956 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:53:13.956 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:53:13.956 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.956 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.956 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:13.956 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:53:13.956 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:53:13.957 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.957 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.957 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:13.957 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:53:13.957 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:53:13.957 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.957 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.957 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:13.957 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:53:13.957 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:53:13.957 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.957 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.957 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:13.957 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:53:13.957 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:53:13.958 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.958 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.958 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:13.958 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:53:13.958 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:53:13.958 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.958 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.958 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:13.958 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:53:13.958 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:53:13.958 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.958 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.958 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:13.959 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:53:13.959 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:53:13.959 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.959 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.959 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:13.959 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:53:13.959 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:53:13.959 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.959 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.959 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:13.959 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:53:13.959 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:53:13.959 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.960 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.960 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:13.960 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:53:13.960 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:53:13.960 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.960 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.960 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:13.960 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:53:13.960 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:53:13.960 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:13.960 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:13.960 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:13.960 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.960 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.961 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:13.961 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:13.961 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 80.844739602999994, 2024-04-25T22:53:13.961 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:53:13.961 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:13.961 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:13.961 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:13.961 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:13.961 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.961 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:13.961 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:13.961 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:13.961 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.962 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.962 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:13.962 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:13.962 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:13.962 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.962 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.962 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:13.963 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:53:13.963 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:53:13.963 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.963 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.963 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:13.963 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:53:13.963 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:53:13.963 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.963 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.963 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:13.964 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:53:13.964 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:53:13.964 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.964 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.964 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:13.964 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:53:13.964 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:53:13.964 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.964 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.965 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:13.965 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:53:13.965 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:53:13.965 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.965 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.965 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:53:13.965 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:53:13.965 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:53:13.965 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.966 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.966 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:13.966 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:53:13.966 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:53:13.966 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.966 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.966 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:13.966 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:53:13.967 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:53:13.967 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.967 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.967 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:13.967 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:53:13.967 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:53:13.967 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.967 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.967 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:13.968 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:53:13.968 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:53:13.968 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.968 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.968 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:13.968 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:53:13.968 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:53:13.968 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.969 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.969 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:13.969 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:53:13.969 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:53:13.969 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.969 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.969 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:13.969 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:53:13.970 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:53:13.970 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:13.970 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:13.970 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:13.970 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.970 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.970 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:13.971 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:13.971 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 80.844714636999996, 2024-04-25T22:53:13.971 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:53:13.971 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:13.971 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:13.971 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:13.971 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:13.971 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.972 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:13.972 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:13.972 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:13.972 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.972 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.972 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:13.972 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:13.972 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:13.972 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.973 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.973 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:13.973 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:53:13.973 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:53:13.973 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.973 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.974 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:13.974 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:53:13.974 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:53:13.974 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.974 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.974 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:13.974 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:13.974 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:53:13.975 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.975 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.975 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:13.975 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:53:13.975 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:53:13.975 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.975 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.975 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:13.975 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:53:13.976 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:53:13.976 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.976 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.976 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:13.976 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:53:13.976 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:53:13.977 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.977 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.977 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:13.977 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:53:13.977 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:53:13.977 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.977 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.977 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:13.978 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:53:13.978 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:53:13.978 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.978 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.978 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:13.978 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:53:13.978 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:53:13.979 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.979 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.979 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:13.979 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:53:13.979 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:53:13.979 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.979 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.979 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:13.980 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:53:13.980 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:53:13.980 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:13.980 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:13.980 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:13.980 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.980 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.980 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:13.981 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:13.981 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 80.844678273, 2024-04-25T22:53:13.981 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:53:13.981 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:13.981 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:13.981 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:13.981 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:13.981 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.981 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:13.981 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:13.981 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:13.981 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.981 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.982 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:13.982 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:13.982 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:13.982 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.982 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.982 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:13.982 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:53:13.982 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:53:13.982 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.983 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.983 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:13.983 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:53:13.983 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:53:13.983 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.983 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.983 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:13.983 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:53:13.983 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:53:13.983 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.984 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.984 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:13.984 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:53:13.984 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:53:13.984 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.984 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.984 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:13.984 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:53:13.984 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:53:13.984 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.984 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.985 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:13.985 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:53:13.985 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:53:13.985 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.985 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.985 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:13.985 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:53:13.985 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:53:13.985 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.985 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.985 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:13.985 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:53:13.985 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:53:13.985 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.986 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.986 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:13.986 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:53:13.986 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:53:13.986 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:13.986 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:13.986 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:13.986 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.986 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.986 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:13.986 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:13.986 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 80.844647191999996, 2024-04-25T22:53:13.987 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:53:13.987 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:13.987 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:13.987 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:13.987 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:13.987 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.987 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:13.987 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:13.987 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:13.987 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.987 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.987 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:13.987 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:13.988 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:13.988 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.988 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.988 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:13.988 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:13.988 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:13.988 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.988 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.988 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:13.989 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:53:13.989 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:53:13.989 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.989 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.989 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:13.989 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:53:13.989 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:53:13.989 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.989 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.989 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:13.989 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:53:13.989 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:53:13.989 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.990 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.990 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:13.990 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:53:13.990 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:53:13.990 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.990 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.990 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:13.990 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:53:13.990 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:53:13.990 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.990 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.990 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:13.991 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:53:13.991 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:53:13.991 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:13.991 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:13.991 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:13.991 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.991 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.991 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:53:13.991 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:13.991 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 80.844206223, 2024-04-25T22:53:13.991 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064881979999999997, 2024-04-25T22:53:13.992 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:13.992 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:13.992 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:13.992 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:13.992 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.992 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:13.992 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:13.992 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:13.992 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.992 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.992 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:13.992 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:13.992 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:13.993 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.993 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.993 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:13.993 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:13.993 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2699999999999999e-07 2024-04-25T22:53:13.993 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.993 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.993 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:13.993 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013898+0000", 2024-04-25T22:53:13.993 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0796e-05 2024-04-25T22:53:13.993 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.993 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.993 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:13.994 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013907+0000", 2024-04-25T22:53:13.994 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5140000000000007e-06 2024-04-25T22:53:13.994 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.994 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.994 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:13.994 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013952+0000", 2024-04-25T22:53:13.994 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4134000000000001e-05 2024-04-25T22:53:13.994 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.994 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.995 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:13.995 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016812+0000", 2024-04-25T22:53:13.995 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028601059999999998 2024-04-25T22:53:13.995 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.995 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.995 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:13.995 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.017052+0000", 2024-04-25T22:53:13.995 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024056500000000001 2024-04-25T22:53:13.995 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.995 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.995 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:13.995 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020350+0000", 2024-04-25T22:53:13.996 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032978320000000001 2024-04-25T22:53:13.996 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.996 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.996 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:13.996 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020375+0000", 2024-04-25T22:53:13.996 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4624e-05 2024-04-25T22:53:13.996 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:13.996 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:13.996 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:13.996 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.996 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.996 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-25T22:53:13.996 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:13.996 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 80.830675776999996, 2024-04-25T22:53:13.997 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058583000000000003, 2024-04-25T22:53:13.997 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:13.997 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:13.997 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:13.997 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:13.997 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.997 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:13.997 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:13.997 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:13.997 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.997 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.997 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:13.997 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:13.997 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:13.998 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.998 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.998 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:13.998 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:13.998 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.41e-07 2024-04-25T22:53:13.998 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.998 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.998 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:13.998 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027428+0000", 2024-04-25T22:53:13.998 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.075e-05 2024-04-25T22:53:13.999 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.999 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.999 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:13.999 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027435+0000", 2024-04-25T22:53:13.999 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3610000000000003e-06 2024-04-25T22:53:13.999 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:13.999 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:13.999 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:13.999 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027442+0000", 2024-04-25T22:53:13.999 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0400000000000004e-06 2024-04-25T22:53:14.000 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.000 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.000 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:14.000 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028094+0000", 2024-04-25T22:53:14.000 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00065134800000000005 2024-04-25T22:53:14.000 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.000 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.000 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:14.000 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028107+0000", 2024-04-25T22:53:14.000 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3087e-05 2024-04-25T22:53:14.000 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.000 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.000 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:14.001 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033239+0000", 2024-04-25T22:53:14.001 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051319429999999999 2024-04-25T22:53:14.001 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.001 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.001 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:14.001 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033275+0000", 2024-04-25T22:53:14.001 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6430000000000002e-05 2024-04-25T22:53:14.001 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:14.001 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:14.001 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:14.002 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.002 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.002 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-25T22:53:14.002 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:14.002 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 80.830290939999998, 2024-04-25T22:53:14.002 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005413597, 2024-04-25T22:53:14.002 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:14.002 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:14.002 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:14.002 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:14.002 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.003 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:14.003 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:14.003 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:14.003 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.003 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.003 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:14.003 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:14.003 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:14.003 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.003 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.003 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:14.003 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:14.003 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3799999999999997e-07 2024-04-25T22:53:14.004 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.004 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.004 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:14.004 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027816+0000", 2024-04-25T22:53:14.004 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3230999999999999e-05 2024-04-25T22:53:14.004 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.004 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.004 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:14.004 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027823+0000", 2024-04-25T22:53:14.004 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9039999999999992e-06 2024-04-25T22:53:14.004 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.004 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.004 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:14.005 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027841+0000", 2024-04-25T22:53:14.005 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7651000000000001e-05 2024-04-25T22:53:14.005 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.005 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.005 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:14.005 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027904+0000", 2024-04-25T22:53:14.005 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3058000000000005e-05 2024-04-25T22:53:14.006 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.006 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.006 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:14.006 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027926+0000", 2024-04-25T22:53:14.006 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1450999999999998e-05 2024-04-25T22:53:14.006 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.006 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.006 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:14.006 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033177+0000", 2024-04-25T22:53:14.006 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052508909999999997 2024-04-25T22:53:14.006 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.007 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.007 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:14.007 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033215+0000", 2024-04-25T22:53:14.007 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8872999999999999e-05 2024-04-25T22:53:14.007 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:14.007 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:14.007 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:14.007 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.007 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.007 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 171 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:53:14.007 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:14.007 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 80.830233837999998, 2024-04-25T22:53:14.007 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054322240000000003, 2024-04-25T22:53:14.007 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:14.008 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:14.008 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "reached pg", 2024-04-25T22:53:14.008 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:14.008 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.008 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:14.008 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:14.008 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:14.008 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.008 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.008 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:14.008 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:14.008 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:14.008 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.008 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.009 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:14.009 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:14.009 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7500000000000001e-07 2024-04-25T22:53:14.009 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.009 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.009 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:14.009 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027868+0000", 2024-04-25T22:53:14.009 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5750000000000001e-06 2024-04-25T22:53:14.009 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.009 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.009 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:14.009 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027885+0000", 2024-04-25T22:53:14.009 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7272e-05 2024-04-25T22:53:14.010 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.010 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.010 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:14.010 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027900+0000", 2024-04-25T22:53:14.010 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.502e-05 2024-04-25T22:53:14.010 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.010 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.010 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:14.010 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028381+0000", 2024-04-25T22:53:14.010 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00048039399999999998 2024-04-25T22:53:14.010 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.010 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.010 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:14.011 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033291+0000", 2024-04-25T22:53:14.011 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049105879999999996 2024-04-25T22:53:14.011 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:14.011 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:14.011 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:14.011 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:14.011 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:14.011 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:14.013 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:14.012+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:14.014 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:14.113 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:14.113+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:14.121 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:14.121 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:14.121 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-04-25T22:53:14.121 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:14.130 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:14.214 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:14.214+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:14.227 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-25T22:53:14.232 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:14.232 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:14.232 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:53:14.232 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:53:14.232 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:14.241 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:14.315 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:14.314+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:14.346 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:14.346 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-04-25T22:53:14.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-04-25T22:53:14.346 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:53:14.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.346 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:14.347 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:14.347 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 86.379063685999995, 2024-04-25T22:53:14.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0103421, 2024-04-25T22:53:14.347 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:14.347 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:14.347 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:14.347 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:14.347 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:14.347 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:14.347 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 115 2024-04-25T22:53:14.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.347 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:14.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:14.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:14.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:14.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:14.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:14.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:14.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:14.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:14.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9500000000000002e-07 2024-04-25T22:53:14.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:14.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965108+0000", 2024-04-25T22:53:14.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9177999999999994e-05 2024-04-25T22:53:14.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:14.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965127+0000", 2024-04-25T22:53:14.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8868e-05 2024-04-25T22:53:14.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:14.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965133+0000", 2024-04-25T22:53:14.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8929999999999999e-06 2024-04-25T22:53:14.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:14.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.969991+0000", 2024-04-25T22:53:14.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048573849999999997 2024-04-25T22:53:14.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:14.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970072+0000", 2024-04-25T22:53:14.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0728000000000004e-05 2024-04-25T22:53:14.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:14.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970189+0000", 2024-04-25T22:53:14.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000117778 2024-04-25T22:53:14.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:14.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970946+0000", 2024-04-25T22:53:14.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00075704600000000004 2024-04-25T22:53:14.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:14.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975297+0000", 2024-04-25T22:53:14.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004350217 2024-04-25T22:53:14.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:14.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975343+0000", 2024-04-25T22:53:14.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6687999999999998e-05 2024-04-25T22:53:14.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:14.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975380+0000", 2024-04-25T22:53:14.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6724000000000003e-05 2024-04-25T22:53:14.352 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:14.352 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:14.352 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:14.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.353 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:14.353 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:14.353 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 86.378957654999994, 2024-04-25T22:53:14.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010304384, 2024-04-25T22:53:14.353 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:14.353 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:14.353 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:14.353 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:14.353 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:14.353 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:14.353 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 116 2024-04-25T22:53:14.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.353 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:14.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:14.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:14.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:14.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:14.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:14.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:14.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:14.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:14.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5799999999999999e-07 2024-04-25T22:53:14.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:14.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965154+0000", 2024-04-25T22:53:14.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0009e-05 2024-04-25T22:53:14.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:14.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965164+0000", 2024-04-25T22:53:14.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8490000000000001e-06 2024-04-25T22:53:14.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:14.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965169+0000", 2024-04-25T22:53:14.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0730000000000004e-06 2024-04-25T22:53:14.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:14.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970609+0000", 2024-04-25T22:53:14.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054397689999999997 2024-04-25T22:53:14.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:14.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970651+0000", 2024-04-25T22:53:14.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1873999999999999e-05 2024-04-25T22:53:14.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:14.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970723+0000", 2024-04-25T22:53:14.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2039999999999995e-05 2024-04-25T22:53:14.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:14.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971358+0000", 2024-04-25T22:53:14.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063489500000000001 2024-04-25T22:53:14.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:14.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975409+0000", 2024-04-25T22:53:14.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040506880000000002 2024-04-25T22:53:14.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:14.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975432+0000", 2024-04-25T22:53:14.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3315999999999998e-05 2024-04-25T22:53:14.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.360 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:14.360 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975448+0000", 2024-04-25T22:53:14.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6313000000000001e-05 2024-04-25T22:53:14.360 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:14.360 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:14.360 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:14.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.360 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:14.360 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:14.360 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 86.378923072999996, 2024-04-25T22:53:14.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010384338999999999, 2024-04-25T22:53:14.361 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:14.361 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:14.361 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:14.361 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:14.361 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:14.361 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:14.361 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-04-25T22:53:14.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.361 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:14.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.361 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:14.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:14.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:14.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:14.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:14.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:14.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:14.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:14.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3600000000000004e-07 2024-04-25T22:53:14.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:14.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965185+0000", 2024-04-25T22:53:14.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.117e-06 2024-04-25T22:53:14.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:14.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965192+0000", 2024-04-25T22:53:14.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3239999999999997e-06 2024-04-25T22:53:14.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:14.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965198+0000", 2024-04-25T22:53:14.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6370000000000004e-06 2024-04-25T22:53:14.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:14.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970973+0000", 2024-04-25T22:53:14.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057748239999999996 2024-04-25T22:53:14.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:14.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971049+0000", 2024-04-25T22:53:14.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6029e-05 2024-04-25T22:53:14.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:14.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971174+0000", 2024-04-25T22:53:14.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012462399999999999 2024-04-25T22:53:14.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:14.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971553+0000", 2024-04-25T22:53:14.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037896499999999999 2024-04-25T22:53:14.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:14.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975482+0000", 2024-04-25T22:53:14.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039297459999999996 2024-04-25T22:53:14.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:14.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975529+0000", 2024-04-25T22:53:14.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6387000000000002e-05 2024-04-25T22:53:14.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:14.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975563+0000", 2024-04-25T22:53:14.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4150000000000003e-05 2024-04-25T22:53:14.366 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:14.366 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:14.366 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:14.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.366 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:14.366 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:14.366 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 81.331876750000006, 2024-04-25T22:53:14.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012637705000000001, 2024-04-25T22:53:14.367 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:14.367 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:14.367 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:14.367 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:14.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:14.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:14.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:14.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:14.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:14.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:14.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:14.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012227+0000", 2024-04-25T22:53:14.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.863e-06 2024-04-25T22:53:14.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:14.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012236+0000", 2024-04-25T22:53:14.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1109999999999997e-06 2024-04-25T22:53:14.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:14.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012309+0000", 2024-04-25T22:53:14.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3242000000000001e-05 2024-04-25T22:53:14.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:14.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012324+0000", 2024-04-25T22:53:14.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4837e-05 2024-04-25T22:53:14.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:14.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015060+0000", 2024-04-25T22:53:14.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027363349999999999 2024-04-25T22:53:14.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:14.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015169+0000", 2024-04-25T22:53:14.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108372 2024-04-25T22:53:14.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:14.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015498+0000", 2024-04-25T22:53:14.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032949999999999999 2024-04-25T22:53:14.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:14.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021282+0000", 2024-04-25T22:53:14.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057836429999999998 2024-04-25T22:53:14.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:14.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024709+0000", 2024-04-25T22:53:14.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034271979999999998 2024-04-25T22:53:14.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:14.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024802+0000", 2024-04-25T22:53:14.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2960000000000004e-05 2024-04-25T22:53:14.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:14.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024863+0000", 2024-04-25T22:53:14.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0643999999999997e-05 2024-04-25T22:53:14.372 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:14.372 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:14.372 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:14.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.372 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:14.372 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:14.372 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 81.331752979000001, 2024-04-25T22:53:14.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012979447999999999, 2024-04-25T22:53:14.372 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:14.373 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:14.373 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:14.373 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:14.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:14.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:14.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:14.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:14.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:14.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:14.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:14.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:14.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:53:14.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:14.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012354+0000", 2024-04-25T22:53:14.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7740000000000004e-06 2024-04-25T22:53:14.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:14.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012365+0000", 2024-04-25T22:53:14.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.064e-05 2024-04-25T22:53:14.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:14.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012382+0000", 2024-04-25T22:53:14.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6999000000000001e-05 2024-04-25T22:53:14.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:14.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015958+0000", 2024-04-25T22:53:14.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035765699999999998 2024-04-25T22:53:14.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:14.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016037+0000", 2024-04-25T22:53:14.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8242000000000001e-05 2024-04-25T22:53:14.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:14.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016404+0000", 2024-04-25T22:53:14.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036784300000000002 2024-04-25T22:53:14.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:14.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021294+0000", 2024-04-25T22:53:14.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048890629999999999 2024-04-25T22:53:14.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:14.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024959+0000", 2024-04-25T22:53:14.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036651570000000001 2024-04-25T22:53:14.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:14.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025097+0000", 2024-04-25T22:53:14.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013788099999999999 2024-04-25T22:53:14.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:14.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025328+0000", 2024-04-25T22:53:14.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231492 2024-04-25T22:53:14.378 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:14.378 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:14.378 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:14.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.378 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:14.378 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:14.378 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 81.331665209999997, 2024-04-25T22:53:14.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013049827, 2024-04-25T22:53:14.378 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:14.378 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:14.378 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:14.379 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:14.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:14.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:14.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:14.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:14.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:14.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:14.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:14.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012437+0000", 2024-04-25T22:53:14.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-04-25T22:53:14.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:14.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012440+0000", 2024-04-25T22:53:14.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7609999999999999e-06 2024-04-25T22:53:14.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:14.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012449+0000", 2024-04-25T22:53:14.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.285e-06 2024-04-25T22:53:14.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:14.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012457+0000", 2024-04-25T22:53:14.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9510000000000006e-06 2024-04-25T22:53:14.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:14.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017106+0000", 2024-04-25T22:53:14.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046494220000000003 2024-04-25T22:53:14.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:14.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017223+0000", 2024-04-25T22:53:14.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116824 2024-04-25T22:53:14.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:14.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017345+0000", 2024-04-25T22:53:14.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122175 2024-04-25T22:53:14.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:14.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021299+0000", 2024-04-25T22:53:14.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039534879999999998 2024-04-25T22:53:14.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:14.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025398+0000", 2024-04-25T22:53:14.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040988960000000003 2024-04-25T22:53:14.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:14.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025439+0000", 2024-04-25T22:53:14.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0915999999999999e-05 2024-04-25T22:53:14.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:14.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025486+0000", 2024-04-25T22:53:14.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7534999999999998e-05 2024-04-25T22:53:14.383 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:14.383 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:14.384 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:14.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.384 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:14.384 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:14.384 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 81.331635059000007, 2024-04-25T22:53:14.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020988041999999998, 2024-04-25T22:53:14.384 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:14.384 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:14.384 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:14.384 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:14.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:14.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:14.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:14.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:14.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:14.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:14.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:14.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:14.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.99e-07 2024-04-25T22:53:14.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:14.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012470+0000", 2024-04-25T22:53:14.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2789999999999999e-06 2024-04-25T22:53:14.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:14.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012477+0000", 2024-04-25T22:53:14.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:53:14.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:14.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012500+0000", 2024-04-25T22:53:14.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2490999999999999e-05 2024-04-25T22:53:14.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:14.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021911+0000", 2024-04-25T22:53:14.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094114160000000006 2024-04-25T22:53:14.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:14.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022000+0000", 2024-04-25T22:53:14.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8601000000000001e-05 2024-04-25T22:53:14.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:14.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022359+0000", 2024-04-25T22:53:14.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035921999999999999 2024-04-25T22:53:14.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:14.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025541+0000", 2024-04-25T22:53:14.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031820619999999998 2024-04-25T22:53:14.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:14.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033375+0000", 2024-04-25T22:53:14.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078338379999999992 2024-04-25T22:53:14.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:14.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033415+0000", 2024-04-25T22:53:14.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9527000000000003e-05 2024-04-25T22:53:14.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:14.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033455+0000", 2024-04-25T22:53:14.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9932000000000003e-05 2024-04-25T22:53:14.389 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:14.389 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:14.389 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:14.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.390 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:14.390 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:14.390 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 81.331579865999998, 2024-04-25T22:53:14.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021043857999999999, 2024-04-25T22:53:14.390 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:14.390 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:14.390 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:14.390 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:14.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:14.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:14.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:14.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:14.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:14.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:14.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:14.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012523+0000", 2024-04-25T22:53:14.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.361e-06 2024-04-25T22:53:14.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:14.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012530+0000", 2024-04-25T22:53:14.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5440000000000004e-06 2024-04-25T22:53:14.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:14.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012541+0000", 2024-04-25T22:53:14.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1745e-05 2024-04-25T22:53:14.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:14.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012551+0000", 2024-04-25T22:53:14.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5789999999999993e-06 2024-04-25T22:53:14.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:14.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022709+0000", 2024-04-25T22:53:14.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010157685 2024-04-25T22:53:14.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.393 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:14.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022957+0000", 2024-04-25T22:53:14.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024824599999999998 2024-04-25T22:53:14.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.393 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:14.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023443+0000", 2024-04-25T22:53:14.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048578599999999999 2024-04-25T22:53:14.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:14.394 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025547+0000", 2024-04-25T22:53:14.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021044789999999998 2024-04-25T22:53:14.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:14.394 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033509+0000", 2024-04-25T22:53:14.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0079622180000000001 2024-04-25T22:53:14.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:14.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033542+0000", 2024-04-25T22:53:14.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3018000000000001e-05 2024-04-25T22:53:14.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:14.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033566+0000", 2024-04-25T22:53:14.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3197000000000002e-05 2024-04-25T22:53:14.395 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:14.395 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:14.395 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:14.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.395 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:14.395 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:14.396 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 81.331539900999999, 2024-04-25T22:53:14.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021122696, 2024-04-25T22:53:14.396 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:14.396 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:14.396 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:14.396 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:14.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:14.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:14.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:14.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:14.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:14.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:14.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:14.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:14.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:53:14.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:14.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012566+0000", 2024-04-25T22:53:14.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-04-25T22:53:14.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:14.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012619+0000", 2024-04-25T22:53:14.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2607e-05 2024-04-25T22:53:14.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:14.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012628+0000", 2024-04-25T22:53:14.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6500000000000008e-06 2024-04-25T22:53:14.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:14.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024024+0000", 2024-04-25T22:53:14.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011396007999999999 2024-04-25T22:53:14.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:14.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024198+0000", 2024-04-25T22:53:14.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000173215 2024-04-25T22:53:14.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:14.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024447+0000", 2024-04-25T22:53:14.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024898500000000002 2024-04-25T22:53:14.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:14.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026431+0000", 2024-04-25T22:53:14.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001984923 2024-04-25T22:53:14.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:14.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033608+0000", 2024-04-25T22:53:14.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071768459999999997 2024-04-25T22:53:14.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:14.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033646+0000", 2024-04-25T22:53:14.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299000000000003e-05 2024-04-25T22:53:14.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:14.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033684+0000", 2024-04-25T22:53:14.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8773000000000003e-05 2024-04-25T22:53:14.401 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:14.401 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:14.401 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:14.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.401 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:14.401 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:14.401 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 81.331451302000005, 2024-04-25T22:53:14.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021175381, 2024-04-25T22:53:14.401 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:14.402 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:14.402 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:14.402 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:14.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:14.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:14.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:14.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:14.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:14.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:14.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:14.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012651+0000", 2024-04-25T22:53:14.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:53:14.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:14.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012656+0000", 2024-04-25T22:53:14.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8899999999999998e-06 2024-04-25T22:53:14.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:14.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012666+0000", 2024-04-25T22:53:14.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0346999999999999e-05 2024-04-25T22:53:14.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:14.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012675+0000", 2024-04-25T22:53:14.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9930000000000001e-06 2024-04-25T22:53:14.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:14.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025661+0000", 2024-04-25T22:53:14.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01298531 2024-04-25T22:53:14.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:14.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025757+0000", 2024-04-25T22:53:14.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5822000000000005e-05 2024-04-25T22:53:14.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:14.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025907+0000", 2024-04-25T22:53:14.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015051499999999999 2024-04-25T22:53:14.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:14.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026435+0000", 2024-04-25T22:53:14.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052762200000000005 2024-04-25T22:53:14.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:14.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033732+0000", 2024-04-25T22:53:14.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072978419999999997 2024-04-25T22:53:14.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:14.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033787+0000", 2024-04-25T22:53:14.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4703999999999997e-05 2024-04-25T22:53:14.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:14.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033826+0000", 2024-04-25T22:53:14.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8458999999999999e-05 2024-04-25T22:53:14.407 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:14.407 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:14.407 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:14.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.407 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:14.407 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:14.407 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 81.331395888000003, 2024-04-25T22:53:14.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021244174000000001, 2024-04-25T22:53:14.407 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:14.407 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:14.407 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:14.407 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:14.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:14.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:14.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:14.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:14.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:14.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:14.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:14.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:14.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:14.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:14.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012712+0000", 2024-04-25T22:53:14.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.913e-06 2024-04-25T22:53:14.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:14.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012722+0000", 2024-04-25T22:53:14.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2879999999999998e-06 2024-04-25T22:53:14.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:14.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012727+0000", 2024-04-25T22:53:14.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8429999999999998e-06 2024-04-25T22:53:14.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:14.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026099+0000", 2024-04-25T22:53:14.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013371450999999999 2024-04-25T22:53:14.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:14.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026147+0000", 2024-04-25T22:53:14.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7837999999999998e-05 2024-04-25T22:53:14.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:14.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026254+0000", 2024-04-25T22:53:14.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107314 2024-04-25T22:53:14.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:14.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026686+0000", 2024-04-25T22:53:14.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000432428 2024-04-25T22:53:14.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:14.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033873+0000", 2024-04-25T22:53:14.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071864399999999997 2024-04-25T22:53:14.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:14.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033904+0000", 2024-04-25T22:53:14.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1321e-05 2024-04-25T22:53:14.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:14.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033950+0000", 2024-04-25T22:53:14.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5707999999999997e-05 2024-04-25T22:53:14.412 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:14.412 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:14.412 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:14.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.413 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:14.413 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:14.413 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 81.331365503000001, 2024-04-25T22:53:14.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01096505, 2024-04-25T22:53:14.413 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:14.413 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:14.413 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:14.413 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:14.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:14.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:14.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:14.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:14.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:14.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:14.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:14.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012737+0000", 2024-04-25T22:53:14.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:14.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:14.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012739+0000", 2024-04-25T22:53:14.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-04-25T22:53:14.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:14.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012743+0000", 2024-04-25T22:53:14.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3239999999999996e-06 2024-04-25T22:53:14.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:14.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012746+0000", 2024-04-25T22:53:14.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.129e-06 2024-04-25T22:53:14.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:14.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012796+0000", 2024-04-25T22:53:14.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9231999999999999e-05 2024-04-25T22:53:14.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:14.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012915+0000", 2024-04-25T22:53:14.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119021 2024-04-25T22:53:14.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:14.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013069+0000", 2024-04-25T22:53:14.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015463900000000001 2024-04-25T22:53:14.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:14.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019237+0000", 2024-04-25T22:53:14.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061680329999999998 2024-04-25T22:53:14.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:14.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023603+0000", 2024-04-25T22:53:14.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043655860000000003 2024-04-25T22:53:14.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:14.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023659+0000", 2024-04-25T22:53:14.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6484000000000003e-05 2024-04-25T22:53:14.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:14.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023701+0000", 2024-04-25T22:53:14.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1761999999999998e-05 2024-04-25T22:53:14.418 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:14.418 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:14.418 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:14.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.418 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:14.418 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:14.419 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 81.331340554999997, 2024-04-25T22:53:14.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011234429000000001, 2024-04-25T22:53:14.419 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:14.419 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:14.419 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:14.419 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:14.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:14.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:14.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:14.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:14.420 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:14.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:14.420 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.420 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:14.420 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012762+0000", 2024-04-25T22:53:14.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-04-25T22:53:14.420 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.420 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:14.420 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012765+0000", 2024-04-25T22:53:14.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2569999999999999e-06 2024-04-25T22:53:14.420 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:14.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012783+0000", 2024-04-25T22:53:14.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8431999999999999e-05 2024-04-25T22:53:14.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:14.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012799+0000", 2024-04-25T22:53:14.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5438999999999999e-05 2024-04-25T22:53:14.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:14.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013826+0000", 2024-04-25T22:53:14.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010275060000000001 2024-04-25T22:53:14.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:14.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013913+0000", 2024-04-25T22:53:14.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.708e-05 2024-04-25T22:53:14.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:14.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014098+0000", 2024-04-25T22:53:14.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018519399999999999 2024-04-25T22:53:14.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:14.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019684+0000", 2024-04-25T22:53:14.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055860079999999999 2024-04-25T22:53:14.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:14.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023876+0000", 2024-04-25T22:53:14.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041918800000000003 2024-04-25T22:53:14.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:14.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023957+0000", 2024-04-25T22:53:14.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1165e-05 2024-04-25T22:53:14.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.424 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:14.424 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023995+0000", 2024-04-25T22:53:14.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:53:14.424 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:14.424 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:14.424 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:14.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.424 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:14.424 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:14.424 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 81.331242775999996, 2024-04-25T22:53:14.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011131200000000001, 2024-04-25T22:53:14.424 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:14.425 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:14.425 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:14.425 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:14.425 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.425 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:14.425 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:14.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:14.425 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.425 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.425 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:14.425 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:14.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:14.425 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.426 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:14.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012860+0000", 2024-04-25T22:53:14.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3900000000000004e-07 2024-04-25T22:53:14.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.426 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:14.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012865+0000", 2024-04-25T22:53:14.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5609999999999998e-06 2024-04-25T22:53:14.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.426 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:14.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012895+0000", 2024-04-25T22:53:14.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9847000000000001e-05 2024-04-25T22:53:14.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:14.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012905+0000", 2024-04-25T22:53:14.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.03e-05 2024-04-25T22:53:14.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:14.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015020+0000", 2024-04-25T22:53:14.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021142940000000001 2024-04-25T22:53:14.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:14.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015182+0000", 2024-04-25T22:53:14.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016248099999999999 2024-04-25T22:53:14.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:14.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015357+0000", 2024-04-25T22:53:14.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017471000000000001 2024-04-25T22:53:14.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:14.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021021+0000", 2024-04-25T22:53:14.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056638340000000004 2024-04-25T22:53:14.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.429 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:14.429 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023712+0000", 2024-04-25T22:53:14.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026910380000000002 2024-04-25T22:53:14.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.429 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.429 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:14.429 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023763+0000", 2024-04-25T22:53:14.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1477999999999997e-05 2024-04-25T22:53:14.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.429 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.429 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:14.429 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023990+0000", 2024-04-25T22:53:14.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000226818 2024-04-25T22:53:14.429 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:14.430 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:14.430 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:14.430 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.430 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:14.430 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:14.430 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 81.33111968, 2024-04-25T22:53:14.430 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011705299000000001, 2024-04-25T22:53:14.430 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:14.430 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:14.430 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:14.430 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:14.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.430 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:14.430 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:14.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:14.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.431 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:14.431 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:14.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:14.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.431 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:14.431 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012983+0000", 2024-04-25T22:53:14.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:53:14.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.431 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:14.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012986+0000", 2024-04-25T22:53:14.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5700000000000001e-06 2024-04-25T22:53:14.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:14.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012993+0000", 2024-04-25T22:53:14.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8730000000000001e-06 2024-04-25T22:53:14.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:14.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013000+0000", 2024-04-25T22:53:14.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1890000000000001e-06 2024-04-25T22:53:14.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:14.433 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:53:14.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002147866 2024-04-25T22:53:14.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.433 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:14.433 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015351+0000", 2024-04-25T22:53:14.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020300799999999999 2024-04-25T22:53:14.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.433 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:14.433 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016260+0000", 2024-04-25T22:53:14.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00090926799999999997 2024-04-25T22:53:14.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.433 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:14.434 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022669+0000", 2024-04-25T22:53:14.434 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064082849999999997 2024-04-25T22:53:14.434 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.434 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.434 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:14.434 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024584+0000", 2024-04-25T22:53:14.434 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019151699999999999 2024-04-25T22:53:14.434 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.434 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.434 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:14.434 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024643+0000", 2024-04-25T22:53:14.434 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8888999999999998e-05 2024-04-25T22:53:14.434 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.435 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:14.435 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024687+0000", 2024-04-25T22:53:14.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4444999999999999e-05 2024-04-25T22:53:14.435 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:14.435 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:14.435 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:14.435 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.435 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:14.435 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:14.435 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 81.331092088999995, 2024-04-25T22:53:14.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011249699, 2024-04-25T22:53:14.435 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:14.436 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:14.436 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:14.436 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:14.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:14.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:14.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:14.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:14.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:14.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:14.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:14.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013010+0000", 2024-04-25T22:53:14.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2099999999999996e-07 2024-04-25T22:53:14.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:14.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013013+0000", 2024-04-25T22:53:14.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1310000000000002e-06 2024-04-25T22:53:14.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:14.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013020+0000", 2024-04-25T22:53:14.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3330000000000002e-06 2024-04-25T22:53:14.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.438 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:14.438 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013025+0000", 2024-04-25T22:53:14.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6760000000000004e-06 2024-04-25T22:53:14.438 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.438 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:14.438 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013163+0000", 2024-04-25T22:53:14.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013824599999999999 2024-04-25T22:53:14.438 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.438 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:14.438 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013504+0000", 2024-04-25T22:53:14.439 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034080299999999998 2024-04-25T22:53:14.439 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.439 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.441 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:14.441 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013613+0000", 2024-04-25T22:53:14.441 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108705 2024-04-25T22:53:14.442 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.442 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.442 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:14.442 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015831+0000", 2024-04-25T22:53:14.442 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002217672 2024-04-25T22:53:14.442 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.442 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.442 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:14.442 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024137+0000", 2024-04-25T22:53:14.442 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0083060489999999994 2024-04-25T22:53:14.442 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.442 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.442 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:14.442 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024218+0000", 2024-04-25T22:53:14.443 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1351000000000001e-05 2024-04-25T22:53:14.443 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.443 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.443 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:14.443 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024259+0000", 2024-04-25T22:53:14.443 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1112000000000002e-05 2024-04-25T22:53:14.443 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:14.443 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:14.443 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:14.443 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.443 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.443 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:14.443 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:14.444 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 81.331004363000005, 2024-04-25T22:53:14.444 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020379749999999999, 2024-04-25T22:53:14.444 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:14.444 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:14.444 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:14.444 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:14.444 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.444 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:14.444 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:14.444 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:14.444 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.444 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.444 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:14.444 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:14.445 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:14.445 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.445 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.445 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:14.445 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013098+0000", 2024-04-25T22:53:14.445 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:53:14.445 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.445 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.445 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:14.445 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013105+0000", 2024-04-25T22:53:14.445 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5969999999999997e-06 2024-04-25T22:53:14.445 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.445 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.445 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:14.446 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013190+0000", 2024-04-25T22:53:14.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5618999999999995e-05 2024-04-25T22:53:14.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.446 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.446 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:14.446 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013200+0000", 2024-04-25T22:53:14.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5859999999999994e-06 2024-04-25T22:53:14.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.446 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.446 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:14.446 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020265+0000", 2024-04-25T22:53:14.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070653349999999998 2024-04-25T22:53:14.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.446 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.447 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:14.447 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020454+0000", 2024-04-25T22:53:14.447 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189316 2024-04-25T22:53:14.447 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.447 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.447 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:14.447 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020586+0000", 2024-04-25T22:53:14.447 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013195700000000001 2024-04-25T22:53:14.447 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.447 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.447 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:14.447 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023822+0000", 2024-04-25T22:53:14.447 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032358529999999999 2024-04-25T22:53:14.447 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.448 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.448 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:14.448 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033409+0000", 2024-04-25T22:53:14.448 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095870520000000004 2024-04-25T22:53:14.448 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.448 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.448 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:14.448 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033447+0000", 2024-04-25T22:53:14.448 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7261999999999997e-05 2024-04-25T22:53:14.448 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.448 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.448 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:14.448 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033477+0000", 2024-04-25T22:53:14.448 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0389e-05 2024-04-25T22:53:14.449 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:14.449 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:14.449 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:14.449 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.449 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.449 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:14.449 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:14.449 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 81.330887856999993, 2024-04-25T22:53:14.449 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010857383999999999, 2024-04-25T22:53:14.449 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:14.449 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:14.449 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:14.449 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:14.450 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.450 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:14.450 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:14.450 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:14.450 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.450 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.450 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:14.450 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:14.450 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:14.450 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.450 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.450 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:14.450 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:14.451 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:14.451 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.451 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.451 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:14.451 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013218+0000", 2024-04-25T22:53:14.451 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8199999999999998e-06 2024-04-25T22:53:14.451 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.451 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.451 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:14.451 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013226+0000", 2024-04-25T22:53:14.451 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7649999999999993e-06 2024-04-25T22:53:14.451 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.451 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.451 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:14.452 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013259+0000", 2024-04-25T22:53:14.452 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2727e-05 2024-04-25T22:53:14.452 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.452 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.452 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:14.452 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014809+0000", 2024-04-25T22:53:14.452 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001550144 2024-04-25T22:53:14.452 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.452 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.452 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:14.452 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014958+0000", 2024-04-25T22:53:14.452 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014890300000000001 2024-04-25T22:53:14.452 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.453 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.453 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:14.453 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015087+0000", 2024-04-25T22:53:14.453 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012939200000000001 2024-04-25T22:53:14.453 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.453 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.453 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:14.453 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020212+0000", 2024-04-25T22:53:14.453 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051248939999999996 2024-04-25T22:53:14.453 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.453 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.453 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:14.453 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023699+0000", 2024-04-25T22:53:14.453 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034873289999999999 2024-04-25T22:53:14.454 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.454 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.454 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:14.454 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024014+0000", 2024-04-25T22:53:14.454 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031473999999999999 2024-04-25T22:53:14.454 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.454 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.454 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:14.454 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024071+0000", 2024-04-25T22:53:14.454 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7040000000000003e-05 2024-04-25T22:53:14.454 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:14.454 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:14.454 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:14.454 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.455 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.455 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:14.455 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:14.455 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 81.330833151999997, 2024-04-25T22:53:14.455 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012329677000000001, 2024-04-25T22:53:14.455 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:14.455 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:14.455 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:14.455 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:14.455 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.455 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:14.455 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:14.455 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:14.456 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.456 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.456 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:14.456 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:14.456 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:14.456 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.456 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.456 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:14.456 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013269+0000", 2024-04-25T22:53:14.456 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5000000000000002e-07 2024-04-25T22:53:14.456 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.456 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.456 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:14.456 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:14.456 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6909999999999999e-06 2024-04-25T22:53:14.457 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.457 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.457 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:14.457 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013284+0000", 2024-04-25T22:53:14.457 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0963e-05 2024-04-25T22:53:14.457 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.457 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.457 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:14.457 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013361+0000", 2024-04-25T22:53:14.457 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7379999999999994e-05 2024-04-25T22:53:14.457 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.457 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.457 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:14.458 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013448+0000", 2024-04-25T22:53:14.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6990000000000006e-05 2024-04-25T22:53:14.458 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.458 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:14.458 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013632+0000", 2024-04-25T22:53:14.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018396800000000001 2024-04-25T22:53:14.458 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.458 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:14.458 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013800+0000", 2024-04-25T22:53:14.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167467 2024-04-25T22:53:14.459 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.459 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.459 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:14.459 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.018570+0000", 2024-04-25T22:53:14.459 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047701460000000003 2024-04-25T22:53:14.459 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.459 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.459 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:14.459 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025507+0000", 2024-04-25T22:53:14.459 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069372039999999998 2024-04-25T22:53:14.459 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.459 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.459 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:14.459 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025562+0000", 2024-04-25T22:53:14.459 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4858999999999998e-05 2024-04-25T22:53:14.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.460 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.460 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:14.460 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025598+0000", 2024-04-25T22:53:14.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6259e-05 2024-04-25T22:53:14.460 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:14.460 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:14.460 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:14.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.460 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.460 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:14.460 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:14.460 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 81.330701278999996, 2024-04-25T22:53:14.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020176666999999999, 2024-04-25T22:53:14.460 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:14.460 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:14.461 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:53:14.461 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:14.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.461 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:14.461 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:14.461 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:14.461 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.461 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:14.461 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:14.461 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:14.461 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.461 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:14.461 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:14.461 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-04-25T22:53:14.462 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.462 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.462 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:14.462 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013405+0000", 2024-04-25T22:53:14.462 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0559999999999998e-06 2024-04-25T22:53:14.462 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.462 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.462 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:14.462 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013422+0000", 2024-04-25T22:53:14.462 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6770999999999999e-05 2024-04-25T22:53:14.462 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.462 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.462 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:14.462 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013431+0000", 2024-04-25T22:53:14.463 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5019999999999998e-06 2024-04-25T22:53:14.463 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.463 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.463 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:14.463 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021720+0000", 2024-04-25T22:53:14.463 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082884340000000008 2024-04-25T22:53:14.463 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.463 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.463 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:14.463 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022122+0000", 2024-04-25T22:53:14.463 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000401634 2024-04-25T22:53:14.463 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:14.463 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:14.464 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:14.464 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033577+0000", 2024-04-25T22:53:14.464 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011455435999999999 2024-04-25T22:53:14.464 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:14.464 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:14.464 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:14.464 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:14.464 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:14.464 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:14.466 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:14.466 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:14.465+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:14.567 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:14.566+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:14.577 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:14.577 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:14.577 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-25T22:53:14.577 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:14.587 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:14.668 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:14.667+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:14.689 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:14.689 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:14.690 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-25T22:53:14.690 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-25T22:53:14.690 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:14.699 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:14.770 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:14.769+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:14.802 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:14.803 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:53:14.803 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:53:14.803 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:53:14.803 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.803 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:53:14.803 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:14.803 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 86.833845801999999, 2024-04-25T22:53:14.803 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:53:14.803 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:14.803 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:14.803 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:14.803 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:14.803 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.804 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:14.804 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:14.804 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:14.804 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.804 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.804 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:14.804 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:14.804 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:14.804 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.804 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.804 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:14.804 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:53:14.804 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:53:14.804 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.804 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.805 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:14.805 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:53:14.805 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:53:14.805 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.805 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.805 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:14.805 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:53:14.805 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:53:14.805 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.805 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.805 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:14.805 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:53:14.805 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:53:14.805 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.806 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.806 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:14.806 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:53:14.806 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:53:14.806 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.806 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.806 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:14.806 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:53:14.806 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:53:14.806 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.806 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.806 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:14.806 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:53:14.807 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:53:14.807 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.807 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.807 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:14.807 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:53:14.807 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:53:14.807 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:14.807 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:14.807 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:14.807 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.807 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.807 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:110 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'72, mlcod=10'68)", 2024-04-25T22:53:14.807 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:14.807 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 86.833211801999994, 2024-04-25T22:53:14.808 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065316630000000001, 2024-04-25T22:53:14.808 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:14.808 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:14.808 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:14.808 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:14.808 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.808 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:14.808 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:14.808 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:14.808 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.808 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.808 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:14.808 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:14.808 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:14.809 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.809 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.809 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:14.809 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:14.809 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.58e-07 2024-04-25T22:53:14.809 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.809 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.809 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:14.809 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967811+0000", 2024-04-25T22:53:14.810 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.118e-06 2024-04-25T22:53:14.810 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.810 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.810 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:14.810 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967817+0000", 2024-04-25T22:53:14.810 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3709999999999996e-06 2024-04-25T22:53:14.810 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.810 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.810 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:14.810 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967820+0000", 2024-04-25T22:53:14.810 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2210000000000002e-06 2024-04-25T22:53:14.810 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.810 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.810 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:14.811 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967876+0000", 2024-04-25T22:53:14.811 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5507000000000002e-05 2024-04-25T22:53:14.811 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.811 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.811 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:14.811 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967893+0000", 2024-04-25T22:53:14.811 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7812000000000002e-05 2024-04-25T22:53:14.811 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.811 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.812 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:14.812 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974317+0000", 2024-04-25T22:53:14.812 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064237160000000003 2024-04-25T22:53:14.812 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.812 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.812 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:14.812 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:53:14.812 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.156e-05 2024-04-25T22:53:14.812 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:14.812 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:14.812 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:14.812 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.812 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.812 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'68)", 2024-04-25T22:53:14.813 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:14.813 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 86.832794289000006, 2024-04-25T22:53:14.813 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061292279999999996, 2024-04-25T22:53:14.813 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:14.813 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:14.813 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:14.813 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:14.813 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.813 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:14.813 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:14.813 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:14.813 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.813 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.813 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:14.814 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:14.814 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:14.814 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.814 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.814 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:14.814 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:14.814 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6300000000000001e-07 2024-04-25T22:53:14.814 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.814 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.814 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:14.814 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968228+0000", 2024-04-25T22:53:14.814 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6139999999999999e-06 2024-04-25T22:53:14.814 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.814 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.815 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:14.815 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968235+0000", 2024-04-25T22:53:14.815 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7020000000000001e-06 2024-04-25T22:53:14.815 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.815 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.815 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:14.815 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968238+0000", 2024-04-25T22:53:14.815 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0010000000000002e-06 2024-04-25T22:53:14.815 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.815 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.815 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:14.815 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968297+0000", 2024-04-25T22:53:14.815 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8424999999999997e-05 2024-04-25T22:53:14.815 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.816 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.816 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:14.816 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968316+0000", 2024-04-25T22:53:14.816 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8814999999999999e-05 2024-04-25T22:53:14.816 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.816 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.816 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:14.816 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:53:14.816 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060239439999999998 2024-04-25T22:53:14.816 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.816 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.816 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:14.816 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974354+0000", 2024-04-25T22:53:14.816 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4364e-05 2024-04-25T22:53:14.816 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:14.817 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:14.817 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:14.817 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.817 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.817 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'68)", 2024-04-25T22:53:14.817 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:14.817 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 86.832357286999994, 2024-04-25T22:53:14.817 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005948414, 2024-04-25T22:53:14.817 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:14.817 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:14.817 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:14.817 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:14.817 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.818 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:14.818 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:14.818 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:14.818 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.818 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.818 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:14.818 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:14.818 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:14.818 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.818 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.818 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:14.818 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:14.818 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6199999999999998e-07 2024-04-25T22:53:14.819 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.819 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.819 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:14.819 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968723+0000", 2024-04-25T22:53:14.819 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1148999999999993e-05 2024-04-25T22:53:14.819 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.819 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.819 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:14.819 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968730+0000", 2024-04-25T22:53:14.819 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1749999999999999e-06 2024-04-25T22:53:14.819 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.819 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.819 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:14.819 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968734+0000", 2024-04-25T22:53:14.820 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5200000000000002e-06 2024-04-25T22:53:14.820 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.820 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.820 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:14.820 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968771+0000", 2024-04-25T22:53:14.820 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6851999999999999e-05 2024-04-25T22:53:14.820 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.820 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.820 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:14.820 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968788+0000", 2024-04-25T22:53:14.820 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7027000000000001e-05 2024-04-25T22:53:14.820 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.820 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.820 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:14.821 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974589+0000", 2024-04-25T22:53:14.821 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058013320000000002 2024-04-25T22:53:14.821 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.821 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.821 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:14.821 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974610+0000", 2024-04-25T22:53:14.821 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0897e-05 2024-04-25T22:53:14.821 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:14.821 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:14.822 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:14.822 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.822 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.822 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'68)", 2024-04-25T22:53:14.822 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:14.822 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 86.831787277000004, 2024-04-25T22:53:14.822 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053935750000000003, 2024-04-25T22:53:14.822 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:14.822 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:14.822 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:14.822 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:14.822 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.822 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:14.823 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:14.823 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:14.823 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.823 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.823 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:14.823 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:14.823 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:14.823 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.823 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.823 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:14.823 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:14.823 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.03e-07 2024-04-25T22:53:14.823 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.823 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.824 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:14.824 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969235+0000", 2024-04-25T22:53:14.824 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2399999999999999e-06 2024-04-25T22:53:14.824 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.824 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.824 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:14.824 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969242+0000", 2024-04-25T22:53:14.824 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1269999999999997e-06 2024-04-25T22:53:14.824 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.824 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.824 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:14.824 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969246+0000", 2024-04-25T22:53:14.824 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3840000000000001e-06 2024-04-25T22:53:14.824 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.825 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.825 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:14.825 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969278+0000", 2024-04-25T22:53:14.825 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1868e-05 2024-04-25T22:53:14.825 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.825 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.825 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:14.825 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969295+0000", 2024-04-25T22:53:14.825 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7530999999999999e-05 2024-04-25T22:53:14.825 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.825 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.825 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:14.825 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974611+0000", 2024-04-25T22:53:14.825 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053160789999999996 2024-04-25T22:53:14.826 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.826 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.826 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:14.826 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974625+0000", 2024-04-25T22:53:14.826 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3943e-05 2024-04-25T22:53:14.826 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:14.826 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:14.826 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:14.826 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.826 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.826 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-25T22:53:14.826 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:14.826 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 86.638191368999998, 2024-04-25T22:53:14.826 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054952610000000004, 2024-04-25T22:53:14.827 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:14.827 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:14.827 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:14.827 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:14.827 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.827 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:14.827 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:14.827 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:14.827 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.827 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.827 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:14.827 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:14.827 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:14.827 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.828 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.828 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:14.828 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:14.828 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.68e-07 2024-04-25T22:53:14.828 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.828 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.828 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:14.828 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162898+0000", 2024-04-25T22:53:14.828 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9470999999999999e-05 2024-04-25T22:53:14.828 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.828 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.828 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:14.828 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162906+0000", 2024-04-25T22:53:14.828 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1580000000000005e-06 2024-04-25T22:53:14.829 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.829 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.829 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:14.829 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162911+0000", 2024-04-25T22:53:14.829 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4779999999999999e-06 2024-04-25T22:53:14.829 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.829 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.829 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:14.829 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162952+0000", 2024-04-25T22:53:14.829 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0629e-05 2024-04-25T22:53:14.829 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.829 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.829 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:14.829 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162968+0000", 2024-04-25T22:53:14.830 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6239000000000002e-05 2024-04-25T22:53:14.830 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.830 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.830 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:14.830 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168281+0000", 2024-04-25T22:53:14.830 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053132869999999999 2024-04-25T22:53:14.830 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.830 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.830 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:14.830 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168323+0000", 2024-04-25T22:53:14.830 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1430999999999997e-05 2024-04-25T22:53:14.830 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:14.830 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:14.830 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:14.831 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.831 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.831 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-04-25T22:53:14.831 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:14.831 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 86.207714007000007, 2024-04-25T22:53:14.831 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050872510000000001, 2024-04-25T22:53:14.831 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:14.831 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:14.831 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:14.831 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:14.831 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.831 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:14.831 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:14.831 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:14.832 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.832 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.832 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:14.832 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:14.832 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:14.832 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.832 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.832 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:14.833 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:14.833 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.72e-07 2024-04-25T22:53:14.833 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.833 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.833 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:14.833 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593381+0000", 2024-04-25T22:53:14.833 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5797000000000006e-05 2024-04-25T22:53:14.833 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.833 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.833 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:14.833 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593389+0000", 2024-04-25T22:53:14.833 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8480000000000001e-06 2024-04-25T22:53:14.833 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.834 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.834 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:14.834 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593393+0000", 2024-04-25T22:53:14.834 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4819999999999996e-06 2024-04-25T22:53:14.834 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.834 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.834 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:14.834 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593435+0000", 2024-04-25T22:53:14.834 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1600000000000002e-05 2024-04-25T22:53:14.834 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.834 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.834 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:14.834 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593454+0000", 2024-04-25T22:53:14.834 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8868e-05 2024-04-25T22:53:14.835 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.835 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.835 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:14.835 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598350+0000", 2024-04-25T22:53:14.835 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004895763 2024-04-25T22:53:14.835 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.835 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.835 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:14.835 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598392+0000", 2024-04-25T22:53:14.835 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2521000000000002e-05 2024-04-25T22:53:14.835 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:14.835 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:14.835 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:14.836 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.836 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.836 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:14.836 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:14.836 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 81.789350103000004, 2024-04-25T22:53:14.836 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:53:14.836 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:14.836 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:14.836 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:14.836 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:14.836 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.836 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:14.836 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:14.836 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:14.837 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.837 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.837 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:14.837 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:14.837 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:14.837 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.837 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.837 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:14.837 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:53:14.837 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:53:14.837 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.837 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.837 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:14.837 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:53:14.838 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:53:14.838 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.838 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.838 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:14.838 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:53:14.838 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:53:14.838 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.838 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.838 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:14.838 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:53:14.838 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:53:14.838 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.838 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.839 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:14.839 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:53:14.839 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:53:14.839 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.839 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.839 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:14.839 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:53:14.839 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:53:14.839 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.839 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.839 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:14.839 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:53:14.839 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:53:14.839 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.840 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.840 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:14.840 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:53:14.840 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:53:14.840 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.840 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.840 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:14.840 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:53:14.840 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:53:14.840 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.840 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.840 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:14.840 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:53:14.840 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:53:14.841 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.841 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.841 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:14.841 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:53:14.841 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:53:14.841 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:14.841 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:14.841 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:14.841 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.841 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.841 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:14.841 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:14.841 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 81.788675726999998, 2024-04-25T22:53:14.841 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:53:14.842 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:14.842 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:14.842 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:14.842 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:14.842 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.842 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:14.842 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:14.842 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:14.842 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.842 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.842 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:14.842 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:14.842 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:14.842 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.843 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.843 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:14.843 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:53:14.843 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:53:14.843 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.843 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.843 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:14.843 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:53:14.843 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:53:14.843 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.843 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.843 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:14.843 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:53:14.843 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:53:14.844 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.844 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.844 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:14.844 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:53:14.844 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:53:14.844 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.844 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.844 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:14.844 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:53:14.844 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:53:14.844 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.844 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.844 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:14.844 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:53:14.845 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:53:14.845 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.845 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.845 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:14.845 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:53:14.845 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:53:14.845 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.845 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.845 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:14.845 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:53:14.846 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:53:14.846 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.846 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.846 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:14.846 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:53:14.846 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:53:14.846 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.846 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.846 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:14.846 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:53:14.846 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:53:14.846 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.846 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.847 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:14.847 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:53:14.847 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:53:14.847 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:14.847 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:14.847 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:14.847 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.847 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.847 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:14.847 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:14.847 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 81.788166515, 2024-04-25T22:53:14.847 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:53:14.847 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:14.848 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:14.848 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:14.848 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:14.848 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.848 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:14.848 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:14.848 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:14.848 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.848 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.848 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:14.848 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:14.848 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:14.848 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.848 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.849 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:14.849 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:53:14.849 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:53:14.849 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.849 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.849 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:14.849 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:53:14.849 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:53:14.849 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.849 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.849 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:14.849 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:53:14.849 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:53:14.849 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.850 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.850 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:14.850 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:53:14.850 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:53:14.850 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.850 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.850 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:14.850 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:53:14.850 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:53:14.850 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.850 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.850 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:14.850 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:53:14.850 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:53:14.851 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.851 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.851 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:14.851 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:53:14.851 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:53:14.851 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.851 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.851 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:14.851 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:53:14.853 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:53:14.853 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.853 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.853 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:14.853 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:53:14.854 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:53:14.854 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.854 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.854 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:14.854 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:53:14.854 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:53:14.854 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.854 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.854 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:14.854 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:53:14.854 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:53:14.854 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:14.854 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:14.855 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:14.855 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.855 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.855 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:14.855 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:14.855 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 81.787753316999996, 2024-04-25T22:53:14.855 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:53:14.855 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:14.855 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:14.855 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:14.855 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:14.855 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.855 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:14.855 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:14.856 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:14.856 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.856 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.856 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:14.856 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:14.856 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:14.856 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.856 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.856 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:14.856 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:14.856 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:53:14.856 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.856 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.856 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:14.857 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:14.857 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:53:14.857 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.857 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.857 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:14.857 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:53:14.857 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:53:14.857 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.857 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.857 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:14.857 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:53:14.857 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:53:14.858 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.858 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.858 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:14.858 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:53:14.858 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:53:14.858 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.858 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.858 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:14.858 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:53:14.858 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:53:14.858 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.858 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.858 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:14.859 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:53:14.859 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:53:14.859 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.859 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.859 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:14.859 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:53:14.859 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:53:14.859 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.859 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.859 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:14.859 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:53:14.859 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:53:14.859 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.859 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.860 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:14.860 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:53:14.860 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:53:14.860 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.860 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.860 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:14.860 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:53:14.860 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:53:14.860 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:14.860 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:14.860 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:14.860 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.860 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.860 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:14.861 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:14.861 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 81.787702647000003, 2024-04-25T22:53:14.861 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:53:14.861 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:14.861 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:14.861 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:14.861 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:14.861 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.861 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:14.861 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:14.861 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:14.861 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.861 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.861 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:14.862 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:14.862 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:14.862 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.862 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.862 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:14.862 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:53:14.862 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:53:14.862 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.862 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.862 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:14.862 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:53:14.862 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:53:14.862 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.863 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.863 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:14.863 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:53:14.863 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:53:14.863 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.863 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.863 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:14.863 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:53:14.863 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:53:14.863 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.863 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.863 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:14.863 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:53:14.863 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:53:14.864 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.864 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.864 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:14.864 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:53:14.864 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:53:14.864 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.864 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.864 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:14.864 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:53:14.864 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:53:14.864 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.864 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.864 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:14.864 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:53:14.865 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:53:14.865 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.865 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.865 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:14.865 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:53:14.865 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:53:14.865 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.865 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.865 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:14.865 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:53:14.865 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:53:14.865 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.865 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.865 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:14.866 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:53:14.866 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:53:14.866 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.866 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.866 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:14.866 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:53:14.866 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:53:14.866 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.866 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.866 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:14.866 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:53:14.866 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:53:14.866 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:14.866 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:14.867 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:14.867 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.867 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.867 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:14.867 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:14.867 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 81.787665778000004, 2024-04-25T22:53:14.867 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:53:14.867 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:14.867 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:14.867 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:14.867 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:14.867 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.867 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:14.867 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:14.868 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:14.868 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.868 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.868 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:14.868 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:14.868 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:14.868 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.868 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.868 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:14.868 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:53:14.868 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:53:14.868 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.868 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.869 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:14.869 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:53:14.869 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:53:14.869 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.869 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.869 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:14.869 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:53:14.869 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:53:14.869 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.869 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.869 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:14.869 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:53:14.869 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:53:14.869 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.870 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.870 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:14.870 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:53:14.870 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:53:14.870 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.870 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.870 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:53:14.870 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:53:14.870 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:53:14.870 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.870 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.870 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:14.870 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:53:14.871 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:53:14.871 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.871 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.871 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:14.871 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:53:14.871 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:53:14.871 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.871 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.871 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:14.871 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:53:14.871 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:53:14.871 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.871 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.871 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:14.872 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:53:14.872 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:53:14.872 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.872 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.872 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:14.872 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:53:14.872 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:53:14.872 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.872 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.872 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:14.872 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:53:14.872 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:53:14.872 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.873 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.873 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:14.873 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:53:14.873 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:53:14.873 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:14.873 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:14.873 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:14.873 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.873 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.873 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:14.873 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:14.873 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 81.787640812000006, 2024-04-25T22:53:14.873 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:53:14.874 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:14.874 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:14.874 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:14.874 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:14.874 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.874 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:14.874 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:14.874 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:14.874 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.874 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.874 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:14.874 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:14.874 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:14.874 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.875 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.875 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:14.875 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:53:14.875 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:53:14.875 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.875 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.875 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:14.875 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:53:14.875 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:53:14.875 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.875 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.875 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:14.875 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:14.875 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:53:14.876 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.876 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.876 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:14.876 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:53:14.876 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:53:14.876 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.876 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.876 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:14.876 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:53:14.876 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:53:14.876 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.876 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.876 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:14.877 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:53:14.877 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:53:14.877 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.877 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.877 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:14.877 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:53:14.877 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:53:14.877 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.877 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.877 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:14.877 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:53:14.877 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:53:14.877 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.877 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.878 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:14.878 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:53:14.878 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:53:14.878 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.878 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.878 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:14.878 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:53:14.878 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:53:14.878 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.878 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.878 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:14.878 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:53:14.878 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:53:14.879 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:14.879 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:14.879 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:14.879 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.879 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.879 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:14.879 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:14.879 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 81.787604447999996, 2024-04-25T22:53:14.879 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:53:14.879 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:14.879 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:14.879 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:14.879 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:14.879 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.880 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:14.880 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:14.880 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:14.880 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.880 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.880 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:14.880 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:14.880 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:14.880 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.880 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.880 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:14.880 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:53:14.880 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:53:14.880 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.881 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.881 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:14.881 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:53:14.881 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:53:14.881 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.881 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.881 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:14.881 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:53:14.881 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:53:14.881 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.881 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.881 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:14.881 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:53:14.882 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:53:14.882 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.882 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.882 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:14.882 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:53:14.882 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:53:14.882 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.882 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.882 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:14.882 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:53:14.882 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:53:14.882 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.882 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.882 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:14.883 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:53:14.883 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:53:14.883 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.883 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.883 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:14.883 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:53:14.883 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:53:14.883 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.883 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.883 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:14.883 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:53:14.883 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:53:14.883 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:14.884 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:14.884 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:14.884 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.884 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.884 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:14.884 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:14.884 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 81.787573366999993, 2024-04-25T22:53:14.884 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:53:14.884 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:14.884 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:14.884 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:14.884 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:14.884 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.884 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:14.885 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:14.885 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:14.885 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.885 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.885 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:14.885 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:14.885 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:14.885 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.885 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.885 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:14.885 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:14.885 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:14.885 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.885 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.886 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:14.886 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:53:14.886 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:53:14.886 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.886 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.886 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:14.886 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:53:14.886 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:53:14.886 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.886 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.886 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:14.886 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:53:14.886 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:53:14.887 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.887 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.887 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:14.887 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:53:14.887 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:53:14.887 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.887 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.887 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:14.887 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:53:14.887 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:53:14.887 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.887 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.887 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:14.887 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:53:14.888 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:53:14.888 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:14.888 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:14.888 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:14.888 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.888 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.888 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:53:14.888 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:14.888 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 81.787132397999997, 2024-04-25T22:53:14.888 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064881979999999997, 2024-04-25T22:53:14.888 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:14.888 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:14.888 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:14.888 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:14.889 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.889 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:14.889 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:14.889 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:14.889 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.889 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.889 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:14.889 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:14.889 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:14.889 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.889 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.889 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:14.889 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:14.889 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2699999999999999e-07 2024-04-25T22:53:14.890 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.890 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.890 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:14.890 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013898+0000", 2024-04-25T22:53:14.890 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0796e-05 2024-04-25T22:53:14.890 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.890 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.890 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:14.890 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013907+0000", 2024-04-25T22:53:14.890 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5140000000000007e-06 2024-04-25T22:53:14.890 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.890 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.890 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:14.891 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013952+0000", 2024-04-25T22:53:14.891 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4134000000000001e-05 2024-04-25T22:53:14.891 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.891 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.891 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:14.891 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016812+0000", 2024-04-25T22:53:14.891 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028601059999999998 2024-04-25T22:53:14.891 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.891 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.891 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:14.891 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.017052+0000", 2024-04-25T22:53:14.891 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024056500000000001 2024-04-25T22:53:14.891 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.891 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.892 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:14.892 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020350+0000", 2024-04-25T22:53:14.892 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032978320000000001 2024-04-25T22:53:14.892 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.892 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.892 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:14.892 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020375+0000", 2024-04-25T22:53:14.892 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4624e-05 2024-04-25T22:53:14.892 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:14.892 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:14.892 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:14.892 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.892 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.892 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-25T22:53:14.893 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:14.893 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 81.773601952000007, 2024-04-25T22:53:14.893 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058583000000000003, 2024-04-25T22:53:14.893 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:14.893 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:14.893 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:14.893 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:14.893 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.893 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:14.893 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:14.893 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:14.893 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.893 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.893 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:14.894 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:14.894 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:14.894 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.894 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.894 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:14.894 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:14.894 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.41e-07 2024-04-25T22:53:14.894 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.894 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.894 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:14.894 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027428+0000", 2024-04-25T22:53:14.894 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.075e-05 2024-04-25T22:53:14.894 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.894 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.895 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:14.895 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027435+0000", 2024-04-25T22:53:14.895 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3610000000000003e-06 2024-04-25T22:53:14.895 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.895 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.895 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:14.895 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027442+0000", 2024-04-25T22:53:14.895 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0400000000000004e-06 2024-04-25T22:53:14.895 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.895 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.895 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:14.895 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028094+0000", 2024-04-25T22:53:14.895 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00065134800000000005 2024-04-25T22:53:14.895 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.895 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.896 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:14.896 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028107+0000", 2024-04-25T22:53:14.896 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3087e-05 2024-04-25T22:53:14.896 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.896 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.896 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:14.896 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033239+0000", 2024-04-25T22:53:14.896 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051319429999999999 2024-04-25T22:53:14.896 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.896 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.896 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:14.896 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033275+0000", 2024-04-25T22:53:14.896 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6430000000000002e-05 2024-04-25T22:53:14.896 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:14.897 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:14.897 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:14.897 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.897 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.897 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-25T22:53:14.897 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:14.897 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 81.773217114999994, 2024-04-25T22:53:14.897 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005413597, 2024-04-25T22:53:14.897 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:14.897 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:14.897 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:14.897 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:14.897 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.897 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:14.898 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:14.898 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:14.898 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.898 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.898 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:14.898 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:14.898 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:14.898 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.898 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.898 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:14.898 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:14.898 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3799999999999997e-07 2024-04-25T22:53:14.898 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.898 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.899 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:14.899 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027816+0000", 2024-04-25T22:53:14.899 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3230999999999999e-05 2024-04-25T22:53:14.899 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.899 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.899 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:14.899 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027823+0000", 2024-04-25T22:53:14.899 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9039999999999992e-06 2024-04-25T22:53:14.899 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.899 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.899 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:14.899 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027841+0000", 2024-04-25T22:53:14.899 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7651000000000001e-05 2024-04-25T22:53:14.899 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.900 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.900 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:14.900 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027904+0000", 2024-04-25T22:53:14.900 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3058000000000005e-05 2024-04-25T22:53:14.900 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.900 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.900 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:14.900 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027926+0000", 2024-04-25T22:53:14.900 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1450999999999998e-05 2024-04-25T22:53:14.900 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.900 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.900 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:14.900 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033177+0000", 2024-04-25T22:53:14.900 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052508909999999997 2024-04-25T22:53:14.901 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.901 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.901 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:14.901 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033215+0000", 2024-04-25T22:53:14.901 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8872999999999999e-05 2024-04-25T22:53:14.901 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:14.901 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:14.901 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:14.901 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.901 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.901 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 171 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:53:14.901 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:14.901 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 81.773160012999995, 2024-04-25T22:53:14.901 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054322240000000003, 2024-04-25T22:53:14.901 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:14.902 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:14.902 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "reached pg", 2024-04-25T22:53:14.902 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:14.902 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.902 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:14.902 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:14.902 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:14.902 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.902 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.902 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:14.902 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:14.902 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:14.902 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.903 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.903 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:14.903 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:14.903 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7500000000000001e-07 2024-04-25T22:53:14.903 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.903 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.903 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:14.903 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027868+0000", 2024-04-25T22:53:14.903 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5750000000000001e-06 2024-04-25T22:53:14.903 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.903 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.903 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:14.903 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027885+0000", 2024-04-25T22:53:14.903 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7272e-05 2024-04-25T22:53:14.903 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.904 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.904 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:14.904 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027900+0000", 2024-04-25T22:53:14.904 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.502e-05 2024-04-25T22:53:14.904 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.904 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.904 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:14.904 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028381+0000", 2024-04-25T22:53:14.904 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00048039399999999998 2024-04-25T22:53:14.904 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:14.904 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:14.904 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:14.904 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033291+0000", 2024-04-25T22:53:14.904 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049105879999999996 2024-04-25T22:53:14.905 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:14.905 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:14.905 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:14.905 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:14.905 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:14.905 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:14.906 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:14.907 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:14.906+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:15.007 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:15.007+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:15.009 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:15.009 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:15.010 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-04-25T22:53:15.010 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:15.018 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:15.108 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:15.108+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:15.120 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:15.120 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:15.120 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:53:15.120 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:53:15.120 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:15.129 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:15.209 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:15.209+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:15.222 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is set 2024-04-25T22:53:15.272 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:15.273 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-04-25T22:53:15.273 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-04-25T22:53:15.273 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:53:15.273 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.273 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:15.273 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:15.273 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 87.305648837000007, 2024-04-25T22:53:15.273 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0103421, 2024-04-25T22:53:15.273 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:15.273 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:15.273 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:15.273 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:15.273 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:15.273 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:15.274 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 115 2024-04-25T22:53:15.274 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.274 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:15.274 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.274 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:15.274 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:15.274 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:15.274 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.274 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.274 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:15.274 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:15.274 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:15.274 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.275 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.275 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:15.275 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:15.275 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9500000000000002e-07 2024-04-25T22:53:15.275 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.275 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.275 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:15.275 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965108+0000", 2024-04-25T22:53:15.275 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9177999999999994e-05 2024-04-25T22:53:15.275 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.275 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.275 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:15.275 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965127+0000", 2024-04-25T22:53:15.275 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8868e-05 2024-04-25T22:53:15.276 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.276 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.276 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:15.276 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965133+0000", 2024-04-25T22:53:15.276 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8929999999999999e-06 2024-04-25T22:53:15.276 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.276 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.276 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:15.276 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.969991+0000", 2024-04-25T22:53:15.276 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048573849999999997 2024-04-25T22:53:15.276 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.276 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.276 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:15.276 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970072+0000", 2024-04-25T22:53:15.277 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0728000000000004e-05 2024-04-25T22:53:15.277 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.277 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.277 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:15.277 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970189+0000", 2024-04-25T22:53:15.277 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000117778 2024-04-25T22:53:15.277 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.277 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.277 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:15.277 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970946+0000", 2024-04-25T22:53:15.277 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00075704600000000004 2024-04-25T22:53:15.277 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.277 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.277 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:15.278 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975297+0000", 2024-04-25T22:53:15.278 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004350217 2024-04-25T22:53:15.278 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.278 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.278 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:15.278 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975343+0000", 2024-04-25T22:53:15.278 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6687999999999998e-05 2024-04-25T22:53:15.278 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.278 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.278 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:15.278 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975380+0000", 2024-04-25T22:53:15.278 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6724000000000003e-05 2024-04-25T22:53:15.278 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:15.278 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:15.279 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:15.279 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.279 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.279 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:15.279 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:15.279 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 87.305542806000005, 2024-04-25T22:53:15.279 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010304384, 2024-04-25T22:53:15.279 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:15.279 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:15.279 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:15.279 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:15.279 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:15.279 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:15.279 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 116 2024-04-25T22:53:15.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.280 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:15.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:15.280 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:15.280 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:15.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:15.280 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:15.280 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:15.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:15.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:15.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5799999999999999e-07 2024-04-25T22:53:15.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.281 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:15.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965154+0000", 2024-04-25T22:53:15.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0009e-05 2024-04-25T22:53:15.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.281 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:15.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965164+0000", 2024-04-25T22:53:15.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8490000000000001e-06 2024-04-25T22:53:15.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:15.282 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965169+0000", 2024-04-25T22:53:15.282 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0730000000000004e-06 2024-04-25T22:53:15.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:15.282 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970609+0000", 2024-04-25T22:53:15.282 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054397689999999997 2024-04-25T22:53:15.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:15.282 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970651+0000", 2024-04-25T22:53:15.282 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1873999999999999e-05 2024-04-25T22:53:15.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.283 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:15.283 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970723+0000", 2024-04-25T22:53:15.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2039999999999995e-05 2024-04-25T22:53:15.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.283 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:15.283 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971358+0000", 2024-04-25T22:53:15.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063489500000000001 2024-04-25T22:53:15.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.283 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:15.283 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975409+0000", 2024-04-25T22:53:15.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040506880000000002 2024-04-25T22:53:15.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.284 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.284 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:15.284 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975432+0000", 2024-04-25T22:53:15.284 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3315999999999998e-05 2024-04-25T22:53:15.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.284 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.284 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:15.284 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975448+0000", 2024-04-25T22:53:15.284 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6313000000000001e-05 2024-04-25T22:53:15.284 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:15.284 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:15.284 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:15.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.285 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.285 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:15.285 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:15.285 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 87.305508223999993, 2024-04-25T22:53:15.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010384338999999999, 2024-04-25T22:53:15.285 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:15.285 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:15.285 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:15.285 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:15.285 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:15.285 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:15.285 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-04-25T22:53:15.285 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.286 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:15.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.286 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:15.286 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:15.286 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:15.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.286 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:15.286 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:15.286 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:15.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.286 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:15.286 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:15.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3600000000000004e-07 2024-04-25T22:53:15.287 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.287 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.287 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:15.287 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965185+0000", 2024-04-25T22:53:15.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.117e-06 2024-04-25T22:53:15.287 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.287 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.287 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:15.287 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965192+0000", 2024-04-25T22:53:15.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3239999999999997e-06 2024-04-25T22:53:15.287 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.287 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.287 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:15.288 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965198+0000", 2024-04-25T22:53:15.288 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6370000000000004e-06 2024-04-25T22:53:15.288 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.288 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.288 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:15.288 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970973+0000", 2024-04-25T22:53:15.288 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057748239999999996 2024-04-25T22:53:15.288 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.288 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.288 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:15.288 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971049+0000", 2024-04-25T22:53:15.288 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6029e-05 2024-04-25T22:53:15.288 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.288 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.289 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:15.289 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971174+0000", 2024-04-25T22:53:15.289 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012462399999999999 2024-04-25T22:53:15.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.289 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:15.289 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971553+0000", 2024-04-25T22:53:15.289 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037896499999999999 2024-04-25T22:53:15.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.289 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:15.289 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975482+0000", 2024-04-25T22:53:15.289 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039297459999999996 2024-04-25T22:53:15.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:15.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975529+0000", 2024-04-25T22:53:15.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6387000000000002e-05 2024-04-25T22:53:15.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:15.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975563+0000", 2024-04-25T22:53:15.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4150000000000003e-05 2024-04-25T22:53:15.290 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:15.290 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:15.290 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:15.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.291 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.291 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:15.291 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:15.291 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 82.258461901000004, 2024-04-25T22:53:15.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012637705000000001, 2024-04-25T22:53:15.291 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:15.291 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:15.291 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:15.291 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:15.291 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.291 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:15.291 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:15.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:15.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.292 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.292 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:15.292 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:15.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:15.292 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.292 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.292 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:15.292 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012227+0000", 2024-04-25T22:53:15.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.863e-06 2024-04-25T22:53:15.292 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.292 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.292 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:15.292 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012236+0000", 2024-04-25T22:53:15.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1109999999999997e-06 2024-04-25T22:53:15.292 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:15.293 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012309+0000", 2024-04-25T22:53:15.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3242000000000001e-05 2024-04-25T22:53:15.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:15.293 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012324+0000", 2024-04-25T22:53:15.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4837e-05 2024-04-25T22:53:15.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:15.293 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015060+0000", 2024-04-25T22:53:15.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027363349999999999 2024-04-25T22:53:15.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:15.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015169+0000", 2024-04-25T22:53:15.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108372 2024-04-25T22:53:15.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:15.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015498+0000", 2024-04-25T22:53:15.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032949999999999999 2024-04-25T22:53:15.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:15.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021282+0000", 2024-04-25T22:53:15.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057836429999999998 2024-04-25T22:53:15.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:15.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024709+0000", 2024-04-25T22:53:15.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034271979999999998 2024-04-25T22:53:15.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:15.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024802+0000", 2024-04-25T22:53:15.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2960000000000004e-05 2024-04-25T22:53:15.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.296 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:15.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024863+0000", 2024-04-25T22:53:15.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0643999999999997e-05 2024-04-25T22:53:15.296 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:15.296 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:15.296 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:15.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.296 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:15.296 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:15.296 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 82.258338129999999, 2024-04-25T22:53:15.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012979447999999999, 2024-04-25T22:53:15.297 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:15.297 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:15.297 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:15.297 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:15.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.297 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:15.297 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:15.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:15.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.297 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:15.297 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:15.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:15.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:15.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:15.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:53:15.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:15.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012354+0000", 2024-04-25T22:53:15.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7740000000000004e-06 2024-04-25T22:53:15.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:15.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012365+0000", 2024-04-25T22:53:15.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.064e-05 2024-04-25T22:53:15.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:15.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012382+0000", 2024-04-25T22:53:15.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6999000000000001e-05 2024-04-25T22:53:15.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:15.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015958+0000", 2024-04-25T22:53:15.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035765699999999998 2024-04-25T22:53:15.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:15.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016037+0000", 2024-04-25T22:53:15.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8242000000000001e-05 2024-04-25T22:53:15.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:15.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016404+0000", 2024-04-25T22:53:15.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036784300000000002 2024-04-25T22:53:15.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:15.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021294+0000", 2024-04-25T22:53:15.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048890629999999999 2024-04-25T22:53:15.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:15.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024959+0000", 2024-04-25T22:53:15.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036651570000000001 2024-04-25T22:53:15.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:15.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025097+0000", 2024-04-25T22:53:15.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013788099999999999 2024-04-25T22:53:15.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:15.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025328+0000", 2024-04-25T22:53:15.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231492 2024-04-25T22:53:15.302 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:15.302 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:15.302 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:15.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.302 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:15.302 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:15.302 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 82.258250360999995, 2024-04-25T22:53:15.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013049827, 2024-04-25T22:53:15.302 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:15.302 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:15.303 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:15.303 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:15.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.303 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:15.303 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:15.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:15.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.303 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:15.303 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:15.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:15.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.303 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:15.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012437+0000", 2024-04-25T22:53:15.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-04-25T22:53:15.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:15.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012440+0000", 2024-04-25T22:53:15.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7609999999999999e-06 2024-04-25T22:53:15.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:15.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012449+0000", 2024-04-25T22:53:15.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.285e-06 2024-04-25T22:53:15.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:15.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012457+0000", 2024-04-25T22:53:15.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9510000000000006e-06 2024-04-25T22:53:15.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:15.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017106+0000", 2024-04-25T22:53:15.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046494220000000003 2024-04-25T22:53:15.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:15.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017223+0000", 2024-04-25T22:53:15.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116824 2024-04-25T22:53:15.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:15.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017345+0000", 2024-04-25T22:53:15.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122175 2024-04-25T22:53:15.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:15.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021299+0000", 2024-04-25T22:53:15.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039534879999999998 2024-04-25T22:53:15.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:15.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025398+0000", 2024-04-25T22:53:15.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040988960000000003 2024-04-25T22:53:15.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:15.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025439+0000", 2024-04-25T22:53:15.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0915999999999999e-05 2024-04-25T22:53:15.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:15.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025486+0000", 2024-04-25T22:53:15.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7534999999999998e-05 2024-04-25T22:53:15.307 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:15.307 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:15.307 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:15.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.308 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:15.308 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:15.308 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 82.258220210000005, 2024-04-25T22:53:15.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020988041999999998, 2024-04-25T22:53:15.308 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:15.308 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:15.308 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:15.308 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:15.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:15.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:15.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:15.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:15.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:15.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:15.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:15.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:15.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.99e-07 2024-04-25T22:53:15.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:15.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012470+0000", 2024-04-25T22:53:15.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2789999999999999e-06 2024-04-25T22:53:15.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:15.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012477+0000", 2024-04-25T22:53:15.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:53:15.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:15.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012500+0000", 2024-04-25T22:53:15.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2490999999999999e-05 2024-04-25T22:53:15.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:15.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021911+0000", 2024-04-25T22:53:15.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094114160000000006 2024-04-25T22:53:15.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:15.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022000+0000", 2024-04-25T22:53:15.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8601000000000001e-05 2024-04-25T22:53:15.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:15.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022359+0000", 2024-04-25T22:53:15.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035921999999999999 2024-04-25T22:53:15.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:15.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025541+0000", 2024-04-25T22:53:15.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031820619999999998 2024-04-25T22:53:15.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:15.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033375+0000", 2024-04-25T22:53:15.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078338379999999992 2024-04-25T22:53:15.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:15.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033415+0000", 2024-04-25T22:53:15.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9527000000000003e-05 2024-04-25T22:53:15.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:15.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033455+0000", 2024-04-25T22:53:15.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9932000000000003e-05 2024-04-25T22:53:15.313 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:15.313 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:15.313 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:15.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.313 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:15.313 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:15.313 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 82.258165016999996, 2024-04-25T22:53:15.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021043857999999999, 2024-04-25T22:53:15.313 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:15.313 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:15.314 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:15.314 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:15.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:15.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:15.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:15.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:15.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:15.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:15.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:15.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012523+0000", 2024-04-25T22:53:15.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.361e-06 2024-04-25T22:53:15.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:15.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012530+0000", 2024-04-25T22:53:15.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5440000000000004e-06 2024-04-25T22:53:15.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:15.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012541+0000", 2024-04-25T22:53:15.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1745e-05 2024-04-25T22:53:15.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:15.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012551+0000", 2024-04-25T22:53:15.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5789999999999993e-06 2024-04-25T22:53:15.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:15.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022709+0000", 2024-04-25T22:53:15.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010157685 2024-04-25T22:53:15.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:15.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022957+0000", 2024-04-25T22:53:15.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024824599999999998 2024-04-25T22:53:15.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:15.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023443+0000", 2024-04-25T22:53:15.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048578599999999999 2024-04-25T22:53:15.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:15.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025547+0000", 2024-04-25T22:53:15.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021044789999999998 2024-04-25T22:53:15.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:15.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033509+0000", 2024-04-25T22:53:15.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0079622180000000001 2024-04-25T22:53:15.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:15.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033542+0000", 2024-04-25T22:53:15.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3018000000000001e-05 2024-04-25T22:53:15.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:15.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033566+0000", 2024-04-25T22:53:15.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3197000000000002e-05 2024-04-25T22:53:15.318 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:15.318 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:15.318 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:15.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.319 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:15.319 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:15.319 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 82.258125051999997, 2024-04-25T22:53:15.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021122696, 2024-04-25T22:53:15.319 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:15.319 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:15.319 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:15.319 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:15.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:15.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:15.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:15.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:15.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:15.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:15.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:15.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:15.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:53:15.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:15.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012566+0000", 2024-04-25T22:53:15.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-04-25T22:53:15.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:15.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012619+0000", 2024-04-25T22:53:15.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2607e-05 2024-04-25T22:53:15.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:15.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012628+0000", 2024-04-25T22:53:15.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6500000000000008e-06 2024-04-25T22:53:15.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:15.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024024+0000", 2024-04-25T22:53:15.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011396007999999999 2024-04-25T22:53:15.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:15.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024198+0000", 2024-04-25T22:53:15.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000173215 2024-04-25T22:53:15.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:15.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024447+0000", 2024-04-25T22:53:15.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024898500000000002 2024-04-25T22:53:15.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:15.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026431+0000", 2024-04-25T22:53:15.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001984923 2024-04-25T22:53:15.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:15.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033608+0000", 2024-04-25T22:53:15.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071768459999999997 2024-04-25T22:53:15.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:15.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033646+0000", 2024-04-25T22:53:15.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299000000000003e-05 2024-04-25T22:53:15.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:15.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033684+0000", 2024-04-25T22:53:15.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8773000000000003e-05 2024-04-25T22:53:15.324 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:15.324 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:15.324 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:15.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.324 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:15.324 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:15.324 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 82.258036453000003, 2024-04-25T22:53:15.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021175381, 2024-04-25T22:53:15.325 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:15.325 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:15.325 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:15.325 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:15.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:15.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:15.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:15.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:15.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:15.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:15.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:15.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012651+0000", 2024-04-25T22:53:15.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:53:15.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:15.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012656+0000", 2024-04-25T22:53:15.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8899999999999998e-06 2024-04-25T22:53:15.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:15.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012666+0000", 2024-04-25T22:53:15.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0346999999999999e-05 2024-04-25T22:53:15.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:15.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012675+0000", 2024-04-25T22:53:15.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9930000000000001e-06 2024-04-25T22:53:15.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:15.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025661+0000", 2024-04-25T22:53:15.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01298531 2024-04-25T22:53:15.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:15.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025757+0000", 2024-04-25T22:53:15.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5822000000000005e-05 2024-04-25T22:53:15.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:15.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025907+0000", 2024-04-25T22:53:15.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015051499999999999 2024-04-25T22:53:15.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:15.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026435+0000", 2024-04-25T22:53:15.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052762200000000005 2024-04-25T22:53:15.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:15.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033732+0000", 2024-04-25T22:53:15.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072978419999999997 2024-04-25T22:53:15.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:15.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033787+0000", 2024-04-25T22:53:15.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4703999999999997e-05 2024-04-25T22:53:15.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:15.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033826+0000", 2024-04-25T22:53:15.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8458999999999999e-05 2024-04-25T22:53:15.330 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:15.330 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:15.330 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:15.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.330 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:15.330 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:15.330 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 82.257981039000001, 2024-04-25T22:53:15.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021244174000000001, 2024-04-25T22:53:15.330 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:15.330 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:15.330 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:15.331 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:15.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:15.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:15.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:15.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:15.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:15.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:15.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:15.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:15.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:15.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:15.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012712+0000", 2024-04-25T22:53:15.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.913e-06 2024-04-25T22:53:15.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:15.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012722+0000", 2024-04-25T22:53:15.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2879999999999998e-06 2024-04-25T22:53:15.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:15.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012727+0000", 2024-04-25T22:53:15.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8429999999999998e-06 2024-04-25T22:53:15.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:15.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026099+0000", 2024-04-25T22:53:15.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013371450999999999 2024-04-25T22:53:15.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:15.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026147+0000", 2024-04-25T22:53:15.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7837999999999998e-05 2024-04-25T22:53:15.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:15.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026254+0000", 2024-04-25T22:53:15.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107314 2024-04-25T22:53:15.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:15.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026686+0000", 2024-04-25T22:53:15.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000432428 2024-04-25T22:53:15.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:15.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033873+0000", 2024-04-25T22:53:15.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071864399999999997 2024-04-25T22:53:15.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:15.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033904+0000", 2024-04-25T22:53:15.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1321e-05 2024-04-25T22:53:15.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:15.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033950+0000", 2024-04-25T22:53:15.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5707999999999997e-05 2024-04-25T22:53:15.335 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:15.335 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:15.335 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:15.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.336 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:15.336 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:15.336 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 82.257950653999998, 2024-04-25T22:53:15.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01096505, 2024-04-25T22:53:15.336 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:15.336 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:15.336 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:15.336 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:15.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:15.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:15.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:15.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:15.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:15.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:15.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:15.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012737+0000", 2024-04-25T22:53:15.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:15.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:15.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012739+0000", 2024-04-25T22:53:15.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-04-25T22:53:15.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:15.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012743+0000", 2024-04-25T22:53:15.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3239999999999996e-06 2024-04-25T22:53:15.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:15.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012746+0000", 2024-04-25T22:53:15.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.129e-06 2024-04-25T22:53:15.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:15.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012796+0000", 2024-04-25T22:53:15.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9231999999999999e-05 2024-04-25T22:53:15.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:15.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012915+0000", 2024-04-25T22:53:15.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119021 2024-04-25T22:53:15.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:15.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013069+0000", 2024-04-25T22:53:15.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015463900000000001 2024-04-25T22:53:15.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:15.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019237+0000", 2024-04-25T22:53:15.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061680329999999998 2024-04-25T22:53:15.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:15.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023603+0000", 2024-04-25T22:53:15.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043655860000000003 2024-04-25T22:53:15.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:15.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023659+0000", 2024-04-25T22:53:15.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6484000000000003e-05 2024-04-25T22:53:15.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:15.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023701+0000", 2024-04-25T22:53:15.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1761999999999998e-05 2024-04-25T22:53:15.341 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:15.341 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:15.341 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:15.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.341 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:15.341 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:15.341 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 82.257925705999995, 2024-04-25T22:53:15.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011234429000000001, 2024-04-25T22:53:15.341 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:15.341 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:15.341 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:15.342 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:15.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:15.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:15.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:15.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:15.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:15.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:15.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:15.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012762+0000", 2024-04-25T22:53:15.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-04-25T22:53:15.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:15.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012765+0000", 2024-04-25T22:53:15.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2569999999999999e-06 2024-04-25T22:53:15.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:15.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012783+0000", 2024-04-25T22:53:15.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8431999999999999e-05 2024-04-25T22:53:15.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:15.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012799+0000", 2024-04-25T22:53:15.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5438999999999999e-05 2024-04-25T22:53:15.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:15.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013826+0000", 2024-04-25T22:53:15.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010275060000000001 2024-04-25T22:53:15.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:15.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013913+0000", 2024-04-25T22:53:15.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.708e-05 2024-04-25T22:53:15.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:15.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014098+0000", 2024-04-25T22:53:15.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018519399999999999 2024-04-25T22:53:15.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:15.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019684+0000", 2024-04-25T22:53:15.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055860079999999999 2024-04-25T22:53:15.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:15.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023876+0000", 2024-04-25T22:53:15.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041918800000000003 2024-04-25T22:53:15.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:15.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023957+0000", 2024-04-25T22:53:15.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1165e-05 2024-04-25T22:53:15.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:15.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023995+0000", 2024-04-25T22:53:15.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:53:15.346 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:15.346 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:15.346 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:15.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.347 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:15.347 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:15.347 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 82.257827926999994, 2024-04-25T22:53:15.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011131200000000001, 2024-04-25T22:53:15.347 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:15.347 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:15.347 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:15.347 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:15.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:15.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:15.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:15.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:15.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:15.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:15.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:15.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012860+0000", 2024-04-25T22:53:15.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3900000000000004e-07 2024-04-25T22:53:15.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:15.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012865+0000", 2024-04-25T22:53:15.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5609999999999998e-06 2024-04-25T22:53:15.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:15.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012895+0000", 2024-04-25T22:53:15.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9847000000000001e-05 2024-04-25T22:53:15.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:15.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012905+0000", 2024-04-25T22:53:15.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.03e-05 2024-04-25T22:53:15.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:15.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015020+0000", 2024-04-25T22:53:15.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021142940000000001 2024-04-25T22:53:15.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:15.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015182+0000", 2024-04-25T22:53:15.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016248099999999999 2024-04-25T22:53:15.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:15.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015357+0000", 2024-04-25T22:53:15.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017471000000000001 2024-04-25T22:53:15.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:15.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021021+0000", 2024-04-25T22:53:15.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056638340000000004 2024-04-25T22:53:15.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:15.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023712+0000", 2024-04-25T22:53:15.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026910380000000002 2024-04-25T22:53:15.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:15.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023763+0000", 2024-04-25T22:53:15.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1477999999999997e-05 2024-04-25T22:53:15.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:15.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023990+0000", 2024-04-25T22:53:15.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000226818 2024-04-25T22:53:15.352 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:15.352 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:15.352 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:15.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.352 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:15.352 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:15.352 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 82.257704830999998, 2024-04-25T22:53:15.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011705299000000001, 2024-04-25T22:53:15.352 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:15.353 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:15.353 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:15.353 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:15.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:15.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:15.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:15.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:15.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:15.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:15.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:15.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012983+0000", 2024-04-25T22:53:15.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:53:15.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:15.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012986+0000", 2024-04-25T22:53:15.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5700000000000001e-06 2024-04-25T22:53:15.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:15.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012993+0000", 2024-04-25T22:53:15.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8730000000000001e-06 2024-04-25T22:53:15.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:15.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013000+0000", 2024-04-25T22:53:15.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1890000000000001e-06 2024-04-25T22:53:15.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:15.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:53:15.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002147866 2024-04-25T22:53:15.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:15.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015351+0000", 2024-04-25T22:53:15.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020300799999999999 2024-04-25T22:53:15.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:15.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016260+0000", 2024-04-25T22:53:15.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00090926799999999997 2024-04-25T22:53:15.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:15.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022669+0000", 2024-04-25T22:53:15.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064082849999999997 2024-04-25T22:53:15.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:15.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024584+0000", 2024-04-25T22:53:15.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019151699999999999 2024-04-25T22:53:15.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:15.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024643+0000", 2024-04-25T22:53:15.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8888999999999998e-05 2024-04-25T22:53:15.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:15.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024687+0000", 2024-04-25T22:53:15.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4444999999999999e-05 2024-04-25T22:53:15.357 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:15.357 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:15.358 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:15.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.358 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:15.358 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:15.358 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 82.257677240000007, 2024-04-25T22:53:15.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011249699, 2024-04-25T22:53:15.358 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:15.358 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:15.358 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:15.358 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:15.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:15.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:15.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:15.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:15.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:15.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:15.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:15.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013010+0000", 2024-04-25T22:53:15.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2099999999999996e-07 2024-04-25T22:53:15.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.360 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:15.360 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013013+0000", 2024-04-25T22:53:15.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1310000000000002e-06 2024-04-25T22:53:15.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.360 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:15.360 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013020+0000", 2024-04-25T22:53:15.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3330000000000002e-06 2024-04-25T22:53:15.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.360 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:15.360 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013025+0000", 2024-04-25T22:53:15.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6760000000000004e-06 2024-04-25T22:53:15.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.361 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:15.361 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013163+0000", 2024-04-25T22:53:15.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013824599999999999 2024-04-25T22:53:15.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.361 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:15.361 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013504+0000", 2024-04-25T22:53:15.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034080299999999998 2024-04-25T22:53:15.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.361 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:15.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013613+0000", 2024-04-25T22:53:15.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108705 2024-04-25T22:53:15.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:15.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015831+0000", 2024-04-25T22:53:15.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002217672 2024-04-25T22:53:15.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:15.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024137+0000", 2024-04-25T22:53:15.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0083060489999999994 2024-04-25T22:53:15.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:15.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024218+0000", 2024-04-25T22:53:15.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1351000000000001e-05 2024-04-25T22:53:15.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:15.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024259+0000", 2024-04-25T22:53:15.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1112000000000002e-05 2024-04-25T22:53:15.363 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:15.363 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:15.363 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:15.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.364 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:15.364 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:15.364 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 82.257589514000003, 2024-04-25T22:53:15.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020379749999999999, 2024-04-25T22:53:15.364 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:15.364 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:15.364 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:15.364 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:15.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:15.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:15.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:15.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:15.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:15.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:15.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:15.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013098+0000", 2024-04-25T22:53:15.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:53:15.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:15.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013105+0000", 2024-04-25T22:53:15.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5969999999999997e-06 2024-04-25T22:53:15.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:15.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013190+0000", 2024-04-25T22:53:15.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5618999999999995e-05 2024-04-25T22:53:15.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:15.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013200+0000", 2024-04-25T22:53:15.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5859999999999994e-06 2024-04-25T22:53:15.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:15.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020265+0000", 2024-04-25T22:53:15.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070653349999999998 2024-04-25T22:53:15.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:15.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020454+0000", 2024-04-25T22:53:15.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189316 2024-04-25T22:53:15.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:15.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020586+0000", 2024-04-25T22:53:15.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013195700000000001 2024-04-25T22:53:15.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:15.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023822+0000", 2024-04-25T22:53:15.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032358529999999999 2024-04-25T22:53:15.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:15.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033409+0000", 2024-04-25T22:53:15.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095870520000000004 2024-04-25T22:53:15.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:15.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033447+0000", 2024-04-25T22:53:15.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7261999999999997e-05 2024-04-25T22:53:15.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:15.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033477+0000", 2024-04-25T22:53:15.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0389e-05 2024-04-25T22:53:15.369 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:15.369 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:15.369 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:15.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.369 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:15.369 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:15.369 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 82.257473008000005, 2024-04-25T22:53:15.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010857383999999999, 2024-04-25T22:53:15.370 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:15.370 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:15.370 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:15.370 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:15.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:15.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:15.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:15.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:15.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:15.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:15.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:15.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:15.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:15.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:15.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013218+0000", 2024-04-25T22:53:15.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8199999999999998e-06 2024-04-25T22:53:15.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:15.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013226+0000", 2024-04-25T22:53:15.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7649999999999993e-06 2024-04-25T22:53:15.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:15.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013259+0000", 2024-04-25T22:53:15.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2727e-05 2024-04-25T22:53:15.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:15.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014809+0000", 2024-04-25T22:53:15.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001550144 2024-04-25T22:53:15.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:15.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014958+0000", 2024-04-25T22:53:15.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014890300000000001 2024-04-25T22:53:15.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:15.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015087+0000", 2024-04-25T22:53:15.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012939200000000001 2024-04-25T22:53:15.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:15.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020212+0000", 2024-04-25T22:53:15.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051248939999999996 2024-04-25T22:53:15.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:15.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023699+0000", 2024-04-25T22:53:15.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034873289999999999 2024-04-25T22:53:15.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:15.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024014+0000", 2024-04-25T22:53:15.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031473999999999999 2024-04-25T22:53:15.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:15.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024071+0000", 2024-04-25T22:53:15.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7040000000000003e-05 2024-04-25T22:53:15.375 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:15.375 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:15.375 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:15.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.375 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:15.375 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:15.375 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 82.257418302999994, 2024-04-25T22:53:15.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012329677000000001, 2024-04-25T22:53:15.375 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:15.375 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:15.375 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:15.376 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:15.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:15.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:15.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:15.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:15.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:15.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:15.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:15.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013269+0000", 2024-04-25T22:53:15.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5000000000000002e-07 2024-04-25T22:53:15.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:15.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:15.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6909999999999999e-06 2024-04-25T22:53:15.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:15.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013284+0000", 2024-04-25T22:53:15.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0963e-05 2024-04-25T22:53:15.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:15.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013361+0000", 2024-04-25T22:53:15.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7379999999999994e-05 2024-04-25T22:53:15.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:15.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013448+0000", 2024-04-25T22:53:15.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6990000000000006e-05 2024-04-25T22:53:15.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:15.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013632+0000", 2024-04-25T22:53:15.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018396800000000001 2024-04-25T22:53:15.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:15.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013800+0000", 2024-04-25T22:53:15.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167467 2024-04-25T22:53:15.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:15.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.018570+0000", 2024-04-25T22:53:15.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047701460000000003 2024-04-25T22:53:15.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:15.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025507+0000", 2024-04-25T22:53:15.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069372039999999998 2024-04-25T22:53:15.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:15.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025562+0000", 2024-04-25T22:53:15.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4858999999999998e-05 2024-04-25T22:53:15.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:15.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025598+0000", 2024-04-25T22:53:15.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6259e-05 2024-04-25T22:53:15.380 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:15.380 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:15.381 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:15.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.381 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:15.381 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:15.381 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 82.257286429999994, 2024-04-25T22:53:15.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020176666999999999, 2024-04-25T22:53:15.381 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:15.381 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:15.381 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:53:15.381 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:15.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:15.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:15.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:15.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:15.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:15.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:15.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:15.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:15.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-04-25T22:53:15.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:15.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013405+0000", 2024-04-25T22:53:15.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0559999999999998e-06 2024-04-25T22:53:15.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:15.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013422+0000", 2024-04-25T22:53:15.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6770999999999999e-05 2024-04-25T22:53:15.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:15.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013431+0000", 2024-04-25T22:53:15.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5019999999999998e-06 2024-04-25T22:53:15.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:15.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021720+0000", 2024-04-25T22:53:15.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082884340000000008 2024-04-25T22:53:15.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:15.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022122+0000", 2024-04-25T22:53:15.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000401634 2024-04-25T22:53:15.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:15.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:15.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:15.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033577+0000", 2024-04-25T22:53:15.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011455435999999999 2024-04-25T22:53:15.384 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:15.384 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:15.385 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:15.385 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:15.385 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:15.385 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:15.385 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T22:53:15.395 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:15.396 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:15.385+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:15.487 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:15.486+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:15.495 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on 2024-04-25T22:53:15.507 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:15.507 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:15.507 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-25T22:53:15.507 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:15.517 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:15.521 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:53:15.595 INFO:teuthology.orchestra.console.smithi164:Power on completed 2024-04-25T22:53:15.601 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:15.601+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:15.659 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:15.659 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:15.659 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-25T22:53:15.659 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-25T22:53:15.659 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:15.665 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-25T22:53:15.665 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:53:15.665 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:53:15.670 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:15.696 DEBUG:teuthology.orchestra.console.smithi164:Waiting for login prompt 2024-04-25T22:53:15.696 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi164 2024-04-25T22:53:15.705 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-25T22:53:15.706 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:53:15.707 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:53:15.707 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:53:15.711 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:15.711+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:15.790 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:15.789+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:15.812 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:15.813 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:15.822 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:15.891 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:15.891+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:15.926 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:15.926 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:15.935 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:15.992 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:15.992+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:16.037 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:16.037 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:16.045 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:16.093 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:16.092+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:16.149 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:16.149 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:16.157 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:16.198 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:16.198+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:16.262 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:16.262 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:16.271 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:16.315 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:16.315+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:16.372 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:16.373 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:16.381 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:16.422 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:16.422+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:16.497 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:16.496+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:16.523 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:16.523 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:16.532 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:16.598 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:16.597+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:16.637 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:16.637 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:16.646 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:16.698 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:16.698+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:16.748 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:16.748 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:16.756 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:16.798 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:16.798+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:16.900 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:16.900 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:16.900 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:16.899+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:16.908 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:17.001 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:17.000+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:17.012 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:17.013 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:17.022 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:17.103 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:17.103+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:17.125 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:17.125 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:17.134 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:17.218 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:17.218+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:17.241 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-25T22:53:17.276 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:17.277 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:17.285 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:17.326 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:17.326+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:17.391 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:17.392 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:17.400 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:17.406 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:17.406+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:17.501 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:17.501 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:17.511 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:17.511 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:17.510+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:17.611 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:17.611+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:17.612 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:17.612 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:17.621 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:17.708 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:53:17.714 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:17.712+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:17.724 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:17.724 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:17.733 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:17.817 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:17.817+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:17.839 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-25T22:53:17.840 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:53:17.840 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:53:17.859 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-25T22:53:17.859 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:53:17.861 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:53:17.861 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:53:17.875 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:17.875 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:17.875 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-25T22:53:17.875 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-25T22:53:17.875 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:17.884 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:17.925 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:17.925+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:18.014 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:18.013+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:18.028 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:18.028 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:53:18.028 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:53:18.028 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:53:18.028 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.029 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:53:18.029 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:18.029 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 90.058918970999997, 2024-04-25T22:53:18.029 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:53:18.029 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:18.029 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:18.030 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:18.030 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:18.030 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.030 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:18.030 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:18.030 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:18.031 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.031 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.031 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:18.031 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:18.031 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:18.031 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.031 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.031 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:18.031 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:53:18.031 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:53:18.031 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.031 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.032 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:18.032 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:53:18.032 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:53:18.032 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.032 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.033 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:18.033 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:53:18.033 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:53:18.033 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.033 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.033 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:18.033 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:53:18.033 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:53:18.033 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.033 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.033 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:18.033 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:53:18.034 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:53:18.034 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.034 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.034 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:18.034 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:53:18.034 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:53:18.034 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.034 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.034 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:18.034 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:53:18.034 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:53:18.034 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.034 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.035 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:18.035 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:53:18.035 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:53:18.035 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:18.035 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:18.035 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:18.035 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.035 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.035 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:110 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'72, mlcod=10'68)", 2024-04-25T22:53:18.035 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:18.035 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 90.058284971000006, 2024-04-25T22:53:18.035 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065316630000000001, 2024-04-25T22:53:18.036 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:18.036 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:18.036 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:18.036 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:18.036 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.036 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:18.036 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:18.036 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:18.036 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.036 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.036 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:18.036 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:18.036 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:18.036 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.037 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.037 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:18.037 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:18.037 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.58e-07 2024-04-25T22:53:18.037 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.037 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.037 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:18.037 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967811+0000", 2024-04-25T22:53:18.037 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.118e-06 2024-04-25T22:53:18.037 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.037 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.037 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:18.037 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967817+0000", 2024-04-25T22:53:18.037 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3709999999999996e-06 2024-04-25T22:53:18.037 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.038 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.038 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:18.038 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967820+0000", 2024-04-25T22:53:18.038 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2210000000000002e-06 2024-04-25T22:53:18.038 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.038 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.038 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:18.038 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967876+0000", 2024-04-25T22:53:18.038 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5507000000000002e-05 2024-04-25T22:53:18.038 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.038 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.039 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:18.039 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967893+0000", 2024-04-25T22:53:18.039 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7812000000000002e-05 2024-04-25T22:53:18.039 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.039 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.039 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:18.039 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974317+0000", 2024-04-25T22:53:18.039 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064237160000000003 2024-04-25T22:53:18.039 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.039 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.039 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:18.039 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:53:18.039 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.156e-05 2024-04-25T22:53:18.039 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:18.040 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:18.040 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:18.040 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.040 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.040 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'68)", 2024-04-25T22:53:18.040 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:18.040 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 90.057867458000004, 2024-04-25T22:53:18.040 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061292279999999996, 2024-04-25T22:53:18.040 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:18.040 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:18.040 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:18.040 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:18.040 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.040 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:18.041 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:18.041 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:18.041 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.041 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.041 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:18.041 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:18.041 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:18.041 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.041 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.041 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:18.041 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:18.041 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6300000000000001e-07 2024-04-25T22:53:18.041 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.042 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.042 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:18.042 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968228+0000", 2024-04-25T22:53:18.042 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6139999999999999e-06 2024-04-25T22:53:18.042 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.042 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.042 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:18.042 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968235+0000", 2024-04-25T22:53:18.042 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7020000000000001e-06 2024-04-25T22:53:18.042 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.042 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.042 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:18.042 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968238+0000", 2024-04-25T22:53:18.042 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0010000000000002e-06 2024-04-25T22:53:18.043 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.043 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.043 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:18.043 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968297+0000", 2024-04-25T22:53:18.043 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8424999999999997e-05 2024-04-25T22:53:18.043 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.043 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.043 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:18.043 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968316+0000", 2024-04-25T22:53:18.043 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8814999999999999e-05 2024-04-25T22:53:18.043 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.043 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.043 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:18.043 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:53:18.044 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060239439999999998 2024-04-25T22:53:18.044 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.044 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.044 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:18.044 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974354+0000", 2024-04-25T22:53:18.044 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4364e-05 2024-04-25T22:53:18.044 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:18.044 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:18.044 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:18.044 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.044 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.044 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'68)", 2024-04-25T22:53:18.044 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:18.045 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 90.057430456000006, 2024-04-25T22:53:18.045 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005948414, 2024-04-25T22:53:18.045 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:18.045 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:18.045 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:18.045 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:18.045 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.045 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:18.045 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:18.045 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:18.045 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.045 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.046 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:18.046 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:18.046 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:18.046 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.046 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.046 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:18.046 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:18.046 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6199999999999998e-07 2024-04-25T22:53:18.046 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.046 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.046 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:18.046 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968723+0000", 2024-04-25T22:53:18.046 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1148999999999993e-05 2024-04-25T22:53:18.047 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.047 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.047 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:18.047 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968730+0000", 2024-04-25T22:53:18.047 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1749999999999999e-06 2024-04-25T22:53:18.047 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.047 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.047 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:18.047 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968734+0000", 2024-04-25T22:53:18.047 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5200000000000002e-06 2024-04-25T22:53:18.047 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.047 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.047 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:18.047 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968771+0000", 2024-04-25T22:53:18.048 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6851999999999999e-05 2024-04-25T22:53:18.048 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.048 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.048 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:18.048 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968788+0000", 2024-04-25T22:53:18.048 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7027000000000001e-05 2024-04-25T22:53:18.048 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.048 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.048 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:18.048 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974589+0000", 2024-04-25T22:53:18.048 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058013320000000002 2024-04-25T22:53:18.048 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.048 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.048 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:18.049 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974610+0000", 2024-04-25T22:53:18.049 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0897e-05 2024-04-25T22:53:18.049 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:18.049 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:18.049 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:18.049 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.049 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.049 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'68)", 2024-04-25T22:53:18.049 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:18.049 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 90.056860446000002, 2024-04-25T22:53:18.049 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053935750000000003, 2024-04-25T22:53:18.049 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:18.049 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:18.050 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:18.050 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:18.050 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.050 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:18.050 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:18.050 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:18.050 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.050 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.050 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:18.050 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:18.050 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:18.050 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.051 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.051 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:18.051 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:18.051 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.03e-07 2024-04-25T22:53:18.051 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.051 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.051 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:18.051 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969235+0000", 2024-04-25T22:53:18.051 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2399999999999999e-06 2024-04-25T22:53:18.051 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.051 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.051 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:18.051 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969242+0000", 2024-04-25T22:53:18.051 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1269999999999997e-06 2024-04-25T22:53:18.052 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.052 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.052 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:18.052 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969246+0000", 2024-04-25T22:53:18.052 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3840000000000001e-06 2024-04-25T22:53:18.052 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.052 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.052 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:18.052 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969278+0000", 2024-04-25T22:53:18.052 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1868e-05 2024-04-25T22:53:18.052 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.052 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.052 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:18.053 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969295+0000", 2024-04-25T22:53:18.053 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7530999999999999e-05 2024-04-25T22:53:18.053 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.053 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.053 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:18.053 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974611+0000", 2024-04-25T22:53:18.053 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053160789999999996 2024-04-25T22:53:18.053 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.053 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.053 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:18.053 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974625+0000", 2024-04-25T22:53:18.053 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3943e-05 2024-04-25T22:53:18.053 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:18.053 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:18.054 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:18.054 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.054 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.054 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-25T22:53:18.054 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:18.054 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 89.863264537999996, 2024-04-25T22:53:18.054 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054952610000000004, 2024-04-25T22:53:18.054 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:18.054 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:18.054 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:18.054 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:18.054 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.054 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:18.055 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:18.055 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:18.055 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.055 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.055 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:18.055 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:18.055 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:18.055 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.055 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.055 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:18.055 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:18.055 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.68e-07 2024-04-25T22:53:18.055 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.056 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.056 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:18.056 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162898+0000", 2024-04-25T22:53:18.056 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9470999999999999e-05 2024-04-25T22:53:18.056 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.056 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.056 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:18.056 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162906+0000", 2024-04-25T22:53:18.056 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1580000000000005e-06 2024-04-25T22:53:18.056 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.056 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.056 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:18.056 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162911+0000", 2024-04-25T22:53:18.056 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4779999999999999e-06 2024-04-25T22:53:18.057 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.057 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.057 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:18.057 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162952+0000", 2024-04-25T22:53:18.057 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0629e-05 2024-04-25T22:53:18.057 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.057 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.057 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:18.057 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162968+0000", 2024-04-25T22:53:18.057 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6239000000000002e-05 2024-04-25T22:53:18.057 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.057 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.058 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:18.058 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168281+0000", 2024-04-25T22:53:18.058 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053132869999999999 2024-04-25T22:53:18.058 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.058 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.058 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:18.058 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168323+0000", 2024-04-25T22:53:18.058 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1430999999999997e-05 2024-04-25T22:53:18.058 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:18.058 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:18.058 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:18.059 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.059 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.059 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-04-25T22:53:18.059 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:18.059 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 89.432787176000005, 2024-04-25T22:53:18.059 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050872510000000001, 2024-04-25T22:53:18.059 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:18.059 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:18.059 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:18.059 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:18.059 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.059 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:18.059 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:18.060 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:18.060 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.060 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.060 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:18.060 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:18.060 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:18.060 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.060 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.060 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:18.060 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:18.061 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.72e-07 2024-04-25T22:53:18.061 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.061 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.061 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:18.061 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593381+0000", 2024-04-25T22:53:18.061 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5797000000000006e-05 2024-04-25T22:53:18.061 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.061 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.061 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:18.061 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593389+0000", 2024-04-25T22:53:18.061 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8480000000000001e-06 2024-04-25T22:53:18.062 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.062 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.062 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:18.062 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593393+0000", 2024-04-25T22:53:18.062 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4819999999999996e-06 2024-04-25T22:53:18.062 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.062 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.062 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:18.062 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593435+0000", 2024-04-25T22:53:18.062 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1600000000000002e-05 2024-04-25T22:53:18.062 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.062 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.062 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:18.063 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593454+0000", 2024-04-25T22:53:18.063 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8868e-05 2024-04-25T22:53:18.063 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.063 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.063 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:18.063 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598350+0000", 2024-04-25T22:53:18.063 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004895763 2024-04-25T22:53:18.063 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.063 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.063 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:18.063 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598392+0000", 2024-04-25T22:53:18.063 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2521000000000002e-05 2024-04-25T22:53:18.063 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:18.063 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:18.064 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:18.064 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.064 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.064 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:18.064 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:18.064 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 85.014423272000002, 2024-04-25T22:53:18.064 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:53:18.064 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:18.064 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:18.064 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:18.064 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:18.064 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.064 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:18.065 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:18.065 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:18.065 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.065 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.065 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:18.065 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:18.065 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:18.065 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.065 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.065 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:18.065 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:53:18.065 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:53:18.065 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.065 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.066 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:18.066 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:53:18.066 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:53:18.066 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.066 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.066 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:18.066 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:53:18.066 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:53:18.066 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.066 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.066 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:18.066 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:53:18.066 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:53:18.066 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.067 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.067 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:18.067 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:53:18.067 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:53:18.067 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.067 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.067 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:18.067 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:53:18.067 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:53:18.067 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.067 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.067 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:18.068 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:53:18.068 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:53:18.068 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.068 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.068 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:18.068 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:53:18.068 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:53:18.068 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.068 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.068 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:18.069 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:53:18.069 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:53:18.069 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.069 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.069 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:18.069 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:53:18.069 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:53:18.069 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.069 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.070 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:18.070 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:53:18.070 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:53:18.070 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:18.070 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:18.070 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:18.070 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.070 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.070 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:18.070 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:18.070 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 85.013748895999996, 2024-04-25T22:53:18.070 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:53:18.070 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:18.071 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:18.071 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:18.071 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:18.071 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.071 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:18.071 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:18.071 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:18.071 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.071 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.071 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:18.071 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:18.071 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:18.071 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.071 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.072 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:18.072 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:53:18.072 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:53:18.072 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.072 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.072 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:18.072 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:53:18.072 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:53:18.072 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.072 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.072 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:18.072 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:53:18.072 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:53:18.072 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.072 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.073 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:18.073 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:53:18.073 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:53:18.073 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.073 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.073 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:18.073 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:53:18.073 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:53:18.073 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.073 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.073 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:18.073 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:53:18.073 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:53:18.073 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.074 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.074 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:18.074 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:53:18.074 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:53:18.074 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.074 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.074 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:18.074 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:53:18.074 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:53:18.074 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.074 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.074 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:18.074 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:53:18.075 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:53:18.075 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.075 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.075 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:18.075 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:53:18.075 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:53:18.075 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.075 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.075 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:18.075 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:53:18.075 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:53:18.075 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:18.075 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:18.076 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:18.076 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.076 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.076 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:18.076 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:18.076 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 85.013239683999998, 2024-04-25T22:53:18.076 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:53:18.076 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:18.076 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:18.076 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:18.076 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:18.076 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.076 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:18.076 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:18.077 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:18.077 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.077 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.077 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:18.077 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:18.077 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:18.077 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.077 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.077 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:18.077 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:53:18.077 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:53:18.077 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.077 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.077 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:18.078 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:53:18.078 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:53:18.078 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.078 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.078 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:18.078 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:53:18.078 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:53:18.078 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.078 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.078 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:18.078 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:53:18.078 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:53:18.078 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.079 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.079 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:18.079 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:53:18.079 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:53:18.079 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.079 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.079 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:18.079 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:53:18.079 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:53:18.079 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.080 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.080 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:18.080 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:53:18.080 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:53:18.080 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.080 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.080 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:18.081 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:53:18.081 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:53:18.081 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.081 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.081 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:18.081 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:53:18.081 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:53:18.081 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.081 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.081 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:18.081 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:53:18.082 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:53:18.082 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.082 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.082 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:18.082 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:53:18.082 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:53:18.082 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:18.082 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:18.082 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:18.082 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.082 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.082 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:18.082 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:18.083 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 85.012826485999994, 2024-04-25T22:53:18.083 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:53:18.083 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:18.083 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:18.083 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:18.083 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:18.083 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.083 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:18.083 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:18.083 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:18.083 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.083 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.083 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:18.083 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:18.084 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:18.084 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.084 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.084 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:18.084 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:18.084 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:53:18.084 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.084 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.084 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:18.084 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:18.084 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:53:18.085 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.085 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.085 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:18.085 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:53:18.085 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:53:18.085 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.085 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.085 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:18.085 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:53:18.085 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:53:18.085 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.085 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.085 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:18.086 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:53:18.086 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:53:18.086 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.086 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.086 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:18.086 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:53:18.086 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:53:18.086 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.086 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.086 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:18.086 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:53:18.086 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:53:18.086 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.087 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.087 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:18.087 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:53:18.087 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:53:18.087 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.087 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.087 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:18.087 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:53:18.087 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:53:18.087 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.087 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.087 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:18.087 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:53:18.087 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:53:18.087 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.088 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.088 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:18.088 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:53:18.088 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:53:18.088 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:18.088 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:18.088 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:18.088 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.088 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.088 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:18.088 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:18.088 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 85.012775816000001, 2024-04-25T22:53:18.088 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:53:18.089 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:18.089 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:18.089 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:18.089 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:18.089 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.089 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:18.089 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:18.089 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:18.089 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.089 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.089 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:18.089 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:18.089 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:18.089 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.089 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.090 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:18.090 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:53:18.090 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:53:18.090 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.090 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.090 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:18.090 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:53:18.090 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:53:18.091 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.091 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.091 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:18.091 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:53:18.091 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:53:18.091 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.091 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.091 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:18.091 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:53:18.091 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:53:18.091 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.092 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.092 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:18.092 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:53:18.092 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:53:18.092 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.092 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.093 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:18.093 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:53:18.093 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:53:18.093 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.093 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.093 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:18.093 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:53:18.093 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:53:18.093 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.093 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.093 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:18.094 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:53:18.094 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:53:18.094 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.094 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.094 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:18.094 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:53:18.094 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:53:18.094 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.094 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.094 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:18.094 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:53:18.094 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:53:18.094 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.095 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.095 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:18.095 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:53:18.095 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:53:18.095 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.095 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.095 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:18.095 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:53:18.095 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:53:18.095 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.095 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.095 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:18.095 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:53:18.095 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:53:18.096 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:18.096 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:18.096 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:18.096 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.096 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.096 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:18.096 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:18.096 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 85.012738947000003, 2024-04-25T22:53:18.096 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:53:18.096 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:18.097 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:18.097 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:18.097 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:18.097 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.097 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:18.097 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:18.097 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:18.098 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.098 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.098 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:18.098 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:18.098 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:18.098 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.099 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.099 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:18.099 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:53:18.099 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:53:18.099 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.099 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.099 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:18.100 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:53:18.100 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:53:18.100 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.100 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.100 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:18.100 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:53:18.100 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:53:18.101 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.101 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.101 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:18.101 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:53:18.101 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:53:18.101 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.102 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.102 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:18.102 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:53:18.102 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:53:18.102 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.102 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.103 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:53:18.103 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:53:18.103 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:53:18.103 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.103 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.103 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:18.103 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:53:18.104 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:53:18.104 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.104 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.104 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:18.104 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:53:18.104 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:53:18.104 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.105 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.105 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:18.105 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:53:18.105 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:53:18.105 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.105 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.106 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:18.106 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:53:18.106 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:53:18.106 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.106 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.106 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:18.106 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:53:18.107 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:53:18.107 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.107 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.107 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:18.107 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:53:18.107 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:53:18.108 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.108 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.108 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:18.108 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:53:18.108 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:53:18.108 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:18.108 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:18.109 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:18.109 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.109 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.109 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:18.109 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:18.109 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 85.012713981000005, 2024-04-25T22:53:18.110 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:53:18.110 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:18.110 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:18.110 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:18.110 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:18.110 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.111 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:18.111 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:18.111 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:18.111 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.111 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.111 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:18.111 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:18.112 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:18.112 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.112 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.112 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:18.112 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:53:18.112 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:53:18.113 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.113 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.113 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:18.113 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:53:18.113 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:53:18.113 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.114 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.114 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:18.114 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:18.114 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:53:18.114 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.114 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.115 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:18.115 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:53:18.115 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:53:18.115 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.115 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.115 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:18.116 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:53:18.116 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:53:18.116 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.116 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.116 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:18.116 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:53:18.117 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:53:18.117 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.117 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.117 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:18.117 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:53:18.117 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:53:18.118 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.118 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.118 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:18.118 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:53:18.118 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:53:18.118 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.119 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.119 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:18.119 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:53:18.119 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:53:18.119 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.119 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.120 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:18.120 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:53:18.120 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:53:18.120 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.120 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.120 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:18.121 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:53:18.121 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:53:18.121 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:18.121 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:18.121 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:18.121 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.121 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.122 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:18.122 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:18.122 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 85.012677616999994, 2024-04-25T22:53:18.122 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:53:18.122 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:18.122 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:18.122 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:18.122 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:18.122 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.122 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:18.122 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:18.123 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:18.123 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.123 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.123 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:18.123 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:18.123 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:18.125 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.125 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.126 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:18.126 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:53:18.126 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:53:18.126 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.126 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.126 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:18.126 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:53:18.126 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:53:18.127 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.127 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.127 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:18.127 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:53:18.127 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:53:18.127 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.127 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.127 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:18.128 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:53:18.128 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:53:18.128 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.128 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.128 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:18.128 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:53:18.128 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:53:18.129 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.129 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.129 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:18.129 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:53:18.129 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:53:18.129 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.129 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.129 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:18.129 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:53:18.130 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:53:18.130 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.130 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.130 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:18.130 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:53:18.130 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:53:18.130 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.130 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.131 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:18.131 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:53:18.131 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:53:18.131 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:18.131 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:18.131 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:18.131 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.131 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.132 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:18.132 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:18.132 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 85.012646536000005, 2024-04-25T22:53:18.132 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:53:18.132 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:18.132 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:18.132 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:18.132 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:18.132 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.133 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:18.133 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:18.133 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:18.133 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.133 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.133 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:18.134 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:18.134 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:18.134 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.134 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.134 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:18.134 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:18.134 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:18.135 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.135 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.135 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:18.135 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:53:18.135 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:53:18.135 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.136 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.136 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:18.136 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:53:18.136 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:53:18.136 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.136 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.137 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:18.137 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:53:18.137 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:53:18.137 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.137 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.137 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:18.138 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:53:18.138 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:53:18.138 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.138 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.138 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:18.138 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:53:18.138 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:53:18.139 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.139 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.139 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:18.139 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:53:18.139 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:53:18.139 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:18.140 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:18.140 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:18.140 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.140 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.140 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:53:18.140 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:18.141 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 85.012205566999995, 2024-04-25T22:53:18.141 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064881979999999997, 2024-04-25T22:53:18.141 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:18.141 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:18.141 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:18.141 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:18.142 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.142 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:18.142 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:18.142 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:18.142 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.142 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.143 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:18.143 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:18.143 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:18.143 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.143 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.143 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:18.144 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:18.144 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2699999999999999e-07 2024-04-25T22:53:18.144 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.144 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.144 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:18.144 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013898+0000", 2024-04-25T22:53:18.144 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0796e-05 2024-04-25T22:53:18.145 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.145 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.145 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:18.145 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013907+0000", 2024-04-25T22:53:18.145 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5140000000000007e-06 2024-04-25T22:53:18.145 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.146 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.146 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:18.146 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013952+0000", 2024-04-25T22:53:18.146 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4134000000000001e-05 2024-04-25T22:53:18.146 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.146 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.147 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:18.147 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016812+0000", 2024-04-25T22:53:18.147 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028601059999999998 2024-04-25T22:53:18.147 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.147 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.147 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:18.147 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.017052+0000", 2024-04-25T22:53:18.148 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024056500000000001 2024-04-25T22:53:18.148 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.148 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.148 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:18.148 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020350+0000", 2024-04-25T22:53:18.148 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032978320000000001 2024-04-25T22:53:18.148 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.148 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.149 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:18.149 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020375+0000", 2024-04-25T22:53:18.149 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4624e-05 2024-04-25T22:53:18.149 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:18.149 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:18.149 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:18.149 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.149 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.149 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-25T22:53:18.149 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:18.149 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 84.998675121000005, 2024-04-25T22:53:18.150 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058583000000000003, 2024-04-25T22:53:18.150 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:18.150 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:18.150 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:18.150 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:18.150 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.150 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:18.150 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:18.150 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:18.150 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.150 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.150 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:18.150 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:18.151 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:18.151 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.151 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.151 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:18.151 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:18.151 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.41e-07 2024-04-25T22:53:18.151 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.151 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.151 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:18.151 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027428+0000", 2024-04-25T22:53:18.151 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.075e-05 2024-04-25T22:53:18.151 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.151 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.151 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:18.151 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027435+0000", 2024-04-25T22:53:18.152 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3610000000000003e-06 2024-04-25T22:53:18.152 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.152 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.152 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:18.152 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027442+0000", 2024-04-25T22:53:18.152 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0400000000000004e-06 2024-04-25T22:53:18.152 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.152 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.152 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:18.152 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028094+0000", 2024-04-25T22:53:18.152 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00065134800000000005 2024-04-25T22:53:18.152 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.152 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.152 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:18.153 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028107+0000", 2024-04-25T22:53:18.153 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3087e-05 2024-04-25T22:53:18.153 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.153 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.153 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:18.153 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033239+0000", 2024-04-25T22:53:18.153 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051319429999999999 2024-04-25T22:53:18.153 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.153 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.153 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:18.153 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033275+0000", 2024-04-25T22:53:18.153 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6430000000000002e-05 2024-04-25T22:53:18.153 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:18.153 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:18.153 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:18.154 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.154 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.154 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-25T22:53:18.154 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:18.154 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 84.998290284000007, 2024-04-25T22:53:18.154 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005413597, 2024-04-25T22:53:18.154 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:18.154 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:18.154 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:18.154 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:18.154 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.154 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:18.154 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:18.154 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:18.155 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.155 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.155 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:18.155 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:18.155 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:18.155 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.155 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.155 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:18.155 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:18.155 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3799999999999997e-07 2024-04-25T22:53:18.155 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.155 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.155 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:18.155 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027816+0000", 2024-04-25T22:53:18.155 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3230999999999999e-05 2024-04-25T22:53:18.156 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.156 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.156 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:18.156 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027823+0000", 2024-04-25T22:53:18.156 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9039999999999992e-06 2024-04-25T22:53:18.156 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.156 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.156 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:18.156 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027841+0000", 2024-04-25T22:53:18.156 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7651000000000001e-05 2024-04-25T22:53:18.156 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.156 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.156 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:18.156 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027904+0000", 2024-04-25T22:53:18.157 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3058000000000005e-05 2024-04-25T22:53:18.157 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.157 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.157 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:18.157 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027926+0000", 2024-04-25T22:53:18.157 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1450999999999998e-05 2024-04-25T22:53:18.157 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.157 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.157 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:18.157 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033177+0000", 2024-04-25T22:53:18.157 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052508909999999997 2024-04-25T22:53:18.157 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.157 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.157 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:18.157 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033215+0000", 2024-04-25T22:53:18.158 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8872999999999999e-05 2024-04-25T22:53:18.158 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:18.158 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:18.158 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:18.158 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.158 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.158 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 171 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:53:18.158 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:18.158 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 84.998233182000007, 2024-04-25T22:53:18.158 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054322240000000003, 2024-04-25T22:53:18.158 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:18.158 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:18.158 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "reached pg", 2024-04-25T22:53:18.158 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:18.159 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.159 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:18.159 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:18.159 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:18.159 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.159 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.159 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:18.159 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:18.159 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:18.159 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.159 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.159 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:18.159 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:18.159 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7500000000000001e-07 2024-04-25T22:53:18.160 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.160 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.160 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:18.160 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027868+0000", 2024-04-25T22:53:18.160 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5750000000000001e-06 2024-04-25T22:53:18.160 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.160 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.160 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:18.160 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027885+0000", 2024-04-25T22:53:18.160 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7272e-05 2024-04-25T22:53:18.160 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.160 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.160 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:18.160 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027900+0000", 2024-04-25T22:53:18.161 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.502e-05 2024-04-25T22:53:18.161 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.161 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.161 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:18.161 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028381+0000", 2024-04-25T22:53:18.161 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00048039399999999998 2024-04-25T22:53:18.161 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:18.161 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:18.161 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:18.161 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033291+0000", 2024-04-25T22:53:18.161 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049105879999999996 2024-04-25T22:53:18.161 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:18.161 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:18.161 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:18.162 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:18.162 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:18.162 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:18.163 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:18.163+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:18.163 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:18.230 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is set 2024-04-25T22:53:18.264 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:18.263+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:18.269 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:18.269 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:18.270 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-04-25T22:53:18.270 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:18.279 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:18.364 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:18.364+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:18.421 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:18.421 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:18.421 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:53:18.421 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:53:18.421 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:18.429 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:18.471 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:18.470+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:18.566 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~35s 2024-04-25T22:53:18.566 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:18.566+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:18.572 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:18.572 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-04-25T22:53:18.572 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-04-25T22:53:18.573 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:53:18.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.573 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:18.573 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:18.573 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 90.605670007000001, 2024-04-25T22:53:18.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0103421, 2024-04-25T22:53:18.573 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:18.573 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:18.573 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:18.573 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:18.573 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:18.573 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:18.573 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 115 2024-04-25T22:53:18.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.574 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:18.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:18.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:18.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:18.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:18.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:18.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:18.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:18.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:18.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9500000000000002e-07 2024-04-25T22:53:18.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:18.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965108+0000", 2024-04-25T22:53:18.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9177999999999994e-05 2024-04-25T22:53:18.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:18.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965127+0000", 2024-04-25T22:53:18.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8868e-05 2024-04-25T22:53:18.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:18.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965133+0000", 2024-04-25T22:53:18.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8929999999999999e-06 2024-04-25T22:53:18.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.576 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:18.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.969991+0000", 2024-04-25T22:53:18.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048573849999999997 2024-04-25T22:53:18.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.576 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:18.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970072+0000", 2024-04-25T22:53:18.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0728000000000004e-05 2024-04-25T22:53:18.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.576 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:18.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970189+0000", 2024-04-25T22:53:18.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000117778 2024-04-25T22:53:18.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:18.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970946+0000", 2024-04-25T22:53:18.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00075704600000000004 2024-04-25T22:53:18.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:18.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975297+0000", 2024-04-25T22:53:18.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004350217 2024-04-25T22:53:18.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:18.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975343+0000", 2024-04-25T22:53:18.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6687999999999998e-05 2024-04-25T22:53:18.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:18.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975380+0000", 2024-04-25T22:53:18.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6724000000000003e-05 2024-04-25T22:53:18.578 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:18.578 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:18.578 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:18.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.579 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:18.579 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:18.579 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 90.605563975999999, 2024-04-25T22:53:18.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010304384, 2024-04-25T22:53:18.579 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:18.579 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:18.579 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:18.579 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:18.579 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:18.579 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:18.579 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 116 2024-04-25T22:53:18.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.579 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:18.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.580 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:18.580 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:18.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:18.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.580 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:18.580 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:18.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:18.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.580 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:18.580 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:18.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5799999999999999e-07 2024-04-25T22:53:18.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.581 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.581 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:18.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965154+0000", 2024-04-25T22:53:18.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0009e-05 2024-04-25T22:53:18.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.581 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.581 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:18.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965164+0000", 2024-04-25T22:53:18.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8490000000000001e-06 2024-04-25T22:53:18.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.581 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.581 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:18.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965169+0000", 2024-04-25T22:53:18.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0730000000000004e-06 2024-04-25T22:53:18.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:18.582 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970609+0000", 2024-04-25T22:53:18.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054397689999999997 2024-04-25T22:53:18.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:18.582 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970651+0000", 2024-04-25T22:53:18.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1873999999999999e-05 2024-04-25T22:53:18.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:18.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970723+0000", 2024-04-25T22:53:18.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2039999999999995e-05 2024-04-25T22:53:18.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:18.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971358+0000", 2024-04-25T22:53:18.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063489500000000001 2024-04-25T22:53:18.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:18.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975409+0000", 2024-04-25T22:53:18.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040506880000000002 2024-04-25T22:53:18.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:18.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975432+0000", 2024-04-25T22:53:18.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3315999999999998e-05 2024-04-25T22:53:18.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:18.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975448+0000", 2024-04-25T22:53:18.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6313000000000001e-05 2024-04-25T22:53:18.584 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:18.584 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:18.584 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:18.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.585 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:18.585 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:18.585 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 90.605529394000001, 2024-04-25T22:53:18.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010384338999999999, 2024-04-25T22:53:18.585 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:18.585 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:18.585 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:18.585 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:18.585 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:18.585 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:18.585 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-04-25T22:53:18.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.585 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:18.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:18.586 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:18.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:18.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.586 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:18.586 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:18.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:18.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.586 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:18.586 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:18.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3600000000000004e-07 2024-04-25T22:53:18.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.587 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:18.587 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965185+0000", 2024-04-25T22:53:18.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.117e-06 2024-04-25T22:53:18.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.587 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:18.587 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965192+0000", 2024-04-25T22:53:18.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3239999999999997e-06 2024-04-25T22:53:18.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.587 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:18.587 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965198+0000", 2024-04-25T22:53:18.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6370000000000004e-06 2024-04-25T22:53:18.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:18.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970973+0000", 2024-04-25T22:53:18.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057748239999999996 2024-04-25T22:53:18.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:18.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971049+0000", 2024-04-25T22:53:18.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6029e-05 2024-04-25T22:53:18.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:18.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971174+0000", 2024-04-25T22:53:18.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012462399999999999 2024-04-25T22:53:18.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:18.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971553+0000", 2024-04-25T22:53:18.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037896499999999999 2024-04-25T22:53:18.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:18.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975482+0000", 2024-04-25T22:53:18.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039297459999999996 2024-04-25T22:53:18.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.590 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:18.590 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975529+0000", 2024-04-25T22:53:18.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6387000000000002e-05 2024-04-25T22:53:18.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.590 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.590 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:18.590 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975563+0000", 2024-04-25T22:53:18.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4150000000000003e-05 2024-04-25T22:53:18.590 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:18.590 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:18.590 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:18.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.590 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.591 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:18.591 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:18.591 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 85.558483070999998, 2024-04-25T22:53:18.591 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012637705000000001, 2024-04-25T22:53:18.591 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:18.591 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:18.591 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:18.591 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:18.591 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.591 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:18.591 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:18.591 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:18.591 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.591 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.592 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:18.592 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:18.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:18.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.592 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.592 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:18.592 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012227+0000", 2024-04-25T22:53:18.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.863e-06 2024-04-25T22:53:18.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.592 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.592 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:18.592 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012236+0000", 2024-04-25T22:53:18.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1109999999999997e-06 2024-04-25T22:53:18.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.593 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:18.593 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012309+0000", 2024-04-25T22:53:18.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3242000000000001e-05 2024-04-25T22:53:18.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.593 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:18.593 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012324+0000", 2024-04-25T22:53:18.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4837e-05 2024-04-25T22:53:18.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.593 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:18.593 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015060+0000", 2024-04-25T22:53:18.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027363349999999999 2024-04-25T22:53:18.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:18.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015169+0000", 2024-04-25T22:53:18.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108372 2024-04-25T22:53:18.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:18.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015498+0000", 2024-04-25T22:53:18.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032949999999999999 2024-04-25T22:53:18.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:18.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021282+0000", 2024-04-25T22:53:18.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057836429999999998 2024-04-25T22:53:18.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.595 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:18.595 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024709+0000", 2024-04-25T22:53:18.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034271979999999998 2024-04-25T22:53:18.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.595 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:18.595 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024802+0000", 2024-04-25T22:53:18.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2960000000000004e-05 2024-04-25T22:53:18.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.595 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:18.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024863+0000", 2024-04-25T22:53:18.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0643999999999997e-05 2024-04-25T22:53:18.596 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:18.596 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:18.596 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:18.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.596 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:18.596 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:18.596 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 85.558359300000006, 2024-04-25T22:53:18.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012979447999999999, 2024-04-25T22:53:18.596 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:18.596 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:18.596 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:18.596 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:18.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:18.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:18.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:18.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:18.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:18.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:18.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:18.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:18.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:53:18.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.598 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:18.598 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012354+0000", 2024-04-25T22:53:18.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7740000000000004e-06 2024-04-25T22:53:18.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.598 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:18.598 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012365+0000", 2024-04-25T22:53:18.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.064e-05 2024-04-25T22:53:18.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.598 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:18.598 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012382+0000", 2024-04-25T22:53:18.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6999000000000001e-05 2024-04-25T22:53:18.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.599 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:18.599 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015958+0000", 2024-04-25T22:53:18.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035765699999999998 2024-04-25T22:53:18.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.599 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:18.599 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016037+0000", 2024-04-25T22:53:18.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8242000000000001e-05 2024-04-25T22:53:18.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.599 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:18.600 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016404+0000", 2024-04-25T22:53:18.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036784300000000002 2024-04-25T22:53:18.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:18.600 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021294+0000", 2024-04-25T22:53:18.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048890629999999999 2024-04-25T22:53:18.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:18.600 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024959+0000", 2024-04-25T22:53:18.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036651570000000001 2024-04-25T22:53:18.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:18.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025097+0000", 2024-04-25T22:53:18.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013788099999999999 2024-04-25T22:53:18.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:18.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025328+0000", 2024-04-25T22:53:18.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231492 2024-04-25T22:53:18.601 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:18.601 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:18.601 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:18.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.602 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:18.602 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:18.602 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 85.558271531000003, 2024-04-25T22:53:18.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013049827, 2024-04-25T22:53:18.602 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:18.602 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:18.602 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:18.602 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:18.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:18.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:18.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:18.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:18.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:18.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:18.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:18.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012437+0000", 2024-04-25T22:53:18.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-04-25T22:53:18.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:18.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012440+0000", 2024-04-25T22:53:18.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7609999999999999e-06 2024-04-25T22:53:18.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:18.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012449+0000", 2024-04-25T22:53:18.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.285e-06 2024-04-25T22:53:18.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:18.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012457+0000", 2024-04-25T22:53:18.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9510000000000006e-06 2024-04-25T22:53:18.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:18.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017106+0000", 2024-04-25T22:53:18.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046494220000000003 2024-04-25T22:53:18.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:18.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017223+0000", 2024-04-25T22:53:18.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116824 2024-04-25T22:53:18.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:18.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017345+0000", 2024-04-25T22:53:18.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122175 2024-04-25T22:53:18.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:18.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021299+0000", 2024-04-25T22:53:18.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039534879999999998 2024-04-25T22:53:18.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:18.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025398+0000", 2024-04-25T22:53:18.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040988960000000003 2024-04-25T22:53:18.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:18.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025439+0000", 2024-04-25T22:53:18.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0915999999999999e-05 2024-04-25T22:53:18.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:18.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025486+0000", 2024-04-25T22:53:18.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7534999999999998e-05 2024-04-25T22:53:18.607 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:18.607 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:18.607 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:18.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.607 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:18.607 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:18.607 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 85.558241379999998, 2024-04-25T22:53:18.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020988041999999998, 2024-04-25T22:53:18.607 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:18.607 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:18.607 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:18.607 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:18.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:18.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:18.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:18.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:18.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:18.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:18.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:18.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:18.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.99e-07 2024-04-25T22:53:18.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:18.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012470+0000", 2024-04-25T22:53:18.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2789999999999999e-06 2024-04-25T22:53:18.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:18.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012477+0000", 2024-04-25T22:53:18.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:53:18.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:18.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012500+0000", 2024-04-25T22:53:18.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2490999999999999e-05 2024-04-25T22:53:18.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:18.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021911+0000", 2024-04-25T22:53:18.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094114160000000006 2024-04-25T22:53:18.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:18.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022000+0000", 2024-04-25T22:53:18.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8601000000000001e-05 2024-04-25T22:53:18.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:18.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022359+0000", 2024-04-25T22:53:18.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035921999999999999 2024-04-25T22:53:18.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:18.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025541+0000", 2024-04-25T22:53:18.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031820619999999998 2024-04-25T22:53:18.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:18.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033375+0000", 2024-04-25T22:53:18.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078338379999999992 2024-04-25T22:53:18.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:18.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033415+0000", 2024-04-25T22:53:18.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9527000000000003e-05 2024-04-25T22:53:18.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:18.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033455+0000", 2024-04-25T22:53:18.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9932000000000003e-05 2024-04-25T22:53:18.612 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:18.612 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:18.612 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:18.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.613 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:18.613 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:18.613 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 85.558186187000004, 2024-04-25T22:53:18.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021043857999999999, 2024-04-25T22:53:18.613 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:18.613 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:18.613 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:18.613 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:18.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.613 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:18.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:18.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:18.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.614 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:18.614 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:18.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:18.614 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.614 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:18.614 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012523+0000", 2024-04-25T22:53:18.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.361e-06 2024-04-25T22:53:18.614 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.614 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:18.614 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012530+0000", 2024-04-25T22:53:18.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5440000000000004e-06 2024-04-25T22:53:18.614 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:18.615 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012541+0000", 2024-04-25T22:53:18.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1745e-05 2024-04-25T22:53:18.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:18.615 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012551+0000", 2024-04-25T22:53:18.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5789999999999993e-06 2024-04-25T22:53:18.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:18.615 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022709+0000", 2024-04-25T22:53:18.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010157685 2024-04-25T22:53:18.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:18.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022957+0000", 2024-04-25T22:53:18.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024824599999999998 2024-04-25T22:53:18.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:18.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023443+0000", 2024-04-25T22:53:18.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048578599999999999 2024-04-25T22:53:18.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:18.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025547+0000", 2024-04-25T22:53:18.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021044789999999998 2024-04-25T22:53:18.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:18.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033509+0000", 2024-04-25T22:53:18.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0079622180000000001 2024-04-25T22:53:18.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:18.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033542+0000", 2024-04-25T22:53:18.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3018000000000001e-05 2024-04-25T22:53:18.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:18.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033566+0000", 2024-04-25T22:53:18.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3197000000000002e-05 2024-04-25T22:53:18.618 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:18.618 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:18.618 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:18.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.618 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:18.618 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:18.618 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 85.558146222000005, 2024-04-25T22:53:18.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021122696, 2024-04-25T22:53:18.618 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:18.618 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:18.618 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:18.619 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:18.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.619 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:18.619 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:18.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:18.619 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.619 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:18.619 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:18.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:18.619 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.619 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:18.619 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:18.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:53:18.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.620 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:18.620 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012566+0000", 2024-04-25T22:53:18.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-04-25T22:53:18.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.620 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:18.620 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012619+0000", 2024-04-25T22:53:18.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2607e-05 2024-04-25T22:53:18.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.620 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:18.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012628+0000", 2024-04-25T22:53:18.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6500000000000008e-06 2024-04-25T22:53:18.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:18.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024024+0000", 2024-04-25T22:53:18.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011396007999999999 2024-04-25T22:53:18.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:18.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024198+0000", 2024-04-25T22:53:18.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000173215 2024-04-25T22:53:18.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:18.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024447+0000", 2024-04-25T22:53:18.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024898500000000002 2024-04-25T22:53:18.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:18.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026431+0000", 2024-04-25T22:53:18.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001984923 2024-04-25T22:53:18.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:18.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033608+0000", 2024-04-25T22:53:18.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071768459999999997 2024-04-25T22:53:18.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:18.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033646+0000", 2024-04-25T22:53:18.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299000000000003e-05 2024-04-25T22:53:18.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:18.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033684+0000", 2024-04-25T22:53:18.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8773000000000003e-05 2024-04-25T22:53:18.623 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:18.623 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:18.623 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:18.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.623 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:18.624 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:18.624 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 85.558057622999996, 2024-04-25T22:53:18.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021175381, 2024-04-25T22:53:18.624 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:18.624 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:18.624 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:18.624 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:18.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:18.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:18.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:18.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:18.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:18.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:18.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.625 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:18.625 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012651+0000", 2024-04-25T22:53:18.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:53:18.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.625 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:18.625 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012656+0000", 2024-04-25T22:53:18.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8899999999999998e-06 2024-04-25T22:53:18.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.625 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:18.625 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012666+0000", 2024-04-25T22:53:18.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0346999999999999e-05 2024-04-25T22:53:18.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:18.626 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012675+0000", 2024-04-25T22:53:18.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9930000000000001e-06 2024-04-25T22:53:18.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:18.626 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025661+0000", 2024-04-25T22:53:18.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01298531 2024-04-25T22:53:18.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:18.627 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025757+0000", 2024-04-25T22:53:18.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5822000000000005e-05 2024-04-25T22:53:18.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.627 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:18.627 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025907+0000", 2024-04-25T22:53:18.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015051499999999999 2024-04-25T22:53:18.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.627 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:18.627 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026435+0000", 2024-04-25T22:53:18.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052762200000000005 2024-04-25T22:53:18.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:18.628 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033732+0000", 2024-04-25T22:53:18.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072978419999999997 2024-04-25T22:53:18.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:18.628 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033787+0000", 2024-04-25T22:53:18.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4703999999999997e-05 2024-04-25T22:53:18.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:18.628 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033826+0000", 2024-04-25T22:53:18.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8458999999999999e-05 2024-04-25T22:53:18.629 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:18.629 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:18.629 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:18.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.629 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:18.629 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:18.629 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 85.558002208999994, 2024-04-25T22:53:18.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021244174000000001, 2024-04-25T22:53:18.629 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:18.629 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:18.629 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:18.629 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:18.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:18.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:18.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:18.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:18.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:18.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:18.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:18.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:18.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:18.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.631 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.631 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:18.631 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012712+0000", 2024-04-25T22:53:18.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.913e-06 2024-04-25T22:53:18.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.631 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.631 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:18.631 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012722+0000", 2024-04-25T22:53:18.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2879999999999998e-06 2024-04-25T22:53:18.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.631 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.631 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:18.631 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012727+0000", 2024-04-25T22:53:18.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8429999999999998e-06 2024-04-25T22:53:18.632 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.632 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:18.632 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026099+0000", 2024-04-25T22:53:18.632 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013371450999999999 2024-04-25T22:53:18.632 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.632 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:18.632 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026147+0000", 2024-04-25T22:53:18.632 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7837999999999998e-05 2024-04-25T22:53:18.632 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.632 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:18.632 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026254+0000", 2024-04-25T22:53:18.632 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107314 2024-04-25T22:53:18.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:18.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026686+0000", 2024-04-25T22:53:18.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000432428 2024-04-25T22:53:18.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:18.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033873+0000", 2024-04-25T22:53:18.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071864399999999997 2024-04-25T22:53:18.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:18.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033904+0000", 2024-04-25T22:53:18.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1321e-05 2024-04-25T22:53:18.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:18.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033950+0000", 2024-04-25T22:53:18.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5707999999999997e-05 2024-04-25T22:53:18.634 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:18.634 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:18.634 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:18.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.634 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:18.634 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:18.635 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 85.557971824000006, 2024-04-25T22:53:18.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01096505, 2024-04-25T22:53:18.635 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:18.635 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:18.635 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:18.635 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:18.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.635 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:18.635 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:18.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:18.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.635 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:18.636 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:18.636 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:18.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.636 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:18.636 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012737+0000", 2024-04-25T22:53:18.636 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:18.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.636 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:18.636 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012739+0000", 2024-04-25T22:53:18.636 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-04-25T22:53:18.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.637 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.637 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:18.637 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012743+0000", 2024-04-25T22:53:18.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3239999999999996e-06 2024-04-25T22:53:18.637 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.637 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.637 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:18.637 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012746+0000", 2024-04-25T22:53:18.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.129e-06 2024-04-25T22:53:18.637 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.637 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.637 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:18.637 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012796+0000", 2024-04-25T22:53:18.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9231999999999999e-05 2024-04-25T22:53:18.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.638 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:18.638 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012915+0000", 2024-04-25T22:53:18.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119021 2024-04-25T22:53:18.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.638 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:18.638 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013069+0000", 2024-04-25T22:53:18.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015463900000000001 2024-04-25T22:53:18.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.639 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:18.639 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019237+0000", 2024-04-25T22:53:18.639 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061680329999999998 2024-04-25T22:53:18.639 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.639 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.639 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:18.639 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023603+0000", 2024-04-25T22:53:18.639 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043655860000000003 2024-04-25T22:53:18.639 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.639 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.639 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:18.639 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023659+0000", 2024-04-25T22:53:18.639 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6484000000000003e-05 2024-04-25T22:53:18.639 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.640 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.640 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:18.640 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023701+0000", 2024-04-25T22:53:18.640 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1761999999999998e-05 2024-04-25T22:53:18.640 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:18.640 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:18.640 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:18.640 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.640 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.640 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:18.640 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:18.640 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 85.557946876000003, 2024-04-25T22:53:18.640 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011234429000000001, 2024-04-25T22:53:18.641 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:18.641 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:18.641 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:18.641 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:18.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.641 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:18.641 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:18.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:18.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.641 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:18.641 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:18.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:18.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:18.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012762+0000", 2024-04-25T22:53:18.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-04-25T22:53:18.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:18.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012765+0000", 2024-04-25T22:53:18.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2569999999999999e-06 2024-04-25T22:53:18.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:18.643 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012783+0000", 2024-04-25T22:53:18.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8431999999999999e-05 2024-04-25T22:53:18.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.643 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:18.643 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012799+0000", 2024-04-25T22:53:18.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5438999999999999e-05 2024-04-25T22:53:18.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.643 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:18.643 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013826+0000", 2024-04-25T22:53:18.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010275060000000001 2024-04-25T22:53:18.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.644 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:18.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013913+0000", 2024-04-25T22:53:18.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.708e-05 2024-04-25T22:53:18.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.644 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.644 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:18.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014098+0000", 2024-04-25T22:53:18.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018519399999999999 2024-04-25T22:53:18.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.644 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.644 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:18.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019684+0000", 2024-04-25T22:53:18.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055860079999999999 2024-04-25T22:53:18.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.645 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:18.645 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023876+0000", 2024-04-25T22:53:18.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041918800000000003 2024-04-25T22:53:18.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.645 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:18.645 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023957+0000", 2024-04-25T22:53:18.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1165e-05 2024-04-25T22:53:18.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.645 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:18.645 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023995+0000", 2024-04-25T22:53:18.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:53:18.645 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:18.646 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:18.646 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:18.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.646 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:18.646 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:18.646 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 85.557849097000002, 2024-04-25T22:53:18.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011131200000000001, 2024-04-25T22:53:18.646 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:18.646 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:18.646 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:18.646 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:18.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:18.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:18.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:18.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:18.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:18.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:18.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:18.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012860+0000", 2024-04-25T22:53:18.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3900000000000004e-07 2024-04-25T22:53:18.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:18.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012865+0000", 2024-04-25T22:53:18.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5609999999999998e-06 2024-04-25T22:53:18.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:18.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012895+0000", 2024-04-25T22:53:18.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9847000000000001e-05 2024-04-25T22:53:18.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:18.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012905+0000", 2024-04-25T22:53:18.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.03e-05 2024-04-25T22:53:18.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:18.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015020+0000", 2024-04-25T22:53:18.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021142940000000001 2024-04-25T22:53:18.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:18.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015182+0000", 2024-04-25T22:53:18.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016248099999999999 2024-04-25T22:53:18.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:18.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015357+0000", 2024-04-25T22:53:18.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017471000000000001 2024-04-25T22:53:18.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:18.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021021+0000", 2024-04-25T22:53:18.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056638340000000004 2024-04-25T22:53:18.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:18.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023712+0000", 2024-04-25T22:53:18.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026910380000000002 2024-04-25T22:53:18.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:18.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023763+0000", 2024-04-25T22:53:18.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1477999999999997e-05 2024-04-25T22:53:18.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:18.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023990+0000", 2024-04-25T22:53:18.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000226818 2024-04-25T22:53:18.651 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:18.651 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:18.651 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:18.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.651 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:18.651 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:18.651 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 85.557726001000006, 2024-04-25T22:53:18.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011705299000000001, 2024-04-25T22:53:18.652 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:18.652 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:18.652 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:18.652 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:18.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:18.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:18.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:18.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:18.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:18.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:18.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:18.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012983+0000", 2024-04-25T22:53:18.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:53:18.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:18.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012986+0000", 2024-04-25T22:53:18.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5700000000000001e-06 2024-04-25T22:53:18.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:18.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012993+0000", 2024-04-25T22:53:18.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8730000000000001e-06 2024-04-25T22:53:18.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.654 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:18.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013000+0000", 2024-04-25T22:53:18.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1890000000000001e-06 2024-04-25T22:53:18.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.654 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:18.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:53:18.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002147866 2024-04-25T22:53:18.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:18.655 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015351+0000", 2024-04-25T22:53:18.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020300799999999999 2024-04-25T22:53:18.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:18.655 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016260+0000", 2024-04-25T22:53:18.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00090926799999999997 2024-04-25T22:53:18.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:18.655 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022669+0000", 2024-04-25T22:53:18.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064082849999999997 2024-04-25T22:53:18.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:18.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024584+0000", 2024-04-25T22:53:18.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019151699999999999 2024-04-25T22:53:18.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:18.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024643+0000", 2024-04-25T22:53:18.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8888999999999998e-05 2024-04-25T22:53:18.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:18.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024687+0000", 2024-04-25T22:53:18.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4444999999999999e-05 2024-04-25T22:53:18.656 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:18.657 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:18.657 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:18.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.657 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:18.657 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:18.657 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 85.55769841, 2024-04-25T22:53:18.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011249699, 2024-04-25T22:53:18.657 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:18.657 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:18.657 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:18.657 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:18.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:18.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:18.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:18.658 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.658 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:18.658 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:18.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:18.658 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.658 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:18.658 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013010+0000", 2024-04-25T22:53:18.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2099999999999996e-07 2024-04-25T22:53:18.658 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.658 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:18.658 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013013+0000", 2024-04-25T22:53:18.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1310000000000002e-06 2024-04-25T22:53:18.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.659 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:18.659 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013020+0000", 2024-04-25T22:53:18.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3330000000000002e-06 2024-04-25T22:53:18.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.659 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:18.659 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013025+0000", 2024-04-25T22:53:18.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6760000000000004e-06 2024-04-25T22:53:18.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.659 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:18.659 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013163+0000", 2024-04-25T22:53:18.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013824599999999999 2024-04-25T22:53:18.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:18.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013504+0000", 2024-04-25T22:53:18.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034080299999999998 2024-04-25T22:53:18.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:18.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013613+0000", 2024-04-25T22:53:18.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108705 2024-04-25T22:53:18.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:18.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015831+0000", 2024-04-25T22:53:18.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002217672 2024-04-25T22:53:18.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:18.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024137+0000", 2024-04-25T22:53:18.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0083060489999999994 2024-04-25T22:53:18.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:18.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024218+0000", 2024-04-25T22:53:18.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1351000000000001e-05 2024-04-25T22:53:18.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:18.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024259+0000", 2024-04-25T22:53:18.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1112000000000002e-05 2024-04-25T22:53:18.662 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:18.662 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:18.662 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:18.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.662 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:18.662 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:18.662 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 85.557610683999997, 2024-04-25T22:53:18.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020379749999999999, 2024-04-25T22:53:18.662 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:18.662 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:18.663 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:18.663 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:18.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:18.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:18.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:18.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:18.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:18.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:18.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:18.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013098+0000", 2024-04-25T22:53:18.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:53:18.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:18.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013105+0000", 2024-04-25T22:53:18.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5969999999999997e-06 2024-04-25T22:53:18.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:18.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013190+0000", 2024-04-25T22:53:18.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5618999999999995e-05 2024-04-25T22:53:18.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:18.665 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013200+0000", 2024-04-25T22:53:18.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5859999999999994e-06 2024-04-25T22:53:18.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.665 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:18.665 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020265+0000", 2024-04-25T22:53:18.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070653349999999998 2024-04-25T22:53:18.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.665 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:18.665 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020454+0000", 2024-04-25T22:53:18.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189316 2024-04-25T22:53:18.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.666 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:18.666 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020586+0000", 2024-04-25T22:53:18.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013195700000000001 2024-04-25T22:53:18.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.666 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:18.666 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023822+0000", 2024-04-25T22:53:18.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032358529999999999 2024-04-25T22:53:18.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.666 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:18.666 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033409+0000", 2024-04-25T22:53:18.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095870520000000004 2024-04-25T22:53:18.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:18.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033447+0000", 2024-04-25T22:53:18.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7261999999999997e-05 2024-04-25T22:53:18.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:18.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033477+0000", 2024-04-25T22:53:18.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0389e-05 2024-04-25T22:53:18.667 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:18.667 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:18.667 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:18.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.668 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:18.668 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:18.668 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 85.557494177999999, 2024-04-25T22:53:18.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010857383999999999, 2024-04-25T22:53:18.668 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:18.668 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:18.668 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:18.668 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:18.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:18.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:18.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:18.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:18.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:18.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:18.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:18.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:18.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:18.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:18.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013218+0000", 2024-04-25T22:53:18.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8199999999999998e-06 2024-04-25T22:53:18.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:18.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013226+0000", 2024-04-25T22:53:18.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7649999999999993e-06 2024-04-25T22:53:18.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:18.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013259+0000", 2024-04-25T22:53:18.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2727e-05 2024-04-25T22:53:18.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:18.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014809+0000", 2024-04-25T22:53:18.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001550144 2024-04-25T22:53:18.671 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.671 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:18.671 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014958+0000", 2024-04-25T22:53:18.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014890300000000001 2024-04-25T22:53:18.671 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.671 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:18.671 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015087+0000", 2024-04-25T22:53:18.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012939200000000001 2024-04-25T22:53:18.671 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:18.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020212+0000", 2024-04-25T22:53:18.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051248939999999996 2024-04-25T22:53:18.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:18.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023699+0000", 2024-04-25T22:53:18.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034873289999999999 2024-04-25T22:53:18.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:18.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024014+0000", 2024-04-25T22:53:18.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031473999999999999 2024-04-25T22:53:18.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:18.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024071+0000", 2024-04-25T22:53:18.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7040000000000003e-05 2024-04-25T22:53:18.673 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:18.673 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:18.673 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:18.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.673 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:18.673 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:18.673 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 85.557439473000002, 2024-04-25T22:53:18.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012329677000000001, 2024-04-25T22:53:18.673 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:18.673 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:18.673 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:18.674 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:18.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:18.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:18.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:18.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:18.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:18.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:18.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:18.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013269+0000", 2024-04-25T22:53:18.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5000000000000002e-07 2024-04-25T22:53:18.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:18.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:18.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6909999999999999e-06 2024-04-25T22:53:18.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:18.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013284+0000", 2024-04-25T22:53:18.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0963e-05 2024-04-25T22:53:18.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:18.676 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013361+0000", 2024-04-25T22:53:18.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7379999999999994e-05 2024-04-25T22:53:18.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.676 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:18.676 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013448+0000", 2024-04-25T22:53:18.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6990000000000006e-05 2024-04-25T22:53:18.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.676 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:18.676 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013632+0000", 2024-04-25T22:53:18.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018396800000000001 2024-04-25T22:53:18.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.676 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:18.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013800+0000", 2024-04-25T22:53:18.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167467 2024-04-25T22:53:18.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:18.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.018570+0000", 2024-04-25T22:53:18.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047701460000000003 2024-04-25T22:53:18.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:18.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025507+0000", 2024-04-25T22:53:18.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069372039999999998 2024-04-25T22:53:18.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:18.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025562+0000", 2024-04-25T22:53:18.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4858999999999998e-05 2024-04-25T22:53:18.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:18.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025598+0000", 2024-04-25T22:53:18.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6259e-05 2024-04-25T22:53:18.678 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:18.678 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:18.678 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:18.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.678 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:18.679 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:18.679 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 85.557307600000001, 2024-04-25T22:53:18.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020176666999999999, 2024-04-25T22:53:18.679 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:18.679 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:18.679 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:53:18.679 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:18.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:18.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:18.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:18.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:18.680 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:18.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:18.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.680 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:18.680 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:18.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-04-25T22:53:18.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.680 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:18.680 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013405+0000", 2024-04-25T22:53:18.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0559999999999998e-06 2024-04-25T22:53:18.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:18.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013422+0000", 2024-04-25T22:53:18.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6770999999999999e-05 2024-04-25T22:53:18.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:18.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013431+0000", 2024-04-25T22:53:18.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5019999999999998e-06 2024-04-25T22:53:18.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:18.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021720+0000", 2024-04-25T22:53:18.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082884340000000008 2024-04-25T22:53:18.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:18.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022122+0000", 2024-04-25T22:53:18.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000401634 2024-04-25T22:53:18.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:18.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:18.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:18.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033577+0000", 2024-04-25T22:53:18.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011455435999999999 2024-04-25T22:53:18.682 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:18.682 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:18.682 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:18.682 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:18.683 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:18.683 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:18.684 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:18.685 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:18.684+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:18.785 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:18.785+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:18.794 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:18.794 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:18.794 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-25T22:53:18.794 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:18.804 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:18.885 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:18.885+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:18.908 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:18.909 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:18.909 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-25T22:53:18.909 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-25T22:53:18.909 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:18.918 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:18.986 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:18.986+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:19.022 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:19.022 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:53:19.022 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:53:19.022 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:53:19.022 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.022 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:53:19.022 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:19.022 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 91.053098743999996, 2024-04-25T22:53:19.022 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:53:19.022 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:19.023 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:19.023 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:19.023 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:19.023 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.023 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:19.023 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:19.023 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:19.023 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.023 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.023 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:19.023 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:19.023 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:19.023 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.023 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.024 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:19.024 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:53:19.024 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:53:19.024 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.024 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.024 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:19.024 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:53:19.024 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:53:19.024 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.024 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.024 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:19.024 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:53:19.024 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:53:19.024 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.025 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.025 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:19.025 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:53:19.025 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:53:19.025 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.025 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.025 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:19.025 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:53:19.025 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:53:19.025 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.025 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.025 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:19.025 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:53:19.025 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:53:19.025 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.026 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.026 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:19.026 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:53:19.026 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:53:19.026 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.026 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.026 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:19.026 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:53:19.026 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:53:19.026 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:19.026 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:19.026 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:19.026 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.026 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.027 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:110 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'72, mlcod=10'68)", 2024-04-25T22:53:19.027 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:19.027 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 91.052464744000005, 2024-04-25T22:53:19.027 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065316630000000001, 2024-04-25T22:53:19.027 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:19.027 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:19.027 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:19.027 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:19.027 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.027 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:19.027 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:19.027 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:19.027 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.027 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.028 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:19.028 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:19.028 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:19.028 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.028 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.028 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:19.028 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:19.028 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.58e-07 2024-04-25T22:53:19.028 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.028 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.028 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:19.028 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967811+0000", 2024-04-25T22:53:19.028 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.118e-06 2024-04-25T22:53:19.028 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.029 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.029 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:19.029 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967817+0000", 2024-04-25T22:53:19.029 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3709999999999996e-06 2024-04-25T22:53:19.029 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.029 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.029 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:19.029 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967820+0000", 2024-04-25T22:53:19.029 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2210000000000002e-06 2024-04-25T22:53:19.029 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.029 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.029 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:19.029 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967876+0000", 2024-04-25T22:53:19.029 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5507000000000002e-05 2024-04-25T22:53:19.029 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.030 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.030 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:19.030 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967893+0000", 2024-04-25T22:53:19.030 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7812000000000002e-05 2024-04-25T22:53:19.030 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.030 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.030 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:19.030 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974317+0000", 2024-04-25T22:53:19.030 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064237160000000003 2024-04-25T22:53:19.030 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.030 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.030 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:19.030 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:53:19.030 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.156e-05 2024-04-25T22:53:19.031 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:19.031 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:19.031 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:19.031 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.031 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.031 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'68)", 2024-04-25T22:53:19.031 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:19.031 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 91.052047231000003, 2024-04-25T22:53:19.031 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061292279999999996, 2024-04-25T22:53:19.031 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:19.031 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:19.031 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:19.031 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:19.031 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.032 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:19.032 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:19.032 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:19.032 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.032 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.032 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:19.032 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:19.032 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:19.032 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.032 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.032 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:19.032 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:19.032 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6300000000000001e-07 2024-04-25T22:53:19.032 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.033 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.033 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:19.033 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968228+0000", 2024-04-25T22:53:19.033 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6139999999999999e-06 2024-04-25T22:53:19.033 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.033 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.033 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:19.033 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968235+0000", 2024-04-25T22:53:19.033 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7020000000000001e-06 2024-04-25T22:53:19.033 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.033 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.033 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:19.033 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968238+0000", 2024-04-25T22:53:19.033 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0010000000000002e-06 2024-04-25T22:53:19.033 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.034 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.034 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:19.034 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968297+0000", 2024-04-25T22:53:19.034 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8424999999999997e-05 2024-04-25T22:53:19.034 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.034 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.034 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:19.034 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968316+0000", 2024-04-25T22:53:19.034 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8814999999999999e-05 2024-04-25T22:53:19.034 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.034 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.034 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:19.034 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:53:19.034 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060239439999999998 2024-04-25T22:53:19.035 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.035 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.035 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:19.035 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974354+0000", 2024-04-25T22:53:19.035 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4364e-05 2024-04-25T22:53:19.035 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:19.035 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:19.035 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:19.035 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.035 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.035 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'68)", 2024-04-25T22:53:19.035 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:19.035 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 91.051610229000005, 2024-04-25T22:53:19.035 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005948414, 2024-04-25T22:53:19.036 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:19.036 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:19.036 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:19.036 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:19.036 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.036 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:19.036 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:19.036 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:19.036 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.036 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.036 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:19.036 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:19.036 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:19.036 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.037 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.037 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:19.037 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:19.037 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6199999999999998e-07 2024-04-25T22:53:19.037 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.037 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.037 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:19.037 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968723+0000", 2024-04-25T22:53:19.037 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1148999999999993e-05 2024-04-25T22:53:19.037 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.037 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.037 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:19.037 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968730+0000", 2024-04-25T22:53:19.037 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1749999999999999e-06 2024-04-25T22:53:19.038 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.038 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.038 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:19.038 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968734+0000", 2024-04-25T22:53:19.038 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5200000000000002e-06 2024-04-25T22:53:19.038 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.038 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.038 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:19.038 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968771+0000", 2024-04-25T22:53:19.038 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6851999999999999e-05 2024-04-25T22:53:19.038 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.038 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.038 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:19.038 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968788+0000", 2024-04-25T22:53:19.039 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7027000000000001e-05 2024-04-25T22:53:19.039 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.039 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.039 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:19.039 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974589+0000", 2024-04-25T22:53:19.039 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058013320000000002 2024-04-25T22:53:19.039 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.039 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.039 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:19.039 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974610+0000", 2024-04-25T22:53:19.039 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0897e-05 2024-04-25T22:53:19.039 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:19.039 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:19.039 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:19.040 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.040 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.040 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'68)", 2024-04-25T22:53:19.040 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:19.040 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 91.051040219000001, 2024-04-25T22:53:19.040 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053935750000000003, 2024-04-25T22:53:19.040 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:19.040 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:19.040 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:19.040 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:19.040 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.040 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:19.040 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:19.040 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:19.041 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.041 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.041 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:19.041 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:19.041 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:19.041 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.041 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.041 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:19.041 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:19.041 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.03e-07 2024-04-25T22:53:19.041 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.041 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.041 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:19.041 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969235+0000", 2024-04-25T22:53:19.042 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2399999999999999e-06 2024-04-25T22:53:19.042 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.042 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.042 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:19.042 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969242+0000", 2024-04-25T22:53:19.042 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1269999999999997e-06 2024-04-25T22:53:19.042 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.042 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.042 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:19.042 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969246+0000", 2024-04-25T22:53:19.042 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3840000000000001e-06 2024-04-25T22:53:19.042 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.042 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.042 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:19.043 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969278+0000", 2024-04-25T22:53:19.043 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1868e-05 2024-04-25T22:53:19.043 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.043 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.043 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:19.043 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969295+0000", 2024-04-25T22:53:19.043 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7530999999999999e-05 2024-04-25T22:53:19.043 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.043 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.043 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:19.043 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974611+0000", 2024-04-25T22:53:19.043 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053160789999999996 2024-04-25T22:53:19.043 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.043 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.044 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:19.044 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974625+0000", 2024-04-25T22:53:19.044 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3943e-05 2024-04-25T22:53:19.044 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:19.044 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:19.044 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:19.044 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.044 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.044 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-25T22:53:19.044 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:19.044 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 90.857444310999995, 2024-04-25T22:53:19.044 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054952610000000004, 2024-04-25T22:53:19.044 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:19.044 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:19.044 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:19.045 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:19.045 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.045 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:19.045 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:19.045 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:19.045 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.045 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.045 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:19.045 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:19.045 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:19.045 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.045 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.045 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:19.045 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:19.046 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.68e-07 2024-04-25T22:53:19.046 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.046 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.046 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:19.046 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162898+0000", 2024-04-25T22:53:19.046 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9470999999999999e-05 2024-04-25T22:53:19.046 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.046 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.046 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:19.046 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162906+0000", 2024-04-25T22:53:19.046 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1580000000000005e-06 2024-04-25T22:53:19.046 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.046 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.046 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:19.047 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162911+0000", 2024-04-25T22:53:19.047 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4779999999999999e-06 2024-04-25T22:53:19.047 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.047 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.047 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:19.047 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162952+0000", 2024-04-25T22:53:19.047 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0629e-05 2024-04-25T22:53:19.047 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.047 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.047 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:19.047 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162968+0000", 2024-04-25T22:53:19.047 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6239000000000002e-05 2024-04-25T22:53:19.047 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.047 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.048 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:19.048 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168281+0000", 2024-04-25T22:53:19.048 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053132869999999999 2024-04-25T22:53:19.048 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.048 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.048 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:19.048 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168323+0000", 2024-04-25T22:53:19.048 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1430999999999997e-05 2024-04-25T22:53:19.048 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:19.048 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:19.048 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:19.048 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.048 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.048 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-04-25T22:53:19.048 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:19.049 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 90.426966949000004, 2024-04-25T22:53:19.049 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050872510000000001, 2024-04-25T22:53:19.049 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:19.049 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:19.049 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:19.049 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:19.049 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.049 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:19.049 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:19.049 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:19.049 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.049 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.049 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:19.049 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:19.050 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:19.050 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.050 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.050 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:19.050 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:19.050 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.72e-07 2024-04-25T22:53:19.050 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.050 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.050 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:19.050 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593381+0000", 2024-04-25T22:53:19.050 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5797000000000006e-05 2024-04-25T22:53:19.050 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.050 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.051 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:19.051 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593389+0000", 2024-04-25T22:53:19.051 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8480000000000001e-06 2024-04-25T22:53:19.051 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.051 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.051 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:19.051 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593393+0000", 2024-04-25T22:53:19.051 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4819999999999996e-06 2024-04-25T22:53:19.051 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.051 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.051 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:19.051 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593435+0000", 2024-04-25T22:53:19.051 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1600000000000002e-05 2024-04-25T22:53:19.051 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.051 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.052 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:19.052 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593454+0000", 2024-04-25T22:53:19.052 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8868e-05 2024-04-25T22:53:19.052 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.052 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.052 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:19.052 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598350+0000", 2024-04-25T22:53:19.052 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004895763 2024-04-25T22:53:19.052 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.052 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.052 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:19.052 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598392+0000", 2024-04-25T22:53:19.052 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2521000000000002e-05 2024-04-25T22:53:19.052 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:19.053 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:19.053 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:19.053 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.053 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.053 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:19.053 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:19.053 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 86.008603045000001, 2024-04-25T22:53:19.053 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:53:19.053 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:19.053 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:19.053 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:19.053 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:19.053 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.053 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:19.054 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:19.054 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:19.054 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.054 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.054 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:19.054 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:19.054 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:19.054 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.054 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.054 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:19.054 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:53:19.054 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:53:19.054 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.054 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.055 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:19.055 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:53:19.055 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:53:19.055 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.055 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.055 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:19.055 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:53:19.055 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:53:19.055 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.055 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.055 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:19.055 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:53:19.055 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:53:19.055 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.056 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.056 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:19.056 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:53:19.056 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:53:19.056 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.056 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.056 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:19.056 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:53:19.056 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:53:19.056 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.056 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.056 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:19.056 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:53:19.056 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:53:19.056 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.057 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.057 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:19.057 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:53:19.057 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:53:19.057 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.057 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.057 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:19.057 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:53:19.057 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:53:19.057 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.057 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.057 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:19.057 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:53:19.057 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:53:19.058 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.058 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.058 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:19.058 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:53:19.058 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:53:19.058 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:19.058 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:19.058 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:19.058 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.058 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.058 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:19.058 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:19.058 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 86.007928668999995, 2024-04-25T22:53:19.058 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:53:19.059 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:19.059 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:19.059 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:19.059 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:19.059 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.059 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:19.059 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:19.059 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:19.059 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.059 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.059 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:19.059 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:19.059 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:19.059 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.059 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.060 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:19.060 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:53:19.060 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:53:19.060 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.060 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.060 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:19.060 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:53:19.060 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:53:19.060 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.060 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.060 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:19.060 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:53:19.060 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:53:19.060 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.061 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.061 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:19.061 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:53:19.061 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:53:19.061 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.061 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.061 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:19.061 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:53:19.061 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:53:19.061 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.061 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.061 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:19.061 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:53:19.061 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:53:19.061 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.062 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.062 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:19.062 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:53:19.062 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:53:19.062 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.062 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.062 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:19.062 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:53:19.062 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:53:19.062 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.062 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.062 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:19.062 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:53:19.062 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:53:19.063 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.063 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.063 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:19.063 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:53:19.063 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:53:19.063 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.063 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.063 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:19.063 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:53:19.063 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:53:19.063 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:19.063 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:19.063 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:19.063 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.064 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.064 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:19.064 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:19.064 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 86.007419456999997, 2024-04-25T22:53:19.064 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:53:19.064 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:19.064 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:19.064 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:19.064 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:19.064 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.064 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:19.064 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:19.064 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:19.064 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.065 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.065 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:19.065 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:19.065 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:19.065 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.065 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.065 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:19.065 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:53:19.065 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:53:19.065 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.065 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.065 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:19.065 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:53:19.065 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:53:19.066 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.066 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.066 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:19.066 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:53:19.066 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:53:19.066 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.066 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.066 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:19.066 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:53:19.066 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:53:19.066 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.066 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.066 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:19.066 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:53:19.067 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:53:19.067 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.067 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.067 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:19.067 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:53:19.067 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:53:19.067 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.067 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.067 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:19.067 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:53:19.067 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:53:19.067 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.067 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.067 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:19.068 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:53:19.068 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:53:19.068 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.068 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.068 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:19.068 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:53:19.068 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:53:19.068 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.068 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.068 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:19.068 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:53:19.068 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:53:19.068 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.068 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.069 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:19.069 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:53:19.069 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:53:19.069 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:19.069 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:19.069 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:19.069 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.069 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.069 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:19.069 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:19.069 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 86.007006258999994, 2024-04-25T22:53:19.069 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:53:19.069 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:19.069 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:19.069 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:19.070 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:19.070 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.070 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:19.070 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:19.070 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:19.070 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.070 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.070 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:19.070 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:19.070 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:19.070 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.070 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.070 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:19.070 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:19.071 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:53:19.071 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.071 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.071 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:19.071 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:19.071 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:53:19.071 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.071 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.071 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:19.071 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:53:19.071 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:53:19.071 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.071 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.071 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:19.072 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:53:19.072 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:53:19.072 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.072 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.072 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:19.072 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:53:19.072 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:53:19.072 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.072 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.072 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:19.072 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:53:19.072 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:53:19.072 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.072 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.072 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:19.073 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:53:19.073 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:53:19.073 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.073 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.073 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:19.073 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:53:19.073 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:53:19.073 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.073 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.073 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:19.073 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:53:19.073 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:53:19.073 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.073 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.074 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:19.074 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:53:19.074 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:53:19.074 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.074 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.074 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:19.074 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:53:19.074 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:53:19.074 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:19.074 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:19.074 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:19.074 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.074 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.074 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:19.075 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:19.075 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 86.006955589, 2024-04-25T22:53:19.075 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:53:19.075 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:19.075 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:19.075 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:19.075 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:19.075 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.075 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:19.075 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:19.075 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:19.075 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.075 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.075 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:19.075 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:19.076 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:19.076 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.076 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.076 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:19.076 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:53:19.076 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:53:19.076 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.076 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.076 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:19.076 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:53:19.076 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:53:19.076 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.076 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.077 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:19.077 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:53:19.077 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:53:19.077 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.077 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.077 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:19.077 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:53:19.077 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:53:19.077 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.077 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.077 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:19.077 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:53:19.077 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:53:19.077 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.077 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.078 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:19.078 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:53:19.078 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:53:19.078 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.078 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.078 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:19.078 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:53:19.078 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:53:19.078 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.078 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.078 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:19.078 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:53:19.078 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:53:19.079 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.079 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.079 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:19.079 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:53:19.079 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:53:19.079 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.079 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.079 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:19.079 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:53:19.079 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:53:19.079 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.079 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.079 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:19.079 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:53:19.079 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:53:19.080 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.080 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.080 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:19.080 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:53:19.080 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:53:19.080 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.080 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.080 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:19.080 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:53:19.080 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:53:19.080 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:19.080 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:19.080 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:19.080 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.081 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.081 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:19.081 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:19.081 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 86.006918720000002, 2024-04-25T22:53:19.081 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:53:19.081 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:19.081 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:19.081 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:19.081 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:19.081 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.081 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:19.081 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:19.081 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:19.081 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.082 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.082 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:19.082 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:19.082 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:19.082 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.082 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.082 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:19.082 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:53:19.082 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:53:19.082 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.082 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.082 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:19.082 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:53:19.082 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:53:19.083 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.083 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.083 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:19.083 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:53:19.083 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:53:19.083 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.083 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.083 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:19.083 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:53:19.083 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:53:19.083 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.083 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.083 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:19.083 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:53:19.084 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:53:19.084 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.084 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.084 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:53:19.084 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:53:19.084 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:53:19.084 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.084 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.084 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:19.084 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:53:19.084 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:53:19.084 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.084 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.084 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:19.085 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:53:19.085 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:53:19.085 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.085 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.085 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:19.085 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:53:19.085 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:53:19.085 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.085 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.085 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:19.085 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:53:19.085 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:53:19.085 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.085 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.085 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:19.086 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:53:19.086 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:53:19.086 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.086 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.086 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:19.086 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:53:19.086 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:53:19.086 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.086 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.086 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:19.086 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:53:19.086 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:53:19.086 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:19.086 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:19.087 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:19.087 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.087 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.087 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:19.087 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:19.087 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 86.006893754000004, 2024-04-25T22:53:19.087 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:53:19.087 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:19.087 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:19.087 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:19.087 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:19.087 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.087 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:19.087 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:19.088 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:19.088 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.088 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.088 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:19.088 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:19.088 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:19.088 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.088 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.088 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:19.088 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:53:19.088 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:53:19.088 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.088 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.088 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:19.088 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:53:19.089 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:53:19.089 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.089 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.089 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:19.089 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:19.089 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:53:19.089 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.089 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.089 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:19.089 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:53:19.089 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:53:19.089 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.089 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.089 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:19.090 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:53:19.090 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:53:19.090 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.090 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.090 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:19.090 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:53:19.090 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:53:19.090 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.090 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.090 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:19.090 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:53:19.090 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:53:19.090 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.091 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.091 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:19.091 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:53:19.091 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:53:19.091 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.091 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.091 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:19.091 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:53:19.091 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:53:19.091 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.091 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.091 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:19.091 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:53:19.091 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:53:19.092 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.092 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.092 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:19.092 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:53:19.092 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:53:19.092 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:19.092 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:19.092 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:19.092 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.092 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.092 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:19.092 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:19.092 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 86.006857389999993, 2024-04-25T22:53:19.092 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:53:19.093 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:19.093 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:19.093 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:19.093 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:19.093 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.093 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:19.093 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:19.093 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:19.093 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.093 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.093 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:19.093 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:19.093 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:19.093 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.094 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.094 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:19.094 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:53:19.094 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:53:19.094 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.094 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.094 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:19.094 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:53:19.094 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:53:19.094 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.094 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.094 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:19.094 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:53:19.094 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:53:19.095 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.095 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.095 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:19.095 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:53:19.095 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:53:19.095 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.095 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.095 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:19.095 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:53:19.095 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:53:19.095 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.095 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.095 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:19.095 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:53:19.096 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:53:19.096 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.096 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.096 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:19.096 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:53:19.096 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:53:19.096 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.096 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.096 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:19.096 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:53:19.096 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:53:19.096 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.096 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.096 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:19.097 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:53:19.097 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:53:19.097 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:19.097 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:19.097 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:19.097 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.097 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.097 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:19.097 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:19.097 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 86.006826309000004, 2024-04-25T22:53:19.097 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:53:19.097 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:19.097 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:19.097 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:19.098 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:19.098 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.098 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:19.098 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:19.098 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:19.098 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.098 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.098 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:19.098 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:19.098 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:19.098 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.098 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.098 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:19.098 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:19.099 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:19.099 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.099 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.099 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:19.099 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:53:19.099 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:53:19.099 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.099 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.099 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:19.099 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:53:19.099 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:53:19.099 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.099 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.099 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:19.100 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:53:19.100 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:53:19.100 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.100 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.100 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:19.100 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:53:19.100 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:53:19.100 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.100 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.100 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:19.100 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:53:19.100 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:53:19.100 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.100 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.100 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:19.101 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:53:19.101 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:53:19.101 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:19.101 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:19.101 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:19.101 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.101 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.101 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:53:19.101 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:19.101 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 86.006385339999994, 2024-04-25T22:53:19.101 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064881979999999997, 2024-04-25T22:53:19.101 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:19.101 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:19.101 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:19.102 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:19.102 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.102 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:19.102 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:19.102 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:19.102 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.102 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.102 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:19.102 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:19.102 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:19.102 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.102 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.102 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:19.102 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:19.102 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2699999999999999e-07 2024-04-25T22:53:19.103 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.103 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.103 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:19.103 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013898+0000", 2024-04-25T22:53:19.103 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0796e-05 2024-04-25T22:53:19.103 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.103 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.103 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:19.103 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013907+0000", 2024-04-25T22:53:19.103 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5140000000000007e-06 2024-04-25T22:53:19.103 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.103 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.103 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:19.103 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013952+0000", 2024-04-25T22:53:19.104 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4134000000000001e-05 2024-04-25T22:53:19.104 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.104 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.104 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:19.104 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016812+0000", 2024-04-25T22:53:19.104 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028601059999999998 2024-04-25T22:53:19.104 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.104 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.104 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:19.104 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.017052+0000", 2024-04-25T22:53:19.104 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024056500000000001 2024-04-25T22:53:19.104 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.104 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.104 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:19.105 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020350+0000", 2024-04-25T22:53:19.105 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032978320000000001 2024-04-25T22:53:19.105 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.105 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.105 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:19.105 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020375+0000", 2024-04-25T22:53:19.105 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4624e-05 2024-04-25T22:53:19.105 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:19.105 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:19.105 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:19.105 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.105 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.105 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-25T22:53:19.105 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:19.106 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 85.992854894000004, 2024-04-25T22:53:19.106 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058583000000000003, 2024-04-25T22:53:19.106 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:19.106 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:19.106 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:19.106 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:19.106 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.106 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:19.106 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:19.106 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:19.106 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.106 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.106 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:19.106 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:19.107 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:19.107 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.107 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.107 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:19.107 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:19.107 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.41e-07 2024-04-25T22:53:19.107 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.107 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.107 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:19.107 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027428+0000", 2024-04-25T22:53:19.107 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.075e-05 2024-04-25T22:53:19.107 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.107 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.107 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:19.108 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027435+0000", 2024-04-25T22:53:19.108 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3610000000000003e-06 2024-04-25T22:53:19.108 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.108 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.108 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:19.108 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027442+0000", 2024-04-25T22:53:19.108 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0400000000000004e-06 2024-04-25T22:53:19.108 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.108 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.108 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:19.108 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028094+0000", 2024-04-25T22:53:19.108 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00065134800000000005 2024-04-25T22:53:19.108 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.108 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.108 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:19.109 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028107+0000", 2024-04-25T22:53:19.109 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3087e-05 2024-04-25T22:53:19.109 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.109 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.109 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:19.109 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033239+0000", 2024-04-25T22:53:19.109 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051319429999999999 2024-04-25T22:53:19.109 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.109 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.109 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:19.109 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033275+0000", 2024-04-25T22:53:19.109 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6430000000000002e-05 2024-04-25T22:53:19.109 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:19.109 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:19.110 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:19.110 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.110 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.110 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-25T22:53:19.110 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:19.110 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 85.992470057000006, 2024-04-25T22:53:19.110 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005413597, 2024-04-25T22:53:19.110 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:19.110 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:19.110 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:19.110 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:19.110 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.110 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:19.110 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:19.111 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:19.111 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.111 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.111 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:19.111 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:19.111 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:19.111 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.111 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.111 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:19.111 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:19.111 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3799999999999997e-07 2024-04-25T22:53:19.111 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.111 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.111 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:19.111 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027816+0000", 2024-04-25T22:53:19.112 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3230999999999999e-05 2024-04-25T22:53:19.112 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.112 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.112 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:19.112 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027823+0000", 2024-04-25T22:53:19.112 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9039999999999992e-06 2024-04-25T22:53:19.112 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.112 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.112 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:19.112 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027841+0000", 2024-04-25T22:53:19.112 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7651000000000001e-05 2024-04-25T22:53:19.112 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.112 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.112 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:19.113 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027904+0000", 2024-04-25T22:53:19.113 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3058000000000005e-05 2024-04-25T22:53:19.113 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.113 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.113 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:19.113 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027926+0000", 2024-04-25T22:53:19.113 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1450999999999998e-05 2024-04-25T22:53:19.113 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.113 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.113 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:19.113 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033177+0000", 2024-04-25T22:53:19.113 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052508909999999997 2024-04-25T22:53:19.113 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.113 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.113 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:19.114 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033215+0000", 2024-04-25T22:53:19.114 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8872999999999999e-05 2024-04-25T22:53:19.114 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:19.114 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:19.114 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:19.114 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.114 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.114 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 171 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:53:19.114 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:19.114 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 85.992412955000006, 2024-04-25T22:53:19.114 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054322240000000003, 2024-04-25T22:53:19.114 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:19.114 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:19.114 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "reached pg", 2024-04-25T22:53:19.115 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:19.115 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.115 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:19.115 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:19.115 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:19.115 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.115 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.115 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:19.115 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:19.115 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:19.115 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.115 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.115 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:19.115 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:19.116 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7500000000000001e-07 2024-04-25T22:53:19.116 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.116 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.116 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:19.116 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027868+0000", 2024-04-25T22:53:19.116 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5750000000000001e-06 2024-04-25T22:53:19.116 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.116 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.116 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:19.116 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027885+0000", 2024-04-25T22:53:19.116 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7272e-05 2024-04-25T22:53:19.116 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.116 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.116 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:19.116 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027900+0000", 2024-04-25T22:53:19.117 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.502e-05 2024-04-25T22:53:19.117 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.117 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.117 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:19.117 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028381+0000", 2024-04-25T22:53:19.117 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00048039399999999998 2024-04-25T22:53:19.117 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.117 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.117 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:19.117 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033291+0000", 2024-04-25T22:53:19.117 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049105879999999996 2024-04-25T22:53:19.117 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:19.117 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:19.117 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:19.118 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:19.118 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:19.118 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:19.119 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:19.118+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:19.119 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:19.220 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:19.219+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:19.223 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:19.224 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:19.224 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-04-25T22:53:19.224 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:19.232 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:19.322 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:19.321+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:19.374 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:19.374 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:19.374 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:53:19.375 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:53:19.375 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:19.383 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:19.423 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:19.423+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:19.489 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:19.489 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-04-25T22:53:19.489 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-04-25T22:53:19.489 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:53:19.489 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.489 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:19.489 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:19.489 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 91.520887833000003, 2024-04-25T22:53:19.489 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0103421, 2024-04-25T22:53:19.489 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:19.490 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:19.490 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:19.490 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:19.490 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:19.490 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:19.490 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 115 2024-04-25T22:53:19.490 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.490 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:19.490 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.491 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:19.491 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:19.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:19.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.491 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:19.491 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:19.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:19.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.491 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:19.492 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:19.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9500000000000002e-07 2024-04-25T22:53:19.492 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.492 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.492 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:19.492 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965108+0000", 2024-04-25T22:53:19.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9177999999999994e-05 2024-04-25T22:53:19.492 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.492 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.492 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:19.493 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965127+0000", 2024-04-25T22:53:19.493 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8868e-05 2024-04-25T22:53:19.493 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.493 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.493 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:19.493 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965133+0000", 2024-04-25T22:53:19.493 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8929999999999999e-06 2024-04-25T22:53:19.493 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.493 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.493 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:19.494 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.969991+0000", 2024-04-25T22:53:19.494 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048573849999999997 2024-04-25T22:53:19.494 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.494 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.494 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:19.494 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970072+0000", 2024-04-25T22:53:19.495 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0728000000000004e-05 2024-04-25T22:53:19.495 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.495 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.495 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:19.495 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970189+0000", 2024-04-25T22:53:19.495 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000117778 2024-04-25T22:53:19.495 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.495 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.495 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:19.495 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970946+0000", 2024-04-25T22:53:19.496 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00075704600000000004 2024-04-25T22:53:19.496 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.496 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.496 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:19.496 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975297+0000", 2024-04-25T22:53:19.496 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004350217 2024-04-25T22:53:19.496 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.496 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.496 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:19.496 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975343+0000", 2024-04-25T22:53:19.496 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6687999999999998e-05 2024-04-25T22:53:19.497 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.497 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.497 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:19.497 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975380+0000", 2024-04-25T22:53:19.497 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6724000000000003e-05 2024-04-25T22:53:19.497 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:19.497 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:19.497 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:19.497 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.497 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.498 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:19.498 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:19.498 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 91.520781802000002, 2024-04-25T22:53:19.498 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010304384, 2024-04-25T22:53:19.498 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:19.498 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:19.498 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:19.498 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:19.498 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:19.498 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:19.498 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 116 2024-04-25T22:53:19.498 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.499 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:19.499 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.499 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:19.499 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:19.499 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:19.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.499 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.499 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:19.499 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:19.499 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:19.500 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.500 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.500 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:19.500 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:19.500 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5799999999999999e-07 2024-04-25T22:53:19.500 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.500 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.500 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:19.500 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965154+0000", 2024-04-25T22:53:19.500 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0009e-05 2024-04-25T22:53:19.501 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.501 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.501 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:19.501 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965164+0000", 2024-04-25T22:53:19.501 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8490000000000001e-06 2024-04-25T22:53:19.501 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.501 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.501 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:19.501 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965169+0000", 2024-04-25T22:53:19.502 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0730000000000004e-06 2024-04-25T22:53:19.502 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.502 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.502 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:19.502 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970609+0000", 2024-04-25T22:53:19.502 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054397689999999997 2024-04-25T22:53:19.502 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.502 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.502 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:19.502 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970651+0000", 2024-04-25T22:53:19.502 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1873999999999999e-05 2024-04-25T22:53:19.503 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.503 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.503 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:19.503 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970723+0000", 2024-04-25T22:53:19.503 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2039999999999995e-05 2024-04-25T22:53:19.503 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.503 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.503 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:19.503 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971358+0000", 2024-04-25T22:53:19.503 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063489500000000001 2024-04-25T22:53:19.503 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.504 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.504 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:19.504 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975409+0000", 2024-04-25T22:53:19.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040506880000000002 2024-04-25T22:53:19.504 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.504 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.504 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:19.504 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975432+0000", 2024-04-25T22:53:19.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3315999999999998e-05 2024-04-25T22:53:19.504 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.505 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.505 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:19.505 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975448+0000", 2024-04-25T22:53:19.505 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6313000000000001e-05 2024-04-25T22:53:19.505 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:19.505 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:19.505 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:19.505 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.505 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.505 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:19.505 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:19.506 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 91.520747220000004, 2024-04-25T22:53:19.506 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010384338999999999, 2024-04-25T22:53:19.506 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:19.506 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:19.506 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:19.506 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:19.506 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:19.506 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:19.506 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-04-25T22:53:19.506 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.507 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:19.507 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.507 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:19.507 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:19.507 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:19.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.507 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.507 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:19.507 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:19.507 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:19.508 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.508 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.508 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:19.508 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:19.508 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3600000000000004e-07 2024-04-25T22:53:19.508 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.508 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.508 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:19.508 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965185+0000", 2024-04-25T22:53:19.508 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.117e-06 2024-04-25T22:53:19.508 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.509 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.509 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:19.509 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965192+0000", 2024-04-25T22:53:19.509 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3239999999999997e-06 2024-04-25T22:53:19.509 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.509 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.509 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:19.509 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965198+0000", 2024-04-25T22:53:19.509 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6370000000000004e-06 2024-04-25T22:53:19.509 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.509 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.510 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:19.510 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970973+0000", 2024-04-25T22:53:19.510 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057748239999999996 2024-04-25T22:53:19.510 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.510 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.510 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:19.510 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971049+0000", 2024-04-25T22:53:19.511 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6029e-05 2024-04-25T22:53:19.511 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.511 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.511 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:19.511 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971174+0000", 2024-04-25T22:53:19.511 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012462399999999999 2024-04-25T22:53:19.511 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.511 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.511 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:19.511 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971553+0000", 2024-04-25T22:53:19.511 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037896499999999999 2024-04-25T22:53:19.511 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.512 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.512 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:19.512 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975482+0000", 2024-04-25T22:53:19.512 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039297459999999996 2024-04-25T22:53:19.512 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.512 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.512 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:19.512 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975529+0000", 2024-04-25T22:53:19.512 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6387000000000002e-05 2024-04-25T22:53:19.512 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.513 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:19.513 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975563+0000", 2024-04-25T22:53:19.513 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4150000000000003e-05 2024-04-25T22:53:19.513 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:19.513 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:19.513 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:19.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.513 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:19.513 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:19.514 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 86.473700897000001, 2024-04-25T22:53:19.514 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012637705000000001, 2024-04-25T22:53:19.514 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:19.514 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:19.514 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:19.514 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:19.514 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.514 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:19.514 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:19.514 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:19.514 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.515 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.515 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:19.515 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:19.515 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:19.515 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.515 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.515 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:19.515 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012227+0000", 2024-04-25T22:53:19.515 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.863e-06 2024-04-25T22:53:19.515 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.515 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.515 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:19.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012236+0000", 2024-04-25T22:53:19.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1109999999999997e-06 2024-04-25T22:53:19.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:19.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012309+0000", 2024-04-25T22:53:19.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3242000000000001e-05 2024-04-25T22:53:19.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:19.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012324+0000", 2024-04-25T22:53:19.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4837e-05 2024-04-25T22:53:19.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:19.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015060+0000", 2024-04-25T22:53:19.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027363349999999999 2024-04-25T22:53:19.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:19.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015169+0000", 2024-04-25T22:53:19.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108372 2024-04-25T22:53:19.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.518 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:19.518 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015498+0000", 2024-04-25T22:53:19.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032949999999999999 2024-04-25T22:53:19.518 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.518 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:19.518 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021282+0000", 2024-04-25T22:53:19.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057836429999999998 2024-04-25T22:53:19.518 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.518 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:19.519 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024709+0000", 2024-04-25T22:53:19.519 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034271979999999998 2024-04-25T22:53:19.519 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.519 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.519 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:19.519 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024802+0000", 2024-04-25T22:53:19.519 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2960000000000004e-05 2024-04-25T22:53:19.519 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.519 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.519 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:19.519 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024863+0000", 2024-04-25T22:53:19.520 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0643999999999997e-05 2024-04-25T22:53:19.520 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:19.520 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:19.520 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:19.520 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.520 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:19.520 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:19.520 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 86.473577125999995, 2024-04-25T22:53:19.520 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012979447999999999, 2024-04-25T22:53:19.520 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:19.520 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:19.520 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:19.521 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:19.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:19.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:19.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:19.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:19.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:19.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:19.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.522 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:19.522 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:19.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:53:19.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.522 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:19.522 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012354+0000", 2024-04-25T22:53:19.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7740000000000004e-06 2024-04-25T22:53:19.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.523 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.523 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:19.523 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012365+0000", 2024-04-25T22:53:19.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.064e-05 2024-04-25T22:53:19.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.523 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.523 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:19.523 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012382+0000", 2024-04-25T22:53:19.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6999000000000001e-05 2024-04-25T22:53:19.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.523 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.524 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:19.524 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015958+0000", 2024-04-25T22:53:19.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035765699999999998 2024-04-25T22:53:19.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.524 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:19.524 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016037+0000", 2024-04-25T22:53:19.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8242000000000001e-05 2024-04-25T22:53:19.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.524 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:19.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016404+0000", 2024-04-25T22:53:19.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036784300000000002 2024-04-25T22:53:19.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:19.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021294+0000", 2024-04-25T22:53:19.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048890629999999999 2024-04-25T22:53:19.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:19.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024959+0000", 2024-04-25T22:53:19.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036651570000000001 2024-04-25T22:53:19.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:19.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025097+0000", 2024-04-25T22:53:19.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013788099999999999 2024-04-25T22:53:19.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:19.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025328+0000", 2024-04-25T22:53:19.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231492 2024-04-25T22:53:19.527 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:19.527 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:19.527 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:19.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.527 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:19.527 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:19.527 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 86.473489357000005, 2024-04-25T22:53:19.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013049827, 2024-04-25T22:53:19.527 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:19.527 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:19.528 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:19.528 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:19.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.528 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:19.528 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:19.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:19.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.528 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:19.528 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:19.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:19.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:19.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012437+0000", 2024-04-25T22:53:19.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-04-25T22:53:19.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:19.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012440+0000", 2024-04-25T22:53:19.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7609999999999999e-06 2024-04-25T22:53:19.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:19.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012449+0000", 2024-04-25T22:53:19.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.285e-06 2024-04-25T22:53:19.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:19.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012457+0000", 2024-04-25T22:53:19.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9510000000000006e-06 2024-04-25T22:53:19.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:19.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017106+0000", 2024-04-25T22:53:19.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046494220000000003 2024-04-25T22:53:19.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:19.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017223+0000", 2024-04-25T22:53:19.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116824 2024-04-25T22:53:19.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:19.532 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017345+0000", 2024-04-25T22:53:19.532 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122175 2024-04-25T22:53:19.532 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.532 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.532 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:19.532 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021299+0000", 2024-04-25T22:53:19.532 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039534879999999998 2024-04-25T22:53:19.532 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.532 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.532 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:19.532 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025398+0000", 2024-04-25T22:53:19.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040988960000000003 2024-04-25T22:53:19.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.533 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:19.533 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025439+0000", 2024-04-25T22:53:19.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0915999999999999e-05 2024-04-25T22:53:19.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.533 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:19.533 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025486+0000", 2024-04-25T22:53:19.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7534999999999998e-05 2024-04-25T22:53:19.533 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:19.534 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:19.534 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:19.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.534 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:19.534 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:19.534 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 86.473459206000001, 2024-04-25T22:53:19.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020988041999999998, 2024-04-25T22:53:19.534 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:19.534 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:19.534 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:19.535 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:19.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:19.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:19.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:19.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:19.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:19.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:19.536 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.536 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:19.536 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:19.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.99e-07 2024-04-25T22:53:19.536 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.536 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:19.536 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012470+0000", 2024-04-25T22:53:19.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2789999999999999e-06 2024-04-25T22:53:19.536 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:19.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012477+0000", 2024-04-25T22:53:19.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:53:19.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:19.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012500+0000", 2024-04-25T22:53:19.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2490999999999999e-05 2024-04-25T22:53:19.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:19.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021911+0000", 2024-04-25T22:53:19.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094114160000000006 2024-04-25T22:53:19.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.538 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:19.538 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022000+0000", 2024-04-25T22:53:19.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8601000000000001e-05 2024-04-25T22:53:19.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.538 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:19.538 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022359+0000", 2024-04-25T22:53:19.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035921999999999999 2024-04-25T22:53:19.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:19.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025541+0000", 2024-04-25T22:53:19.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031820619999999998 2024-04-25T22:53:19.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:19.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033375+0000", 2024-04-25T22:53:19.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078338379999999992 2024-04-25T22:53:19.540 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.540 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:19.540 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033415+0000", 2024-04-25T22:53:19.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9527000000000003e-05 2024-04-25T22:53:19.540 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.540 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:19.540 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033455+0000", 2024-04-25T22:53:19.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9932000000000003e-05 2024-04-25T22:53:19.541 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:19.541 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:19.541 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:19.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.541 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.541 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:19.541 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:19.541 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 86.473404013000007, 2024-04-25T22:53:19.541 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021043857999999999, 2024-04-25T22:53:19.541 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:19.541 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:19.541 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:19.542 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:19.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.542 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:19.542 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:19.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:19.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.542 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:19.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:19.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:19.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:19.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012523+0000", 2024-04-25T22:53:19.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.361e-06 2024-04-25T22:53:19.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:19.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012530+0000", 2024-04-25T22:53:19.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5440000000000004e-06 2024-04-25T22:53:19.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:19.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012541+0000", 2024-04-25T22:53:19.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1745e-05 2024-04-25T22:53:19.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:19.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012551+0000", 2024-04-25T22:53:19.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5789999999999993e-06 2024-04-25T22:53:19.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.545 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:19.545 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022709+0000", 2024-04-25T22:53:19.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010157685 2024-04-25T22:53:19.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.545 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:19.545 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022957+0000", 2024-04-25T22:53:19.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024824599999999998 2024-04-25T22:53:19.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.546 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:19.546 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023443+0000", 2024-04-25T22:53:19.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048578599999999999 2024-04-25T22:53:19.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.546 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:19.546 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025547+0000", 2024-04-25T22:53:19.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021044789999999998 2024-04-25T22:53:19.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:19.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033509+0000", 2024-04-25T22:53:19.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0079622180000000001 2024-04-25T22:53:19.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:19.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033542+0000", 2024-04-25T22:53:19.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3018000000000001e-05 2024-04-25T22:53:19.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:19.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033566+0000", 2024-04-25T22:53:19.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3197000000000002e-05 2024-04-25T22:53:19.548 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:19.548 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:19.548 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:19.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.548 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:19.548 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:19.548 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 86.473364047999993, 2024-04-25T22:53:19.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021122696, 2024-04-25T22:53:19.548 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:19.548 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:19.549 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:19.549 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:19.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:19.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:19.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:19.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:19.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:19.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:19.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:19.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:19.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:53:19.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:19.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012566+0000", 2024-04-25T22:53:19.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-04-25T22:53:19.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:19.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012619+0000", 2024-04-25T22:53:19.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2607e-05 2024-04-25T22:53:19.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:19.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012628+0000", 2024-04-25T22:53:19.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6500000000000008e-06 2024-04-25T22:53:19.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:19.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024024+0000", 2024-04-25T22:53:19.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011396007999999999 2024-04-25T22:53:19.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:19.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024198+0000", 2024-04-25T22:53:19.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000173215 2024-04-25T22:53:19.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:19.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024447+0000", 2024-04-25T22:53:19.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024898500000000002 2024-04-25T22:53:19.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:19.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026431+0000", 2024-04-25T22:53:19.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001984923 2024-04-25T22:53:19.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:19.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033608+0000", 2024-04-25T22:53:19.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071768459999999997 2024-04-25T22:53:19.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:19.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033646+0000", 2024-04-25T22:53:19.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299000000000003e-05 2024-04-25T22:53:19.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:19.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033684+0000", 2024-04-25T22:53:19.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8773000000000003e-05 2024-04-25T22:53:19.554 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:19.554 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:19.554 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:19.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.555 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:19.555 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:19.555 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 86.473275448999999, 2024-04-25T22:53:19.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021175381, 2024-04-25T22:53:19.557 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:19.558 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:19.558 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:19.558 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:19.558 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.558 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:19.558 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:19.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:19.558 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.558 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.558 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:19.558 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:19.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:19.558 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.559 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:19.559 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012651+0000", 2024-04-25T22:53:19.559 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:53:19.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.559 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:19.559 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012656+0000", 2024-04-25T22:53:19.559 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8899999999999998e-06 2024-04-25T22:53:19.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.559 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:19.560 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012666+0000", 2024-04-25T22:53:19.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0346999999999999e-05 2024-04-25T22:53:19.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.560 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.560 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:19.560 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012675+0000", 2024-04-25T22:53:19.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9930000000000001e-06 2024-04-25T22:53:19.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.560 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.560 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:19.560 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025661+0000", 2024-04-25T22:53:19.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01298531 2024-04-25T22:53:19.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:19.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025757+0000", 2024-04-25T22:53:19.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5822000000000005e-05 2024-04-25T22:53:19.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:19.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025907+0000", 2024-04-25T22:53:19.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015051499999999999 2024-04-25T22:53:19.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:19.562 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026435+0000", 2024-04-25T22:53:19.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052762200000000005 2024-04-25T22:53:19.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.562 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.562 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:19.562 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033732+0000", 2024-04-25T22:53:19.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072978419999999997 2024-04-25T22:53:19.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.562 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.562 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:19.562 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033787+0000", 2024-04-25T22:53:19.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4703999999999997e-05 2024-04-25T22:53:19.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.563 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.563 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:19.563 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033826+0000", 2024-04-25T22:53:19.563 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8458999999999999e-05 2024-04-25T22:53:19.563 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:19.563 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:19.563 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:19.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.563 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.563 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:19.563 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:19.563 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 86.473220034999997, 2024-04-25T22:53:19.564 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021244174000000001, 2024-04-25T22:53:19.564 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:19.564 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:19.564 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:19.564 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:19.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.564 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:19.564 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:19.564 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:19.564 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.564 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:19.564 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:19.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:19.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:19.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:19.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:19.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:19.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012712+0000", 2024-04-25T22:53:19.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.913e-06 2024-04-25T22:53:19.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:19.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012722+0000", 2024-04-25T22:53:19.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2879999999999998e-06 2024-04-25T22:53:19.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:19.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012727+0000", 2024-04-25T22:53:19.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8429999999999998e-06 2024-04-25T22:53:19.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:19.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026099+0000", 2024-04-25T22:53:19.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013371450999999999 2024-04-25T22:53:19.567 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.567 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.567 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:19.567 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026147+0000", 2024-04-25T22:53:19.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7837999999999998e-05 2024-04-25T22:53:19.567 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.567 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.567 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:19.567 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026254+0000", 2024-04-25T22:53:19.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107314 2024-04-25T22:53:19.567 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.567 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.567 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:19.568 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026686+0000", 2024-04-25T22:53:19.568 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000432428 2024-04-25T22:53:19.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.568 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:19.568 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033873+0000", 2024-04-25T22:53:19.568 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071864399999999997 2024-04-25T22:53:19.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.568 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:19.568 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033904+0000", 2024-04-25T22:53:19.568 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1321e-05 2024-04-25T22:53:19.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.569 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:19.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033950+0000", 2024-04-25T22:53:19.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5707999999999997e-05 2024-04-25T22:53:19.569 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:19.569 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:19.569 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:19.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.569 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:19.569 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:19.569 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 86.473189649999995, 2024-04-25T22:53:19.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01096505, 2024-04-25T22:53:19.569 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:19.569 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:19.570 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:19.570 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:19.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:19.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:19.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:19.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:19.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:19.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:19.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:19.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012737+0000", 2024-04-25T22:53:19.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:19.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:19.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012739+0000", 2024-04-25T22:53:19.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-04-25T22:53:19.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:19.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012743+0000", 2024-04-25T22:53:19.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3239999999999996e-06 2024-04-25T22:53:19.572 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.572 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.572 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:19.572 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012746+0000", 2024-04-25T22:53:19.572 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.129e-06 2024-04-25T22:53:19.572 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.572 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.572 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:19.572 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012796+0000", 2024-04-25T22:53:19.572 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9231999999999999e-05 2024-04-25T22:53:19.572 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.572 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.572 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:19.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012915+0000", 2024-04-25T22:53:19.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119021 2024-04-25T22:53:19.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:19.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013069+0000", 2024-04-25T22:53:19.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015463900000000001 2024-04-25T22:53:19.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:19.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019237+0000", 2024-04-25T22:53:19.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061680329999999998 2024-04-25T22:53:19.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:19.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023603+0000", 2024-04-25T22:53:19.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043655860000000003 2024-04-25T22:53:19.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:19.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023659+0000", 2024-04-25T22:53:19.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6484000000000003e-05 2024-04-25T22:53:19.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:19.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023701+0000", 2024-04-25T22:53:19.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1761999999999998e-05 2024-04-25T22:53:19.575 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:19.575 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:19.575 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:19.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.575 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:19.575 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:19.575 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 86.473164702000005, 2024-04-25T22:53:19.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011234429000000001, 2024-04-25T22:53:19.575 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:19.576 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:19.576 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:19.576 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:19.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.576 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:19.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:19.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:19.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.576 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:19.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:19.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:19.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:19.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012762+0000", 2024-04-25T22:53:19.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-04-25T22:53:19.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:19.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012765+0000", 2024-04-25T22:53:19.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2569999999999999e-06 2024-04-25T22:53:19.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:19.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012783+0000", 2024-04-25T22:53:19.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8431999999999999e-05 2024-04-25T22:53:19.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:19.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012799+0000", 2024-04-25T22:53:19.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5438999999999999e-05 2024-04-25T22:53:19.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:19.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013826+0000", 2024-04-25T22:53:19.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010275060000000001 2024-04-25T22:53:19.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:19.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013913+0000", 2024-04-25T22:53:19.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.708e-05 2024-04-25T22:53:19.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:19.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014098+0000", 2024-04-25T22:53:19.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018519399999999999 2024-04-25T22:53:19.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:19.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019684+0000", 2024-04-25T22:53:19.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055860079999999999 2024-04-25T22:53:19.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.580 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:19.580 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023876+0000", 2024-04-25T22:53:19.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041918800000000003 2024-04-25T22:53:19.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.580 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:19.580 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023957+0000", 2024-04-25T22:53:19.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1165e-05 2024-04-25T22:53:19.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.580 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:19.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023995+0000", 2024-04-25T22:53:19.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:53:19.581 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:19.581 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:19.581 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:19.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.581 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.581 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:19.581 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:19.581 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 86.473066923000005, 2024-04-25T22:53:19.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011131200000000001, 2024-04-25T22:53:19.581 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:19.581 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:19.582 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:19.582 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:19.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:19.582 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:19.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:19.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:19.582 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:19.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:19.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:19.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012860+0000", 2024-04-25T22:53:19.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3900000000000004e-07 2024-04-25T22:53:19.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:19.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012865+0000", 2024-04-25T22:53:19.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5609999999999998e-06 2024-04-25T22:53:19.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:19.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012895+0000", 2024-04-25T22:53:19.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9847000000000001e-05 2024-04-25T22:53:19.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:19.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012905+0000", 2024-04-25T22:53:19.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.03e-05 2024-04-25T22:53:19.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:19.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015020+0000", 2024-04-25T22:53:19.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021142940000000001 2024-04-25T22:53:19.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:19.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015182+0000", 2024-04-25T22:53:19.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016248099999999999 2024-04-25T22:53:19.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:19.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015357+0000", 2024-04-25T22:53:19.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017471000000000001 2024-04-25T22:53:19.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:19.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021021+0000", 2024-04-25T22:53:19.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056638340000000004 2024-04-25T22:53:19.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.586 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:19.586 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023712+0000", 2024-04-25T22:53:19.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026910380000000002 2024-04-25T22:53:19.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.586 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:19.586 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023763+0000", 2024-04-25T22:53:19.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1477999999999997e-05 2024-04-25T22:53:19.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.586 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:19.586 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023990+0000", 2024-04-25T22:53:19.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000226818 2024-04-25T22:53:19.587 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:19.587 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:19.587 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:19.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.587 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:19.587 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:19.587 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 86.472943826999995, 2024-04-25T22:53:19.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011705299000000001, 2024-04-25T22:53:19.587 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:19.587 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:19.587 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:19.587 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:19.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:19.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:19.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:19.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:19.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:19.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:19.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:19.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012983+0000", 2024-04-25T22:53:19.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:53:19.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:19.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012986+0000", 2024-04-25T22:53:19.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5700000000000001e-06 2024-04-25T22:53:19.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:19.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012993+0000", 2024-04-25T22:53:19.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8730000000000001e-06 2024-04-25T22:53:19.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:19.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013000+0000", 2024-04-25T22:53:19.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1890000000000001e-06 2024-04-25T22:53:19.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.590 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.590 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:19.590 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:53:19.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002147866 2024-04-25T22:53:19.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.590 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.590 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:19.590 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015351+0000", 2024-04-25T22:53:19.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020300799999999999 2024-04-25T22:53:19.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.590 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.591 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:19.591 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016260+0000", 2024-04-25T22:53:19.591 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00090926799999999997 2024-04-25T22:53:19.591 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.591 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.591 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:19.591 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022669+0000", 2024-04-25T22:53:19.591 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064082849999999997 2024-04-25T22:53:19.591 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.591 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.591 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:19.591 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024584+0000", 2024-04-25T22:53:19.591 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019151699999999999 2024-04-25T22:53:19.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.592 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.592 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:19.592 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024643+0000", 2024-04-25T22:53:19.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8888999999999998e-05 2024-04-25T22:53:19.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.592 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.592 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:19.592 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024687+0000", 2024-04-25T22:53:19.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4444999999999999e-05 2024-04-25T22:53:19.593 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:19.593 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:19.593 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:19.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.593 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:19.593 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:19.593 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 86.472916236000003, 2024-04-25T22:53:19.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011249699, 2024-04-25T22:53:19.593 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:19.593 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:19.594 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:19.594 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:19.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:19.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:19.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:19.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:19.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:19.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:19.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.595 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:19.595 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013010+0000", 2024-04-25T22:53:19.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2099999999999996e-07 2024-04-25T22:53:19.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.595 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:19.595 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013013+0000", 2024-04-25T22:53:19.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1310000000000002e-06 2024-04-25T22:53:19.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.595 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:19.595 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013020+0000", 2024-04-25T22:53:19.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3330000000000002e-06 2024-04-25T22:53:19.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:19.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013025+0000", 2024-04-25T22:53:19.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6760000000000004e-06 2024-04-25T22:53:19.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:19.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013163+0000", 2024-04-25T22:53:19.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013824599999999999 2024-04-25T22:53:19.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:19.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013504+0000", 2024-04-25T22:53:19.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034080299999999998 2024-04-25T22:53:19.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:19.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013613+0000", 2024-04-25T22:53:19.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108705 2024-04-25T22:53:19.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:19.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015831+0000", 2024-04-25T22:53:19.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002217672 2024-04-25T22:53:19.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.598 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:19.598 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024137+0000", 2024-04-25T22:53:19.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0083060489999999994 2024-04-25T22:53:19.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.598 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:19.598 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024218+0000", 2024-04-25T22:53:19.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1351000000000001e-05 2024-04-25T22:53:19.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.599 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:19.599 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024259+0000", 2024-04-25T22:53:19.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1112000000000002e-05 2024-04-25T22:53:19.599 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:19.599 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:19.599 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:19.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.599 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:19.599 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:19.599 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 86.472828509999999, 2024-04-25T22:53:19.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020379749999999999, 2024-04-25T22:53:19.599 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:19.600 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:19.600 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:19.600 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:19.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:19.600 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:19.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:19.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:19.600 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:19.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:19.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:19.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013098+0000", 2024-04-25T22:53:19.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:53:19.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:19.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013105+0000", 2024-04-25T22:53:19.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5969999999999997e-06 2024-04-25T22:53:19.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:19.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013190+0000", 2024-04-25T22:53:19.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5618999999999995e-05 2024-04-25T22:53:19.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:19.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013200+0000", 2024-04-25T22:53:19.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5859999999999994e-06 2024-04-25T22:53:19.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:19.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020265+0000", 2024-04-25T22:53:19.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070653349999999998 2024-04-25T22:53:19.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:19.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020454+0000", 2024-04-25T22:53:19.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189316 2024-04-25T22:53:19.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:19.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020586+0000", 2024-04-25T22:53:19.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013195700000000001 2024-04-25T22:53:19.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:19.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023822+0000", 2024-04-25T22:53:19.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032358529999999999 2024-04-25T22:53:19.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:19.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033409+0000", 2024-04-25T22:53:19.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095870520000000004 2024-04-25T22:53:19.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:19.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033447+0000", 2024-04-25T22:53:19.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7261999999999997e-05 2024-04-25T22:53:19.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:19.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033477+0000", 2024-04-25T22:53:19.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0389e-05 2024-04-25T22:53:19.604 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:19.604 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:19.604 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:19.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.605 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:19.605 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:19.605 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 86.472712004000002, 2024-04-25T22:53:19.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010857383999999999, 2024-04-25T22:53:19.605 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:19.605 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:19.605 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:19.605 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:19.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:19.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:19.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:19.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:19.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:19.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:19.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:19.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:19.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:19.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:19.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013218+0000", 2024-04-25T22:53:19.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8199999999999998e-06 2024-04-25T22:53:19.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.607 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:19.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013226+0000", 2024-04-25T22:53:19.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7649999999999993e-06 2024-04-25T22:53:19.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.607 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:19.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013259+0000", 2024-04-25T22:53:19.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2727e-05 2024-04-25T22:53:19.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:19.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014809+0000", 2024-04-25T22:53:19.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001550144 2024-04-25T22:53:19.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:19.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014958+0000", 2024-04-25T22:53:19.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014890300000000001 2024-04-25T22:53:19.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:19.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015087+0000", 2024-04-25T22:53:19.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012939200000000001 2024-04-25T22:53:19.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:19.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020212+0000", 2024-04-25T22:53:19.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051248939999999996 2024-04-25T22:53:19.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:19.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023699+0000", 2024-04-25T22:53:19.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034873289999999999 2024-04-25T22:53:19.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:19.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024014+0000", 2024-04-25T22:53:19.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031473999999999999 2024-04-25T22:53:19.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:19.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024071+0000", 2024-04-25T22:53:19.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7040000000000003e-05 2024-04-25T22:53:19.610 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:19.610 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:19.610 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:19.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.610 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:19.611 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:19.611 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 86.472657299000005, 2024-04-25T22:53:19.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012329677000000001, 2024-04-25T22:53:19.611 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:19.611 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:19.611 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:19.611 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:19.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:19.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:19.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:19.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:19.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:19.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:19.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:19.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013269+0000", 2024-04-25T22:53:19.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5000000000000002e-07 2024-04-25T22:53:19.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:19.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:19.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6909999999999999e-06 2024-04-25T22:53:19.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.613 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:19.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013284+0000", 2024-04-25T22:53:19.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0963e-05 2024-04-25T22:53:19.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.613 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:19.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013361+0000", 2024-04-25T22:53:19.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7379999999999994e-05 2024-04-25T22:53:19.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.614 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:19.614 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013448+0000", 2024-04-25T22:53:19.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6990000000000006e-05 2024-04-25T22:53:19.614 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.614 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:19.614 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013632+0000", 2024-04-25T22:53:19.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018396800000000001 2024-04-25T22:53:19.614 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.614 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:19.614 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013800+0000", 2024-04-25T22:53:19.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167467 2024-04-25T22:53:19.614 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:19.615 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.018570+0000", 2024-04-25T22:53:19.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047701460000000003 2024-04-25T22:53:19.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:19.615 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025507+0000", 2024-04-25T22:53:19.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069372039999999998 2024-04-25T22:53:19.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:19.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025562+0000", 2024-04-25T22:53:19.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4858999999999998e-05 2024-04-25T22:53:19.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:19.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025598+0000", 2024-04-25T22:53:19.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6259e-05 2024-04-25T22:53:19.616 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:19.616 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:19.616 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:19.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.616 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:19.616 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:19.616 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 86.472525426000004, 2024-04-25T22:53:19.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020176666999999999, 2024-04-25T22:53:19.617 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:19.617 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:19.617 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:53:19.617 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:19.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:19.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:19.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:19.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:19.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:19.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:19.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:19.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:19.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-04-25T22:53:19.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:19.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013405+0000", 2024-04-25T22:53:19.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0559999999999998e-06 2024-04-25T22:53:19.619 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.619 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:19.619 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013422+0000", 2024-04-25T22:53:19.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6770999999999999e-05 2024-04-25T22:53:19.619 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.619 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:19.619 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013431+0000", 2024-04-25T22:53:19.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5019999999999998e-06 2024-04-25T22:53:19.619 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.620 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:19.620 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021720+0000", 2024-04-25T22:53:19.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082884340000000008 2024-04-25T22:53:19.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.620 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:19.620 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022122+0000", 2024-04-25T22:53:19.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000401634 2024-04-25T22:53:19.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:19.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:19.620 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:19.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033577+0000", 2024-04-25T22:53:19.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011455435999999999 2024-04-25T22:53:19.621 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:19.621 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:19.621 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:19.621 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:19.621 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:19.621 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:19.623 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:19.623 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:19.622+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:19.723 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:19.723+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:19.728 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:19.728 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:19.728 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-25T22:53:19.729 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:19.738 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:19.824 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:19.824+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:19.862 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:53:19.879 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:19.879 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:19.879 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-25T22:53:19.879 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-25T22:53:19.879 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:19.888 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:19.925 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:19.925+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:19.991 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:19.991 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:53:19.992 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:53:19.992 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:53:19.992 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.992 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:53:19.992 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:19.992 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 92.022723494000005, 2024-04-25T22:53:19.992 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:53:19.992 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:19.992 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:19.992 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:19.992 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:19.992 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.992 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:19.993 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:19.993 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:19.993 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.993 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.993 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:19.993 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:19.993 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:19.993 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.993 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.993 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:19.993 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:53:19.993 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:53:19.993 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.993 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.994 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:19.994 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:53:19.994 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:53:19.994 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.994 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.994 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:19.994 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:53:19.994 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:53:19.994 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.994 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.994 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:19.994 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:53:19.994 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:53:19.995 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.995 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.995 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:19.995 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:53:19.995 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:53:19.995 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.995 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.995 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:19.995 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:53:19.995 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:53:19.995 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.995 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.995 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:19.995 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:53:19.996 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:53:19.996 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.996 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.996 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:19.996 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:53:19.996 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:53:19.996 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:19.996 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:19.996 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:19.997 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.997 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.997 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:110 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'72, mlcod=10'68)", 2024-04-25T22:53:19.997 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:19.997 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 92.022089493999999, 2024-04-25T22:53:19.997 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065316630000000001, 2024-04-25T22:53:19.997 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:19.997 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:19.997 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:19.997 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:19.997 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.997 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:19.998 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:19.998 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:19.998 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.998 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.998 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:19.998 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:19.998 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:19.998 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.998 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.998 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:19.998 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:19.998 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.58e-07 2024-04-25T22:53:19.998 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.999 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.999 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:19.999 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967811+0000", 2024-04-25T22:53:19.999 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.118e-06 2024-04-25T22:53:19.999 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.999 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.999 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:19.999 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967817+0000", 2024-04-25T22:53:19.999 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3709999999999996e-06 2024-04-25T22:53:19.999 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:19.999 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:19.999 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:19.999 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967820+0000", 2024-04-25T22:53:20.000 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2210000000000002e-06 2024-04-25T22:53:20.000 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.000 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.000 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:20.000 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967876+0000", 2024-04-25T22:53:20.000 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5507000000000002e-05 2024-04-25T22:53:20.000 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.000 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.000 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:20.000 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967893+0000", 2024-04-25T22:53:20.000 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7812000000000002e-05 2024-04-25T22:53:20.000 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.000 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.000 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:20.001 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974317+0000", 2024-04-25T22:53:20.001 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064237160000000003 2024-04-25T22:53:20.001 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.001 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.001 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:20.001 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:53:20.001 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.156e-05 2024-04-25T22:53:20.001 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:20.001 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:20.001 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:20.001 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.001 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.001 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'68)", 2024-04-25T22:53:20.002 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:20.002 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 92.021671980999997, 2024-04-25T22:53:20.002 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061292279999999996, 2024-04-25T22:53:20.002 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:20.002 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:20.002 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:20.002 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:20.002 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.002 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:20.002 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:20.002 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:20.002 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.002 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.003 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:20.003 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:20.003 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:20.003 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.003 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.003 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:20.003 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:20.003 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6300000000000001e-07 2024-04-25T22:53:20.003 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.003 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.003 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:20.003 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968228+0000", 2024-04-25T22:53:20.003 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6139999999999999e-06 2024-04-25T22:53:20.003 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.004 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.004 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:20.004 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968235+0000", 2024-04-25T22:53:20.004 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7020000000000001e-06 2024-04-25T22:53:20.004 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.004 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.004 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:20.004 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968238+0000", 2024-04-25T22:53:20.004 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0010000000000002e-06 2024-04-25T22:53:20.004 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.004 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.004 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:20.004 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968297+0000", 2024-04-25T22:53:20.004 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8424999999999997e-05 2024-04-25T22:53:20.005 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.005 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.005 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:20.005 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968316+0000", 2024-04-25T22:53:20.005 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8814999999999999e-05 2024-04-25T22:53:20.005 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.005 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.005 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:20.005 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:53:20.005 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060239439999999998 2024-04-25T22:53:20.005 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.005 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.005 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:20.005 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974354+0000", 2024-04-25T22:53:20.006 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4364e-05 2024-04-25T22:53:20.006 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:20.006 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:20.006 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:20.006 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.006 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.006 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'68)", 2024-04-25T22:53:20.006 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:20.006 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 92.021234978999999, 2024-04-25T22:53:20.006 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005948414, 2024-04-25T22:53:20.006 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:20.006 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:20.006 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:20.007 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:20.007 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.007 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:20.007 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:20.007 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:20.007 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.008 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.008 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:20.008 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:20.008 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:20.008 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.008 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.008 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:20.008 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:20.008 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6199999999999998e-07 2024-04-25T22:53:20.008 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.008 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.008 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:20.008 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968723+0000", 2024-04-25T22:53:20.008 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1148999999999993e-05 2024-04-25T22:53:20.009 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.009 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.009 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:20.009 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968730+0000", 2024-04-25T22:53:20.009 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1749999999999999e-06 2024-04-25T22:53:20.009 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.009 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.009 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:20.009 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968734+0000", 2024-04-25T22:53:20.009 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5200000000000002e-06 2024-04-25T22:53:20.009 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.009 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.009 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:20.010 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968771+0000", 2024-04-25T22:53:20.010 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6851999999999999e-05 2024-04-25T22:53:20.010 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.010 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.010 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:20.010 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968788+0000", 2024-04-25T22:53:20.010 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7027000000000001e-05 2024-04-25T22:53:20.010 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.010 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.010 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:20.010 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974589+0000", 2024-04-25T22:53:20.010 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058013320000000002 2024-04-25T22:53:20.010 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.011 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.011 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:20.011 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974610+0000", 2024-04-25T22:53:20.011 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0897e-05 2024-04-25T22:53:20.011 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:20.011 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:20.011 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:20.011 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.011 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.011 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'68)", 2024-04-25T22:53:20.011 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:20.011 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 92.020664968999995, 2024-04-25T22:53:20.011 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053935750000000003, 2024-04-25T22:53:20.011 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:20.012 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:20.012 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:20.012 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:20.012 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.012 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:20.012 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:20.012 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:20.012 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.012 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.012 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:20.012 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:20.012 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:20.012 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.012 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.013 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:20.013 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:20.013 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.03e-07 2024-04-25T22:53:20.013 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.013 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.013 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:20.013 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969235+0000", 2024-04-25T22:53:20.013 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2399999999999999e-06 2024-04-25T22:53:20.013 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.013 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.013 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:20.013 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969242+0000", 2024-04-25T22:53:20.013 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1269999999999997e-06 2024-04-25T22:53:20.013 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.014 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.014 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:20.014 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969246+0000", 2024-04-25T22:53:20.014 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3840000000000001e-06 2024-04-25T22:53:20.014 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.014 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.014 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:20.014 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969278+0000", 2024-04-25T22:53:20.014 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1868e-05 2024-04-25T22:53:20.014 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.014 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.014 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:20.014 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969295+0000", 2024-04-25T22:53:20.015 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7530999999999999e-05 2024-04-25T22:53:20.015 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.015 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.015 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:20.015 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974611+0000", 2024-04-25T22:53:20.015 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053160789999999996 2024-04-25T22:53:20.015 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.015 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.015 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:20.015 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974625+0000", 2024-04-25T22:53:20.015 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3943e-05 2024-04-25T22:53:20.015 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:20.015 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:20.016 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:20.016 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.016 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.016 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-25T22:53:20.016 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:20.016 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 91.827069061000003, 2024-04-25T22:53:20.016 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054952610000000004, 2024-04-25T22:53:20.016 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:20.016 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:20.016 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:20.016 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:20.016 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.016 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:20.016 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:20.017 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:20.017 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.017 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.017 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:20.017 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:20.017 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:20.017 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.017 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.017 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:20.018 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:20.018 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.68e-07 2024-04-25T22:53:20.018 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.018 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.018 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:20.018 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162898+0000", 2024-04-25T22:53:20.018 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9470999999999999e-05 2024-04-25T22:53:20.018 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.018 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.019 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:20.019 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162906+0000", 2024-04-25T22:53:20.019 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1580000000000005e-06 2024-04-25T22:53:20.019 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.019 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.019 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:20.019 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162911+0000", 2024-04-25T22:53:20.019 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4779999999999999e-06 2024-04-25T22:53:20.019 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.019 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.019 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:20.019 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162952+0000", 2024-04-25T22:53:20.019 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0629e-05 2024-04-25T22:53:20.020 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.020 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.020 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:20.020 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162968+0000", 2024-04-25T22:53:20.020 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6239000000000002e-05 2024-04-25T22:53:20.020 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.020 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.020 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:20.020 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168281+0000", 2024-04-25T22:53:20.020 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053132869999999999 2024-04-25T22:53:20.020 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.020 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.020 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:20.020 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168323+0000", 2024-04-25T22:53:20.021 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1430999999999997e-05 2024-04-25T22:53:20.021 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:20.021 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:20.021 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:20.021 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.021 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.021 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-04-25T22:53:20.021 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:20.021 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 91.396591698999998, 2024-04-25T22:53:20.021 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050872510000000001, 2024-04-25T22:53:20.021 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:20.021 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:20.021 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:20.021 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:20.022 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.022 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:20.022 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:20.022 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:20.022 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.022 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.022 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:20.022 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:20.022 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:20.022 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.022 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.022 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:20.022 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:20.023 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.72e-07 2024-04-25T22:53:20.023 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.023 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.023 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:20.023 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593381+0000", 2024-04-25T22:53:20.023 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5797000000000006e-05 2024-04-25T22:53:20.023 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.023 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.023 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:20.023 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593389+0000", 2024-04-25T22:53:20.023 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8480000000000001e-06 2024-04-25T22:53:20.023 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.023 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.024 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:20.024 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593393+0000", 2024-04-25T22:53:20.024 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4819999999999996e-06 2024-04-25T22:53:20.024 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.024 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.024 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:20.024 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593435+0000", 2024-04-25T22:53:20.024 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1600000000000002e-05 2024-04-25T22:53:20.024 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.024 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.024 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:20.024 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593454+0000", 2024-04-25T22:53:20.024 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8868e-05 2024-04-25T22:53:20.025 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.025 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.025 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:20.025 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598350+0000", 2024-04-25T22:53:20.025 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004895763 2024-04-25T22:53:20.025 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.025 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.025 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:20.025 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598392+0000", 2024-04-25T22:53:20.025 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2521000000000002e-05 2024-04-25T22:53:20.025 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:20.025 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:20.025 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:20.025 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.026 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.026 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:20.026 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:20.026 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 86.978227794999995, 2024-04-25T22:53:20.026 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:53:20.026 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:20.026 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:20.026 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:20.026 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:20.026 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.026 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:20.026 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:20.026 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:20.027 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.027 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.027 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:20.027 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:20.027 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:20.027 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.027 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.027 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:20.027 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:53:20.027 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:53:20.027 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.027 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.027 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:20.028 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:53:20.028 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:53:20.028 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.028 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.028 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:20.028 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:53:20.028 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:53:20.029 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.029 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.029 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:20.029 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:53:20.029 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:53:20.029 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.029 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.029 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:20.029 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:53:20.029 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:53:20.029 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.029 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.029 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:20.029 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:53:20.030 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:53:20.030 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.030 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.030 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:20.030 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:53:20.030 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:53:20.030 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.030 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.030 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:20.030 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:53:20.030 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:53:20.030 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.030 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.031 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:20.031 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:53:20.031 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:53:20.031 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.031 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.031 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:20.031 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:53:20.031 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:53:20.031 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.031 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.031 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:20.031 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:53:20.031 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:53:20.031 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:20.032 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:20.032 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:20.032 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.032 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.032 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:20.032 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:20.032 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 86.977553419000003, 2024-04-25T22:53:20.032 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:53:20.032 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:20.032 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:20.032 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:20.032 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:20.032 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.033 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:20.033 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:20.033 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:20.033 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.033 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.033 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:20.033 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:20.033 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:20.033 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.033 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.033 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:20.033 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:53:20.033 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:53:20.033 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.033 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.034 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:20.034 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:53:20.034 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:53:20.034 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.034 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.034 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:20.034 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:53:20.034 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:53:20.034 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.034 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.034 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:20.034 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:53:20.035 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:53:20.035 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.035 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.035 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:20.035 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:53:20.035 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:53:20.035 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.035 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.035 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:20.035 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:53:20.035 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:53:20.035 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.035 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.035 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:20.036 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:53:20.036 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:53:20.036 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.036 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.036 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:20.036 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:53:20.036 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:53:20.036 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.036 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.036 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:20.036 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:53:20.036 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:53:20.036 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.036 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.037 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:20.037 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:53:20.037 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:53:20.037 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.037 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.037 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:20.037 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:53:20.037 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:53:20.037 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:20.037 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:20.037 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:20.037 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.037 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.038 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:20.038 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:20.038 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 86.977044207000006, 2024-04-25T22:53:20.038 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:53:20.038 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:20.038 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:20.038 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:20.038 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:20.038 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.038 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:20.039 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:20.039 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:20.039 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.039 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.039 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:20.039 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:20.039 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:20.039 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.039 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.039 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:20.039 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:53:20.040 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:53:20.040 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.040 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.040 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:20.040 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:53:20.040 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:53:20.040 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.040 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.040 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:20.040 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:53:20.041 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:53:20.041 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.041 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.041 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:20.041 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:53:20.041 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:53:20.041 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.041 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.041 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:20.041 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:53:20.041 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:53:20.041 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.041 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.042 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:20.042 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:53:20.042 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:53:20.042 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.042 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.042 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:20.042 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:53:20.042 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:53:20.042 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.042 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.042 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:20.042 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:53:20.042 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:53:20.042 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.043 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.043 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:20.043 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:53:20.043 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:53:20.043 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.043 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.043 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:20.043 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:53:20.043 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:53:20.043 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.043 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.043 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:20.044 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:53:20.044 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:53:20.044 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:20.044 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:20.044 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:20.044 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.044 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.044 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:20.044 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:20.044 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 86.976631009000002, 2024-04-25T22:53:20.044 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:53:20.044 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:20.044 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:20.044 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:20.045 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:20.045 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.045 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:20.045 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:20.045 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:20.045 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.045 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.045 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:20.045 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:20.045 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:20.045 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.045 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.045 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:20.045 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:20.046 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:53:20.046 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.046 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.046 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:20.046 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:20.046 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:53:20.046 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.046 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.046 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:20.046 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:53:20.046 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:53:20.046 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.046 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.046 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:20.047 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:53:20.047 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:53:20.047 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.047 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.047 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:20.047 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:53:20.047 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:53:20.047 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.047 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.047 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:20.047 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:53:20.047 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:53:20.047 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.047 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.048 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:20.048 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:53:20.048 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:53:20.048 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.048 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.048 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:20.048 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:53:20.048 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:53:20.048 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.048 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.048 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:20.048 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:53:20.048 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:53:20.048 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.049 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.049 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:20.049 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:53:20.049 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:53:20.049 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.049 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.050 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:20.050 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:53:20.050 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:53:20.050 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:20.050 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:20.050 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:20.050 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.050 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.050 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:20.050 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:20.050 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 86.976580338999995, 2024-04-25T22:53:20.050 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:53:20.050 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:20.051 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:20.051 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:20.051 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:20.051 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.051 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:20.051 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:20.051 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:20.051 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.051 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.051 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:20.051 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:20.051 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:20.051 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.051 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.052 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:20.052 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:53:20.052 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:53:20.052 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.052 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.052 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:20.052 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:53:20.052 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:53:20.052 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.052 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.052 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:20.052 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:53:20.052 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:53:20.053 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.053 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.053 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:20.053 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:53:20.053 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:53:20.053 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.053 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.053 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:20.053 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:53:20.053 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:53:20.053 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.053 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.053 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:20.053 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:53:20.054 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:53:20.054 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.054 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.054 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:20.054 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:53:20.054 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:53:20.054 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.054 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.054 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:20.054 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:53:20.054 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:53:20.054 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.054 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.054 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:20.055 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:53:20.055 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:53:20.055 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.055 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.055 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:20.055 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:53:20.055 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:53:20.055 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.055 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.055 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:20.055 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:53:20.055 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:53:20.055 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.055 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.056 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:20.056 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:53:20.056 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:53:20.056 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.056 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.056 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:20.056 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:53:20.056 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:53:20.056 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:20.056 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:20.056 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:20.056 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.056 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.057 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:20.057 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:20.057 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 86.976543469999996, 2024-04-25T22:53:20.057 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:53:20.057 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:20.057 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:20.057 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:20.057 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:20.057 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.057 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:20.057 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:20.057 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:20.057 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.057 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.058 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:20.058 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:20.058 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:20.058 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.058 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.058 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:20.058 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:53:20.058 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:53:20.058 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.058 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.058 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:20.058 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:53:20.058 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:53:20.058 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.059 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.059 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:20.059 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:53:20.059 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:53:20.059 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.059 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.059 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:20.059 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:53:20.059 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:53:20.060 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.060 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.060 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:20.060 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:53:20.060 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:53:20.060 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.060 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.060 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:53:20.060 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:53:20.060 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:53:20.060 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.060 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.061 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:20.061 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:53:20.061 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:53:20.061 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.061 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.061 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:20.061 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:53:20.061 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:53:20.061 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.061 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.061 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:20.061 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:53:20.061 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:53:20.061 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.062 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.062 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:20.062 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:53:20.062 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:53:20.062 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.062 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.062 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:20.062 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:53:20.062 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:53:20.062 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.062 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.062 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:20.062 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:53:20.063 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:53:20.063 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.063 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.063 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:20.063 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:53:20.063 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:53:20.063 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:20.063 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:20.063 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:20.063 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.063 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.063 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:20.063 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:20.063 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 86.976518503999998, 2024-04-25T22:53:20.064 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:53:20.064 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:20.064 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:20.064 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:20.064 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:20.064 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.064 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:20.064 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:20.064 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:20.064 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.064 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.064 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:20.064 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:20.064 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:20.065 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.065 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.065 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:20.065 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:53:20.065 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:53:20.065 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.065 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.065 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:20.065 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:53:20.065 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:53:20.065 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.065 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.065 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:20.065 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:20.066 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:53:20.066 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.066 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.066 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:20.066 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:53:20.066 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:53:20.066 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.066 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.066 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:20.066 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:53:20.066 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:53:20.066 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.066 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.067 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:20.067 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:53:20.067 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:53:20.067 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.067 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.067 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:20.067 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:53:20.067 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:53:20.067 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.067 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.067 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:20.067 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:53:20.067 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:53:20.067 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.068 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.068 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:20.068 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:53:20.068 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:53:20.068 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.068 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.068 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:20.068 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:53:20.068 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:53:20.068 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.068 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.068 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:20.068 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:53:20.069 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:53:20.069 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:20.069 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:20.069 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:20.069 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.069 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.069 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:20.069 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:20.069 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 86.976482140000002, 2024-04-25T22:53:20.069 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:53:20.069 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:20.069 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:20.069 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:20.069 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:20.070 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.070 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:20.070 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:20.070 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:20.070 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.070 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.071 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:20.071 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:20.071 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:20.071 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.071 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.071 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:20.071 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:53:20.071 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:53:20.071 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.071 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.071 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:20.071 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:53:20.071 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:53:20.071 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.072 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.072 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:20.072 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:53:20.072 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:53:20.072 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.072 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.072 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:20.072 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:53:20.072 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:53:20.072 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.072 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.072 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:20.072 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:53:20.072 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:53:20.073 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.073 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.073 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:20.073 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:53:20.073 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:53:20.073 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.073 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.073 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:20.073 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:53:20.073 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:53:20.073 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.073 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.073 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:20.073 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:53:20.073 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:53:20.074 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.074 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.074 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:20.074 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:53:20.074 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:53:20.074 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:20.074 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:20.074 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:20.074 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.074 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.074 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:20.074 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:20.074 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 86.976451058999999, 2024-04-25T22:53:20.075 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:53:20.075 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:20.075 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:20.075 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:20.075 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:20.075 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.075 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:20.075 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:20.075 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:20.075 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.075 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.075 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:20.076 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:20.076 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:20.076 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.076 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.076 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:20.076 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:20.076 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:20.076 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.076 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.076 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:20.076 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:53:20.076 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:53:20.076 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.077 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.077 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:20.077 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:53:20.077 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:53:20.077 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.077 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.077 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:20.077 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:53:20.077 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:53:20.077 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.077 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.077 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:20.077 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:53:20.077 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:53:20.078 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.078 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.078 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:20.078 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:53:20.078 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:53:20.078 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.078 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.078 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:20.078 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:53:20.078 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:53:20.078 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:20.078 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:20.078 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:20.078 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.079 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.079 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:53:20.079 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:20.079 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 86.976010090000003, 2024-04-25T22:53:20.079 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064881979999999997, 2024-04-25T22:53:20.079 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:20.079 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:20.079 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:20.079 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:20.079 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.079 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:20.079 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:20.079 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:20.080 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.080 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.080 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:20.080 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:20.080 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:20.080 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.080 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.080 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:20.081 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:20.081 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2699999999999999e-07 2024-04-25T22:53:20.081 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.081 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.081 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:20.081 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013898+0000", 2024-04-25T22:53:20.081 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0796e-05 2024-04-25T22:53:20.081 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.081 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.081 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:20.082 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013907+0000", 2024-04-25T22:53:20.082 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5140000000000007e-06 2024-04-25T22:53:20.082 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.082 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.082 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:20.082 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013952+0000", 2024-04-25T22:53:20.082 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4134000000000001e-05 2024-04-25T22:53:20.082 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.082 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.082 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:20.082 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016812+0000", 2024-04-25T22:53:20.082 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028601059999999998 2024-04-25T22:53:20.082 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.082 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.083 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:20.083 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.017052+0000", 2024-04-25T22:53:20.083 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024056500000000001 2024-04-25T22:53:20.083 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.083 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.083 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:20.083 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020350+0000", 2024-04-25T22:53:20.083 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032978320000000001 2024-04-25T22:53:20.083 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.083 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.083 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:20.083 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020375+0000", 2024-04-25T22:53:20.083 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4624e-05 2024-04-25T22:53:20.083 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:20.084 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:20.084 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:20.084 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.084 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.084 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-25T22:53:20.084 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:20.084 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 86.962479643999998, 2024-04-25T22:53:20.084 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058583000000000003, 2024-04-25T22:53:20.084 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:20.084 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:20.084 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:20.084 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:20.084 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.085 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:20.085 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:20.085 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:20.085 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.085 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.085 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:20.085 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:20.085 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:20.085 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.085 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.085 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:20.085 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:20.085 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.41e-07 2024-04-25T22:53:20.086 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.086 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.086 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:20.086 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027428+0000", 2024-04-25T22:53:20.086 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.075e-05 2024-04-25T22:53:20.086 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.086 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.086 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:20.086 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027435+0000", 2024-04-25T22:53:20.086 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3610000000000003e-06 2024-04-25T22:53:20.086 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.086 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.086 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:20.086 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027442+0000", 2024-04-25T22:53:20.087 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0400000000000004e-06 2024-04-25T22:53:20.087 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.087 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.087 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:20.087 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028094+0000", 2024-04-25T22:53:20.087 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00065134800000000005 2024-04-25T22:53:20.087 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.087 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.087 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:20.087 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028107+0000", 2024-04-25T22:53:20.087 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3087e-05 2024-04-25T22:53:20.087 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.087 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.087 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:20.088 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033239+0000", 2024-04-25T22:53:20.088 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051319429999999999 2024-04-25T22:53:20.088 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.088 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.088 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:20.088 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033275+0000", 2024-04-25T22:53:20.088 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6430000000000002e-05 2024-04-25T22:53:20.088 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:20.088 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:20.088 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:20.088 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.088 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.088 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-25T22:53:20.088 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:20.089 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 86.962094807, 2024-04-25T22:53:20.089 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005413597, 2024-04-25T22:53:20.089 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:20.089 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:20.089 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:20.089 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:20.089 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.089 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:20.089 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:20.089 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:20.089 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.089 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.089 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:20.089 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:20.090 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:20.090 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.090 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.090 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:20.090 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:20.090 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3799999999999997e-07 2024-04-25T22:53:20.090 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.090 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.090 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:20.090 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027816+0000", 2024-04-25T22:53:20.090 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3230999999999999e-05 2024-04-25T22:53:20.090 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.090 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.091 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:20.091 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027823+0000", 2024-04-25T22:53:20.091 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9039999999999992e-06 2024-04-25T22:53:20.091 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.091 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.091 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:20.092 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027841+0000", 2024-04-25T22:53:20.092 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7651000000000001e-05 2024-04-25T22:53:20.092 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.092 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.092 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:20.092 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027904+0000", 2024-04-25T22:53:20.092 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3058000000000005e-05 2024-04-25T22:53:20.092 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.092 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.092 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:20.092 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027926+0000", 2024-04-25T22:53:20.092 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1450999999999998e-05 2024-04-25T22:53:20.092 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.092 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.093 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:20.093 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033177+0000", 2024-04-25T22:53:20.093 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052508909999999997 2024-04-25T22:53:20.093 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.093 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.093 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:20.093 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033215+0000", 2024-04-25T22:53:20.093 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8872999999999999e-05 2024-04-25T22:53:20.093 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:20.093 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:20.093 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:20.093 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.093 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.093 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 171 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:53:20.094 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:20.094 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 86.962037705, 2024-04-25T22:53:20.094 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054322240000000003, 2024-04-25T22:53:20.094 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:20.094 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:20.094 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "reached pg", 2024-04-25T22:53:20.094 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:20.094 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.094 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:20.094 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:20.094 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:20.094 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.094 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.095 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:20.095 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:20.095 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:20.095 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.095 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.095 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:20.095 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:20.095 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7500000000000001e-07 2024-04-25T22:53:20.095 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.095 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.095 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:20.095 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027868+0000", 2024-04-25T22:53:20.095 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5750000000000001e-06 2024-04-25T22:53:20.095 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.096 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.096 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:20.096 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027885+0000", 2024-04-25T22:53:20.096 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7272e-05 2024-04-25T22:53:20.096 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.096 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.096 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:20.096 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027900+0000", 2024-04-25T22:53:20.096 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.502e-05 2024-04-25T22:53:20.096 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.096 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.096 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:20.096 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028381+0000", 2024-04-25T22:53:20.097 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00048039399999999998 2024-04-25T22:53:20.097 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:20.097 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:20.097 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:20.097 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033291+0000", 2024-04-25T22:53:20.097 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049105879999999996 2024-04-25T22:53:20.097 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:20.097 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:20.097 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:20.097 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:20.097 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:20.097 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:20.098 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-25T22:53:20.099 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:53:20.099 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:53:20.099 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-25T22:53:20.100 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:20.098+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:20.100 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:20.101 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:53:20.101 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:53:20.102 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:53:20.199 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:20.198+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:20.211 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:20.212 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:20.221 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:20.248 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-25T22:53:20.300 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:20.300+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:20.365 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:20.365 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:20.374 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:20.401 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:20.401+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:20.476 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:20.476 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:20.485 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:20.501 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:20.501+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:20.588 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:20.588 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:20.596 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:20.602 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:20.602+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:20.698 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:20.698 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:20.703 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:20.703+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:20.706 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:20.804 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:20.804+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:20.808 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:20.808 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:20.818 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:20.905 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:20.904+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:20.921 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:20.921 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:20.930 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:21.007 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:21.006+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:21.072 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:21.072 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:21.081 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:21.107 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:21.107+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:21.182 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:21.182 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:21.191 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:21.234 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:21.234+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:21.240 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is unset 2024-04-25T22:53:21.296 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:21.296 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:21.305 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:21.309 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:21.309+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:21.410 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:21.410+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:21.448 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:21.448 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:21.456 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:21.511 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:21.511+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:21.600 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:21.600 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:21.609 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:21.611 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:21.611+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:21.712 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:21.712+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:21.713 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:21.713 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:21.722 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:21.814 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:21.813+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:21.824 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:21.824 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:21.833 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:21.915 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:21.914+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:21.934 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:21.934 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:21.943 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:22.016 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:22.015+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:22.047 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:22.047 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:22.056 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:22.102 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:53:22.116 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:22.116+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:22.157 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:22.158 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:22.166 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:22.218 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:22.218+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:22.253 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-25T22:53:22.253 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:53:22.254 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:53:22.287 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-25T22:53:22.288 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:53:22.291 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:53:22.292 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:53:22.311 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:22.311 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:53:22.311 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:53:22.311 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:53:22.311 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.311 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:53:22.311 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:22.311 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 94.342429788000004, 2024-04-25T22:53:22.312 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:53:22.312 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:22.312 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:22.312 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:22.312 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:22.312 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.312 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:22.312 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:22.312 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:22.312 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.312 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.312 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:22.312 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:22.313 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:22.313 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.313 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.313 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:22.313 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:53:22.313 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:53:22.313 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.313 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.313 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:22.313 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:53:22.313 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:53:22.313 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.313 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.313 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:22.314 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:53:22.314 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:53:22.314 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.314 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.314 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:22.314 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:53:22.314 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:53:22.314 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.314 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.314 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:22.314 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:53:22.314 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:53:22.314 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.315 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.315 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:22.315 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:53:22.315 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:53:22.315 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.315 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.315 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:22.315 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:53:22.315 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:53:22.315 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.315 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.315 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:22.316 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:53:22.316 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:53:22.316 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:22.316 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:22.316 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:22.316 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.316 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.316 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:110 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'72, mlcod=10'68)", 2024-04-25T22:53:22.316 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:22.316 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 94.341795787999999, 2024-04-25T22:53:22.316 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065316630000000001, 2024-04-25T22:53:22.316 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:22.316 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:22.316 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:22.317 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:22.317 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.317 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:22.317 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:22.317 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:22.317 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.317 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.317 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:22.317 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:22.317 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:22.317 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.317 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.317 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:22.317 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:22.318 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.58e-07 2024-04-25T22:53:22.318 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.318 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.318 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:22.318 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967811+0000", 2024-04-25T22:53:22.318 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.118e-06 2024-04-25T22:53:22.318 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.318 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.318 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:22.318 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967817+0000", 2024-04-25T22:53:22.318 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3709999999999996e-06 2024-04-25T22:53:22.318 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.319 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.319 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:22.319 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967820+0000", 2024-04-25T22:53:22.319 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2210000000000002e-06 2024-04-25T22:53:22.319 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.319 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.319 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:22.319 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967876+0000", 2024-04-25T22:53:22.319 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5507000000000002e-05 2024-04-25T22:53:22.319 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.319 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.319 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:22.319 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967893+0000", 2024-04-25T22:53:22.319 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7812000000000002e-05 2024-04-25T22:53:22.320 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.320 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.320 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:22.320 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974317+0000", 2024-04-25T22:53:22.320 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064237160000000003 2024-04-25T22:53:22.320 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.320 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.320 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:22.320 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:53:22.320 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.156e-05 2024-04-25T22:53:22.320 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:22.320 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:22.320 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:22.320 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.321 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.321 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'68)", 2024-04-25T22:53:22.321 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:22.321 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 94.341378274999997, 2024-04-25T22:53:22.321 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061292279999999996, 2024-04-25T22:53:22.321 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:22.321 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:22.321 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:22.321 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:22.321 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.321 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:22.321 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:22.321 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:22.321 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.322 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.322 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:22.322 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:22.322 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:22.322 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.322 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.322 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:22.322 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:22.322 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6300000000000001e-07 2024-04-25T22:53:22.323 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.323 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.323 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:22.323 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968228+0000", 2024-04-25T22:53:22.323 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6139999999999999e-06 2024-04-25T22:53:22.323 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.323 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.323 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:22.323 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968235+0000", 2024-04-25T22:53:22.323 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7020000000000001e-06 2024-04-25T22:53:22.323 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.323 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.323 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:22.323 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968238+0000", 2024-04-25T22:53:22.324 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0010000000000002e-06 2024-04-25T22:53:22.324 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.324 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.324 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:22.324 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968297+0000", 2024-04-25T22:53:22.324 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8424999999999997e-05 2024-04-25T22:53:22.324 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.324 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.324 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:22.324 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968316+0000", 2024-04-25T22:53:22.324 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8814999999999999e-05 2024-04-25T22:53:22.324 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.324 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.324 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:22.325 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:53:22.325 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060239439999999998 2024-04-25T22:53:22.325 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.325 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.325 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:22.325 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974354+0000", 2024-04-25T22:53:22.325 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4364e-05 2024-04-25T22:53:22.325 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:22.325 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:22.325 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:22.325 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.325 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.325 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'68)", 2024-04-25T22:53:22.325 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:22.326 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 94.340941272999999, 2024-04-25T22:53:22.326 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005948414, 2024-04-25T22:53:22.326 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:22.326 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:22.326 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:22.326 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:22.326 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.326 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:22.326 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:22.326 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:22.326 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.327 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.327 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:22.327 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:22.327 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:22.327 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.327 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.327 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:22.327 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:22.327 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6199999999999998e-07 2024-04-25T22:53:22.327 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.327 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.327 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:22.327 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968723+0000", 2024-04-25T22:53:22.327 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1148999999999993e-05 2024-04-25T22:53:22.328 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.328 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.328 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:22.328 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968730+0000", 2024-04-25T22:53:22.328 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1749999999999999e-06 2024-04-25T22:53:22.328 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.328 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.328 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:22.328 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968734+0000", 2024-04-25T22:53:22.328 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5200000000000002e-06 2024-04-25T22:53:22.328 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.328 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.328 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:22.328 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968771+0000", 2024-04-25T22:53:22.329 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6851999999999999e-05 2024-04-25T22:53:22.329 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.329 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.329 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:22.329 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968788+0000", 2024-04-25T22:53:22.329 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7027000000000001e-05 2024-04-25T22:53:22.329 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.329 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.329 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:22.329 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974589+0000", 2024-04-25T22:53:22.329 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058013320000000002 2024-04-25T22:53:22.329 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.330 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.331 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:22.331 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974610+0000", 2024-04-25T22:53:22.331 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0897e-05 2024-04-25T22:53:22.331 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:22.331 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:22.331 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:22.331 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.331 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.331 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'68)", 2024-04-25T22:53:22.332 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:22.332 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 94.340371262999994, 2024-04-25T22:53:22.332 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053935750000000003, 2024-04-25T22:53:22.332 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:22.332 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:22.332 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:22.332 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:22.332 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.332 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:22.332 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:22.332 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:22.332 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.332 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.332 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:22.333 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:22.333 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:22.333 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.333 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.333 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:22.333 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:22.333 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.03e-07 2024-04-25T22:53:22.333 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.333 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.333 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:22.333 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969235+0000", 2024-04-25T22:53:22.333 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2399999999999999e-06 2024-04-25T22:53:22.333 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.333 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.334 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:22.334 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969242+0000", 2024-04-25T22:53:22.334 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1269999999999997e-06 2024-04-25T22:53:22.334 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.334 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.334 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:22.334 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969246+0000", 2024-04-25T22:53:22.334 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3840000000000001e-06 2024-04-25T22:53:22.334 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.334 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.334 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:22.334 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969278+0000", 2024-04-25T22:53:22.334 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1868e-05 2024-04-25T22:53:22.335 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.335 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.335 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:22.335 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969295+0000", 2024-04-25T22:53:22.335 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7530999999999999e-05 2024-04-25T22:53:22.335 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.335 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.335 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:22.335 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974611+0000", 2024-04-25T22:53:22.335 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053160789999999996 2024-04-25T22:53:22.335 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.335 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.335 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:22.335 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974625+0000", 2024-04-25T22:53:22.336 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3943e-05 2024-04-25T22:53:22.336 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:22.336 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:22.336 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:22.336 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.336 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.336 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-25T22:53:22.336 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:22.336 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 94.146775355000003, 2024-04-25T22:53:22.336 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054952610000000004, 2024-04-25T22:53:22.336 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:22.336 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:22.337 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:22.337 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:22.337 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.337 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:22.337 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:22.337 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:22.337 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.337 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.337 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:22.337 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:22.337 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:22.337 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.337 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.337 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:22.337 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:22.338 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.68e-07 2024-04-25T22:53:22.338 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.338 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.338 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:22.338 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162898+0000", 2024-04-25T22:53:22.338 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9470999999999999e-05 2024-04-25T22:53:22.338 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.338 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.338 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:22.338 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162906+0000", 2024-04-25T22:53:22.338 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1580000000000005e-06 2024-04-25T22:53:22.338 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.338 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.339 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:22.339 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162911+0000", 2024-04-25T22:53:22.339 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4779999999999999e-06 2024-04-25T22:53:22.339 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.339 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.339 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:22.339 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162952+0000", 2024-04-25T22:53:22.339 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0629e-05 2024-04-25T22:53:22.339 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.339 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.339 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:22.339 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162968+0000", 2024-04-25T22:53:22.339 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6239000000000002e-05 2024-04-25T22:53:22.339 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.340 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.340 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:22.340 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168281+0000", 2024-04-25T22:53:22.340 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053132869999999999 2024-04-25T22:53:22.340 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.340 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.340 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:22.340 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168323+0000", 2024-04-25T22:53:22.340 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1430999999999997e-05 2024-04-25T22:53:22.340 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:22.340 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:22.340 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:22.340 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.340 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.341 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-04-25T22:53:22.341 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:22.341 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 93.716297992999998, 2024-04-25T22:53:22.341 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050872510000000001, 2024-04-25T22:53:22.341 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:22.341 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:22.341 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:22.341 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:22.341 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.341 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:22.341 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:22.341 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:22.341 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.341 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.342 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:22.342 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:22.342 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:22.342 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.342 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.342 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:22.342 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:22.342 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.72e-07 2024-04-25T22:53:22.342 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.342 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.342 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:22.342 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593381+0000", 2024-04-25T22:53:22.343 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5797000000000006e-05 2024-04-25T22:53:22.343 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.343 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.343 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:22.343 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593389+0000", 2024-04-25T22:53:22.343 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8480000000000001e-06 2024-04-25T22:53:22.343 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.343 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.343 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:22.343 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593393+0000", 2024-04-25T22:53:22.343 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4819999999999996e-06 2024-04-25T22:53:22.343 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.343 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.344 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:22.344 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593435+0000", 2024-04-25T22:53:22.344 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1600000000000002e-05 2024-04-25T22:53:22.344 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.344 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.344 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:22.344 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593454+0000", 2024-04-25T22:53:22.344 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8868e-05 2024-04-25T22:53:22.344 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.344 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.344 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:22.344 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598350+0000", 2024-04-25T22:53:22.344 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004895763 2024-04-25T22:53:22.344 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.345 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.345 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:22.345 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598392+0000", 2024-04-25T22:53:22.345 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2521000000000002e-05 2024-04-25T22:53:22.345 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:22.345 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:22.345 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:22.345 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.345 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.345 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:22.345 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:22.345 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 89.297934088999995, 2024-04-25T22:53:22.345 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:53:22.345 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:22.346 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:22.346 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:22.346 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:22.346 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.346 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:22.346 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:22.346 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:22.346 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.346 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.346 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:22.346 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:22.346 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:22.346 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.347 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.347 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:22.347 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:53:22.347 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:53:22.347 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.347 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.347 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:22.347 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:53:22.347 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:53:22.347 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.347 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.347 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:22.347 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:53:22.347 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:53:22.348 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.348 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.348 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:22.348 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:53:22.348 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:53:22.348 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.348 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.348 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:22.348 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:53:22.348 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:53:22.348 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.348 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.348 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:22.348 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:53:22.349 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:53:22.349 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.349 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.349 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:22.349 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:53:22.349 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:53:22.349 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.349 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.349 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:22.349 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:53:22.349 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:53:22.349 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.349 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.349 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:22.350 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:53:22.350 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:53:22.350 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.350 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.350 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:22.350 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:53:22.350 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:53:22.350 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.350 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.350 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:22.350 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:53:22.350 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:53:22.350 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:22.350 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:22.351 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:22.351 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.351 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.351 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:22.351 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:22.351 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 89.297259713000003, 2024-04-25T22:53:22.351 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:53:22.351 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:22.351 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:22.351 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:22.351 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:22.351 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.351 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:22.351 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:22.352 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:22.352 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.352 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.352 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:22.352 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:22.352 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:22.352 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.352 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.352 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:22.352 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:53:22.352 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:53:22.352 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.352 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.352 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:22.353 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:53:22.353 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:53:22.353 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.353 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.353 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:22.353 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:53:22.353 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:53:22.353 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.353 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.353 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:22.353 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:53:22.353 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:53:22.353 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.353 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.354 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:22.354 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:53:22.354 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:53:22.354 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.354 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.354 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:22.354 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:53:22.354 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:53:22.354 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.354 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.354 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:22.354 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:53:22.354 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:53:22.354 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.355 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.355 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:22.355 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:53:22.355 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:53:22.355 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.355 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.355 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:22.355 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:53:22.355 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:53:22.355 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.355 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.355 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:22.355 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:53:22.355 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:53:22.356 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.356 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.356 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:22.356 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:53:22.356 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:53:22.356 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:22.356 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:22.356 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:22.356 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.356 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.356 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:22.356 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:22.356 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 89.296750501000005, 2024-04-25T22:53:22.357 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:53:22.357 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:22.357 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:22.357 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:22.357 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:22.357 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.357 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:22.357 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:22.357 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:22.357 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.357 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.357 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:22.357 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:22.357 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:22.358 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.358 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.358 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:22.358 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:53:22.358 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:53:22.358 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.358 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.358 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:22.358 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:53:22.358 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:53:22.359 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.359 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.359 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:22.359 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:53:22.359 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:53:22.359 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.359 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.359 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:22.359 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:53:22.359 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:53:22.359 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.359 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.359 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:22.359 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:53:22.360 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:53:22.360 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.360 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.360 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:22.360 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:53:22.360 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:53:22.360 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.360 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.360 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:22.360 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:53:22.360 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:53:22.360 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.360 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.360 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:22.361 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:53:22.361 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:53:22.361 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.361 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.361 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:22.361 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:53:22.361 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:53:22.361 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.361 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.361 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:22.361 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:53:22.361 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:53:22.361 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.361 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.362 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:22.362 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:53:22.362 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:53:22.362 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:22.362 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:22.362 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:22.362 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.362 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.362 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:22.362 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:22.362 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 89.296337303000001, 2024-04-25T22:53:22.362 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:53:22.362 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:22.363 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:22.363 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:22.363 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:22.363 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.363 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:22.363 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:22.363 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:22.363 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.363 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.363 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:22.363 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:22.363 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:22.363 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.364 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.364 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:22.364 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:22.364 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:53:22.364 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.364 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.364 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:22.364 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:22.364 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:53:22.364 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.364 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.364 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:22.364 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:53:22.364 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:53:22.365 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.365 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.365 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:22.365 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:53:22.365 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:53:22.365 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.365 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.365 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:22.365 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:53:22.365 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:53:22.365 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.365 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.365 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:22.366 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:53:22.366 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:53:22.366 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.366 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.366 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:22.366 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:53:22.366 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:53:22.366 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.366 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.366 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:22.366 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:53:22.366 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:53:22.366 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.366 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.367 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:22.367 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:53:22.367 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:53:22.367 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.367 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.367 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:22.367 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:53:22.367 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:53:22.367 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.367 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.367 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:22.367 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:53:22.367 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:53:22.367 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:22.368 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:22.368 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:22.368 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.368 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.368 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:22.368 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:22.368 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 89.296286632999994, 2024-04-25T22:53:22.368 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:53:22.368 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:22.368 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:22.368 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:22.368 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:22.368 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.369 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:22.369 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:22.369 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:22.369 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.369 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.369 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:22.369 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:22.369 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:22.369 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.369 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.369 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:22.369 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:53:22.369 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:53:22.369 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.369 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.370 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:22.370 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:53:22.370 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:53:22.370 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.370 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.370 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:22.370 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:53:22.370 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:53:22.370 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.370 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.370 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:22.370 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:53:22.370 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:53:22.371 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.371 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.371 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:22.371 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:53:22.371 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:53:22.371 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.371 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.371 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:22.371 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:53:22.371 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:53:22.371 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.371 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.371 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:22.371 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:53:22.372 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:53:22.372 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.372 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.372 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:22.372 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:53:22.372 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:53:22.372 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.372 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.372 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:22.372 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:53:22.372 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:53:22.372 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.372 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.372 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:22.373 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:53:22.373 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:53:22.373 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.373 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.373 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:22.373 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:53:22.373 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:53:22.373 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.373 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.373 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:22.373 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:53:22.373 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:53:22.373 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.373 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.373 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:22.374 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:53:22.374 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:53:22.374 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:22.374 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:22.374 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:22.374 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.374 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.374 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:22.374 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:22.374 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 89.296249763999995, 2024-04-25T22:53:22.374 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:53:22.374 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:22.374 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:22.375 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:22.375 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:22.375 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.375 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:22.375 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:22.375 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:22.375 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.375 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.375 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:22.375 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:22.375 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:22.375 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.375 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.375 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:22.376 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:53:22.376 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:53:22.376 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.376 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.376 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:22.376 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:53:22.376 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:53:22.376 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.376 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.376 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:22.376 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:53:22.376 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:53:22.376 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.376 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.377 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:22.377 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:53:22.377 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:53:22.377 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.377 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.377 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:22.377 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:53:22.377 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:53:22.377 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.377 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.377 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:53:22.377 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:53:22.377 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:53:22.377 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.378 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.378 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:22.378 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:53:22.378 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:53:22.378 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.378 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.378 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:22.378 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:53:22.378 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:53:22.378 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.378 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.378 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:22.378 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:53:22.378 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:53:22.379 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.379 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.379 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:22.379 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:53:22.379 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:53:22.379 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.379 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.379 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:22.379 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:53:22.379 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:53:22.379 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.379 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.379 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:22.379 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:53:22.380 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:53:22.380 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.380 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.380 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:22.380 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:53:22.380 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:53:22.380 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:22.380 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:22.380 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:22.380 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.380 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.380 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:22.380 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:22.381 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 89.296224797999997, 2024-04-25T22:53:22.381 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:53:22.381 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:22.381 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:22.381 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:22.381 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:22.381 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.381 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:22.381 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:22.381 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:22.381 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.381 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.381 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:22.381 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:22.382 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:22.382 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.382 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.382 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:22.382 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:53:22.382 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:53:22.382 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.382 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.382 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:22.382 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:53:22.382 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:53:22.382 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.382 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.382 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:22.383 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:22.383 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:53:22.383 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.383 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.383 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:22.383 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:53:22.383 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:53:22.383 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.383 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.383 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:22.383 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:53:22.383 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:53:22.383 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.384 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.384 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:22.384 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:53:22.384 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:53:22.384 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.384 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.384 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:22.384 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:53:22.384 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:53:22.384 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.384 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.384 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:22.384 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:53:22.384 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:53:22.385 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.385 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.385 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:22.385 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:53:22.385 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:53:22.385 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.385 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.385 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:22.385 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:53:22.385 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:53:22.385 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.385 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.385 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:22.385 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:53:22.386 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:53:22.386 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:22.386 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:22.386 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:22.386 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.386 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.386 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:22.386 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:22.386 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 89.296188434000001, 2024-04-25T22:53:22.386 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:53:22.386 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:22.386 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:22.386 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:22.386 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:22.387 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.387 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:22.387 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:22.387 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:22.387 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.387 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.387 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:22.387 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:22.387 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:22.387 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.387 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.387 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:22.387 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:53:22.387 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:53:22.388 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.388 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.388 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:22.388 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:53:22.388 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:53:22.388 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.388 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.388 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:22.388 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:53:22.388 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:53:22.388 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.388 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.388 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:22.389 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:53:22.389 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:53:22.389 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.389 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.389 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:22.389 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:53:22.389 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:53:22.389 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.389 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.389 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:22.389 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:53:22.389 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:53:22.389 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.389 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.390 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:22.390 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:53:22.390 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:53:22.390 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.390 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.390 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:22.390 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:53:22.390 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:53:22.390 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.390 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.390 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:22.390 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:53:22.390 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:53:22.390 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:22.391 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:22.391 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:22.391 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.391 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.391 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:22.391 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:22.391 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 89.296157352999998, 2024-04-25T22:53:22.391 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:53:22.391 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:22.391 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:22.391 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:22.391 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:22.391 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.392 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:22.392 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:22.392 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:22.392 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.392 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.392 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:22.392 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:22.392 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:22.392 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.392 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.392 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:22.392 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:22.392 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:22.392 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.392 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.393 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:22.393 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:53:22.393 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:53:22.393 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.393 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.393 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:22.393 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:53:22.393 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:53:22.393 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.393 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.394 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:22.394 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:53:22.394 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:53:22.394 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.394 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.394 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:22.394 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:53:22.394 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:53:22.394 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.394 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.394 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:22.394 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:53:22.394 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:53:22.395 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.395 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.395 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:22.395 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:53:22.395 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:53:22.395 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:22.395 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:22.395 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:22.395 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.395 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.395 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:53:22.395 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:22.395 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 89.295716384000002, 2024-04-25T22:53:22.396 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064881979999999997, 2024-04-25T22:53:22.396 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:22.396 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:22.396 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:22.396 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:22.396 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.396 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:22.396 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:22.396 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:22.396 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.396 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.396 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:22.396 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:22.396 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:22.397 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.397 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.397 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:22.397 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:22.397 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2699999999999999e-07 2024-04-25T22:53:22.397 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.397 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.397 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:22.397 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013898+0000", 2024-04-25T22:53:22.397 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0796e-05 2024-04-25T22:53:22.397 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.397 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.397 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:22.397 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013907+0000", 2024-04-25T22:53:22.398 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5140000000000007e-06 2024-04-25T22:53:22.398 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.398 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.398 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:22.398 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013952+0000", 2024-04-25T22:53:22.398 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4134000000000001e-05 2024-04-25T22:53:22.398 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.398 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.398 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:22.398 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016812+0000", 2024-04-25T22:53:22.398 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028601059999999998 2024-04-25T22:53:22.398 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.398 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.399 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:22.399 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.017052+0000", 2024-04-25T22:53:22.399 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024056500000000001 2024-04-25T22:53:22.399 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.399 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.399 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:22.399 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020350+0000", 2024-04-25T22:53:22.399 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032978320000000001 2024-04-25T22:53:22.399 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.399 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.399 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:22.399 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020375+0000", 2024-04-25T22:53:22.399 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4624e-05 2024-04-25T22:53:22.400 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:22.400 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:22.400 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:22.400 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.400 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.400 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-25T22:53:22.400 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:22.400 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 89.282185937999998, 2024-04-25T22:53:22.400 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058583000000000003, 2024-04-25T22:53:22.400 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:22.400 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:22.400 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:22.400 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:22.401 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.401 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:22.401 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:22.401 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:22.401 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.401 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.401 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:22.401 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:22.401 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:22.401 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.401 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.402 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:22.402 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:22.402 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.41e-07 2024-04-25T22:53:22.402 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.402 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.402 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:22.402 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027428+0000", 2024-04-25T22:53:22.402 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.075e-05 2024-04-25T22:53:22.402 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.402 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.402 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:22.402 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027435+0000", 2024-04-25T22:53:22.402 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3610000000000003e-06 2024-04-25T22:53:22.403 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.403 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.403 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:22.403 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027442+0000", 2024-04-25T22:53:22.403 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0400000000000004e-06 2024-04-25T22:53:22.403 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.403 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.403 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:22.403 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028094+0000", 2024-04-25T22:53:22.403 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00065134800000000005 2024-04-25T22:53:22.403 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.403 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.403 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:22.403 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028107+0000", 2024-04-25T22:53:22.404 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3087e-05 2024-04-25T22:53:22.404 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.404 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.404 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:22.404 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033239+0000", 2024-04-25T22:53:22.404 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051319429999999999 2024-04-25T22:53:22.404 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.404 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.404 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:22.404 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033275+0000", 2024-04-25T22:53:22.404 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6430000000000002e-05 2024-04-25T22:53:22.404 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:22.404 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:22.404 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:22.405 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.405 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.405 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-25T22:53:22.405 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:22.405 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 89.281801100999999, 2024-04-25T22:53:22.405 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005413597, 2024-04-25T22:53:22.405 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:22.405 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:22.405 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:22.405 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:22.405 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.405 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:22.405 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:22.405 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:22.406 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.406 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.406 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:22.406 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:22.406 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:22.406 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.406 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.406 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:22.406 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:22.406 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3799999999999997e-07 2024-04-25T22:53:22.406 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.406 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.406 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:22.407 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027816+0000", 2024-04-25T22:53:22.407 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3230999999999999e-05 2024-04-25T22:53:22.407 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.407 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.407 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:22.407 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027823+0000", 2024-04-25T22:53:22.407 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9039999999999992e-06 2024-04-25T22:53:22.407 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.407 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.407 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:22.407 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027841+0000", 2024-04-25T22:53:22.407 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7651000000000001e-05 2024-04-25T22:53:22.407 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.408 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.408 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:22.408 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027904+0000", 2024-04-25T22:53:22.408 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3058000000000005e-05 2024-04-25T22:53:22.408 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.408 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.408 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:22.408 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027926+0000", 2024-04-25T22:53:22.408 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1450999999999998e-05 2024-04-25T22:53:22.408 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.408 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.408 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:22.408 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033177+0000", 2024-04-25T22:53:22.408 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052508909999999997 2024-04-25T22:53:22.409 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.409 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.409 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:22.409 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033215+0000", 2024-04-25T22:53:22.409 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8872999999999999e-05 2024-04-25T22:53:22.409 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:22.409 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:22.409 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:22.409 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.409 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.409 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 171 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:53:22.409 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:22.409 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 89.281743999, 2024-04-25T22:53:22.410 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054322240000000003, 2024-04-25T22:53:22.410 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:22.410 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:22.410 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "reached pg", 2024-04-25T22:53:22.410 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:22.410 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.410 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:22.410 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:22.410 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:22.410 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.410 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.410 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:22.411 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:22.411 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:22.411 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.411 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.411 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:22.411 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:22.411 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7500000000000001e-07 2024-04-25T22:53:22.411 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.411 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.411 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:22.411 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027868+0000", 2024-04-25T22:53:22.411 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5750000000000001e-06 2024-04-25T22:53:22.411 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.411 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.412 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:22.412 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027885+0000", 2024-04-25T22:53:22.412 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7272e-05 2024-04-25T22:53:22.412 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.412 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.412 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:22.412 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027900+0000", 2024-04-25T22:53:22.412 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.502e-05 2024-04-25T22:53:22.412 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.412 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.412 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:22.412 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028381+0000", 2024-04-25T22:53:22.412 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00048039399999999998 2024-04-25T22:53:22.413 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:22.413 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:22.413 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:22.413 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033291+0000", 2024-04-25T22:53:22.413 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049105879999999996 2024-04-25T22:53:22.413 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:22.413 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:22.413 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:22.413 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:22.413 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:22.413 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:22.415 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:22.414+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:22.415 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:22.516 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:22.516+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:22.518 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:22.518 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:22.519 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-04-25T22:53:22.519 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:22.527 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:22.617 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:22.617+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:22.630 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:22.630 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:22.630 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:53:22.630 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:53:22.630 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:22.638 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:22.717 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:22.717+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:22.741 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:22.741 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-04-25T22:53:22.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-04-25T22:53:22.741 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:53:22.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.742 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:22.742 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:22.742 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 94.774232476999998, 2024-04-25T22:53:22.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0103421, 2024-04-25T22:53:22.742 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:22.742 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:22.742 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:22.742 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:22.742 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:22.742 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:22.742 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 115 2024-04-25T22:53:22.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.743 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:22.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:22.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:22.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:22.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:22.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:22.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:22.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:22.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:22.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9500000000000002e-07 2024-04-25T22:53:22.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:22.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965108+0000", 2024-04-25T22:53:22.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9177999999999994e-05 2024-04-25T22:53:22.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:22.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965127+0000", 2024-04-25T22:53:22.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8868e-05 2024-04-25T22:53:22.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:22.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965133+0000", 2024-04-25T22:53:22.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8929999999999999e-06 2024-04-25T22:53:22.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:22.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.969991+0000", 2024-04-25T22:53:22.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048573849999999997 2024-04-25T22:53:22.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:22.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970072+0000", 2024-04-25T22:53:22.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0728000000000004e-05 2024-04-25T22:53:22.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:22.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970189+0000", 2024-04-25T22:53:22.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000117778 2024-04-25T22:53:22.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:22.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970946+0000", 2024-04-25T22:53:22.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00075704600000000004 2024-04-25T22:53:22.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:22.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975297+0000", 2024-04-25T22:53:22.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004350217 2024-04-25T22:53:22.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:22.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975343+0000", 2024-04-25T22:53:22.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6687999999999998e-05 2024-04-25T22:53:22.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:22.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975380+0000", 2024-04-25T22:53:22.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6724000000000003e-05 2024-04-25T22:53:22.748 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:22.748 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:22.748 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:22.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.748 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:22.748 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:22.748 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 94.774126445999997, 2024-04-25T22:53:22.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010304384, 2024-04-25T22:53:22.748 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:22.748 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:22.748 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:22.748 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:22.748 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:22.749 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:22.749 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 116 2024-04-25T22:53:22.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.749 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:22.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:22.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:22.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:22.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:22.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:22.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:22.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:22.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:22.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5799999999999999e-07 2024-04-25T22:53:22.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:22.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965154+0000", 2024-04-25T22:53:22.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0009e-05 2024-04-25T22:53:22.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:22.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965164+0000", 2024-04-25T22:53:22.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8490000000000001e-06 2024-04-25T22:53:22.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:22.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965169+0000", 2024-04-25T22:53:22.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0730000000000004e-06 2024-04-25T22:53:22.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:22.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970609+0000", 2024-04-25T22:53:22.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054397689999999997 2024-04-25T22:53:22.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:22.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970651+0000", 2024-04-25T22:53:22.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1873999999999999e-05 2024-04-25T22:53:22.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:22.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970723+0000", 2024-04-25T22:53:22.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2039999999999995e-05 2024-04-25T22:53:22.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:22.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971358+0000", 2024-04-25T22:53:22.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063489500000000001 2024-04-25T22:53:22.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:22.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975409+0000", 2024-04-25T22:53:22.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040506880000000002 2024-04-25T22:53:22.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:22.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975432+0000", 2024-04-25T22:53:22.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3315999999999998e-05 2024-04-25T22:53:22.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:22.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975448+0000", 2024-04-25T22:53:22.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6313000000000001e-05 2024-04-25T22:53:22.753 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:22.754 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:22.754 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:22.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.754 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:22.754 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:22.754 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 94.774091863999999, 2024-04-25T22:53:22.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010384338999999999, 2024-04-25T22:53:22.754 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:22.754 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:22.754 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:22.754 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:22.754 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:22.754 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:22.755 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-04-25T22:53:22.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.755 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:22.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:22.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:22.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:22.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:22.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:22.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:22.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:22.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:22.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3600000000000004e-07 2024-04-25T22:53:22.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:22.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965185+0000", 2024-04-25T22:53:22.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.117e-06 2024-04-25T22:53:22.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:22.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965192+0000", 2024-04-25T22:53:22.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3239999999999997e-06 2024-04-25T22:53:22.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:22.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965198+0000", 2024-04-25T22:53:22.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6370000000000004e-06 2024-04-25T22:53:22.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:22.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970973+0000", 2024-04-25T22:53:22.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057748239999999996 2024-04-25T22:53:22.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:22.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971049+0000", 2024-04-25T22:53:22.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6029e-05 2024-04-25T22:53:22.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:22.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971174+0000", 2024-04-25T22:53:22.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012462399999999999 2024-04-25T22:53:22.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:22.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971553+0000", 2024-04-25T22:53:22.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037896499999999999 2024-04-25T22:53:22.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:22.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975482+0000", 2024-04-25T22:53:22.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039297459999999996 2024-04-25T22:53:22.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:22.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975529+0000", 2024-04-25T22:53:22.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6387000000000002e-05 2024-04-25T22:53:22.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:22.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975563+0000", 2024-04-25T22:53:22.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4150000000000003e-05 2024-04-25T22:53:22.759 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:22.760 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:22.760 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:22.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.760 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:22.760 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:22.760 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 89.727045540999995, 2024-04-25T22:53:22.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012637705000000001, 2024-04-25T22:53:22.760 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:22.760 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:22.760 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:22.760 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:22.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:22.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:22.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:22.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:22.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:22.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:22.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:22.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012227+0000", 2024-04-25T22:53:22.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.863e-06 2024-04-25T22:53:22.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:22.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012236+0000", 2024-04-25T22:53:22.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1109999999999997e-06 2024-04-25T22:53:22.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:22.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012309+0000", 2024-04-25T22:53:22.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3242000000000001e-05 2024-04-25T22:53:22.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:22.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012324+0000", 2024-04-25T22:53:22.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4837e-05 2024-04-25T22:53:22.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:22.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015060+0000", 2024-04-25T22:53:22.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027363349999999999 2024-04-25T22:53:22.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:22.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015169+0000", 2024-04-25T22:53:22.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108372 2024-04-25T22:53:22.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:22.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015498+0000", 2024-04-25T22:53:22.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032949999999999999 2024-04-25T22:53:22.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:22.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021282+0000", 2024-04-25T22:53:22.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057836429999999998 2024-04-25T22:53:22.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:22.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024709+0000", 2024-04-25T22:53:22.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034271979999999998 2024-04-25T22:53:22.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:22.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024802+0000", 2024-04-25T22:53:22.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2960000000000004e-05 2024-04-25T22:53:22.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:22.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024863+0000", 2024-04-25T22:53:22.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0643999999999997e-05 2024-04-25T22:53:22.765 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:22.765 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:22.765 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:22.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.766 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:22.766 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:22.766 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 89.726921770000004, 2024-04-25T22:53:22.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012979447999999999, 2024-04-25T22:53:22.766 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:22.766 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:22.766 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:22.766 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:22.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:22.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:22.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:22.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:22.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:22.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:22.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:22.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:22.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:53:22.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:22.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012354+0000", 2024-04-25T22:53:22.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7740000000000004e-06 2024-04-25T22:53:22.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:22.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012365+0000", 2024-04-25T22:53:22.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.064e-05 2024-04-25T22:53:22.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:22.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012382+0000", 2024-04-25T22:53:22.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6999000000000001e-05 2024-04-25T22:53:22.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:22.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015958+0000", 2024-04-25T22:53:22.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035765699999999998 2024-04-25T22:53:22.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:22.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016037+0000", 2024-04-25T22:53:22.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8242000000000001e-05 2024-04-25T22:53:22.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:22.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016404+0000", 2024-04-25T22:53:22.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036784300000000002 2024-04-25T22:53:22.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:22.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021294+0000", 2024-04-25T22:53:22.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048890629999999999 2024-04-25T22:53:22.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:22.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024959+0000", 2024-04-25T22:53:22.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036651570000000001 2024-04-25T22:53:22.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:22.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025097+0000", 2024-04-25T22:53:22.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013788099999999999 2024-04-25T22:53:22.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:22.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025328+0000", 2024-04-25T22:53:22.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231492 2024-04-25T22:53:22.771 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:22.771 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:22.771 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:22.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.771 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:22.771 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:22.771 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 89.726834001, 2024-04-25T22:53:22.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013049827, 2024-04-25T22:53:22.772 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:22.772 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:22.772 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:22.772 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:22.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:22.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:22.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:22.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:22.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:22.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:22.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:22.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012437+0000", 2024-04-25T22:53:22.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-04-25T22:53:22.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:22.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012440+0000", 2024-04-25T22:53:22.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7609999999999999e-06 2024-04-25T22:53:22.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:22.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012449+0000", 2024-04-25T22:53:22.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.285e-06 2024-04-25T22:53:22.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:22.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012457+0000", 2024-04-25T22:53:22.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9510000000000006e-06 2024-04-25T22:53:22.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:22.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017106+0000", 2024-04-25T22:53:22.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046494220000000003 2024-04-25T22:53:22.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:22.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017223+0000", 2024-04-25T22:53:22.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116824 2024-04-25T22:53:22.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:22.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017345+0000", 2024-04-25T22:53:22.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122175 2024-04-25T22:53:22.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:22.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021299+0000", 2024-04-25T22:53:22.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039534879999999998 2024-04-25T22:53:22.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:22.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025398+0000", 2024-04-25T22:53:22.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040988960000000003 2024-04-25T22:53:22.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:22.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025439+0000", 2024-04-25T22:53:22.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0915999999999999e-05 2024-04-25T22:53:22.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:22.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025486+0000", 2024-04-25T22:53:22.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7534999999999998e-05 2024-04-25T22:53:22.777 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:22.777 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:22.777 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:22.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.777 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:22.777 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:22.777 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 89.726803849999996, 2024-04-25T22:53:22.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020988041999999998, 2024-04-25T22:53:22.778 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:22.778 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:22.778 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:22.778 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:22.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:22.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:22.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:22.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:22.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:22.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:22.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:22.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:22.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.99e-07 2024-04-25T22:53:22.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:22.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012470+0000", 2024-04-25T22:53:22.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2789999999999999e-06 2024-04-25T22:53:22.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:22.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012477+0000", 2024-04-25T22:53:22.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:53:22.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:22.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012500+0000", 2024-04-25T22:53:22.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2490999999999999e-05 2024-04-25T22:53:22.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:22.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021911+0000", 2024-04-25T22:53:22.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094114160000000006 2024-04-25T22:53:22.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:22.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022000+0000", 2024-04-25T22:53:22.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8601000000000001e-05 2024-04-25T22:53:22.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:22.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022359+0000", 2024-04-25T22:53:22.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035921999999999999 2024-04-25T22:53:22.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:22.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025541+0000", 2024-04-25T22:53:22.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031820619999999998 2024-04-25T22:53:22.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:22.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033375+0000", 2024-04-25T22:53:22.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078338379999999992 2024-04-25T22:53:22.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:22.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033415+0000", 2024-04-25T22:53:22.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9527000000000003e-05 2024-04-25T22:53:22.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:22.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033455+0000", 2024-04-25T22:53:22.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9932000000000003e-05 2024-04-25T22:53:22.783 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:22.783 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:22.783 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:22.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.783 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:22.783 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:22.783 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 89.726748657000002, 2024-04-25T22:53:22.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021043857999999999, 2024-04-25T22:53:22.783 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:22.783 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:22.783 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:22.783 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:22.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:22.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:22.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:22.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:22.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:22.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:22.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:22.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012523+0000", 2024-04-25T22:53:22.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.361e-06 2024-04-25T22:53:22.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:22.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012530+0000", 2024-04-25T22:53:22.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5440000000000004e-06 2024-04-25T22:53:22.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:22.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012541+0000", 2024-04-25T22:53:22.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1745e-05 2024-04-25T22:53:22.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:22.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012551+0000", 2024-04-25T22:53:22.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5789999999999993e-06 2024-04-25T22:53:22.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:22.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022709+0000", 2024-04-25T22:53:22.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010157685 2024-04-25T22:53:22.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:22.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022957+0000", 2024-04-25T22:53:22.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024824599999999998 2024-04-25T22:53:22.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:22.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023443+0000", 2024-04-25T22:53:22.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048578599999999999 2024-04-25T22:53:22.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:22.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025547+0000", 2024-04-25T22:53:22.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021044789999999998 2024-04-25T22:53:22.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:22.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033509+0000", 2024-04-25T22:53:22.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0079622180000000001 2024-04-25T22:53:22.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:22.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033542+0000", 2024-04-25T22:53:22.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3018000000000001e-05 2024-04-25T22:53:22.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:22.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033566+0000", 2024-04-25T22:53:22.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3197000000000002e-05 2024-04-25T22:53:22.789 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:22.789 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:22.789 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:22.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.789 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:22.789 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:22.789 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 89.726708692000003, 2024-04-25T22:53:22.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021122696, 2024-04-25T22:53:22.790 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:22.790 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:22.790 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:22.790 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:22.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:22.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:22.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:22.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:22.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:22.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:22.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:22.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:22.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:53:22.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:22.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012566+0000", 2024-04-25T22:53:22.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-04-25T22:53:22.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:22.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012619+0000", 2024-04-25T22:53:22.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2607e-05 2024-04-25T22:53:22.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:22.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012628+0000", 2024-04-25T22:53:22.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6500000000000008e-06 2024-04-25T22:53:22.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:22.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024024+0000", 2024-04-25T22:53:22.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011396007999999999 2024-04-25T22:53:22.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:22.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024198+0000", 2024-04-25T22:53:22.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000173215 2024-04-25T22:53:22.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:22.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024447+0000", 2024-04-25T22:53:22.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024898500000000002 2024-04-25T22:53:22.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:22.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026431+0000", 2024-04-25T22:53:22.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001984923 2024-04-25T22:53:22.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:22.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033608+0000", 2024-04-25T22:53:22.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071768459999999997 2024-04-25T22:53:22.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:22.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033646+0000", 2024-04-25T22:53:22.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299000000000003e-05 2024-04-25T22:53:22.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:22.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033684+0000", 2024-04-25T22:53:22.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8773000000000003e-05 2024-04-25T22:53:22.795 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:22.795 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:22.795 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:22.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.795 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:22.795 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:22.795 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 89.726620092999994, 2024-04-25T22:53:22.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021175381, 2024-04-25T22:53:22.795 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:22.795 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:22.795 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:22.795 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:22.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:22.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:22.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:22.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:22.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:22.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:22.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:22.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012651+0000", 2024-04-25T22:53:22.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:53:22.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:22.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012656+0000", 2024-04-25T22:53:22.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8899999999999998e-06 2024-04-25T22:53:22.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:22.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012666+0000", 2024-04-25T22:53:22.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0346999999999999e-05 2024-04-25T22:53:22.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:22.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012675+0000", 2024-04-25T22:53:22.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9930000000000001e-06 2024-04-25T22:53:22.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:22.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025661+0000", 2024-04-25T22:53:22.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01298531 2024-04-25T22:53:22.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:22.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025757+0000", 2024-04-25T22:53:22.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5822000000000005e-05 2024-04-25T22:53:22.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:22.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025907+0000", 2024-04-25T22:53:22.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015051499999999999 2024-04-25T22:53:22.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:22.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026435+0000", 2024-04-25T22:53:22.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052762200000000005 2024-04-25T22:53:22.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:22.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033732+0000", 2024-04-25T22:53:22.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072978419999999997 2024-04-25T22:53:22.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:22.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033787+0000", 2024-04-25T22:53:22.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4703999999999997e-05 2024-04-25T22:53:22.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:22.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033826+0000", 2024-04-25T22:53:22.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8458999999999999e-05 2024-04-25T22:53:22.800 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:22.800 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:22.800 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:22.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.801 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:22.801 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:22.801 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 89.726564679000006, 2024-04-25T22:53:22.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021244174000000001, 2024-04-25T22:53:22.801 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:22.801 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:22.801 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:22.801 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:22.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:22.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:22.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:22.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:22.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:22.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:22.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:22.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:22.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:22.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:22.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012712+0000", 2024-04-25T22:53:22.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.913e-06 2024-04-25T22:53:22.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:22.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012722+0000", 2024-04-25T22:53:22.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2879999999999998e-06 2024-04-25T22:53:22.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:22.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012727+0000", 2024-04-25T22:53:22.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8429999999999998e-06 2024-04-25T22:53:22.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:22.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026099+0000", 2024-04-25T22:53:22.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013371450999999999 2024-04-25T22:53:22.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:22.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026147+0000", 2024-04-25T22:53:22.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7837999999999998e-05 2024-04-25T22:53:22.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:22.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026254+0000", 2024-04-25T22:53:22.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107314 2024-04-25T22:53:22.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:22.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026686+0000", 2024-04-25T22:53:22.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000432428 2024-04-25T22:53:22.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:22.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033873+0000", 2024-04-25T22:53:22.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071864399999999997 2024-04-25T22:53:22.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:22.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033904+0000", 2024-04-25T22:53:22.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1321e-05 2024-04-25T22:53:22.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:22.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033950+0000", 2024-04-25T22:53:22.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5707999999999997e-05 2024-04-25T22:53:22.806 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:22.806 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:22.806 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:22.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.806 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:22.806 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:22.806 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 89.726534294000004, 2024-04-25T22:53:22.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01096505, 2024-04-25T22:53:22.807 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:22.807 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:22.807 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:22.807 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:22.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:22.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:22.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:22.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:22.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:22.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:22.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:22.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012737+0000", 2024-04-25T22:53:22.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:22.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:22.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012739+0000", 2024-04-25T22:53:22.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-04-25T22:53:22.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:22.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012743+0000", 2024-04-25T22:53:22.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3239999999999996e-06 2024-04-25T22:53:22.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:22.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012746+0000", 2024-04-25T22:53:22.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.129e-06 2024-04-25T22:53:22.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:22.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012796+0000", 2024-04-25T22:53:22.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9231999999999999e-05 2024-04-25T22:53:22.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:22.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012915+0000", 2024-04-25T22:53:22.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119021 2024-04-25T22:53:22.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:22.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013069+0000", 2024-04-25T22:53:22.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015463900000000001 2024-04-25T22:53:22.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:22.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019237+0000", 2024-04-25T22:53:22.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061680329999999998 2024-04-25T22:53:22.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:22.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023603+0000", 2024-04-25T22:53:22.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043655860000000003 2024-04-25T22:53:22.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:22.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023659+0000", 2024-04-25T22:53:22.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6484000000000003e-05 2024-04-25T22:53:22.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:22.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023701+0000", 2024-04-25T22:53:22.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1761999999999998e-05 2024-04-25T22:53:22.812 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:22.812 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:22.812 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:22.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.812 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:22.812 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:22.812 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 89.726509346, 2024-04-25T22:53:22.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011234429000000001, 2024-04-25T22:53:22.812 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:22.812 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:22.813 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:22.813 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:22.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:22.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:22.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:22.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:22.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:22.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:22.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:22.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012762+0000", 2024-04-25T22:53:22.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-04-25T22:53:22.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:22.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012765+0000", 2024-04-25T22:53:22.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2569999999999999e-06 2024-04-25T22:53:22.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:22.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012783+0000", 2024-04-25T22:53:22.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8431999999999999e-05 2024-04-25T22:53:22.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:22.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012799+0000", 2024-04-25T22:53:22.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5438999999999999e-05 2024-04-25T22:53:22.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:22.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013826+0000", 2024-04-25T22:53:22.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010275060000000001 2024-04-25T22:53:22.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:22.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013913+0000", 2024-04-25T22:53:22.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.708e-05 2024-04-25T22:53:22.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:22.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014098+0000", 2024-04-25T22:53:22.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018519399999999999 2024-04-25T22:53:22.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:22.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019684+0000", 2024-04-25T22:53:22.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055860079999999999 2024-04-25T22:53:22.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:22.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023876+0000", 2024-04-25T22:53:22.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041918800000000003 2024-04-25T22:53:22.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:22.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023957+0000", 2024-04-25T22:53:22.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1165e-05 2024-04-25T22:53:22.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:22.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023995+0000", 2024-04-25T22:53:22.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:53:22.817 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:22.817 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:22.818 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:22.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.818 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:22.818 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:22.818 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 89.726411567, 2024-04-25T22:53:22.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011131200000000001, 2024-04-25T22:53:22.818 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:22.818 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:22.818 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:22.818 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:22.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:22.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:22.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:22.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:22.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:22.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:22.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:22.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012860+0000", 2024-04-25T22:53:22.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3900000000000004e-07 2024-04-25T22:53:22.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:22.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012865+0000", 2024-04-25T22:53:22.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5609999999999998e-06 2024-04-25T22:53:22.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:22.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012895+0000", 2024-04-25T22:53:22.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9847000000000001e-05 2024-04-25T22:53:22.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:22.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012905+0000", 2024-04-25T22:53:22.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.03e-05 2024-04-25T22:53:22.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:22.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015020+0000", 2024-04-25T22:53:22.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021142940000000001 2024-04-25T22:53:22.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:22.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015182+0000", 2024-04-25T22:53:22.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016248099999999999 2024-04-25T22:53:22.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:22.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015357+0000", 2024-04-25T22:53:22.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017471000000000001 2024-04-25T22:53:22.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.822 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:22.822 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021021+0000", 2024-04-25T22:53:22.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056638340000000004 2024-04-25T22:53:22.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.822 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:22.822 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023712+0000", 2024-04-25T22:53:22.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026910380000000002 2024-04-25T22:53:22.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:22.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023763+0000", 2024-04-25T22:53:22.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1477999999999997e-05 2024-04-25T22:53:22.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:22.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023990+0000", 2024-04-25T22:53:22.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000226818 2024-04-25T22:53:22.823 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:22.823 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:22.823 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:22.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.823 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:22.824 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:22.824 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 89.726288471000004, 2024-04-25T22:53:22.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011705299000000001, 2024-04-25T22:53:22.824 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:22.824 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:22.824 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:22.824 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:22.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:22.824 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:22.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:22.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:22.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:22.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:22.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:22.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012983+0000", 2024-04-25T22:53:22.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:53:22.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:22.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012986+0000", 2024-04-25T22:53:22.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5700000000000001e-06 2024-04-25T22:53:22.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:22.826 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012993+0000", 2024-04-25T22:53:22.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8730000000000001e-06 2024-04-25T22:53:22.826 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.826 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.826 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:22.826 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013000+0000", 2024-04-25T22:53:22.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1890000000000001e-06 2024-04-25T22:53:22.826 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.829 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:22.830 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:53:22.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002147866 2024-04-25T22:53:22.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.830 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:22.830 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015351+0000", 2024-04-25T22:53:22.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020300799999999999 2024-04-25T22:53:22.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.830 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:22.830 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016260+0000", 2024-04-25T22:53:22.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00090926799999999997 2024-04-25T22:53:22.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.831 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.831 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:22.831 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022669+0000", 2024-04-25T22:53:22.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064082849999999997 2024-04-25T22:53:22.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.831 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.831 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:22.831 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024584+0000", 2024-04-25T22:53:22.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019151699999999999 2024-04-25T22:53:22.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.831 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.831 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:22.831 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024643+0000", 2024-04-25T22:53:22.832 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8888999999999998e-05 2024-04-25T22:53:22.832 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.832 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:22.832 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024687+0000", 2024-04-25T22:53:22.832 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4444999999999999e-05 2024-04-25T22:53:22.832 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:22.832 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:22.832 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:22.832 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.832 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:22.832 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:22.832 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 89.726260879999998, 2024-04-25T22:53:22.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011249699, 2024-04-25T22:53:22.833 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:22.833 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:22.833 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:22.833 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:22.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.833 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:22.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:22.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:22.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.833 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:22.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:22.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:22.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:22.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013010+0000", 2024-04-25T22:53:22.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2099999999999996e-07 2024-04-25T22:53:22.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:22.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013013+0000", 2024-04-25T22:53:22.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1310000000000002e-06 2024-04-25T22:53:22.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:22.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013020+0000", 2024-04-25T22:53:22.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3330000000000002e-06 2024-04-25T22:53:22.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:22.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013025+0000", 2024-04-25T22:53:22.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6760000000000004e-06 2024-04-25T22:53:22.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:22.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013163+0000", 2024-04-25T22:53:22.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013824599999999999 2024-04-25T22:53:22.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.836 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:22.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013504+0000", 2024-04-25T22:53:22.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034080299999999998 2024-04-25T22:53:22.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.836 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:22.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013613+0000", 2024-04-25T22:53:22.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108705 2024-04-25T22:53:22.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.836 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:22.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015831+0000", 2024-04-25T22:53:22.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002217672 2024-04-25T22:53:22.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:22.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024137+0000", 2024-04-25T22:53:22.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0083060489999999994 2024-04-25T22:53:22.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:22.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024218+0000", 2024-04-25T22:53:22.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1351000000000001e-05 2024-04-25T22:53:22.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:22.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024259+0000", 2024-04-25T22:53:22.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1112000000000002e-05 2024-04-25T22:53:22.838 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:22.838 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:22.838 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:22.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.838 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:22.838 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:22.838 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 89.726173153999994, 2024-04-25T22:53:22.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020379749999999999, 2024-04-25T22:53:22.838 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:22.838 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:22.838 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:22.838 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:22.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:22.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:22.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:22.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:22.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:22.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:22.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:22.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013098+0000", 2024-04-25T22:53:22.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:53:22.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:22.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013105+0000", 2024-04-25T22:53:22.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5969999999999997e-06 2024-04-25T22:53:22.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:22.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013190+0000", 2024-04-25T22:53:22.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5618999999999995e-05 2024-04-25T22:53:22.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:22.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013200+0000", 2024-04-25T22:53:22.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5859999999999994e-06 2024-04-25T22:53:22.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:22.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020265+0000", 2024-04-25T22:53:22.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070653349999999998 2024-04-25T22:53:22.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:22.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020454+0000", 2024-04-25T22:53:22.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189316 2024-04-25T22:53:22.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:22.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020586+0000", 2024-04-25T22:53:22.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013195700000000001 2024-04-25T22:53:22.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:22.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023822+0000", 2024-04-25T22:53:22.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032358529999999999 2024-04-25T22:53:22.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:22.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033409+0000", 2024-04-25T22:53:22.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095870520000000004 2024-04-25T22:53:22.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:22.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033447+0000", 2024-04-25T22:53:22.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7261999999999997e-05 2024-04-25T22:53:22.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:22.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033477+0000", 2024-04-25T22:53:22.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0389e-05 2024-04-25T22:53:22.843 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:22.844 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:22.844 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:22.844 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.844 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:22.844 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:22.844 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 89.726056647999997, 2024-04-25T22:53:22.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010857383999999999, 2024-04-25T22:53:22.844 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:22.844 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:22.844 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:22.844 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:22.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:22.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:22.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:22.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:22.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:22.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:22.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:22.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:22.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:22.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:22.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013218+0000", 2024-04-25T22:53:22.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8199999999999998e-06 2024-04-25T22:53:22.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:22.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013226+0000", 2024-04-25T22:53:22.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7649999999999993e-06 2024-04-25T22:53:22.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:22.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013259+0000", 2024-04-25T22:53:22.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2727e-05 2024-04-25T22:53:22.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:22.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014809+0000", 2024-04-25T22:53:22.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001550144 2024-04-25T22:53:22.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:22.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014958+0000", 2024-04-25T22:53:22.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014890300000000001 2024-04-25T22:53:22.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:22.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015087+0000", 2024-04-25T22:53:22.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012939200000000001 2024-04-25T22:53:22.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:22.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020212+0000", 2024-04-25T22:53:22.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051248939999999996 2024-04-25T22:53:22.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:22.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023699+0000", 2024-04-25T22:53:22.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034873289999999999 2024-04-25T22:53:22.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.849 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:22.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024014+0000", 2024-04-25T22:53:22.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031473999999999999 2024-04-25T22:53:22.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.849 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:22.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024071+0000", 2024-04-25T22:53:22.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7040000000000003e-05 2024-04-25T22:53:22.849 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:22.849 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:22.849 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:22.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.850 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:22.850 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:22.850 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 89.726001943, 2024-04-25T22:53:22.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012329677000000001, 2024-04-25T22:53:22.850 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:22.850 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:22.850 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:22.850 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:22.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.850 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:22.850 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:22.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:22.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:22.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:22.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:22.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:22.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013269+0000", 2024-04-25T22:53:22.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5000000000000002e-07 2024-04-25T22:53:22.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:22.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:22.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6909999999999999e-06 2024-04-25T22:53:22.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:22.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013284+0000", 2024-04-25T22:53:22.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0963e-05 2024-04-25T22:53:22.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:22.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013361+0000", 2024-04-25T22:53:22.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7379999999999994e-05 2024-04-25T22:53:22.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.853 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:22.853 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013448+0000", 2024-04-25T22:53:22.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6990000000000006e-05 2024-04-25T22:53:22.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.853 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:22.853 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013632+0000", 2024-04-25T22:53:22.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018396800000000001 2024-04-25T22:53:22.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.853 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:22.853 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013800+0000", 2024-04-25T22:53:22.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167467 2024-04-25T22:53:22.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.854 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:22.854 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.018570+0000", 2024-04-25T22:53:22.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047701460000000003 2024-04-25T22:53:22.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.854 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:22.854 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025507+0000", 2024-04-25T22:53:22.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069372039999999998 2024-04-25T22:53:22.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.854 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:22.854 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025562+0000", 2024-04-25T22:53:22.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4858999999999998e-05 2024-04-25T22:53:22.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:22.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025598+0000", 2024-04-25T22:53:22.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6259e-05 2024-04-25T22:53:22.855 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:22.855 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:22.855 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:22.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.855 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:22.855 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:22.856 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 89.725870069999999, 2024-04-25T22:53:22.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020176666999999999, 2024-04-25T22:53:22.856 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:22.856 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:22.856 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:53:22.856 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:22.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:22.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:22.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:22.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:22.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:22.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:22.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.857 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:22.857 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:22.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-04-25T22:53:22.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.857 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:22.857 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013405+0000", 2024-04-25T22:53:22.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0559999999999998e-06 2024-04-25T22:53:22.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.857 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:22.858 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013422+0000", 2024-04-25T22:53:22.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6770999999999999e-05 2024-04-25T22:53:22.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.858 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:22.858 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013431+0000", 2024-04-25T22:53:22.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5019999999999998e-06 2024-04-25T22:53:22.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.858 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:22.858 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021720+0000", 2024-04-25T22:53:22.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082884340000000008 2024-04-25T22:53:22.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:22.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022122+0000", 2024-04-25T22:53:22.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000401634 2024-04-25T22:53:22.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:22.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:22.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:22.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033577+0000", 2024-04-25T22:53:22.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011455435999999999 2024-04-25T22:53:22.859 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:22.859 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:22.859 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:22.859 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:22.860 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:22.860 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:22.861 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:22.862 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:22.861+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:22.962 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:22.962+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:22.966 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:22.966 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:22.966 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-25T22:53:22.967 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:22.975 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:23.063 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:23.063+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:23.079 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:23.079 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:23.080 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-25T22:53:23.080 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-25T22:53:23.080 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:23.089 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:23.164 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:23.164+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:23.195 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:23.195 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:53:23.195 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:53:23.195 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:53:23.195 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.195 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:53:23.196 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:23.196 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 95.226210993999999, 2024-04-25T22:53:23.196 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:53:23.196 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:23.196 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:23.196 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:23.196 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:23.196 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.196 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:23.196 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:23.196 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:23.196 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.196 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.197 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:23.197 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:23.197 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:23.197 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.197 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.197 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:23.197 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:53:23.197 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:53:23.197 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.198 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.198 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:23.198 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:53:23.198 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:53:23.198 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.198 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.198 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:23.198 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:53:23.198 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:53:23.198 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.198 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.199 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:23.199 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:53:23.199 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:53:23.199 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.199 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.199 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:23.199 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:53:23.199 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:53:23.199 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.199 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.199 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:23.199 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:53:23.199 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:53:23.199 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.200 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.200 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:23.200 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:53:23.200 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:53:23.200 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.200 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.200 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:23.200 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:53:23.200 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:53:23.200 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:23.200 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:23.200 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:23.200 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.200 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.201 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:110 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'72, mlcod=10'68)", 2024-04-25T22:53:23.201 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:23.201 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 95.225576993999994, 2024-04-25T22:53:23.201 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065316630000000001, 2024-04-25T22:53:23.201 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:23.201 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:23.201 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:23.201 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:23.201 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.201 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:23.201 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:23.201 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:23.201 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.201 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.202 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:23.202 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:23.202 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:23.202 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.202 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.202 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:23.202 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:23.202 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.58e-07 2024-04-25T22:53:23.202 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.202 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.202 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:23.202 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967811+0000", 2024-04-25T22:53:23.203 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.118e-06 2024-04-25T22:53:23.203 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.203 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.203 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:23.203 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967817+0000", 2024-04-25T22:53:23.203 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3709999999999996e-06 2024-04-25T22:53:23.203 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.203 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.203 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:23.203 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967820+0000", 2024-04-25T22:53:23.203 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2210000000000002e-06 2024-04-25T22:53:23.203 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.203 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.203 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:23.204 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967876+0000", 2024-04-25T22:53:23.204 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5507000000000002e-05 2024-04-25T22:53:23.204 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.204 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.204 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:23.204 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967893+0000", 2024-04-25T22:53:23.204 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7812000000000002e-05 2024-04-25T22:53:23.204 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.204 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.204 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:23.204 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974317+0000", 2024-04-25T22:53:23.204 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064237160000000003 2024-04-25T22:53:23.204 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.204 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.204 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:23.205 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:53:23.205 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.156e-05 2024-04-25T22:53:23.205 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:23.205 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:23.205 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:23.205 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.205 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.205 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'68)", 2024-04-25T22:53:23.205 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:23.205 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 95.225159481000006, 2024-04-25T22:53:23.206 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061292279999999996, 2024-04-25T22:53:23.206 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:23.206 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:23.206 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:23.206 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:23.206 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.206 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:23.206 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:23.206 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:23.206 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.206 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.206 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:23.207 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:23.207 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:23.207 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.207 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.207 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:23.207 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:23.207 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6300000000000001e-07 2024-04-25T22:53:23.207 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.207 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.207 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:23.207 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968228+0000", 2024-04-25T22:53:23.208 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6139999999999999e-06 2024-04-25T22:53:23.208 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.208 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.208 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:23.208 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968235+0000", 2024-04-25T22:53:23.208 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7020000000000001e-06 2024-04-25T22:53:23.208 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.208 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.208 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:23.209 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968238+0000", 2024-04-25T22:53:23.209 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0010000000000002e-06 2024-04-25T22:53:23.209 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.209 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.209 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:23.209 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968297+0000", 2024-04-25T22:53:23.209 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8424999999999997e-05 2024-04-25T22:53:23.209 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.209 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.209 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:23.209 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968316+0000", 2024-04-25T22:53:23.209 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8814999999999999e-05 2024-04-25T22:53:23.210 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.210 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.210 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:23.210 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:53:23.210 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060239439999999998 2024-04-25T22:53:23.210 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.210 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.210 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:23.210 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974354+0000", 2024-04-25T22:53:23.210 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4364e-05 2024-04-25T22:53:23.210 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:23.210 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:23.210 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:23.211 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.211 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.211 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'68)", 2024-04-25T22:53:23.211 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:23.211 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 95.224722478999993, 2024-04-25T22:53:23.211 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005948414, 2024-04-25T22:53:23.211 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:23.211 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:23.211 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:23.211 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:23.211 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.211 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:23.211 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:23.211 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:23.212 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.212 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.212 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:23.212 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:23.212 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:23.212 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.212 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.212 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:23.212 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:23.212 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6199999999999998e-07 2024-04-25T22:53:23.213 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.213 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.213 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:23.213 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968723+0000", 2024-04-25T22:53:23.213 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1148999999999993e-05 2024-04-25T22:53:23.213 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.213 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.213 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:23.213 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968730+0000", 2024-04-25T22:53:23.213 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1749999999999999e-06 2024-04-25T22:53:23.213 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.214 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.214 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:23.214 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968734+0000", 2024-04-25T22:53:23.214 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5200000000000002e-06 2024-04-25T22:53:23.214 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.214 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.214 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:23.215 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968771+0000", 2024-04-25T22:53:23.215 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6851999999999999e-05 2024-04-25T22:53:23.215 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.215 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.215 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:23.215 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968788+0000", 2024-04-25T22:53:23.215 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7027000000000001e-05 2024-04-25T22:53:23.215 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.215 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.215 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:23.215 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974589+0000", 2024-04-25T22:53:23.215 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058013320000000002 2024-04-25T22:53:23.216 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.216 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.216 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:23.216 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974610+0000", 2024-04-25T22:53:23.216 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0897e-05 2024-04-25T22:53:23.216 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:23.216 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:23.216 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:23.216 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.216 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.216 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'68)", 2024-04-25T22:53:23.216 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:23.216 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 95.224152469000003, 2024-04-25T22:53:23.217 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053935750000000003, 2024-04-25T22:53:23.217 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:23.217 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:23.217 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:23.217 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:23.217 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.217 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:23.217 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:23.217 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:23.217 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.217 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.217 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:23.217 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:23.217 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:23.218 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.218 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.218 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:23.218 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:23.218 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.03e-07 2024-04-25T22:53:23.218 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.218 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.218 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:23.218 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969235+0000", 2024-04-25T22:53:23.218 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2399999999999999e-06 2024-04-25T22:53:23.219 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.219 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.219 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:23.219 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969242+0000", 2024-04-25T22:53:23.219 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1269999999999997e-06 2024-04-25T22:53:23.219 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.219 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.219 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:23.219 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969246+0000", 2024-04-25T22:53:23.219 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3840000000000001e-06 2024-04-25T22:53:23.219 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.220 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.220 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:23.220 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969278+0000", 2024-04-25T22:53:23.220 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1868e-05 2024-04-25T22:53:23.220 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.220 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.220 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:23.220 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969295+0000", 2024-04-25T22:53:23.220 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7530999999999999e-05 2024-04-25T22:53:23.220 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.220 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.220 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:23.220 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974611+0000", 2024-04-25T22:53:23.221 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053160789999999996 2024-04-25T22:53:23.221 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.221 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.221 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:23.221 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974625+0000", 2024-04-25T22:53:23.221 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3943e-05 2024-04-25T22:53:23.221 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:23.221 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:23.221 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:23.221 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.221 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.221 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-25T22:53:23.222 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:23.222 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 95.030556560999997, 2024-04-25T22:53:23.222 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054952610000000004, 2024-04-25T22:53:23.222 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:23.222 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:23.222 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:23.222 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:23.222 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.222 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:23.222 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:23.222 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:23.222 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.223 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.223 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:23.223 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:23.223 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:23.223 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.223 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.223 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:23.223 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:23.223 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.68e-07 2024-04-25T22:53:23.224 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.224 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.224 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:23.224 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162898+0000", 2024-04-25T22:53:23.224 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9470999999999999e-05 2024-04-25T22:53:23.224 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.224 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.224 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:23.224 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162906+0000", 2024-04-25T22:53:23.225 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1580000000000005e-06 2024-04-25T22:53:23.225 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.225 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.225 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:23.225 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162911+0000", 2024-04-25T22:53:23.225 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4779999999999999e-06 2024-04-25T22:53:23.225 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.225 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.225 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:23.225 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162952+0000", 2024-04-25T22:53:23.225 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0629e-05 2024-04-25T22:53:23.225 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.226 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.226 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:23.226 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162968+0000", 2024-04-25T22:53:23.226 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6239000000000002e-05 2024-04-25T22:53:23.226 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.226 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.226 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:23.226 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168281+0000", 2024-04-25T22:53:23.226 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053132869999999999 2024-04-25T22:53:23.227 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.227 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.227 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:23.227 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168323+0000", 2024-04-25T22:53:23.227 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1430999999999997e-05 2024-04-25T22:53:23.227 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:23.227 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:23.227 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:23.227 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.227 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.227 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-04-25T22:53:23.227 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:23.227 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 94.600079199000007, 2024-04-25T22:53:23.227 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050872510000000001, 2024-04-25T22:53:23.228 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:23.228 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:23.228 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:23.228 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:23.228 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.228 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:23.228 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:23.228 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:23.228 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.228 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.228 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:23.228 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:23.228 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:23.229 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.229 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.229 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:23.229 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:23.229 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.72e-07 2024-04-25T22:53:23.229 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.229 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.229 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:23.230 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593381+0000", 2024-04-25T22:53:23.230 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5797000000000006e-05 2024-04-25T22:53:23.230 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.230 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.230 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:23.230 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593389+0000", 2024-04-25T22:53:23.230 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8480000000000001e-06 2024-04-25T22:53:23.230 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.230 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.230 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:23.231 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593393+0000", 2024-04-25T22:53:23.231 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4819999999999996e-06 2024-04-25T22:53:23.231 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.231 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.231 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:23.231 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593435+0000", 2024-04-25T22:53:23.231 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1600000000000002e-05 2024-04-25T22:53:23.231 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.231 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.231 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:23.231 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593454+0000", 2024-04-25T22:53:23.231 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8868e-05 2024-04-25T22:53:23.231 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.232 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.232 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:23.232 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598350+0000", 2024-04-25T22:53:23.232 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004895763 2024-04-25T22:53:23.232 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.232 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.232 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:23.232 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598392+0000", 2024-04-25T22:53:23.232 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2521000000000002e-05 2024-04-25T22:53:23.232 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:23.232 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:23.232 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:23.232 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.233 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.233 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:23.233 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:23.233 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 90.181715295000004, 2024-04-25T22:53:23.233 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:53:23.233 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:23.233 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:23.233 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:23.233 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:23.233 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.233 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:23.233 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:23.233 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:23.233 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.233 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.233 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:23.234 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:23.234 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:23.234 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.234 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.234 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:23.234 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:53:23.234 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:53:23.234 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.237 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.238 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:23.238 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:53:23.238 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:53:23.238 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.238 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.238 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:23.238 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:53:23.238 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:53:23.238 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.238 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.238 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:23.239 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:53:23.239 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:53:23.239 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.239 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.239 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:23.239 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:53:23.239 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:53:23.239 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.239 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.239 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:23.239 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:53:23.239 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:53:23.240 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.240 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.240 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:23.240 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:53:23.240 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:53:23.240 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.240 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.241 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:23.241 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:53:23.241 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:53:23.241 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.241 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.241 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:23.241 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:53:23.241 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:53:23.241 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.241 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.241 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:23.242 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:53:23.242 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:53:23.242 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.242 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.242 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:23.242 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:53:23.242 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:53:23.242 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:23.242 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:23.242 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:23.242 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.242 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.243 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:23.243 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:23.243 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 90.181040918999997, 2024-04-25T22:53:23.243 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:53:23.243 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:23.243 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:23.243 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:23.243 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:23.243 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.244 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:23.244 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:23.244 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:23.244 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.244 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.244 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:23.244 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:23.244 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:23.244 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.244 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.244 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:23.244 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:53:23.245 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:53:23.245 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.245 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.245 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:23.245 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:53:23.245 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:53:23.245 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.246 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.246 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:23.246 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:53:23.246 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:53:23.247 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.247 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.247 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:23.247 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:53:23.247 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:53:23.247 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.248 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.248 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:23.248 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:53:23.248 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:53:23.248 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.248 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.248 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:23.248 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:53:23.248 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:53:23.248 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.248 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.248 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:23.248 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:53:23.249 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:53:23.249 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.249 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.249 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:23.249 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:53:23.249 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:53:23.249 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.249 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.249 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:23.249 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:53:23.250 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:53:23.250 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.250 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.250 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:23.250 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:53:23.250 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:53:23.251 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.251 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.251 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:23.251 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:53:23.251 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:53:23.251 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:23.251 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:23.251 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:23.251 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.251 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.252 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:23.252 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:23.252 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 90.180531707, 2024-04-25T22:53:23.252 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:53:23.252 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:23.252 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:23.252 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:23.252 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:23.252 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.252 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:23.253 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:23.253 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:23.253 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.253 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.253 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:23.253 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:23.253 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:23.253 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.253 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.253 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:23.253 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:53:23.253 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:53:23.254 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.254 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.254 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:23.254 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:53:23.254 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:53:23.254 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.254 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.254 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:23.254 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:53:23.254 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:53:23.254 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.254 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.255 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:23.255 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:53:23.255 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:53:23.255 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.255 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.255 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:23.255 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:53:23.255 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:53:23.255 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.255 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.255 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:23.255 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:53:23.256 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:53:23.256 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.256 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.256 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:23.256 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:53:23.256 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:53:23.256 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.256 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.256 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:23.256 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:53:23.256 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:53:23.256 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.256 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.257 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:23.257 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:53:23.257 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:53:23.257 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.257 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.257 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:23.257 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:53:23.257 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:53:23.257 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.257 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.257 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:23.257 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:53:23.258 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:53:23.258 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:23.258 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:23.258 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:23.258 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.258 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.258 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:23.258 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:23.258 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 90.180118508999996, 2024-04-25T22:53:23.258 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:53:23.258 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:23.258 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:23.259 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:23.259 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:23.259 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.259 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:23.259 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:23.259 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:23.259 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.259 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.259 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:23.259 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:23.259 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:23.259 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.259 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.259 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:23.260 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:23.260 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:53:23.260 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.260 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.260 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:23.260 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:23.260 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:53:23.260 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.260 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.260 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:23.261 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:53:23.261 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:53:23.261 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.261 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.261 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:23.261 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:53:23.261 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:53:23.261 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.262 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.262 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:23.262 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:53:23.262 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:53:23.262 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.262 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.262 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:23.262 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:53:23.263 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:53:23.263 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.263 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.263 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:23.263 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:53:23.263 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:53:23.263 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.263 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.264 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:23.264 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:53:23.264 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:53:23.264 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.264 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.264 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:23.264 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:53:23.265 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:53:23.265 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.265 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.265 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:23.265 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:53:23.265 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:53:23.266 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.266 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.266 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:23.266 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:53:23.266 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:53:23.266 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:23.266 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:23.267 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:23.267 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.267 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.267 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:23.267 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:23.267 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 90.180067839000003, 2024-04-25T22:53:23.267 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:53:23.268 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:23.268 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:23.268 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:23.268 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:23.268 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.268 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:23.269 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:23.269 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:23.269 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.269 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.269 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:23.269 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:23.269 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:23.269 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.270 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.270 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:23.270 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:53:23.270 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:53:23.270 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.270 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.271 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:23.271 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:53:23.271 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:53:23.271 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.271 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.272 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:23.272 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:53:23.272 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:53:23.272 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.272 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.272 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:23.272 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:53:23.273 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:53:23.273 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.273 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.273 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:23.273 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:53:23.273 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:53:23.274 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.274 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.274 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:23.274 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:53:23.274 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:53:23.274 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.275 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.275 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:23.275 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:53:23.275 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:53:23.275 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.275 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.275 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:23.275 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:53:23.275 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:53:23.275 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.276 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.276 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:23.276 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:53:23.276 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:53:23.276 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.276 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.276 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:23.276 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:53:23.276 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:53:23.276 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.276 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.276 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:23.276 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:53:23.276 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:53:23.277 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.277 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.277 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:23.277 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:53:23.277 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:53:23.277 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.277 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.277 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:23.277 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:53:23.277 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:53:23.277 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:23.277 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:23.277 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:23.278 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.278 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.278 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:23.278 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:23.278 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 90.180030970000004, 2024-04-25T22:53:23.278 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:53:23.278 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:23.278 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:23.278 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:23.278 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:23.278 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.278 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:23.278 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:23.279 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:23.279 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.279 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.279 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:23.279 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:23.279 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:23.279 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.279 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.279 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:23.279 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:53:23.279 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:53:23.279 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.279 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.280 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:23.280 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:53:23.280 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:53:23.280 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.280 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.280 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:23.280 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:53:23.280 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:53:23.280 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.280 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.281 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:23.281 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:53:23.281 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:53:23.281 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.281 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.281 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:23.281 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:53:23.281 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:53:23.281 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.281 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.281 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:53:23.281 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:53:23.281 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:53:23.282 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.282 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.282 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:23.282 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:53:23.282 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:53:23.282 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.282 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.282 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:23.282 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:53:23.282 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:53:23.282 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.283 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.283 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:23.283 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:53:23.283 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:53:23.283 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.283 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.283 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:23.283 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:53:23.283 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:53:23.283 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.283 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.283 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:23.284 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:53:23.284 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:53:23.284 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.284 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.284 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:23.284 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:53:23.284 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:53:23.284 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.284 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.284 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:23.284 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:53:23.284 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:53:23.284 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:23.284 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:23.285 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:23.285 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.285 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.285 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:23.285 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:23.285 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 90.180006004000006, 2024-04-25T22:53:23.285 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:53:23.285 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:23.285 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:23.285 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:23.285 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:23.285 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.285 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:23.286 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:23.286 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:23.286 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.286 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.286 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:23.286 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:23.286 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:23.286 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.286 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.286 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:23.287 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:53:23.287 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:53:23.287 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.287 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.287 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:23.287 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:53:23.287 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:53:23.287 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.287 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.287 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:23.287 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:23.287 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:53:23.287 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.288 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.288 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:23.288 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:53:23.288 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:53:23.288 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.288 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.288 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:23.288 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:53:23.288 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:53:23.288 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.288 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.288 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:23.289 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:53:23.289 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:53:23.289 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.289 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.289 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:23.289 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:53:23.289 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:53:23.289 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.289 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.289 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:23.289 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:53:23.289 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:53:23.289 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.290 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.290 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:23.290 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:53:23.290 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:53:23.290 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.290 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.290 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:23.290 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:53:23.290 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:53:23.290 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.290 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.291 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:23.291 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:53:23.291 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:53:23.291 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:23.291 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:23.291 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:23.291 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.291 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.291 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:23.291 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:23.291 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 90.179969639999996, 2024-04-25T22:53:23.291 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:53:23.291 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:23.292 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:23.292 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:23.292 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:23.292 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.292 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:23.292 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:23.292 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:23.292 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.292 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.292 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:23.292 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:23.292 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:23.292 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.292 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.293 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:23.293 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:53:23.293 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:53:23.293 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.293 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.293 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:23.293 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:53:23.293 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:53:23.293 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.293 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.293 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:23.293 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:53:23.293 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:53:23.293 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.294 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.294 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:23.294 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:53:23.294 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:53:23.294 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.294 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.294 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:23.294 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:53:23.294 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:53:23.294 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.295 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.295 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:23.295 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:53:23.295 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:53:23.295 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.295 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.295 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:23.295 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:53:23.295 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:53:23.295 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.295 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.295 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:23.295 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:53:23.296 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:53:23.296 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.296 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.296 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:23.296 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:53:23.296 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:53:23.296 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:23.296 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:23.296 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:23.296 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.296 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.297 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:23.297 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:23.297 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 90.179938558999993, 2024-04-25T22:53:23.297 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:53:23.297 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:23.297 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:23.297 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:23.297 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:23.297 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.297 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:23.297 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:23.297 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:23.297 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.298 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.298 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:23.298 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:23.298 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:23.298 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.298 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.298 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:23.298 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:23.298 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:23.298 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.298 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.298 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:23.299 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:53:23.299 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:53:23.299 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.299 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.299 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:23.299 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:53:23.299 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:53:23.299 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.299 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.299 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:23.300 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:53:23.300 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:53:23.300 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.300 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.300 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:23.300 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:53:23.300 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:53:23.300 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.300 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.300 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:23.300 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:53:23.300 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:53:23.300 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.301 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.301 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:23.301 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:53:23.301 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:53:23.301 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:23.301 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:23.301 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:23.301 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.301 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.301 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:53:23.301 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:23.301 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 90.179497589999997, 2024-04-25T22:53:23.301 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064881979999999997, 2024-04-25T22:53:23.302 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:23.302 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:23.302 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:23.302 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:23.302 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.302 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:23.302 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:23.302 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:23.302 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.302 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.302 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:23.302 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:23.303 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:23.303 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.303 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.303 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:23.303 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:23.303 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2699999999999999e-07 2024-04-25T22:53:23.303 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.303 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.303 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:23.303 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013898+0000", 2024-04-25T22:53:23.303 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0796e-05 2024-04-25T22:53:23.303 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.304 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.304 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:23.304 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013907+0000", 2024-04-25T22:53:23.304 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5140000000000007e-06 2024-04-25T22:53:23.304 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.304 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.304 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:23.304 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013952+0000", 2024-04-25T22:53:23.304 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4134000000000001e-05 2024-04-25T22:53:23.304 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.304 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.304 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:23.305 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016812+0000", 2024-04-25T22:53:23.305 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028601059999999998 2024-04-25T22:53:23.305 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.305 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.305 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:23.305 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.017052+0000", 2024-04-25T22:53:23.305 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024056500000000001 2024-04-25T22:53:23.305 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.305 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.305 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:23.305 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020350+0000", 2024-04-25T22:53:23.306 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032978320000000001 2024-04-25T22:53:23.306 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.306 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.306 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:23.306 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020375+0000", 2024-04-25T22:53:23.306 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4624e-05 2024-04-25T22:53:23.306 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:23.306 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:23.306 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:23.306 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.306 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.307 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-25T22:53:23.307 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:23.307 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 90.165967144000007, 2024-04-25T22:53:23.307 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058583000000000003, 2024-04-25T22:53:23.307 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:23.307 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:23.307 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:23.307 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:23.307 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.307 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:23.307 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:23.307 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:23.308 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.308 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.308 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:23.308 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:23.308 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:23.308 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.308 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.308 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:23.308 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:23.308 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.41e-07 2024-04-25T22:53:23.308 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.308 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.308 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:23.308 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027428+0000", 2024-04-25T22:53:23.308 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.075e-05 2024-04-25T22:53:23.309 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.309 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.309 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:23.309 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027435+0000", 2024-04-25T22:53:23.309 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3610000000000003e-06 2024-04-25T22:53:23.309 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.309 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.309 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:23.309 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027442+0000", 2024-04-25T22:53:23.309 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0400000000000004e-06 2024-04-25T22:53:23.310 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.310 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.310 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:23.310 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028094+0000", 2024-04-25T22:53:23.310 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00065134800000000005 2024-04-25T22:53:23.310 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.310 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.310 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:23.310 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028107+0000", 2024-04-25T22:53:23.310 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3087e-05 2024-04-25T22:53:23.311 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.311 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.311 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:23.311 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033239+0000", 2024-04-25T22:53:23.311 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051319429999999999 2024-04-25T22:53:23.311 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.311 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.311 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:23.311 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033275+0000", 2024-04-25T22:53:23.311 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6430000000000002e-05 2024-04-25T22:53:23.311 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:23.311 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:23.312 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:23.312 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.312 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.312 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-25T22:53:23.312 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:23.312 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 90.165582306999994, 2024-04-25T22:53:23.312 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005413597, 2024-04-25T22:53:23.312 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:23.312 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:23.312 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:23.312 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:23.313 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.313 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:23.313 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:23.313 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:23.313 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.313 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.313 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:23.313 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:23.313 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:23.313 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.314 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.314 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:23.314 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:23.314 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3799999999999997e-07 2024-04-25T22:53:23.314 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.314 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.314 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:23.314 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027816+0000", 2024-04-25T22:53:23.315 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3230999999999999e-05 2024-04-25T22:53:23.315 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.315 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.315 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:23.315 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027823+0000", 2024-04-25T22:53:23.315 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9039999999999992e-06 2024-04-25T22:53:23.315 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.315 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.315 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:23.315 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027841+0000", 2024-04-25T22:53:23.315 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7651000000000001e-05 2024-04-25T22:53:23.315 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.316 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.316 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:23.316 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027904+0000", 2024-04-25T22:53:23.316 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3058000000000005e-05 2024-04-25T22:53:23.316 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.316 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.316 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:23.316 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027926+0000", 2024-04-25T22:53:23.316 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1450999999999998e-05 2024-04-25T22:53:23.316 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.317 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.317 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:23.317 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033177+0000", 2024-04-25T22:53:23.317 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052508909999999997 2024-04-25T22:53:23.317 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.317 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.317 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:23.317 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033215+0000", 2024-04-25T22:53:23.317 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8872999999999999e-05 2024-04-25T22:53:23.317 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:23.317 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:23.317 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:23.317 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.318 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.318 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 171 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:53:23.318 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:23.318 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 90.165525204999994, 2024-04-25T22:53:23.318 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054322240000000003, 2024-04-25T22:53:23.318 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:23.318 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:23.318 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "reached pg", 2024-04-25T22:53:23.318 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:23.318 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.318 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:23.318 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:23.319 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:23.319 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.319 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.319 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:23.319 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:23.319 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:23.319 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.319 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.319 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:23.319 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:23.319 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7500000000000001e-07 2024-04-25T22:53:23.320 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.320 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.320 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:23.320 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027868+0000", 2024-04-25T22:53:23.320 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5750000000000001e-06 2024-04-25T22:53:23.320 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.320 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.320 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:23.320 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027885+0000", 2024-04-25T22:53:23.320 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7272e-05 2024-04-25T22:53:23.320 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.320 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.320 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:23.320 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027900+0000", 2024-04-25T22:53:23.320 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.502e-05 2024-04-25T22:53:23.321 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.321 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.321 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:23.321 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028381+0000", 2024-04-25T22:53:23.321 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00048039399999999998 2024-04-25T22:53:23.321 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:23.321 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:23.321 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:23.321 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033291+0000", 2024-04-25T22:53:23.321 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049105879999999996 2024-04-25T22:53:23.321 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:23.321 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:23.321 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:23.322 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:23.322 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:23.322 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:23.322 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-25T22:53:23.324 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:23.325 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:23.323+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:23.425 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:23.425+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:23.449 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:23.450 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:23.450 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-04-25T22:53:23.450 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:23.450 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:23.525 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:23.524+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:23.552 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:23.553 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:23.553 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:53:23.553 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:53:23.553 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:23.562 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:23.626 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:23.626+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:23.708 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:23.708 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-04-25T22:53:23.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-04-25T22:53:23.708 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:53:23.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.708 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:23.708 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:23.708 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 95.740838081000007, 2024-04-25T22:53:23.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0103421, 2024-04-25T22:53:23.709 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:23.709 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:23.709 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:23.709 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:23.709 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:23.709 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:23.709 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 115 2024-04-25T22:53:23.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.709 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:23.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:23.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:23.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:23.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:23.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:23.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:23.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:23.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:23.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9500000000000002e-07 2024-04-25T22:53:23.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:23.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965108+0000", 2024-04-25T22:53:23.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9177999999999994e-05 2024-04-25T22:53:23.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:23.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965127+0000", 2024-04-25T22:53:23.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8868e-05 2024-04-25T22:53:23.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:23.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965133+0000", 2024-04-25T22:53:23.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8929999999999999e-06 2024-04-25T22:53:23.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:23.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.969991+0000", 2024-04-25T22:53:23.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048573849999999997 2024-04-25T22:53:23.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:23.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970072+0000", 2024-04-25T22:53:23.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0728000000000004e-05 2024-04-25T22:53:23.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:23.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970189+0000", 2024-04-25T22:53:23.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000117778 2024-04-25T22:53:23.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:23.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970946+0000", 2024-04-25T22:53:23.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00075704600000000004 2024-04-25T22:53:23.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:23.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975297+0000", 2024-04-25T22:53:23.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004350217 2024-04-25T22:53:23.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:23.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975343+0000", 2024-04-25T22:53:23.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6687999999999998e-05 2024-04-25T22:53:23.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:23.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975380+0000", 2024-04-25T22:53:23.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6724000000000003e-05 2024-04-25T22:53:23.715 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:23.715 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:23.715 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:23.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.715 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:23.715 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:23.715 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 95.740732050000005, 2024-04-25T22:53:23.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010304384, 2024-04-25T22:53:23.715 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:23.715 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:23.715 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:23.715 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:23.715 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:23.716 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:23.716 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 116 2024-04-25T22:53:23.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.716 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:23.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:23.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:23.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:23.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:23.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:23.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:23.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:23.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:23.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5799999999999999e-07 2024-04-25T22:53:23.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:23.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965154+0000", 2024-04-25T22:53:23.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0009e-05 2024-04-25T22:53:23.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:23.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965164+0000", 2024-04-25T22:53:23.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8490000000000001e-06 2024-04-25T22:53:23.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:23.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965169+0000", 2024-04-25T22:53:23.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0730000000000004e-06 2024-04-25T22:53:23.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:23.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970609+0000", 2024-04-25T22:53:23.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054397689999999997 2024-04-25T22:53:23.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:23.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970651+0000", 2024-04-25T22:53:23.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1873999999999999e-05 2024-04-25T22:53:23.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:23.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970723+0000", 2024-04-25T22:53:23.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2039999999999995e-05 2024-04-25T22:53:23.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:23.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971358+0000", 2024-04-25T22:53:23.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063489500000000001 2024-04-25T22:53:23.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:23.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975409+0000", 2024-04-25T22:53:23.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040506880000000002 2024-04-25T22:53:23.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:23.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975432+0000", 2024-04-25T22:53:23.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3315999999999998e-05 2024-04-25T22:53:23.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:23.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975448+0000", 2024-04-25T22:53:23.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6313000000000001e-05 2024-04-25T22:53:23.720 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:23.721 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:23.721 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:23.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.721 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:23.721 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:23.721 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 95.740697467999993, 2024-04-25T22:53:23.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010384338999999999, 2024-04-25T22:53:23.721 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:23.721 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:23.721 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:23.721 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:23.721 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:23.722 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:23.722 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-04-25T22:53:23.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.722 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:23.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:23.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:23.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:23.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:23.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:23.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:23.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:23.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:23.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3600000000000004e-07 2024-04-25T22:53:23.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:23.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965185+0000", 2024-04-25T22:53:23.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.117e-06 2024-04-25T22:53:23.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:23.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965192+0000", 2024-04-25T22:53:23.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3239999999999997e-06 2024-04-25T22:53:23.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:23.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965198+0000", 2024-04-25T22:53:23.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6370000000000004e-06 2024-04-25T22:53:23.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:23.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970973+0000", 2024-04-25T22:53:23.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057748239999999996 2024-04-25T22:53:23.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:23.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971049+0000", 2024-04-25T22:53:23.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6029e-05 2024-04-25T22:53:23.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:23.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971174+0000", 2024-04-25T22:53:23.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012462399999999999 2024-04-25T22:53:23.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:23.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971553+0000", 2024-04-25T22:53:23.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037896499999999999 2024-04-25T22:53:23.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:23.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975482+0000", 2024-04-25T22:53:23.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039297459999999996 2024-04-25T22:53:23.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:23.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975529+0000", 2024-04-25T22:53:23.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6387000000000002e-05 2024-04-25T22:53:23.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:23.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975563+0000", 2024-04-25T22:53:23.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4150000000000003e-05 2024-04-25T22:53:23.727 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:23.727 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:23.727 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:23.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.727 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:23.727 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:23.727 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 90.693651145000004, 2024-04-25T22:53:23.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012637705000000001, 2024-04-25T22:53:23.727 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:23.727 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:23.727 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:23.727 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:23.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:23.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:23.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:23.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:23.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:23.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:23.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:23.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012227+0000", 2024-04-25T22:53:23.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.863e-06 2024-04-25T22:53:23.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:23.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012236+0000", 2024-04-25T22:53:23.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1109999999999997e-06 2024-04-25T22:53:23.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:23.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012309+0000", 2024-04-25T22:53:23.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3242000000000001e-05 2024-04-25T22:53:23.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:23.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012324+0000", 2024-04-25T22:53:23.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4837e-05 2024-04-25T22:53:23.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:23.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015060+0000", 2024-04-25T22:53:23.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027363349999999999 2024-04-25T22:53:23.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:23.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015169+0000", 2024-04-25T22:53:23.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108372 2024-04-25T22:53:23.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:23.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015498+0000", 2024-04-25T22:53:23.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032949999999999999 2024-04-25T22:53:23.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:23.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021282+0000", 2024-04-25T22:53:23.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057836429999999998 2024-04-25T22:53:23.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:23.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024709+0000", 2024-04-25T22:53:23.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034271979999999998 2024-04-25T22:53:23.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:23.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024802+0000", 2024-04-25T22:53:23.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2960000000000004e-05 2024-04-25T22:53:23.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:23.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024863+0000", 2024-04-25T22:53:23.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0643999999999997e-05 2024-04-25T22:53:23.732 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:23.732 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:23.732 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:23.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.733 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:23.733 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:23.733 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 90.693527373999999, 2024-04-25T22:53:23.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012979447999999999, 2024-04-25T22:53:23.733 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:23.733 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:23.733 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:23.733 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:23.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:23.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:23.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:23.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:23.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:23.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:23.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:23.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:23.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:53:23.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:23.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012354+0000", 2024-04-25T22:53:23.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7740000000000004e-06 2024-04-25T22:53:23.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:23.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012365+0000", 2024-04-25T22:53:23.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.064e-05 2024-04-25T22:53:23.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:23.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012382+0000", 2024-04-25T22:53:23.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6999000000000001e-05 2024-04-25T22:53:23.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:23.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015958+0000", 2024-04-25T22:53:23.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035765699999999998 2024-04-25T22:53:23.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:23.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016037+0000", 2024-04-25T22:53:23.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8242000000000001e-05 2024-04-25T22:53:23.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:23.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016404+0000", 2024-04-25T22:53:23.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036784300000000002 2024-04-25T22:53:23.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:23.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021294+0000", 2024-04-25T22:53:23.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048890629999999999 2024-04-25T22:53:23.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:23.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024959+0000", 2024-04-25T22:53:23.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036651570000000001 2024-04-25T22:53:23.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:23.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025097+0000", 2024-04-25T22:53:23.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013788099999999999 2024-04-25T22:53:23.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:23.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025328+0000", 2024-04-25T22:53:23.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231492 2024-04-25T22:53:23.738 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:23.738 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:23.738 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:23.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.738 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:23.738 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:23.738 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 90.693439604999995, 2024-04-25T22:53:23.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013049827, 2024-04-25T22:53:23.739 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:23.739 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:23.739 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:23.739 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:23.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:23.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:23.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:23.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:23.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:23.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:23.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:23.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012437+0000", 2024-04-25T22:53:23.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-04-25T22:53:23.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:23.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012440+0000", 2024-04-25T22:53:23.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7609999999999999e-06 2024-04-25T22:53:23.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:23.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012449+0000", 2024-04-25T22:53:23.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.285e-06 2024-04-25T22:53:23.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:23.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012457+0000", 2024-04-25T22:53:23.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9510000000000006e-06 2024-04-25T22:53:23.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:23.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017106+0000", 2024-04-25T22:53:23.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046494220000000003 2024-04-25T22:53:23.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:23.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017223+0000", 2024-04-25T22:53:23.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116824 2024-04-25T22:53:23.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:23.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017345+0000", 2024-04-25T22:53:23.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122175 2024-04-25T22:53:23.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:23.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021299+0000", 2024-04-25T22:53:23.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039534879999999998 2024-04-25T22:53:23.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:23.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025398+0000", 2024-04-25T22:53:23.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040988960000000003 2024-04-25T22:53:23.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:23.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025439+0000", 2024-04-25T22:53:23.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0915999999999999e-05 2024-04-25T22:53:23.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:23.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025486+0000", 2024-04-25T22:53:23.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7534999999999998e-05 2024-04-25T22:53:23.743 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:23.744 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:23.744 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:23.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.744 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:23.744 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:23.744 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 90.693409454000005, 2024-04-25T22:53:23.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020988041999999998, 2024-04-25T22:53:23.744 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:23.744 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:23.744 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:23.744 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:23.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:23.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:23.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:23.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:23.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:23.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:23.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:23.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:23.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.99e-07 2024-04-25T22:53:23.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:23.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012470+0000", 2024-04-25T22:53:23.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2789999999999999e-06 2024-04-25T22:53:23.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:23.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012477+0000", 2024-04-25T22:53:23.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:53:23.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:23.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012500+0000", 2024-04-25T22:53:23.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2490999999999999e-05 2024-04-25T22:53:23.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:23.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021911+0000", 2024-04-25T22:53:23.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094114160000000006 2024-04-25T22:53:23.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:23.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022000+0000", 2024-04-25T22:53:23.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8601000000000001e-05 2024-04-25T22:53:23.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:23.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022359+0000", 2024-04-25T22:53:23.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035921999999999999 2024-04-25T22:53:23.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:23.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025541+0000", 2024-04-25T22:53:23.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031820619999999998 2024-04-25T22:53:23.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:23.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033375+0000", 2024-04-25T22:53:23.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078338379999999992 2024-04-25T22:53:23.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:23.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033415+0000", 2024-04-25T22:53:23.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9527000000000003e-05 2024-04-25T22:53:23.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:23.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033455+0000", 2024-04-25T22:53:23.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9932000000000003e-05 2024-04-25T22:53:23.749 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:23.749 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:23.749 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:23.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.750 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:23.750 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:23.750 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 90.693354260999996, 2024-04-25T22:53:23.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021043857999999999, 2024-04-25T22:53:23.750 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:23.750 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:23.750 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:23.750 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:23.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:23.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:23.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:23.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:23.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:23.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:23.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:23.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012523+0000", 2024-04-25T22:53:23.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.361e-06 2024-04-25T22:53:23.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:23.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012530+0000", 2024-04-25T22:53:23.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5440000000000004e-06 2024-04-25T22:53:23.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:23.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012541+0000", 2024-04-25T22:53:23.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1745e-05 2024-04-25T22:53:23.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:23.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012551+0000", 2024-04-25T22:53:23.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5789999999999993e-06 2024-04-25T22:53:23.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:23.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022709+0000", 2024-04-25T22:53:23.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010157685 2024-04-25T22:53:23.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:23.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022957+0000", 2024-04-25T22:53:23.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024824599999999998 2024-04-25T22:53:23.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:23.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023443+0000", 2024-04-25T22:53:23.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048578599999999999 2024-04-25T22:53:23.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:23.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025547+0000", 2024-04-25T22:53:23.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021044789999999998 2024-04-25T22:53:23.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:23.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033509+0000", 2024-04-25T22:53:23.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0079622180000000001 2024-04-25T22:53:23.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:23.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033542+0000", 2024-04-25T22:53:23.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3018000000000001e-05 2024-04-25T22:53:23.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:23.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033566+0000", 2024-04-25T22:53:23.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3197000000000002e-05 2024-04-25T22:53:23.755 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:23.755 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:23.755 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:23.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.755 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:23.755 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:23.755 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 90.693314295999997, 2024-04-25T22:53:23.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021122696, 2024-04-25T22:53:23.755 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:23.756 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:23.756 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:23.756 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:23.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:23.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:23.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:23.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:23.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:23.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:23.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:23.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:23.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:53:23.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:23.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012566+0000", 2024-04-25T22:53:23.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-04-25T22:53:23.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:23.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012619+0000", 2024-04-25T22:53:23.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2607e-05 2024-04-25T22:53:23.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:23.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012628+0000", 2024-04-25T22:53:23.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6500000000000008e-06 2024-04-25T22:53:23.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:23.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024024+0000", 2024-04-25T22:53:23.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011396007999999999 2024-04-25T22:53:23.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:23.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024198+0000", 2024-04-25T22:53:23.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000173215 2024-04-25T22:53:23.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:23.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024447+0000", 2024-04-25T22:53:23.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024898500000000002 2024-04-25T22:53:23.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:23.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026431+0000", 2024-04-25T22:53:23.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001984923 2024-04-25T22:53:23.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:23.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033608+0000", 2024-04-25T22:53:23.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071768459999999997 2024-04-25T22:53:23.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:23.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033646+0000", 2024-04-25T22:53:23.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299000000000003e-05 2024-04-25T22:53:23.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:23.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033684+0000", 2024-04-25T22:53:23.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8773000000000003e-05 2024-04-25T22:53:23.760 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:23.760 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:23.761 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:23.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.761 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:23.761 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:23.761 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 90.693225697000003, 2024-04-25T22:53:23.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021175381, 2024-04-25T22:53:23.761 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:23.761 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:23.761 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:23.761 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:23.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:23.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:23.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:23.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:23.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:23.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:23.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:23.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012651+0000", 2024-04-25T22:53:23.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:53:23.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:23.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012656+0000", 2024-04-25T22:53:23.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8899999999999998e-06 2024-04-25T22:53:23.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:23.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012666+0000", 2024-04-25T22:53:23.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0346999999999999e-05 2024-04-25T22:53:23.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:23.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012675+0000", 2024-04-25T22:53:23.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9930000000000001e-06 2024-04-25T22:53:23.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:23.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025661+0000", 2024-04-25T22:53:23.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01298531 2024-04-25T22:53:23.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:23.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025757+0000", 2024-04-25T22:53:23.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5822000000000005e-05 2024-04-25T22:53:23.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:23.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025907+0000", 2024-04-25T22:53:23.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015051499999999999 2024-04-25T22:53:23.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:23.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026435+0000", 2024-04-25T22:53:23.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052762200000000005 2024-04-25T22:53:23.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:23.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033732+0000", 2024-04-25T22:53:23.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072978419999999997 2024-04-25T22:53:23.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:23.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033787+0000", 2024-04-25T22:53:23.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4703999999999997e-05 2024-04-25T22:53:23.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:23.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033826+0000", 2024-04-25T22:53:23.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8458999999999999e-05 2024-04-25T22:53:23.766 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:23.766 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:23.766 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:23.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.766 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:23.766 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:23.766 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 90.693170283000001, 2024-04-25T22:53:23.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021244174000000001, 2024-04-25T22:53:23.766 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:23.767 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:23.767 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:23.767 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:23.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:23.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:23.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:23.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:23.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:23.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:23.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:23.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:23.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:23.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:23.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012712+0000", 2024-04-25T22:53:23.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.913e-06 2024-04-25T22:53:23.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:23.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012722+0000", 2024-04-25T22:53:23.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2879999999999998e-06 2024-04-25T22:53:23.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:23.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012727+0000", 2024-04-25T22:53:23.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8429999999999998e-06 2024-04-25T22:53:23.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:23.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026099+0000", 2024-04-25T22:53:23.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013371450999999999 2024-04-25T22:53:23.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:23.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026147+0000", 2024-04-25T22:53:23.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7837999999999998e-05 2024-04-25T22:53:23.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:23.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026254+0000", 2024-04-25T22:53:23.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107314 2024-04-25T22:53:23.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:23.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026686+0000", 2024-04-25T22:53:23.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000432428 2024-04-25T22:53:23.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:23.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033873+0000", 2024-04-25T22:53:23.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071864399999999997 2024-04-25T22:53:23.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:23.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033904+0000", 2024-04-25T22:53:23.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1321e-05 2024-04-25T22:53:23.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:23.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033950+0000", 2024-04-25T22:53:23.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5707999999999997e-05 2024-04-25T22:53:23.771 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:23.771 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:23.771 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:23.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.772 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:23.772 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:23.772 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 90.693139897999998, 2024-04-25T22:53:23.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01096505, 2024-04-25T22:53:23.772 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:23.772 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:23.772 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:23.772 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:23.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:23.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:23.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:23.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:23.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:23.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:23.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:23.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012737+0000", 2024-04-25T22:53:23.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:23.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:23.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012739+0000", 2024-04-25T22:53:23.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-04-25T22:53:23.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:23.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012743+0000", 2024-04-25T22:53:23.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3239999999999996e-06 2024-04-25T22:53:23.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:23.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012746+0000", 2024-04-25T22:53:23.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.129e-06 2024-04-25T22:53:23.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:23.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012796+0000", 2024-04-25T22:53:23.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9231999999999999e-05 2024-04-25T22:53:23.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:23.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012915+0000", 2024-04-25T22:53:23.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119021 2024-04-25T22:53:23.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:23.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013069+0000", 2024-04-25T22:53:23.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015463900000000001 2024-04-25T22:53:23.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:23.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019237+0000", 2024-04-25T22:53:23.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061680329999999998 2024-04-25T22:53:23.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:23.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023603+0000", 2024-04-25T22:53:23.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043655860000000003 2024-04-25T22:53:23.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:23.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023659+0000", 2024-04-25T22:53:23.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6484000000000003e-05 2024-04-25T22:53:23.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:23.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023701+0000", 2024-04-25T22:53:23.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1761999999999998e-05 2024-04-25T22:53:23.777 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:23.777 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:23.777 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:23.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.777 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:23.777 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:23.777 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 90.693114949999995, 2024-04-25T22:53:23.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011234429000000001, 2024-04-25T22:53:23.777 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:23.778 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:23.778 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:23.778 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:23.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:23.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:23.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:23.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:23.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:23.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:23.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:23.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012762+0000", 2024-04-25T22:53:23.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-04-25T22:53:23.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:23.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012765+0000", 2024-04-25T22:53:23.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2569999999999999e-06 2024-04-25T22:53:23.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:23.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012783+0000", 2024-04-25T22:53:23.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8431999999999999e-05 2024-04-25T22:53:23.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:23.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012799+0000", 2024-04-25T22:53:23.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5438999999999999e-05 2024-04-25T22:53:23.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:23.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013826+0000", 2024-04-25T22:53:23.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010275060000000001 2024-04-25T22:53:23.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:23.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013913+0000", 2024-04-25T22:53:23.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.708e-05 2024-04-25T22:53:23.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:23.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014098+0000", 2024-04-25T22:53:23.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018519399999999999 2024-04-25T22:53:23.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:23.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019684+0000", 2024-04-25T22:53:23.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055860079999999999 2024-04-25T22:53:23.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:23.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023876+0000", 2024-04-25T22:53:23.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041918800000000003 2024-04-25T22:53:23.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:23.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023957+0000", 2024-04-25T22:53:23.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1165e-05 2024-04-25T22:53:23.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:23.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023995+0000", 2024-04-25T22:53:23.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:53:23.783 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:23.783 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:23.783 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:23.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.783 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:23.783 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:23.783 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 90.693017170999994, 2024-04-25T22:53:23.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011131200000000001, 2024-04-25T22:53:23.783 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:23.783 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:23.783 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:23.783 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:23.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:23.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:23.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:23.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:23.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:23.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:23.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:23.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012860+0000", 2024-04-25T22:53:23.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3900000000000004e-07 2024-04-25T22:53:23.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:23.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012865+0000", 2024-04-25T22:53:23.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5609999999999998e-06 2024-04-25T22:53:23.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:23.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012895+0000", 2024-04-25T22:53:23.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9847000000000001e-05 2024-04-25T22:53:23.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:23.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012905+0000", 2024-04-25T22:53:23.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.03e-05 2024-04-25T22:53:23.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:23.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015020+0000", 2024-04-25T22:53:23.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021142940000000001 2024-04-25T22:53:23.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:23.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015182+0000", 2024-04-25T22:53:23.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016248099999999999 2024-04-25T22:53:23.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:23.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015357+0000", 2024-04-25T22:53:23.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017471000000000001 2024-04-25T22:53:23.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:23.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021021+0000", 2024-04-25T22:53:23.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056638340000000004 2024-04-25T22:53:23.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:23.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023712+0000", 2024-04-25T22:53:23.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026910380000000002 2024-04-25T22:53:23.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:23.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023763+0000", 2024-04-25T22:53:23.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1477999999999997e-05 2024-04-25T22:53:23.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:23.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023990+0000", 2024-04-25T22:53:23.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000226818 2024-04-25T22:53:23.788 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:23.788 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:23.788 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:23.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.788 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:23.789 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:23.789 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 90.692894074999998, 2024-04-25T22:53:23.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011705299000000001, 2024-04-25T22:53:23.789 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:23.789 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:23.789 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:23.789 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:23.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:23.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:23.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:23.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:23.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:23.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:23.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:23.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012983+0000", 2024-04-25T22:53:23.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:53:23.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:23.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012986+0000", 2024-04-25T22:53:23.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5700000000000001e-06 2024-04-25T22:53:23.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:23.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012993+0000", 2024-04-25T22:53:23.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8730000000000001e-06 2024-04-25T22:53:23.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:23.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013000+0000", 2024-04-25T22:53:23.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1890000000000001e-06 2024-04-25T22:53:23.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:23.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:53:23.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002147866 2024-04-25T22:53:23.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:23.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015351+0000", 2024-04-25T22:53:23.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020300799999999999 2024-04-25T22:53:23.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:23.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016260+0000", 2024-04-25T22:53:23.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00090926799999999997 2024-04-25T22:53:23.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:23.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022669+0000", 2024-04-25T22:53:23.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064082849999999997 2024-04-25T22:53:23.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:23.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024584+0000", 2024-04-25T22:53:23.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019151699999999999 2024-04-25T22:53:23.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:23.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024643+0000", 2024-04-25T22:53:23.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8888999999999998e-05 2024-04-25T22:53:23.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:23.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024687+0000", 2024-04-25T22:53:23.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4444999999999999e-05 2024-04-25T22:53:23.794 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:23.794 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:23.794 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:23.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.794 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:23.794 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:23.794 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 90.692866484000007, 2024-04-25T22:53:23.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011249699, 2024-04-25T22:53:23.794 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:23.794 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:23.794 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:23.794 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:23.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:23.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:23.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:23.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:23.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:23.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:23.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:23.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013010+0000", 2024-04-25T22:53:23.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2099999999999996e-07 2024-04-25T22:53:23.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:23.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013013+0000", 2024-04-25T22:53:23.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1310000000000002e-06 2024-04-25T22:53:23.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:23.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013020+0000", 2024-04-25T22:53:23.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3330000000000002e-06 2024-04-25T22:53:23.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:23.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013025+0000", 2024-04-25T22:53:23.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6760000000000004e-06 2024-04-25T22:53:23.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:23.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013163+0000", 2024-04-25T22:53:23.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013824599999999999 2024-04-25T22:53:23.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:23.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013504+0000", 2024-04-25T22:53:23.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034080299999999998 2024-04-25T22:53:23.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:23.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013613+0000", 2024-04-25T22:53:23.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108705 2024-04-25T22:53:23.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:23.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015831+0000", 2024-04-25T22:53:23.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002217672 2024-04-25T22:53:23.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:23.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024137+0000", 2024-04-25T22:53:23.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0083060489999999994 2024-04-25T22:53:23.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:23.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024218+0000", 2024-04-25T22:53:23.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1351000000000001e-05 2024-04-25T22:53:23.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:23.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024259+0000", 2024-04-25T22:53:23.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1112000000000002e-05 2024-04-25T22:53:23.799 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:23.799 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:23.799 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:23.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.799 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:23.800 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:23.800 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 90.692778758000003, 2024-04-25T22:53:23.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020379749999999999, 2024-04-25T22:53:23.800 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:23.800 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:23.800 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:23.800 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:23.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:23.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:23.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:23.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:23.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:23.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:23.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:23.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013098+0000", 2024-04-25T22:53:23.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:53:23.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:23.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013105+0000", 2024-04-25T22:53:23.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5969999999999997e-06 2024-04-25T22:53:23.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:23.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013190+0000", 2024-04-25T22:53:23.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5618999999999995e-05 2024-04-25T22:53:23.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:23.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013200+0000", 2024-04-25T22:53:23.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5859999999999994e-06 2024-04-25T22:53:23.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:23.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020265+0000", 2024-04-25T22:53:23.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070653349999999998 2024-04-25T22:53:23.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:23.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020454+0000", 2024-04-25T22:53:23.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189316 2024-04-25T22:53:23.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:23.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020586+0000", 2024-04-25T22:53:23.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013195700000000001 2024-04-25T22:53:23.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:23.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023822+0000", 2024-04-25T22:53:23.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032358529999999999 2024-04-25T22:53:23.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:23.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033409+0000", 2024-04-25T22:53:23.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095870520000000004 2024-04-25T22:53:23.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:23.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033447+0000", 2024-04-25T22:53:23.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7261999999999997e-05 2024-04-25T22:53:23.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:23.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033477+0000", 2024-04-25T22:53:23.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0389e-05 2024-04-25T22:53:23.805 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:23.805 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:23.805 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:23.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.805 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:23.805 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:23.805 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 90.692662252000005, 2024-04-25T22:53:23.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010857383999999999, 2024-04-25T22:53:23.805 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:23.805 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:23.805 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:23.805 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:23.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:23.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:23.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:23.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:23.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:23.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:23.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:23.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:23.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:23.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:23.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013218+0000", 2024-04-25T22:53:23.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8199999999999998e-06 2024-04-25T22:53:23.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:23.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013226+0000", 2024-04-25T22:53:23.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7649999999999993e-06 2024-04-25T22:53:23.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:23.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013259+0000", 2024-04-25T22:53:23.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2727e-05 2024-04-25T22:53:23.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:23.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014809+0000", 2024-04-25T22:53:23.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001550144 2024-04-25T22:53:23.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:23.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014958+0000", 2024-04-25T22:53:23.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014890300000000001 2024-04-25T22:53:23.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:23.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015087+0000", 2024-04-25T22:53:23.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012939200000000001 2024-04-25T22:53:23.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:23.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020212+0000", 2024-04-25T22:53:23.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051248939999999996 2024-04-25T22:53:23.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:23.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023699+0000", 2024-04-25T22:53:23.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034873289999999999 2024-04-25T22:53:23.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:23.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024014+0000", 2024-04-25T22:53:23.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031473999999999999 2024-04-25T22:53:23.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:23.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024071+0000", 2024-04-25T22:53:23.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7040000000000003e-05 2024-04-25T22:53:23.810 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:23.810 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:23.810 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:23.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.810 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:23.810 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:23.810 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 90.692607546999994, 2024-04-25T22:53:23.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012329677000000001, 2024-04-25T22:53:23.811 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:23.811 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:23.811 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:23.811 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:23.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:23.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:23.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:23.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:23.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:23.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:23.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:23.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013269+0000", 2024-04-25T22:53:23.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5000000000000002e-07 2024-04-25T22:53:23.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:23.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:23.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6909999999999999e-06 2024-04-25T22:53:23.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:23.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013284+0000", 2024-04-25T22:53:23.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0963e-05 2024-04-25T22:53:23.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:23.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013361+0000", 2024-04-25T22:53:23.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7379999999999994e-05 2024-04-25T22:53:23.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:23.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013448+0000", 2024-04-25T22:53:23.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6990000000000006e-05 2024-04-25T22:53:23.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:23.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013632+0000", 2024-04-25T22:53:23.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018396800000000001 2024-04-25T22:53:23.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:23.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013800+0000", 2024-04-25T22:53:23.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167467 2024-04-25T22:53:23.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:23.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.018570+0000", 2024-04-25T22:53:23.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047701460000000003 2024-04-25T22:53:23.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:23.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025507+0000", 2024-04-25T22:53:23.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069372039999999998 2024-04-25T22:53:23.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:23.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025562+0000", 2024-04-25T22:53:23.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4858999999999998e-05 2024-04-25T22:53:23.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:23.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025598+0000", 2024-04-25T22:53:23.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6259e-05 2024-04-25T22:53:23.815 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:23.815 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:23.816 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:23.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.816 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:23.816 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:23.816 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 90.692475673999994, 2024-04-25T22:53:23.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020176666999999999, 2024-04-25T22:53:23.816 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:23.816 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:23.816 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:53:23.816 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:23.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:23.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:23.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:23.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:23.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:23.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:23.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:23.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:23.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-04-25T22:53:23.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:23.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013405+0000", 2024-04-25T22:53:23.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0559999999999998e-06 2024-04-25T22:53:23.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:23.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013422+0000", 2024-04-25T22:53:23.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6770999999999999e-05 2024-04-25T22:53:23.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:23.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013431+0000", 2024-04-25T22:53:23.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5019999999999998e-06 2024-04-25T22:53:23.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:23.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021720+0000", 2024-04-25T22:53:23.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082884340000000008 2024-04-25T22:53:23.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:23.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022122+0000", 2024-04-25T22:53:23.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000401634 2024-04-25T22:53:23.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:23.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:23.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:23.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033577+0000", 2024-04-25T22:53:23.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011455435999999999 2024-04-25T22:53:23.819 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:23.819 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:23.820 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:23.820 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:23.820 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:23.820 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:23.821 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:23.822 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:23.821+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:23.922 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:23.922+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:23.937 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:23.937 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:23.937 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-25T22:53:23.937 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:23.947 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:24.023 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:24.023+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:24.049 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:24.050 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:24.050 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-25T22:53:24.050 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-25T22:53:24.050 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:24.059 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:24.124 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:24.124+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:24.163 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:24.163 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:53:24.163 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:53:24.163 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:53:24.163 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.163 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:53:24.163 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:24.164 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 96.194329951, 2024-04-25T22:53:24.164 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:53:24.164 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:24.164 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:24.164 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:24.164 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:24.164 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.164 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:24.164 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:24.164 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:24.164 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.164 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.164 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:24.165 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:24.165 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:24.165 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.165 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.165 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:24.165 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:53:24.165 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:53:24.165 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.165 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.165 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:24.165 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:53:24.165 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:53:24.165 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.165 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.166 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:24.166 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:53:24.166 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:53:24.166 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.166 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.166 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:24.166 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:53:24.166 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:53:24.166 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.166 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.166 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:24.166 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:53:24.166 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:53:24.166 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.167 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.167 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:24.167 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:53:24.167 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:53:24.167 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.167 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.167 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:24.167 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:53:24.167 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:53:24.167 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.167 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.167 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:24.167 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:53:24.167 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:53:24.168 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:24.168 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:24.168 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:24.168 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.168 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.168 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:110 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'72, mlcod=10'68)", 2024-04-25T22:53:24.168 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:24.168 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 96.193695950999995, 2024-04-25T22:53:24.168 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065316630000000001, 2024-04-25T22:53:24.169 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:24.169 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:24.169 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:24.169 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:24.169 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.169 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:24.169 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:24.170 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:24.170 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.170 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.170 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:24.170 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:24.170 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:24.170 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.170 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.170 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:24.170 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:24.170 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.58e-07 2024-04-25T22:53:24.170 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.170 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.170 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:24.171 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967811+0000", 2024-04-25T22:53:24.171 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.118e-06 2024-04-25T22:53:24.171 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.171 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.171 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:24.171 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967817+0000", 2024-04-25T22:53:24.171 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3709999999999996e-06 2024-04-25T22:53:24.171 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.171 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.171 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:24.171 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967820+0000", 2024-04-25T22:53:24.171 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2210000000000002e-06 2024-04-25T22:53:24.171 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.171 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.172 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:24.172 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967876+0000", 2024-04-25T22:53:24.172 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5507000000000002e-05 2024-04-25T22:53:24.172 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.172 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.172 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:24.172 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967893+0000", 2024-04-25T22:53:24.172 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7812000000000002e-05 2024-04-25T22:53:24.172 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.173 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.173 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:24.173 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974317+0000", 2024-04-25T22:53:24.173 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064237160000000003 2024-04-25T22:53:24.173 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.173 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.173 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:24.173 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:53:24.173 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.156e-05 2024-04-25T22:53:24.173 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:24.174 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:24.174 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:24.174 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.174 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.174 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'68)", 2024-04-25T22:53:24.174 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:24.174 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 96.193278437999993, 2024-04-25T22:53:24.174 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061292279999999996, 2024-04-25T22:53:24.174 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:24.174 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:24.174 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:24.175 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:24.175 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.175 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:24.175 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:24.175 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:24.175 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.175 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.175 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:24.175 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:24.175 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:24.176 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.176 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.176 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:24.176 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:24.176 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6300000000000001e-07 2024-04-25T22:53:24.176 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.176 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.176 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:24.176 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968228+0000", 2024-04-25T22:53:24.176 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6139999999999999e-06 2024-04-25T22:53:24.176 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.176 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.176 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:24.177 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968235+0000", 2024-04-25T22:53:24.177 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7020000000000001e-06 2024-04-25T22:53:24.177 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.177 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.177 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:24.177 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968238+0000", 2024-04-25T22:53:24.177 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0010000000000002e-06 2024-04-25T22:53:24.177 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.177 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.177 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:24.177 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968297+0000", 2024-04-25T22:53:24.178 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8424999999999997e-05 2024-04-25T22:53:24.178 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.178 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.178 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:24.178 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968316+0000", 2024-04-25T22:53:24.178 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8814999999999999e-05 2024-04-25T22:53:24.178 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.178 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.178 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:24.178 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:53:24.178 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060239439999999998 2024-04-25T22:53:24.178 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.178 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.179 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:24.179 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974354+0000", 2024-04-25T22:53:24.179 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4364e-05 2024-04-25T22:53:24.179 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:24.179 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:24.179 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:24.179 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.179 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.179 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'68)", 2024-04-25T22:53:24.179 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:24.179 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 96.192841435999995, 2024-04-25T22:53:24.179 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005948414, 2024-04-25T22:53:24.180 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:24.180 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:24.180 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:24.180 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:24.180 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.180 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:24.180 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:24.180 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:24.180 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.180 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.180 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:24.180 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:24.180 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:24.181 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.181 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.182 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:24.182 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:24.182 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6199999999999998e-07 2024-04-25T22:53:24.182 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.183 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.183 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:24.183 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968723+0000", 2024-04-25T22:53:24.183 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1148999999999993e-05 2024-04-25T22:53:24.183 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.183 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.183 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:24.184 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968730+0000", 2024-04-25T22:53:24.184 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1749999999999999e-06 2024-04-25T22:53:24.184 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.184 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.184 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:24.184 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968734+0000", 2024-04-25T22:53:24.184 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5200000000000002e-06 2024-04-25T22:53:24.184 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.184 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.184 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:24.184 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968771+0000", 2024-04-25T22:53:24.184 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6851999999999999e-05 2024-04-25T22:53:24.184 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.184 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.185 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:24.185 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968788+0000", 2024-04-25T22:53:24.185 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7027000000000001e-05 2024-04-25T22:53:24.185 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.185 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.185 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:24.185 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974589+0000", 2024-04-25T22:53:24.185 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058013320000000002 2024-04-25T22:53:24.185 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.185 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.185 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:24.185 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974610+0000", 2024-04-25T22:53:24.185 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0897e-05 2024-04-25T22:53:24.185 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:24.186 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:24.186 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:24.186 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.186 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.186 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'68)", 2024-04-25T22:53:24.186 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:24.186 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 96.192271426000005, 2024-04-25T22:53:24.186 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053935750000000003, 2024-04-25T22:53:24.186 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:24.186 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:24.186 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:24.186 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:24.186 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.187 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:24.187 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:24.187 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:24.187 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.187 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.187 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:24.187 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:24.187 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:24.187 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.187 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.187 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:24.188 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:24.188 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.03e-07 2024-04-25T22:53:24.188 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.188 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.188 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:24.188 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969235+0000", 2024-04-25T22:53:24.188 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2399999999999999e-06 2024-04-25T22:53:24.188 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.188 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.188 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:24.188 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969242+0000", 2024-04-25T22:53:24.188 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1269999999999997e-06 2024-04-25T22:53:24.188 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.188 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.189 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:24.189 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969246+0000", 2024-04-25T22:53:24.189 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3840000000000001e-06 2024-04-25T22:53:24.189 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.189 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.189 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:24.189 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969278+0000", 2024-04-25T22:53:24.189 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1868e-05 2024-04-25T22:53:24.189 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.189 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.189 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:24.189 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969295+0000", 2024-04-25T22:53:24.189 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7530999999999999e-05 2024-04-25T22:53:24.189 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.190 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.190 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:24.190 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974611+0000", 2024-04-25T22:53:24.190 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053160789999999996 2024-04-25T22:53:24.190 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.190 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.190 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:24.190 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974625+0000", 2024-04-25T22:53:24.190 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3943e-05 2024-04-25T22:53:24.190 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:24.190 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:24.190 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:24.190 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.191 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.191 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-25T22:53:24.191 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:24.191 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 95.998675517999999, 2024-04-25T22:53:24.191 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054952610000000004, 2024-04-25T22:53:24.191 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:24.191 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:24.191 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:24.191 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:24.191 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.191 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:24.191 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:24.191 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:24.191 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.192 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.192 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:24.192 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:24.192 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:24.192 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.192 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.192 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:24.192 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:24.192 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.68e-07 2024-04-25T22:53:24.192 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.192 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.192 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:24.192 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162898+0000", 2024-04-25T22:53:24.192 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9470999999999999e-05 2024-04-25T22:53:24.193 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.193 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.193 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:24.193 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162906+0000", 2024-04-25T22:53:24.193 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1580000000000005e-06 2024-04-25T22:53:24.193 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.193 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.193 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:24.193 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162911+0000", 2024-04-25T22:53:24.193 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4779999999999999e-06 2024-04-25T22:53:24.193 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.193 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.193 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:24.194 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162952+0000", 2024-04-25T22:53:24.194 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0629e-05 2024-04-25T22:53:24.194 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.194 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.194 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:24.194 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162968+0000", 2024-04-25T22:53:24.194 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6239000000000002e-05 2024-04-25T22:53:24.194 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.194 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.194 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:24.194 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168281+0000", 2024-04-25T22:53:24.194 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053132869999999999 2024-04-25T22:53:24.194 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.195 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.195 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:24.195 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168323+0000", 2024-04-25T22:53:24.195 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1430999999999997e-05 2024-04-25T22:53:24.195 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:24.195 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:24.195 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:24.195 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.195 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.195 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-04-25T22:53:24.195 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:24.195 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 95.568198155999994, 2024-04-25T22:53:24.195 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050872510000000001, 2024-04-25T22:53:24.195 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:24.196 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:24.196 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:24.196 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:24.196 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.196 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:24.196 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:24.196 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:24.196 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.196 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.196 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:24.196 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:24.196 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:24.196 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.197 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.197 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:24.197 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:24.197 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.72e-07 2024-04-25T22:53:24.197 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.197 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.197 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:24.197 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593381+0000", 2024-04-25T22:53:24.197 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5797000000000006e-05 2024-04-25T22:53:24.197 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.197 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.197 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:24.197 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593389+0000", 2024-04-25T22:53:24.197 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8480000000000001e-06 2024-04-25T22:53:24.198 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.198 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.198 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:24.198 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593393+0000", 2024-04-25T22:53:24.198 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4819999999999996e-06 2024-04-25T22:53:24.198 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.198 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.198 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:24.198 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593435+0000", 2024-04-25T22:53:24.198 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1600000000000002e-05 2024-04-25T22:53:24.198 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.198 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.198 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:24.199 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593454+0000", 2024-04-25T22:53:24.199 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8868e-05 2024-04-25T22:53:24.199 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.199 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.199 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:24.199 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598350+0000", 2024-04-25T22:53:24.199 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004895763 2024-04-25T22:53:24.199 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.199 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.199 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:24.199 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598392+0000", 2024-04-25T22:53:24.199 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2521000000000002e-05 2024-04-25T22:53:24.199 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:24.200 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:24.200 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:24.200 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.200 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.200 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:24.200 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:24.200 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 91.149834252000005, 2024-04-25T22:53:24.200 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:53:24.200 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:24.200 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:24.200 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:24.201 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:24.201 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.201 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:24.201 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:24.201 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:24.201 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.201 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.201 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:24.201 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:24.201 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:24.201 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.202 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.202 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:24.202 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:53:24.202 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:53:24.202 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.202 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.202 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:24.202 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:53:24.202 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:53:24.202 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.202 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.202 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:24.202 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:53:24.203 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:53:24.203 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.203 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.203 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:24.203 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:53:24.203 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:53:24.203 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.203 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.203 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:24.203 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:53:24.203 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:53:24.203 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.203 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.203 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:24.204 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:53:24.204 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:53:24.204 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.204 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.204 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:24.204 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:53:24.204 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:53:24.204 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.204 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.204 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:24.204 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:53:24.204 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:53:24.204 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.204 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.205 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:24.205 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:53:24.205 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:53:24.205 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.205 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.205 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:24.205 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:53:24.205 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:53:24.205 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.205 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.205 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:24.205 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:53:24.205 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:53:24.205 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:24.206 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:24.206 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:24.206 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.206 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.206 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:24.206 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:24.206 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 91.149159875999999, 2024-04-25T22:53:24.206 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:53:24.206 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:24.206 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:24.206 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:24.206 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:24.206 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.207 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:24.207 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:24.207 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:24.207 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.207 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.207 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:24.207 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:24.207 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:24.207 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.207 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.208 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:24.208 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:53:24.208 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:53:24.208 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.208 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.208 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:24.208 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:53:24.208 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:53:24.208 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.208 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.208 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:24.208 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:53:24.208 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:53:24.208 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.209 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.209 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:24.209 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:53:24.209 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:53:24.209 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.209 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.209 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:24.209 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:53:24.209 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:53:24.210 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.210 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.210 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:24.210 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:53:24.210 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:53:24.210 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.210 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.210 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:24.210 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:53:24.210 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:53:24.210 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.211 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.211 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:24.211 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:53:24.211 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:53:24.211 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.211 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.211 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:24.211 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:53:24.211 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:53:24.211 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.211 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.211 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:24.211 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:53:24.212 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:53:24.212 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.212 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.212 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:24.212 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:53:24.212 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:53:24.212 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:24.212 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:24.212 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:24.212 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.212 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.213 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:24.213 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:24.213 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 91.148650664000002, 2024-04-25T22:53:24.213 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:53:24.213 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:24.213 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:24.213 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:24.213 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:24.213 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.213 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:24.213 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:24.213 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:24.213 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.214 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.214 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:24.214 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:24.214 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:24.214 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.214 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.214 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:24.214 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:53:24.214 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:53:24.214 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.214 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.214 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:24.214 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:53:24.215 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:53:24.215 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.215 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.215 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:24.215 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:53:24.215 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:53:24.215 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.215 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.215 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:24.215 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:53:24.215 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:53:24.215 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.215 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.215 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:24.216 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:53:24.216 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:53:24.216 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.216 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.216 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:24.216 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:53:24.216 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:53:24.216 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.216 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.216 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:24.216 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:53:24.216 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:53:24.216 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.217 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.217 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:24.217 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:53:24.217 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:53:24.217 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.217 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.217 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:24.217 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:53:24.217 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:53:24.217 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.217 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.217 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:24.217 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:53:24.217 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:53:24.218 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.218 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.218 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:24.218 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:53:24.218 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:53:24.218 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:24.218 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:24.218 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:24.218 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.218 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.218 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:24.218 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:24.218 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 91.148237465999998, 2024-04-25T22:53:24.219 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:53:24.219 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:24.219 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:24.219 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:24.219 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:24.219 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.219 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:24.219 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:24.219 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:24.219 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.219 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.219 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:24.219 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:24.219 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:24.220 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.220 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.220 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:24.220 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:24.220 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:53:24.220 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.220 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.220 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:24.220 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:24.220 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:53:24.220 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.220 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.220 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:24.220 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:53:24.221 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:53:24.221 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.221 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.221 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:24.221 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:53:24.221 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:53:24.221 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.221 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.221 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:24.221 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:53:24.221 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:53:24.221 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.221 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.221 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:24.222 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:53:24.222 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:53:24.222 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.222 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.222 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:24.222 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:53:24.222 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:53:24.222 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.222 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.222 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:24.222 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:53:24.222 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:53:24.222 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.222 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.223 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:24.223 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:53:24.223 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:53:24.223 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.223 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.223 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:24.223 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:53:24.223 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:53:24.223 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.223 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.223 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:24.223 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:53:24.223 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:53:24.223 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:24.224 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:24.224 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:24.224 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.224 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.224 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:24.224 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:24.224 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 91.148186796000005, 2024-04-25T22:53:24.224 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:53:24.224 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:24.224 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:24.224 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:24.224 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:24.224 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.224 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:24.225 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:24.225 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:24.225 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.225 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.225 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:24.225 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:24.225 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:24.225 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.225 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.225 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:24.225 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:53:24.225 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:53:24.225 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.225 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.226 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:24.226 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:53:24.226 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:53:24.226 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.226 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.226 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:24.226 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:53:24.226 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:53:24.226 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.226 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.226 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:24.226 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:53:24.227 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:53:24.227 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.227 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.227 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:24.227 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:53:24.227 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:53:24.227 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.227 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.227 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:24.227 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:53:24.227 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:53:24.227 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.227 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.227 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:24.228 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:53:24.228 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:53:24.228 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.228 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.228 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:24.228 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:53:24.228 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:53:24.228 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.228 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.228 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:24.228 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:53:24.228 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:53:24.228 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.228 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.229 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:24.229 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:53:24.229 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:53:24.229 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.229 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.229 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:24.229 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:53:24.229 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:53:24.229 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.229 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.229 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:24.229 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:53:24.229 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:53:24.230 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.230 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.230 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:24.230 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:53:24.230 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:53:24.230 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:24.230 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:24.230 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:24.230 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.230 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.230 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:24.230 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:24.230 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 91.148149927000006, 2024-04-25T22:53:24.231 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:53:24.231 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:24.231 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:24.231 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:24.231 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:24.231 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.231 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:24.231 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:24.231 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:24.231 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.231 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.231 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:24.231 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:24.231 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:24.232 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.232 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.232 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:24.232 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:53:24.232 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:53:24.232 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.232 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.232 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:24.232 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:53:24.232 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:53:24.232 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.232 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.232 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:24.232 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:53:24.233 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:53:24.233 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.233 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.233 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:24.233 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:53:24.233 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:53:24.233 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.233 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.233 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:24.233 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:53:24.233 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:53:24.233 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.233 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.233 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:53:24.234 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:53:24.234 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:53:24.234 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.234 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.234 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:24.234 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:53:24.234 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:53:24.234 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.234 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.234 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:24.234 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:53:24.234 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:53:24.234 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.235 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.235 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:24.235 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:53:24.235 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:53:24.235 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.235 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.235 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:24.235 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:53:24.235 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:53:24.235 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.235 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.235 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:24.235 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:53:24.235 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:53:24.236 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.236 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.236 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:24.236 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:53:24.236 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:53:24.236 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.236 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.236 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:24.236 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:53:24.236 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:53:24.236 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:24.236 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:24.236 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:24.236 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.237 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.237 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:24.237 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:24.237 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 91.148124960999994, 2024-04-25T22:53:24.237 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:53:24.237 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:24.237 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:24.237 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:24.237 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:24.237 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.237 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:24.237 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:24.237 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:24.237 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.238 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.238 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:24.238 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:24.238 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:24.238 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.238 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.238 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:24.238 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:53:24.238 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:53:24.238 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.238 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.238 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:24.238 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:53:24.239 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:53:24.239 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.239 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.239 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:24.239 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:24.239 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:53:24.239 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.239 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.239 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:24.239 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:53:24.239 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:53:24.239 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.239 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.239 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:24.239 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:53:24.240 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:53:24.240 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.240 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.240 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:24.240 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:53:24.240 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:53:24.240 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.240 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.240 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:24.240 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:53:24.240 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:53:24.240 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.240 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.241 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:24.241 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:53:24.241 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:53:24.241 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.241 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.241 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:24.241 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:53:24.241 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:53:24.241 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.241 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.241 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:24.241 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:53:24.241 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:53:24.242 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.242 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.242 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:24.242 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:53:24.242 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:53:24.242 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:24.242 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:24.242 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:24.242 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.242 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.242 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:24.242 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:24.242 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 91.148088596999997, 2024-04-25T22:53:24.243 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:53:24.243 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:24.243 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:24.243 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:24.243 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:24.243 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.243 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:24.243 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:24.243 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:24.243 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.243 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.243 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:24.243 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:24.243 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:24.244 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.244 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.244 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:24.244 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:53:24.244 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:53:24.244 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.244 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.244 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:24.244 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:53:24.244 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:53:24.244 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.244 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.244 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:24.245 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:53:24.245 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:53:24.245 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.245 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.245 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:24.245 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:53:24.245 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:53:24.245 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.245 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.245 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:24.245 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:53:24.245 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:53:24.245 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.245 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.246 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:24.246 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:53:24.246 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:53:24.246 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.246 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.246 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:24.246 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:53:24.246 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:53:24.246 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.246 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.246 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:24.246 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:53:24.246 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:53:24.247 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.247 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.247 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:24.247 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:53:24.247 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:53:24.247 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:24.247 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:24.247 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:24.247 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.247 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.247 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:24.247 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:24.247 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 91.148057515999994, 2024-04-25T22:53:24.248 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:53:24.248 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:24.248 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:24.248 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:24.248 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:24.248 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.248 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:24.248 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:24.248 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:24.248 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.249 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.249 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:24.249 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:24.249 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:24.249 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.249 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.249 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:24.249 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:24.249 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:24.249 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.249 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.249 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:24.249 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:53:24.250 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:53:24.250 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.250 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.250 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:24.250 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:53:24.250 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:53:24.250 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.250 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.250 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:24.250 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:53:24.250 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:53:24.250 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.250 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.251 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:24.251 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:53:24.251 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:53:24.251 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.251 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.251 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:24.251 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:53:24.251 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:53:24.251 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.251 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.251 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:24.251 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:53:24.251 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:53:24.251 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:24.252 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:24.252 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:24.252 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.252 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.252 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:53:24.252 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:24.252 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 91.147616546999998, 2024-04-25T22:53:24.252 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064881979999999997, 2024-04-25T22:53:24.252 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:24.252 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:24.252 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:24.252 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:24.252 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.252 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:24.253 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:24.253 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:24.253 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.253 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.253 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:24.253 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:24.253 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:24.253 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.253 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.253 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:24.253 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:24.253 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2699999999999999e-07 2024-04-25T22:53:24.253 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.253 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.254 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:24.254 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013898+0000", 2024-04-25T22:53:24.254 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0796e-05 2024-04-25T22:53:24.254 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.254 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.254 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:24.254 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013907+0000", 2024-04-25T22:53:24.254 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5140000000000007e-06 2024-04-25T22:53:24.254 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.254 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.254 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:24.254 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013952+0000", 2024-04-25T22:53:24.254 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4134000000000001e-05 2024-04-25T22:53:24.255 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.255 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.255 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:24.255 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016812+0000", 2024-04-25T22:53:24.255 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028601059999999998 2024-04-25T22:53:24.255 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.255 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.255 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:24.255 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.017052+0000", 2024-04-25T22:53:24.255 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024056500000000001 2024-04-25T22:53:24.255 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.255 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.255 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:24.256 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020350+0000", 2024-04-25T22:53:24.256 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032978320000000001 2024-04-25T22:53:24.256 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.256 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.256 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:24.256 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020375+0000", 2024-04-25T22:53:24.256 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4624e-05 2024-04-25T22:53:24.256 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:24.256 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:24.256 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:24.256 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.256 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.256 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-25T22:53:24.256 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:24.257 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 91.134086100999994, 2024-04-25T22:53:24.257 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058583000000000003, 2024-04-25T22:53:24.257 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:24.257 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:24.257 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:24.257 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:24.257 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.257 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:24.257 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:24.257 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:24.257 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.257 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.257 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:24.258 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:24.258 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:24.258 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.258 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.258 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:24.258 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:24.258 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.41e-07 2024-04-25T22:53:24.258 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.258 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.258 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:24.258 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027428+0000", 2024-04-25T22:53:24.258 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.075e-05 2024-04-25T22:53:24.258 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.261 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.262 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:24.262 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027435+0000", 2024-04-25T22:53:24.262 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3610000000000003e-06 2024-04-25T22:53:24.262 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.262 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.262 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:24.262 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027442+0000", 2024-04-25T22:53:24.262 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0400000000000004e-06 2024-04-25T22:53:24.262 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.262 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.263 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:24.263 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028094+0000", 2024-04-25T22:53:24.263 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00065134800000000005 2024-04-25T22:53:24.263 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.263 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.263 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:24.263 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028107+0000", 2024-04-25T22:53:24.263 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3087e-05 2024-04-25T22:53:24.263 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.263 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.263 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:24.263 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033239+0000", 2024-04-25T22:53:24.263 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051319429999999999 2024-04-25T22:53:24.264 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.264 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.264 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:24.264 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033275+0000", 2024-04-25T22:53:24.264 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6430000000000002e-05 2024-04-25T22:53:24.264 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:24.264 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:24.264 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:24.264 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.264 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.264 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-25T22:53:24.264 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:24.264 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 91.133701263999995, 2024-04-25T22:53:24.265 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005413597, 2024-04-25T22:53:24.265 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:24.265 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:24.265 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:24.265 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:24.265 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.265 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:24.265 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:24.265 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:24.265 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.265 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.265 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:24.265 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:24.265 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:24.266 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.266 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.266 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:24.266 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:24.266 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3799999999999997e-07 2024-04-25T22:53:24.266 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.266 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.266 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:24.266 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027816+0000", 2024-04-25T22:53:24.266 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3230999999999999e-05 2024-04-25T22:53:24.266 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.266 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.266 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:24.267 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027823+0000", 2024-04-25T22:53:24.267 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9039999999999992e-06 2024-04-25T22:53:24.267 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.267 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.267 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:24.267 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027841+0000", 2024-04-25T22:53:24.267 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7651000000000001e-05 2024-04-25T22:53:24.267 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.267 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.267 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:24.267 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027904+0000", 2024-04-25T22:53:24.267 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3058000000000005e-05 2024-04-25T22:53:24.267 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.267 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.268 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:24.268 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027926+0000", 2024-04-25T22:53:24.268 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1450999999999998e-05 2024-04-25T22:53:24.268 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.268 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.268 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:24.268 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033177+0000", 2024-04-25T22:53:24.268 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052508909999999997 2024-04-25T22:53:24.268 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.268 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.268 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:24.268 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033215+0000", 2024-04-25T22:53:24.268 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8872999999999999e-05 2024-04-25T22:53:24.268 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:24.269 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:24.269 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:24.269 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.269 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.269 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 171 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:53:24.269 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:24.269 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 91.133644161999996, 2024-04-25T22:53:24.269 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054322240000000003, 2024-04-25T22:53:24.269 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:24.269 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:24.269 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "reached pg", 2024-04-25T22:53:24.269 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:24.269 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.270 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:24.270 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:24.270 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:24.270 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.270 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.270 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:24.270 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:24.270 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:24.270 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.270 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.270 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:24.270 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:24.270 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7500000000000001e-07 2024-04-25T22:53:24.271 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.271 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.271 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:24.271 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027868+0000", 2024-04-25T22:53:24.271 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5750000000000001e-06 2024-04-25T22:53:24.271 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.271 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.271 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:24.271 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027885+0000", 2024-04-25T22:53:24.271 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7272e-05 2024-04-25T22:53:24.271 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.271 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.271 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:24.271 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027900+0000", 2024-04-25T22:53:24.272 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.502e-05 2024-04-25T22:53:24.272 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.272 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.272 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:24.272 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028381+0000", 2024-04-25T22:53:24.272 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00048039399999999998 2024-04-25T22:53:24.272 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:24.272 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:24.272 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:24.272 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033291+0000", 2024-04-25T22:53:24.272 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049105879999999996 2024-04-25T22:53:24.272 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:24.272 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:24.273 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:24.273 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:24.273 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:24.273 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:24.274 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:24.274+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:24.275 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is unset 2024-04-25T22:53:24.275 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:24.292 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:53:24.375 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:24.375+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:24.382 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:24.382 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:24.382 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-04-25T22:53:24.382 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:24.391 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:24.418 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-25T22:53:24.419 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:53:24.419 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:53:24.449 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-25T22:53:24.449 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:53:24.452 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:53:24.452 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:53:24.475 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~41s 2024-04-25T22:53:24.476 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:24.476+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:24.495 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:24.495 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:24.504 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:24.576 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:24.576+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:24.606 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:24.606 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:24.615 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:24.678 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:24.677+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:24.719 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:24.719 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:24.728 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:24.779 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:24.779+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:24.830 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:24.830 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:24.839 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:24.880 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:24.880+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:24.941 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:24.942 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:24.950 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:24.995 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:24.994+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:25.055 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:25.055 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:25.063 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:25.104 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:25.103+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:25.183 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:25.182+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:25.205 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:25.205 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:25.215 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:25.283 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:25.282+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:25.355 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:25.356 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:25.364 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:25.384 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:25.383+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:25.469 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:25.469 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:25.477 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:25.487 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:25.487+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:25.578 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:25.578 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:25.587 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:25.588 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:25.588+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:25.691 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:25.691 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:25.691 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:25.691+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:25.697 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:25.792 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:25.791+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:25.800 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:25.801 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:25.809 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:25.895 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:25.894+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:25.910 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:25.910 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:25.919 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:25.996 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:25.995+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:26.021 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:26.021 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:26.029 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:26.097 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:26.096+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:26.133 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:26.133 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:26.142 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:26.198 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:26.197+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:26.276 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-25T22:53:26.284 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:26.284 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:26.293 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:26.298 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:26.298+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:26.394 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:26.394 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:26.399 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:26.398+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:26.402 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:26.453 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:53:26.500 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:26.499+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:26.504 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:26.505 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:26.514 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:26.578 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-25T22:53:26.579 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:53:26.579 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:53:26.601 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:26.600+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:26.614 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-25T22:53:26.614 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:53:26.615 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:26.615 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:26.615 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:53:26.616 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:53:26.616 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:26.617 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:53:26.618 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:53:26.624 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:26.702 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:26.701+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:26.769 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:26.769 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-04-25T22:53:26.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-04-25T22:53:26.770 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:53:26.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.770 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:26.770 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:26.770 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.802553380000006, 2024-04-25T22:53:26.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0103421, 2024-04-25T22:53:26.770 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:26.770 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:26.770 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:26.770 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:26.770 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:26.770 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:26.771 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 115 2024-04-25T22:53:26.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.771 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:26.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:26.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:26.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:26.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:26.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:26.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:26.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:26.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:26.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9500000000000002e-07 2024-04-25T22:53:26.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:26.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965108+0000", 2024-04-25T22:53:26.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9177999999999994e-05 2024-04-25T22:53:26.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:26.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965127+0000", 2024-04-25T22:53:26.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8868e-05 2024-04-25T22:53:26.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:26.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965133+0000", 2024-04-25T22:53:26.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8929999999999999e-06 2024-04-25T22:53:26.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:26.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.969991+0000", 2024-04-25T22:53:26.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048573849999999997 2024-04-25T22:53:26.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:26.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970072+0000", 2024-04-25T22:53:26.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0728000000000004e-05 2024-04-25T22:53:26.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:26.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970189+0000", 2024-04-25T22:53:26.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000117778 2024-04-25T22:53:26.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:26.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970946+0000", 2024-04-25T22:53:26.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00075704600000000004 2024-04-25T22:53:26.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:26.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975297+0000", 2024-04-25T22:53:26.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004350217 2024-04-25T22:53:26.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:26.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975343+0000", 2024-04-25T22:53:26.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6687999999999998e-05 2024-04-25T22:53:26.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:26.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975380+0000", 2024-04-25T22:53:26.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6724000000000003e-05 2024-04-25T22:53:26.776 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:26.776 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:26.776 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:26.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.776 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:26.776 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:26.776 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.802447349000005, 2024-04-25T22:53:26.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010304384, 2024-04-25T22:53:26.776 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:26.776 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:26.776 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:26.776 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:26.777 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:26.777 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:26.777 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 116 2024-04-25T22:53:26.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.777 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:26.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:26.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:26.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:26.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:26.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:26.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:26.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:26.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:26.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5799999999999999e-07 2024-04-25T22:53:26.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:26.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965154+0000", 2024-04-25T22:53:26.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0009e-05 2024-04-25T22:53:26.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:26.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965164+0000", 2024-04-25T22:53:26.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8490000000000001e-06 2024-04-25T22:53:26.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:26.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965169+0000", 2024-04-25T22:53:26.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0730000000000004e-06 2024-04-25T22:53:26.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:26.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970609+0000", 2024-04-25T22:53:26.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054397689999999997 2024-04-25T22:53:26.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:26.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970651+0000", 2024-04-25T22:53:26.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1873999999999999e-05 2024-04-25T22:53:26.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:26.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970723+0000", 2024-04-25T22:53:26.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2039999999999995e-05 2024-04-25T22:53:26.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:26.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971358+0000", 2024-04-25T22:53:26.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063489500000000001 2024-04-25T22:53:26.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:26.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975409+0000", 2024-04-25T22:53:26.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040506880000000002 2024-04-25T22:53:26.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:26.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975432+0000", 2024-04-25T22:53:26.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3315999999999998e-05 2024-04-25T22:53:26.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:26.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975448+0000", 2024-04-25T22:53:26.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6313000000000001e-05 2024-04-25T22:53:26.783 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:26.783 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:26.783 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:26.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.783 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:26.783 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:26.783 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.802412767000007, 2024-04-25T22:53:26.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010384338999999999, 2024-04-25T22:53:26.783 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:26.783 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:26.783 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:26.783 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:26.784 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:26.784 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:26.784 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-04-25T22:53:26.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.784 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:26.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:26.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:26.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:26.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:26.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:26.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:26.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:26.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:26.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3600000000000004e-07 2024-04-25T22:53:26.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:26.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965185+0000", 2024-04-25T22:53:26.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.117e-06 2024-04-25T22:53:26.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:26.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965192+0000", 2024-04-25T22:53:26.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3239999999999997e-06 2024-04-25T22:53:26.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:26.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965198+0000", 2024-04-25T22:53:26.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6370000000000004e-06 2024-04-25T22:53:26.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:26.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970973+0000", 2024-04-25T22:53:26.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057748239999999996 2024-04-25T22:53:26.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:26.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971049+0000", 2024-04-25T22:53:26.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6029e-05 2024-04-25T22:53:26.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:26.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971174+0000", 2024-04-25T22:53:26.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012462399999999999 2024-04-25T22:53:26.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:26.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971553+0000", 2024-04-25T22:53:26.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037896499999999999 2024-04-25T22:53:26.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:26.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975482+0000", 2024-04-25T22:53:26.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039297459999999996 2024-04-25T22:53:26.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:26.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975529+0000", 2024-04-25T22:53:26.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6387000000000002e-05 2024-04-25T22:53:26.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:26.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975563+0000", 2024-04-25T22:53:26.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4150000000000003e-05 2024-04-25T22:53:26.789 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:26.789 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:26.789 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:26.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.789 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:26.789 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:26.789 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 93.755366444000003, 2024-04-25T22:53:26.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012637705000000001, 2024-04-25T22:53:26.789 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:26.789 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:26.789 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:26.790 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:26.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:26.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:26.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:26.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:26.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:26.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:26.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:26.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012227+0000", 2024-04-25T22:53:26.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.863e-06 2024-04-25T22:53:26.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:26.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012236+0000", 2024-04-25T22:53:26.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1109999999999997e-06 2024-04-25T22:53:26.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:26.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012309+0000", 2024-04-25T22:53:26.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3242000000000001e-05 2024-04-25T22:53:26.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:26.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012324+0000", 2024-04-25T22:53:26.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4837e-05 2024-04-25T22:53:26.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:26.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015060+0000", 2024-04-25T22:53:26.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027363349999999999 2024-04-25T22:53:26.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:26.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015169+0000", 2024-04-25T22:53:26.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108372 2024-04-25T22:53:26.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:26.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015498+0000", 2024-04-25T22:53:26.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032949999999999999 2024-04-25T22:53:26.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:26.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021282+0000", 2024-04-25T22:53:26.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057836429999999998 2024-04-25T22:53:26.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:26.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024709+0000", 2024-04-25T22:53:26.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034271979999999998 2024-04-25T22:53:26.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:26.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024802+0000", 2024-04-25T22:53:26.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2960000000000004e-05 2024-04-25T22:53:26.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:26.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024863+0000", 2024-04-25T22:53:26.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0643999999999997e-05 2024-04-25T22:53:26.795 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:26.795 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:26.795 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:26.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.795 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:26.795 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:26.795 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 93.755242672999998, 2024-04-25T22:53:26.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012979447999999999, 2024-04-25T22:53:26.795 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:26.795 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:26.795 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:26.795 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:26.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:26.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:26.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:26.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:26.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:26.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:26.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:26.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:26.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:53:26.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:26.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012354+0000", 2024-04-25T22:53:26.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7740000000000004e-06 2024-04-25T22:53:26.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:26.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012365+0000", 2024-04-25T22:53:26.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.064e-05 2024-04-25T22:53:26.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:26.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012382+0000", 2024-04-25T22:53:26.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6999000000000001e-05 2024-04-25T22:53:26.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:26.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015958+0000", 2024-04-25T22:53:26.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035765699999999998 2024-04-25T22:53:26.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:26.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016037+0000", 2024-04-25T22:53:26.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8242000000000001e-05 2024-04-25T22:53:26.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:26.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016404+0000", 2024-04-25T22:53:26.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036784300000000002 2024-04-25T22:53:26.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:26.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021294+0000", 2024-04-25T22:53:26.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048890629999999999 2024-04-25T22:53:26.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:26.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024959+0000", 2024-04-25T22:53:26.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036651570000000001 2024-04-25T22:53:26.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:26.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025097+0000", 2024-04-25T22:53:26.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013788099999999999 2024-04-25T22:53:26.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:26.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025328+0000", 2024-04-25T22:53:26.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231492 2024-04-25T22:53:26.800 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:26.800 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:26.800 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:26.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.800 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:26.801 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:26.801 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 93.755154903999994, 2024-04-25T22:53:26.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013049827, 2024-04-25T22:53:26.801 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:26.801 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:26.801 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:26.801 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:26.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:26.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:26.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:26.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:26.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:26.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:26.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:26.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012437+0000", 2024-04-25T22:53:26.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-04-25T22:53:26.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:26.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012440+0000", 2024-04-25T22:53:26.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7609999999999999e-06 2024-04-25T22:53:26.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:26.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012449+0000", 2024-04-25T22:53:26.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.285e-06 2024-04-25T22:53:26.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:26.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012457+0000", 2024-04-25T22:53:26.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9510000000000006e-06 2024-04-25T22:53:26.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:26.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017106+0000", 2024-04-25T22:53:26.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046494220000000003 2024-04-25T22:53:26.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:26.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017223+0000", 2024-04-25T22:53:26.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116824 2024-04-25T22:53:26.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:26.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017345+0000", 2024-04-25T22:53:26.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122175 2024-04-25T22:53:26.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:26.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021299+0000", 2024-04-25T22:53:26.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039534879999999998 2024-04-25T22:53:26.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:26.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025398+0000", 2024-04-25T22:53:26.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040988960000000003 2024-04-25T22:53:26.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:26.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025439+0000", 2024-04-25T22:53:26.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0915999999999999e-05 2024-04-25T22:53:26.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:26.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025486+0000", 2024-04-25T22:53:26.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7534999999999998e-05 2024-04-25T22:53:26.806 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:26.806 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:26.806 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:26.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.806 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:26.806 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:26.806 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 93.755124753000004, 2024-04-25T22:53:26.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020988041999999998, 2024-04-25T22:53:26.806 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:26.806 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:26.806 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:26.807 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:26.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:26.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:26.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:26.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:26.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:26.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:26.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:26.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:26.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.99e-07 2024-04-25T22:53:26.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:26.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012470+0000", 2024-04-25T22:53:26.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2789999999999999e-06 2024-04-25T22:53:26.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:26.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012477+0000", 2024-04-25T22:53:26.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:53:26.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:26.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012500+0000", 2024-04-25T22:53:26.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2490999999999999e-05 2024-04-25T22:53:26.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:26.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021911+0000", 2024-04-25T22:53:26.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094114160000000006 2024-04-25T22:53:26.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:26.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022000+0000", 2024-04-25T22:53:26.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8601000000000001e-05 2024-04-25T22:53:26.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:26.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022359+0000", 2024-04-25T22:53:26.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035921999999999999 2024-04-25T22:53:26.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:26.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025541+0000", 2024-04-25T22:53:26.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031820619999999998 2024-04-25T22:53:26.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:26.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033375+0000", 2024-04-25T22:53:26.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078338379999999992 2024-04-25T22:53:26.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:26.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033415+0000", 2024-04-25T22:53:26.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9527000000000003e-05 2024-04-25T22:53:26.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:26.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033455+0000", 2024-04-25T22:53:26.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9932000000000003e-05 2024-04-25T22:53:26.811 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:26.811 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:26.811 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:26.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.812 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:26.812 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:26.812 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 93.755069559999995, 2024-04-25T22:53:26.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021043857999999999, 2024-04-25T22:53:26.812 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:26.812 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:26.812 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:26.812 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:26.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:26.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:26.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:26.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:26.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:26.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:26.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:26.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012523+0000", 2024-04-25T22:53:26.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.361e-06 2024-04-25T22:53:26.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:26.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012530+0000", 2024-04-25T22:53:26.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5440000000000004e-06 2024-04-25T22:53:26.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:26.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012541+0000", 2024-04-25T22:53:26.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1745e-05 2024-04-25T22:53:26.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:26.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012551+0000", 2024-04-25T22:53:26.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5789999999999993e-06 2024-04-25T22:53:26.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:26.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022709+0000", 2024-04-25T22:53:26.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010157685 2024-04-25T22:53:26.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:26.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022957+0000", 2024-04-25T22:53:26.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024824599999999998 2024-04-25T22:53:26.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:26.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023443+0000", 2024-04-25T22:53:26.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048578599999999999 2024-04-25T22:53:26.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:26.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025547+0000", 2024-04-25T22:53:26.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021044789999999998 2024-04-25T22:53:26.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:26.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033509+0000", 2024-04-25T22:53:26.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0079622180000000001 2024-04-25T22:53:26.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:26.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033542+0000", 2024-04-25T22:53:26.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3018000000000001e-05 2024-04-25T22:53:26.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:26.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033566+0000", 2024-04-25T22:53:26.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3197000000000002e-05 2024-04-25T22:53:26.817 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:26.817 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:26.817 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:26.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.818 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:26.818 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:26.818 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 93.755029594999996, 2024-04-25T22:53:26.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021122696, 2024-04-25T22:53:26.818 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:26.818 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:26.818 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:26.818 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:26.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:26.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:26.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:26.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:26.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:26.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:26.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:26.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:26.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:53:26.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:26.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012566+0000", 2024-04-25T22:53:26.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-04-25T22:53:26.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:26.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012619+0000", 2024-04-25T22:53:26.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2607e-05 2024-04-25T22:53:26.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:26.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012628+0000", 2024-04-25T22:53:26.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6500000000000008e-06 2024-04-25T22:53:26.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:26.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024024+0000", 2024-04-25T22:53:26.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011396007999999999 2024-04-25T22:53:26.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:26.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024198+0000", 2024-04-25T22:53:26.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000173215 2024-04-25T22:53:26.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.822 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:26.822 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024447+0000", 2024-04-25T22:53:26.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024898500000000002 2024-04-25T22:53:26.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.822 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:26.822 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026431+0000", 2024-04-25T22:53:26.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001984923 2024-04-25T22:53:26.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.822 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:26.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033608+0000", 2024-04-25T22:53:26.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071768459999999997 2024-04-25T22:53:26.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:26.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033646+0000", 2024-04-25T22:53:26.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299000000000003e-05 2024-04-25T22:53:26.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:26.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033684+0000", 2024-04-25T22:53:26.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8773000000000003e-05 2024-04-25T22:53:26.823 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:26.824 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:26.824 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:26.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.824 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:26.824 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:26.824 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 93.754940996000002, 2024-04-25T22:53:26.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021175381, 2024-04-25T22:53:26.824 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:26.824 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:26.824 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:26.824 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:26.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:26.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:26.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:26.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:26.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:26.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:26.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:26.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012651+0000", 2024-04-25T22:53:26.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:53:26.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.826 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.826 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:26.826 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012656+0000", 2024-04-25T22:53:26.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8899999999999998e-06 2024-04-25T22:53:26.826 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.826 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.826 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:26.826 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012666+0000", 2024-04-25T22:53:26.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0346999999999999e-05 2024-04-25T22:53:26.826 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.826 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.826 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:26.826 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012675+0000", 2024-04-25T22:53:26.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9930000000000001e-06 2024-04-25T22:53:26.827 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.827 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:26.827 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025661+0000", 2024-04-25T22:53:26.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01298531 2024-04-25T22:53:26.827 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.827 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:26.827 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025757+0000", 2024-04-25T22:53:26.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5822000000000005e-05 2024-04-25T22:53:26.827 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.827 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:26.827 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025907+0000", 2024-04-25T22:53:26.828 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015051499999999999 2024-04-25T22:53:26.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.828 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:26.828 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026435+0000", 2024-04-25T22:53:26.828 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052762200000000005 2024-04-25T22:53:26.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.828 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:26.828 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033732+0000", 2024-04-25T22:53:26.828 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072978419999999997 2024-04-25T22:53:26.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.829 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:26.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033787+0000", 2024-04-25T22:53:26.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4703999999999997e-05 2024-04-25T22:53:26.829 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.829 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:26.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033826+0000", 2024-04-25T22:53:26.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8458999999999999e-05 2024-04-25T22:53:26.829 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:26.829 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:26.829 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:26.829 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.830 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:26.830 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:26.830 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 93.754885582, 2024-04-25T22:53:26.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021244174000000001, 2024-04-25T22:53:26.830 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:26.830 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:26.830 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:26.830 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:26.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.830 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:26.830 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:26.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:26.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.831 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.831 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:26.831 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:26.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:26.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.831 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.831 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:26.831 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:26.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:26.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.832 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:26.832 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012712+0000", 2024-04-25T22:53:26.832 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.913e-06 2024-04-25T22:53:26.832 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.832 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:26.832 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012722+0000", 2024-04-25T22:53:26.832 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2879999999999998e-06 2024-04-25T22:53:26.832 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.832 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:26.832 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012727+0000", 2024-04-25T22:53:26.832 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8429999999999998e-06 2024-04-25T22:53:26.832 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.833 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:26.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026099+0000", 2024-04-25T22:53:26.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013371450999999999 2024-04-25T22:53:26.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.833 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:26.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026147+0000", 2024-04-25T22:53:26.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7837999999999998e-05 2024-04-25T22:53:26.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.833 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:26.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026254+0000", 2024-04-25T22:53:26.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107314 2024-04-25T22:53:26.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:26.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026686+0000", 2024-04-25T22:53:26.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000432428 2024-04-25T22:53:26.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:26.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033873+0000", 2024-04-25T22:53:26.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071864399999999997 2024-04-25T22:53:26.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:26.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033904+0000", 2024-04-25T22:53:26.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1321e-05 2024-04-25T22:53:26.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:26.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033950+0000", 2024-04-25T22:53:26.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5707999999999997e-05 2024-04-25T22:53:26.835 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:26.835 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:26.835 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:26.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.835 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:26.835 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:26.836 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 93.754855196999998, 2024-04-25T22:53:26.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01096505, 2024-04-25T22:53:26.836 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:26.836 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:26.836 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:26.836 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:26.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.836 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:26.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:26.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:26.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.836 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:26.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:26.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:26.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:26.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012737+0000", 2024-04-25T22:53:26.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:26.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:26.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012739+0000", 2024-04-25T22:53:26.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-04-25T22:53:26.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:26.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012743+0000", 2024-04-25T22:53:26.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3239999999999996e-06 2024-04-25T22:53:26.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:26.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012746+0000", 2024-04-25T22:53:26.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.129e-06 2024-04-25T22:53:26.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:26.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012796+0000", 2024-04-25T22:53:26.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9231999999999999e-05 2024-04-25T22:53:26.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:26.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012915+0000", 2024-04-25T22:53:26.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119021 2024-04-25T22:53:26.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:26.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013069+0000", 2024-04-25T22:53:26.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015463900000000001 2024-04-25T22:53:26.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:26.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019237+0000", 2024-04-25T22:53:26.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061680329999999998 2024-04-25T22:53:26.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:26.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023603+0000", 2024-04-25T22:53:26.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043655860000000003 2024-04-25T22:53:26.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:26.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023659+0000", 2024-04-25T22:53:26.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6484000000000003e-05 2024-04-25T22:53:26.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:26.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023701+0000", 2024-04-25T22:53:26.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1761999999999998e-05 2024-04-25T22:53:26.841 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:26.841 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:26.841 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:26.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.841 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:26.841 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:26.841 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 93.754830248999994, 2024-04-25T22:53:26.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011234429000000001, 2024-04-25T22:53:26.841 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:26.841 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:26.841 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:26.841 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:26.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:26.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:26.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:26.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:26.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:26.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:26.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:26.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012762+0000", 2024-04-25T22:53:26.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-04-25T22:53:26.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:26.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012765+0000", 2024-04-25T22:53:26.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2569999999999999e-06 2024-04-25T22:53:26.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:26.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012783+0000", 2024-04-25T22:53:26.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8431999999999999e-05 2024-04-25T22:53:26.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:26.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012799+0000", 2024-04-25T22:53:26.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5438999999999999e-05 2024-04-25T22:53:26.844 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.844 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:26.844 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013826+0000", 2024-04-25T22:53:26.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010275060000000001 2024-04-25T22:53:26.844 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.844 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:26.844 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013913+0000", 2024-04-25T22:53:26.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.708e-05 2024-04-25T22:53:26.844 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.844 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:26.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014098+0000", 2024-04-25T22:53:26.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018519399999999999 2024-04-25T22:53:26.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:26.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019684+0000", 2024-04-25T22:53:26.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055860079999999999 2024-04-25T22:53:26.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:26.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023876+0000", 2024-04-25T22:53:26.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041918800000000003 2024-04-25T22:53:26.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:26.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023957+0000", 2024-04-25T22:53:26.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1165e-05 2024-04-25T22:53:26.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:26.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023995+0000", 2024-04-25T22:53:26.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:53:26.846 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:26.846 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:26.846 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:26.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.847 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:26.847 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:26.847 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 93.754732469999993, 2024-04-25T22:53:26.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011131200000000001, 2024-04-25T22:53:26.847 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:26.847 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:26.847 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:26.847 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:26.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:26.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:26.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:26.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:26.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:26.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:26.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:26.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012860+0000", 2024-04-25T22:53:26.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3900000000000004e-07 2024-04-25T22:53:26.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:26.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012865+0000", 2024-04-25T22:53:26.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5609999999999998e-06 2024-04-25T22:53:26.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.849 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:26.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012895+0000", 2024-04-25T22:53:26.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9847000000000001e-05 2024-04-25T22:53:26.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.849 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:26.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012905+0000", 2024-04-25T22:53:26.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.03e-05 2024-04-25T22:53:26.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.850 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:26.850 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015020+0000", 2024-04-25T22:53:26.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021142940000000001 2024-04-25T22:53:26.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.850 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:26.850 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015182+0000", 2024-04-25T22:53:26.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016248099999999999 2024-04-25T22:53:26.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.850 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:26.850 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015357+0000", 2024-04-25T22:53:26.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017471000000000001 2024-04-25T22:53:26.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:26.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021021+0000", 2024-04-25T22:53:26.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056638340000000004 2024-04-25T22:53:26.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:26.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023712+0000", 2024-04-25T22:53:26.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026910380000000002 2024-04-25T22:53:26.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:26.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023763+0000", 2024-04-25T22:53:26.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1477999999999997e-05 2024-04-25T22:53:26.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:26.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023990+0000", 2024-04-25T22:53:26.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000226818 2024-04-25T22:53:26.852 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:26.852 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:26.852 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:26.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.852 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:26.852 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:26.852 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 93.754609373999998, 2024-04-25T22:53:26.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011705299000000001, 2024-04-25T22:53:26.853 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:26.853 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:26.853 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:26.853 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:26.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.853 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:26.853 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:26.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:26.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.853 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:26.853 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:26.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:26.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.854 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:26.854 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012983+0000", 2024-04-25T22:53:26.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:53:26.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.854 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:26.854 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012986+0000", 2024-04-25T22:53:26.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5700000000000001e-06 2024-04-25T22:53:26.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.854 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:26.854 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012993+0000", 2024-04-25T22:53:26.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8730000000000001e-06 2024-04-25T22:53:26.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:26.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013000+0000", 2024-04-25T22:53:26.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1890000000000001e-06 2024-04-25T22:53:26.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:26.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:53:26.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002147866 2024-04-25T22:53:26.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:26.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015351+0000", 2024-04-25T22:53:26.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020300799999999999 2024-04-25T22:53:26.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:26.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016260+0000", 2024-04-25T22:53:26.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00090926799999999997 2024-04-25T22:53:26.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:26.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022669+0000", 2024-04-25T22:53:26.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064082849999999997 2024-04-25T22:53:26.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.857 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:26.857 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024584+0000", 2024-04-25T22:53:26.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019151699999999999 2024-04-25T22:53:26.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.857 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:26.857 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024643+0000", 2024-04-25T22:53:26.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8888999999999998e-05 2024-04-25T22:53:26.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.857 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:26.857 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024687+0000", 2024-04-25T22:53:26.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4444999999999999e-05 2024-04-25T22:53:26.858 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:26.858 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:26.858 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:26.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.858 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:26.858 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:26.858 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 93.754581783000006, 2024-04-25T22:53:26.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011249699, 2024-04-25T22:53:26.858 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:26.858 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:26.858 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:26.858 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:26.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.858 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:26.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:26.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:26.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:26.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:26.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:26.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:26.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013010+0000", 2024-04-25T22:53:26.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2099999999999996e-07 2024-04-25T22:53:26.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:26.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013013+0000", 2024-04-25T22:53:26.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1310000000000002e-06 2024-04-25T22:53:26.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:26.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013020+0000", 2024-04-25T22:53:26.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3330000000000002e-06 2024-04-25T22:53:26.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:26.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013025+0000", 2024-04-25T22:53:26.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6760000000000004e-06 2024-04-25T22:53:26.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:26.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013163+0000", 2024-04-25T22:53:26.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013824599999999999 2024-04-25T22:53:26.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:26.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013504+0000", 2024-04-25T22:53:26.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034080299999999998 2024-04-25T22:53:26.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:26.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013613+0000", 2024-04-25T22:53:26.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108705 2024-04-25T22:53:26.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:26.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015831+0000", 2024-04-25T22:53:26.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002217672 2024-04-25T22:53:26.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:26.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024137+0000", 2024-04-25T22:53:26.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0083060489999999994 2024-04-25T22:53:26.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:26.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024218+0000", 2024-04-25T22:53:26.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1351000000000001e-05 2024-04-25T22:53:26.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:26.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024259+0000", 2024-04-25T22:53:26.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1112000000000002e-05 2024-04-25T22:53:26.863 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:26.863 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:26.863 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:26.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.863 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:26.864 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:26.864 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 93.754494057000002, 2024-04-25T22:53:26.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020379749999999999, 2024-04-25T22:53:26.864 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:26.864 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:26.864 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:26.864 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:26.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.864 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:26.864 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:26.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:26.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:26.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:26.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:26.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:26.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013098+0000", 2024-04-25T22:53:26.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:53:26.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:26.866 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013105+0000", 2024-04-25T22:53:26.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5969999999999997e-06 2024-04-25T22:53:26.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.866 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:26.866 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013190+0000", 2024-04-25T22:53:26.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5618999999999995e-05 2024-04-25T22:53:26.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.866 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:26.866 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013200+0000", 2024-04-25T22:53:26.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5859999999999994e-06 2024-04-25T22:53:26.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.867 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:26.867 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020265+0000", 2024-04-25T22:53:26.867 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070653349999999998 2024-04-25T22:53:26.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.867 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:26.867 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020454+0000", 2024-04-25T22:53:26.867 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189316 2024-04-25T22:53:26.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.867 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:26.868 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020586+0000", 2024-04-25T22:53:26.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013195700000000001 2024-04-25T22:53:26.868 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.868 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.868 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:26.868 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023822+0000", 2024-04-25T22:53:26.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032358529999999999 2024-04-25T22:53:26.868 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.868 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.868 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:26.868 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033409+0000", 2024-04-25T22:53:26.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095870520000000004 2024-04-25T22:53:26.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.869 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.869 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:26.869 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033447+0000", 2024-04-25T22:53:26.869 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7261999999999997e-05 2024-04-25T22:53:26.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.869 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.869 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:26.869 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033477+0000", 2024-04-25T22:53:26.869 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0389e-05 2024-04-25T22:53:26.869 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:26.869 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:26.869 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:26.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.870 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.870 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:26.870 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:26.870 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 93.754377551000005, 2024-04-25T22:53:26.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010857383999999999, 2024-04-25T22:53:26.870 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:26.870 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:26.870 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:26.870 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:26.870 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.870 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:26.870 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:26.871 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:26.871 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.871 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.871 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:26.871 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:26.871 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:26.871 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.871 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.871 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:26.871 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:26.871 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:26.871 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.871 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.871 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:26.872 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013218+0000", 2024-04-25T22:53:26.872 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8199999999999998e-06 2024-04-25T22:53:26.872 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.872 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.872 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:26.872 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013226+0000", 2024-04-25T22:53:26.872 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7649999999999993e-06 2024-04-25T22:53:26.872 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.872 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.872 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:26.872 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013259+0000", 2024-04-25T22:53:26.872 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2727e-05 2024-04-25T22:53:26.872 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.873 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.873 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:26.873 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014809+0000", 2024-04-25T22:53:26.873 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001550144 2024-04-25T22:53:26.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.873 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.873 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:26.873 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014958+0000", 2024-04-25T22:53:26.873 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014890300000000001 2024-04-25T22:53:26.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.873 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.873 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:26.873 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015087+0000", 2024-04-25T22:53:26.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012939200000000001 2024-04-25T22:53:26.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.874 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:26.874 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020212+0000", 2024-04-25T22:53:26.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051248939999999996 2024-04-25T22:53:26.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.874 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:26.874 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023699+0000", 2024-04-25T22:53:26.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034873289999999999 2024-04-25T22:53:26.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.875 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:26.875 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024014+0000", 2024-04-25T22:53:26.875 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031473999999999999 2024-04-25T22:53:26.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.875 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:26.875 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024071+0000", 2024-04-25T22:53:26.875 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7040000000000003e-05 2024-04-25T22:53:26.875 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:26.875 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:26.875 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:26.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.875 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:26.876 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:26.876 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 93.754322845999994, 2024-04-25T22:53:26.876 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012329677000000001, 2024-04-25T22:53:26.876 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:26.876 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:26.876 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:26.876 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:26.876 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.876 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:26.876 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:26.876 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:26.876 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.876 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.876 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:26.877 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:26.877 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:26.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.877 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:26.877 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013269+0000", 2024-04-25T22:53:26.877 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5000000000000002e-07 2024-04-25T22:53:26.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.877 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:26.877 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:26.877 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6909999999999999e-06 2024-04-25T22:53:26.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.878 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:26.878 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013284+0000", 2024-04-25T22:53:26.878 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0963e-05 2024-04-25T22:53:26.878 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.878 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.878 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:26.878 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013361+0000", 2024-04-25T22:53:26.878 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7379999999999994e-05 2024-04-25T22:53:26.878 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.878 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.878 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:26.878 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013448+0000", 2024-04-25T22:53:26.878 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6990000000000006e-05 2024-04-25T22:53:26.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:26.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013632+0000", 2024-04-25T22:53:26.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018396800000000001 2024-04-25T22:53:26.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:26.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013800+0000", 2024-04-25T22:53:26.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167467 2024-04-25T22:53:26.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:26.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.018570+0000", 2024-04-25T22:53:26.880 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047701460000000003 2024-04-25T22:53:26.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.880 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.880 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:26.880 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025507+0000", 2024-04-25T22:53:26.880 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069372039999999998 2024-04-25T22:53:26.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.880 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.880 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:26.880 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025562+0000", 2024-04-25T22:53:26.880 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4858999999999998e-05 2024-04-25T22:53:26.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.880 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.880 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:26.881 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025598+0000", 2024-04-25T22:53:26.881 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6259e-05 2024-04-25T22:53:26.881 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:26.881 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:26.881 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:26.881 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.881 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.881 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:26.881 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:26.881 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 93.754190972999993, 2024-04-25T22:53:26.881 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020176666999999999, 2024-04-25T22:53:26.881 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:26.881 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:26.881 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:53:26.881 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:26.882 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.882 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:26.882 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:26.882 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:26.882 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.882 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.882 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:26.882 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:26.882 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:26.882 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.882 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.882 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:26.882 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:26.882 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-04-25T22:53:26.883 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.883 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:26.883 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013405+0000", 2024-04-25T22:53:26.883 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0559999999999998e-06 2024-04-25T22:53:26.883 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.883 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:26.883 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013422+0000", 2024-04-25T22:53:26.883 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6770999999999999e-05 2024-04-25T22:53:26.883 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.883 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:26.883 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013431+0000", 2024-04-25T22:53:26.884 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5019999999999998e-06 2024-04-25T22:53:26.884 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.884 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.884 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:26.884 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021720+0000", 2024-04-25T22:53:26.884 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082884340000000008 2024-04-25T22:53:26.884 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.884 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.884 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:26.884 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022122+0000", 2024-04-25T22:53:26.884 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000401634 2024-04-25T22:53:26.884 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:26.884 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:26.885 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:26.885 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033577+0000", 2024-04-25T22:53:26.885 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011455435999999999 2024-04-25T22:53:26.885 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:26.885 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:26.885 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:26.885 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:26.885 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:26.885 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:26.887 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:26.887 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:26.885+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:26.987 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:26.987+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:26.993 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:26.993 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:26.993 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-25T22:53:26.993 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:27.003 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:27.088 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:27.087+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:27.105 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:27.105 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:27.105 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-25T22:53:27.105 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-25T22:53:27.105 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:27.114 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:27.189 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:27.189+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:27.219 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:27.219 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:53:27.219 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:53:27.219 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:53:27.219 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.219 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:53:27.219 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:27.219 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 99.250255788000004, 2024-04-25T22:53:27.219 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:53:27.219 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:27.220 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:27.220 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:27.220 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:27.220 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.220 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:27.220 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:27.220 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:27.220 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.220 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.220 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:27.220 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:27.220 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:27.220 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.220 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.221 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:27.221 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:53:27.221 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:53:27.221 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.221 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.221 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:27.221 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:53:27.221 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:53:27.221 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.221 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.221 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:27.221 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:53:27.221 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:53:27.221 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.222 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.222 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:27.222 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:53:27.222 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:53:27.222 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.222 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.222 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:27.222 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:53:27.222 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:53:27.222 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.222 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.222 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:27.222 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:53:27.223 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:53:27.223 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.223 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.223 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:27.223 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:53:27.223 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:53:27.223 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.223 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.223 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:27.223 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:53:27.223 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:53:27.223 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:27.223 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:27.224 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:27.224 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.224 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.224 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:110 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'72, mlcod=10'68)", 2024-04-25T22:53:27.224 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:27.224 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 99.249621787999999, 2024-04-25T22:53:27.224 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065316630000000001, 2024-04-25T22:53:27.224 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:27.224 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:27.224 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:27.224 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:27.224 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.224 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:27.225 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:27.225 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:27.225 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.225 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.225 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:27.225 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:27.225 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:27.225 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.225 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.225 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:27.225 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:27.225 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.58e-07 2024-04-25T22:53:27.225 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.226 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.226 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:27.226 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967811+0000", 2024-04-25T22:53:27.226 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.118e-06 2024-04-25T22:53:27.226 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.226 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.226 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:27.226 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967817+0000", 2024-04-25T22:53:27.226 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3709999999999996e-06 2024-04-25T22:53:27.226 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.227 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.227 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:27.227 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967820+0000", 2024-04-25T22:53:27.227 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2210000000000002e-06 2024-04-25T22:53:27.227 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.227 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.227 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:27.227 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967876+0000", 2024-04-25T22:53:27.227 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5507000000000002e-05 2024-04-25T22:53:27.227 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.227 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.227 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:27.227 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967893+0000", 2024-04-25T22:53:27.228 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7812000000000002e-05 2024-04-25T22:53:27.228 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.228 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.228 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:27.228 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974317+0000", 2024-04-25T22:53:27.228 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064237160000000003 2024-04-25T22:53:27.228 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.228 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.228 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:27.228 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:53:27.228 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.156e-05 2024-04-25T22:53:27.228 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:27.228 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:27.229 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:27.229 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.229 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.229 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'68)", 2024-04-25T22:53:27.229 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:27.229 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 99.249204274999997, 2024-04-25T22:53:27.229 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061292279999999996, 2024-04-25T22:53:27.229 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:27.229 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:27.229 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:27.229 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:27.229 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.229 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:27.229 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:27.230 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:27.230 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.230 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.230 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:27.230 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:27.230 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:27.230 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.230 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.230 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:27.231 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:27.231 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6300000000000001e-07 2024-04-25T22:53:27.231 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.231 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.231 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:27.231 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968228+0000", 2024-04-25T22:53:27.231 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6139999999999999e-06 2024-04-25T22:53:27.231 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.231 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.231 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:27.231 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968235+0000", 2024-04-25T22:53:27.231 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7020000000000001e-06 2024-04-25T22:53:27.232 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.232 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.232 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:27.232 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968238+0000", 2024-04-25T22:53:27.232 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0010000000000002e-06 2024-04-25T22:53:27.232 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.232 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.232 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:27.232 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968297+0000", 2024-04-25T22:53:27.232 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8424999999999997e-05 2024-04-25T22:53:27.232 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.232 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.232 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:27.232 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968316+0000", 2024-04-25T22:53:27.233 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8814999999999999e-05 2024-04-25T22:53:27.233 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.233 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.233 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:27.233 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:53:27.233 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060239439999999998 2024-04-25T22:53:27.233 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.233 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.233 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:27.233 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974354+0000", 2024-04-25T22:53:27.233 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4364e-05 2024-04-25T22:53:27.233 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:27.233 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:27.233 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:27.234 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.234 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.234 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'68)", 2024-04-25T22:53:27.234 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:27.234 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 99.248767272999999, 2024-04-25T22:53:27.234 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005948414, 2024-04-25T22:53:27.234 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:27.234 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:27.234 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:27.234 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:27.234 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.234 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:27.235 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:27.235 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:27.235 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.235 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.235 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:27.235 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:27.235 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:27.235 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.235 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.235 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:27.235 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:27.235 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6199999999999998e-07 2024-04-25T22:53:27.235 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.236 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.236 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:27.236 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968723+0000", 2024-04-25T22:53:27.236 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1148999999999993e-05 2024-04-25T22:53:27.236 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.236 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.236 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:27.236 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968730+0000", 2024-04-25T22:53:27.236 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1749999999999999e-06 2024-04-25T22:53:27.236 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.236 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.236 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:27.236 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968734+0000", 2024-04-25T22:53:27.236 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5200000000000002e-06 2024-04-25T22:53:27.237 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.237 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.237 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:27.237 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968771+0000", 2024-04-25T22:53:27.237 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6851999999999999e-05 2024-04-25T22:53:27.237 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.237 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.237 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:27.237 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968788+0000", 2024-04-25T22:53:27.237 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7027000000000001e-05 2024-04-25T22:53:27.237 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.237 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.237 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:27.237 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974589+0000", 2024-04-25T22:53:27.238 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058013320000000002 2024-04-25T22:53:27.238 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.238 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.238 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:27.238 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974610+0000", 2024-04-25T22:53:27.238 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0897e-05 2024-04-25T22:53:27.238 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:27.238 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:27.238 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:27.238 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.238 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.238 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'68)", 2024-04-25T22:53:27.238 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:27.239 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 99.248197262999994, 2024-04-25T22:53:27.239 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053935750000000003, 2024-04-25T22:53:27.239 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:27.239 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:27.239 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:27.239 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:27.239 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.239 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:27.239 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:27.239 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:27.239 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.239 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.239 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:27.239 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:27.240 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:27.240 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.240 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.240 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:27.240 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:27.240 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.03e-07 2024-04-25T22:53:27.240 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.240 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.240 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:27.240 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969235+0000", 2024-04-25T22:53:27.240 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2399999999999999e-06 2024-04-25T22:53:27.240 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.240 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.241 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:27.241 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969242+0000", 2024-04-25T22:53:27.241 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1269999999999997e-06 2024-04-25T22:53:27.241 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.241 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.241 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:27.241 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969246+0000", 2024-04-25T22:53:27.241 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3840000000000001e-06 2024-04-25T22:53:27.241 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.241 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.241 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:27.241 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969278+0000", 2024-04-25T22:53:27.241 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1868e-05 2024-04-25T22:53:27.241 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.242 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.242 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:27.242 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969295+0000", 2024-04-25T22:53:27.242 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7530999999999999e-05 2024-04-25T22:53:27.242 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.242 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.242 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:27.242 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974611+0000", 2024-04-25T22:53:27.242 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053160789999999996 2024-04-25T22:53:27.242 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.242 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.242 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:27.242 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974625+0000", 2024-04-25T22:53:27.243 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3943e-05 2024-04-25T22:53:27.243 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:27.243 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:27.243 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:27.243 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.243 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.243 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-25T22:53:27.243 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:27.243 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 99.054601355000003, 2024-04-25T22:53:27.243 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054952610000000004, 2024-04-25T22:53:27.243 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:27.243 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:27.243 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:27.243 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:27.244 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.244 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:27.244 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:27.244 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:27.244 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.244 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.244 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:27.244 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:27.244 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:27.244 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.244 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.244 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:27.244 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:27.245 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.68e-07 2024-04-25T22:53:27.245 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.245 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.245 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:27.245 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162898+0000", 2024-04-25T22:53:27.245 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9470999999999999e-05 2024-04-25T22:53:27.245 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.245 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.245 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:27.245 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162906+0000", 2024-04-25T22:53:27.245 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1580000000000005e-06 2024-04-25T22:53:27.245 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.245 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.245 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:27.246 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162911+0000", 2024-04-25T22:53:27.246 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4779999999999999e-06 2024-04-25T22:53:27.246 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.246 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.246 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:27.246 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162952+0000", 2024-04-25T22:53:27.246 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0629e-05 2024-04-25T22:53:27.246 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.246 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.246 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:27.246 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162968+0000", 2024-04-25T22:53:27.246 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6239000000000002e-05 2024-04-25T22:53:27.246 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.246 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.247 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:27.247 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168281+0000", 2024-04-25T22:53:27.247 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053132869999999999 2024-04-25T22:53:27.247 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.247 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.247 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:27.247 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168323+0000", 2024-04-25T22:53:27.247 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1430999999999997e-05 2024-04-25T22:53:27.247 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:27.247 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:27.247 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:27.247 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.247 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.248 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-04-25T22:53:27.248 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:27.248 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 98.624123992999998, 2024-04-25T22:53:27.248 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050872510000000001, 2024-04-25T22:53:27.248 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:27.248 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:27.248 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:27.248 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:27.248 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.248 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:27.248 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:27.248 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:27.248 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.248 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.249 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:27.249 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:27.249 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:27.249 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.249 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.249 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:27.249 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:27.249 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.72e-07 2024-04-25T22:53:27.249 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.249 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.249 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:27.249 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593381+0000", 2024-04-25T22:53:27.250 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5797000000000006e-05 2024-04-25T22:53:27.250 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.250 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.250 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:27.250 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593389+0000", 2024-04-25T22:53:27.250 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8480000000000001e-06 2024-04-25T22:53:27.250 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.250 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.250 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:27.250 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593393+0000", 2024-04-25T22:53:27.250 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4819999999999996e-06 2024-04-25T22:53:27.250 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.250 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.251 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:27.251 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593435+0000", 2024-04-25T22:53:27.251 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1600000000000002e-05 2024-04-25T22:53:27.251 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.251 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.251 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:27.251 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593454+0000", 2024-04-25T22:53:27.251 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8868e-05 2024-04-25T22:53:27.251 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.251 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.251 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:27.251 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598350+0000", 2024-04-25T22:53:27.251 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004895763 2024-04-25T22:53:27.252 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.252 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.252 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:27.252 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598392+0000", 2024-04-25T22:53:27.252 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2521000000000002e-05 2024-04-25T22:53:27.252 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:27.252 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:27.252 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:27.252 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.252 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.252 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:27.252 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:27.252 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 94.205760088999995, 2024-04-25T22:53:27.252 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:53:27.253 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:27.253 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:27.253 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:27.253 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:27.253 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.253 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:27.253 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:27.253 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:27.253 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.253 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.253 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:27.253 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:27.253 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:27.254 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.254 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.254 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:27.254 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:53:27.254 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:53:27.254 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.254 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.254 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:27.254 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:53:27.254 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:53:27.254 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.254 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.254 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:27.255 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:53:27.255 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:53:27.255 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.255 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.255 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:27.255 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:53:27.255 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:53:27.255 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.255 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.255 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:27.255 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:53:27.256 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:53:27.256 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.256 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.256 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:27.256 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:53:27.256 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:53:27.256 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.256 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.256 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:27.256 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:53:27.256 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:53:27.256 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.256 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.257 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:27.257 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:53:27.257 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:53:27.257 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.257 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.257 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:27.257 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:53:27.257 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:53:27.258 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.258 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.258 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:27.258 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:53:27.258 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:53:27.258 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.258 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.258 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:27.258 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:53:27.258 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:53:27.258 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:27.258 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:27.259 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:27.259 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.259 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.259 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:27.259 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:27.259 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 94.205085713000003, 2024-04-25T22:53:27.259 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:53:27.259 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:27.259 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:27.259 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:27.259 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:27.259 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.259 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:27.259 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:27.260 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:27.260 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.260 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.260 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:27.260 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:27.260 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:27.260 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.260 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.261 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:27.261 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:53:27.261 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:53:27.261 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.261 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.261 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:27.261 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:53:27.261 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:53:27.261 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.261 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.261 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:27.261 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:53:27.261 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:53:27.262 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.262 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.262 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:27.262 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:53:27.262 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:53:27.262 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.262 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.262 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:27.262 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:53:27.262 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:53:27.262 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.262 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.262 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:27.263 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:53:27.263 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:53:27.263 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.263 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.263 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:27.263 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:53:27.263 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:53:27.263 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.263 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.263 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:27.263 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:53:27.263 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:53:27.263 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.263 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.264 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:27.264 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:53:27.264 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:53:27.264 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.264 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.264 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:27.264 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:53:27.264 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:53:27.264 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.264 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.264 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:27.264 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:53:27.264 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:53:27.265 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:27.265 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:27.265 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:27.265 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.265 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.265 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:27.265 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:27.265 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 94.204576501000005, 2024-04-25T22:53:27.265 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:53:27.265 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:27.265 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:27.265 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:27.265 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:27.266 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.266 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:27.266 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:27.266 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:27.266 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.266 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.266 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:27.266 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:27.266 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:27.266 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.266 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.266 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:27.266 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:53:27.266 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:53:27.267 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.267 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.267 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:27.267 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:53:27.267 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:53:27.267 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.267 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.267 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:27.267 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:53:27.267 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:53:27.267 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.267 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.267 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:27.268 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:53:27.268 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:53:27.268 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.268 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.268 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:27.268 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:53:27.268 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:53:27.268 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.268 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.268 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:27.268 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:53:27.268 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:53:27.268 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.268 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.269 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:27.269 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:53:27.269 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:53:27.269 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.269 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.269 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:27.269 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:53:27.269 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:53:27.269 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.269 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.269 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:27.269 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:53:27.269 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:53:27.270 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.270 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.270 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:27.270 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:53:27.270 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:53:27.270 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.270 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.270 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:27.270 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:53:27.270 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:53:27.270 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:27.270 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:27.270 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:27.271 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.271 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.271 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:27.271 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:27.271 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 94.204163303000001, 2024-04-25T22:53:27.271 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:53:27.271 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:27.271 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:27.271 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:27.271 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:27.271 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.271 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:27.271 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:27.271 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:27.272 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.272 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.272 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:27.272 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:27.272 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:27.272 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.272 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.272 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:27.272 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:27.272 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:53:27.272 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.272 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.272 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:27.273 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:27.273 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:53:27.273 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.273 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.273 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:27.273 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:53:27.273 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:53:27.273 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.273 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.273 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:27.273 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:53:27.273 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:53:27.273 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.273 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.274 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:27.274 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:53:27.274 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:53:27.274 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.274 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.274 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:27.274 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:53:27.274 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:53:27.274 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.274 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.274 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:27.274 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:53:27.274 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:53:27.275 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.275 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.275 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:27.275 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:53:27.275 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:53:27.275 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.275 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.275 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:27.275 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:53:27.275 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:53:27.275 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.275 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.275 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:27.275 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:53:27.276 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:53:27.276 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.276 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.276 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:27.276 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:53:27.276 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:53:27.276 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:27.276 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:27.276 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:27.276 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.276 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.276 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:27.276 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:27.277 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 94.204112632999994, 2024-04-25T22:53:27.277 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:53:27.277 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:27.277 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:27.277 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:27.277 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:27.277 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.277 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:27.277 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:27.277 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:27.277 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.277 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.277 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:27.277 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:27.278 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:27.278 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.278 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.278 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:27.278 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:53:27.278 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:53:27.278 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.278 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.278 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:27.278 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:53:27.278 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:53:27.278 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.278 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.279 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:27.279 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:53:27.279 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:53:27.279 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.279 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.279 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:27.279 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:53:27.279 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:53:27.279 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.279 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.279 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:27.279 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:53:27.279 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:53:27.280 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.280 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.280 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:27.280 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:53:27.280 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:53:27.280 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.280 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.280 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:27.280 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:53:27.280 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:53:27.280 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.280 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.280 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:27.281 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:53:27.281 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:53:27.281 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.281 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.281 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:27.281 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:53:27.281 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:53:27.281 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.281 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.281 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:27.281 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:53:27.281 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:53:27.281 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.281 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.282 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:27.282 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:53:27.282 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:53:27.282 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.282 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.282 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:27.282 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:53:27.282 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:53:27.282 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.282 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.282 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:27.282 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:53:27.282 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:53:27.282 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:27.283 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:27.283 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:27.283 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.283 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.283 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:27.283 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:27.283 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 94.204075763999995, 2024-04-25T22:53:27.283 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:53:27.283 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:27.283 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:27.283 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:27.283 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:27.283 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.284 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:27.284 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:27.284 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:27.284 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.284 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.284 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:27.284 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:27.284 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:27.284 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.284 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.284 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:27.284 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:53:27.284 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:53:27.284 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.285 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.285 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:27.285 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:53:27.285 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:53:27.285 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.285 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.285 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:27.285 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:53:27.285 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:53:27.285 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.285 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.285 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:27.285 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:53:27.286 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:53:27.286 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.286 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.286 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:27.286 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:53:27.286 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:53:27.286 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.286 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.286 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:53:27.286 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:53:27.286 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:53:27.286 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.286 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.287 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:27.287 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:53:27.287 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:53:27.287 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.287 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.287 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:27.287 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:53:27.287 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:53:27.287 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.287 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.287 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:27.287 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:53:27.287 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:53:27.288 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.288 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.288 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:27.288 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:53:27.288 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:53:27.288 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.288 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.288 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:27.288 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:53:27.288 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:53:27.288 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.288 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.288 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:27.289 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:53:27.289 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:53:27.289 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.289 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.289 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:27.289 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:53:27.289 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:53:27.289 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:27.289 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:27.289 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:27.289 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.289 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.289 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:27.289 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:27.289 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 94.204050797999997, 2024-04-25T22:53:27.290 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:53:27.290 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:27.290 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:27.290 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:27.290 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:27.290 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.290 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:27.290 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:27.290 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:27.290 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.290 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.290 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:27.290 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:27.291 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:27.291 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.291 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.291 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:27.291 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:53:27.291 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:53:27.291 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.291 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.291 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:27.291 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:53:27.291 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:53:27.291 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.291 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.292 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:27.292 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:27.292 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:53:27.292 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.292 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.292 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:27.292 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:53:27.292 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:53:27.292 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.292 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.292 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:27.292 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:53:27.292 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:53:27.293 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.293 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.293 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:27.293 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:53:27.293 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:53:27.293 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.293 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.293 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:27.293 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:53:27.293 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:53:27.293 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.293 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.293 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:27.293 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:53:27.294 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:53:27.294 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.294 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.294 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:27.294 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:53:27.294 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:53:27.294 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.294 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.294 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:27.294 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:53:27.294 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:53:27.294 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.294 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.295 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:27.295 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:53:27.295 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:53:27.295 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:27.295 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:27.295 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:27.295 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.295 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.295 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:27.295 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:27.295 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 94.204014434000001, 2024-04-25T22:53:27.295 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:53:27.295 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:27.296 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:27.296 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:27.296 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:27.296 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.296 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:27.296 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:27.296 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:27.296 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.296 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.296 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:27.296 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:27.296 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:27.296 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.297 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.297 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:27.297 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:53:27.297 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:53:27.297 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.297 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.297 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:27.297 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:53:27.297 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:53:27.297 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.297 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.297 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:27.297 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:53:27.298 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:53:27.298 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.298 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.298 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:27.298 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:53:27.298 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:53:27.298 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.298 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.298 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:27.298 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:53:27.298 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:53:27.298 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.298 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.298 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:27.299 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:53:27.299 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:53:27.299 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.299 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.299 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:27.299 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:53:27.299 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:53:27.299 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.299 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.299 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:27.299 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:53:27.299 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:53:27.299 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.300 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.300 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:27.300 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:53:27.300 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:53:27.300 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:27.300 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:27.300 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:27.300 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.300 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.300 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:27.300 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:27.300 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 94.203983352999998, 2024-04-25T22:53:27.300 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:53:27.300 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:27.301 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:27.301 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:27.301 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:27.301 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.301 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:27.301 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:27.301 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:27.301 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.301 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.301 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:27.301 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:27.301 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:27.301 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.302 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.302 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:27.302 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:27.302 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:27.302 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.302 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.302 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:27.302 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:53:27.302 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:53:27.302 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.302 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.302 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:27.302 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:53:27.303 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:53:27.303 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.303 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.303 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:27.303 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:53:27.303 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:53:27.303 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.303 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.303 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:27.303 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:53:27.303 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:53:27.303 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.303 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.303 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:27.304 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:53:27.304 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:53:27.304 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.304 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.304 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:27.304 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:53:27.304 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:53:27.304 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:27.304 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:27.304 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:27.304 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.304 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.304 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:53:27.304 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:27.305 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 94.203542384000002, 2024-04-25T22:53:27.305 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064881979999999997, 2024-04-25T22:53:27.305 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:27.305 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:27.305 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:27.305 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:27.305 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.305 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:27.305 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:27.305 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:27.305 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.305 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.305 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:27.305 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:27.306 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:27.306 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.306 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.306 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:27.306 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:27.306 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2699999999999999e-07 2024-04-25T22:53:27.306 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.306 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.306 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:27.306 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013898+0000", 2024-04-25T22:53:27.306 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0796e-05 2024-04-25T22:53:27.306 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.306 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.306 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:27.307 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013907+0000", 2024-04-25T22:53:27.307 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5140000000000007e-06 2024-04-25T22:53:27.307 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.307 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.307 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:27.307 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013952+0000", 2024-04-25T22:53:27.307 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4134000000000001e-05 2024-04-25T22:53:27.307 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.307 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.307 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:27.307 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016812+0000", 2024-04-25T22:53:27.307 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028601059999999998 2024-04-25T22:53:27.307 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.308 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.308 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:27.308 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.017052+0000", 2024-04-25T22:53:27.308 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024056500000000001 2024-04-25T22:53:27.308 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.308 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.308 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:27.308 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020350+0000", 2024-04-25T22:53:27.308 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032978320000000001 2024-04-25T22:53:27.308 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.308 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.308 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:27.308 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020375+0000", 2024-04-25T22:53:27.309 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4624e-05 2024-04-25T22:53:27.309 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:27.309 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:27.309 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:27.309 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.309 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.309 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-25T22:53:27.309 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:27.309 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 94.190011937999998, 2024-04-25T22:53:27.309 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058583000000000003, 2024-04-25T22:53:27.309 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:27.309 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:27.309 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:27.309 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:27.310 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.310 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:27.310 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:27.310 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:27.310 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.310 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.310 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:27.310 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:27.310 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:27.310 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.310 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.310 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:27.310 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:27.311 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.41e-07 2024-04-25T22:53:27.311 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.311 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.311 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:27.311 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027428+0000", 2024-04-25T22:53:27.311 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.075e-05 2024-04-25T22:53:27.311 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.311 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.311 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:27.311 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027435+0000", 2024-04-25T22:53:27.311 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3610000000000003e-06 2024-04-25T22:53:27.311 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.311 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.311 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:27.312 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027442+0000", 2024-04-25T22:53:27.312 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0400000000000004e-06 2024-04-25T22:53:27.312 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.312 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.312 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:27.312 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028094+0000", 2024-04-25T22:53:27.312 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00065134800000000005 2024-04-25T22:53:27.312 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.312 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.312 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:27.312 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028107+0000", 2024-04-25T22:53:27.312 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3087e-05 2024-04-25T22:53:27.312 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.313 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.313 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:27.313 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033239+0000", 2024-04-25T22:53:27.313 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051319429999999999 2024-04-25T22:53:27.313 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.313 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.313 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:27.313 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033275+0000", 2024-04-25T22:53:27.313 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6430000000000002e-05 2024-04-25T22:53:27.313 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:27.313 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:27.313 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:27.313 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.314 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.314 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-25T22:53:27.314 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:27.314 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 94.189627100999999, 2024-04-25T22:53:27.314 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005413597, 2024-04-25T22:53:27.314 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:27.314 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:27.314 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:27.314 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:27.314 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.314 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:27.314 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:27.314 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:27.315 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.315 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.315 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:27.315 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:27.315 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:27.315 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.315 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.315 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:27.315 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:27.315 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3799999999999997e-07 2024-04-25T22:53:27.315 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.315 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.315 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:27.315 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027816+0000", 2024-04-25T22:53:27.316 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3230999999999999e-05 2024-04-25T22:53:27.316 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.316 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.316 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:27.316 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027823+0000", 2024-04-25T22:53:27.316 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9039999999999992e-06 2024-04-25T22:53:27.316 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.316 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.316 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:27.316 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027841+0000", 2024-04-25T22:53:27.316 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7651000000000001e-05 2024-04-25T22:53:27.316 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.316 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.317 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:27.317 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027904+0000", 2024-04-25T22:53:27.317 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3058000000000005e-05 2024-04-25T22:53:27.317 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.317 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.317 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:27.317 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027926+0000", 2024-04-25T22:53:27.317 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1450999999999998e-05 2024-04-25T22:53:27.317 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.317 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.317 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:27.317 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033177+0000", 2024-04-25T22:53:27.317 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052508909999999997 2024-04-25T22:53:27.317 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.318 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.318 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:27.318 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033215+0000", 2024-04-25T22:53:27.318 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8872999999999999e-05 2024-04-25T22:53:27.318 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:27.318 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:27.318 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:27.318 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.318 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.318 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 171 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:53:27.318 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:27.318 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 94.189569999, 2024-04-25T22:53:27.318 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054322240000000003, 2024-04-25T22:53:27.319 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:27.319 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:27.319 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "reached pg", 2024-04-25T22:53:27.319 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:27.319 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.319 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:27.319 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:27.319 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:27.319 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.319 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.319 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:27.319 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:27.319 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:27.319 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.320 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.320 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:27.320 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:27.320 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7500000000000001e-07 2024-04-25T22:53:27.320 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.320 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.320 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:27.320 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027868+0000", 2024-04-25T22:53:27.320 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5750000000000001e-06 2024-04-25T22:53:27.320 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.320 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.320 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:27.320 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027885+0000", 2024-04-25T22:53:27.321 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7272e-05 2024-04-25T22:53:27.321 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.321 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.321 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:27.321 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027900+0000", 2024-04-25T22:53:27.321 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.502e-05 2024-04-25T22:53:27.321 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.321 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.321 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:27.321 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028381+0000", 2024-04-25T22:53:27.321 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00048039399999999998 2024-04-25T22:53:27.321 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:27.321 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:27.321 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:27.322 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033291+0000", 2024-04-25T22:53:27.322 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049105879999999996 2024-04-25T22:53:27.322 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:27.322 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:27.322 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:27.322 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:27.322 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:27.322 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:27.323 INFO:tasks.workunit.client.0.smithi052.stderr:Updating files: 93% (11679/12492) Updating files: 94% (11743/12492) Updating files: 95% (11868/12492) Updating files: 96% (11993/12492) Updating files: 97% (12118/12492) Updating files: 98% (12243/12492) Updating files: 99% (12368/12492) Updating files: 100% (12492/12492) Updating files: 100% (12492/12492), done. 2024-04-25T22:53:27.324 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:27.322+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:27.325 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is set 2024-04-25T22:53:27.325 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:27.425 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:27.424+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:27.433 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:27.434 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:27.434 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-04-25T22:53:27.434 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:27.443 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:27.526 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:27.525+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:27.585 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:27.585 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:27.586 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:53:27.586 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:53:27.586 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:27.594 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:27.626 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:27.625+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:27.664 INFO:tasks.workunit.client.0.smithi052.stderr:Note: switching to 'b22e2ebdeb24376882b7bda2a7329c8cccc2276a'. 2024-04-25T22:53:27.665 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-04-25T22:53:27.665 INFO:tasks.workunit.client.0.smithi052.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-25T22:53:27.665 INFO:tasks.workunit.client.0.smithi052.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-25T22:53:27.665 INFO:tasks.workunit.client.0.smithi052.stderr:state without impacting any branches by switching back to a branch. 2024-04-25T22:53:27.665 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-04-25T22:53:27.665 INFO:tasks.workunit.client.0.smithi052.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-25T22:53:27.665 INFO:tasks.workunit.client.0.smithi052.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-25T22:53:27.665 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-04-25T22:53:27.665 INFO:tasks.workunit.client.0.smithi052.stderr: git switch -c 2024-04-25T22:53:27.665 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-04-25T22:53:27.665 INFO:tasks.workunit.client.0.smithi052.stderr:Or undo this operation with: 2024-04-25T22:53:27.665 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-04-25T22:53:27.665 INFO:tasks.workunit.client.0.smithi052.stderr: git switch - 2024-04-25T22:53:27.666 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-04-25T22:53:27.666 INFO:tasks.workunit.client.0.smithi052.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-25T22:53:27.666 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-04-25T22:53:27.666 INFO:tasks.workunit.client.0.smithi052.stderr:HEAD is now at b22e2ebdeb2 Merge pull request #57078 from adk3798/squid-cephadm-no-downgrade 2024-04-25T22:53:27.669 DEBUG:teuthology.orchestra.run.smithi052:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-25T22:53:27.695 INFO:tasks.workunit.client.0.smithi052.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-25T22:53:27.697 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:27.697 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-04-25T22:53:27.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-04-25T22:53:27.697 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:53:27.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.697 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:27.697 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:27.697 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 99.730356603000004, 2024-04-25T22:53:27.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0103421, 2024-04-25T22:53:27.698 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:27.698 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:27.698 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:27.698 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:27.698 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:27.698 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:27.698 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 115 2024-04-25T22:53:27.698 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.698 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:27.698 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.698 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:27.698 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:27.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:27.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:27.699 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:27.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:27.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:27.699 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:27.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9500000000000002e-07 2024-04-25T22:53:27.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:27.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965108+0000", 2024-04-25T22:53:27.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9177999999999994e-05 2024-04-25T22:53:27.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:27.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965127+0000", 2024-04-25T22:53:27.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8868e-05 2024-04-25T22:53:27.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:27.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965133+0000", 2024-04-25T22:53:27.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8929999999999999e-06 2024-04-25T22:53:27.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:27.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.969991+0000", 2024-04-25T22:53:27.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048573849999999997 2024-04-25T22:53:27.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:27.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970072+0000", 2024-04-25T22:53:27.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0728000000000004e-05 2024-04-25T22:53:27.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:27.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970189+0000", 2024-04-25T22:53:27.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000117778 2024-04-25T22:53:27.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:27.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970946+0000", 2024-04-25T22:53:27.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00075704600000000004 2024-04-25T22:53:27.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:27.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975297+0000", 2024-04-25T22:53:27.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004350217 2024-04-25T22:53:27.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:27.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975343+0000", 2024-04-25T22:53:27.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6687999999999998e-05 2024-04-25T22:53:27.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:27.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975380+0000", 2024-04-25T22:53:27.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6724000000000003e-05 2024-04-25T22:53:27.703 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:27.703 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:27.703 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:27.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.703 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:27.703 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:27.703 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 99.730250572000003, 2024-04-25T22:53:27.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010304384, 2024-04-25T22:53:27.704 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:27.704 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:27.704 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:27.704 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:27.704 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:27.704 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:27.704 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 116 2024-04-25T22:53:27.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.704 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:27.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:27.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:27.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:27.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:27.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:27.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:27.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:27.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:27.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5799999999999999e-07 2024-04-25T22:53:27.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:27.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965154+0000", 2024-04-25T22:53:27.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0009e-05 2024-04-25T22:53:27.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:27.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965164+0000", 2024-04-25T22:53:27.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8490000000000001e-06 2024-04-25T22:53:27.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:27.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965169+0000", 2024-04-25T22:53:27.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0730000000000004e-06 2024-04-25T22:53:27.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:27.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970609+0000", 2024-04-25T22:53:27.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054397689999999997 2024-04-25T22:53:27.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:27.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970651+0000", 2024-04-25T22:53:27.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1873999999999999e-05 2024-04-25T22:53:27.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:27.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970723+0000", 2024-04-25T22:53:27.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2039999999999995e-05 2024-04-25T22:53:27.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:27.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971358+0000", 2024-04-25T22:53:27.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063489500000000001 2024-04-25T22:53:27.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:27.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975409+0000", 2024-04-25T22:53:27.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040506880000000002 2024-04-25T22:53:27.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:27.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975432+0000", 2024-04-25T22:53:27.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3315999999999998e-05 2024-04-25T22:53:27.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:27.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975448+0000", 2024-04-25T22:53:27.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6313000000000001e-05 2024-04-25T22:53:27.709 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:27.709 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:27.709 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:27.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.709 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:27.709 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:27.709 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 99.730215990000005, 2024-04-25T22:53:27.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010384338999999999, 2024-04-25T22:53:27.709 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:27.709 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:27.710 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:27.710 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:27.710 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:27.710 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:27.710 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-04-25T22:53:27.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.710 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:27.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:27.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:27.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:27.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:27.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:27.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:27.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:27.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:27.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3600000000000004e-07 2024-04-25T22:53:27.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:27.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965185+0000", 2024-04-25T22:53:27.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.117e-06 2024-04-25T22:53:27.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:27.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965192+0000", 2024-04-25T22:53:27.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3239999999999997e-06 2024-04-25T22:53:27.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:27.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965198+0000", 2024-04-25T22:53:27.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6370000000000004e-06 2024-04-25T22:53:27.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:27.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970973+0000", 2024-04-25T22:53:27.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057748239999999996 2024-04-25T22:53:27.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:27.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971049+0000", 2024-04-25T22:53:27.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6029e-05 2024-04-25T22:53:27.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:27.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971174+0000", 2024-04-25T22:53:27.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012462399999999999 2024-04-25T22:53:27.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:27.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971553+0000", 2024-04-25T22:53:27.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037896499999999999 2024-04-25T22:53:27.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:27.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975482+0000", 2024-04-25T22:53:27.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039297459999999996 2024-04-25T22:53:27.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:27.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975529+0000", 2024-04-25T22:53:27.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6387000000000002e-05 2024-04-25T22:53:27.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:27.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975563+0000", 2024-04-25T22:53:27.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4150000000000003e-05 2024-04-25T22:53:27.715 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:27.715 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:27.715 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:27.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.715 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:27.715 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:27.715 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 94.683169667000001, 2024-04-25T22:53:27.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012637705000000001, 2024-04-25T22:53:27.715 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:27.715 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:27.715 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:27.715 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:27.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:27.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:27.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:27.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:27.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:27.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:27.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:27.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012227+0000", 2024-04-25T22:53:27.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.863e-06 2024-04-25T22:53:27.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:27.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012236+0000", 2024-04-25T22:53:27.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1109999999999997e-06 2024-04-25T22:53:27.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:27.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012309+0000", 2024-04-25T22:53:27.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3242000000000001e-05 2024-04-25T22:53:27.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:27.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012324+0000", 2024-04-25T22:53:27.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4837e-05 2024-04-25T22:53:27.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:27.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015060+0000", 2024-04-25T22:53:27.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027363349999999999 2024-04-25T22:53:27.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:27.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015169+0000", 2024-04-25T22:53:27.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108372 2024-04-25T22:53:27.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:27.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015498+0000", 2024-04-25T22:53:27.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032949999999999999 2024-04-25T22:53:27.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:27.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021282+0000", 2024-04-25T22:53:27.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057836429999999998 2024-04-25T22:53:27.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:27.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024709+0000", 2024-04-25T22:53:27.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034271979999999998 2024-04-25T22:53:27.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:27.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024802+0000", 2024-04-25T22:53:27.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2960000000000004e-05 2024-04-25T22:53:27.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:27.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024863+0000", 2024-04-25T22:53:27.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0643999999999997e-05 2024-04-25T22:53:27.720 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:27.720 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:27.721 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:27.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.721 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:27.721 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:27.721 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 94.683045895999996, 2024-04-25T22:53:27.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012979447999999999, 2024-04-25T22:53:27.721 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:27.721 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:27.721 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:27.721 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:27.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:27.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:27.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:27.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:27.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:27.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:27.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:27.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:27.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:53:27.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:27.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012354+0000", 2024-04-25T22:53:27.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7740000000000004e-06 2024-04-25T22:53:27.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:27.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012365+0000", 2024-04-25T22:53:27.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.064e-05 2024-04-25T22:53:27.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:27.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012382+0000", 2024-04-25T22:53:27.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6999000000000001e-05 2024-04-25T22:53:27.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:27.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015958+0000", 2024-04-25T22:53:27.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035765699999999998 2024-04-25T22:53:27.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:27.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016037+0000", 2024-04-25T22:53:27.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8242000000000001e-05 2024-04-25T22:53:27.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:27.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016404+0000", 2024-04-25T22:53:27.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036784300000000002 2024-04-25T22:53:27.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:27.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021294+0000", 2024-04-25T22:53:27.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048890629999999999 2024-04-25T22:53:27.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:27.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024959+0000", 2024-04-25T22:53:27.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036651570000000001 2024-04-25T22:53:27.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:27.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025097+0000", 2024-04-25T22:53:27.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013788099999999999 2024-04-25T22:53:27.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:27.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025328+0000", 2024-04-25T22:53:27.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231492 2024-04-25T22:53:27.726 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:27.726 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:27.726 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:27.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.726 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:27.727 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:27.727 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 94.682958127000006, 2024-04-25T22:53:27.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013049827, 2024-04-25T22:53:27.727 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:27.727 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:27.727 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:27.727 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:27.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:27.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:27.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:27.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:27.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:27.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:27.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:27.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012437+0000", 2024-04-25T22:53:27.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-04-25T22:53:27.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:27.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012440+0000", 2024-04-25T22:53:27.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7609999999999999e-06 2024-04-25T22:53:27.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:27.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012449+0000", 2024-04-25T22:53:27.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.285e-06 2024-04-25T22:53:27.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:27.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012457+0000", 2024-04-25T22:53:27.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9510000000000006e-06 2024-04-25T22:53:27.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:27.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017106+0000", 2024-04-25T22:53:27.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046494220000000003 2024-04-25T22:53:27.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:27.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017223+0000", 2024-04-25T22:53:27.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116824 2024-04-25T22:53:27.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:27.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017345+0000", 2024-04-25T22:53:27.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122175 2024-04-25T22:53:27.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:27.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021299+0000", 2024-04-25T22:53:27.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039534879999999998 2024-04-25T22:53:27.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:27.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025398+0000", 2024-04-25T22:53:27.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040988960000000003 2024-04-25T22:53:27.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:27.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025439+0000", 2024-04-25T22:53:27.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0915999999999999e-05 2024-04-25T22:53:27.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:27.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025486+0000", 2024-04-25T22:53:27.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7534999999999998e-05 2024-04-25T22:53:27.732 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:27.732 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:27.732 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:27.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.732 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:27.732 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:27.732 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 94.682927976000002, 2024-04-25T22:53:27.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020988041999999998, 2024-04-25T22:53:27.732 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:27.733 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:27.733 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:27.733 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:27.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:27.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:27.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:27.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:27.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:27.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:27.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:27.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:27.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.99e-07 2024-04-25T22:53:27.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:27.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012470+0000", 2024-04-25T22:53:27.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2789999999999999e-06 2024-04-25T22:53:27.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:27.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012477+0000", 2024-04-25T22:53:27.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:53:27.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:27.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012500+0000", 2024-04-25T22:53:27.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2490999999999999e-05 2024-04-25T22:53:27.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:27.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021911+0000", 2024-04-25T22:53:27.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094114160000000006 2024-04-25T22:53:27.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:27.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022000+0000", 2024-04-25T22:53:27.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8601000000000001e-05 2024-04-25T22:53:27.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:27.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022359+0000", 2024-04-25T22:53:27.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035921999999999999 2024-04-25T22:53:27.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:27.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025541+0000", 2024-04-25T22:53:27.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031820619999999998 2024-04-25T22:53:27.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:27.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033375+0000", 2024-04-25T22:53:27.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078338379999999992 2024-04-25T22:53:27.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:27.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033415+0000", 2024-04-25T22:53:27.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9527000000000003e-05 2024-04-25T22:53:27.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:27.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033455+0000", 2024-04-25T22:53:27.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9932000000000003e-05 2024-04-25T22:53:27.737 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:27.738 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:27.738 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:27.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.738 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:27.738 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:27.738 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 94.682872782999993, 2024-04-25T22:53:27.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021043857999999999, 2024-04-25T22:53:27.738 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:27.738 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:27.738 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:27.738 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:27.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:27.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:27.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:27.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:27.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:27.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:27.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:27.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012523+0000", 2024-04-25T22:53:27.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.361e-06 2024-04-25T22:53:27.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:27.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012530+0000", 2024-04-25T22:53:27.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5440000000000004e-06 2024-04-25T22:53:27.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:27.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012541+0000", 2024-04-25T22:53:27.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1745e-05 2024-04-25T22:53:27.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:27.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012551+0000", 2024-04-25T22:53:27.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5789999999999993e-06 2024-04-25T22:53:27.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:27.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022709+0000", 2024-04-25T22:53:27.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010157685 2024-04-25T22:53:27.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:27.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022957+0000", 2024-04-25T22:53:27.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024824599999999998 2024-04-25T22:53:27.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:27.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023443+0000", 2024-04-25T22:53:27.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048578599999999999 2024-04-25T22:53:27.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:27.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025547+0000", 2024-04-25T22:53:27.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021044789999999998 2024-04-25T22:53:27.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:27.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033509+0000", 2024-04-25T22:53:27.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0079622180000000001 2024-04-25T22:53:27.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:27.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033542+0000", 2024-04-25T22:53:27.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3018000000000001e-05 2024-04-25T22:53:27.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:27.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033566+0000", 2024-04-25T22:53:27.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3197000000000002e-05 2024-04-25T22:53:27.743 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:27.743 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:27.743 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:27.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.743 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:27.744 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:27.744 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 94.682832817999994, 2024-04-25T22:53:27.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021122696, 2024-04-25T22:53:27.744 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:27.744 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:27.744 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:27.744 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:27.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:27.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:27.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:27.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:27.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:27.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:27.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:27.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:27.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:53:27.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:27.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012566+0000", 2024-04-25T22:53:27.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-04-25T22:53:27.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:27.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012619+0000", 2024-04-25T22:53:27.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2607e-05 2024-04-25T22:53:27.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:27.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012628+0000", 2024-04-25T22:53:27.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6500000000000008e-06 2024-04-25T22:53:27.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:27.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024024+0000", 2024-04-25T22:53:27.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011396007999999999 2024-04-25T22:53:27.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:27.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024198+0000", 2024-04-25T22:53:27.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000173215 2024-04-25T22:53:27.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:27.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024447+0000", 2024-04-25T22:53:27.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024898500000000002 2024-04-25T22:53:27.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:27.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026431+0000", 2024-04-25T22:53:27.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001984923 2024-04-25T22:53:27.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:27.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033608+0000", 2024-04-25T22:53:27.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071768459999999997 2024-04-25T22:53:27.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:27.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033646+0000", 2024-04-25T22:53:27.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299000000000003e-05 2024-04-25T22:53:27.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:27.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033684+0000", 2024-04-25T22:53:27.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8773000000000003e-05 2024-04-25T22:53:27.749 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:27.749 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:27.749 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:27.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.749 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:27.749 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:27.749 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 94.682744219, 2024-04-25T22:53:27.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021175381, 2024-04-25T22:53:27.749 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:27.749 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:27.749 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:27.749 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:27.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:27.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:27.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:27.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:27.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:27.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:27.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:27.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012651+0000", 2024-04-25T22:53:27.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:53:27.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:27.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012656+0000", 2024-04-25T22:53:27.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8899999999999998e-06 2024-04-25T22:53:27.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:27.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012666+0000", 2024-04-25T22:53:27.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0346999999999999e-05 2024-04-25T22:53:27.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:27.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012675+0000", 2024-04-25T22:53:27.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9930000000000001e-06 2024-04-25T22:53:27.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:27.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025661+0000", 2024-04-25T22:53:27.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01298531 2024-04-25T22:53:27.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:27.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025757+0000", 2024-04-25T22:53:27.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5822000000000005e-05 2024-04-25T22:53:27.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:27.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025907+0000", 2024-04-25T22:53:27.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015051499999999999 2024-04-25T22:53:27.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:27.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026435+0000", 2024-04-25T22:53:27.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052762200000000005 2024-04-25T22:53:27.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:27.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033732+0000", 2024-04-25T22:53:27.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072978419999999997 2024-04-25T22:53:27.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:27.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033787+0000", 2024-04-25T22:53:27.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4703999999999997e-05 2024-04-25T22:53:27.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:27.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033826+0000", 2024-04-25T22:53:27.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8458999999999999e-05 2024-04-25T22:53:27.754 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:27.754 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:27.754 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:27.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.754 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:27.755 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:27.755 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 94.682688804999998, 2024-04-25T22:53:27.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021244174000000001, 2024-04-25T22:53:27.755 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:27.755 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:27.755 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:27.755 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:27.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:27.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:27.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:27.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:27.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:27.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:27.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:27.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:27.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:27.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:27.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012712+0000", 2024-04-25T22:53:27.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.913e-06 2024-04-25T22:53:27.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:27.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012722+0000", 2024-04-25T22:53:27.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2879999999999998e-06 2024-04-25T22:53:27.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:27.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012727+0000", 2024-04-25T22:53:27.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8429999999999998e-06 2024-04-25T22:53:27.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:27.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026099+0000", 2024-04-25T22:53:27.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013371450999999999 2024-04-25T22:53:27.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:27.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026147+0000", 2024-04-25T22:53:27.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7837999999999998e-05 2024-04-25T22:53:27.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:27.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026254+0000", 2024-04-25T22:53:27.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107314 2024-04-25T22:53:27.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:27.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026686+0000", 2024-04-25T22:53:27.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000432428 2024-04-25T22:53:27.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:27.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033873+0000", 2024-04-25T22:53:27.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071864399999999997 2024-04-25T22:53:27.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:27.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033904+0000", 2024-04-25T22:53:27.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1321e-05 2024-04-25T22:53:27.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:27.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033950+0000", 2024-04-25T22:53:27.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5707999999999997e-05 2024-04-25T22:53:27.760 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:27.760 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:27.760 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:27.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.760 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:27.760 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:27.760 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 94.682658419999996, 2024-04-25T22:53:27.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01096505, 2024-04-25T22:53:27.760 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:27.760 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:27.761 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:27.761 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:27.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:27.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:27.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:27.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:27.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:27.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:27.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:27.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012737+0000", 2024-04-25T22:53:27.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:27.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:27.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012739+0000", 2024-04-25T22:53:27.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-04-25T22:53:27.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:27.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012743+0000", 2024-04-25T22:53:27.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3239999999999996e-06 2024-04-25T22:53:27.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:27.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012746+0000", 2024-04-25T22:53:27.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.129e-06 2024-04-25T22:53:27.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:27.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012796+0000", 2024-04-25T22:53:27.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9231999999999999e-05 2024-04-25T22:53:27.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:27.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012915+0000", 2024-04-25T22:53:27.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119021 2024-04-25T22:53:27.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:27.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013069+0000", 2024-04-25T22:53:27.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015463900000000001 2024-04-25T22:53:27.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:27.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019237+0000", 2024-04-25T22:53:27.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061680329999999998 2024-04-25T22:53:27.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:27.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023603+0000", 2024-04-25T22:53:27.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043655860000000003 2024-04-25T22:53:27.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:27.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023659+0000", 2024-04-25T22:53:27.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6484000000000003e-05 2024-04-25T22:53:27.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:27.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023701+0000", 2024-04-25T22:53:27.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1761999999999998e-05 2024-04-25T22:53:27.765 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:27.765 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:27.766 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:27.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.766 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:27.766 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:27.766 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 94.682633472000006, 2024-04-25T22:53:27.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011234429000000001, 2024-04-25T22:53:27.766 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:27.766 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:27.766 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:27.766 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:27.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:27.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:27.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:27.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:27.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:27.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:27.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:27.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012762+0000", 2024-04-25T22:53:27.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-04-25T22:53:27.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:27.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012765+0000", 2024-04-25T22:53:27.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2569999999999999e-06 2024-04-25T22:53:27.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:27.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012783+0000", 2024-04-25T22:53:27.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8431999999999999e-05 2024-04-25T22:53:27.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:27.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012799+0000", 2024-04-25T22:53:27.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5438999999999999e-05 2024-04-25T22:53:27.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:27.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013826+0000", 2024-04-25T22:53:27.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010275060000000001 2024-04-25T22:53:27.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:27.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013913+0000", 2024-04-25T22:53:27.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.708e-05 2024-04-25T22:53:27.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:27.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014098+0000", 2024-04-25T22:53:27.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018519399999999999 2024-04-25T22:53:27.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:27.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019684+0000", 2024-04-25T22:53:27.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055860079999999999 2024-04-25T22:53:27.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:27.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023876+0000", 2024-04-25T22:53:27.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041918800000000003 2024-04-25T22:53:27.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:27.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023957+0000", 2024-04-25T22:53:27.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1165e-05 2024-04-25T22:53:27.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:27.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023995+0000", 2024-04-25T22:53:27.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:53:27.771 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:27.771 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:27.771 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:27.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.772 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:27.772 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:27.772 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 94.682535693000005, 2024-04-25T22:53:27.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011131200000000001, 2024-04-25T22:53:27.772 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:27.772 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:27.772 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:27.773 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:27.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:27.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:27.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:27.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:27.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:27.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:27.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:27.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012860+0000", 2024-04-25T22:53:27.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3900000000000004e-07 2024-04-25T22:53:27.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:27.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012865+0000", 2024-04-25T22:53:27.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5609999999999998e-06 2024-04-25T22:53:27.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:27.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012895+0000", 2024-04-25T22:53:27.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9847000000000001e-05 2024-04-25T22:53:27.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:27.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012905+0000", 2024-04-25T22:53:27.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.03e-05 2024-04-25T22:53:27.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:27.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015020+0000", 2024-04-25T22:53:27.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021142940000000001 2024-04-25T22:53:27.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:27.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015182+0000", 2024-04-25T22:53:27.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016248099999999999 2024-04-25T22:53:27.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:27.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015357+0000", 2024-04-25T22:53:27.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017471000000000001 2024-04-25T22:53:27.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:27.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021021+0000", 2024-04-25T22:53:27.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056638340000000004 2024-04-25T22:53:27.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:27.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023712+0000", 2024-04-25T22:53:27.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026910380000000002 2024-04-25T22:53:27.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:27.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023763+0000", 2024-04-25T22:53:27.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1477999999999997e-05 2024-04-25T22:53:27.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:27.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023990+0000", 2024-04-25T22:53:27.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000226818 2024-04-25T22:53:27.777 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:27.777 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:27.777 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:27.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.778 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:27.778 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:27.778 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 94.682412596999995, 2024-04-25T22:53:27.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011705299000000001, 2024-04-25T22:53:27.778 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:27.778 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:27.778 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:27.778 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:27.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:27.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:27.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:27.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:27.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:27.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:27.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:27.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012983+0000", 2024-04-25T22:53:27.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:53:27.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:27.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012986+0000", 2024-04-25T22:53:27.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5700000000000001e-06 2024-04-25T22:53:27.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:27.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012993+0000", 2024-04-25T22:53:27.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8730000000000001e-06 2024-04-25T22:53:27.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:27.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013000+0000", 2024-04-25T22:53:27.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1890000000000001e-06 2024-04-25T22:53:27.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:27.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:53:27.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002147866 2024-04-25T22:53:27.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:27.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015351+0000", 2024-04-25T22:53:27.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020300799999999999 2024-04-25T22:53:27.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:27.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016260+0000", 2024-04-25T22:53:27.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00090926799999999997 2024-04-25T22:53:27.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:27.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022669+0000", 2024-04-25T22:53:27.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064082849999999997 2024-04-25T22:53:27.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:27.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024584+0000", 2024-04-25T22:53:27.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019151699999999999 2024-04-25T22:53:27.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:27.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024643+0000", 2024-04-25T22:53:27.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8888999999999998e-05 2024-04-25T22:53:27.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:27.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024687+0000", 2024-04-25T22:53:27.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4444999999999999e-05 2024-04-25T22:53:27.783 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:27.783 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:27.783 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:27.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.783 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:27.783 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:27.783 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 94.682385006000004, 2024-04-25T22:53:27.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011249699, 2024-04-25T22:53:27.783 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:27.784 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:27.784 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:27.784 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:27.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:27.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:27.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:27.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:27.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:27.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:27.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:27.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013010+0000", 2024-04-25T22:53:27.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2099999999999996e-07 2024-04-25T22:53:27.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:27.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013013+0000", 2024-04-25T22:53:27.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1310000000000002e-06 2024-04-25T22:53:27.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:27.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013020+0000", 2024-04-25T22:53:27.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3330000000000002e-06 2024-04-25T22:53:27.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:27.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013025+0000", 2024-04-25T22:53:27.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6760000000000004e-06 2024-04-25T22:53:27.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:27.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013163+0000", 2024-04-25T22:53:27.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013824599999999999 2024-04-25T22:53:27.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:27.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013504+0000", 2024-04-25T22:53:27.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034080299999999998 2024-04-25T22:53:27.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:27.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013613+0000", 2024-04-25T22:53:27.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108705 2024-04-25T22:53:27.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:27.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015831+0000", 2024-04-25T22:53:27.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002217672 2024-04-25T22:53:27.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:27.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024137+0000", 2024-04-25T22:53:27.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0083060489999999994 2024-04-25T22:53:27.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:27.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024218+0000", 2024-04-25T22:53:27.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1351000000000001e-05 2024-04-25T22:53:27.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:27.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024259+0000", 2024-04-25T22:53:27.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1112000000000002e-05 2024-04-25T22:53:27.788 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:27.788 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:27.788 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:27.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.789 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:27.789 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:27.789 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 94.68229728, 2024-04-25T22:53:27.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020379749999999999, 2024-04-25T22:53:27.789 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:27.789 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:27.789 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:27.789 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:27.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:27.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:27.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:27.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:27.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:27.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:27.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:27.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013098+0000", 2024-04-25T22:53:27.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:53:27.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:27.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013105+0000", 2024-04-25T22:53:27.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5969999999999997e-06 2024-04-25T22:53:27.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:27.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013190+0000", 2024-04-25T22:53:27.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5618999999999995e-05 2024-04-25T22:53:27.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:27.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013200+0000", 2024-04-25T22:53:27.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5859999999999994e-06 2024-04-25T22:53:27.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:27.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020265+0000", 2024-04-25T22:53:27.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070653349999999998 2024-04-25T22:53:27.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:27.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020454+0000", 2024-04-25T22:53:27.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189316 2024-04-25T22:53:27.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:27.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020586+0000", 2024-04-25T22:53:27.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013195700000000001 2024-04-25T22:53:27.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:27.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023822+0000", 2024-04-25T22:53:27.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032358529999999999 2024-04-25T22:53:27.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:27.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033409+0000", 2024-04-25T22:53:27.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095870520000000004 2024-04-25T22:53:27.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:27.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033447+0000", 2024-04-25T22:53:27.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7261999999999997e-05 2024-04-25T22:53:27.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:27.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033477+0000", 2024-04-25T22:53:27.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0389e-05 2024-04-25T22:53:27.794 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:27.794 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:27.794 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:27.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.794 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:27.794 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:27.794 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 94.682180774000003, 2024-04-25T22:53:27.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010857383999999999, 2024-04-25T22:53:27.795 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:27.795 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:27.795 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:27.795 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:27.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:27.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:27.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:27.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:27.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:27.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:27.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:27.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:27.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:27.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:27.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013218+0000", 2024-04-25T22:53:27.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8199999999999998e-06 2024-04-25T22:53:27.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:27.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013226+0000", 2024-04-25T22:53:27.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7649999999999993e-06 2024-04-25T22:53:27.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:27.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013259+0000", 2024-04-25T22:53:27.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2727e-05 2024-04-25T22:53:27.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:27.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014809+0000", 2024-04-25T22:53:27.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001550144 2024-04-25T22:53:27.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:27.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014958+0000", 2024-04-25T22:53:27.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014890300000000001 2024-04-25T22:53:27.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:27.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015087+0000", 2024-04-25T22:53:27.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012939200000000001 2024-04-25T22:53:27.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:27.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020212+0000", 2024-04-25T22:53:27.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051248939999999996 2024-04-25T22:53:27.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:27.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023699+0000", 2024-04-25T22:53:27.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034873289999999999 2024-04-25T22:53:27.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:27.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024014+0000", 2024-04-25T22:53:27.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031473999999999999 2024-04-25T22:53:27.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:27.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024071+0000", 2024-04-25T22:53:27.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7040000000000003e-05 2024-04-25T22:53:27.800 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:27.800 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:27.800 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:27.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.800 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:27.800 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:27.800 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 94.682126069000006, 2024-04-25T22:53:27.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012329677000000001, 2024-04-25T22:53:27.800 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:27.800 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:27.800 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:27.800 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:27.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:27.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:27.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:27.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:27.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:27.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:27.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:27.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013269+0000", 2024-04-25T22:53:27.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5000000000000002e-07 2024-04-25T22:53:27.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:27.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:27.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6909999999999999e-06 2024-04-25T22:53:27.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:27.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013284+0000", 2024-04-25T22:53:27.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0963e-05 2024-04-25T22:53:27.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:27.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013361+0000", 2024-04-25T22:53:27.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7379999999999994e-05 2024-04-25T22:53:27.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:27.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013448+0000", 2024-04-25T22:53:27.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6990000000000006e-05 2024-04-25T22:53:27.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:27.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013632+0000", 2024-04-25T22:53:27.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018396800000000001 2024-04-25T22:53:27.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:27.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013800+0000", 2024-04-25T22:53:27.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167467 2024-04-25T22:53:27.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:27.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.018570+0000", 2024-04-25T22:53:27.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047701460000000003 2024-04-25T22:53:27.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:27.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025507+0000", 2024-04-25T22:53:27.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069372039999999998 2024-04-25T22:53:27.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:27.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025562+0000", 2024-04-25T22:53:27.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4858999999999998e-05 2024-04-25T22:53:27.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:27.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025598+0000", 2024-04-25T22:53:27.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6259e-05 2024-04-25T22:53:27.805 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:27.805 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:27.805 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:27.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.805 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:27.806 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:27.806 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 94.681994196000005, 2024-04-25T22:53:27.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020176666999999999, 2024-04-25T22:53:27.806 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:27.806 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:27.806 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:53:27.806 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:27.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:27.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:27.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:27.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:27.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:27.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:27.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:27.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:27.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-04-25T22:53:27.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:27.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013405+0000", 2024-04-25T22:53:27.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0559999999999998e-06 2024-04-25T22:53:27.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:27.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013422+0000", 2024-04-25T22:53:27.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6770999999999999e-05 2024-04-25T22:53:27.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:27.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013431+0000", 2024-04-25T22:53:27.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5019999999999998e-06 2024-04-25T22:53:27.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:27.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021720+0000", 2024-04-25T22:53:27.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082884340000000008 2024-04-25T22:53:27.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:27.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022122+0000", 2024-04-25T22:53:27.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000401634 2024-04-25T22:53:27.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:27.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:27.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:27.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033577+0000", 2024-04-25T22:53:27.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011455435999999999 2024-04-25T22:53:27.809 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:27.809 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:27.809 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:27.809 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:27.810 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:27.810 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:27.811 INFO:tasks.workunit.client.0.smithi052.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-25T22:53:27.811 INFO:tasks.workunit.client.0.smithi052.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-25T22:53:27.812 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:27.812 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:27.811+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:27.911 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:27.911+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:27.917 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:27.917 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:27.917 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-25T22:53:27.917 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:27.927 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:28.012 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:28.012+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:28.029 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:28.029 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:28.029 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-25T22:53:28.029 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-25T22:53:28.029 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:28.038 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:28.113 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:28.112+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:28.142 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:28.142 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:53:28.142 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:53:28.142 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:53:28.143 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.143 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:53:28.143 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:28.143 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 100.173710593, 2024-04-25T22:53:28.143 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:53:28.143 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:28.143 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:28.143 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:28.143 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:28.143 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.143 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:28.143 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:28.143 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:28.144 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.144 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.144 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:28.144 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:28.144 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:28.144 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.144 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.144 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:28.144 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:53:28.144 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:53:28.144 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.144 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.145 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:28.145 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:53:28.145 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:53:28.145 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.145 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.145 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:28.145 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:53:28.145 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:53:28.145 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.145 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.145 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:28.145 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:53:28.145 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:53:28.146 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.146 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.146 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:28.146 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:53:28.146 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:53:28.146 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.146 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.146 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:28.146 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:53:28.146 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:53:28.146 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.146 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.146 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:28.147 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:53:28.147 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:53:28.147 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.147 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.147 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:28.147 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:53:28.147 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:53:28.147 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:28.147 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:28.147 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:28.147 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.147 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.147 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:110 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'72, mlcod=10'68)", 2024-04-25T22:53:28.147 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:28.148 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 100.173076593, 2024-04-25T22:53:28.148 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065316630000000001, 2024-04-25T22:53:28.148 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:28.150 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:28.150 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:28.150 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:28.150 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.150 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:28.150 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:28.151 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:28.151 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.151 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.151 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:28.151 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:28.151 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:28.151 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.151 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.151 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:28.151 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:28.151 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.58e-07 2024-04-25T22:53:28.151 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.151 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.152 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:28.152 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967811+0000", 2024-04-25T22:53:28.152 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.118e-06 2024-04-25T22:53:28.152 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.152 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.152 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:28.152 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967817+0000", 2024-04-25T22:53:28.152 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3709999999999996e-06 2024-04-25T22:53:28.152 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.152 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.152 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:28.152 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967820+0000", 2024-04-25T22:53:28.152 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2210000000000002e-06 2024-04-25T22:53:28.152 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.153 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.153 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:28.153 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967876+0000", 2024-04-25T22:53:28.153 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5507000000000002e-05 2024-04-25T22:53:28.153 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.153 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.153 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:28.153 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967893+0000", 2024-04-25T22:53:28.153 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7812000000000002e-05 2024-04-25T22:53:28.153 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.153 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.153 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:28.153 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974317+0000", 2024-04-25T22:53:28.154 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064237160000000003 2024-04-25T22:53:28.154 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.154 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.154 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:28.154 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:53:28.154 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.156e-05 2024-04-25T22:53:28.154 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:28.154 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:28.154 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:28.154 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.154 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.154 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'68)", 2024-04-25T22:53:28.154 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:28.154 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 100.17265908, 2024-04-25T22:53:28.155 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061292279999999996, 2024-04-25T22:53:28.155 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:28.155 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:28.155 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:28.155 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:28.155 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.155 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:28.155 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:28.155 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:28.155 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.155 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.155 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:28.155 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:28.156 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:28.156 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.156 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.156 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:28.156 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:28.156 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6300000000000001e-07 2024-04-25T22:53:28.156 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.156 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.156 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:28.156 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968228+0000", 2024-04-25T22:53:28.156 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6139999999999999e-06 2024-04-25T22:53:28.156 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.156 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.156 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:28.157 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968235+0000", 2024-04-25T22:53:28.157 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7020000000000001e-06 2024-04-25T22:53:28.157 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.157 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.157 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:28.157 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968238+0000", 2024-04-25T22:53:28.157 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0010000000000002e-06 2024-04-25T22:53:28.157 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.157 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.157 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:28.157 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968297+0000", 2024-04-25T22:53:28.157 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8424999999999997e-05 2024-04-25T22:53:28.157 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.158 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.158 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:28.158 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968316+0000", 2024-04-25T22:53:28.158 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8814999999999999e-05 2024-04-25T22:53:28.158 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.158 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.158 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:28.158 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:53:28.158 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060239439999999998 2024-04-25T22:53:28.158 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.158 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.158 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:28.158 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974354+0000", 2024-04-25T22:53:28.159 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4364e-05 2024-04-25T22:53:28.159 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:28.159 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:28.159 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:28.159 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.159 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.159 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'68)", 2024-04-25T22:53:28.159 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:28.159 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 100.172222078, 2024-04-25T22:53:28.159 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005948414, 2024-04-25T22:53:28.159 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:28.159 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:28.159 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:28.160 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:28.160 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.160 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:28.160 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:28.160 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:28.160 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.160 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.160 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:28.160 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:28.160 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:28.160 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.160 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.160 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:28.161 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968662+0000", 2024-04-25T22:53:28.161 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6199999999999998e-07 2024-04-25T22:53:28.161 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.161 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.161 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:28.161 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968723+0000", 2024-04-25T22:53:28.161 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1148999999999993e-05 2024-04-25T22:53:28.161 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.161 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.161 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:28.161 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968730+0000", 2024-04-25T22:53:28.161 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1749999999999999e-06 2024-04-25T22:53:28.161 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.161 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.162 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:28.162 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968734+0000", 2024-04-25T22:53:28.162 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.5200000000000002e-06 2024-04-25T22:53:28.162 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.162 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.162 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:28.162 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968771+0000", 2024-04-25T22:53:28.162 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6851999999999999e-05 2024-04-25T22:53:28.162 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.162 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.162 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:28.163 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968788+0000", 2024-04-25T22:53:28.163 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7027000000000001e-05 2024-04-25T22:53:28.163 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.163 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.163 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:28.163 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974589+0000", 2024-04-25T22:53:28.163 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058013320000000002 2024-04-25T22:53:28.163 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.163 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.163 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:28.163 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974610+0000", 2024-04-25T22:53:28.163 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0897e-05 2024-04-25T22:53:28.163 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:28.164 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:28.164 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:28.164 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.164 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.164 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'68)", 2024-04-25T22:53:28.164 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:28.164 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 100.171652068, 2024-04-25T22:53:28.164 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053935750000000003, 2024-04-25T22:53:28.164 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:28.164 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:28.164 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:28.164 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:28.164 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.165 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:28.165 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:28.165 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:28.165 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.165 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.165 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:28.165 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:28.165 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:28.165 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.165 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.165 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:28.165 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969232+0000", 2024-04-25T22:53:28.165 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.03e-07 2024-04-25T22:53:28.166 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.166 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.166 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:28.166 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969235+0000", 2024-04-25T22:53:28.166 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2399999999999999e-06 2024-04-25T22:53:28.166 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.166 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.166 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:28.166 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969242+0000", 2024-04-25T22:53:28.166 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1269999999999997e-06 2024-04-25T22:53:28.166 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.166 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.166 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:28.167 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969246+0000", 2024-04-25T22:53:28.167 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3840000000000001e-06 2024-04-25T22:53:28.167 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.167 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.167 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:28.167 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969278+0000", 2024-04-25T22:53:28.167 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1868e-05 2024-04-25T22:53:28.167 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.167 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.167 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:28.167 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.969295+0000", 2024-04-25T22:53:28.167 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7530999999999999e-05 2024-04-25T22:53:28.167 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.168 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.168 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:28.168 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974611+0000", 2024-04-25T22:53:28.168 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053160789999999996 2024-04-25T22:53:28.168 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.168 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.168 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:28.168 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974625+0000", 2024-04-25T22:53:28.168 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3943e-05 2024-04-25T22:53:28.168 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:28.168 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:28.168 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:28.168 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.169 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.169 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-25T22:53:28.169 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:28.169 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 99.978056159999994, 2024-04-25T22:53:28.169 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054952610000000004, 2024-04-25T22:53:28.169 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:28.169 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:28.169 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:28.169 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:28.169 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.169 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:28.169 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:28.169 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:28.169 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.170 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.170 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:28.170 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:28.170 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:28.170 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.170 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.170 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:28.170 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162828+0000", 2024-04-25T22:53:28.170 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.68e-07 2024-04-25T22:53:28.170 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.170 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.170 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:28.170 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162898+0000", 2024-04-25T22:53:28.171 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9470999999999999e-05 2024-04-25T22:53:28.171 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.171 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.171 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:28.171 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162906+0000", 2024-04-25T22:53:28.171 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1580000000000005e-06 2024-04-25T22:53:28.171 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.171 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.171 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:28.171 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162911+0000", 2024-04-25T22:53:28.171 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4779999999999999e-06 2024-04-25T22:53:28.171 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.171 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.171 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:28.172 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162952+0000", 2024-04-25T22:53:28.172 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0629e-05 2024-04-25T22:53:28.172 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.172 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.172 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:28.172 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.162968+0000", 2024-04-25T22:53:28.172 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6239000000000002e-05 2024-04-25T22:53:28.172 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.172 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.172 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:28.172 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168281+0000", 2024-04-25T22:53:28.172 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053132869999999999 2024-04-25T22:53:28.172 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.173 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.173 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:28.173 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.168323+0000", 2024-04-25T22:53:28.173 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1430999999999997e-05 2024-04-25T22:53:28.173 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:28.173 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:28.173 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:28.173 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.173 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.173 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:155 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'109, mlcod=10'105)", 2024-04-25T22:53:28.173 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:28.173 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 99.547578798000004, 2024-04-25T22:53:28.174 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050872510000000001, 2024-04-25T22:53:28.174 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:28.174 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:28.174 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:28.174 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:28.174 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.174 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:28.174 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:28.174 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:28.174 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.174 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.174 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:28.174 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:28.175 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:28.175 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.175 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.175 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:28.175 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593305+0000", 2024-04-25T22:53:28.175 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.72e-07 2024-04-25T22:53:28.175 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.175 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.175 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:28.175 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593381+0000", 2024-04-25T22:53:28.175 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5797000000000006e-05 2024-04-25T22:53:28.175 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.175 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.176 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:28.176 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593389+0000", 2024-04-25T22:53:28.176 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8480000000000001e-06 2024-04-25T22:53:28.176 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.176 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.176 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:28.176 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593393+0000", 2024-04-25T22:53:28.176 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4819999999999996e-06 2024-04-25T22:53:28.176 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.176 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.176 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:28.176 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593435+0000", 2024-04-25T22:53:28.176 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1600000000000002e-05 2024-04-25T22:53:28.177 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.177 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.177 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:28.177 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.593454+0000", 2024-04-25T22:53:28.177 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8868e-05 2024-04-25T22:53:28.177 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.177 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.177 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:28.177 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598350+0000", 2024-04-25T22:53:28.177 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.004895763 2024-04-25T22:53:28.177 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.177 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.177 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:28.178 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:48.598392+0000", 2024-04-25T22:53:28.178 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2521000000000002e-05 2024-04-25T22:53:28.178 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:28.178 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:28.178 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:28.178 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.178 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.178 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:28.178 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:28.178 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 95.129214894, 2024-04-25T22:53:28.178 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:53:28.178 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:28.178 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:28.179 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:28.179 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:28.179 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.179 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:28.179 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:28.179 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:28.179 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.179 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.179 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:28.179 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:28.179 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:28.179 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.179 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.180 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:28.180 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:53:28.180 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:53:28.180 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.180 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.180 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:28.180 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:53:28.180 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:53:28.180 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.180 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.180 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:28.180 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:53:28.180 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:53:28.180 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.181 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.181 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:28.181 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:53:28.181 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:53:28.181 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.181 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.181 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:28.181 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:53:28.181 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:53:28.181 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.181 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.181 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:28.181 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:53:28.182 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:53:28.182 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.182 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.182 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:28.182 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:53:28.182 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:53:28.182 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.182 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.182 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:28.182 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:53:28.182 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:53:28.182 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.182 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.183 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:28.183 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:53:28.183 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:53:28.183 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.183 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.183 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:28.183 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:53:28.183 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:53:28.183 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.183 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.183 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:28.183 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:53:28.183 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:53:28.183 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:28.184 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:28.184 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:28.184 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.184 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.184 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:28.184 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:28.184 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 95.128540517999994, 2024-04-25T22:53:28.184 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:53:28.184 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:28.184 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:28.184 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:28.184 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:28.184 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.184 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:28.185 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:28.185 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:28.185 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.185 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.185 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:28.185 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:28.185 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:28.185 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.185 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.185 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:28.185 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:53:28.185 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:53:28.185 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.185 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.186 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:28.186 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:53:28.186 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:53:28.186 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.186 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.186 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:28.186 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:53:28.186 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:53:28.186 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.186 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.186 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:28.186 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:53:28.186 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:53:28.187 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.187 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.187 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:28.187 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:53:28.187 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:53:28.187 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.187 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.187 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:28.187 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:53:28.187 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:53:28.187 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.187 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.187 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:28.187 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:53:28.188 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:53:28.188 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.188 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.188 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:28.188 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:53:28.188 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:53:28.188 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.188 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.188 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:28.188 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:53:28.188 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:53:28.188 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.188 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.188 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:28.189 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:53:28.189 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:53:28.189 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.189 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.189 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:28.189 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:53:28.189 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:53:28.189 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:28.189 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:28.189 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:28.189 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.189 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.189 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:28.190 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:28.190 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 95.128031305999997, 2024-04-25T22:53:28.190 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:53:28.190 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:28.190 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:28.190 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:28.190 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:28.190 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.190 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:28.190 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:28.190 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:28.190 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.190 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.191 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:28.191 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:28.191 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:28.191 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.191 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.191 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:28.191 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:53:28.191 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:53:28.191 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.191 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.191 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:28.191 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:53:28.191 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:53:28.191 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.192 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.192 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:28.192 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:53:28.192 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:53:28.192 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.192 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.192 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:28.192 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:53:28.192 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:53:28.192 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.192 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.192 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:28.192 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:53:28.193 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:53:28.193 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.193 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.193 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:28.193 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:53:28.193 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:53:28.193 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.193 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.193 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:28.193 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:53:28.193 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:53:28.193 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.193 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.193 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:28.194 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:53:28.194 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:53:28.194 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.194 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.194 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:28.194 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:53:28.194 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:53:28.194 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.194 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.194 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:28.194 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:53:28.194 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:53:28.194 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.195 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.195 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:28.195 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:53:28.195 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:53:28.195 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:28.195 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:28.195 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:28.195 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.195 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.195 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:28.195 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:28.195 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 95.127618107999993, 2024-04-25T22:53:28.195 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:53:28.196 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:28.196 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:28.196 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:28.196 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:28.196 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.196 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:28.196 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:28.196 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:28.196 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.196 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.196 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:28.196 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:28.196 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:28.196 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.197 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.197 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:28.197 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:28.197 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:53:28.197 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.197 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.197 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:28.197 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:28.197 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:53:28.197 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.197 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.197 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:28.197 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:53:28.197 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:53:28.198 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.198 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.198 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:28.198 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:53:28.198 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:53:28.198 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.198 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.198 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:28.198 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:53:28.198 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:53:28.198 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.198 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.198 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:28.199 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:53:28.199 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:53:28.199 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.199 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.199 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:28.199 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:53:28.199 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:53:28.199 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.199 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.199 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:28.199 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:53:28.199 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:53:28.199 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.200 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.200 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:28.200 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:53:28.200 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:53:28.200 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.200 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.200 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:28.200 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:53:28.200 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:53:28.200 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.200 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.200 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:28.200 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:53:28.201 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:53:28.201 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:28.201 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:28.201 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:28.201 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.201 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.201 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:28.201 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:28.201 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 95.127567438, 2024-04-25T22:53:28.201 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:53:28.201 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:28.201 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:28.201 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:28.201 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:28.202 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.202 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:28.202 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:28.202 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:28.202 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.202 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.202 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:28.202 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:28.202 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:28.202 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.202 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.202 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:28.202 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:53:28.203 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:53:28.203 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.203 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.203 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:28.203 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:53:28.203 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:53:28.203 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.203 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.203 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:28.203 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:53:28.203 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:53:28.203 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.203 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.204 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:28.204 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:53:28.204 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:53:28.204 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.204 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.204 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:28.204 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:53:28.204 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:53:28.204 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.204 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.204 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:28.204 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:53:28.204 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:53:28.205 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.205 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.205 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:28.205 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:53:28.205 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:53:28.205 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.205 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.205 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:28.205 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:53:28.205 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:53:28.205 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.205 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.205 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:28.206 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:53:28.206 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:53:28.206 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.206 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.206 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:28.206 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:53:28.206 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:53:28.206 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.206 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.206 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:28.206 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:53:28.206 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:53:28.206 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.207 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.207 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:28.207 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:53:28.207 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:53:28.207 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.207 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.207 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:28.207 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:53:28.207 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:53:28.207 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:28.207 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:28.207 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:28.207 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.207 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.208 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:28.208 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:28.208 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 95.127530569000001, 2024-04-25T22:53:28.208 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:53:28.208 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:28.208 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:28.208 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:28.208 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:28.208 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.208 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:28.208 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:28.208 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:28.208 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.209 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.209 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:28.209 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:28.209 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:28.209 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.209 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.209 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:28.209 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:53:28.209 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:53:28.209 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.209 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.209 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:28.209 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:53:28.210 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:53:28.210 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.210 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.210 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:28.210 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:53:28.210 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:53:28.210 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.210 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.210 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:28.210 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:53:28.210 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:53:28.210 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.210 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.211 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:28.211 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:53:28.211 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:53:28.211 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.211 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.211 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:53:28.211 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:53:28.211 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:53:28.211 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.211 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.211 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:28.211 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:53:28.211 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:53:28.212 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.212 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.212 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:28.212 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:53:28.212 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:53:28.212 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.212 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.212 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:28.212 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:53:28.212 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:53:28.212 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.212 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.212 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:28.213 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:53:28.213 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:53:28.213 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.213 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.213 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:28.213 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:53:28.213 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:53:28.213 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.213 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.213 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:28.213 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:53:28.213 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:53:28.213 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.213 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.214 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:28.214 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:53:28.214 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:53:28.214 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:28.214 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:28.214 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:28.214 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.214 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.214 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:28.214 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:28.214 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 95.127505603000003, 2024-04-25T22:53:28.214 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:53:28.214 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:28.214 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:28.215 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:28.215 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:28.215 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.215 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:28.215 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:28.215 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:28.215 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.215 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.215 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:28.215 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:28.215 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:28.215 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.215 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.216 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:28.216 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:53:28.216 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:53:28.216 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.216 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.216 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:28.216 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:53:28.216 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:53:28.216 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.216 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.216 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:28.216 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:28.216 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:53:28.216 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.217 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.217 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:28.217 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:53:28.217 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:53:28.217 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.217 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.217 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:28.217 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:53:28.217 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:53:28.217 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.217 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.217 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:28.217 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:53:28.218 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:53:28.218 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.218 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.218 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:28.218 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:53:28.218 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:53:28.218 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.218 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.218 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:28.218 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:53:28.218 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:53:28.218 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.218 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.218 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:28.219 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:53:28.219 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:53:28.219 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.219 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.219 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:28.219 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:53:28.219 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:53:28.219 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.219 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.219 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:28.219 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:53:28.219 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:53:28.219 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:28.220 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:28.220 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:28.220 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.220 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.220 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:28.220 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:28.220 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 95.127469239000007, 2024-04-25T22:53:28.220 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:53:28.220 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:28.220 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:28.220 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:28.220 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:28.220 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.221 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:28.221 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:28.221 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:28.221 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.221 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.221 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:28.221 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:28.221 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:28.221 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.221 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.221 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:28.221 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:53:28.221 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:53:28.221 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.222 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.222 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:28.222 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:53:28.222 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:53:28.222 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.222 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.222 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:28.222 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:53:28.222 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:53:28.222 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.222 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.222 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:28.223 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:53:28.223 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:53:28.223 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.223 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.223 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:28.223 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:53:28.223 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:53:28.223 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.223 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.223 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:28.223 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:53:28.223 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:53:28.223 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.223 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.224 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:28.224 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:53:28.224 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:53:28.224 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.224 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.224 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:28.224 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:53:28.224 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:53:28.224 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.224 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.224 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:28.224 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:53:28.224 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:53:28.224 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:28.225 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:28.225 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:28.225 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.225 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.225 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:28.225 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:28.225 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 95.127438158000004, 2024-04-25T22:53:28.225 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:53:28.225 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:28.225 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:28.225 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:28.225 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:28.225 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.225 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:28.226 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:28.226 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:28.226 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.226 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.226 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:28.226 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:28.226 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:28.226 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.226 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.226 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:28.226 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:28.226 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:28.226 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.226 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.227 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:28.227 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:53:28.227 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:53:28.227 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.227 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.227 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:28.227 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:53:28.227 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:53:28.227 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.227 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.227 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:28.227 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:53:28.227 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:53:28.227 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.228 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.228 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:28.228 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:53:28.228 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:53:28.228 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.228 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.228 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:28.228 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:53:28.228 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:53:28.228 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.228 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.228 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:28.228 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:53:28.228 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:53:28.229 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:28.229 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:28.229 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:28.229 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.229 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.229 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:53:28.229 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:28.229 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 95.126997188999994, 2024-04-25T22:53:28.229 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064881979999999997, 2024-04-25T22:53:28.229 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:28.229 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:28.229 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:28.229 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:28.229 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.230 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:28.230 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:28.230 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:28.230 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.230 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.230 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:28.230 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:28.230 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:28.230 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.230 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.230 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:28.230 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:28.230 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2699999999999999e-07 2024-04-25T22:53:28.231 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.231 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.231 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:28.231 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013898+0000", 2024-04-25T22:53:28.231 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0796e-05 2024-04-25T22:53:28.231 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.231 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.231 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:28.231 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013907+0000", 2024-04-25T22:53:28.231 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5140000000000007e-06 2024-04-25T22:53:28.231 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.231 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.231 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:28.231 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013952+0000", 2024-04-25T22:53:28.232 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4134000000000001e-05 2024-04-25T22:53:28.232 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.232 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.232 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:28.232 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016812+0000", 2024-04-25T22:53:28.232 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028601059999999998 2024-04-25T22:53:28.232 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.232 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.232 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:28.232 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.017052+0000", 2024-04-25T22:53:28.232 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024056500000000001 2024-04-25T22:53:28.232 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.232 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.233 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:28.233 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020350+0000", 2024-04-25T22:53:28.233 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032978320000000001 2024-04-25T22:53:28.233 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.233 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.233 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:28.233 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020375+0000", 2024-04-25T22:53:28.233 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4624e-05 2024-04-25T22:53:28.233 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:28.233 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:28.233 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:28.233 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.234 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.234 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-25T22:53:28.234 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:28.234 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 95.113466743000004, 2024-04-25T22:53:28.234 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0058583000000000003, 2024-04-25T22:53:28.234 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:28.234 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:28.234 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:28.234 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:28.234 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.235 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:28.235 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:28.235 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:28.235 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.235 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.235 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:28.235 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:28.235 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:28.235 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.235 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.235 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:28.235 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027417+0000", 2024-04-25T22:53:28.235 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.41e-07 2024-04-25T22:53:28.235 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.236 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.236 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:28.236 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027428+0000", 2024-04-25T22:53:28.236 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.075e-05 2024-04-25T22:53:28.236 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.236 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.236 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:28.236 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027435+0000", 2024-04-25T22:53:28.236 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.3610000000000003e-06 2024-04-25T22:53:28.236 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.236 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.236 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:28.237 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027442+0000", 2024-04-25T22:53:28.237 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0400000000000004e-06 2024-04-25T22:53:28.237 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.237 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.237 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:28.237 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028094+0000", 2024-04-25T22:53:28.237 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00065134800000000005 2024-04-25T22:53:28.237 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.237 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.237 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:28.237 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028107+0000", 2024-04-25T22:53:28.237 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3087e-05 2024-04-25T22:53:28.237 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.237 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.238 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:28.238 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033239+0000", 2024-04-25T22:53:28.238 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0051319429999999999 2024-04-25T22:53:28.238 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.238 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.238 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:28.238 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033275+0000", 2024-04-25T22:53:28.238 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6430000000000002e-05 2024-04-25T22:53:28.238 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:28.238 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:28.238 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:28.238 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.238 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.238 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-25T22:53:28.239 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:28.239 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 95.113081906000005, 2024-04-25T22:53:28.239 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.005413597, 2024-04-25T22:53:28.239 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:28.239 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:28.239 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:28.239 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:28.239 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.239 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:28.239 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:28.239 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:28.239 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.239 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.240 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:28.240 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:28.240 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:28.240 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.240 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.240 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:28.240 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027802+0000", 2024-04-25T22:53:28.240 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3799999999999997e-07 2024-04-25T22:53:28.240 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.240 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.240 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:28.240 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027816+0000", 2024-04-25T22:53:28.240 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3230999999999999e-05 2024-04-25T22:53:28.240 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.241 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.241 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:28.241 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027823+0000", 2024-04-25T22:53:28.241 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9039999999999992e-06 2024-04-25T22:53:28.241 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.241 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.241 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:28.241 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027841+0000", 2024-04-25T22:53:28.241 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7651000000000001e-05 2024-04-25T22:53:28.241 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.241 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.241 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:28.241 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027904+0000", 2024-04-25T22:53:28.242 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3058000000000005e-05 2024-04-25T22:53:28.242 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.242 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.242 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:28.242 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027926+0000", 2024-04-25T22:53:28.242 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1450999999999998e-05 2024-04-25T22:53:28.242 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.242 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.242 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:28.242 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033177+0000", 2024-04-25T22:53:28.242 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0052508909999999997 2024-04-25T22:53:28.242 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.242 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.243 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:28.243 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033215+0000", 2024-04-25T22:53:28.243 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8872999999999999e-05 2024-04-25T22:53:28.243 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:28.243 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:28.243 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:28.243 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.243 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.243 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 171 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-25T22:53:28.243 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:28.243 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 95.113024804000005, 2024-04-25T22:53:28.243 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0054322240000000003, 2024-04-25T22:53:28.243 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:28.243 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:28.244 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "reached pg", 2024-04-25T22:53:28.244 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:28.244 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.244 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:28.244 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:28.244 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:28.244 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.244 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.244 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:28.244 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:28.244 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:28.244 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.244 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.244 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:28.245 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027859+0000", 2024-04-25T22:53:28.245 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.7500000000000001e-07 2024-04-25T22:53:28.245 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.245 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.245 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:28.245 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027868+0000", 2024-04-25T22:53:28.245 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5750000000000001e-06 2024-04-25T22:53:28.245 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.245 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.245 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:28.245 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027885+0000", 2024-04-25T22:53:28.245 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7272e-05 2024-04-25T22:53:28.245 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.245 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.246 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:28.246 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.027900+0000", 2024-04-25T22:53:28.246 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.502e-05 2024-04-25T22:53:28.246 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.246 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.246 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:28.246 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028381+0000", 2024-04-25T22:53:28.246 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00048039399999999998 2024-04-25T22:53:28.246 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:28.246 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:28.246 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:28.246 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.033291+0000", 2024-04-25T22:53:28.246 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0049105879999999996 2024-04-25T22:53:28.247 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:28.247 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:28.247 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:28.247 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:28.247 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:28.247 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:28.248 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:28.247+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:28.249 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:28.295 INFO:tasks.workunit.client.0.smithi052.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-25T22:53:28.348 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:28.348+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:28.353 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:28.354 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:28.354 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-04-25T22:53:28.354 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:28.361 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:28.395 INFO:tasks.workunit.client.0.smithi052.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-25T22:53:28.436 INFO:tasks.workunit.client.0.smithi052.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-25T22:53:28.438 INFO:tasks.workunit.client.0.smithi052.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-25T22:53:28.438 INFO:tasks.workunit.client.0.smithi052.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-25T22:53:28.449 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:28.448+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:28.478 INFO:tasks.workunit.client.0.smithi052.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-25T22:53:28.481 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-25T22:53:28.481 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-25T22:53:28.504 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:28.504 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:28.504 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:53:28.504 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:53:28.504 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:28.514 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:28.537 INFO:tasks.workunit:Running workunits matching suites/fsx.sh on client.0... 2024-04-25T22:53:28.538 INFO:tasks.workunit:Running workunit suites/fsx.sh... 2024-04-25T22:53:28.539 DEBUG:teuthology.orchestra.run.smithi052:workunit test suites/fsx.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b22e2ebdeb24376882b7bda2a7329c8cccc2276a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh 2024-04-25T22:53:28.555 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:28.554+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:28.600 INFO:tasks.workunit.client.0.smithi052.stderr:+ set -e 2024-04-25T22:53:28.600 INFO:tasks.workunit.client.0.smithi052.stderr:+ git clone https://git.ceph.com/xfstests-dev.git 2024-04-25T22:53:28.602 INFO:tasks.workunit.client.0.smithi052.stderr:Cloning into 'xfstests-dev'... 2024-04-25T22:53:28.619 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:53:28.650 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:28.650+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:28.662 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:28.662 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-04-25T22:53:28.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-04-25T22:53:28.662 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:53:28.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.663 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:28.663 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:28.663 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 100.695038227, 2024-04-25T22:53:28.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0103421, 2024-04-25T22:53:28.663 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:28.663 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:28.663 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:28.663 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:28.663 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:28.663 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:28.663 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 115 2024-04-25T22:53:28.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.664 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:28.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:28.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:28.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:28.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:28.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:28.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:28.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:28.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:28.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9500000000000002e-07 2024-04-25T22:53:28.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.665 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:28.665 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965108+0000", 2024-04-25T22:53:28.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9177999999999994e-05 2024-04-25T22:53:28.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.665 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:28.665 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965127+0000", 2024-04-25T22:53:28.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8868e-05 2024-04-25T22:53:28.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.665 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:28.666 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965133+0000", 2024-04-25T22:53:28.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8929999999999999e-06 2024-04-25T22:53:28.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.666 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:28.666 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.969991+0000", 2024-04-25T22:53:28.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048573849999999997 2024-04-25T22:53:28.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.666 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:28.666 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970072+0000", 2024-04-25T22:53:28.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0728000000000004e-05 2024-04-25T22:53:28.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:28.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970189+0000", 2024-04-25T22:53:28.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000117778 2024-04-25T22:53:28.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:28.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970946+0000", 2024-04-25T22:53:28.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00075704600000000004 2024-04-25T22:53:28.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:28.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975297+0000", 2024-04-25T22:53:28.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004350217 2024-04-25T22:53:28.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:28.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975343+0000", 2024-04-25T22:53:28.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6687999999999998e-05 2024-04-25T22:53:28.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:28.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975380+0000", 2024-04-25T22:53:28.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6724000000000003e-05 2024-04-25T22:53:28.668 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:28.668 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:28.668 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:28.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.669 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:28.669 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:28.669 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 100.694932196, 2024-04-25T22:53:28.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010304384, 2024-04-25T22:53:28.670 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:28.670 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:28.670 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:28.671 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:28.671 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:28.671 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:28.671 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 116 2024-04-25T22:53:28.671 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.671 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:28.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.671 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:28.671 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:28.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:28.671 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.671 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:28.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:28.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:28.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:28.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:28.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5799999999999999e-07 2024-04-25T22:53:28.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:28.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965154+0000", 2024-04-25T22:53:28.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0009e-05 2024-04-25T22:53:28.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:28.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965164+0000", 2024-04-25T22:53:28.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8490000000000001e-06 2024-04-25T22:53:28.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:28.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965169+0000", 2024-04-25T22:53:28.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0730000000000004e-06 2024-04-25T22:53:28.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:28.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970609+0000", 2024-04-25T22:53:28.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054397689999999997 2024-04-25T22:53:28.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:28.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970651+0000", 2024-04-25T22:53:28.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1873999999999999e-05 2024-04-25T22:53:28.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:28.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970723+0000", 2024-04-25T22:53:28.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2039999999999995e-05 2024-04-25T22:53:28.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:28.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971358+0000", 2024-04-25T22:53:28.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063489500000000001 2024-04-25T22:53:28.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:28.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975409+0000", 2024-04-25T22:53:28.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040506880000000002 2024-04-25T22:53:28.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:28.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975432+0000", 2024-04-25T22:53:28.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3315999999999998e-05 2024-04-25T22:53:28.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:28.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975448+0000", 2024-04-25T22:53:28.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6313000000000001e-05 2024-04-25T22:53:28.676 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:28.676 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:28.676 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:28.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.676 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:28.676 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:28.676 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 100.694897614, 2024-04-25T22:53:28.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010384338999999999, 2024-04-25T22:53:28.676 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:28.676 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:28.676 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:28.676 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:28.677 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:28.677 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:28.677 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-04-25T22:53:28.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.677 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:28.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:28.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:28.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:28.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:28.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:28.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:28.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:28.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:28.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3600000000000004e-07 2024-04-25T22:53:28.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:28.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965185+0000", 2024-04-25T22:53:28.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.117e-06 2024-04-25T22:53:28.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:28.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965192+0000", 2024-04-25T22:53:28.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3239999999999997e-06 2024-04-25T22:53:28.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:28.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965198+0000", 2024-04-25T22:53:28.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6370000000000004e-06 2024-04-25T22:53:28.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:28.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970973+0000", 2024-04-25T22:53:28.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057748239999999996 2024-04-25T22:53:28.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.680 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:28.680 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971049+0000", 2024-04-25T22:53:28.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6029e-05 2024-04-25T22:53:28.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.680 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:28.680 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971174+0000", 2024-04-25T22:53:28.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012462399999999999 2024-04-25T22:53:28.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:28.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971553+0000", 2024-04-25T22:53:28.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037896499999999999 2024-04-25T22:53:28.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:28.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975482+0000", 2024-04-25T22:53:28.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039297459999999996 2024-04-25T22:53:28.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:28.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975529+0000", 2024-04-25T22:53:28.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6387000000000002e-05 2024-04-25T22:53:28.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:28.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975563+0000", 2024-04-25T22:53:28.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4150000000000003e-05 2024-04-25T22:53:28.682 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:28.682 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:28.682 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:28.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.682 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:28.682 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:28.682 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 95.647851290999995, 2024-04-25T22:53:28.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012637705000000001, 2024-04-25T22:53:28.683 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:28.683 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:28.683 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:28.683 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:28.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:28.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:28.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:28.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:28.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:28.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:28.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:28.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012227+0000", 2024-04-25T22:53:28.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.863e-06 2024-04-25T22:53:28.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:28.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012236+0000", 2024-04-25T22:53:28.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1109999999999997e-06 2024-04-25T22:53:28.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:28.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012309+0000", 2024-04-25T22:53:28.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3242000000000001e-05 2024-04-25T22:53:28.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:28.685 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012324+0000", 2024-04-25T22:53:28.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4837e-05 2024-04-25T22:53:28.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:28.685 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015060+0000", 2024-04-25T22:53:28.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027363349999999999 2024-04-25T22:53:28.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:28.685 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015169+0000", 2024-04-25T22:53:28.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108372 2024-04-25T22:53:28.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.686 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:28.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015498+0000", 2024-04-25T22:53:28.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032949999999999999 2024-04-25T22:53:28.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.686 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:28.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021282+0000", 2024-04-25T22:53:28.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057836429999999998 2024-04-25T22:53:28.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:28.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024709+0000", 2024-04-25T22:53:28.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034271979999999998 2024-04-25T22:53:28.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:28.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024802+0000", 2024-04-25T22:53:28.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2960000000000004e-05 2024-04-25T22:53:28.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:28.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024863+0000", 2024-04-25T22:53:28.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0643999999999997e-05 2024-04-25T22:53:28.687 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:28.688 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:28.688 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:28.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.688 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:28.688 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:28.688 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 95.647727520000004, 2024-04-25T22:53:28.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012979447999999999, 2024-04-25T22:53:28.688 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:28.688 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:28.688 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:28.688 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:28.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:28.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:28.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:28.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:28.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:28.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:28.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:28.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:28.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:53:28.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:28.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012354+0000", 2024-04-25T22:53:28.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7740000000000004e-06 2024-04-25T22:53:28.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:28.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012365+0000", 2024-04-25T22:53:28.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.064e-05 2024-04-25T22:53:28.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:28.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012382+0000", 2024-04-25T22:53:28.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6999000000000001e-05 2024-04-25T22:53:28.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.691 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:28.691 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015958+0000", 2024-04-25T22:53:28.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035765699999999998 2024-04-25T22:53:28.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.691 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:28.691 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016037+0000", 2024-04-25T22:53:28.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8242000000000001e-05 2024-04-25T22:53:28.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.691 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:28.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016404+0000", 2024-04-25T22:53:28.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036784300000000002 2024-04-25T22:53:28.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:28.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021294+0000", 2024-04-25T22:53:28.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048890629999999999 2024-04-25T22:53:28.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:28.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024959+0000", 2024-04-25T22:53:28.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036651570000000001 2024-04-25T22:53:28.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.693 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:28.693 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025097+0000", 2024-04-25T22:53:28.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013788099999999999 2024-04-25T22:53:28.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.693 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:28.693 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025328+0000", 2024-04-25T22:53:28.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231492 2024-04-25T22:53:28.693 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:28.693 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:28.693 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:28.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.694 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:28.694 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:28.694 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 95.647639751, 2024-04-25T22:53:28.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013049827, 2024-04-25T22:53:28.694 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:28.694 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:28.694 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:28.694 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:28.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:28.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:28.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:28.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:28.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:28.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:28.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:28.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012437+0000", 2024-04-25T22:53:28.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-04-25T22:53:28.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:28.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012440+0000", 2024-04-25T22:53:28.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7609999999999999e-06 2024-04-25T22:53:28.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.696 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:28.696 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012449+0000", 2024-04-25T22:53:28.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.285e-06 2024-04-25T22:53:28.696 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.696 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:28.696 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012457+0000", 2024-04-25T22:53:28.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9510000000000006e-06 2024-04-25T22:53:28.696 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.696 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:28.696 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017106+0000", 2024-04-25T22:53:28.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046494220000000003 2024-04-25T22:53:28.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:28.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017223+0000", 2024-04-25T22:53:28.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116824 2024-04-25T22:53:28.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:28.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017345+0000", 2024-04-25T22:53:28.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122175 2024-04-25T22:53:28.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:28.698 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021299+0000", 2024-04-25T22:53:28.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039534879999999998 2024-04-25T22:53:28.698 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.698 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.698 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:28.698 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025398+0000", 2024-04-25T22:53:28.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040988960000000003 2024-04-25T22:53:28.698 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.698 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.698 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:28.698 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025439+0000", 2024-04-25T22:53:28.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0915999999999999e-05 2024-04-25T22:53:28.698 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.698 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:28.699 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025486+0000", 2024-04-25T22:53:28.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7534999999999998e-05 2024-04-25T22:53:28.699 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:28.699 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:28.699 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:28.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.699 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:28.699 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:28.699 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 95.647609599999996, 2024-04-25T22:53:28.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020988041999999998, 2024-04-25T22:53:28.699 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:28.699 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:28.700 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:28.700 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:28.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:28.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:28.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:28.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:28.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:28.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:28.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:28.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:28.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.99e-07 2024-04-25T22:53:28.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:28.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012470+0000", 2024-04-25T22:53:28.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2789999999999999e-06 2024-04-25T22:53:28.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:28.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012477+0000", 2024-04-25T22:53:28.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:53:28.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:28.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012500+0000", 2024-04-25T22:53:28.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2490999999999999e-05 2024-04-25T22:53:28.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:28.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021911+0000", 2024-04-25T22:53:28.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094114160000000006 2024-04-25T22:53:28.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:28.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022000+0000", 2024-04-25T22:53:28.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8601000000000001e-05 2024-04-25T22:53:28.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:28.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022359+0000", 2024-04-25T22:53:28.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035921999999999999 2024-04-25T22:53:28.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:28.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025541+0000", 2024-04-25T22:53:28.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031820619999999998 2024-04-25T22:53:28.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:28.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033375+0000", 2024-04-25T22:53:28.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078338379999999992 2024-04-25T22:53:28.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:28.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033415+0000", 2024-04-25T22:53:28.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9527000000000003e-05 2024-04-25T22:53:28.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:28.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033455+0000", 2024-04-25T22:53:28.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9932000000000003e-05 2024-04-25T22:53:28.704 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:28.704 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:28.704 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:28.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.705 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:28.705 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:28.705 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 95.647554407000001, 2024-04-25T22:53:28.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021043857999999999, 2024-04-25T22:53:28.705 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:28.705 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:28.705 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:28.705 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:28.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:28.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:28.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:28.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:28.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:28.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:28.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:28.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012523+0000", 2024-04-25T22:53:28.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.361e-06 2024-04-25T22:53:28.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:28.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012530+0000", 2024-04-25T22:53:28.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5440000000000004e-06 2024-04-25T22:53:28.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:28.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012541+0000", 2024-04-25T22:53:28.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1745e-05 2024-04-25T22:53:28.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:28.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012551+0000", 2024-04-25T22:53:28.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5789999999999993e-06 2024-04-25T22:53:28.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:28.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022709+0000", 2024-04-25T22:53:28.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010157685 2024-04-25T22:53:28.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:28.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022957+0000", 2024-04-25T22:53:28.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024824599999999998 2024-04-25T22:53:28.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:28.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023443+0000", 2024-04-25T22:53:28.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048578599999999999 2024-04-25T22:53:28.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:28.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025547+0000", 2024-04-25T22:53:28.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021044789999999998 2024-04-25T22:53:28.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:28.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033509+0000", 2024-04-25T22:53:28.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0079622180000000001 2024-04-25T22:53:28.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:28.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033542+0000", 2024-04-25T22:53:28.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3018000000000001e-05 2024-04-25T22:53:28.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:28.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033566+0000", 2024-04-25T22:53:28.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3197000000000002e-05 2024-04-25T22:53:28.710 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:28.710 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:28.710 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:28.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.710 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:28.711 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:28.711 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 95.647514442000002, 2024-04-25T22:53:28.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021122696, 2024-04-25T22:53:28.711 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:28.711 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:28.711 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:28.711 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:28.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:28.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:28.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:28.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:28.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:28.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:28.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:28.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:28.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:53:28.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:28.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012566+0000", 2024-04-25T22:53:28.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-04-25T22:53:28.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:28.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012619+0000", 2024-04-25T22:53:28.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2607e-05 2024-04-25T22:53:28.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:28.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012628+0000", 2024-04-25T22:53:28.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6500000000000008e-06 2024-04-25T22:53:28.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:28.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024024+0000", 2024-04-25T22:53:28.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011396007999999999 2024-04-25T22:53:28.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:28.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024198+0000", 2024-04-25T22:53:28.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000173215 2024-04-25T22:53:28.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:28.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024447+0000", 2024-04-25T22:53:28.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024898500000000002 2024-04-25T22:53:28.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:28.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026431+0000", 2024-04-25T22:53:28.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001984923 2024-04-25T22:53:28.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:28.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033608+0000", 2024-04-25T22:53:28.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071768459999999997 2024-04-25T22:53:28.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:28.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033646+0000", 2024-04-25T22:53:28.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299000000000003e-05 2024-04-25T22:53:28.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:28.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033684+0000", 2024-04-25T22:53:28.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8773000000000003e-05 2024-04-25T22:53:28.716 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:28.716 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:28.716 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:28.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.716 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:28.716 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:28.716 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 95.647425842999994, 2024-04-25T22:53:28.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021175381, 2024-04-25T22:53:28.716 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:28.716 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:28.716 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:28.717 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:28.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:28.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:28.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:28.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:28.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:28.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:28.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:28.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012651+0000", 2024-04-25T22:53:28.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:53:28.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:28.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012656+0000", 2024-04-25T22:53:28.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8899999999999998e-06 2024-04-25T22:53:28.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:28.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012666+0000", 2024-04-25T22:53:28.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0346999999999999e-05 2024-04-25T22:53:28.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:28.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012675+0000", 2024-04-25T22:53:28.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9930000000000001e-06 2024-04-25T22:53:28.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:28.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025661+0000", 2024-04-25T22:53:28.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01298531 2024-04-25T22:53:28.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:28.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025757+0000", 2024-04-25T22:53:28.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5822000000000005e-05 2024-04-25T22:53:28.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:28.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025907+0000", 2024-04-25T22:53:28.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015051499999999999 2024-04-25T22:53:28.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:28.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026435+0000", 2024-04-25T22:53:28.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052762200000000005 2024-04-25T22:53:28.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:28.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033732+0000", 2024-04-25T22:53:28.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072978419999999997 2024-04-25T22:53:28.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:28.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033787+0000", 2024-04-25T22:53:28.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4703999999999997e-05 2024-04-25T22:53:28.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:28.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033826+0000", 2024-04-25T22:53:28.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8458999999999999e-05 2024-04-25T22:53:28.721 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:28.721 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:28.721 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:28.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.722 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:28.722 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:28.722 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 95.647370429000006, 2024-04-25T22:53:28.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021244174000000001, 2024-04-25T22:53:28.722 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:28.722 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:28.722 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:28.722 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:28.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:28.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:28.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:28.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:28.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:28.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:28.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:28.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:28.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:28.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:28.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012712+0000", 2024-04-25T22:53:28.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.913e-06 2024-04-25T22:53:28.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:28.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012722+0000", 2024-04-25T22:53:28.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2879999999999998e-06 2024-04-25T22:53:28.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:28.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012727+0000", 2024-04-25T22:53:28.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8429999999999998e-06 2024-04-25T22:53:28.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:28.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026099+0000", 2024-04-25T22:53:28.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013371450999999999 2024-04-25T22:53:28.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:28.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026147+0000", 2024-04-25T22:53:28.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7837999999999998e-05 2024-04-25T22:53:28.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:28.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026254+0000", 2024-04-25T22:53:28.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107314 2024-04-25T22:53:28.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:28.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026686+0000", 2024-04-25T22:53:28.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000432428 2024-04-25T22:53:28.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:28.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033873+0000", 2024-04-25T22:53:28.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071864399999999997 2024-04-25T22:53:28.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:28.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033904+0000", 2024-04-25T22:53:28.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1321e-05 2024-04-25T22:53:28.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:28.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033950+0000", 2024-04-25T22:53:28.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5707999999999997e-05 2024-04-25T22:53:28.727 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:28.727 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:28.727 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:28.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.728 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:28.728 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:28.728 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 95.647340044000003, 2024-04-25T22:53:28.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01096505, 2024-04-25T22:53:28.728 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:28.728 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:28.728 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:28.728 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:28.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:28.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:28.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:28.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:28.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:28.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:28.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:28.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012737+0000", 2024-04-25T22:53:28.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:28.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:28.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012739+0000", 2024-04-25T22:53:28.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-04-25T22:53:28.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:28.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012743+0000", 2024-04-25T22:53:28.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3239999999999996e-06 2024-04-25T22:53:28.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:28.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012746+0000", 2024-04-25T22:53:28.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.129e-06 2024-04-25T22:53:28.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:28.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012796+0000", 2024-04-25T22:53:28.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9231999999999999e-05 2024-04-25T22:53:28.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:28.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012915+0000", 2024-04-25T22:53:28.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119021 2024-04-25T22:53:28.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:28.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013069+0000", 2024-04-25T22:53:28.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015463900000000001 2024-04-25T22:53:28.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:28.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019237+0000", 2024-04-25T22:53:28.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061680329999999998 2024-04-25T22:53:28.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:28.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023603+0000", 2024-04-25T22:53:28.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043655860000000003 2024-04-25T22:53:28.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:28.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023659+0000", 2024-04-25T22:53:28.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6484000000000003e-05 2024-04-25T22:53:28.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:28.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023701+0000", 2024-04-25T22:53:28.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1761999999999998e-05 2024-04-25T22:53:28.733 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:28.733 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:28.733 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:28.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.733 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:28.733 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:28.733 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 95.647315096, 2024-04-25T22:53:28.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011234429000000001, 2024-04-25T22:53:28.734 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:28.734 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:28.734 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:28.734 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:28.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:28.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:28.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:28.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:28.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:28.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:28.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:28.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012762+0000", 2024-04-25T22:53:28.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-04-25T22:53:28.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:28.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012765+0000", 2024-04-25T22:53:28.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2569999999999999e-06 2024-04-25T22:53:28.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:28.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012783+0000", 2024-04-25T22:53:28.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8431999999999999e-05 2024-04-25T22:53:28.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:28.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012799+0000", 2024-04-25T22:53:28.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5438999999999999e-05 2024-04-25T22:53:28.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:28.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013826+0000", 2024-04-25T22:53:28.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010275060000000001 2024-04-25T22:53:28.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:28.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013913+0000", 2024-04-25T22:53:28.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.708e-05 2024-04-25T22:53:28.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:28.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014098+0000", 2024-04-25T22:53:28.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018519399999999999 2024-04-25T22:53:28.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:28.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019684+0000", 2024-04-25T22:53:28.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055860079999999999 2024-04-25T22:53:28.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:28.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023876+0000", 2024-04-25T22:53:28.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041918800000000003 2024-04-25T22:53:28.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:28.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023957+0000", 2024-04-25T22:53:28.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1165e-05 2024-04-25T22:53:28.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:28.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023995+0000", 2024-04-25T22:53:28.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:53:28.739 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:28.739 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:28.739 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:28.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.739 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:28.739 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:28.739 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 95.647217316999999, 2024-04-25T22:53:28.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011131200000000001, 2024-04-25T22:53:28.739 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:28.739 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:28.740 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:28.740 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:28.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:28.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:28.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:28.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:28.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:28.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:28.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:28.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012860+0000", 2024-04-25T22:53:28.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3900000000000004e-07 2024-04-25T22:53:28.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:28.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012865+0000", 2024-04-25T22:53:28.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5609999999999998e-06 2024-04-25T22:53:28.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:28.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012895+0000", 2024-04-25T22:53:28.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9847000000000001e-05 2024-04-25T22:53:28.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:28.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012905+0000", 2024-04-25T22:53:28.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.03e-05 2024-04-25T22:53:28.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:28.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015020+0000", 2024-04-25T22:53:28.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021142940000000001 2024-04-25T22:53:28.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:28.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015182+0000", 2024-04-25T22:53:28.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016248099999999999 2024-04-25T22:53:28.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:28.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015357+0000", 2024-04-25T22:53:28.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017471000000000001 2024-04-25T22:53:28.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:28.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021021+0000", 2024-04-25T22:53:28.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056638340000000004 2024-04-25T22:53:28.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:28.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023712+0000", 2024-04-25T22:53:28.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026910380000000002 2024-04-25T22:53:28.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:28.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023763+0000", 2024-04-25T22:53:28.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1477999999999997e-05 2024-04-25T22:53:28.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:28.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023990+0000", 2024-04-25T22:53:28.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000226818 2024-04-25T22:53:28.744 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:28.744 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:28.744 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:28.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.745 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:28.745 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:28.745 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 95.647094221000003, 2024-04-25T22:53:28.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011705299000000001, 2024-04-25T22:53:28.745 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:28.745 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:28.745 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:28.745 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:28.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:28.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:28.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:28.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:28.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:28.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:28.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:28.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012983+0000", 2024-04-25T22:53:28.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:53:28.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:28.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012986+0000", 2024-04-25T22:53:28.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5700000000000001e-06 2024-04-25T22:53:28.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:28.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012993+0000", 2024-04-25T22:53:28.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8730000000000001e-06 2024-04-25T22:53:28.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:28.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013000+0000", 2024-04-25T22:53:28.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1890000000000001e-06 2024-04-25T22:53:28.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:28.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:53:28.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002147866 2024-04-25T22:53:28.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:28.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015351+0000", 2024-04-25T22:53:28.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020300799999999999 2024-04-25T22:53:28.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:28.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016260+0000", 2024-04-25T22:53:28.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00090926799999999997 2024-04-25T22:53:28.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:28.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022669+0000", 2024-04-25T22:53:28.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064082849999999997 2024-04-25T22:53:28.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:28.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024584+0000", 2024-04-25T22:53:28.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019151699999999999 2024-04-25T22:53:28.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:28.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024643+0000", 2024-04-25T22:53:28.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8888999999999998e-05 2024-04-25T22:53:28.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:28.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024687+0000", 2024-04-25T22:53:28.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4444999999999999e-05 2024-04-25T22:53:28.750 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:28.750 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:28.750 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:28.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.751 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:28.751 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:28.751 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 95.647066629999998, 2024-04-25T22:53:28.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011249699, 2024-04-25T22:53:28.751 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:28.751 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:28.751 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:28.751 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:28.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:28.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:28.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:28.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:28.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:28.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:28.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:28.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013010+0000", 2024-04-25T22:53:28.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2099999999999996e-07 2024-04-25T22:53:28.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:28.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013013+0000", 2024-04-25T22:53:28.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1310000000000002e-06 2024-04-25T22:53:28.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:28.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013020+0000", 2024-04-25T22:53:28.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3330000000000002e-06 2024-04-25T22:53:28.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:28.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013025+0000", 2024-04-25T22:53:28.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6760000000000004e-06 2024-04-25T22:53:28.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:28.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013163+0000", 2024-04-25T22:53:28.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013824599999999999 2024-04-25T22:53:28.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:28.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013504+0000", 2024-04-25T22:53:28.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034080299999999998 2024-04-25T22:53:28.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:28.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013613+0000", 2024-04-25T22:53:28.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108705 2024-04-25T22:53:28.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:28.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015831+0000", 2024-04-25T22:53:28.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002217672 2024-04-25T22:53:28.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:28.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024137+0000", 2024-04-25T22:53:28.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0083060489999999994 2024-04-25T22:53:28.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:28.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024218+0000", 2024-04-25T22:53:28.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1351000000000001e-05 2024-04-25T22:53:28.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:28.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024259+0000", 2024-04-25T22:53:28.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1112000000000002e-05 2024-04-25T22:53:28.756 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:28.756 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:28.756 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:28.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.756 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:28.756 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:28.756 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 95.646978903999994, 2024-04-25T22:53:28.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020379749999999999, 2024-04-25T22:53:28.756 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:28.757 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:28.757 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:28.757 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:28.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:28.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:28.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:28.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:28.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:28.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:28.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:28.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013098+0000", 2024-04-25T22:53:28.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:53:28.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:28.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013105+0000", 2024-04-25T22:53:28.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5969999999999997e-06 2024-04-25T22:53:28.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:28.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013190+0000", 2024-04-25T22:53:28.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5618999999999995e-05 2024-04-25T22:53:28.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:28.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013200+0000", 2024-04-25T22:53:28.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5859999999999994e-06 2024-04-25T22:53:28.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:28.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020265+0000", 2024-04-25T22:53:28.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070653349999999998 2024-04-25T22:53:28.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:28.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020454+0000", 2024-04-25T22:53:28.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189316 2024-04-25T22:53:28.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:28.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020586+0000", 2024-04-25T22:53:28.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013195700000000001 2024-04-25T22:53:28.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:28.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023822+0000", 2024-04-25T22:53:28.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032358529999999999 2024-04-25T22:53:28.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:28.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033409+0000", 2024-04-25T22:53:28.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095870520000000004 2024-04-25T22:53:28.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:28.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033447+0000", 2024-04-25T22:53:28.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7261999999999997e-05 2024-04-25T22:53:28.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:28.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033477+0000", 2024-04-25T22:53:28.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0389e-05 2024-04-25T22:53:28.765 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:28.765 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:28.765 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:28.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.765 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:28.766 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:28.766 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 95.646862397999996, 2024-04-25T22:53:28.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010857383999999999, 2024-04-25T22:53:28.766 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:28.766 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:28.766 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:28.766 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:28.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:28.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:28.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:28.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:28.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:28.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:28.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:28.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:28.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:28.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:28.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013218+0000", 2024-04-25T22:53:28.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8199999999999998e-06 2024-04-25T22:53:28.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:28.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013226+0000", 2024-04-25T22:53:28.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7649999999999993e-06 2024-04-25T22:53:28.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:28.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013259+0000", 2024-04-25T22:53:28.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2727e-05 2024-04-25T22:53:28.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:28.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014809+0000", 2024-04-25T22:53:28.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001550144 2024-04-25T22:53:28.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:28.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014958+0000", 2024-04-25T22:53:28.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014890300000000001 2024-04-25T22:53:28.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:28.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015087+0000", 2024-04-25T22:53:28.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012939200000000001 2024-04-25T22:53:28.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:28.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020212+0000", 2024-04-25T22:53:28.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051248939999999996 2024-04-25T22:53:28.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:28.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023699+0000", 2024-04-25T22:53:28.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034873289999999999 2024-04-25T22:53:28.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:28.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024014+0000", 2024-04-25T22:53:28.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031473999999999999 2024-04-25T22:53:28.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:28.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024071+0000", 2024-04-25T22:53:28.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7040000000000003e-05 2024-04-25T22:53:28.771 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:28.771 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:28.771 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:28.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.771 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:28.771 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:28.772 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 95.646807693, 2024-04-25T22:53:28.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012329677000000001, 2024-04-25T22:53:28.772 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:28.772 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:28.772 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:28.772 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:28.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:28.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:28.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:28.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:28.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:28.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:28.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:28.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013269+0000", 2024-04-25T22:53:28.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5000000000000002e-07 2024-04-25T22:53:28.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:28.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:28.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6909999999999999e-06 2024-04-25T22:53:28.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:28.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013284+0000", 2024-04-25T22:53:28.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0963e-05 2024-04-25T22:53:28.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:28.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013361+0000", 2024-04-25T22:53:28.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7379999999999994e-05 2024-04-25T22:53:28.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:28.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013448+0000", 2024-04-25T22:53:28.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6990000000000006e-05 2024-04-25T22:53:28.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:28.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013632+0000", 2024-04-25T22:53:28.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018396800000000001 2024-04-25T22:53:28.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:28.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013800+0000", 2024-04-25T22:53:28.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167467 2024-04-25T22:53:28.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:28.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.018570+0000", 2024-04-25T22:53:28.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047701460000000003 2024-04-25T22:53:28.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:28.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025507+0000", 2024-04-25T22:53:28.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069372039999999998 2024-04-25T22:53:28.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:28.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025562+0000", 2024-04-25T22:53:28.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4858999999999998e-05 2024-04-25T22:53:28.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:28.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025598+0000", 2024-04-25T22:53:28.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6259e-05 2024-04-25T22:53:28.777 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:28.777 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:28.777 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:28.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.777 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:28.777 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:28.777 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 95.646675819999999, 2024-04-25T22:53:28.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020176666999999999, 2024-04-25T22:53:28.777 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:28.777 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:28.777 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:53:28.777 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:28.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:28.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:28.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:28.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:28.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:28.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:28.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:28.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:28.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-04-25T22:53:28.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:28.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013405+0000", 2024-04-25T22:53:28.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0559999999999998e-06 2024-04-25T22:53:28.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:28.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013422+0000", 2024-04-25T22:53:28.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6770999999999999e-05 2024-04-25T22:53:28.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:28.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013431+0000", 2024-04-25T22:53:28.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5019999999999998e-06 2024-04-25T22:53:28.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:28.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021720+0000", 2024-04-25T22:53:28.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082884340000000008 2024-04-25T22:53:28.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:28.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022122+0000", 2024-04-25T22:53:28.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000401634 2024-04-25T22:53:28.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:28.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:28.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:28.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033577+0000", 2024-04-25T22:53:28.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011455435999999999 2024-04-25T22:53:28.781 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:28.781 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:28.781 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:28.781 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:28.781 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:28.781 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:28.782 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-25T22:53:28.783 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:53:28.783 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:53:28.783 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-25T22:53:28.784 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:28.784 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:28.781+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:28.785 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:53:28.785 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:53:28.785 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:53:28.884 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:28.883+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:28.891 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:28.891 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:28.899 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:28.984 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:28.984+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:29.043 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:29.043 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:29.052 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:29.095 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:29.094+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:29.154 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:29.154 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:29.162 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:29.207 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:29.206+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:29.265 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:29.265 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:29.274 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:29.287 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:29.286+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:29.325 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-25T22:53:29.388 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:29.387+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:29.416 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:29.417 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:29.425 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:29.509 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:29.508+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:29.567 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:29.568 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:29.578 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:29.620 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:29.619+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:29.683 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:29.684 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:29.691 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:29.691+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:29.692 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:29.792 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:29.791+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:29.794 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:29.794 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:29.804 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:29.893 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:29.892+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:29.947 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:29.947 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:29.956 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:30.000 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:29.999+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:30.060 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:30.060 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:30.069 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:30.111 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:30.110+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:30.196 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:30.195+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:30.212 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:30.212 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:30.220 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:30.262 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is set 2024-04-25T22:53:30.282 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~47s 2024-04-25T22:53:30.305 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:30.304+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:30.364 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:30.365 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:30.373 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:30.418 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:30.417+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:30.477 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:30.477 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:30.486 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:30.498 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:30.498+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:30.599 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:30.598+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:30.628 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:30.628 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:30.636 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:30.699 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:30.698+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:30.739 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:30.739 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:30.747 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:30.786 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:53:30.800 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:30.799+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:30.852 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:30.852 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:30.862 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:30.903 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:30.902+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:30.959 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-25T22:53:30.960 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:53:30.960 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:53:30.994 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-25T22:53:30.994 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:53:30.997 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:53:30.998 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:53:31.002 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:31.001+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:31.002 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:31.002 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:31.003 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:53:31.003 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:53:31.003 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:31.011 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:31.103 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:31.102+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:31.157 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:31.158 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-04-25T22:53:31.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-04-25T22:53:31.158 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:53:31.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.158 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:31.158 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:31.158 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 103.19080898, 2024-04-25T22:53:31.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0103421, 2024-04-25T22:53:31.158 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:31.158 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:31.158 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:31.158 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:31.159 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:31.159 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:31.159 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 115 2024-04-25T22:53:31.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.159 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:31.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:31.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:31.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:31.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:31.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:31.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:31.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:31.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:31.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9500000000000002e-07 2024-04-25T22:53:31.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:31.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965108+0000", 2024-04-25T22:53:31.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9177999999999994e-05 2024-04-25T22:53:31.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:31.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965127+0000", 2024-04-25T22:53:31.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8868e-05 2024-04-25T22:53:31.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:31.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965133+0000", 2024-04-25T22:53:31.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8929999999999999e-06 2024-04-25T22:53:31.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:31.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.969991+0000", 2024-04-25T22:53:31.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048573849999999997 2024-04-25T22:53:31.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:31.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970072+0000", 2024-04-25T22:53:31.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0728000000000004e-05 2024-04-25T22:53:31.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:31.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970189+0000", 2024-04-25T22:53:31.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000117778 2024-04-25T22:53:31.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:31.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970946+0000", 2024-04-25T22:53:31.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00075704600000000004 2024-04-25T22:53:31.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:31.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975297+0000", 2024-04-25T22:53:31.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004350217 2024-04-25T22:53:31.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:31.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975343+0000", 2024-04-25T22:53:31.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6687999999999998e-05 2024-04-25T22:53:31.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:31.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975380+0000", 2024-04-25T22:53:31.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6724000000000003e-05 2024-04-25T22:53:31.164 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:31.164 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:31.164 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:31.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.164 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:31.165 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:31.165 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 103.190702949, 2024-04-25T22:53:31.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010304384, 2024-04-25T22:53:31.165 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:31.165 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:31.165 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:31.165 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:31.165 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:31.165 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:31.165 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 116 2024-04-25T22:53:31.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.166 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:31.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:31.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:31.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:31.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:31.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:31.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:31.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:31.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965144+0000", 2024-04-25T22:53:31.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5799999999999999e-07 2024-04-25T22:53:31.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:31.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965154+0000", 2024-04-25T22:53:31.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0009e-05 2024-04-25T22:53:31.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:31.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965164+0000", 2024-04-25T22:53:31.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8490000000000001e-06 2024-04-25T22:53:31.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:31.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965169+0000", 2024-04-25T22:53:31.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0730000000000004e-06 2024-04-25T22:53:31.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:31.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970609+0000", 2024-04-25T22:53:31.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054397689999999997 2024-04-25T22:53:31.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:31.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970651+0000", 2024-04-25T22:53:31.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1873999999999999e-05 2024-04-25T22:53:31.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:31.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970723+0000", 2024-04-25T22:53:31.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2039999999999995e-05 2024-04-25T22:53:31.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:31.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971358+0000", 2024-04-25T22:53:31.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063489500000000001 2024-04-25T22:53:31.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:31.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975409+0000", 2024-04-25T22:53:31.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040506880000000002 2024-04-25T22:53:31.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:31.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975432+0000", 2024-04-25T22:53:31.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3315999999999998e-05 2024-04-25T22:53:31.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:31.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975448+0000", 2024-04-25T22:53:31.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6313000000000001e-05 2024-04-25T22:53:31.171 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:31.171 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:31.171 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:31.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.171 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:31.171 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:31.171 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 103.190668367, 2024-04-25T22:53:31.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010384338999999999, 2024-04-25T22:53:31.171 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:31.171 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:31.171 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:31.172 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:31.172 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:31.172 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:31.172 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-04-25T22:53:31.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.172 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:31.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:31.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:31.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:31.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:31.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:31.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:31.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:31.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:31.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3600000000000004e-07 2024-04-25T22:53:31.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:31.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965185+0000", 2024-04-25T22:53:31.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.117e-06 2024-04-25T22:53:31.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:31.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965192+0000", 2024-04-25T22:53:31.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3239999999999997e-06 2024-04-25T22:53:31.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:31.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965198+0000", 2024-04-25T22:53:31.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6370000000000004e-06 2024-04-25T22:53:31.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:31.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970973+0000", 2024-04-25T22:53:31.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057748239999999996 2024-04-25T22:53:31.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:31.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971049+0000", 2024-04-25T22:53:31.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6029e-05 2024-04-25T22:53:31.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:31.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971174+0000", 2024-04-25T22:53:31.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012462399999999999 2024-04-25T22:53:31.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:31.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971553+0000", 2024-04-25T22:53:31.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037896499999999999 2024-04-25T22:53:31.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:31.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975482+0000", 2024-04-25T22:53:31.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039297459999999996 2024-04-25T22:53:31.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:31.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975529+0000", 2024-04-25T22:53:31.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6387000000000002e-05 2024-04-25T22:53:31.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:31.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975563+0000", 2024-04-25T22:53:31.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4150000000000003e-05 2024-04-25T22:53:31.177 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:31.177 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:31.177 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:31.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.177 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:31.177 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:31.177 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.143622043999997, 2024-04-25T22:53:31.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012637705000000001, 2024-04-25T22:53:31.177 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:31.177 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:31.177 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:31.177 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:31.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:31.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:31.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:31.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:31.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:31.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:31.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:31.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012227+0000", 2024-04-25T22:53:31.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.863e-06 2024-04-25T22:53:31.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:31.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012236+0000", 2024-04-25T22:53:31.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1109999999999997e-06 2024-04-25T22:53:31.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:31.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012309+0000", 2024-04-25T22:53:31.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3242000000000001e-05 2024-04-25T22:53:31.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:31.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012324+0000", 2024-04-25T22:53:31.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4837e-05 2024-04-25T22:53:31.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:31.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015060+0000", 2024-04-25T22:53:31.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027363349999999999 2024-04-25T22:53:31.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:31.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015169+0000", 2024-04-25T22:53:31.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108372 2024-04-25T22:53:31.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:31.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015498+0000", 2024-04-25T22:53:31.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032949999999999999 2024-04-25T22:53:31.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:31.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021282+0000", 2024-04-25T22:53:31.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057836429999999998 2024-04-25T22:53:31.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:31.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024709+0000", 2024-04-25T22:53:31.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034271979999999998 2024-04-25T22:53:31.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:31.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024802+0000", 2024-04-25T22:53:31.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2960000000000004e-05 2024-04-25T22:53:31.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:31.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024863+0000", 2024-04-25T22:53:31.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0643999999999997e-05 2024-04-25T22:53:31.182 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:31.182 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:31.182 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:31.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.183 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:31.183 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:31.183 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.143498273000006, 2024-04-25T22:53:31.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012979447999999999, 2024-04-25T22:53:31.183 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:31.183 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:31.183 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:31.183 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:31.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:31.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:31.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:31.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:31.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:31.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:31.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:31.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:31.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:53:31.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:31.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012354+0000", 2024-04-25T22:53:31.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7740000000000004e-06 2024-04-25T22:53:31.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:31.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012365+0000", 2024-04-25T22:53:31.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.064e-05 2024-04-25T22:53:31.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:31.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012382+0000", 2024-04-25T22:53:31.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6999000000000001e-05 2024-04-25T22:53:31.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:31.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015958+0000", 2024-04-25T22:53:31.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035765699999999998 2024-04-25T22:53:31.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:31.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016037+0000", 2024-04-25T22:53:31.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8242000000000001e-05 2024-04-25T22:53:31.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:31.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016404+0000", 2024-04-25T22:53:31.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036784300000000002 2024-04-25T22:53:31.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:31.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021294+0000", 2024-04-25T22:53:31.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048890629999999999 2024-04-25T22:53:31.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:31.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024959+0000", 2024-04-25T22:53:31.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036651570000000001 2024-04-25T22:53:31.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:31.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025097+0000", 2024-04-25T22:53:31.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013788099999999999 2024-04-25T22:53:31.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:31.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025328+0000", 2024-04-25T22:53:31.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231492 2024-04-25T22:53:31.188 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:31.188 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:31.188 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:31.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.188 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:31.188 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:31.189 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.143410504000002, 2024-04-25T22:53:31.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013049827, 2024-04-25T22:53:31.189 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:31.189 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:31.189 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:31.189 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:31.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:31.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:31.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:31.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:31.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:31.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:31.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:31.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012437+0000", 2024-04-25T22:53:31.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-04-25T22:53:31.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:31.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012440+0000", 2024-04-25T22:53:31.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7609999999999999e-06 2024-04-25T22:53:31.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:31.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012449+0000", 2024-04-25T22:53:31.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.285e-06 2024-04-25T22:53:31.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:31.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012457+0000", 2024-04-25T22:53:31.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9510000000000006e-06 2024-04-25T22:53:31.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:31.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017106+0000", 2024-04-25T22:53:31.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046494220000000003 2024-04-25T22:53:31.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:31.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017223+0000", 2024-04-25T22:53:31.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116824 2024-04-25T22:53:31.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:31.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017345+0000", 2024-04-25T22:53:31.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122175 2024-04-25T22:53:31.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:31.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021299+0000", 2024-04-25T22:53:31.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039534879999999998 2024-04-25T22:53:31.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.193 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:31.193 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025398+0000", 2024-04-25T22:53:31.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040988960000000003 2024-04-25T22:53:31.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.193 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:31.193 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025439+0000", 2024-04-25T22:53:31.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0915999999999999e-05 2024-04-25T22:53:31.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.194 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:31.194 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025486+0000", 2024-04-25T22:53:31.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7534999999999998e-05 2024-04-25T22:53:31.194 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:31.194 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:31.194 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:31.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.194 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:31.194 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:31.194 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.143380352999998, 2024-04-25T22:53:31.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020988041999999998, 2024-04-25T22:53:31.194 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:31.195 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:31.195 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:31.195 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:31.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:31.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:31.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:31.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:31.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:31.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:31.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:31.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:31.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.99e-07 2024-04-25T22:53:31.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:31.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012470+0000", 2024-04-25T22:53:31.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2789999999999999e-06 2024-04-25T22:53:31.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:31.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012477+0000", 2024-04-25T22:53:31.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:53:31.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:31.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012500+0000", 2024-04-25T22:53:31.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2490999999999999e-05 2024-04-25T22:53:31.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:31.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021911+0000", 2024-04-25T22:53:31.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094114160000000006 2024-04-25T22:53:31.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.198 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:31.198 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022000+0000", 2024-04-25T22:53:31.198 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8601000000000001e-05 2024-04-25T22:53:31.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.198 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:31.198 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022359+0000", 2024-04-25T22:53:31.198 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035921999999999999 2024-04-25T22:53:31.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.198 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:31.198 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025541+0000", 2024-04-25T22:53:31.198 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031820619999999998 2024-04-25T22:53:31.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:31.199 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033375+0000", 2024-04-25T22:53:31.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078338379999999992 2024-04-25T22:53:31.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:31.199 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033415+0000", 2024-04-25T22:53:31.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9527000000000003e-05 2024-04-25T22:53:31.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:31.199 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033455+0000", 2024-04-25T22:53:31.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9932000000000003e-05 2024-04-25T22:53:31.200 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:31.200 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:31.200 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:31.200 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.200 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.200 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:31.200 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:31.200 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.143325160000003, 2024-04-25T22:53:31.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021043857999999999, 2024-04-25T22:53:31.200 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:31.200 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:31.200 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:31.201 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:31.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:31.201 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:31.201 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:31.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:31.201 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:31.201 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:31.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.202 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.202 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:31.202 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012523+0000", 2024-04-25T22:53:31.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.361e-06 2024-04-25T22:53:31.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.202 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.202 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:31.202 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012530+0000", 2024-04-25T22:53:31.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5440000000000004e-06 2024-04-25T22:53:31.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.202 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.202 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:31.202 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012541+0000", 2024-04-25T22:53:31.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1745e-05 2024-04-25T22:53:31.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:31.203 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012551+0000", 2024-04-25T22:53:31.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5789999999999993e-06 2024-04-25T22:53:31.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:31.203 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022709+0000", 2024-04-25T22:53:31.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010157685 2024-04-25T22:53:31.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:31.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022957+0000", 2024-04-25T22:53:31.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024824599999999998 2024-04-25T22:53:31.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:31.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023443+0000", 2024-04-25T22:53:31.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048578599999999999 2024-04-25T22:53:31.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:31.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025547+0000", 2024-04-25T22:53:31.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021044789999999998 2024-04-25T22:53:31.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:31.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033509+0000", 2024-04-25T22:53:31.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0079622180000000001 2024-04-25T22:53:31.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:31.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033542+0000", 2024-04-25T22:53:31.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3018000000000001e-05 2024-04-25T22:53:31.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:31.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033566+0000", 2024-04-25T22:53:31.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3197000000000002e-05 2024-04-25T22:53:31.206 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:31.206 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:31.206 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:31.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.206 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:31.206 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:31.206 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.143285195000004, 2024-04-25T22:53:31.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021122696, 2024-04-25T22:53:31.207 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:31.207 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:31.207 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:31.207 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:31.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.207 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:31.207 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:31.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:31.207 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.207 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:31.207 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:31.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:31.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:31.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:31.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:53:31.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:31.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012566+0000", 2024-04-25T22:53:31.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-04-25T22:53:31.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:31.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012619+0000", 2024-04-25T22:53:31.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2607e-05 2024-04-25T22:53:31.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:31.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012628+0000", 2024-04-25T22:53:31.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6500000000000008e-06 2024-04-25T22:53:31.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:31.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024024+0000", 2024-04-25T22:53:31.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011396007999999999 2024-04-25T22:53:31.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:31.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024198+0000", 2024-04-25T22:53:31.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000173215 2024-04-25T22:53:31.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:31.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024447+0000", 2024-04-25T22:53:31.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024898500000000002 2024-04-25T22:53:31.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:31.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026431+0000", 2024-04-25T22:53:31.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001984923 2024-04-25T22:53:31.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:31.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033608+0000", 2024-04-25T22:53:31.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071768459999999997 2024-04-25T22:53:31.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:31.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033646+0000", 2024-04-25T22:53:31.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299000000000003e-05 2024-04-25T22:53:31.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:31.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033684+0000", 2024-04-25T22:53:31.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8773000000000003e-05 2024-04-25T22:53:31.212 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:31.213 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:31.213 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:31.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.213 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:31.213 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:31.213 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.143196595999996, 2024-04-25T22:53:31.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021175381, 2024-04-25T22:53:31.214 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:31.214 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:31.214 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:31.214 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:31.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:31.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:31.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:31.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:31.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:31.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:31.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:31.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012651+0000", 2024-04-25T22:53:31.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:53:31.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:31.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012656+0000", 2024-04-25T22:53:31.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8899999999999998e-06 2024-04-25T22:53:31.216 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.216 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:31.216 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012666+0000", 2024-04-25T22:53:31.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0346999999999999e-05 2024-04-25T22:53:31.216 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.216 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:31.216 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012675+0000", 2024-04-25T22:53:31.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9930000000000001e-06 2024-04-25T22:53:31.216 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.216 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:31.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025661+0000", 2024-04-25T22:53:31.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01298531 2024-04-25T22:53:31.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:31.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025757+0000", 2024-04-25T22:53:31.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5822000000000005e-05 2024-04-25T22:53:31.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:31.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025907+0000", 2024-04-25T22:53:31.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015051499999999999 2024-04-25T22:53:31.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:31.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026435+0000", 2024-04-25T22:53:31.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052762200000000005 2024-04-25T22:53:31.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:31.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033732+0000", 2024-04-25T22:53:31.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072978419999999997 2024-04-25T22:53:31.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:31.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033787+0000", 2024-04-25T22:53:31.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4703999999999997e-05 2024-04-25T22:53:31.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:31.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033826+0000", 2024-04-25T22:53:31.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8458999999999999e-05 2024-04-25T22:53:31.219 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:31.219 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:31.219 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:31.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.219 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:31.219 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:31.219 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.143141181999994, 2024-04-25T22:53:31.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021244174000000001, 2024-04-25T22:53:31.220 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:31.220 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:31.220 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:31.220 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:31.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:31.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:31.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:31.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:31.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:31.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:31.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:31.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:31.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:31.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:31.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012712+0000", 2024-04-25T22:53:31.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.913e-06 2024-04-25T22:53:31.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:31.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012722+0000", 2024-04-25T22:53:31.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2879999999999998e-06 2024-04-25T22:53:31.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:31.222 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012727+0000", 2024-04-25T22:53:31.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8429999999999998e-06 2024-04-25T22:53:31.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:31.222 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026099+0000", 2024-04-25T22:53:31.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013371450999999999 2024-04-25T22:53:31.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:31.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026147+0000", 2024-04-25T22:53:31.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7837999999999998e-05 2024-04-25T22:53:31.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:31.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026254+0000", 2024-04-25T22:53:31.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107314 2024-04-25T22:53:31.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:31.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026686+0000", 2024-04-25T22:53:31.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000432428 2024-04-25T22:53:31.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:31.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033873+0000", 2024-04-25T22:53:31.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071864399999999997 2024-04-25T22:53:31.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:31.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033904+0000", 2024-04-25T22:53:31.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1321e-05 2024-04-25T22:53:31.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:31.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033950+0000", 2024-04-25T22:53:31.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5707999999999997e-05 2024-04-25T22:53:31.224 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:31.225 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:31.225 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:31.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.225 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:31.225 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:31.225 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.143110797000006, 2024-04-25T22:53:31.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01096505, 2024-04-25T22:53:31.225 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:31.225 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:31.225 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:31.225 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:31.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:31.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:31.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:31.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:31.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:31.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:31.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:31.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012737+0000", 2024-04-25T22:53:31.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:31.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:31.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012739+0000", 2024-04-25T22:53:31.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-04-25T22:53:31.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:31.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012743+0000", 2024-04-25T22:53:31.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3239999999999996e-06 2024-04-25T22:53:31.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:31.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012746+0000", 2024-04-25T22:53:31.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.129e-06 2024-04-25T22:53:31.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.228 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:31.228 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012796+0000", 2024-04-25T22:53:31.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9231999999999999e-05 2024-04-25T22:53:31.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.228 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:31.228 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012915+0000", 2024-04-25T22:53:31.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119021 2024-04-25T22:53:31.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.228 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:31.228 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013069+0000", 2024-04-25T22:53:31.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015463900000000001 2024-04-25T22:53:31.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:31.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019237+0000", 2024-04-25T22:53:31.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061680329999999998 2024-04-25T22:53:31.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:31.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023603+0000", 2024-04-25T22:53:31.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043655860000000003 2024-04-25T22:53:31.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:31.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023659+0000", 2024-04-25T22:53:31.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6484000000000003e-05 2024-04-25T22:53:31.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:31.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023701+0000", 2024-04-25T22:53:31.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1761999999999998e-05 2024-04-25T22:53:31.230 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:31.230 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:31.230 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:31.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.230 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:31.231 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:31.231 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.143085849000002, 2024-04-25T22:53:31.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011234429000000001, 2024-04-25T22:53:31.231 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:31.231 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:31.231 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:31.231 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:31.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:31.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:31.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:31.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:31.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:31.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:31.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:31.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012762+0000", 2024-04-25T22:53:31.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-04-25T22:53:31.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:31.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012765+0000", 2024-04-25T22:53:31.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2569999999999999e-06 2024-04-25T22:53:31.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:31.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012783+0000", 2024-04-25T22:53:31.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8431999999999999e-05 2024-04-25T22:53:31.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:31.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012799+0000", 2024-04-25T22:53:31.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5438999999999999e-05 2024-04-25T22:53:31.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:31.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013826+0000", 2024-04-25T22:53:31.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010275060000000001 2024-04-25T22:53:31.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:31.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013913+0000", 2024-04-25T22:53:31.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.708e-05 2024-04-25T22:53:31.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:31.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014098+0000", 2024-04-25T22:53:31.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018519399999999999 2024-04-25T22:53:31.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:31.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019684+0000", 2024-04-25T22:53:31.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055860079999999999 2024-04-25T22:53:31.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:31.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023876+0000", 2024-04-25T22:53:31.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041918800000000003 2024-04-25T22:53:31.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:31.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023957+0000", 2024-04-25T22:53:31.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1165e-05 2024-04-25T22:53:31.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:31.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023995+0000", 2024-04-25T22:53:31.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:53:31.236 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:31.236 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:31.236 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:31.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.236 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:31.236 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:31.236 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.142988070000001, 2024-04-25T22:53:31.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011131200000000001, 2024-04-25T22:53:31.237 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:31.237 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:31.237 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:31.237 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:31.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:31.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:31.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:31.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:31.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:31.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:31.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:31.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012860+0000", 2024-04-25T22:53:31.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3900000000000004e-07 2024-04-25T22:53:31.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:31.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012865+0000", 2024-04-25T22:53:31.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5609999999999998e-06 2024-04-25T22:53:31.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:31.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012895+0000", 2024-04-25T22:53:31.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9847000000000001e-05 2024-04-25T22:53:31.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:31.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012905+0000", 2024-04-25T22:53:31.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.03e-05 2024-04-25T22:53:31.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:31.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015020+0000", 2024-04-25T22:53:31.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021142940000000001 2024-04-25T22:53:31.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:31.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015182+0000", 2024-04-25T22:53:31.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016248099999999999 2024-04-25T22:53:31.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:31.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015357+0000", 2024-04-25T22:53:31.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017471000000000001 2024-04-25T22:53:31.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:31.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021021+0000", 2024-04-25T22:53:31.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056638340000000004 2024-04-25T22:53:31.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:31.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023712+0000", 2024-04-25T22:53:31.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026910380000000002 2024-04-25T22:53:31.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:31.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023763+0000", 2024-04-25T22:53:31.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1477999999999997e-05 2024-04-25T22:53:31.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:31.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023990+0000", 2024-04-25T22:53:31.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000226818 2024-04-25T22:53:31.241 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:31.242 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:31.242 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:31.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.242 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:31.242 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:31.242 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.142864974000005, 2024-04-25T22:53:31.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011705299000000001, 2024-04-25T22:53:31.242 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:31.242 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:31.242 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:31.242 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:31.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:31.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:31.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:31.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:31.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:31.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:31.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:31.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012983+0000", 2024-04-25T22:53:31.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:53:31.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:31.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012986+0000", 2024-04-25T22:53:31.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5700000000000001e-06 2024-04-25T22:53:31.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:31.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012993+0000", 2024-04-25T22:53:31.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8730000000000001e-06 2024-04-25T22:53:31.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:31.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013000+0000", 2024-04-25T22:53:31.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1890000000000001e-06 2024-04-25T22:53:31.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:31.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:53:31.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002147866 2024-04-25T22:53:31.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:31.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015351+0000", 2024-04-25T22:53:31.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020300799999999999 2024-04-25T22:53:31.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:31.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016260+0000", 2024-04-25T22:53:31.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00090926799999999997 2024-04-25T22:53:31.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:31.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022669+0000", 2024-04-25T22:53:31.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064082849999999997 2024-04-25T22:53:31.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:31.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024584+0000", 2024-04-25T22:53:31.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019151699999999999 2024-04-25T22:53:31.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.247 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:31.247 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024643+0000", 2024-04-25T22:53:31.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8888999999999998e-05 2024-04-25T22:53:31.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.247 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:31.247 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024687+0000", 2024-04-25T22:53:31.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4444999999999999e-05 2024-04-25T22:53:31.247 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:31.247 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:31.247 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:31.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.248 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:31.248 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:31.248 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.142837383, 2024-04-25T22:53:31.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011249699, 2024-04-25T22:53:31.248 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:31.248 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:31.248 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:31.248 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:31.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.248 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:31.248 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:31.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:31.248 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:31.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:31.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:31.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:31.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013010+0000", 2024-04-25T22:53:31.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2099999999999996e-07 2024-04-25T22:53:31.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:31.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013013+0000", 2024-04-25T22:53:31.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1310000000000002e-06 2024-04-25T22:53:31.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:31.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013020+0000", 2024-04-25T22:53:31.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3330000000000002e-06 2024-04-25T22:53:31.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:31.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013025+0000", 2024-04-25T22:53:31.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6760000000000004e-06 2024-04-25T22:53:31.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:31.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013163+0000", 2024-04-25T22:53:31.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013824599999999999 2024-04-25T22:53:31.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:31.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013504+0000", 2024-04-25T22:53:31.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034080299999999998 2024-04-25T22:53:31.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:31.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013613+0000", 2024-04-25T22:53:31.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108705 2024-04-25T22:53:31.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.252 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:31.252 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015831+0000", 2024-04-25T22:53:31.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002217672 2024-04-25T22:53:31.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.252 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:31.252 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024137+0000", 2024-04-25T22:53:31.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0083060489999999994 2024-04-25T22:53:31.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.252 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:31.252 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024218+0000", 2024-04-25T22:53:31.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1351000000000001e-05 2024-04-25T22:53:31.253 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.253 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.253 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:31.253 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024259+0000", 2024-04-25T22:53:31.253 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1112000000000002e-05 2024-04-25T22:53:31.253 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:31.253 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:31.253 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:31.253 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.253 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.253 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:31.253 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:31.253 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.142749656999996, 2024-04-25T22:53:31.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020379749999999999, 2024-04-25T22:53:31.254 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:31.254 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:31.254 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:31.254 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:31.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:31.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:31.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:31.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:31.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:31.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:31.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:31.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013098+0000", 2024-04-25T22:53:31.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:53:31.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:31.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013105+0000", 2024-04-25T22:53:31.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5969999999999997e-06 2024-04-25T22:53:31.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:31.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013190+0000", 2024-04-25T22:53:31.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5618999999999995e-05 2024-04-25T22:53:31.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.256 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:31.256 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013200+0000", 2024-04-25T22:53:31.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5859999999999994e-06 2024-04-25T22:53:31.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.256 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:31.256 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020265+0000", 2024-04-25T22:53:31.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070653349999999998 2024-04-25T22:53:31.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.256 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:31.257 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020454+0000", 2024-04-25T22:53:31.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189316 2024-04-25T22:53:31.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.257 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:31.257 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020586+0000", 2024-04-25T22:53:31.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013195700000000001 2024-04-25T22:53:31.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.257 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:31.257 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023822+0000", 2024-04-25T22:53:31.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032358529999999999 2024-04-25T22:53:31.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:31.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033409+0000", 2024-04-25T22:53:31.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095870520000000004 2024-04-25T22:53:31.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:31.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033447+0000", 2024-04-25T22:53:31.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7261999999999997e-05 2024-04-25T22:53:31.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:31.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033477+0000", 2024-04-25T22:53:31.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0389e-05 2024-04-25T22:53:31.259 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:31.259 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:31.259 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:31.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.259 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:31.259 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:31.259 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.142633150999998, 2024-04-25T22:53:31.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010857383999999999, 2024-04-25T22:53:31.259 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:31.259 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:31.260 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:31.260 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:31.260 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.260 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:31.260 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:31.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:31.260 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.260 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.260 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:31.260 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:31.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:31.260 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.260 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.261 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:31.261 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:31.261 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:31.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.261 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:31.261 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013218+0000", 2024-04-25T22:53:31.261 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8199999999999998e-06 2024-04-25T22:53:31.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.261 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:31.261 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013226+0000", 2024-04-25T22:53:31.261 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7649999999999993e-06 2024-04-25T22:53:31.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:31.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013259+0000", 2024-04-25T22:53:31.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2727e-05 2024-04-25T22:53:31.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:31.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014809+0000", 2024-04-25T22:53:31.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001550144 2024-04-25T22:53:31.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:31.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014958+0000", 2024-04-25T22:53:31.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014890300000000001 2024-04-25T22:53:31.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:31.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015087+0000", 2024-04-25T22:53:31.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012939200000000001 2024-04-25T22:53:31.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:31.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020212+0000", 2024-04-25T22:53:31.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051248939999999996 2024-04-25T22:53:31.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:31.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023699+0000", 2024-04-25T22:53:31.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034873289999999999 2024-04-25T22:53:31.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:31.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024014+0000", 2024-04-25T22:53:31.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031473999999999999 2024-04-25T22:53:31.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:31.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024071+0000", 2024-04-25T22:53:31.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7040000000000003e-05 2024-04-25T22:53:31.264 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:31.264 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:31.265 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:31.265 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.265 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.265 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:31.265 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:31.265 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.142578446000002, 2024-04-25T22:53:31.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012329677000000001, 2024-04-25T22:53:31.265 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:31.265 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:31.265 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:31.265 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:31.265 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.265 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:31.265 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:31.266 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:31.266 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.266 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.266 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:31.266 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:31.266 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:31.266 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.266 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.266 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:31.266 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013269+0000", 2024-04-25T22:53:31.266 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5000000000000002e-07 2024-04-25T22:53:31.266 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.266 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.266 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:31.267 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:31.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6909999999999999e-06 2024-04-25T22:53:31.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.267 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:31.267 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013284+0000", 2024-04-25T22:53:31.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0963e-05 2024-04-25T22:53:31.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.267 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:31.267 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013361+0000", 2024-04-25T22:53:31.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7379999999999994e-05 2024-04-25T22:53:31.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.268 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.268 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:31.268 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013448+0000", 2024-04-25T22:53:31.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6990000000000006e-05 2024-04-25T22:53:31.268 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.268 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.268 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:31.268 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013632+0000", 2024-04-25T22:53:31.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018396800000000001 2024-04-25T22:53:31.268 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.268 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.268 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:31.268 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013800+0000", 2024-04-25T22:53:31.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167467 2024-04-25T22:53:31.268 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.269 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.269 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:31.269 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.018570+0000", 2024-04-25T22:53:31.269 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047701460000000003 2024-04-25T22:53:31.269 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.269 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.269 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:31.269 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025507+0000", 2024-04-25T22:53:31.269 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069372039999999998 2024-04-25T22:53:31.269 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.269 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.269 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:31.270 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025562+0000", 2024-04-25T22:53:31.270 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4858999999999998e-05 2024-04-25T22:53:31.270 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.270 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.270 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:31.270 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025598+0000", 2024-04-25T22:53:31.270 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6259e-05 2024-04-25T22:53:31.270 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:31.270 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:31.270 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:31.270 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.270 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.270 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:31.271 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:31.271 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.142446573000001, 2024-04-25T22:53:31.271 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020176666999999999, 2024-04-25T22:53:31.271 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:31.271 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:31.271 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:53:31.271 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:31.271 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.271 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:31.271 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:31.271 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:31.271 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.271 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.271 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:31.272 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:31.272 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:31.272 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.272 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.272 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:31.272 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:31.272 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-04-25T22:53:31.272 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.272 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.272 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:31.272 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013405+0000", 2024-04-25T22:53:31.272 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0559999999999998e-06 2024-04-25T22:53:31.272 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.272 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.273 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:31.273 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013422+0000", 2024-04-25T22:53:31.273 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6770999999999999e-05 2024-04-25T22:53:31.273 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.273 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.273 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:31.273 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013431+0000", 2024-04-25T22:53:31.273 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5019999999999998e-06 2024-04-25T22:53:31.273 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.273 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.274 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:31.274 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021720+0000", 2024-04-25T22:53:31.274 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082884340000000008 2024-04-25T22:53:31.274 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.274 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.274 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:31.274 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022122+0000", 2024-04-25T22:53:31.274 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000401634 2024-04-25T22:53:31.274 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.274 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.274 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:31.274 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033577+0000", 2024-04-25T22:53:31.275 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011455435999999999 2024-04-25T22:53:31.275 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:31.275 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:31.275 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:31.275 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:31.275 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:31.275 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:31.277 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:31.277 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:31.275+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:31.377 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:31.376+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:31.396 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:31.397 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:31.397 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-25T22:53:31.397 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:31.407 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:31.478 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:31.477+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:31.557 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:31.557 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:31.557 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-25T22:53:31.557 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-25T22:53:31.557 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:31.566 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:31.610 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:31.609+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:31.678 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:31.678 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:53:31.679 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:53:31.679 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:53:31.679 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.679 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:53:31.679 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:31.679 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 103.70949256, 2024-04-25T22:53:31.679 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:53:31.679 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:31.679 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:31.679 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:31.679 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:31.679 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.679 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:31.680 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:31.680 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:31.680 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.680 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.680 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:31.680 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:31.680 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:31.680 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.680 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.680 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:31.680 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:53:31.680 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:53:31.681 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.681 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.681 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:31.681 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:53:31.681 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:53:31.681 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.681 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.681 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:31.681 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:53:31.681 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:53:31.681 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.681 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.681 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:31.681 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:53:31.682 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:53:31.682 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.682 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.682 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:31.682 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:53:31.682 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:53:31.682 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.682 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.682 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:31.682 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:53:31.682 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:53:31.682 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.682 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.683 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:31.683 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:53:31.683 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:53:31.683 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.683 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.683 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:31.683 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:53:31.683 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:53:31.683 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:31.683 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:31.683 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:31.683 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.683 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.683 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:110 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'72, mlcod=10'68)", 2024-04-25T22:53:31.684 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:31.684 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 103.70885856, 2024-04-25T22:53:31.684 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065316630000000001, 2024-04-25T22:53:31.684 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:31.684 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:31.684 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:31.684 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:31.684 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.684 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:31.684 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:31.684 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:31.684 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.684 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.685 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:31.685 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:31.685 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:31.685 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.685 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.685 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:31.685 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:31.685 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.58e-07 2024-04-25T22:53:31.685 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.685 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.685 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:31.685 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967811+0000", 2024-04-25T22:53:31.686 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.118e-06 2024-04-25T22:53:31.686 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.686 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.686 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:31.686 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967817+0000", 2024-04-25T22:53:31.686 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3709999999999996e-06 2024-04-25T22:53:31.686 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.686 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.686 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:31.686 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967820+0000", 2024-04-25T22:53:31.686 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2210000000000002e-06 2024-04-25T22:53:31.686 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.687 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.687 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:31.687 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967876+0000", 2024-04-25T22:53:31.687 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5507000000000002e-05 2024-04-25T22:53:31.687 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.687 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.687 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:31.687 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967893+0000", 2024-04-25T22:53:31.687 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7812000000000002e-05 2024-04-25T22:53:31.687 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.687 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.687 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:31.687 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974317+0000", 2024-04-25T22:53:31.687 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064237160000000003 2024-04-25T22:53:31.688 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.688 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.688 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:31.688 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:53:31.688 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.156e-05 2024-04-25T22:53:31.688 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:31.688 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:31.688 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:31.688 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.688 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.688 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'68)", 2024-04-25T22:53:31.688 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:31.688 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 103.70844104699999, 2024-04-25T22:53:31.689 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061292279999999996, 2024-04-25T22:53:31.689 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:31.689 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:31.689 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:31.689 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:31.689 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.689 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:31.689 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:31.689 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:31.689 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.689 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.689 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:31.689 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:31.689 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:31.690 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.690 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.690 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:31.690 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:31.690 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6300000000000001e-07 2024-04-25T22:53:31.690 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.690 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.690 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:31.690 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968228+0000", 2024-04-25T22:53:31.690 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6139999999999999e-06 2024-04-25T22:53:31.690 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.690 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.690 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:31.691 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968235+0000", 2024-04-25T22:53:31.691 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7020000000000001e-06 2024-04-25T22:53:31.691 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.691 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.691 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:31.691 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968238+0000", 2024-04-25T22:53:31.691 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0010000000000002e-06 2024-04-25T22:53:31.691 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.691 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.691 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:31.691 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968297+0000", 2024-04-25T22:53:31.691 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8424999999999997e-05 2024-04-25T22:53:31.691 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.691 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.692 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:31.692 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968316+0000", 2024-04-25T22:53:31.692 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8814999999999999e-05 2024-04-25T22:53:31.692 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.692 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.692 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:31.692 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:53:31.692 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060239439999999998 2024-04-25T22:53:31.692 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.692 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.692 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:31.692 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974354+0000", 2024-04-25T22:53:31.692 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4364e-05 2024-04-25T22:53:31.692 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:31.693 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:31.693 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:31.693 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.693 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.693 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:31.693 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:31.693 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 98.664996861000006, 2024-04-25T22:53:31.693 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:53:31.693 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:31.693 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:31.693 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:31.693 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:31.693 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.694 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:31.694 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:31.694 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:31.694 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.694 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.694 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:31.694 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:31.694 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:31.694 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.694 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.694 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:31.694 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:53:31.694 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:53:31.695 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.695 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.695 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:31.695 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:53:31.695 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:53:31.695 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.695 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.695 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:31.695 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:53:31.695 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:53:31.695 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.695 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.695 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:31.695 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:53:31.696 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:53:31.696 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.696 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.696 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:31.696 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:53:31.696 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:53:31.696 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.696 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.696 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:31.696 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:53:31.696 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:53:31.696 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.696 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.696 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:31.697 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:53:31.697 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:53:31.697 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.697 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.697 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:31.697 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:53:31.697 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:53:31.697 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.697 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.697 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:31.697 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:53:31.697 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:53:31.697 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.697 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.698 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:31.698 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:53:31.698 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:53:31.698 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.698 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.698 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:31.698 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:53:31.698 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:53:31.698 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:31.698 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:31.698 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:31.698 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.698 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.699 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:31.699 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:31.699 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 98.664322485, 2024-04-25T22:53:31.699 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:53:31.699 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:31.699 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:31.699 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:31.699 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:31.699 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.699 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:31.699 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:31.699 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:31.699 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.699 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.700 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:31.700 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:31.700 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:31.700 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.700 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.700 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:31.700 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:53:31.700 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:53:31.700 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.700 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.700 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:31.700 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:53:31.700 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:53:31.700 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.701 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.701 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:31.701 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:53:31.701 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:53:31.701 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.701 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.701 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:31.701 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:53:31.701 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:53:31.701 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.701 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.701 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:31.701 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:53:31.701 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:53:31.702 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.702 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.702 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:31.702 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:53:31.702 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:53:31.702 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.702 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.702 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:31.702 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:53:31.702 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:53:31.702 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.702 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.702 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:31.702 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:53:31.703 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:53:31.703 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.703 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.703 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:31.703 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:53:31.703 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:53:31.703 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.703 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.703 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:31.703 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:53:31.703 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:53:31.703 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.703 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.703 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:31.703 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:53:31.704 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:53:31.704 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:31.704 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:31.704 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:31.704 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.704 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.704 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:31.704 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:31.704 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 98.663813273000002, 2024-04-25T22:53:31.705 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:53:31.705 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:31.705 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:31.705 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:31.705 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:31.705 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.705 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:31.705 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:31.705 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:31.705 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.705 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.705 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:31.705 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:31.705 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:31.706 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.706 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.706 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:31.706 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:53:31.706 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:53:31.706 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.706 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.706 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:31.706 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:53:31.706 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:53:31.706 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.706 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.706 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:31.707 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:53:31.707 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:53:31.707 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.707 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.707 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:31.707 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:53:31.707 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:53:31.707 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.707 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.707 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:31.707 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:53:31.707 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:53:31.707 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.708 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.708 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:31.708 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:53:31.708 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:53:31.708 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.708 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.708 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:31.708 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:53:31.708 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:53:31.708 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.708 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.708 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:31.709 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:53:31.709 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:53:31.709 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.709 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.709 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:31.709 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:53:31.709 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:53:31.709 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.709 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.709 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:31.709 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:53:31.709 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:53:31.709 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.710 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.710 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:31.710 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:53:31.710 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:53:31.710 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:31.710 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:31.710 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:31.710 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.710 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.710 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:31.710 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:31.710 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 98.663400074999998, 2024-04-25T22:53:31.710 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:53:31.711 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:31.711 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:31.711 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:31.711 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:31.711 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.711 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:31.711 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:31.711 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:31.711 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.711 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.711 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:31.711 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:31.712 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:31.712 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.712 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.712 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:31.712 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:31.712 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:53:31.712 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.712 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.712 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:31.712 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:31.712 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:53:31.713 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.713 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.713 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:31.713 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:53:31.713 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:53:31.713 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.713 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.713 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:31.713 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:53:31.713 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:53:31.713 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.713 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.713 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:31.713 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:53:31.713 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:53:31.714 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.714 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.714 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:31.714 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:53:31.714 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:53:31.714 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.714 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.714 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:31.714 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:53:31.714 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:53:31.714 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.714 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.714 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:31.714 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:53:31.715 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:53:31.715 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.715 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.715 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:31.715 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:53:31.715 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:53:31.715 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.715 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.715 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:31.715 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:53:31.715 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:53:31.715 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.715 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.715 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:31.715 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:53:31.716 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:53:31.716 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:31.716 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:31.716 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:31.716 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.716 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.716 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:31.716 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:31.716 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 98.663349405000005, 2024-04-25T22:53:31.716 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:53:31.716 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:31.716 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:31.716 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:31.717 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:31.717 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.717 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:31.717 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:31.717 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:31.717 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.717 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.717 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:31.717 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:31.717 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:31.717 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.717 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.717 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:31.717 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:53:31.717 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:53:31.718 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.718 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.718 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:31.718 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:53:31.718 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:53:31.718 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.718 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.718 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:31.718 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:53:31.718 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:53:31.718 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.718 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.718 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:31.719 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:53:31.719 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:53:31.719 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.719 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.719 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:31.719 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:53:31.719 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:53:31.719 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.719 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.719 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:31.719 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:53:31.719 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:53:31.719 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.719 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.720 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:31.720 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:53:31.720 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:53:31.720 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.720 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.720 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:31.720 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:53:31.720 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:53:31.720 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.720 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.720 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:31.720 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:53:31.720 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:53:31.721 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.721 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.721 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:31.721 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:53:31.721 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:53:31.721 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.721 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.721 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:31.721 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:53:31.721 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:53:31.721 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.721 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.721 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:31.722 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:53:31.722 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:53:31.722 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.722 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.722 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:31.722 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:53:31.722 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:53:31.722 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:31.722 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:31.722 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:31.723 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.723 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.723 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:31.723 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:31.723 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 98.663312536000007, 2024-04-25T22:53:31.723 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:53:31.723 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:31.723 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:31.723 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:31.723 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:31.723 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.723 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:31.723 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:31.723 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:31.724 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.724 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.724 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:31.724 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:31.724 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:31.724 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.724 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.724 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:31.724 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:53:31.724 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:53:31.724 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.724 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.724 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:31.725 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:53:31.725 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:53:31.725 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.725 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.725 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:31.725 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:53:31.725 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:53:31.725 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.725 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.725 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:31.725 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:53:31.725 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:53:31.725 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.725 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.726 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:31.726 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:53:31.726 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:53:31.726 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.726 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.726 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:53:31.726 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:53:31.726 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:53:31.726 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.726 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.726 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:31.727 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:53:31.727 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:53:31.727 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.727 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.727 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:31.727 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:53:31.727 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:53:31.727 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.727 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.727 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:31.727 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:53:31.727 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:53:31.727 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.727 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.728 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:31.728 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:53:31.728 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:53:31.728 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.728 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.728 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:31.728 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:53:31.728 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:53:31.728 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.728 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.728 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:31.728 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:53:31.728 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:53:31.729 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.729 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.729 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:31.729 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:53:31.729 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:53:31.729 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:31.729 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:31.729 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:31.729 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.729 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.729 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:31.729 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:31.729 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 98.663287569999994, 2024-04-25T22:53:31.729 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:53:31.730 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:31.730 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:31.730 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:31.730 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:31.730 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.730 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:31.730 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:31.730 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:31.730 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.730 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.730 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:31.730 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:31.730 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:31.731 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.731 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.731 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:31.731 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:53:31.731 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:53:31.731 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.731 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.731 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:31.731 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:53:31.731 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:53:31.731 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.731 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.731 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:31.732 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:31.732 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:53:31.732 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.732 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.732 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:31.732 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:53:31.732 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:53:31.732 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.732 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.732 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:31.732 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:53:31.732 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:53:31.732 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.733 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.733 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:31.733 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:53:31.733 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:53:31.733 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.733 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.733 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:31.733 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:53:31.733 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:53:31.733 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.733 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.733 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:31.734 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:53:31.734 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:53:31.734 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.734 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.734 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:31.734 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:53:31.734 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:53:31.734 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.734 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.734 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:31.734 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:53:31.734 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:53:31.734 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.734 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.735 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:31.735 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:53:31.735 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:53:31.735 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:31.735 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:31.735 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:31.735 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.735 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.735 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:31.735 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:31.735 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 98.663251205999998, 2024-04-25T22:53:31.735 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:53:31.735 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:31.736 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:31.736 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:31.736 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:31.736 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.736 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:31.736 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:31.736 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:31.736 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.736 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.736 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:31.736 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:31.736 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:31.736 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.736 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.737 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:31.737 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:53:31.737 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:53:31.737 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.737 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.737 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:31.737 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:53:31.737 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:53:31.737 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.737 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.737 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:31.738 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:53:31.738 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:53:31.738 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.738 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.738 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:31.738 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:53:31.738 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:53:31.738 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.738 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.738 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:31.738 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:53:31.738 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:53:31.739 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.739 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.739 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:31.739 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:53:31.739 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:53:31.739 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.739 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.739 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:31.739 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:53:31.739 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:53:31.739 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.740 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.740 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:31.740 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:53:31.740 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:53:31.740 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.740 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.740 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:31.740 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:53:31.740 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:53:31.740 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:31.740 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:31.740 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:31.740 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.740 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.740 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:31.741 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:31.741 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 98.663220124999995, 2024-04-25T22:53:31.741 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:53:31.741 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:31.741 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:31.741 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:31.741 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:31.741 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.741 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:31.741 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:31.741 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:31.741 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.741 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.742 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:31.742 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:31.742 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:31.742 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.742 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.742 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:31.742 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:31.742 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:31.742 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.742 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.742 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:31.742 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:53:31.742 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:53:31.743 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.743 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.743 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:31.743 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:53:31.743 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:53:31.743 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.743 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.743 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:31.743 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:53:31.743 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:53:31.743 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.743 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.743 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:31.743 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:53:31.743 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:53:31.744 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.744 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.744 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:31.744 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:53:31.744 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:53:31.744 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.744 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.744 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:31.744 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:53:31.744 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:53:31.744 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:31.744 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:31.744 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:31.744 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.744 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.745 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:53:31.745 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:31.745 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 98.662779155999999, 2024-04-25T22:53:31.745 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064881979999999997, 2024-04-25T22:53:31.745 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:31.745 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:31.745 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:31.745 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:31.745 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.745 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:31.745 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:31.745 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:31.745 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.746 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.746 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:31.746 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:31.746 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:31.746 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.746 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.746 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:31.746 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:31.746 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2699999999999999e-07 2024-04-25T22:53:31.746 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.746 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.746 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:31.746 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013898+0000", 2024-04-25T22:53:31.746 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0796e-05 2024-04-25T22:53:31.747 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.747 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.747 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:31.747 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013907+0000", 2024-04-25T22:53:31.747 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5140000000000007e-06 2024-04-25T22:53:31.747 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.747 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.747 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:31.747 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013952+0000", 2024-04-25T22:53:31.747 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4134000000000001e-05 2024-04-25T22:53:31.747 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.747 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.747 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:31.747 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016812+0000", 2024-04-25T22:53:31.748 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028601059999999998 2024-04-25T22:53:31.748 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.748 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.748 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:31.748 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.017052+0000", 2024-04-25T22:53:31.748 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024056500000000001 2024-04-25T22:53:31.748 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.748 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.748 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:31.748 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020350+0000", 2024-04-25T22:53:31.748 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032978320000000001 2024-04-25T22:53:31.748 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.748 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.748 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:31.749 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020375+0000", 2024-04-25T22:53:31.749 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4624e-05 2024-04-25T22:53:31.749 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:31.749 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:31.749 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:31.749 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.749 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.749 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:30 4.31 4:8ebfc112:::1000000021d.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-25T22:53:31.749 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:53:31.749 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.62353425500000004, 2024-04-25T22:53:31.749 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015003005, 2024-04-25T22:53:31.749 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:31.749 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:31.749 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:31.750 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:31.750 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:31.750 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:31.750 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 30 2024-04-25T22:53:31.750 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.750 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:31.750 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.750 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:31.750 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:53:31.750 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:31.750 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.750 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.750 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:31.751 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:53:31.751 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:31.751 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.751 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.751 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:31.751 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053133+0000", 2024-04-25T22:53:31.751 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0370000000000001e-06 2024-04-25T22:53:31.751 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.751 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.751 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:31.751 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060377+0000", 2024-04-25T22:53:31.751 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0072431070000000004 2024-04-25T22:53:31.752 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.752 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.752 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:31.752 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060388+0000", 2024-04-25T22:53:31.752 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1285e-05 2024-04-25T22:53:31.752 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.752 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.752 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:31.752 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060394+0000", 2024-04-25T22:53:31.752 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1040000000000003e-06 2024-04-25T22:53:31.752 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.752 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.752 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:31.752 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060483+0000", 2024-04-25T22:53:31.753 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.9345000000000006e-05 2024-04-25T22:53:31.753 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.753 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.753 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:31.753 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060566+0000", 2024-04-25T22:53:31.753 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2237999999999994e-05 2024-04-25T22:53:31.753 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.753 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.753 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:31.753 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068057+0000", 2024-04-25T22:53:31.753 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074912210000000002 2024-04-25T22:53:31.753 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.753 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.754 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:31.754 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068090+0000", 2024-04-25T22:53:31.754 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3501000000000003e-05 2024-04-25T22:53:31.754 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.754 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.754 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:31.754 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068134+0000", 2024-04-25T22:53:31.754 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4166999999999999e-05 2024-04-25T22:53:31.754 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:31.754 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:31.754 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:31.754 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.754 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.754 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:66 4.27 4:e5671758:::1000000024f.00000000:head [write 0~6641] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:31.755 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:31.755 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.36342391899999998, 2024-04-25T22:53:31.755 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075166540000000002, 2024-04-25T22:53:31.755 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:31.755 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:31.755 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:31.755 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:31.755 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:31.755 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:31.755 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 66 2024-04-25T22:53:31.755 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.755 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:31.755 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.755 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:31.756 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:31.756 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:31.756 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.756 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.756 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:31.756 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:31.756 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:31.756 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.756 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.756 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:31.756 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:31.756 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4099999999999998e-07 2024-04-25T22:53:31.756 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.756 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.756 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:31.757 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313252+0000", 2024-04-25T22:53:31.757 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5380000000000008e-06 2024-04-25T22:53:31.757 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.757 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.757 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:31.757 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313260+0000", 2024-04-25T22:53:31.757 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2609999999999993e-06 2024-04-25T22:53:31.757 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.757 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.757 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:31.757 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313265+0000", 2024-04-25T22:53:31.757 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4850000000000003e-06 2024-04-25T22:53:31.757 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.758 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.758 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:31.758 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313310+0000", 2024-04-25T22:53:31.758 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5247999999999998e-05 2024-04-25T22:53:31.758 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.758 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.758 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:31.758 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313370+0000", 2024-04-25T22:53:31.758 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0275000000000001e-05 2024-04-25T22:53:31.758 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.758 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.758 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:31.759 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313435+0000", 2024-04-25T22:53:31.759 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4647000000000006e-05 2024-04-25T22:53:31.759 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.759 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.759 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:31.759 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314174+0000", 2024-04-25T22:53:31.759 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00073925 2024-04-25T22:53:31.759 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.759 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.759 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:31.759 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320688+0000", 2024-04-25T22:53:31.759 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.006513418 2024-04-25T22:53:31.759 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.760 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.760 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:31.760 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320736+0000", 2024-04-25T22:53:31.760 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.8114e-05 2024-04-25T22:53:31.760 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.760 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.760 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:31.760 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320758+0000", 2024-04-25T22:53:31.760 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2776999999999999e-05 2024-04-25T22:53:31.760 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:31.760 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:31.760 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:31.760 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.760 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.761 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:68 4.31 4:8fb7f7b7:::10000000251.00000000:head [write 0~2067] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:31.761 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:31.761 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.36173814100000001, 2024-04-25T22:53:31.761 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0087011669999999992, 2024-04-25T22:53:31.761 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:31.761 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:31.761 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:31.761 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:31.761 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:31.761 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:31.761 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 68 2024-04-25T22:53:31.761 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.762 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:31.762 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.762 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:31.762 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:31.762 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:31.762 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.762 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.762 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:31.762 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:31.762 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:31.762 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.762 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.762 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:31.763 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:31.763 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:53:31.763 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.763 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.763 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:31.763 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314933+0000", 2024-04-25T22:53:31.763 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5430000000000004e-06 2024-04-25T22:53:31.763 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.763 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.763 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:31.763 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314944+0000", 2024-04-25T22:53:31.763 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.076e-05 2024-04-25T22:53:31.763 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.763 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.764 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:31.764 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314949+0000", 2024-04-25T22:53:31.764 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1019999999999996e-06 2024-04-25T22:53:31.764 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.764 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.764 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:31.764 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314996+0000", 2024-04-25T22:53:31.764 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7018999999999998e-05 2024-04-25T22:53:31.764 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.764 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.764 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:31.764 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315064+0000", 2024-04-25T22:53:31.764 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8738000000000005e-05 2024-04-25T22:53:31.764 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.765 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.765 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:31.765 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323531+0000", 2024-04-25T22:53:31.765 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084664739999999999 2024-04-25T22:53:31.765 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.765 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.765 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:31.765 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323574+0000", 2024-04-25T22:53:31.765 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3449999999999999e-05 2024-04-25T22:53:31.765 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.765 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.765 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:31.765 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323629+0000", 2024-04-25T22:53:31.765 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4296999999999999e-05 2024-04-25T22:53:31.766 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:31.766 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:31.766 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:31.766 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.766 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.766 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4734.0:69 4.32 e46/13 4:4e8c6251:::10000000252.00000000:head v 46'1, mlcod=0'0)", 2024-04-25T22:53:31.766 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:31.766 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.36070687299999998, 2024-04-25T22:53:31.766 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076063240000000002, 2024-04-25T22:53:31.766 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:31.766 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:31.766 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:31.766 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:31.767 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.767 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:31.767 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:31.767 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:31.767 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.767 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.767 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:31.767 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:31.767 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:31.767 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.767 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.767 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:31.767 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:31.767 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3099999999999997e-07 2024-04-25T22:53:31.767 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.768 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.768 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:31.768 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315964+0000", 2024-04-25T22:53:31.768 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3229999999999999e-06 2024-04-25T22:53:31.768 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.768 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.768 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:31.768 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315973+0000", 2024-04-25T22:53:31.768 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7249999999999992e-06 2024-04-25T22:53:31.768 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.768 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.768 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:31.769 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315978+0000", 2024-04-25T22:53:31.769 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4830000000000001e-06 2024-04-25T22:53:31.769 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.769 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.769 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:31.769 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.316043+0000", 2024-04-25T22:53:31.769 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.5036000000000005e-05 2024-04-25T22:53:31.769 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.769 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.769 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:31.769 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.316055+0000", 2024-04-25T22:53:31.769 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1973999999999999e-05 2024-04-25T22:53:31.769 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.769 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.770 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:31.770 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323521+0000", 2024-04-25T22:53:31.770 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074660239999999999 2024-04-25T22:53:31.770 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.770 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.770 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:31.770 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323565+0000", 2024-04-25T22:53:31.770 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4128000000000002e-05 2024-04-25T22:53:31.770 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:31.770 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:31.770 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:31.770 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.771 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.771 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4734.0:71 4.5 e46/13 4:a3a50212:::10000000254.00000000:head v 46'4, mlcod=45'2)", 2024-04-25T22:53:31.771 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.317569+0000", 2024-04-25T22:53:31.771 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.35909709400000001, 2024-04-25T22:53:31.771 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00602572, 2024-04-25T22:53:31.771 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:31.771 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:31.771 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:31.771 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:31.771 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.771 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:31.771 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.317569+0000", 2024-04-25T22:53:31.772 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:31.772 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.772 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.772 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:31.772 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.317569+0000", 2024-04-25T22:53:31.772 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:31.772 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.772 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.772 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:31.772 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.317569+0000", 2024-04-25T22:53:31.772 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4799999999999998e-07 2024-04-25T22:53:31.772 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.772 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.772 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:31.772 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.317586+0000", 2024-04-25T22:53:31.773 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6452000000000001e-05 2024-04-25T22:53:31.773 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.773 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.773 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:31.773 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.317595+0000", 2024-04-25T22:53:31.773 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.8050000000000001e-06 2024-04-25T22:53:31.773 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.773 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.773 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:31.773 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.317600+0000", 2024-04-25T22:53:31.773 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.8590000000000004e-06 2024-04-25T22:53:31.773 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.773 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.773 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:31.774 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.317639+0000", 2024-04-25T22:53:31.774 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8260000000000003e-05 2024-04-25T22:53:31.774 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.774 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.774 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:31.774 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.317653+0000", 2024-04-25T22:53:31.774 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4204e-05 2024-04-25T22:53:31.774 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.774 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.774 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:31.774 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323563+0000", 2024-04-25T22:53:31.774 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0059098939999999997 2024-04-25T22:53:31.774 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.774 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.775 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:31.775 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323594+0000", 2024-04-25T22:53:31.775 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1597999999999998e-05 2024-04-25T22:53:31.775 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:31.775 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:31.775 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:31.775 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.775 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.775 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:72 4.36 4:6cdfec98:::10000000255.00000000:head [write 0~4131] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:31.775 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:31.775 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.358662961, 2024-04-25T22:53:31.775 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084820680000000006, 2024-04-25T22:53:31.775 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:31.775 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:31.775 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:31.775 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:31.776 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:31.776 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:31.776 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 72 2024-04-25T22:53:31.776 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.776 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:31.776 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.776 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:31.776 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:31.776 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:31.776 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.776 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.776 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:31.776 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:31.776 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:31.777 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.777 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.777 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:31.777 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:31.777 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1800000000000005e-07 2024-04-25T22:53:31.777 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.777 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.777 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:31.777 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318010+0000", 2024-04-25T22:53:31.777 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7399999999999998e-06 2024-04-25T22:53:31.777 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.777 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.777 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:31.777 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318019+0000", 2024-04-25T22:53:31.778 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0170000000000002e-06 2024-04-25T22:53:31.778 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.778 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.778 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:31.778 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318024+0000", 2024-04-25T22:53:31.778 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0150000000000003e-06 2024-04-25T22:53:31.778 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.778 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.778 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:31.778 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318075+0000", 2024-04-25T22:53:31.778 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0537000000000001e-05 2024-04-25T22:53:31.778 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.778 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.778 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:31.779 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318144+0000", 2024-04-25T22:53:31.779 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9432999999999997e-05 2024-04-25T22:53:31.779 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.779 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.779 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:31.779 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326392+0000", 2024-04-25T22:53:31.779 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0082482979999999994 2024-04-25T22:53:31.779 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.779 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.779 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:31.779 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326432+0000", 2024-04-25T22:53:31.779 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9870000000000003e-05 2024-04-25T22:53:31.779 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.780 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.780 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:31.780 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326485+0000", 2024-04-25T22:53:31.780 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2439999999999999e-05 2024-04-25T22:53:31.780 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:31.780 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:31.780 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:31.780 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.780 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.780 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:74 4.10 4:08e6f8ca:::10000000257.00000000:head [write 0~839] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:31.780 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:53:31.780 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.35718923299999999, 2024-04-25T22:53:31.780 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070370720000000001, 2024-04-25T22:53:31.780 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:31.781 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:31.781 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:31.781 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:31.781 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:31.781 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:31.781 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 74 2024-04-25T22:53:31.781 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.781 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:31.781 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.781 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:31.781 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:53:31.781 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:31.782 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.782 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.782 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:31.782 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:53:31.782 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:31.782 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.782 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.782 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:31.782 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319477+0000", 2024-04-25T22:53:31.782 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1999999999999999e-07 2024-04-25T22:53:31.782 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.782 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.782 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:31.782 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319483+0000", 2024-04-25T22:53:31.783 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4260000000000002e-06 2024-04-25T22:53:31.783 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.783 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.783 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:31.783 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319494+0000", 2024-04-25T22:53:31.783 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.094e-05 2024-04-25T22:53:31.783 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.783 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.783 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:31.783 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319499+0000", 2024-04-25T22:53:31.783 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3789999999999997e-06 2024-04-25T22:53:31.783 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.783 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.783 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:31.784 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319545+0000", 2024-04-25T22:53:31.784 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6149000000000001e-05 2024-04-25T22:53:31.784 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.784 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.784 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:31.784 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319617+0000", 2024-04-25T22:53:31.784 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1792999999999995e-05 2024-04-25T22:53:31.784 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.784 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.784 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:31.784 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326406+0000", 2024-04-25T22:53:31.784 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067895999999999998 2024-04-25T22:53:31.785 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.785 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.785 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:31.785 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326443+0000", 2024-04-25T22:53:31.785 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6828e-05 2024-04-25T22:53:31.785 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:31.785 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:31.785 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:31.785 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326514+0000", 2024-04-25T22:53:31.785 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0236999999999999e-05 2024-04-25T22:53:31.785 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:31.785 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:31.785 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:31.785 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:31.786 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:31.786 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:31.787 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:31.786+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:31.788 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:31.888 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:31.887+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:31.896 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:31.896 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:53:31.896 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.896 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4734.0:730 4.2a e46/13 4:55de28ea:::100000004f5.00000000:head v 46'14, mlcod=46'12)", 2024-04-25T22:53:31.896 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:53:31.895840+0000", 2024-04-25T22:53:31.896 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00021606800000000001, 2024-04-25T22:53:31.896 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00023052399999999999, 2024-04-25T22:53:31.896 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:31.896 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:31.896 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:53:31.897 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:31.897 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.897 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:31.897 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.895840+0000", 2024-04-25T22:53:31.897 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:31.897 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.897 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.897 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:31.897 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.895840+0000", 2024-04-25T22:53:31.897 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:31.897 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.897 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.897 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:31.897 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.895840+0000", 2024-04-25T22:53:31.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-04-25T22:53:31.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.898 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:31.898 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.895844+0000", 2024-04-25T22:53:31.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6849999999999999e-06 2024-04-25T22:53:31.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.898 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:31.898 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.895851+0000", 2024-04-25T22:53:31.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6930000000000001e-06 2024-04-25T22:53:31.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.899 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:31.899 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.895856+0000", 2024-04-25T22:53:31.899 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9869999999999999e-06 2024-04-25T22:53:31.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.900 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:31.900 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.895887+0000", 2024-04-25T22:53:31.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1163e-05 2024-04-25T22:53:31.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:31.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:31.900 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:31.900 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.895899+0000", 2024-04-25T22:53:31.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1827999999999999e-05 2024-04-25T22:53:31.900 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:31.900 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:31.900 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:31.901 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:31.901 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-04-25T22:53:31.901 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 1 2024-04-25T22:53:31.901 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:31.905 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:31.989 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:31.988+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:32.015 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:32.015 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:32.015 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:53:32.015 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:53:32.015 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:32.024 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:32.108 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:32.108+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:32.175 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:32.175 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-04-25T22:53:32.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-04-25T22:53:32.175 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:53:32.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.175 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:32.175 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:32.176 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 104.208163502, 2024-04-25T22:53:32.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0103421, 2024-04-25T22:53:32.176 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:32.176 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:32.176 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:32.176 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:32.176 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:32.176 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:32.176 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 115 2024-04-25T22:53:32.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.176 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:32.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:32.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:32.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:32.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:32.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:32.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:32.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:32.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965038+0000", 2024-04-25T22:53:32.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9500000000000002e-07 2024-04-25T22:53:32.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:32.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965108+0000", 2024-04-25T22:53:32.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9177999999999994e-05 2024-04-25T22:53:32.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:32.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965127+0000", 2024-04-25T22:53:32.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8868e-05 2024-04-25T22:53:32.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:32.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965133+0000", 2024-04-25T22:53:32.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8929999999999999e-06 2024-04-25T22:53:32.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:32.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.969991+0000", 2024-04-25T22:53:32.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048573849999999997 2024-04-25T22:53:32.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:32.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970072+0000", 2024-04-25T22:53:32.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0728000000000004e-05 2024-04-25T22:53:32.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:32.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970189+0000", 2024-04-25T22:53:32.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000117778 2024-04-25T22:53:32.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:32.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970946+0000", 2024-04-25T22:53:32.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00075704600000000004 2024-04-25T22:53:32.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:32.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975297+0000", 2024-04-25T22:53:32.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004350217 2024-04-25T22:53:32.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:32.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975343+0000", 2024-04-25T22:53:32.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6687999999999998e-05 2024-04-25T22:53:32.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:32.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975380+0000", 2024-04-25T22:53:32.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6724000000000003e-05 2024-04-25T22:53:32.181 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:32.181 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:32.181 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:32.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.182 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:32.182 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:32.182 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 104.20802288900001, 2024-04-25T22:53:32.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010384338999999999, 2024-04-25T22:53:32.182 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:32.182 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:32.182 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:32.182 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:32.183 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:32.183 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:32.183 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-04-25T22:53:32.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.183 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:32.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:32.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:32.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:32.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:32.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:32.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:32.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:32.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:32.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3600000000000004e-07 2024-04-25T22:53:32.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:32.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965185+0000", 2024-04-25T22:53:32.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.117e-06 2024-04-25T22:53:32.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:32.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965192+0000", 2024-04-25T22:53:32.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3239999999999997e-06 2024-04-25T22:53:32.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:32.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965198+0000", 2024-04-25T22:53:32.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6370000000000004e-06 2024-04-25T22:53:32.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:32.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970973+0000", 2024-04-25T22:53:32.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057748239999999996 2024-04-25T22:53:32.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:32.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971049+0000", 2024-04-25T22:53:32.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6029e-05 2024-04-25T22:53:32.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:32.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971174+0000", 2024-04-25T22:53:32.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012462399999999999 2024-04-25T22:53:32.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:32.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971553+0000", 2024-04-25T22:53:32.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037896499999999999 2024-04-25T22:53:32.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:32.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975482+0000", 2024-04-25T22:53:32.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039297459999999996 2024-04-25T22:53:32.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:32.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975529+0000", 2024-04-25T22:53:32.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6387000000000002e-05 2024-04-25T22:53:32.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:32.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975563+0000", 2024-04-25T22:53:32.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4150000000000003e-05 2024-04-25T22:53:32.188 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:32.188 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:32.188 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:32.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.188 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:32.188 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:32.188 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 99.160976566000002, 2024-04-25T22:53:32.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012637705000000001, 2024-04-25T22:53:32.188 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:32.189 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:32.189 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:32.189 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:32.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:32.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:32.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:32.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:32.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:32.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:32.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:32.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012227+0000", 2024-04-25T22:53:32.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.863e-06 2024-04-25T22:53:32.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:32.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012236+0000", 2024-04-25T22:53:32.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1109999999999997e-06 2024-04-25T22:53:32.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:32.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012309+0000", 2024-04-25T22:53:32.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3242000000000001e-05 2024-04-25T22:53:32.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:32.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012324+0000", 2024-04-25T22:53:32.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4837e-05 2024-04-25T22:53:32.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:32.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015060+0000", 2024-04-25T22:53:32.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027363349999999999 2024-04-25T22:53:32.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:32.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015169+0000", 2024-04-25T22:53:32.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108372 2024-04-25T22:53:32.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:32.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015498+0000", 2024-04-25T22:53:32.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032949999999999999 2024-04-25T22:53:32.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:32.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021282+0000", 2024-04-25T22:53:32.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057836429999999998 2024-04-25T22:53:32.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.193 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:32.193 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024709+0000", 2024-04-25T22:53:32.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034271979999999998 2024-04-25T22:53:32.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.193 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:32.193 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024802+0000", 2024-04-25T22:53:32.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2960000000000004e-05 2024-04-25T22:53:32.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.193 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:32.193 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024863+0000", 2024-04-25T22:53:32.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0643999999999997e-05 2024-04-25T22:53:32.193 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:32.194 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:32.194 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:32.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.194 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:32.194 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:32.194 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 99.160852794999997, 2024-04-25T22:53:32.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012979447999999999, 2024-04-25T22:53:32.194 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:32.194 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:32.194 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:32.194 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:32.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:32.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:32.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:32.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:32.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:32.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:32.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:32.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:32.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:53:32.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:32.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012354+0000", 2024-04-25T22:53:32.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7740000000000004e-06 2024-04-25T22:53:32.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:32.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012365+0000", 2024-04-25T22:53:32.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.064e-05 2024-04-25T22:53:32.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:32.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012382+0000", 2024-04-25T22:53:32.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6999000000000001e-05 2024-04-25T22:53:32.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:32.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015958+0000", 2024-04-25T22:53:32.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035765699999999998 2024-04-25T22:53:32.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:32.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016037+0000", 2024-04-25T22:53:32.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8242000000000001e-05 2024-04-25T22:53:32.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:32.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016404+0000", 2024-04-25T22:53:32.198 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036784300000000002 2024-04-25T22:53:32.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.198 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:32.198 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021294+0000", 2024-04-25T22:53:32.198 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048890629999999999 2024-04-25T22:53:32.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.198 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:32.198 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024959+0000", 2024-04-25T22:53:32.198 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036651570000000001 2024-04-25T22:53:32.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.198 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:32.199 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025097+0000", 2024-04-25T22:53:32.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013788099999999999 2024-04-25T22:53:32.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:32.199 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025328+0000", 2024-04-25T22:53:32.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231492 2024-04-25T22:53:32.199 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:32.199 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:32.199 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:32.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.199 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:32.199 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:32.200 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 99.160765026000007, 2024-04-25T22:53:32.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013049827, 2024-04-25T22:53:32.200 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:32.200 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:32.200 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:32.200 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:32.200 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.200 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:32.200 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:32.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:32.200 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.200 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.200 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:32.200 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:32.201 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:32.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:32.201 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012437+0000", 2024-04-25T22:53:32.201 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-04-25T22:53:32.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:32.201 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012440+0000", 2024-04-25T22:53:32.201 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7609999999999999e-06 2024-04-25T22:53:32.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:32.202 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012449+0000", 2024-04-25T22:53:32.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.285e-06 2024-04-25T22:53:32.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.202 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.202 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:32.202 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012457+0000", 2024-04-25T22:53:32.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9510000000000006e-06 2024-04-25T22:53:32.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.202 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.202 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:32.202 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017106+0000", 2024-04-25T22:53:32.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046494220000000003 2024-04-25T22:53:32.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:32.203 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017223+0000", 2024-04-25T22:53:32.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116824 2024-04-25T22:53:32.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:32.203 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017345+0000", 2024-04-25T22:53:32.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122175 2024-04-25T22:53:32.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:32.203 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021299+0000", 2024-04-25T22:53:32.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039534879999999998 2024-04-25T22:53:32.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:32.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025398+0000", 2024-04-25T22:53:32.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040988960000000003 2024-04-25T22:53:32.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:32.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025439+0000", 2024-04-25T22:53:32.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0915999999999999e-05 2024-04-25T22:53:32.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:32.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025486+0000", 2024-04-25T22:53:32.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7534999999999998e-05 2024-04-25T22:53:32.205 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:32.205 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:32.205 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:32.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.205 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:32.205 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:32.205 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 99.160734875000003, 2024-04-25T22:53:32.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020988041999999998, 2024-04-25T22:53:32.205 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:32.205 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:32.205 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:32.205 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:32.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:32.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:32.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:32.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:32.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:32.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:32.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:32.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:32.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.99e-07 2024-04-25T22:53:32.207 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.207 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:32.207 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012470+0000", 2024-04-25T22:53:32.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2789999999999999e-06 2024-04-25T22:53:32.207 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.207 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:32.207 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012477+0000", 2024-04-25T22:53:32.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:53:32.207 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.207 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:32.207 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012500+0000", 2024-04-25T22:53:32.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2490999999999999e-05 2024-04-25T22:53:32.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:32.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021911+0000", 2024-04-25T22:53:32.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094114160000000006 2024-04-25T22:53:32.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:32.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022000+0000", 2024-04-25T22:53:32.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8601000000000001e-05 2024-04-25T22:53:32.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:32.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022359+0000", 2024-04-25T22:53:32.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035921999999999999 2024-04-25T22:53:32.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:32.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025541+0000", 2024-04-25T22:53:32.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031820619999999998 2024-04-25T22:53:32.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:32.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033375+0000", 2024-04-25T22:53:32.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078338379999999992 2024-04-25T22:53:32.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:32.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033415+0000", 2024-04-25T22:53:32.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9527000000000003e-05 2024-04-25T22:53:32.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:32.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033455+0000", 2024-04-25T22:53:32.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9932000000000003e-05 2024-04-25T22:53:32.210 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:32.210 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:32.210 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:32.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.211 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:32.211 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:32.211 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 99.160679681999994, 2024-04-25T22:53:32.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021043857999999999, 2024-04-25T22:53:32.211 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:32.211 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:32.211 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:32.211 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:32.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:32.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:32.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:32.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:32.212 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:32.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:32.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:32.212 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012523+0000", 2024-04-25T22:53:32.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.361e-06 2024-04-25T22:53:32.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:32.212 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012530+0000", 2024-04-25T22:53:32.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5440000000000004e-06 2024-04-25T22:53:32.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.213 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:32.213 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012541+0000", 2024-04-25T22:53:32.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1745e-05 2024-04-25T22:53:32.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.213 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:32.213 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012551+0000", 2024-04-25T22:53:32.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5789999999999993e-06 2024-04-25T22:53:32.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.213 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:32.213 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022709+0000", 2024-04-25T22:53:32.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010157685 2024-04-25T22:53:32.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:32.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022957+0000", 2024-04-25T22:53:32.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024824599999999998 2024-04-25T22:53:32.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:32.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023443+0000", 2024-04-25T22:53:32.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048578599999999999 2024-04-25T22:53:32.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:32.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025547+0000", 2024-04-25T22:53:32.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021044789999999998 2024-04-25T22:53:32.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:32.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033509+0000", 2024-04-25T22:53:32.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0079622180000000001 2024-04-25T22:53:32.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:32.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033542+0000", 2024-04-25T22:53:32.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3018000000000001e-05 2024-04-25T22:53:32.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.216 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:32.216 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033566+0000", 2024-04-25T22:53:32.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3197000000000002e-05 2024-04-25T22:53:32.216 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:32.216 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:32.216 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:32.216 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.216 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:32.216 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:32.216 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 99.160639716999995, 2024-04-25T22:53:32.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021122696, 2024-04-25T22:53:32.216 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:32.217 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:32.217 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:32.217 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:32.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:32.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:32.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:32.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:32.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:32.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:32.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:32.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:32.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:53:32.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:32.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012566+0000", 2024-04-25T22:53:32.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-04-25T22:53:32.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:32.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012619+0000", 2024-04-25T22:53:32.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2607e-05 2024-04-25T22:53:32.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:32.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012628+0000", 2024-04-25T22:53:32.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6500000000000008e-06 2024-04-25T22:53:32.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:32.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024024+0000", 2024-04-25T22:53:32.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011396007999999999 2024-04-25T22:53:32.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:32.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024198+0000", 2024-04-25T22:53:32.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000173215 2024-04-25T22:53:32.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:32.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024447+0000", 2024-04-25T22:53:32.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024898500000000002 2024-04-25T22:53:32.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:32.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026431+0000", 2024-04-25T22:53:32.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001984923 2024-04-25T22:53:32.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:32.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033608+0000", 2024-04-25T22:53:32.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071768459999999997 2024-04-25T22:53:32.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:32.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033646+0000", 2024-04-25T22:53:32.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299000000000003e-05 2024-04-25T22:53:32.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:32.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033684+0000", 2024-04-25T22:53:32.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8773000000000003e-05 2024-04-25T22:53:32.221 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:32.221 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:32.222 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:32.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.222 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:32.222 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:32.222 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 99.160551118000001, 2024-04-25T22:53:32.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021175381, 2024-04-25T22:53:32.222 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:32.222 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:32.222 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:32.222 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:32.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:32.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:32.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:32.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:32.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:32.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:32.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:32.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012651+0000", 2024-04-25T22:53:32.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:53:32.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:32.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012656+0000", 2024-04-25T22:53:32.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8899999999999998e-06 2024-04-25T22:53:32.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:32.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012666+0000", 2024-04-25T22:53:32.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0346999999999999e-05 2024-04-25T22:53:32.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:32.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012675+0000", 2024-04-25T22:53:32.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9930000000000001e-06 2024-04-25T22:53:32.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:32.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025661+0000", 2024-04-25T22:53:32.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01298531 2024-04-25T22:53:32.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:32.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025757+0000", 2024-04-25T22:53:32.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5822000000000005e-05 2024-04-25T22:53:32.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:32.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025907+0000", 2024-04-25T22:53:32.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015051499999999999 2024-04-25T22:53:32.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:32.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026435+0000", 2024-04-25T22:53:32.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052762200000000005 2024-04-25T22:53:32.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:32.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033732+0000", 2024-04-25T22:53:32.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072978419999999997 2024-04-25T22:53:32.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:32.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033787+0000", 2024-04-25T22:53:32.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4703999999999997e-05 2024-04-25T22:53:32.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:32.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033826+0000", 2024-04-25T22:53:32.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8458999999999999e-05 2024-04-25T22:53:32.227 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:32.227 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:32.227 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:32.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.227 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:32.227 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:32.228 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 99.160495703999999, 2024-04-25T22:53:32.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021244174000000001, 2024-04-25T22:53:32.228 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:32.228 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:32.228 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:32.228 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:32.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.228 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:32.228 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:32.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:32.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.228 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:32.228 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:32.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:32.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:32.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:32.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:32.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:32.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012712+0000", 2024-04-25T22:53:32.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.913e-06 2024-04-25T22:53:32.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:32.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012722+0000", 2024-04-25T22:53:32.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2879999999999998e-06 2024-04-25T22:53:32.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:32.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012727+0000", 2024-04-25T22:53:32.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8429999999999998e-06 2024-04-25T22:53:32.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:32.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026099+0000", 2024-04-25T22:53:32.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013371450999999999 2024-04-25T22:53:32.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:32.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026147+0000", 2024-04-25T22:53:32.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7837999999999998e-05 2024-04-25T22:53:32.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:32.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026254+0000", 2024-04-25T22:53:32.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107314 2024-04-25T22:53:32.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:32.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026686+0000", 2024-04-25T22:53:32.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000432428 2024-04-25T22:53:32.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:32.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033873+0000", 2024-04-25T22:53:32.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071864399999999997 2024-04-25T22:53:32.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:32.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033904+0000", 2024-04-25T22:53:32.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1321e-05 2024-04-25T22:53:32.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:32.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033950+0000", 2024-04-25T22:53:32.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5707999999999997e-05 2024-04-25T22:53:32.234 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:32.234 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:32.234 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:32.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.234 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:32.235 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:32.235 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 99.160465318999996, 2024-04-25T22:53:32.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01096505, 2024-04-25T22:53:32.235 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:32.235 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:32.235 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:32.235 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:32.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:32.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:32.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:32.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:32.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:32.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:32.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:32.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012737+0000", 2024-04-25T22:53:32.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:32.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:32.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012739+0000", 2024-04-25T22:53:32.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-04-25T22:53:32.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:32.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012743+0000", 2024-04-25T22:53:32.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3239999999999996e-06 2024-04-25T22:53:32.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:32.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012746+0000", 2024-04-25T22:53:32.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.129e-06 2024-04-25T22:53:32.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:32.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012796+0000", 2024-04-25T22:53:32.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9231999999999999e-05 2024-04-25T22:53:32.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:32.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012915+0000", 2024-04-25T22:53:32.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119021 2024-04-25T22:53:32.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:32.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013069+0000", 2024-04-25T22:53:32.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015463900000000001 2024-04-25T22:53:32.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:32.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019237+0000", 2024-04-25T22:53:32.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061680329999999998 2024-04-25T22:53:32.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:32.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023603+0000", 2024-04-25T22:53:32.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043655860000000003 2024-04-25T22:53:32.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:32.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023659+0000", 2024-04-25T22:53:32.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6484000000000003e-05 2024-04-25T22:53:32.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:32.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023701+0000", 2024-04-25T22:53:32.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1761999999999998e-05 2024-04-25T22:53:32.240 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:32.240 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:32.240 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:32.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.240 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:32.240 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:32.240 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 99.160440371000007, 2024-04-25T22:53:32.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011234429000000001, 2024-04-25T22:53:32.240 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:32.240 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:32.241 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:32.241 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:32.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:32.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:32.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:32.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:32.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:32.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:32.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:32.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012762+0000", 2024-04-25T22:53:32.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-04-25T22:53:32.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:32.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012765+0000", 2024-04-25T22:53:32.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2569999999999999e-06 2024-04-25T22:53:32.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:32.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012783+0000", 2024-04-25T22:53:32.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8431999999999999e-05 2024-04-25T22:53:32.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:32.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012799+0000", 2024-04-25T22:53:32.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5438999999999999e-05 2024-04-25T22:53:32.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:32.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013826+0000", 2024-04-25T22:53:32.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010275060000000001 2024-04-25T22:53:32.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:32.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013913+0000", 2024-04-25T22:53:32.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.708e-05 2024-04-25T22:53:32.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:32.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014098+0000", 2024-04-25T22:53:32.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018519399999999999 2024-04-25T22:53:32.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:32.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019684+0000", 2024-04-25T22:53:32.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055860079999999999 2024-04-25T22:53:32.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:32.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023876+0000", 2024-04-25T22:53:32.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041918800000000003 2024-04-25T22:53:32.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:32.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023957+0000", 2024-04-25T22:53:32.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1165e-05 2024-04-25T22:53:32.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:32.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023995+0000", 2024-04-25T22:53:32.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:53:32.245 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:32.245 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:32.245 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:32.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.246 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:32.246 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:32.246 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 99.160342592000006, 2024-04-25T22:53:32.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011131200000000001, 2024-04-25T22:53:32.246 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:32.246 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:32.246 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:32.246 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:32.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:32.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:32.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:32.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.247 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:32.247 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:32.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:32.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.247 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:32.247 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012860+0000", 2024-04-25T22:53:32.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3900000000000004e-07 2024-04-25T22:53:32.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.247 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:32.247 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012865+0000", 2024-04-25T22:53:32.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5609999999999998e-06 2024-04-25T22:53:32.248 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.248 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:32.248 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012895+0000", 2024-04-25T22:53:32.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9847000000000001e-05 2024-04-25T22:53:32.248 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.248 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:32.248 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012905+0000", 2024-04-25T22:53:32.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.03e-05 2024-04-25T22:53:32.248 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.248 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:32.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015020+0000", 2024-04-25T22:53:32.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021142940000000001 2024-04-25T22:53:32.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:32.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015182+0000", 2024-04-25T22:53:32.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016248099999999999 2024-04-25T22:53:32.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:32.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015357+0000", 2024-04-25T22:53:32.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017471000000000001 2024-04-25T22:53:32.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:32.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021021+0000", 2024-04-25T22:53:32.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056638340000000004 2024-04-25T22:53:32.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:32.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023712+0000", 2024-04-25T22:53:32.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026910380000000002 2024-04-25T22:53:32.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:32.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023763+0000", 2024-04-25T22:53:32.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1477999999999997e-05 2024-04-25T22:53:32.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:32.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023990+0000", 2024-04-25T22:53:32.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000226818 2024-04-25T22:53:32.251 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:32.251 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:32.251 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:32.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.251 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:32.251 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:32.251 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 99.160219495999996, 2024-04-25T22:53:32.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011705299000000001, 2024-04-25T22:53:32.252 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:32.252 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:32.252 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:32.252 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:32.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.252 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:32.252 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:32.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:32.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.252 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:32.252 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:32.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:32.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.253 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:32.253 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012983+0000", 2024-04-25T22:53:32.253 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:53:32.253 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.253 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.253 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:32.253 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012986+0000", 2024-04-25T22:53:32.253 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5700000000000001e-06 2024-04-25T22:53:32.253 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.253 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.253 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:32.253 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012993+0000", 2024-04-25T22:53:32.253 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8730000000000001e-06 2024-04-25T22:53:32.253 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:32.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013000+0000", 2024-04-25T22:53:32.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1890000000000001e-06 2024-04-25T22:53:32.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:32.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:53:32.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002147866 2024-04-25T22:53:32.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:32.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015351+0000", 2024-04-25T22:53:32.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020300799999999999 2024-04-25T22:53:32.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:32.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016260+0000", 2024-04-25T22:53:32.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00090926799999999997 2024-04-25T22:53:32.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:32.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022669+0000", 2024-04-25T22:53:32.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064082849999999997 2024-04-25T22:53:32.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:32.256 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024584+0000", 2024-04-25T22:53:32.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019151699999999999 2024-04-25T22:53:32.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.256 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:32.256 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024643+0000", 2024-04-25T22:53:32.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8888999999999998e-05 2024-04-25T22:53:32.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.256 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:32.256 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024687+0000", 2024-04-25T22:53:32.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4444999999999999e-05 2024-04-25T22:53:32.256 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:32.256 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:32.257 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:32.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.257 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:32.257 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:32.257 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 99.160191905000005, 2024-04-25T22:53:32.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011249699, 2024-04-25T22:53:32.257 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:32.257 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:32.257 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:32.257 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:32.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.257 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:32.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:32.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:32.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:32.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:32.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:32.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:32.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013010+0000", 2024-04-25T22:53:32.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2099999999999996e-07 2024-04-25T22:53:32.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.259 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:32.259 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013013+0000", 2024-04-25T22:53:32.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1310000000000002e-06 2024-04-25T22:53:32.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.259 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:32.259 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013020+0000", 2024-04-25T22:53:32.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3330000000000002e-06 2024-04-25T22:53:32.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.259 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:32.259 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013025+0000", 2024-04-25T22:53:32.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6760000000000004e-06 2024-04-25T22:53:32.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.260 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.260 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:32.260 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013163+0000", 2024-04-25T22:53:32.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013824599999999999 2024-04-25T22:53:32.260 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.260 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.260 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:32.260 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013504+0000", 2024-04-25T22:53:32.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034080299999999998 2024-04-25T22:53:32.260 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.260 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.260 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:32.260 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013613+0000", 2024-04-25T22:53:32.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108705 2024-04-25T22:53:32.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.261 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:32.261 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015831+0000", 2024-04-25T22:53:32.261 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002217672 2024-04-25T22:53:32.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.261 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:32.261 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024137+0000", 2024-04-25T22:53:32.261 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0083060489999999994 2024-04-25T22:53:32.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.261 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:32.261 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024218+0000", 2024-04-25T22:53:32.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1351000000000001e-05 2024-04-25T22:53:32.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:32.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024259+0000", 2024-04-25T22:53:32.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1112000000000002e-05 2024-04-25T22:53:32.262 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:32.262 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:32.262 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:32.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.262 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:32.262 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:32.263 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 99.160104179000001, 2024-04-25T22:53:32.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020379749999999999, 2024-04-25T22:53:32.263 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:32.263 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:32.263 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:32.263 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:32.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:32.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:32.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:32.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:32.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:32.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:32.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:32.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013098+0000", 2024-04-25T22:53:32.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:53:32.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:32.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013105+0000", 2024-04-25T22:53:32.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5969999999999997e-06 2024-04-25T22:53:32.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.265 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:32.265 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013190+0000", 2024-04-25T22:53:32.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5618999999999995e-05 2024-04-25T22:53:32.265 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.265 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.265 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:32.265 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013200+0000", 2024-04-25T22:53:32.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5859999999999994e-06 2024-04-25T22:53:32.265 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.265 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.265 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:32.265 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020265+0000", 2024-04-25T22:53:32.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070653349999999998 2024-04-25T22:53:32.265 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.266 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.266 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:32.266 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020454+0000", 2024-04-25T22:53:32.266 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189316 2024-04-25T22:53:32.266 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.266 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.266 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:32.266 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020586+0000", 2024-04-25T22:53:32.266 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013195700000000001 2024-04-25T22:53:32.266 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.266 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.266 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:32.266 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023822+0000", 2024-04-25T22:53:32.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032358529999999999 2024-04-25T22:53:32.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.267 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:32.267 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033409+0000", 2024-04-25T22:53:32.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095870520000000004 2024-04-25T22:53:32.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.267 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:32.267 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033447+0000", 2024-04-25T22:53:32.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7261999999999997e-05 2024-04-25T22:53:32.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.267 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:32.268 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033477+0000", 2024-04-25T22:53:32.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0389e-05 2024-04-25T22:53:32.268 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:32.268 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:32.268 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:32.268 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.268 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.268 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:32.268 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:32.268 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 99.159987673000003, 2024-04-25T22:53:32.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010857383999999999, 2024-04-25T22:53:32.268 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:32.268 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:32.268 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:32.269 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:32.269 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.269 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:32.269 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:32.269 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:32.269 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.269 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.269 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:32.269 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:32.269 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:32.269 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.269 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.269 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:32.269 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:32.270 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:32.270 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.270 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.270 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:32.270 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013218+0000", 2024-04-25T22:53:32.270 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8199999999999998e-06 2024-04-25T22:53:32.270 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.270 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.270 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:32.270 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013226+0000", 2024-04-25T22:53:32.270 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7649999999999993e-06 2024-04-25T22:53:32.270 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.270 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.270 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:32.271 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013259+0000", 2024-04-25T22:53:32.271 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2727e-05 2024-04-25T22:53:32.271 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.271 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.271 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:32.271 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014809+0000", 2024-04-25T22:53:32.271 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001550144 2024-04-25T22:53:32.271 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.271 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.271 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:32.271 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014958+0000", 2024-04-25T22:53:32.271 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014890300000000001 2024-04-25T22:53:32.271 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.271 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.272 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:32.272 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015087+0000", 2024-04-25T22:53:32.272 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012939200000000001 2024-04-25T22:53:32.272 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.272 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.272 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:32.272 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020212+0000", 2024-04-25T22:53:32.272 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051248939999999996 2024-04-25T22:53:32.272 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.272 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.272 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:32.272 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023699+0000", 2024-04-25T22:53:32.272 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034873289999999999 2024-04-25T22:53:32.272 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.272 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.273 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:32.273 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024014+0000", 2024-04-25T22:53:32.273 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031473999999999999 2024-04-25T22:53:32.273 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.273 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.273 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:32.273 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024071+0000", 2024-04-25T22:53:32.273 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7040000000000003e-05 2024-04-25T22:53:32.273 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:32.273 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:32.273 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:32.273 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.273 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.273 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:32.274 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:32.274 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 99.159932968000007, 2024-04-25T22:53:32.274 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012329677000000001, 2024-04-25T22:53:32.274 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:32.274 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:32.274 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:32.274 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:32.274 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.274 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:32.274 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:32.274 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:32.274 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.274 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.275 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:32.275 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:32.275 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:32.275 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.275 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.275 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:32.275 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013269+0000", 2024-04-25T22:53:32.275 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5000000000000002e-07 2024-04-25T22:53:32.275 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.275 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.275 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:32.275 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:32.275 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6909999999999999e-06 2024-04-25T22:53:32.275 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.276 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.276 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:32.276 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013284+0000", 2024-04-25T22:53:32.276 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0963e-05 2024-04-25T22:53:32.276 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.276 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.276 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:32.276 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013361+0000", 2024-04-25T22:53:32.276 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7379999999999994e-05 2024-04-25T22:53:32.276 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.276 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.276 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:32.276 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013448+0000", 2024-04-25T22:53:32.276 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6990000000000006e-05 2024-04-25T22:53:32.277 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.277 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.277 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:32.277 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013632+0000", 2024-04-25T22:53:32.277 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018396800000000001 2024-04-25T22:53:32.277 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.277 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.277 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:32.277 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013800+0000", 2024-04-25T22:53:32.277 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167467 2024-04-25T22:53:32.277 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.277 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.277 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:32.277 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.018570+0000", 2024-04-25T22:53:32.278 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047701460000000003 2024-04-25T22:53:32.278 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.278 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.278 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:32.278 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025507+0000", 2024-04-25T22:53:32.278 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069372039999999998 2024-04-25T22:53:32.278 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.278 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.278 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:32.278 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025562+0000", 2024-04-25T22:53:32.278 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4858999999999998e-05 2024-04-25T22:53:32.278 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.278 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.278 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:32.279 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025598+0000", 2024-04-25T22:53:32.279 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6259e-05 2024-04-25T22:53:32.279 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:32.279 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:32.279 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:32.279 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.279 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.279 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:32.279 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:32.279 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 99.159801095000006, 2024-04-25T22:53:32.279 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020176666999999999, 2024-04-25T22:53:32.279 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:32.279 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:32.279 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:53:32.280 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:32.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:32.280 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:32.280 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:32.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:32.280 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:32.280 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:32.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:32.280 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:32.280 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-04-25T22:53:32.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.281 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:32.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013405+0000", 2024-04-25T22:53:32.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0559999999999998e-06 2024-04-25T22:53:32.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.281 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:32.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013422+0000", 2024-04-25T22:53:32.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6770999999999999e-05 2024-04-25T22:53:32.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.281 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:32.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013431+0000", 2024-04-25T22:53:32.282 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5019999999999998e-06 2024-04-25T22:53:32.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:32.282 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021720+0000", 2024-04-25T22:53:32.282 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082884340000000008 2024-04-25T22:53:32.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:32.282 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022122+0000", 2024-04-25T22:53:32.282 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000401634 2024-04-25T22:53:32.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:32.283 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033577+0000", 2024-04-25T22:53:32.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011455435999999999 2024-04-25T22:53:32.283 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:32.283 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:32.283 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:32.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.283 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4734.0:31 4.1b 4:d9872866:::1000000021d.00000002:head [write 0~3618035] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-25T22:53:32.283 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:53:32.283 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 1.120226833, 2024-04-25T22:53:32.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011647062, 2024-04-25T22:53:32.283 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:32.283 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:32.284 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:32.284 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:32.284 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4734", 2024-04-25T22:53:32.284 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:32.284 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 31 2024-04-25T22:53:32.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.284 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:32.284 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.284 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:32.284 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:53:32.284 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:32.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.284 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.284 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:32.285 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:53:32.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:32.285 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.285 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.285 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:32.285 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:53:32.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5700000000000001e-07 2024-04-25T22:53:32.285 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.285 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.285 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:32.285 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059575+0000", 2024-04-25T22:53:32.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0065991380000000001 2024-04-25T22:53:32.285 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.285 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.286 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:32.286 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059586+0000", 2024-04-25T22:53:32.286 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1438e-05 2024-04-25T22:53:32.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.286 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:32.286 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059592+0000", 2024-04-25T22:53:32.286 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2899999999999999e-06 2024-04-25T22:53:32.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.286 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:32.286 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059660+0000", 2024-04-25T22:53:32.286 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7980999999999998e-05 2024-04-25T22:53:32.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.287 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.287 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:32.287 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059757+0000", 2024-04-25T22:53:32.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6340000000000003e-05 2024-04-25T22:53:32.287 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.287 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.287 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:32.287 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.064487+0000", 2024-04-25T22:53:32.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004730621 2024-04-25T22:53:32.287 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.287 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.287 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:32.287 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.064538+0000", 2024-04-25T22:53:32.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0801999999999999e-05 2024-04-25T22:53:32.287 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.288 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.288 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:32.288 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.064622+0000", 2024-04-25T22:53:32.288 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3595000000000002e-05 2024-04-25T22:53:32.288 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:32.288 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:32.288 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:32.288 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:32.288 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:32.288 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:32.289 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-25T22:53:32.290 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:32.291 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:32.288+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:32.392 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:32.391+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:32.400 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:32.400 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:32.400 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-25T22:53:32.400 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:32.410 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:32.494 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:32.493+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:32.561 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:32.561 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:32.561 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-25T22:53:32.561 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-25T22:53:32.562 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:32.571 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:32.612 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:32.611+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:32.694 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:32.693+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:32.723 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:32.723 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:53:32.723 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:53:32.723 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:53:32.723 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.723 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:53:32.724 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:32.724 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 104.754370108, 2024-04-25T22:53:32.724 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:53:32.724 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:32.724 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:32.724 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:32.724 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:32.724 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.724 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:32.724 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:32.724 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:32.724 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.724 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.724 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:32.725 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:32.725 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:32.725 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.725 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.725 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:32.725 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:53:32.725 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:53:32.725 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.725 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.725 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:32.725 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:53:32.725 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:53:32.725 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.725 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.726 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:32.726 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:53:32.726 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:53:32.726 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.726 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.726 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:32.726 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:53:32.726 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:53:32.726 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.726 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.726 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:32.726 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:53:32.726 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:53:32.727 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.727 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.727 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:32.727 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:53:32.727 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:53:32.727 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.727 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.727 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:32.727 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:53:32.727 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:53:32.727 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.727 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.727 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:32.727 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:53:32.728 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:53:32.728 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:32.728 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:32.728 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:32.728 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.728 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.728 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:110 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'72, mlcod=10'68)", 2024-04-25T22:53:32.728 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:32.728 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 104.753736108, 2024-04-25T22:53:32.728 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065316630000000001, 2024-04-25T22:53:32.728 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:32.728 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:32.728 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:32.728 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:32.729 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.729 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:32.729 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:32.729 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:32.729 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.729 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.729 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:32.729 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:32.729 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:32.729 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.729 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.729 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:32.729 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:32.729 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.58e-07 2024-04-25T22:53:32.729 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.730 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.730 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:32.730 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967811+0000", 2024-04-25T22:53:32.730 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.118e-06 2024-04-25T22:53:32.730 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.730 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.730 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:32.730 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967817+0000", 2024-04-25T22:53:32.730 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3709999999999996e-06 2024-04-25T22:53:32.730 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.730 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.730 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:32.730 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967820+0000", 2024-04-25T22:53:32.731 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2210000000000002e-06 2024-04-25T22:53:32.731 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.731 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.731 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:32.731 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967876+0000", 2024-04-25T22:53:32.731 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5507000000000002e-05 2024-04-25T22:53:32.731 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.731 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.731 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:32.731 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967893+0000", 2024-04-25T22:53:32.731 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7812000000000002e-05 2024-04-25T22:53:32.731 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.731 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.731 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:32.732 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974317+0000", 2024-04-25T22:53:32.732 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064237160000000003 2024-04-25T22:53:32.732 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.732 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.732 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:32.732 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:53:32.732 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.156e-05 2024-04-25T22:53:32.732 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:32.732 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:32.732 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:32.732 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.732 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.732 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'68)", 2024-04-25T22:53:32.732 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:32.733 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 104.753318595, 2024-04-25T22:53:32.733 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061292279999999996, 2024-04-25T22:53:32.733 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:32.733 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:32.733 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:32.733 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:32.733 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.733 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:32.733 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:32.733 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:32.733 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.733 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.733 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:32.733 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:32.733 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:32.734 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.734 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.734 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:32.734 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:32.734 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6300000000000001e-07 2024-04-25T22:53:32.734 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.734 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.734 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:32.734 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968228+0000", 2024-04-25T22:53:32.734 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6139999999999999e-06 2024-04-25T22:53:32.734 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.734 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.734 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:32.734 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968235+0000", 2024-04-25T22:53:32.735 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7020000000000001e-06 2024-04-25T22:53:32.735 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.735 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.735 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:32.735 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968238+0000", 2024-04-25T22:53:32.735 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0010000000000002e-06 2024-04-25T22:53:32.735 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.735 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.735 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:32.735 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968297+0000", 2024-04-25T22:53:32.735 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8424999999999997e-05 2024-04-25T22:53:32.735 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.735 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.735 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:32.736 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968316+0000", 2024-04-25T22:53:32.736 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8814999999999999e-05 2024-04-25T22:53:32.736 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.736 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.736 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:32.736 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:53:32.736 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060239439999999998 2024-04-25T22:53:32.736 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.736 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.736 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:32.736 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974354+0000", 2024-04-25T22:53:32.736 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4364e-05 2024-04-25T22:53:32.736 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:32.736 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:32.737 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:32.737 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.737 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.737 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:32.737 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:32.737 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 99.709874408999994, 2024-04-25T22:53:32.737 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:53:32.737 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:32.737 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:32.737 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:32.737 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:32.737 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.738 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:32.738 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:32.738 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:32.738 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.738 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.738 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:32.738 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:32.738 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:32.738 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.738 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.738 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:32.738 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:53:32.738 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:53:32.738 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.739 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.739 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:32.739 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:53:32.739 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:53:32.739 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.739 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.739 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:32.739 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:53:32.739 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:53:32.739 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.739 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.739 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:32.739 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:53:32.740 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:53:32.740 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.740 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.740 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:32.740 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:53:32.740 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:53:32.740 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.740 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.740 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:32.740 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:53:32.740 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:53:32.740 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.740 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.740 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:32.741 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:53:32.741 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:53:32.741 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.741 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.741 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:32.741 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:53:32.741 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:53:32.741 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.741 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.741 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:32.741 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:53:32.741 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:53:32.741 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.741 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.742 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:32.742 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:53:32.742 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:53:32.742 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.742 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.742 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:32.742 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:53:32.742 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:53:32.742 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:32.742 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:32.742 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:32.742 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.742 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.743 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:32.743 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:32.743 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 99.709200033000002, 2024-04-25T22:53:32.743 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:53:32.743 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:32.743 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:32.743 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:32.743 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:32.743 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.743 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:32.743 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:32.743 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:32.743 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.743 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.744 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:32.744 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:32.744 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:32.744 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.744 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.744 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:32.744 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:53:32.744 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:53:32.744 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.744 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.744 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:32.744 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:53:32.744 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:53:32.744 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.745 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.745 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:32.745 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:53:32.745 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:53:32.745 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.745 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.745 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:32.745 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:53:32.745 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:53:32.745 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.745 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.745 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:32.745 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:53:32.745 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:53:32.746 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.746 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.746 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:32.746 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:53:32.746 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:53:32.746 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.746 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.746 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:32.746 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:53:32.746 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:53:32.746 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.746 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.746 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:32.746 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:53:32.747 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:53:32.747 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.747 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.747 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:32.747 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:53:32.747 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:53:32.747 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.747 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.747 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:32.747 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:53:32.747 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:53:32.747 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.748 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.748 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:32.748 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:53:32.748 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:53:32.748 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:32.748 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:32.748 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:32.748 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.748 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.748 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:32.748 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:32.748 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 99.708690821000005, 2024-04-25T22:53:32.748 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:53:32.748 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:32.748 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:32.749 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:32.749 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:32.749 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.749 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:32.749 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:32.749 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:32.749 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.749 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.749 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:32.749 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:32.749 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:32.749 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.749 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.750 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:32.750 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:53:32.750 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:53:32.750 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.750 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.750 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:32.750 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:53:32.750 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:53:32.750 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.750 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.750 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:32.750 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:53:32.750 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:53:32.750 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.751 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.751 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:32.751 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:53:32.751 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:53:32.751 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.751 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.751 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:32.751 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:53:32.751 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:53:32.751 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.751 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.751 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:32.751 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:53:32.751 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:53:32.752 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.752 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.752 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:32.752 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:53:32.752 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:53:32.752 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.752 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.752 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:32.752 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:53:32.752 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:53:32.752 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.752 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.752 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:32.753 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:53:32.753 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:53:32.753 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.753 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.753 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:32.753 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:53:32.753 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:53:32.753 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.753 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.753 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:32.753 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:53:32.753 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:53:32.753 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:32.753 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:32.753 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:32.754 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.754 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.754 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:32.754 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:32.754 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 99.708277623000001, 2024-04-25T22:53:32.754 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:53:32.754 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:32.754 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:32.754 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:32.754 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:32.754 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.754 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:32.754 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:32.755 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:32.755 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.755 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.755 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:32.755 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:32.755 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:32.755 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.755 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.755 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:32.755 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:32.755 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:53:32.755 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.755 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.756 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:32.756 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:32.756 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:53:32.756 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.756 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.756 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:32.756 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:53:32.756 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:53:32.756 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.756 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.756 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:32.756 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:53:32.756 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:53:32.756 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.757 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.757 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:32.757 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:53:32.757 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:53:32.757 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.757 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.757 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:32.757 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:53:32.757 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:53:32.757 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.757 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.757 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:32.757 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:53:32.757 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:53:32.757 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.758 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.758 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:32.758 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:53:32.758 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:53:32.758 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.758 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.759 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:32.759 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:53:32.759 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:53:32.759 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.759 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.759 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:32.759 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:53:32.759 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:53:32.759 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.760 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.760 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:32.760 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:53:32.760 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:53:32.760 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:32.760 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:32.760 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:32.760 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.760 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.760 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:32.760 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:32.760 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 99.708226952999993, 2024-04-25T22:53:32.760 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:53:32.760 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:32.761 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:32.761 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:32.761 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:32.761 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.761 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:32.762 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:32.762 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:32.762 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.762 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.762 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:32.762 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:32.762 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:32.762 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.762 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.762 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:32.762 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:53:32.762 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:53:32.763 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.763 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.763 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:32.763 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:53:32.763 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:53:32.763 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.763 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.763 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:32.763 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:53:32.763 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:53:32.763 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.763 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.763 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:32.763 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:53:32.764 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:53:32.764 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.764 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.764 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:32.764 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:53:32.764 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:53:32.764 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.764 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.764 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:32.764 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:53:32.764 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:53:32.764 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.764 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.765 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:32.765 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:53:32.765 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:53:32.765 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.765 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.765 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:32.765 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:53:32.765 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:53:32.765 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.765 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.765 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:32.765 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:53:32.765 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:53:32.765 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.766 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.766 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:32.766 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:53:32.766 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:53:32.766 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.766 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.766 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:32.766 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:53:32.766 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:53:32.766 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.766 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.766 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:32.766 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:53:32.766 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:53:32.767 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.767 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.767 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:32.767 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:53:32.767 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:53:32.767 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:32.767 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:32.767 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:32.767 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.767 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.767 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:32.767 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:32.767 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 99.708190083999995, 2024-04-25T22:53:32.768 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:53:32.768 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:32.768 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:32.768 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:32.768 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:32.768 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.768 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:32.768 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:32.768 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:32.768 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.768 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.768 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:32.768 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:32.768 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:32.769 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.769 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.769 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:32.769 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:53:32.769 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:53:32.769 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.769 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.769 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:32.769 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:53:32.769 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:53:32.769 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.769 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.769 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:32.770 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:53:32.770 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:53:32.770 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.770 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.770 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:32.770 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:53:32.770 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:53:32.770 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.770 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.770 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:32.770 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:53:32.770 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:53:32.770 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.771 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.771 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:53:32.771 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:53:32.771 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:53:32.771 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.771 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.771 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:32.771 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:53:32.771 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:53:32.771 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.771 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.771 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:32.771 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:53:32.771 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:53:32.772 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.772 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.772 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:32.772 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:53:32.772 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:53:32.772 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.772 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.772 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:32.772 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:53:32.772 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:53:32.772 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.772 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.772 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:32.772 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:53:32.773 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:53:32.773 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.773 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.773 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:32.773 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:53:32.773 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:53:32.773 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.773 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.773 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:32.773 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:53:32.773 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:53:32.773 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:32.773 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:32.773 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:32.774 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.774 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.774 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:32.774 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:32.774 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 99.708165117999997, 2024-04-25T22:53:32.774 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:53:32.774 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:32.774 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:32.774 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:32.774 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:32.774 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.774 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:32.774 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:32.774 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:32.775 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.775 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.775 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:32.775 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:32.775 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:32.775 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.775 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.775 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:32.775 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:53:32.775 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:53:32.775 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.775 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.775 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:32.775 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:53:32.776 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:53:32.776 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.776 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.776 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:32.776 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:32.776 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:53:32.776 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.776 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.776 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:32.776 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:53:32.776 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:53:32.776 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.776 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.776 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:32.777 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:53:32.777 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:53:32.777 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.777 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.777 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:32.777 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:53:32.777 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:53:32.777 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.777 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.777 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:32.777 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:53:32.777 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:53:32.777 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.777 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.778 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:32.778 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:53:32.778 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:53:32.778 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.778 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.778 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:32.778 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:53:32.778 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:53:32.778 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.778 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.778 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:32.778 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:53:32.778 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:53:32.778 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.779 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.779 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:32.779 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:53:32.779 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:53:32.779 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:32.779 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:32.779 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:32.779 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.779 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.780 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:32.780 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:32.780 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 99.708128754000001, 2024-04-25T22:53:32.780 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:53:32.780 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:32.780 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:32.780 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:32.780 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:32.780 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.780 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:32.780 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:32.780 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:32.780 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.780 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.781 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:32.781 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:32.781 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:32.781 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.781 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.781 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:32.781 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:53:32.781 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:53:32.781 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.781 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.781 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:32.781 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:53:32.781 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:53:32.782 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.782 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.782 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:32.782 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:53:32.782 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:53:32.782 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.782 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.782 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:32.782 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:53:32.782 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:53:32.782 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.782 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.782 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:32.783 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:53:32.783 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:53:32.783 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.783 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.783 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:32.783 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:53:32.783 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:53:32.783 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.783 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.783 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:32.783 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:53:32.784 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:53:32.784 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.784 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.784 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:32.784 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:53:32.784 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:53:32.784 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.784 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.784 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:32.784 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:53:32.784 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:53:32.784 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:32.784 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:32.785 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:32.785 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.785 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.785 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:32.785 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:32.785 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 99.708097672999997, 2024-04-25T22:53:32.785 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:53:32.785 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:32.785 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:32.785 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:32.785 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:32.785 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.785 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:32.786 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:32.786 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:32.786 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.786 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.786 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:32.786 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:32.786 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:32.786 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.786 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.786 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:32.786 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:32.786 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:32.787 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.787 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.787 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:32.787 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:53:32.787 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:53:32.787 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.787 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.787 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:32.787 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:53:32.787 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:53:32.787 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.787 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.787 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:32.787 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:53:32.788 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:53:32.788 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.788 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.788 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:32.788 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:53:32.788 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:53:32.788 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.788 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.788 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:32.788 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:53:32.788 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:53:32.788 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.788 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.788 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:32.788 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:53:32.789 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:53:32.789 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:32.789 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:32.789 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:32.789 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.789 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.789 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:53:32.789 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:32.789 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 99.707656704000001, 2024-04-25T22:53:32.789 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064881979999999997, 2024-04-25T22:53:32.789 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:32.789 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:32.789 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:32.789 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:32.790 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.790 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:32.790 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:32.790 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:32.790 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.790 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.790 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:32.790 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:32.790 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:32.790 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.790 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.790 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:32.790 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:32.791 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2699999999999999e-07 2024-04-25T22:53:32.791 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.791 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.791 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:32.791 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013898+0000", 2024-04-25T22:53:32.791 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0796e-05 2024-04-25T22:53:32.791 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.791 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.791 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:32.791 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013907+0000", 2024-04-25T22:53:32.791 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5140000000000007e-06 2024-04-25T22:53:32.791 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.791 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.791 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:32.792 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013952+0000", 2024-04-25T22:53:32.792 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4134000000000001e-05 2024-04-25T22:53:32.792 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.792 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.792 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:32.792 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016812+0000", 2024-04-25T22:53:32.792 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028601059999999998 2024-04-25T22:53:32.792 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.792 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.792 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:32.792 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.017052+0000", 2024-04-25T22:53:32.792 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024056500000000001 2024-04-25T22:53:32.792 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.792 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.793 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:32.793 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020350+0000", 2024-04-25T22:53:32.793 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032978320000000001 2024-04-25T22:53:32.793 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.793 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.793 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:32.793 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020375+0000", 2024-04-25T22:53:32.793 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4624e-05 2024-04-25T22:53:32.793 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:32.793 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:32.793 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:32.793 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.793 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.793 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:30 4.31 4:8ebfc112:::1000000021d.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-25T22:53:32.793 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:53:32.794 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 1.6684118030000001, 2024-04-25T22:53:32.794 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015003005, 2024-04-25T22:53:32.794 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:32.794 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:32.794 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:32.794 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:32.794 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:32.794 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:32.794 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 30 2024-04-25T22:53:32.794 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.794 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:32.794 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.794 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:32.795 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:53:32.795 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:32.795 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.795 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.795 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:32.795 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:53:32.795 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:32.795 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.795 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.795 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:32.795 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053133+0000", 2024-04-25T22:53:32.795 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0370000000000001e-06 2024-04-25T22:53:32.795 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.795 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.796 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:32.796 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060377+0000", 2024-04-25T22:53:32.796 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0072431070000000004 2024-04-25T22:53:32.796 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.796 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.796 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:32.796 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060388+0000", 2024-04-25T22:53:32.796 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1285e-05 2024-04-25T22:53:32.796 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.796 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.796 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:32.796 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060394+0000", 2024-04-25T22:53:32.796 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1040000000000003e-06 2024-04-25T22:53:32.796 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.797 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.797 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:32.797 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060483+0000", 2024-04-25T22:53:32.797 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.9345000000000006e-05 2024-04-25T22:53:32.797 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.797 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.797 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:32.797 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060566+0000", 2024-04-25T22:53:32.797 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2237999999999994e-05 2024-04-25T22:53:32.797 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.797 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.798 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:32.798 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068057+0000", 2024-04-25T22:53:32.798 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074912210000000002 2024-04-25T22:53:32.798 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.798 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.798 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:32.798 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068090+0000", 2024-04-25T22:53:32.798 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3501000000000003e-05 2024-04-25T22:53:32.798 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.798 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.798 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:32.798 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068134+0000", 2024-04-25T22:53:32.798 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4166999999999999e-05 2024-04-25T22:53:32.798 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:32.799 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:32.799 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:32.799 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.799 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.799 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:66 4.27 4:e5671758:::1000000024f.00000000:head [write 0~6641] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:32.799 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:32.799 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 1.408301467, 2024-04-25T22:53:32.799 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075166540000000002, 2024-04-25T22:53:32.799 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:32.799 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:32.799 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:32.799 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:32.799 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:32.799 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:32.800 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 66 2024-04-25T22:53:32.800 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.800 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:32.800 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.800 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:32.800 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:32.800 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:32.800 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.800 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.800 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:32.800 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:32.800 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:32.800 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.800 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.801 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:32.801 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:32.801 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4099999999999998e-07 2024-04-25T22:53:32.801 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.801 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.801 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:32.801 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313252+0000", 2024-04-25T22:53:32.801 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5380000000000008e-06 2024-04-25T22:53:32.801 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.801 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.801 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:32.801 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313260+0000", 2024-04-25T22:53:32.801 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2609999999999993e-06 2024-04-25T22:53:32.801 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.802 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.802 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:32.802 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313265+0000", 2024-04-25T22:53:32.802 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4850000000000003e-06 2024-04-25T22:53:32.802 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.802 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.802 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:32.802 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313310+0000", 2024-04-25T22:53:32.802 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5247999999999998e-05 2024-04-25T22:53:32.802 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.802 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.802 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:32.802 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313370+0000", 2024-04-25T22:53:32.802 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0275000000000001e-05 2024-04-25T22:53:32.803 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.803 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.803 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:32.803 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313435+0000", 2024-04-25T22:53:32.803 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4647000000000006e-05 2024-04-25T22:53:32.803 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.803 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.803 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:32.803 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314174+0000", 2024-04-25T22:53:32.803 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00073925 2024-04-25T22:53:32.803 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.803 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.803 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:32.803 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320688+0000", 2024-04-25T22:53:32.804 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.006513418 2024-04-25T22:53:32.804 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.804 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.804 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:32.804 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320736+0000", 2024-04-25T22:53:32.804 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.8114e-05 2024-04-25T22:53:32.804 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.804 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.804 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:32.804 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320758+0000", 2024-04-25T22:53:32.804 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2776999999999999e-05 2024-04-25T22:53:32.804 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:32.804 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:32.804 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:32.805 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.805 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.805 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:68 4.31 4:8fb7f7b7:::10000000251.00000000:head [write 0~2067] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:32.805 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:32.805 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 1.4066156890000001, 2024-04-25T22:53:32.805 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0087011669999999992, 2024-04-25T22:53:32.805 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:32.805 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:32.805 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:32.805 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:32.805 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:32.805 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:32.805 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 68 2024-04-25T22:53:32.805 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.806 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:32.806 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.806 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:32.806 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:32.806 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:32.806 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.806 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.806 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:32.806 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:32.806 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:32.806 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.806 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.806 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:32.806 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:32.807 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:53:32.807 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.807 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.807 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:32.807 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314933+0000", 2024-04-25T22:53:32.807 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5430000000000004e-06 2024-04-25T22:53:32.807 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.807 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.807 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:32.807 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314944+0000", 2024-04-25T22:53:32.807 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.076e-05 2024-04-25T22:53:32.807 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.807 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.807 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:32.808 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314949+0000", 2024-04-25T22:53:32.808 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1019999999999996e-06 2024-04-25T22:53:32.808 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.808 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.808 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:32.808 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314996+0000", 2024-04-25T22:53:32.808 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7018999999999998e-05 2024-04-25T22:53:32.808 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.808 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.808 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:32.808 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315064+0000", 2024-04-25T22:53:32.808 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8738000000000005e-05 2024-04-25T22:53:32.808 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.808 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.809 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:32.809 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323531+0000", 2024-04-25T22:53:32.809 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084664739999999999 2024-04-25T22:53:32.809 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.809 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.809 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:32.809 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323574+0000", 2024-04-25T22:53:32.809 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3449999999999999e-05 2024-04-25T22:53:32.809 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.809 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.809 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:32.809 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323629+0000", 2024-04-25T22:53:32.809 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4296999999999999e-05 2024-04-25T22:53:32.810 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:32.810 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:32.810 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:32.810 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.810 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.810 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4734.0:69 4.32 e46/13 4:4e8c6251:::10000000252.00000000:head v 46'1, mlcod=0'0)", 2024-04-25T22:53:32.810 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:32.810 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 1.4055844209999999, 2024-04-25T22:53:32.810 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076063240000000002, 2024-04-25T22:53:32.810 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:32.810 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:32.810 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:32.810 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:32.811 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.811 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:32.811 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:32.811 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:32.811 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.811 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.811 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:32.811 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:32.811 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:32.811 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.811 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.811 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:32.811 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:32.811 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3099999999999997e-07 2024-04-25T22:53:32.812 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.812 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.812 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:32.812 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315964+0000", 2024-04-25T22:53:32.812 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3229999999999999e-06 2024-04-25T22:53:32.812 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.812 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.812 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:32.812 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315973+0000", 2024-04-25T22:53:32.812 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7249999999999992e-06 2024-04-25T22:53:32.812 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.812 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.812 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:32.813 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315978+0000", 2024-04-25T22:53:32.813 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4830000000000001e-06 2024-04-25T22:53:32.813 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.813 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.813 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:32.813 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.316043+0000", 2024-04-25T22:53:32.813 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.5036000000000005e-05 2024-04-25T22:53:32.813 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.813 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.813 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:32.813 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.316055+0000", 2024-04-25T22:53:32.813 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1973999999999999e-05 2024-04-25T22:53:32.813 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.813 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.814 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:32.814 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323521+0000", 2024-04-25T22:53:32.814 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074660239999999999 2024-04-25T22:53:32.814 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.814 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.814 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:32.814 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323565+0000", 2024-04-25T22:53:32.814 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4128000000000002e-05 2024-04-25T22:53:32.814 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:32.814 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:32.814 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:32.814 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.814 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.815 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4734.0:71 4.5 e46/13 4:a3a50212:::10000000254.00000000:head v 46'4, mlcod=45'2)", 2024-04-25T22:53:32.815 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.317569+0000", 2024-04-25T22:53:32.815 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 1.4039746420000001, 2024-04-25T22:53:32.815 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00602572, 2024-04-25T22:53:32.815 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:32.815 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:32.815 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:32.815 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:32.815 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.815 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:32.815 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.317569+0000", 2024-04-25T22:53:32.815 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:32.815 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.815 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.815 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:32.816 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.317569+0000", 2024-04-25T22:53:32.816 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:32.816 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.816 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.816 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:32.816 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.317569+0000", 2024-04-25T22:53:32.816 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4799999999999998e-07 2024-04-25T22:53:32.816 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.816 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.816 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:32.816 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.317586+0000", 2024-04-25T22:53:32.816 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6452000000000001e-05 2024-04-25T22:53:32.816 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.816 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.817 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:32.817 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.317595+0000", 2024-04-25T22:53:32.817 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.8050000000000001e-06 2024-04-25T22:53:32.817 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.817 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.817 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:32.817 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.317600+0000", 2024-04-25T22:53:32.817 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.8590000000000004e-06 2024-04-25T22:53:32.817 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.817 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.817 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:32.817 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.317639+0000", 2024-04-25T22:53:32.817 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8260000000000003e-05 2024-04-25T22:53:32.818 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.818 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.818 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:32.818 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.317653+0000", 2024-04-25T22:53:32.818 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4204e-05 2024-04-25T22:53:32.818 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.818 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.818 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:32.818 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323563+0000", 2024-04-25T22:53:32.818 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0059098939999999997 2024-04-25T22:53:32.818 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.818 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.818 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:32.818 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323594+0000", 2024-04-25T22:53:32.819 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1597999999999998e-05 2024-04-25T22:53:32.819 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:32.819 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:32.819 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:32.819 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.819 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.819 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:72 4.36 4:6cdfec98:::10000000255.00000000:head [write 0~4131] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:32.819 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:32.819 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 1.4035405089999999, 2024-04-25T22:53:32.819 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084820680000000006, 2024-04-25T22:53:32.819 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:32.819 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:32.819 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:32.820 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:32.820 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:32.820 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:32.820 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 72 2024-04-25T22:53:32.820 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.820 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:32.820 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.820 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:32.820 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:32.820 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:32.820 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.820 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.820 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:32.821 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:32.821 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:32.821 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.821 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.821 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:32.821 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:32.821 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1800000000000005e-07 2024-04-25T22:53:32.821 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.821 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.821 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:32.821 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318010+0000", 2024-04-25T22:53:32.821 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7399999999999998e-06 2024-04-25T22:53:32.821 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.821 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.821 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:32.822 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318019+0000", 2024-04-25T22:53:32.822 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0170000000000002e-06 2024-04-25T22:53:32.822 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.822 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.822 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:32.822 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318024+0000", 2024-04-25T22:53:32.822 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0150000000000003e-06 2024-04-25T22:53:32.822 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.822 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.822 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:32.822 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318075+0000", 2024-04-25T22:53:32.822 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0537000000000001e-05 2024-04-25T22:53:32.822 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.822 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.823 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:32.823 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318144+0000", 2024-04-25T22:53:32.823 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9432999999999997e-05 2024-04-25T22:53:32.823 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.823 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.823 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:32.823 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326392+0000", 2024-04-25T22:53:32.823 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0082482979999999994 2024-04-25T22:53:32.823 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.823 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.823 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:32.823 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326432+0000", 2024-04-25T22:53:32.823 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9870000000000003e-05 2024-04-25T22:53:32.823 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.824 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.824 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:32.824 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326485+0000", 2024-04-25T22:53:32.824 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2439999999999999e-05 2024-04-25T22:53:32.824 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:32.824 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:32.824 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:32.824 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.824 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.824 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:74 4.10 4:08e6f8ca:::10000000257.00000000:head [write 0~839] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:32.824 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:53:32.824 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 1.402066781, 2024-04-25T22:53:32.824 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070370720000000001, 2024-04-25T22:53:32.824 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:32.825 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:32.825 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:32.825 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:32.825 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:32.825 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:32.825 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 74 2024-04-25T22:53:32.825 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.825 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:32.825 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.825 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:32.825 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:53:32.825 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:32.825 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.825 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.826 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:32.826 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:53:32.826 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:32.826 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.826 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.826 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:32.826 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319477+0000", 2024-04-25T22:53:32.826 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1999999999999999e-07 2024-04-25T22:53:32.826 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.826 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.826 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:32.826 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319483+0000", 2024-04-25T22:53:32.826 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4260000000000002e-06 2024-04-25T22:53:32.826 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.827 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.827 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:32.827 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319494+0000", 2024-04-25T22:53:32.827 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.094e-05 2024-04-25T22:53:32.827 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.827 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.827 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:32.827 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319499+0000", 2024-04-25T22:53:32.827 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3789999999999997e-06 2024-04-25T22:53:32.827 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.827 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.827 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:32.827 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319545+0000", 2024-04-25T22:53:32.827 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6149000000000001e-05 2024-04-25T22:53:32.828 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.828 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.828 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:32.828 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319617+0000", 2024-04-25T22:53:32.828 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1792999999999995e-05 2024-04-25T22:53:32.828 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.828 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.828 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:32.828 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326406+0000", 2024-04-25T22:53:32.828 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067895999999999998 2024-04-25T22:53:32.828 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.828 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.828 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:32.828 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326443+0000", 2024-04-25T22:53:32.829 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6828e-05 2024-04-25T22:53:32.829 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:32.829 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:32.829 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:32.829 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326514+0000", 2024-04-25T22:53:32.829 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0236999999999999e-05 2024-04-25T22:53:32.829 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:32.829 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:32.829 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:32.829 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:32.829 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:32.829 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:32.831 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:32.829+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:32.831 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:32.931 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:32.930+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:32.940 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:32.940 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:53:32.941 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.941 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4734.0:1855 4.a 4:53b465fc:::1000000095e.00000000:head [write 0~2449 in=2449b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:32.941 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:53:32.940275+0000", 2024-04-25T22:53:32.941 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00033494900000000002, 2024-04-25T22:53:32.941 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035187899999999998, 2024-04-25T22:53:32.941 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:32.941 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:32.941 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:53:32.941 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:32.941 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4734", 2024-04-25T22:53:32.941 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:32.941 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 1855 2024-04-25T22:53:32.941 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.942 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:32.942 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.942 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:32.942 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:32.940275+0000", 2024-04-25T22:53:32.942 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:32.942 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.942 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.942 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:32.942 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:32.940275+0000", 2024-04-25T22:53:32.942 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:32.942 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.942 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.942 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:32.943 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:32.940276+0000", 2024-04-25T22:53:32.943 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9500000000000001e-07 2024-04-25T22:53:32.943 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.943 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.943 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:32.943 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:32.940281+0000", 2024-04-25T22:53:32.943 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8999999999999997e-06 2024-04-25T22:53:32.943 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.943 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.943 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:32.943 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:32.940293+0000", 2024-04-25T22:53:32.943 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2204999999999999e-05 2024-04-25T22:53:32.944 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.944 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.944 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:32.944 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:32.940301+0000", 2024-04-25T22:53:32.944 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6569999999999997e-06 2024-04-25T22:53:32.944 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.944 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.944 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:32.944 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:32.940345+0000", 2024-04-25T22:53:32.944 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4357000000000002e-05 2024-04-25T22:53:32.944 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:32.944 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:32.944 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:32.945 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:32.940421+0000", 2024-04-25T22:53:32.945 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5568000000000006e-05 2024-04-25T22:53:32.945 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:32.945 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:32.945 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:32.945 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:32.945 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-04-25T22:53:32.945 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 1 2024-04-25T22:53:32.945 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:32.950 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:32.999 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:53:33.034 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:33.033+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:33.101 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:33.101 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:33.101 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:53:33.101 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:53:33.101 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:33.110 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:33.141 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-25T22:53:33.141 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:53:33.142 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:53:33.152 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:33.151+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:33.164 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-25T22:53:33.164 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:53:33.167 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:53:33.168 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:53:33.234 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:33.233+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:33.265 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:33.265 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:33.274 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:33.318 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is unset 2024-04-25T22:53:33.335 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:33.334+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:33.386 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:33.386 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:33.395 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:33.436 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:33.435+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:33.537 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:33.536+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:33.546 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:33.546 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:33.556 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:33.642 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:33.641+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:33.713 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:33.713 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:33.721 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:33.765 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:33.764+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:33.828 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:33.829 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:33.837 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:33.840 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:33.839+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:33.941 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:33.941+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:33.986 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:33.987 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:33.996 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:34.082 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:34.080+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:34.143 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:34.142+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:34.148 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:34.148 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:34.158 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:34.244 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:34.244+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:34.271 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:34.271 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:34.281 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:34.345 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:34.344+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:34.394 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:34.394 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:34.404 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:34.446 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:34.445+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:34.514 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:34.514 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:34.523 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:34.546 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:34.545+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:34.631 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:34.631 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:34.640 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:34.647 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:34.646+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:34.748 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:34.747+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:34.749 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:34.749 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:34.759 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:34.848 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:34.847+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:34.876 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:34.876 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:34.887 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:34.949 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:34.948+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:35.013 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:35.013 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:35.024 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:35.067 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:35.066+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:35.133 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:35.133 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:35.142 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:35.150 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:35.149+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:35.163 INFO:tasks.workunit.client.0.smithi052.stderr:Updating files: 25% (1113/4290) Updating files: 26% (1116/4290) Updating files: 27% (1159/4290) Updating files: 28% (1202/4290) Updating files: 29% (1245/4290) Updating files: 30% (1287/4290) Updating files: 31% (1330/4290) Updating files: 32% (1373/4290) Updating files: 33% (1416/4290) Updating files: 34% (1459/4290) Updating files: 35% (1502/4290) Updating files: 36% (1545/4290) Updating files: 37% (1588/4290) Updating files: 38% (1631/4290) Updating files: 39% (1674/4290) Updating files: 40% (1716/4290) Updating files: 41% (1759/4290) Updating files: 42% (1802/4290) Updating files: 43% (1845/4290) Updating files: 44% (1888/4290) Updating files: 45% (1931/4290) Updating files: 46% (1974/4290) Updating files: 47% (2017/4290) Updating files: 48% (2060/4290) Updating files: 49% (2103/4290) Updating files: 50% (2145/4290) Updating files: 51% (2188/4290) Updating files: 51% (2195/4290) Updating files: 52% (2231/4290) Updating files: 53% (2274/4290) Updating files: 54% (2317/4290) Updating files: 55% (2360/4290) Updating files: 56% (2403/4290) Updating files: 57% (2446/4290) Updating files: 58% (2489/4290) Updating files: 59% (2532/4290) Updating files: 60% (2574/4290) Updating files: 61% (2617/4290) Updating files: 62% (2660/4290) Updating files: 63% (2703/4290) Updating files: 64% (2746/4290) Updating files: 65% (2789/4290) Updating files: 66% (2832/4290) Updating files: 67% (2875/4290) Updating files: 68% (2918/4290) Updating files: 69% (2961/4290) Updating files: 70% (3003/4290) Updating files: 71% (3046/4290) Updating files: 72% (3089/4290) Updating files: 73% (3132/4290) Updating files: 74% (3175/4290) Updating files: 75% (3218/4290) Updating files: 76% (3261/4290) Updating files: 77% (3304/4290) Updating files: 78% (3347/4290) Updating files: 79% (3390/4290) Updating files: 80% (3432/4290) Updating files: 81% (3475/4290) Updating files: 82% (3518/4290) Updating files: 83% (3561/4290) Updating files: 84% (3604/4290) Updating files: 85% (3647/4290) Updating files: 86% (3690/4290) Updating files: 87% (3733/4290) Updating files: 88% (3776/4290) Updating files: 89% (3819/4290) Updating files: 90% (3861/4290) Updating files: 91% (3904/4290) Updating files: 92% (3947/4290) Updating files: 93% (3990/4290) Updating files: 94% (4033/4290) Updating files: 95% (4076/4290) Updating files: 96% (4119/4290) Updating files: 97% (4162/4290) Updating files: 98% (4205/4290) Updating files: 99% (4248/4290) Updating files: 100% (4290/4290) Updating files: 100% (4290/4290), done. 2024-04-25T22:53:35.168 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:53:35.171 INFO:tasks.workunit.client.0.smithi052.stderr:+ cd xfstests-dev 2024-04-25T22:53:35.171 INFO:tasks.workunit.client.0.smithi052.stderr:+ git checkout 12973fc04fd10d4af086901e10ffa8e48866b735 2024-04-25T22:53:35.251 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:35.251+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:35.283 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:35.284 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:35.292 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:35.333 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-25T22:53:35.342 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-25T22:53:35.343 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:53:35.343 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:53:35.352 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:35.351+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:35.377 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-25T22:53:35.377 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:53:35.381 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:53:35.382 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:53:35.395 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:35.396 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:35.396 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-04-25T22:53:35.396 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:35.405 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:35.490 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:35.489+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:35.547 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:35.547 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:35.547 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:53:35.547 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:53:35.547 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:35.553 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:35.552+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:35.555 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:35.655 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:35.654+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:35.699 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:35.699 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-04-25T22:53:35.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-04-25T22:53:35.699 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:53:35.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.699 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:35.699 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:35.699 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 107.731748129, 2024-04-25T22:53:35.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010384338999999999, 2024-04-25T22:53:35.700 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:35.700 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:35.700 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:35.700 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:35.700 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:35.700 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:35.700 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-04-25T22:53:35.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.700 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:35.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:35.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:35.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:35.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:35.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:35.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:35.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:35.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:35.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3600000000000004e-07 2024-04-25T22:53:35.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:35.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965185+0000", 2024-04-25T22:53:35.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.117e-06 2024-04-25T22:53:35.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:35.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965192+0000", 2024-04-25T22:53:35.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3239999999999997e-06 2024-04-25T22:53:35.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:35.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965198+0000", 2024-04-25T22:53:35.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6370000000000004e-06 2024-04-25T22:53:35.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:35.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970973+0000", 2024-04-25T22:53:35.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057748239999999996 2024-04-25T22:53:35.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:35.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971049+0000", 2024-04-25T22:53:35.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6029e-05 2024-04-25T22:53:35.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:35.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971174+0000", 2024-04-25T22:53:35.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012462399999999999 2024-04-25T22:53:35.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:35.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971553+0000", 2024-04-25T22:53:35.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037896499999999999 2024-04-25T22:53:35.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:35.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975482+0000", 2024-04-25T22:53:35.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039297459999999996 2024-04-25T22:53:35.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:35.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975529+0000", 2024-04-25T22:53:35.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6387000000000002e-05 2024-04-25T22:53:35.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:35.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975563+0000", 2024-04-25T22:53:35.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4150000000000003e-05 2024-04-25T22:53:35.705 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:35.705 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:35.705 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:35.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.705 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:35.705 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:35.705 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 102.68470180600001, 2024-04-25T22:53:35.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012637705000000001, 2024-04-25T22:53:35.705 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:35.705 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:35.706 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:35.706 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:35.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:35.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:35.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:35.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:35.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:35.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:35.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:35.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012227+0000", 2024-04-25T22:53:35.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.863e-06 2024-04-25T22:53:35.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:35.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012236+0000", 2024-04-25T22:53:35.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1109999999999997e-06 2024-04-25T22:53:35.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:35.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012309+0000", 2024-04-25T22:53:35.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3242000000000001e-05 2024-04-25T22:53:35.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:35.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012324+0000", 2024-04-25T22:53:35.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4837e-05 2024-04-25T22:53:35.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:35.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015060+0000", 2024-04-25T22:53:35.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027363349999999999 2024-04-25T22:53:35.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:35.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015169+0000", 2024-04-25T22:53:35.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108372 2024-04-25T22:53:35.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:35.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015498+0000", 2024-04-25T22:53:35.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032949999999999999 2024-04-25T22:53:35.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:35.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021282+0000", 2024-04-25T22:53:35.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057836429999999998 2024-04-25T22:53:35.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:35.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024709+0000", 2024-04-25T22:53:35.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034271979999999998 2024-04-25T22:53:35.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:35.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024802+0000", 2024-04-25T22:53:35.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2960000000000004e-05 2024-04-25T22:53:35.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:35.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024863+0000", 2024-04-25T22:53:35.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0643999999999997e-05 2024-04-25T22:53:35.710 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:35.710 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:35.710 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:35.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.711 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:35.711 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:35.711 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 102.684578035, 2024-04-25T22:53:35.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012979447999999999, 2024-04-25T22:53:35.711 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:35.711 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:35.711 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:35.711 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:35.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:35.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:35.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:35.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:35.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:35.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:35.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:35.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:35.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:53:35.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:35.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012354+0000", 2024-04-25T22:53:35.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7740000000000004e-06 2024-04-25T22:53:35.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:35.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012365+0000", 2024-04-25T22:53:35.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.064e-05 2024-04-25T22:53:35.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:35.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012382+0000", 2024-04-25T22:53:35.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6999000000000001e-05 2024-04-25T22:53:35.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:35.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015958+0000", 2024-04-25T22:53:35.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035765699999999998 2024-04-25T22:53:35.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:35.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016037+0000", 2024-04-25T22:53:35.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8242000000000001e-05 2024-04-25T22:53:35.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:35.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016404+0000", 2024-04-25T22:53:35.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036784300000000002 2024-04-25T22:53:35.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:35.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021294+0000", 2024-04-25T22:53:35.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048890629999999999 2024-04-25T22:53:35.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:35.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024959+0000", 2024-04-25T22:53:35.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036651570000000001 2024-04-25T22:53:35.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:35.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025097+0000", 2024-04-25T22:53:35.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013788099999999999 2024-04-25T22:53:35.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:35.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025328+0000", 2024-04-25T22:53:35.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231492 2024-04-25T22:53:35.716 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:35.716 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:35.716 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:35.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.717 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:35.717 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:35.717 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 102.684490266, 2024-04-25T22:53:35.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013049827, 2024-04-25T22:53:35.717 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:35.717 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:35.717 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:35.718 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:35.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:35.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:35.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:35.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:35.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:35.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:35.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:35.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012437+0000", 2024-04-25T22:53:35.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-04-25T22:53:35.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:35.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012440+0000", 2024-04-25T22:53:35.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7609999999999999e-06 2024-04-25T22:53:35.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:35.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012449+0000", 2024-04-25T22:53:35.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.285e-06 2024-04-25T22:53:35.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:35.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012457+0000", 2024-04-25T22:53:35.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9510000000000006e-06 2024-04-25T22:53:35.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:35.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017106+0000", 2024-04-25T22:53:35.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046494220000000003 2024-04-25T22:53:35.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:35.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017223+0000", 2024-04-25T22:53:35.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116824 2024-04-25T22:53:35.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:35.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017345+0000", 2024-04-25T22:53:35.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122175 2024-04-25T22:53:35.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:35.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021299+0000", 2024-04-25T22:53:35.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039534879999999998 2024-04-25T22:53:35.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:35.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025398+0000", 2024-04-25T22:53:35.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040988960000000003 2024-04-25T22:53:35.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:35.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025439+0000", 2024-04-25T22:53:35.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0915999999999999e-05 2024-04-25T22:53:35.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:35.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025486+0000", 2024-04-25T22:53:35.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7534999999999998e-05 2024-04-25T22:53:35.722 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:35.722 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:35.722 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:35.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.723 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:35.723 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:35.723 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 102.68446011499999, 2024-04-25T22:53:35.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020988041999999998, 2024-04-25T22:53:35.723 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:35.723 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:35.723 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:35.723 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:35.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:35.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:35.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:35.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:35.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:35.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:35.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:35.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:35.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.99e-07 2024-04-25T22:53:35.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:35.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012470+0000", 2024-04-25T22:53:35.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2789999999999999e-06 2024-04-25T22:53:35.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:35.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012477+0000", 2024-04-25T22:53:35.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:53:35.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:35.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012500+0000", 2024-04-25T22:53:35.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2490999999999999e-05 2024-04-25T22:53:35.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:35.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021911+0000", 2024-04-25T22:53:35.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094114160000000006 2024-04-25T22:53:35.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:35.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022000+0000", 2024-04-25T22:53:35.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8601000000000001e-05 2024-04-25T22:53:35.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:35.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022359+0000", 2024-04-25T22:53:35.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035921999999999999 2024-04-25T22:53:35.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:35.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025541+0000", 2024-04-25T22:53:35.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031820619999999998 2024-04-25T22:53:35.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:35.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033375+0000", 2024-04-25T22:53:35.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078338379999999992 2024-04-25T22:53:35.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:35.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033415+0000", 2024-04-25T22:53:35.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9527000000000003e-05 2024-04-25T22:53:35.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:35.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033455+0000", 2024-04-25T22:53:35.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9932000000000003e-05 2024-04-25T22:53:35.728 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:35.728 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:35.728 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:35.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.728 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:35.728 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:35.728 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 102.684404922, 2024-04-25T22:53:35.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021043857999999999, 2024-04-25T22:53:35.728 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:35.728 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:35.728 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:35.728 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:35.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:35.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:35.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:35.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:35.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:35.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:35.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:35.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012523+0000", 2024-04-25T22:53:35.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.361e-06 2024-04-25T22:53:35.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:35.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012530+0000", 2024-04-25T22:53:35.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5440000000000004e-06 2024-04-25T22:53:35.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:35.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012541+0000", 2024-04-25T22:53:35.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1745e-05 2024-04-25T22:53:35.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:35.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012551+0000", 2024-04-25T22:53:35.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5789999999999993e-06 2024-04-25T22:53:35.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:35.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022709+0000", 2024-04-25T22:53:35.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010157685 2024-04-25T22:53:35.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:35.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022957+0000", 2024-04-25T22:53:35.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024824599999999998 2024-04-25T22:53:35.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:35.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023443+0000", 2024-04-25T22:53:35.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048578599999999999 2024-04-25T22:53:35.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:35.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025547+0000", 2024-04-25T22:53:35.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021044789999999998 2024-04-25T22:53:35.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:35.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033509+0000", 2024-04-25T22:53:35.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0079622180000000001 2024-04-25T22:53:35.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:35.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033542+0000", 2024-04-25T22:53:35.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3018000000000001e-05 2024-04-25T22:53:35.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:35.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033566+0000", 2024-04-25T22:53:35.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3197000000000002e-05 2024-04-25T22:53:35.733 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:35.733 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:35.733 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:35.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.733 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:35.734 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:35.734 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 102.684364957, 2024-04-25T22:53:35.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021122696, 2024-04-25T22:53:35.734 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:35.734 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:35.734 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:35.734 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:35.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:35.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:35.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:35.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:35.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:35.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:35.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:35.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:35.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:53:35.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:35.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012566+0000", 2024-04-25T22:53:35.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-04-25T22:53:35.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:35.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012619+0000", 2024-04-25T22:53:35.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2607e-05 2024-04-25T22:53:35.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:35.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012628+0000", 2024-04-25T22:53:35.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6500000000000008e-06 2024-04-25T22:53:35.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:35.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024024+0000", 2024-04-25T22:53:35.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011396007999999999 2024-04-25T22:53:35.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:35.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024198+0000", 2024-04-25T22:53:35.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000173215 2024-04-25T22:53:35.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:35.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024447+0000", 2024-04-25T22:53:35.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024898500000000002 2024-04-25T22:53:35.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:35.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026431+0000", 2024-04-25T22:53:35.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001984923 2024-04-25T22:53:35.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:35.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033608+0000", 2024-04-25T22:53:35.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071768459999999997 2024-04-25T22:53:35.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:35.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033646+0000", 2024-04-25T22:53:35.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299000000000003e-05 2024-04-25T22:53:35.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:35.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033684+0000", 2024-04-25T22:53:35.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8773000000000003e-05 2024-04-25T22:53:35.739 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:35.739 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:35.739 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:35.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.739 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:35.739 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:35.739 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 102.68427635800001, 2024-04-25T22:53:35.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021175381, 2024-04-25T22:53:35.739 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:35.739 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:35.739 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:35.740 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:35.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:35.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:35.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:35.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:35.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:35.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:35.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:35.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012651+0000", 2024-04-25T22:53:35.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:53:35.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:35.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012656+0000", 2024-04-25T22:53:35.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8899999999999998e-06 2024-04-25T22:53:35.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:35.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012666+0000", 2024-04-25T22:53:35.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0346999999999999e-05 2024-04-25T22:53:35.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:35.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012675+0000", 2024-04-25T22:53:35.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9930000000000001e-06 2024-04-25T22:53:35.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:35.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025661+0000", 2024-04-25T22:53:35.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01298531 2024-04-25T22:53:35.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:35.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025757+0000", 2024-04-25T22:53:35.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5822000000000005e-05 2024-04-25T22:53:35.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:35.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025907+0000", 2024-04-25T22:53:35.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015051499999999999 2024-04-25T22:53:35.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:35.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026435+0000", 2024-04-25T22:53:35.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052762200000000005 2024-04-25T22:53:35.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:35.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033732+0000", 2024-04-25T22:53:35.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072978419999999997 2024-04-25T22:53:35.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:35.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033787+0000", 2024-04-25T22:53:35.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4703999999999997e-05 2024-04-25T22:53:35.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:35.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033826+0000", 2024-04-25T22:53:35.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8458999999999999e-05 2024-04-25T22:53:35.744 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:35.744 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:35.745 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:35.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.745 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:35.746 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:35.746 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 102.684220944, 2024-04-25T22:53:35.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021244174000000001, 2024-04-25T22:53:35.746 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:35.746 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:35.746 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:35.746 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:35.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:35.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:35.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:35.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:35.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:35.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:35.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:35.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:35.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:35.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:35.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012712+0000", 2024-04-25T22:53:35.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.913e-06 2024-04-25T22:53:35.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:35.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012722+0000", 2024-04-25T22:53:35.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2879999999999998e-06 2024-04-25T22:53:35.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:35.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012727+0000", 2024-04-25T22:53:35.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8429999999999998e-06 2024-04-25T22:53:35.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:35.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026099+0000", 2024-04-25T22:53:35.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013371450999999999 2024-04-25T22:53:35.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:35.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026147+0000", 2024-04-25T22:53:35.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7837999999999998e-05 2024-04-25T22:53:35.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:35.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026254+0000", 2024-04-25T22:53:35.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107314 2024-04-25T22:53:35.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:35.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026686+0000", 2024-04-25T22:53:35.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000432428 2024-04-25T22:53:35.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:35.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033873+0000", 2024-04-25T22:53:35.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071864399999999997 2024-04-25T22:53:35.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:35.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033904+0000", 2024-04-25T22:53:35.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1321e-05 2024-04-25T22:53:35.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:35.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033950+0000", 2024-04-25T22:53:35.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5707999999999997e-05 2024-04-25T22:53:35.752 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:35.752 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:35.752 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:35.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.752 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:35.752 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:35.752 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 102.684190559, 2024-04-25T22:53:35.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01096505, 2024-04-25T22:53:35.752 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:35.752 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:35.753 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:35.753 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:35.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:35.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:35.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:35.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:35.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:35.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:35.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:35.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012737+0000", 2024-04-25T22:53:35.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:35.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:35.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012739+0000", 2024-04-25T22:53:35.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-04-25T22:53:35.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:35.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012743+0000", 2024-04-25T22:53:35.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3239999999999996e-06 2024-04-25T22:53:35.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:35.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012746+0000", 2024-04-25T22:53:35.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.129e-06 2024-04-25T22:53:35.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:35.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012796+0000", 2024-04-25T22:53:35.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9231999999999999e-05 2024-04-25T22:53:35.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:35.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012915+0000", 2024-04-25T22:53:35.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119021 2024-04-25T22:53:35.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:35.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013069+0000", 2024-04-25T22:53:35.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015463900000000001 2024-04-25T22:53:35.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:35.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019237+0000", 2024-04-25T22:53:35.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061680329999999998 2024-04-25T22:53:35.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:35.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023603+0000", 2024-04-25T22:53:35.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043655860000000003 2024-04-25T22:53:35.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:35.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023659+0000", 2024-04-25T22:53:35.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6484000000000003e-05 2024-04-25T22:53:35.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:35.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023701+0000", 2024-04-25T22:53:35.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1761999999999998e-05 2024-04-25T22:53:35.759 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:35.759 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:35.759 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:35.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.760 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:35.760 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:35.760 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 102.684165611, 2024-04-25T22:53:35.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011234429000000001, 2024-04-25T22:53:35.760 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:35.760 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:35.761 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:35.761 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:35.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:35.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:35.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:35.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:35.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:35.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:35.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:35.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012762+0000", 2024-04-25T22:53:35.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-04-25T22:53:35.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:35.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012765+0000", 2024-04-25T22:53:35.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2569999999999999e-06 2024-04-25T22:53:35.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:35.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012783+0000", 2024-04-25T22:53:35.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8431999999999999e-05 2024-04-25T22:53:35.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:35.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012799+0000", 2024-04-25T22:53:35.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5438999999999999e-05 2024-04-25T22:53:35.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:35.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013826+0000", 2024-04-25T22:53:35.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010275060000000001 2024-04-25T22:53:35.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:35.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013913+0000", 2024-04-25T22:53:35.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.708e-05 2024-04-25T22:53:35.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:35.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014098+0000", 2024-04-25T22:53:35.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018519399999999999 2024-04-25T22:53:35.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:35.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019684+0000", 2024-04-25T22:53:35.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055860079999999999 2024-04-25T22:53:35.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:35.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023876+0000", 2024-04-25T22:53:35.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041918800000000003 2024-04-25T22:53:35.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:35.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023957+0000", 2024-04-25T22:53:35.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1165e-05 2024-04-25T22:53:35.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:35.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023995+0000", 2024-04-25T22:53:35.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:53:35.771 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:35.771 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:35.771 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:35.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.772 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:35.772 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:35.772 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 102.684067832, 2024-04-25T22:53:35.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011131200000000001, 2024-04-25T22:53:35.772 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:35.773 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:35.773 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:35.773 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:35.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:35.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:35.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:35.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:35.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:35.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:35.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:35.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012860+0000", 2024-04-25T22:53:35.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3900000000000004e-07 2024-04-25T22:53:35.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:35.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012865+0000", 2024-04-25T22:53:35.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5609999999999998e-06 2024-04-25T22:53:35.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:35.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012895+0000", 2024-04-25T22:53:35.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9847000000000001e-05 2024-04-25T22:53:35.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:35.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012905+0000", 2024-04-25T22:53:35.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.03e-05 2024-04-25T22:53:35.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:35.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015020+0000", 2024-04-25T22:53:35.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021142940000000001 2024-04-25T22:53:35.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:35.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015182+0000", 2024-04-25T22:53:35.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016248099999999999 2024-04-25T22:53:35.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:35.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015357+0000", 2024-04-25T22:53:35.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017471000000000001 2024-04-25T22:53:35.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:35.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021021+0000", 2024-04-25T22:53:35.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056638340000000004 2024-04-25T22:53:35.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:35.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023712+0000", 2024-04-25T22:53:35.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026910380000000002 2024-04-25T22:53:35.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:35.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023763+0000", 2024-04-25T22:53:35.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1477999999999997e-05 2024-04-25T22:53:35.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:35.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023990+0000", 2024-04-25T22:53:35.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000226818 2024-04-25T22:53:35.781 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:35.781 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:35.781 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:35.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.781 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:35.782 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:35.782 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 102.683944736, 2024-04-25T22:53:35.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011705299000000001, 2024-04-25T22:53:35.782 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:35.782 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:35.782 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:35.782 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:35.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:35.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:35.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:35.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:35.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:35.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:35.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:35.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012983+0000", 2024-04-25T22:53:35.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:53:35.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:35.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012986+0000", 2024-04-25T22:53:35.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5700000000000001e-06 2024-04-25T22:53:35.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:35.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012993+0000", 2024-04-25T22:53:35.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8730000000000001e-06 2024-04-25T22:53:35.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:35.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013000+0000", 2024-04-25T22:53:35.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1890000000000001e-06 2024-04-25T22:53:35.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:35.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:53:35.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002147866 2024-04-25T22:53:35.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:35.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015351+0000", 2024-04-25T22:53:35.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020300799999999999 2024-04-25T22:53:35.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:35.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016260+0000", 2024-04-25T22:53:35.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00090926799999999997 2024-04-25T22:53:35.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:35.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022669+0000", 2024-04-25T22:53:35.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064082849999999997 2024-04-25T22:53:35.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:35.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024584+0000", 2024-04-25T22:53:35.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019151699999999999 2024-04-25T22:53:35.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:35.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024643+0000", 2024-04-25T22:53:35.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8888999999999998e-05 2024-04-25T22:53:35.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:35.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024687+0000", 2024-04-25T22:53:35.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4444999999999999e-05 2024-04-25T22:53:35.787 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:35.787 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:35.787 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:35.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.787 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:35.787 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:35.787 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 102.683917145, 2024-04-25T22:53:35.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011249699, 2024-04-25T22:53:35.787 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:35.788 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:35.788 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:35.788 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:35.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:35.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:35.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:35.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:35.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:35.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:35.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:35.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013010+0000", 2024-04-25T22:53:35.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2099999999999996e-07 2024-04-25T22:53:35.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:35.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013013+0000", 2024-04-25T22:53:35.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1310000000000002e-06 2024-04-25T22:53:35.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:35.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013020+0000", 2024-04-25T22:53:35.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3330000000000002e-06 2024-04-25T22:53:35.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:35.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013025+0000", 2024-04-25T22:53:35.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6760000000000004e-06 2024-04-25T22:53:35.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:35.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013163+0000", 2024-04-25T22:53:35.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013824599999999999 2024-04-25T22:53:35.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:35.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013504+0000", 2024-04-25T22:53:35.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034080299999999998 2024-04-25T22:53:35.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:35.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013613+0000", 2024-04-25T22:53:35.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108705 2024-04-25T22:53:35.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:35.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015831+0000", 2024-04-25T22:53:35.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002217672 2024-04-25T22:53:35.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:35.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024137+0000", 2024-04-25T22:53:35.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0083060489999999994 2024-04-25T22:53:35.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:35.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024218+0000", 2024-04-25T22:53:35.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1351000000000001e-05 2024-04-25T22:53:35.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:35.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024259+0000", 2024-04-25T22:53:35.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1112000000000002e-05 2024-04-25T22:53:35.792 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:35.793 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:35.793 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:35.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.793 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:35.793 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:35.793 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 102.68382941900001, 2024-04-25T22:53:35.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020379749999999999, 2024-04-25T22:53:35.793 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:35.793 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:35.793 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:35.793 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:35.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:35.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:35.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:35.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:35.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:35.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:35.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:35.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013098+0000", 2024-04-25T22:53:35.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:53:35.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:35.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013105+0000", 2024-04-25T22:53:35.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5969999999999997e-06 2024-04-25T22:53:35.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:35.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013190+0000", 2024-04-25T22:53:35.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5618999999999995e-05 2024-04-25T22:53:35.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:35.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013200+0000", 2024-04-25T22:53:35.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5859999999999994e-06 2024-04-25T22:53:35.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:35.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020265+0000", 2024-04-25T22:53:35.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070653349999999998 2024-04-25T22:53:35.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:35.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020454+0000", 2024-04-25T22:53:35.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189316 2024-04-25T22:53:35.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:35.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020586+0000", 2024-04-25T22:53:35.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013195700000000001 2024-04-25T22:53:35.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:35.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023822+0000", 2024-04-25T22:53:35.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032358529999999999 2024-04-25T22:53:35.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:35.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033409+0000", 2024-04-25T22:53:35.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095870520000000004 2024-04-25T22:53:35.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:35.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033447+0000", 2024-04-25T22:53:35.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7261999999999997e-05 2024-04-25T22:53:35.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:35.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033477+0000", 2024-04-25T22:53:35.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0389e-05 2024-04-25T22:53:35.798 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:35.798 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:35.798 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:35.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.799 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:35.799 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:35.799 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 102.68371291299999, 2024-04-25T22:53:35.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010857383999999999, 2024-04-25T22:53:35.799 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:35.799 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:35.799 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:35.799 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:35.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:35.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:35.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:35.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:35.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:35.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:35.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:35.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:35.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:35.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:35.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013218+0000", 2024-04-25T22:53:35.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8199999999999998e-06 2024-04-25T22:53:35.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:35.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013226+0000", 2024-04-25T22:53:35.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7649999999999993e-06 2024-04-25T22:53:35.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:35.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013259+0000", 2024-04-25T22:53:35.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2727e-05 2024-04-25T22:53:35.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:35.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014809+0000", 2024-04-25T22:53:35.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001550144 2024-04-25T22:53:35.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:35.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014958+0000", 2024-04-25T22:53:35.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014890300000000001 2024-04-25T22:53:35.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:35.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015087+0000", 2024-04-25T22:53:35.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012939200000000001 2024-04-25T22:53:35.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:35.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020212+0000", 2024-04-25T22:53:35.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051248939999999996 2024-04-25T22:53:35.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:35.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023699+0000", 2024-04-25T22:53:35.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034873289999999999 2024-04-25T22:53:35.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:35.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024014+0000", 2024-04-25T22:53:35.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031473999999999999 2024-04-25T22:53:35.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:35.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024071+0000", 2024-04-25T22:53:35.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7040000000000003e-05 2024-04-25T22:53:35.804 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:35.804 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:35.804 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:35.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.804 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:35.804 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:35.804 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 102.683658208, 2024-04-25T22:53:35.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012329677000000001, 2024-04-25T22:53:35.804 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:35.804 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:35.804 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:35.805 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:35.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:35.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:35.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:35.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:35.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:35.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:35.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:35.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013269+0000", 2024-04-25T22:53:35.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5000000000000002e-07 2024-04-25T22:53:35.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:35.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:35.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6909999999999999e-06 2024-04-25T22:53:35.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:35.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013284+0000", 2024-04-25T22:53:35.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0963e-05 2024-04-25T22:53:35.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:35.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013361+0000", 2024-04-25T22:53:35.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7379999999999994e-05 2024-04-25T22:53:35.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:35.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013448+0000", 2024-04-25T22:53:35.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6990000000000006e-05 2024-04-25T22:53:35.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:35.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013632+0000", 2024-04-25T22:53:35.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018396800000000001 2024-04-25T22:53:35.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:35.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013800+0000", 2024-04-25T22:53:35.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167467 2024-04-25T22:53:35.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:35.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.018570+0000", 2024-04-25T22:53:35.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047701460000000003 2024-04-25T22:53:35.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:35.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025507+0000", 2024-04-25T22:53:35.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069372039999999998 2024-04-25T22:53:35.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:35.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025562+0000", 2024-04-25T22:53:35.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4858999999999998e-05 2024-04-25T22:53:35.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:35.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025598+0000", 2024-04-25T22:53:35.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6259e-05 2024-04-25T22:53:35.809 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:35.809 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:35.809 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:35.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.810 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:35.810 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:35.810 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 102.683526335, 2024-04-25T22:53:35.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020176666999999999, 2024-04-25T22:53:35.810 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:35.810 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:35.810 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:53:35.810 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:35.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:35.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:35.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:35.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:35.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:35.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:35.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:35.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:35.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-04-25T22:53:35.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:35.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013405+0000", 2024-04-25T22:53:35.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0559999999999998e-06 2024-04-25T22:53:35.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:35.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013422+0000", 2024-04-25T22:53:35.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6770999999999999e-05 2024-04-25T22:53:35.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:35.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013431+0000", 2024-04-25T22:53:35.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5019999999999998e-06 2024-04-25T22:53:35.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:35.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021720+0000", 2024-04-25T22:53:35.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082884340000000008 2024-04-25T22:53:35.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:35.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022122+0000", 2024-04-25T22:53:35.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000401634 2024-04-25T22:53:35.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:35.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033577+0000", 2024-04-25T22:53:35.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011455435999999999 2024-04-25T22:53:35.813 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:35.813 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:35.813 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:35.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.813 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4734.0:31 4.1b 4:d9872866:::1000000021d.00000002:head [write 0~3618035] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-25T22:53:35.814 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:53:35.814 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.6439520730000003, 2024-04-25T22:53:35.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011647062, 2024-04-25T22:53:35.814 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:35.814 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:35.814 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:35.814 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:35.814 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4734", 2024-04-25T22:53:35.814 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:35.814 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 31 2024-04-25T22:53:35.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.814 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:35.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:35.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:53:35.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:35.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:35.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:53:35.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:35.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:35.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:53:35.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5700000000000001e-07 2024-04-25T22:53:35.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:35.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059575+0000", 2024-04-25T22:53:35.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0065991380000000001 2024-04-25T22:53:35.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:35.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059586+0000", 2024-04-25T22:53:35.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1438e-05 2024-04-25T22:53:35.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:35.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059592+0000", 2024-04-25T22:53:35.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2899999999999999e-06 2024-04-25T22:53:35.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:35.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059660+0000", 2024-04-25T22:53:35.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7980999999999998e-05 2024-04-25T22:53:35.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:35.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059757+0000", 2024-04-25T22:53:35.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6340000000000003e-05 2024-04-25T22:53:35.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:35.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.064487+0000", 2024-04-25T22:53:35.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004730621 2024-04-25T22:53:35.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:35.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.064538+0000", 2024-04-25T22:53:35.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0801999999999999e-05 2024-04-25T22:53:35.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:35.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.064622+0000", 2024-04-25T22:53:35.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3595000000000002e-05 2024-04-25T22:53:35.818 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:35.818 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:35.818 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:35.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.819 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:97 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-25T22:53:35.819 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:53:33.026298+0000", 2024-04-25T22:53:35.819 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 2.6706282589999999, 2024-04-25T22:53:35.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015641848999999999, 2024-04-25T22:53:35.819 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:35.819 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:35.819 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:35.819 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:35.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:35.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026298+0000", 2024-04-25T22:53:35.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:35.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:35.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026298+0000", 2024-04-25T22:53:35.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:35.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:35.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026299+0000", 2024-04-25T22:53:35.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7299999999999996e-07 2024-04-25T22:53:35.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:35.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026464+0000", 2024-04-25T22:53:35.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016477700000000001 2024-04-25T22:53:35.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:35.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026472+0000", 2024-04-25T22:53:35.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1589999999999993e-06 2024-04-25T22:53:35.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:35.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026476+0000", 2024-04-25T22:53:35.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4580000000000003e-06 2024-04-25T22:53:35.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:35.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026550+0000", 2024-04-25T22:53:35.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3836000000000003e-05 2024-04-25T22:53:35.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.822 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:35.822 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026644+0000", 2024-04-25T22:53:35.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4022000000000002e-05 2024-04-25T22:53:35.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.822 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:35.822 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.041838+0000", 2024-04-25T22:53:35.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015193814999999999 2024-04-25T22:53:35.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.822 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:35.822 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.041874+0000", 2024-04-25T22:53:35.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5856999999999999e-05 2024-04-25T22:53:35.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:35.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:35.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:35.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.041940+0000", 2024-04-25T22:53:35.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6352000000000004e-05 2024-04-25T22:53:35.823 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:35.823 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:35.823 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:35.823 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:35.823 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:35.823 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:35.825 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:35.825 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:35.824+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:35.925 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:35.925+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:35.928 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:35.929 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:35.929 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-25T22:53:35.929 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:35.937 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:36.026 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:36.026+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:36.039 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:36.039 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:36.039 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-25T22:53:36.039 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-25T22:53:36.039 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:36.048 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:36.127 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~53s 2024-04-25T22:53:36.128 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:36.127+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:36.152 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:36.152 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:53:36.152 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:53:36.152 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:53:36.152 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.152 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:53:36.152 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:36.152 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 108.183325611, 2024-04-25T22:53:36.153 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:53:36.153 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:36.153 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:36.153 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:36.153 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:36.153 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.153 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:36.153 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:36.153 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:36.153 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.154 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.154 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:36.154 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:36.154 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:36.154 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.154 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.154 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:36.154 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:53:36.154 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:53:36.154 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.154 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.154 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:36.155 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:53:36.155 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:53:36.155 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.155 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.155 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:36.155 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:53:36.155 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:53:36.155 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.155 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.155 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:36.156 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:53:36.156 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:53:36.156 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.156 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.156 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:36.156 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:53:36.156 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:53:36.156 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.156 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.156 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:36.156 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:53:36.156 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:53:36.157 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.157 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.157 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:36.157 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:53:36.157 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:53:36.157 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.157 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.157 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:36.157 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:53:36.157 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:53:36.157 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:36.157 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:36.157 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:36.157 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.158 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.158 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:110 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'72, mlcod=10'68)", 2024-04-25T22:53:36.158 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:36.158 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 108.182691611, 2024-04-25T22:53:36.158 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065316630000000001, 2024-04-25T22:53:36.158 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:36.158 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:36.158 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:36.158 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:36.158 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.158 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:36.158 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:36.158 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:36.158 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.159 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.159 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:36.159 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:36.159 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:36.159 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.159 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.159 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:36.159 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:36.159 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.58e-07 2024-04-25T22:53:36.159 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.159 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.160 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:36.160 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967811+0000", 2024-04-25T22:53:36.160 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.118e-06 2024-04-25T22:53:36.160 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.160 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.160 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:36.160 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967817+0000", 2024-04-25T22:53:36.160 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3709999999999996e-06 2024-04-25T22:53:36.160 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.160 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.160 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:36.160 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967820+0000", 2024-04-25T22:53:36.160 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2210000000000002e-06 2024-04-25T22:53:36.161 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.161 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.161 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:36.161 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967876+0000", 2024-04-25T22:53:36.161 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5507000000000002e-05 2024-04-25T22:53:36.161 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.161 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.161 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:36.161 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967893+0000", 2024-04-25T22:53:36.161 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7812000000000002e-05 2024-04-25T22:53:36.161 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.161 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.162 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:36.162 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974317+0000", 2024-04-25T22:53:36.162 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064237160000000003 2024-04-25T22:53:36.162 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.162 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.162 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:36.162 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:53:36.162 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.156e-05 2024-04-25T22:53:36.162 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:36.162 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:36.162 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:36.162 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.163 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.163 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:111 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'73, mlcod=10'68)", 2024-04-25T22:53:36.163 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:36.163 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 108.18227409799999, 2024-04-25T22:53:36.163 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0061292279999999996, 2024-04-25T22:53:36.163 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:36.163 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:36.163 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:36.163 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:36.163 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.163 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:36.163 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:36.163 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:36.164 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.164 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.164 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:36.164 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:36.164 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:36.164 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.164 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.164 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:36.164 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968225+0000", 2024-04-25T22:53:36.164 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6300000000000001e-07 2024-04-25T22:53:36.164 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.164 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.164 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:36.164 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968228+0000", 2024-04-25T22:53:36.165 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.6139999999999999e-06 2024-04-25T22:53:36.165 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.165 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.165 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:36.165 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968235+0000", 2024-04-25T22:53:36.165 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7020000000000001e-06 2024-04-25T22:53:36.165 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.166 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.166 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:36.166 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968238+0000", 2024-04-25T22:53:36.166 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.0010000000000002e-06 2024-04-25T22:53:36.166 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.166 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.166 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:36.166 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968297+0000", 2024-04-25T22:53:36.167 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8424999999999997e-05 2024-04-25T22:53:36.167 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.167 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.167 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:36.167 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.968316+0000", 2024-04-25T22:53:36.167 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.8814999999999999e-05 2024-04-25T22:53:36.167 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.167 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.167 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:36.167 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:53:36.167 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0060239439999999998 2024-04-25T22:53:36.167 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.167 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.168 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:36.168 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974354+0000", 2024-04-25T22:53:36.168 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4364e-05 2024-04-25T22:53:36.168 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:36.168 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:36.168 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:36.168 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.168 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.168 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:36.168 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:36.168 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 103.13882991200001, 2024-04-25T22:53:36.168 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:53:36.168 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:36.169 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:36.169 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:36.169 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:36.169 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.169 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:36.170 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:36.170 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:36.170 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.170 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.170 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:36.170 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:36.170 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:36.170 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.170 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.170 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:36.170 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:53:36.170 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:53:36.170 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.171 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.171 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:36.171 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:53:36.171 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:53:36.171 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.171 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.171 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:36.171 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:53:36.171 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:53:36.171 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.171 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.171 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:36.171 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:53:36.171 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:53:36.172 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.172 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.172 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:36.172 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:53:36.172 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:53:36.172 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.172 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.172 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:36.172 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:53:36.172 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:53:36.172 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.172 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.172 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:36.173 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:53:36.173 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:53:36.173 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.173 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.173 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:36.173 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:53:36.173 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:53:36.173 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.173 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.173 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:36.173 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:53:36.173 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:53:36.173 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.173 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.174 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:36.174 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:53:36.174 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:53:36.174 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.174 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.174 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:36.174 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:53:36.174 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:53:36.174 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:36.174 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:36.174 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:36.174 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.174 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.174 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:36.175 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:36.175 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 103.138155536, 2024-04-25T22:53:36.175 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:53:36.175 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:36.175 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:36.175 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:36.175 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:36.175 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.175 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:36.175 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:36.175 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:36.175 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.175 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.176 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:36.176 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:36.176 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:36.176 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.176 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.176 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:36.176 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:53:36.176 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:53:36.176 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.176 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.176 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:36.176 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:53:36.176 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:53:36.176 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.177 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.177 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:36.177 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:53:36.177 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:53:36.177 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.177 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.177 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:36.177 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:53:36.177 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:53:36.177 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.177 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.177 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:36.177 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:53:36.177 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:53:36.178 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.178 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.178 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:36.178 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:53:36.178 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:53:36.178 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.178 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.178 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:36.178 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:53:36.178 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:53:36.178 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.178 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.178 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:36.178 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:53:36.179 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:53:36.179 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.179 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.179 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:36.179 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:53:36.179 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:53:36.179 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.179 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.179 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:36.179 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:53:36.179 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:53:36.179 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.179 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.179 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:36.179 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:53:36.180 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:53:36.180 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:36.180 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:36.180 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:36.180 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.180 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.180 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:36.180 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:36.180 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 103.137646324, 2024-04-25T22:53:36.180 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:53:36.180 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:36.180 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:36.180 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:36.180 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:36.181 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.181 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:36.181 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:36.181 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:36.181 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.181 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.181 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:36.181 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:36.181 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:36.181 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.181 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.181 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:36.181 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:53:36.181 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:53:36.182 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.182 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.182 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:36.182 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:53:36.182 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:53:36.182 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.182 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.182 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:36.182 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:53:36.182 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:53:36.182 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.182 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.182 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:36.183 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:53:36.183 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:53:36.183 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.183 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.183 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:36.183 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:53:36.183 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:53:36.183 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.183 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.183 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:36.183 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:53:36.183 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:53:36.183 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.183 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.184 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:36.184 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:53:36.184 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:53:36.184 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.184 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.184 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:36.184 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:53:36.184 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:53:36.184 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.184 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.184 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:36.184 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:53:36.184 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:53:36.185 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.185 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.185 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:36.185 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:53:36.185 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:53:36.185 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.185 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.185 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:36.185 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:53:36.185 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:53:36.185 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:36.185 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:36.185 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:36.185 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.186 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.186 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:36.186 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:36.186 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 103.137233126, 2024-04-25T22:53:36.186 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:53:36.186 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:36.186 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:36.186 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:36.186 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:36.186 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.186 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:36.186 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:36.186 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:36.187 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.187 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.187 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:36.187 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:36.187 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:36.187 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.187 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.187 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:36.187 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:36.187 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:53:36.187 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.187 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.187 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:36.187 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:36.188 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:53:36.188 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.188 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.188 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:36.188 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:53:36.188 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:53:36.188 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.188 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.188 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:36.188 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:53:36.188 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:53:36.188 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.188 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.188 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:36.188 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:53:36.189 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:53:36.189 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.189 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.189 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:36.189 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:53:36.189 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:53:36.189 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.189 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.189 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:36.189 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:53:36.189 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:53:36.189 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.189 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.189 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:36.190 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:53:36.190 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:53:36.190 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.190 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.190 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:36.190 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:53:36.190 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:53:36.190 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.190 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.190 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:36.190 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:53:36.190 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:53:36.190 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.190 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.191 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:36.191 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:53:36.191 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:53:36.191 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:36.191 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:36.191 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:36.191 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.191 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.191 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:36.191 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:36.191 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 103.13718245600001, 2024-04-25T22:53:36.191 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:53:36.191 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:36.192 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:36.192 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:36.192 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:36.192 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.192 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:36.192 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:36.192 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:36.192 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.192 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.192 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:36.192 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:36.192 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:36.192 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.192 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.193 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:36.193 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:53:36.193 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:53:36.193 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.193 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.193 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:36.193 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:53:36.193 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:53:36.193 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.193 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.193 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:36.193 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:53:36.193 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:53:36.193 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.194 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.194 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:36.194 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:53:36.194 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:53:36.194 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.194 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.194 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:36.194 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:53:36.194 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:53:36.194 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.194 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.194 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:36.194 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:53:36.194 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:53:36.195 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.195 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.195 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:36.195 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:53:36.195 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:53:36.195 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.195 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.195 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:36.195 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:53:36.195 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:53:36.195 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.195 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.195 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:36.195 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:53:36.196 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:53:36.196 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.196 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.196 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:36.196 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:53:36.196 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:53:36.196 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.196 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.196 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:36.196 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:53:36.196 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:53:36.196 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.196 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.196 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:36.197 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:53:36.197 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:53:36.197 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.197 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.197 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:36.197 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:53:36.197 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:53:36.197 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:36.197 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:36.197 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:36.197 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.197 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.197 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:36.198 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:36.198 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 103.13714558700001, 2024-04-25T22:53:36.198 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:53:36.198 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:36.198 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:36.198 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:36.198 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:36.198 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.198 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:36.198 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:36.198 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:36.198 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.198 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.198 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:36.199 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:36.199 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:36.199 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.199 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.199 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:36.199 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:53:36.199 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:53:36.199 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.199 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.199 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:36.199 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:53:36.199 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:53:36.199 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.200 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.200 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:36.200 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:53:36.200 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:53:36.200 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.200 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.200 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:36.200 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:53:36.200 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:53:36.200 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.200 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.200 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:36.200 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:53:36.200 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:53:36.201 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.201 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.201 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:53:36.201 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:53:36.201 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:53:36.201 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.201 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.201 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:36.201 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:53:36.201 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:53:36.201 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.201 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.201 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:36.201 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:53:36.202 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:53:36.202 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.202 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.202 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:36.202 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:53:36.202 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:53:36.202 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.202 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.202 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:36.202 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:53:36.202 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:53:36.202 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.202 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.203 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:36.203 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:53:36.203 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:53:36.203 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.203 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.203 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:36.203 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:53:36.203 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:53:36.203 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.203 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.203 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:36.203 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:53:36.203 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:53:36.203 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:36.204 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:36.204 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:36.204 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.204 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.204 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:36.204 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:36.204 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 103.13712062099999, 2024-04-25T22:53:36.204 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:53:36.204 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:36.204 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:36.204 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:36.204 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:36.204 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.204 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:36.205 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:36.205 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:36.205 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.205 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.205 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:36.205 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:36.205 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:36.205 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.205 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.205 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:36.205 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:53:36.205 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:53:36.205 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.205 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.206 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:36.206 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:53:36.206 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:53:36.206 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.206 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.206 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:36.206 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:36.206 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:53:36.206 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.206 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.206 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:36.206 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:53:36.207 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:53:36.207 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.207 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.207 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:36.207 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:53:36.207 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:53:36.207 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.207 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.207 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:36.207 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:53:36.207 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:53:36.207 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.207 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.207 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:36.208 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:53:36.208 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:53:36.208 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.208 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.208 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:36.208 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:53:36.208 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:53:36.208 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.208 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.208 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:36.208 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:53:36.208 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:53:36.208 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.208 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.209 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:36.209 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:53:36.209 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:53:36.209 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.209 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.209 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:36.209 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:53:36.209 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:53:36.209 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:36.209 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:36.209 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:36.209 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.209 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.209 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:36.210 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:36.210 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 103.137084257, 2024-04-25T22:53:36.210 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:53:36.210 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:36.210 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:36.210 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:36.210 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:36.210 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.210 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:36.210 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:36.210 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:36.210 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.210 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.210 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:36.211 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:36.211 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:36.211 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.211 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.211 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:36.211 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:53:36.211 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:53:36.211 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.211 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.211 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:36.211 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:53:36.211 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:53:36.211 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.212 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.212 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:36.212 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:53:36.212 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:53:36.212 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.212 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.212 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:36.212 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:53:36.212 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:53:36.212 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.212 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.212 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:36.212 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:53:36.212 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:53:36.213 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.213 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.213 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:36.213 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:53:36.213 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:53:36.213 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.213 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.213 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:36.213 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:53:36.213 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:53:36.213 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.213 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.213 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:36.213 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:53:36.214 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:53:36.214 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.214 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.214 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:36.214 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:53:36.214 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:53:36.214 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:36.214 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:36.214 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:36.214 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.214 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.214 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:36.214 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:36.214 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 103.13705317599999, 2024-04-25T22:53:36.215 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:53:36.215 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:36.215 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:36.215 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:36.215 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:36.215 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.215 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:36.215 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:36.215 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:36.215 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.215 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.215 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:36.215 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:36.215 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:36.216 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.216 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.216 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:36.216 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:36.216 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:36.216 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.216 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.216 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:36.216 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:53:36.216 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:53:36.216 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.216 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.217 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:36.217 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:53:36.217 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:53:36.217 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.217 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.217 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:36.217 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:53:36.217 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:53:36.217 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.217 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.217 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:36.217 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:53:36.217 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:53:36.217 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.217 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.218 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:36.218 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:53:36.218 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:53:36.218 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.218 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.218 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:36.218 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:53:36.218 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:53:36.218 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:36.218 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:36.218 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:36.218 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.218 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.219 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:53:36.219 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:36.219 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 103.136612207, 2024-04-25T22:53:36.219 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064881979999999997, 2024-04-25T22:53:36.219 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:36.219 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:36.219 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:36.219 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:36.219 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.219 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:36.219 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:36.219 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:36.219 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.219 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.220 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:36.220 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:36.220 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:36.220 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.220 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.220 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:36.220 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:36.220 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2699999999999999e-07 2024-04-25T22:53:36.220 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.220 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.220 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:36.220 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013898+0000", 2024-04-25T22:53:36.220 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0796e-05 2024-04-25T22:53:36.220 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.220 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.221 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:36.221 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013907+0000", 2024-04-25T22:53:36.221 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5140000000000007e-06 2024-04-25T22:53:36.221 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.221 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.221 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:36.221 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013952+0000", 2024-04-25T22:53:36.221 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4134000000000001e-05 2024-04-25T22:53:36.221 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.221 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.221 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:36.221 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016812+0000", 2024-04-25T22:53:36.221 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028601059999999998 2024-04-25T22:53:36.221 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.222 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.222 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:36.222 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.017052+0000", 2024-04-25T22:53:36.222 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024056500000000001 2024-04-25T22:53:36.222 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.222 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.222 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:36.222 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020350+0000", 2024-04-25T22:53:36.222 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032978320000000001 2024-04-25T22:53:36.222 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.222 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.222 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:36.222 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020375+0000", 2024-04-25T22:53:36.222 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4624e-05 2024-04-25T22:53:36.223 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:36.223 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:36.223 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:36.223 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.223 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.223 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:30 4.31 4:8ebfc112:::1000000021d.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-25T22:53:36.223 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:53:36.223 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 5.0973673059999998, 2024-04-25T22:53:36.223 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015003005, 2024-04-25T22:53:36.223 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:36.223 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:36.223 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:36.223 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:36.223 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:36.224 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:36.224 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 30 2024-04-25T22:53:36.224 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.224 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:36.224 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.224 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:36.224 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:53:36.224 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:36.224 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.224 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.224 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:36.224 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:53:36.224 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:36.224 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.225 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.225 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:36.225 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053133+0000", 2024-04-25T22:53:36.225 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0370000000000001e-06 2024-04-25T22:53:36.225 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.225 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.225 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:36.225 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060377+0000", 2024-04-25T22:53:36.225 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0072431070000000004 2024-04-25T22:53:36.225 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.225 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.225 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:36.225 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060388+0000", 2024-04-25T22:53:36.226 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1285e-05 2024-04-25T22:53:36.226 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.226 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.226 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:36.226 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060394+0000", 2024-04-25T22:53:36.226 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1040000000000003e-06 2024-04-25T22:53:36.226 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.226 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.226 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:36.226 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060483+0000", 2024-04-25T22:53:36.226 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.9345000000000006e-05 2024-04-25T22:53:36.226 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.226 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.227 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:36.227 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060566+0000", 2024-04-25T22:53:36.227 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2237999999999994e-05 2024-04-25T22:53:36.227 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.227 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.227 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:36.227 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068057+0000", 2024-04-25T22:53:36.227 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074912210000000002 2024-04-25T22:53:36.227 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.227 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.227 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:36.227 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068090+0000", 2024-04-25T22:53:36.227 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3501000000000003e-05 2024-04-25T22:53:36.227 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.228 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.228 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:36.228 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068134+0000", 2024-04-25T22:53:36.228 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4166999999999999e-05 2024-04-25T22:53:36.228 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:36.228 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:36.228 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:36.228 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.228 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.228 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:66 4.27 4:e5671758:::1000000024f.00000000:head [write 0~6641] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:36.228 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:36.228 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 4.8372569700000003, 2024-04-25T22:53:36.228 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075166540000000002, 2024-04-25T22:53:36.228 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:36.229 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:36.229 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:36.229 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:36.229 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:36.229 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:36.229 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 66 2024-04-25T22:53:36.229 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.229 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:36.229 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.229 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:36.229 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:36.229 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:36.229 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.229 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.230 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:36.230 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:36.230 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:36.230 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.230 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.230 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:36.230 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:36.230 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4099999999999998e-07 2024-04-25T22:53:36.230 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.230 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.230 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:36.230 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313252+0000", 2024-04-25T22:53:36.230 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5380000000000008e-06 2024-04-25T22:53:36.230 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.231 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.231 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:36.231 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313260+0000", 2024-04-25T22:53:36.231 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2609999999999993e-06 2024-04-25T22:53:36.231 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.231 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.231 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:36.231 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313265+0000", 2024-04-25T22:53:36.231 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4850000000000003e-06 2024-04-25T22:53:36.231 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.231 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.231 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:36.231 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313310+0000", 2024-04-25T22:53:36.231 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5247999999999998e-05 2024-04-25T22:53:36.232 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.232 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.232 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:36.232 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313370+0000", 2024-04-25T22:53:36.232 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0275000000000001e-05 2024-04-25T22:53:36.232 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.232 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.232 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:36.232 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313435+0000", 2024-04-25T22:53:36.232 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4647000000000006e-05 2024-04-25T22:53:36.232 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.232 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.232 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:36.232 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314174+0000", 2024-04-25T22:53:36.233 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00073925 2024-04-25T22:53:36.233 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.233 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.233 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:36.233 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320688+0000", 2024-04-25T22:53:36.233 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.006513418 2024-04-25T22:53:36.233 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.233 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.233 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:36.233 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320736+0000", 2024-04-25T22:53:36.233 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.8114e-05 2024-04-25T22:53:36.233 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.233 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.233 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:36.234 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320758+0000", 2024-04-25T22:53:36.234 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2776999999999999e-05 2024-04-25T22:53:36.234 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:36.234 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:36.234 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:36.234 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.234 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.234 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:68 4.31 4:8fb7f7b7:::10000000251.00000000:head [write 0~2067] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:36.234 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:36.234 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 4.8355711919999997, 2024-04-25T22:53:36.234 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0087011669999999992, 2024-04-25T22:53:36.234 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:36.234 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:36.234 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:36.235 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:36.235 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:36.235 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:36.235 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 68 2024-04-25T22:53:36.235 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.235 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:36.235 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.235 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:36.235 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:36.235 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:36.235 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.235 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.235 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:36.235 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:36.236 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:36.236 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.236 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.236 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:36.236 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:36.236 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:53:36.236 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.236 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.236 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:36.236 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314933+0000", 2024-04-25T22:53:36.236 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5430000000000004e-06 2024-04-25T22:53:36.236 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.236 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.236 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:36.236 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314944+0000", 2024-04-25T22:53:36.237 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.076e-05 2024-04-25T22:53:36.237 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.237 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.237 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:36.237 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314949+0000", 2024-04-25T22:53:36.237 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1019999999999996e-06 2024-04-25T22:53:36.237 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.237 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.237 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:36.237 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314996+0000", 2024-04-25T22:53:36.237 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7018999999999998e-05 2024-04-25T22:53:36.237 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.237 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.238 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:36.238 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315064+0000", 2024-04-25T22:53:36.238 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8738000000000005e-05 2024-04-25T22:53:36.238 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.238 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.238 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:36.238 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323531+0000", 2024-04-25T22:53:36.238 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084664739999999999 2024-04-25T22:53:36.238 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.238 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.238 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:36.238 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323574+0000", 2024-04-25T22:53:36.238 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3449999999999999e-05 2024-04-25T22:53:36.238 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.239 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.239 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:36.239 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323629+0000", 2024-04-25T22:53:36.239 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4296999999999999e-05 2024-04-25T22:53:36.239 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:36.239 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:36.239 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:36.239 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.239 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.239 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4734.0:69 4.32 e46/13 4:4e8c6251:::10000000252.00000000:head v 46'1, mlcod=0'0)", 2024-04-25T22:53:36.239 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:36.239 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 4.8345399239999995, 2024-04-25T22:53:36.239 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076063240000000002, 2024-04-25T22:53:36.239 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:36.240 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:36.240 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:36.240 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:36.240 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.240 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:36.240 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:36.240 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:36.240 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.240 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.240 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:36.240 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:36.240 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:36.240 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.241 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.241 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:36.241 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:36.241 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3099999999999997e-07 2024-04-25T22:53:36.241 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.241 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.241 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:36.241 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315964+0000", 2024-04-25T22:53:36.241 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3229999999999999e-06 2024-04-25T22:53:36.241 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.241 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.241 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:36.241 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315973+0000", 2024-04-25T22:53:36.241 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7249999999999992e-06 2024-04-25T22:53:36.242 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.242 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.242 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:36.242 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315978+0000", 2024-04-25T22:53:36.242 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4830000000000001e-06 2024-04-25T22:53:36.242 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.242 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.242 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:36.242 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.316043+0000", 2024-04-25T22:53:36.242 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.5036000000000005e-05 2024-04-25T22:53:36.242 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.242 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.242 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:36.242 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.316055+0000", 2024-04-25T22:53:36.243 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1973999999999999e-05 2024-04-25T22:53:36.243 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.243 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.243 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:36.243 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323521+0000", 2024-04-25T22:53:36.243 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074660239999999999 2024-04-25T22:53:36.243 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.243 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.243 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:36.243 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323565+0000", 2024-04-25T22:53:36.243 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4128000000000002e-05 2024-04-25T22:53:36.243 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:36.243 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:36.243 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:36.244 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.244 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.244 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4734.0:71 4.5 e46/13 4:a3a50212:::10000000254.00000000:head v 46'4, mlcod=45'2)", 2024-04-25T22:53:36.244 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.317569+0000", 2024-04-25T22:53:36.244 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 4.8329301449999997, 2024-04-25T22:53:36.244 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00602572, 2024-04-25T22:53:36.244 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:36.244 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:36.244 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:36.244 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:36.244 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.244 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:36.244 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.317569+0000", 2024-04-25T22:53:36.244 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:36.244 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.245 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.245 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:36.245 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.317569+0000", 2024-04-25T22:53:36.245 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:36.245 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.245 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.245 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:36.245 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.317569+0000", 2024-04-25T22:53:36.245 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4799999999999998e-07 2024-04-25T22:53:36.245 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.245 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.245 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:36.245 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.317586+0000", 2024-04-25T22:53:36.246 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.6452000000000001e-05 2024-04-25T22:53:36.246 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.246 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.246 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:36.246 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.317595+0000", 2024-04-25T22:53:36.246 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.8050000000000001e-06 2024-04-25T22:53:36.246 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.246 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.246 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:36.246 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.317600+0000", 2024-04-25T22:53:36.246 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.8590000000000004e-06 2024-04-25T22:53:36.246 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.246 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.246 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:36.247 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.317639+0000", 2024-04-25T22:53:36.247 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8260000000000003e-05 2024-04-25T22:53:36.247 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.247 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.247 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:36.247 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.317653+0000", 2024-04-25T22:53:36.247 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4204e-05 2024-04-25T22:53:36.247 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.247 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.247 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:36.247 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323563+0000", 2024-04-25T22:53:36.247 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0059098939999999997 2024-04-25T22:53:36.247 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.247 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.248 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:36.248 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323594+0000", 2024-04-25T22:53:36.248 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.1597999999999998e-05 2024-04-25T22:53:36.248 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:36.248 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:36.248 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:36.248 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.248 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.248 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:72 4.36 4:6cdfec98:::10000000255.00000000:head [write 0~4131] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:36.248 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:36.248 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 4.832496012, 2024-04-25T22:53:36.248 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084820680000000006, 2024-04-25T22:53:36.248 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:36.248 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:36.249 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:36.249 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:36.249 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:36.249 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:36.249 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 72 2024-04-25T22:53:36.249 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.249 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:36.249 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.249 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:36.249 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:36.249 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:36.249 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.249 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.249 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:36.250 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:36.250 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:36.250 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.250 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.250 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:36.250 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:36.250 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1800000000000005e-07 2024-04-25T22:53:36.250 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.250 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.250 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:36.250 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318010+0000", 2024-04-25T22:53:36.250 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7399999999999998e-06 2024-04-25T22:53:36.250 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.251 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.251 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:36.251 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318019+0000", 2024-04-25T22:53:36.251 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0170000000000002e-06 2024-04-25T22:53:36.251 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.251 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.251 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:36.251 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318024+0000", 2024-04-25T22:53:36.251 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0150000000000003e-06 2024-04-25T22:53:36.251 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.251 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.251 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:36.251 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318075+0000", 2024-04-25T22:53:36.251 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0537000000000001e-05 2024-04-25T22:53:36.252 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.252 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.252 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:36.252 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318144+0000", 2024-04-25T22:53:36.252 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9432999999999997e-05 2024-04-25T22:53:36.252 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.252 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.252 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:36.252 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326392+0000", 2024-04-25T22:53:36.252 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0082482979999999994 2024-04-25T22:53:36.252 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.252 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.252 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:36.252 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326432+0000", 2024-04-25T22:53:36.253 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9870000000000003e-05 2024-04-25T22:53:36.253 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.253 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.253 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:36.253 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326485+0000", 2024-04-25T22:53:36.253 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2439999999999999e-05 2024-04-25T22:53:36.253 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:36.253 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:36.253 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:36.253 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.253 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.253 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:74 4.10 4:08e6f8ca:::10000000257.00000000:head [write 0~839] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:36.253 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:53:36.253 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 4.8310222840000003, 2024-04-25T22:53:36.254 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070370720000000001, 2024-04-25T22:53:36.254 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:36.254 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:36.254 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:36.254 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:36.254 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:36.254 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:36.254 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 74 2024-04-25T22:53:36.254 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.254 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:36.254 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.254 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:36.254 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:53:36.254 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:36.255 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.255 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.255 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:36.255 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:53:36.255 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:36.255 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.255 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.255 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:36.255 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319477+0000", 2024-04-25T22:53:36.255 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1999999999999999e-07 2024-04-25T22:53:36.255 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.255 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.255 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:36.255 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319483+0000", 2024-04-25T22:53:36.255 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4260000000000002e-06 2024-04-25T22:53:36.256 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.256 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.256 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:36.256 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319494+0000", 2024-04-25T22:53:36.256 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.094e-05 2024-04-25T22:53:36.256 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.256 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.256 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:36.256 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319499+0000", 2024-04-25T22:53:36.256 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3789999999999997e-06 2024-04-25T22:53:36.256 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.256 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.256 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:36.256 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319545+0000", 2024-04-25T22:53:36.257 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6149000000000001e-05 2024-04-25T22:53:36.257 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.257 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.257 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:36.257 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319617+0000", 2024-04-25T22:53:36.257 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1792999999999995e-05 2024-04-25T22:53:36.257 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.257 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.257 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:36.257 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326406+0000", 2024-04-25T22:53:36.257 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067895999999999998 2024-04-25T22:53:36.257 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.257 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.257 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:36.257 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326443+0000", 2024-04-25T22:53:36.258 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6828e-05 2024-04-25T22:53:36.258 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.258 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.258 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:36.258 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326514+0000", 2024-04-25T22:53:36.258 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0236999999999999e-05 2024-04-25T22:53:36.258 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:36.258 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:36.258 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:36.258 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:36.258 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:36.258 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:36.260 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:36.260 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:36.259+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:36.328 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is unset 2024-04-25T22:53:36.361 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:36.360+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:36.365 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:36.365 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:36.365 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-04-25T22:53:36.365 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:36.373 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:36.462 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:36.462+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:36.476 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:36.476 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:36.476 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:53:36.476 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:53:36.476 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:36.484 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:36.564 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:36.562+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:36.636 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:36.637 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-04-25T22:53:36.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-04-25T22:53:36.637 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:53:36.637 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.637 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:36.637 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:36.637 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 108.66933545099999, 2024-04-25T22:53:36.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010384338999999999, 2024-04-25T22:53:36.637 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:36.637 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:36.637 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:36.637 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:36.638 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:36.638 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:36.638 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-04-25T22:53:36.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.638 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:36.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.638 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:36.638 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:36.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:36.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.638 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:36.639 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:36.639 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:36.639 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.639 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.639 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:36.639 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:36.639 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3600000000000004e-07 2024-04-25T22:53:36.639 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.639 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.639 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:36.640 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965185+0000", 2024-04-25T22:53:36.640 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.117e-06 2024-04-25T22:53:36.640 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.640 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.640 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:36.640 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965192+0000", 2024-04-25T22:53:36.640 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3239999999999997e-06 2024-04-25T22:53:36.640 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.640 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.640 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:36.640 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965198+0000", 2024-04-25T22:53:36.640 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6370000000000004e-06 2024-04-25T22:53:36.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.641 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:36.641 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970973+0000", 2024-04-25T22:53:36.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057748239999999996 2024-04-25T22:53:36.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.641 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:36.641 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971049+0000", 2024-04-25T22:53:36.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6029e-05 2024-04-25T22:53:36.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.641 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:36.641 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971174+0000", 2024-04-25T22:53:36.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012462399999999999 2024-04-25T22:53:36.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:36.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971553+0000", 2024-04-25T22:53:36.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037896499999999999 2024-04-25T22:53:36.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:36.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975482+0000", 2024-04-25T22:53:36.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039297459999999996 2024-04-25T22:53:36.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.643 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:36.643 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975529+0000", 2024-04-25T22:53:36.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6387000000000002e-05 2024-04-25T22:53:36.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.643 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:36.643 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975563+0000", 2024-04-25T22:53:36.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4150000000000003e-05 2024-04-25T22:53:36.643 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:36.643 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:36.643 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:36.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.644 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:36.644 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:36.644 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 103.62228912800001, 2024-04-25T22:53:36.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012637705000000001, 2024-04-25T22:53:36.644 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:36.644 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:36.644 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:36.644 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:36.644 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.644 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:36.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:36.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:36.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.645 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:36.645 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:36.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:36.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:36.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012227+0000", 2024-04-25T22:53:36.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.863e-06 2024-04-25T22:53:36.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:36.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012236+0000", 2024-04-25T22:53:36.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1109999999999997e-06 2024-04-25T22:53:36.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:36.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012309+0000", 2024-04-25T22:53:36.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3242000000000001e-05 2024-04-25T22:53:36.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:36.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012324+0000", 2024-04-25T22:53:36.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4837e-05 2024-04-25T22:53:36.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:36.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015060+0000", 2024-04-25T22:53:36.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027363349999999999 2024-04-25T22:53:36.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:36.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015169+0000", 2024-04-25T22:53:36.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108372 2024-04-25T22:53:36.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:36.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015498+0000", 2024-04-25T22:53:36.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032949999999999999 2024-04-25T22:53:36.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:36.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021282+0000", 2024-04-25T22:53:36.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057836429999999998 2024-04-25T22:53:36.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:36.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024709+0000", 2024-04-25T22:53:36.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034271979999999998 2024-04-25T22:53:36.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:36.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024802+0000", 2024-04-25T22:53:36.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2960000000000004e-05 2024-04-25T22:53:36.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:36.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024863+0000", 2024-04-25T22:53:36.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0643999999999997e-05 2024-04-25T22:53:36.650 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:36.650 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:36.650 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:36.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.650 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:36.650 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:36.650 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 103.622165357, 2024-04-25T22:53:36.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012979447999999999, 2024-04-25T22:53:36.650 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:36.650 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:36.651 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:36.651 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:36.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:36.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:36.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:36.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:36.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:36.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:36.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:36.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:36.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:53:36.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:36.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012354+0000", 2024-04-25T22:53:36.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7740000000000004e-06 2024-04-25T22:53:36.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:36.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012365+0000", 2024-04-25T22:53:36.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.064e-05 2024-04-25T22:53:36.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.654 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:36.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012382+0000", 2024-04-25T22:53:36.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6999000000000001e-05 2024-04-25T22:53:36.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:36.655 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015958+0000", 2024-04-25T22:53:36.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035765699999999998 2024-04-25T22:53:36.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:36.655 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016037+0000", 2024-04-25T22:53:36.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8242000000000001e-05 2024-04-25T22:53:36.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:36.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016404+0000", 2024-04-25T22:53:36.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036784300000000002 2024-04-25T22:53:36.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:36.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021294+0000", 2024-04-25T22:53:36.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048890629999999999 2024-04-25T22:53:36.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:36.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024959+0000", 2024-04-25T22:53:36.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036651570000000001 2024-04-25T22:53:36.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.658 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:36.658 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025097+0000", 2024-04-25T22:53:36.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013788099999999999 2024-04-25T22:53:36.658 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.658 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:36.658 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025328+0000", 2024-04-25T22:53:36.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231492 2024-04-25T22:53:36.658 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:36.658 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:36.659 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:36.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.659 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:36.659 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:36.659 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 103.622077588, 2024-04-25T22:53:36.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013049827, 2024-04-25T22:53:36.659 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:36.659 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:36.659 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:36.659 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:36.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:36.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:36.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:36.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:36.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:36.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:36.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:36.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012437+0000", 2024-04-25T22:53:36.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-04-25T22:53:36.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:36.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012440+0000", 2024-04-25T22:53:36.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7609999999999999e-06 2024-04-25T22:53:36.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:36.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012449+0000", 2024-04-25T22:53:36.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.285e-06 2024-04-25T22:53:36.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:36.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012457+0000", 2024-04-25T22:53:36.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9510000000000006e-06 2024-04-25T22:53:36.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.662 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:36.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017106+0000", 2024-04-25T22:53:36.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046494220000000003 2024-04-25T22:53:36.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.662 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:36.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017223+0000", 2024-04-25T22:53:36.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116824 2024-04-25T22:53:36.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:36.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017345+0000", 2024-04-25T22:53:36.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122175 2024-04-25T22:53:36.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:36.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021299+0000", 2024-04-25T22:53:36.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039534879999999998 2024-04-25T22:53:36.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:36.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025398+0000", 2024-04-25T22:53:36.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040988960000000003 2024-04-25T22:53:36.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:36.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025439+0000", 2024-04-25T22:53:36.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0915999999999999e-05 2024-04-25T22:53:36.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:36.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025486+0000", 2024-04-25T22:53:36.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7534999999999998e-05 2024-04-25T22:53:36.664 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:36.665 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:36.665 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:36.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.665 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:36.665 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:36.665 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 103.62204743700001, 2024-04-25T22:53:36.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020988041999999998, 2024-04-25T22:53:36.665 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:36.665 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:36.665 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:36.665 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:36.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.666 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:36.666 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:36.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:36.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.666 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:36.666 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:36.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:36.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.666 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:36.666 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:36.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.99e-07 2024-04-25T22:53:36.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:36.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012470+0000", 2024-04-25T22:53:36.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2789999999999999e-06 2024-04-25T22:53:36.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:36.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012477+0000", 2024-04-25T22:53:36.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:53:36.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:36.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012500+0000", 2024-04-25T22:53:36.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2490999999999999e-05 2024-04-25T22:53:36.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:36.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021911+0000", 2024-04-25T22:53:36.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094114160000000006 2024-04-25T22:53:36.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:36.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022000+0000", 2024-04-25T22:53:36.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8601000000000001e-05 2024-04-25T22:53:36.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:36.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022359+0000", 2024-04-25T22:53:36.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035921999999999999 2024-04-25T22:53:36.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:36.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025541+0000", 2024-04-25T22:53:36.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031820619999999998 2024-04-25T22:53:36.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:36.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033375+0000", 2024-04-25T22:53:36.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078338379999999992 2024-04-25T22:53:36.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:36.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033415+0000", 2024-04-25T22:53:36.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9527000000000003e-05 2024-04-25T22:53:36.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:36.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033455+0000", 2024-04-25T22:53:36.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9932000000000003e-05 2024-04-25T22:53:36.670 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:36.670 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:36.670 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:36.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.671 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:36.671 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:36.671 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 103.621992244, 2024-04-25T22:53:36.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021043857999999999, 2024-04-25T22:53:36.671 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:36.671 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:36.671 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:36.671 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:36.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.671 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:36.671 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:36.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:36.671 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:36.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:36.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:36.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:36.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012523+0000", 2024-04-25T22:53:36.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.361e-06 2024-04-25T22:53:36.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:36.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012530+0000", 2024-04-25T22:53:36.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5440000000000004e-06 2024-04-25T22:53:36.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:36.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012541+0000", 2024-04-25T22:53:36.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1745e-05 2024-04-25T22:53:36.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:36.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012551+0000", 2024-04-25T22:53:36.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5789999999999993e-06 2024-04-25T22:53:36.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:36.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022709+0000", 2024-04-25T22:53:36.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010157685 2024-04-25T22:53:36.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:36.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022957+0000", 2024-04-25T22:53:36.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024824599999999998 2024-04-25T22:53:36.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:36.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023443+0000", 2024-04-25T22:53:36.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048578599999999999 2024-04-25T22:53:36.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.676 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:36.676 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025547+0000", 2024-04-25T22:53:36.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021044789999999998 2024-04-25T22:53:36.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:36.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033509+0000", 2024-04-25T22:53:36.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0079622180000000001 2024-04-25T22:53:36.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:36.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033542+0000", 2024-04-25T22:53:36.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3018000000000001e-05 2024-04-25T22:53:36.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:36.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033566+0000", 2024-04-25T22:53:36.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3197000000000002e-05 2024-04-25T22:53:36.679 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:36.679 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:36.679 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:36.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.679 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:36.680 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:36.680 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 103.621952279, 2024-04-25T22:53:36.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021122696, 2024-04-25T22:53:36.680 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:36.680 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:36.680 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:36.680 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:36.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:36.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:36.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:36.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:36.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:36.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:36.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:36.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:36.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:53:36.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:36.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012566+0000", 2024-04-25T22:53:36.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-04-25T22:53:36.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:36.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012619+0000", 2024-04-25T22:53:36.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2607e-05 2024-04-25T22:53:36.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:36.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012628+0000", 2024-04-25T22:53:36.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6500000000000008e-06 2024-04-25T22:53:36.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:36.685 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024024+0000", 2024-04-25T22:53:36.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011396007999999999 2024-04-25T22:53:36.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:36.685 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024198+0000", 2024-04-25T22:53:36.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000173215 2024-04-25T22:53:36.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:36.685 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024447+0000", 2024-04-25T22:53:36.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024898500000000002 2024-04-25T22:53:36.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.686 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:36.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026431+0000", 2024-04-25T22:53:36.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001984923 2024-04-25T22:53:36.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.686 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:36.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033608+0000", 2024-04-25T22:53:36.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071768459999999997 2024-04-25T22:53:36.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.686 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:36.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033646+0000", 2024-04-25T22:53:36.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299000000000003e-05 2024-04-25T22:53:36.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:36.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033684+0000", 2024-04-25T22:53:36.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8773000000000003e-05 2024-04-25T22:53:36.687 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:36.687 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:36.687 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:36.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.688 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:36.688 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:36.688 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 103.62186368, 2024-04-25T22:53:36.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021175381, 2024-04-25T22:53:36.688 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:36.688 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:36.688 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:36.688 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:36.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:36.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:36.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:36.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:36.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:36.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:36.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:36.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012651+0000", 2024-04-25T22:53:36.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:53:36.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:36.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012656+0000", 2024-04-25T22:53:36.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8899999999999998e-06 2024-04-25T22:53:36.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:36.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012666+0000", 2024-04-25T22:53:36.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0346999999999999e-05 2024-04-25T22:53:36.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:36.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012675+0000", 2024-04-25T22:53:36.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9930000000000001e-06 2024-04-25T22:53:36.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:36.691 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025661+0000", 2024-04-25T22:53:36.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01298531 2024-04-25T22:53:36.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.691 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:36.691 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025757+0000", 2024-04-25T22:53:36.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5822000000000005e-05 2024-04-25T22:53:36.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.691 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:36.691 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025907+0000", 2024-04-25T22:53:36.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015051499999999999 2024-04-25T22:53:36.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:36.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026435+0000", 2024-04-25T22:53:36.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052762200000000005 2024-04-25T22:53:36.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:36.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033732+0000", 2024-04-25T22:53:36.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072978419999999997 2024-04-25T22:53:36.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:36.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033787+0000", 2024-04-25T22:53:36.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4703999999999997e-05 2024-04-25T22:53:36.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.693 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:36.693 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033826+0000", 2024-04-25T22:53:36.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8458999999999999e-05 2024-04-25T22:53:36.693 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:36.693 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:36.693 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:36.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.693 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:36.693 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:36.693 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 103.621808266, 2024-04-25T22:53:36.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021244174000000001, 2024-04-25T22:53:36.694 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:36.694 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:36.694 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:36.694 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:36.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:36.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:36.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:36.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:36.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:36.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:36.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:36.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:36.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:36.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:36.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012712+0000", 2024-04-25T22:53:36.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.913e-06 2024-04-25T22:53:36.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:36.696 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012722+0000", 2024-04-25T22:53:36.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2879999999999998e-06 2024-04-25T22:53:36.696 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.696 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:36.696 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012727+0000", 2024-04-25T22:53:36.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8429999999999998e-06 2024-04-25T22:53:36.696 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.696 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:36.696 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026099+0000", 2024-04-25T22:53:36.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013371450999999999 2024-04-25T22:53:36.696 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:36.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026147+0000", 2024-04-25T22:53:36.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7837999999999998e-05 2024-04-25T22:53:36.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:36.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026254+0000", 2024-04-25T22:53:36.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107314 2024-04-25T22:53:36.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:36.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026686+0000", 2024-04-25T22:53:36.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000432428 2024-04-25T22:53:36.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.698 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.698 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:36.698 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033873+0000", 2024-04-25T22:53:36.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071864399999999997 2024-04-25T22:53:36.698 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.698 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.698 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:36.698 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033904+0000", 2024-04-25T22:53:36.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1321e-05 2024-04-25T22:53:36.698 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.698 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.698 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:36.699 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033950+0000", 2024-04-25T22:53:36.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5707999999999997e-05 2024-04-25T22:53:36.699 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:36.699 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:36.699 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:36.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.699 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:36.699 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:36.699 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 103.621777881, 2024-04-25T22:53:36.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01096505, 2024-04-25T22:53:36.699 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:36.699 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:36.699 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:36.700 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:36.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:36.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:36.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:36.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:36.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:36.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:36.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:36.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012737+0000", 2024-04-25T22:53:36.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:36.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:36.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012739+0000", 2024-04-25T22:53:36.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-04-25T22:53:36.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:36.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012743+0000", 2024-04-25T22:53:36.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3239999999999996e-06 2024-04-25T22:53:36.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:36.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012746+0000", 2024-04-25T22:53:36.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.129e-06 2024-04-25T22:53:36.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:36.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012796+0000", 2024-04-25T22:53:36.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9231999999999999e-05 2024-04-25T22:53:36.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:36.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012915+0000", 2024-04-25T22:53:36.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119021 2024-04-25T22:53:36.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:36.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013069+0000", 2024-04-25T22:53:36.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015463900000000001 2024-04-25T22:53:36.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:36.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019237+0000", 2024-04-25T22:53:36.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061680329999999998 2024-04-25T22:53:36.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:36.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023603+0000", 2024-04-25T22:53:36.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043655860000000003 2024-04-25T22:53:36.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:36.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023659+0000", 2024-04-25T22:53:36.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6484000000000003e-05 2024-04-25T22:53:36.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:36.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023701+0000", 2024-04-25T22:53:36.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1761999999999998e-05 2024-04-25T22:53:36.705 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:36.705 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:36.705 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:36.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.705 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:36.705 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:36.705 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 103.621752933, 2024-04-25T22:53:36.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011234429000000001, 2024-04-25T22:53:36.706 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:36.706 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:36.706 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:36.706 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:36.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:36.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:36.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:36.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:36.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:36.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:36.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:36.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012762+0000", 2024-04-25T22:53:36.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-04-25T22:53:36.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:36.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012765+0000", 2024-04-25T22:53:36.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2569999999999999e-06 2024-04-25T22:53:36.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:36.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012783+0000", 2024-04-25T22:53:36.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8431999999999999e-05 2024-04-25T22:53:36.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:36.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012799+0000", 2024-04-25T22:53:36.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5438999999999999e-05 2024-04-25T22:53:36.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:36.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013826+0000", 2024-04-25T22:53:36.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010275060000000001 2024-04-25T22:53:36.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:36.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013913+0000", 2024-04-25T22:53:36.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.708e-05 2024-04-25T22:53:36.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:36.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014098+0000", 2024-04-25T22:53:36.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018519399999999999 2024-04-25T22:53:36.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:36.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019684+0000", 2024-04-25T22:53:36.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055860079999999999 2024-04-25T22:53:36.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:36.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023876+0000", 2024-04-25T22:53:36.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041918800000000003 2024-04-25T22:53:36.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:36.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023957+0000", 2024-04-25T22:53:36.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1165e-05 2024-04-25T22:53:36.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:36.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023995+0000", 2024-04-25T22:53:36.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:53:36.711 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:36.711 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:36.711 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:36.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.712 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:36.712 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:36.712 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 103.621655154, 2024-04-25T22:53:36.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011131200000000001, 2024-04-25T22:53:36.712 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:36.712 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:36.712 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:36.712 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:36.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:36.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:36.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:36.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:36.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:36.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:36.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:36.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012860+0000", 2024-04-25T22:53:36.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3900000000000004e-07 2024-04-25T22:53:36.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:36.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012865+0000", 2024-04-25T22:53:36.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5609999999999998e-06 2024-04-25T22:53:36.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:36.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012895+0000", 2024-04-25T22:53:36.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9847000000000001e-05 2024-04-25T22:53:36.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:36.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012905+0000", 2024-04-25T22:53:36.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.03e-05 2024-04-25T22:53:36.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:36.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015020+0000", 2024-04-25T22:53:36.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021142940000000001 2024-04-25T22:53:36.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:36.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015182+0000", 2024-04-25T22:53:36.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016248099999999999 2024-04-25T22:53:36.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:36.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015357+0000", 2024-04-25T22:53:36.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017471000000000001 2024-04-25T22:53:36.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:36.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021021+0000", 2024-04-25T22:53:36.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056638340000000004 2024-04-25T22:53:36.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:36.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023712+0000", 2024-04-25T22:53:36.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026910380000000002 2024-04-25T22:53:36.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:36.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023763+0000", 2024-04-25T22:53:36.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1477999999999997e-05 2024-04-25T22:53:36.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:36.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023990+0000", 2024-04-25T22:53:36.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000226818 2024-04-25T22:53:36.717 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:36.717 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:36.717 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:36.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.717 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:36.717 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:36.717 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 103.621532058, 2024-04-25T22:53:36.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011705299000000001, 2024-04-25T22:53:36.718 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:36.718 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:36.718 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:36.718 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:36.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:36.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:36.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:36.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:36.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:36.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:36.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:36.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012983+0000", 2024-04-25T22:53:36.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:53:36.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:36.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012986+0000", 2024-04-25T22:53:36.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5700000000000001e-06 2024-04-25T22:53:36.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:36.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012993+0000", 2024-04-25T22:53:36.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8730000000000001e-06 2024-04-25T22:53:36.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:36.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013000+0000", 2024-04-25T22:53:36.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1890000000000001e-06 2024-04-25T22:53:36.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:36.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:53:36.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002147866 2024-04-25T22:53:36.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:36.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015351+0000", 2024-04-25T22:53:36.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020300799999999999 2024-04-25T22:53:36.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:36.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016260+0000", 2024-04-25T22:53:36.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00090926799999999997 2024-04-25T22:53:36.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:36.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022669+0000", 2024-04-25T22:53:36.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064082849999999997 2024-04-25T22:53:36.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:36.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024584+0000", 2024-04-25T22:53:36.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019151699999999999 2024-04-25T22:53:36.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:36.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024643+0000", 2024-04-25T22:53:36.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8888999999999998e-05 2024-04-25T22:53:36.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:36.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024687+0000", 2024-04-25T22:53:36.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4444999999999999e-05 2024-04-25T22:53:36.723 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:36.723 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:36.723 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:36.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.723 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:36.723 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:36.723 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 103.62150446699999, 2024-04-25T22:53:36.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011249699, 2024-04-25T22:53:36.723 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:36.723 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:36.723 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:36.723 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:36.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:36.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:36.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:36.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:36.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:36.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:36.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:36.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013010+0000", 2024-04-25T22:53:36.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2099999999999996e-07 2024-04-25T22:53:36.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:36.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013013+0000", 2024-04-25T22:53:36.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1310000000000002e-06 2024-04-25T22:53:36.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:36.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013020+0000", 2024-04-25T22:53:36.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3330000000000002e-06 2024-04-25T22:53:36.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:36.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013025+0000", 2024-04-25T22:53:36.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6760000000000004e-06 2024-04-25T22:53:36.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:36.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013163+0000", 2024-04-25T22:53:36.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013824599999999999 2024-04-25T22:53:36.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:36.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013504+0000", 2024-04-25T22:53:36.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034080299999999998 2024-04-25T22:53:36.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:36.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013613+0000", 2024-04-25T22:53:36.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108705 2024-04-25T22:53:36.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:36.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015831+0000", 2024-04-25T22:53:36.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002217672 2024-04-25T22:53:36.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:36.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024137+0000", 2024-04-25T22:53:36.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0083060489999999994 2024-04-25T22:53:36.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:36.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024218+0000", 2024-04-25T22:53:36.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1351000000000001e-05 2024-04-25T22:53:36.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:36.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024259+0000", 2024-04-25T22:53:36.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1112000000000002e-05 2024-04-25T22:53:36.728 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:36.728 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:36.728 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:36.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.728 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:36.728 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:36.729 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 103.621416741, 2024-04-25T22:53:36.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020379749999999999, 2024-04-25T22:53:36.729 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:36.729 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:36.729 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:36.729 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:36.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:36.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:36.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:36.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:36.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:36.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:36.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:36.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013098+0000", 2024-04-25T22:53:36.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:53:36.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:36.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013105+0000", 2024-04-25T22:53:36.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5969999999999997e-06 2024-04-25T22:53:36.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:36.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013190+0000", 2024-04-25T22:53:36.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5618999999999995e-05 2024-04-25T22:53:36.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:36.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013200+0000", 2024-04-25T22:53:36.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5859999999999994e-06 2024-04-25T22:53:36.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:36.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020265+0000", 2024-04-25T22:53:36.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070653349999999998 2024-04-25T22:53:36.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:36.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020454+0000", 2024-04-25T22:53:36.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189316 2024-04-25T22:53:36.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:36.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020586+0000", 2024-04-25T22:53:36.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013195700000000001 2024-04-25T22:53:36.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:36.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023822+0000", 2024-04-25T22:53:36.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032358529999999999 2024-04-25T22:53:36.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:36.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033409+0000", 2024-04-25T22:53:36.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095870520000000004 2024-04-25T22:53:36.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:36.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033447+0000", 2024-04-25T22:53:36.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7261999999999997e-05 2024-04-25T22:53:36.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:36.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033477+0000", 2024-04-25T22:53:36.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0389e-05 2024-04-25T22:53:36.734 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:36.734 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:36.734 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:36.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.734 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:36.734 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:36.734 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 103.62130023500001, 2024-04-25T22:53:36.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010857383999999999, 2024-04-25T22:53:36.734 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:36.735 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:36.735 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:36.735 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:36.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:36.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:36.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:36.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:36.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:36.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:36.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:36.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:36.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:36.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:36.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013218+0000", 2024-04-25T22:53:36.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8199999999999998e-06 2024-04-25T22:53:36.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:36.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013226+0000", 2024-04-25T22:53:36.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7649999999999993e-06 2024-04-25T22:53:36.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:36.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013259+0000", 2024-04-25T22:53:36.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2727e-05 2024-04-25T22:53:36.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:36.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014809+0000", 2024-04-25T22:53:36.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001550144 2024-04-25T22:53:36.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:36.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014958+0000", 2024-04-25T22:53:36.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014890300000000001 2024-04-25T22:53:36.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:36.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015087+0000", 2024-04-25T22:53:36.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012939200000000001 2024-04-25T22:53:36.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:36.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020212+0000", 2024-04-25T22:53:36.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051248939999999996 2024-04-25T22:53:36.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:36.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023699+0000", 2024-04-25T22:53:36.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034873289999999999 2024-04-25T22:53:36.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:36.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024014+0000", 2024-04-25T22:53:36.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031473999999999999 2024-04-25T22:53:36.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:36.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024071+0000", 2024-04-25T22:53:36.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7040000000000003e-05 2024-04-25T22:53:36.739 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:36.739 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:36.739 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:36.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.740 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:36.740 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:36.740 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 103.62124553, 2024-04-25T22:53:36.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012329677000000001, 2024-04-25T22:53:36.740 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:36.740 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:36.740 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:36.740 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:36.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:36.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:36.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:36.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:36.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:36.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:36.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:36.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013269+0000", 2024-04-25T22:53:36.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5000000000000002e-07 2024-04-25T22:53:36.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:36.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:36.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6909999999999999e-06 2024-04-25T22:53:36.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:36.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013284+0000", 2024-04-25T22:53:36.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0963e-05 2024-04-25T22:53:36.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:36.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013361+0000", 2024-04-25T22:53:36.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7379999999999994e-05 2024-04-25T22:53:36.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:36.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013448+0000", 2024-04-25T22:53:36.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6990000000000006e-05 2024-04-25T22:53:36.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:36.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013632+0000", 2024-04-25T22:53:36.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018396800000000001 2024-04-25T22:53:36.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:36.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013800+0000", 2024-04-25T22:53:36.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167467 2024-04-25T22:53:36.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:36.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.018570+0000", 2024-04-25T22:53:36.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047701460000000003 2024-04-25T22:53:36.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:36.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025507+0000", 2024-04-25T22:53:36.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069372039999999998 2024-04-25T22:53:36.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:36.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025562+0000", 2024-04-25T22:53:36.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4858999999999998e-05 2024-04-25T22:53:36.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:36.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025598+0000", 2024-04-25T22:53:36.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6259e-05 2024-04-25T22:53:36.745 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:36.745 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:36.745 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:36.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.745 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:36.745 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:36.745 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 103.621113657, 2024-04-25T22:53:36.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020176666999999999, 2024-04-25T22:53:36.745 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:36.746 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:36.746 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:53:36.746 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:36.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:36.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:36.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:36.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:36.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:36.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:36.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:36.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:36.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-04-25T22:53:36.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:36.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013405+0000", 2024-04-25T22:53:36.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0559999999999998e-06 2024-04-25T22:53:36.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:36.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013422+0000", 2024-04-25T22:53:36.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6770999999999999e-05 2024-04-25T22:53:36.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:36.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013431+0000", 2024-04-25T22:53:36.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5019999999999998e-06 2024-04-25T22:53:36.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:36.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021720+0000", 2024-04-25T22:53:36.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082884340000000008 2024-04-25T22:53:36.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:36.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022122+0000", 2024-04-25T22:53:36.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000401634 2024-04-25T22:53:36.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:36.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033577+0000", 2024-04-25T22:53:36.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011455435999999999 2024-04-25T22:53:36.749 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:36.749 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:36.749 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:36.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.749 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4734.0:31 4.1b 4:d9872866:::1000000021d.00000002:head [write 0~3618035] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-25T22:53:36.749 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:53:36.749 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 5.5815393950000001, 2024-04-25T22:53:36.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011647062, 2024-04-25T22:53:36.750 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:36.750 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:36.750 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:36.750 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:36.750 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4734", 2024-04-25T22:53:36.750 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:36.750 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 31 2024-04-25T22:53:36.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.750 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:36.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:36.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:53:36.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:36.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:36.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:53:36.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:36.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:36.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:53:36.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5700000000000001e-07 2024-04-25T22:53:36.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:36.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059575+0000", 2024-04-25T22:53:36.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0065991380000000001 2024-04-25T22:53:36.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:36.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059586+0000", 2024-04-25T22:53:36.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1438e-05 2024-04-25T22:53:36.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:36.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059592+0000", 2024-04-25T22:53:36.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2899999999999999e-06 2024-04-25T22:53:36.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:36.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059660+0000", 2024-04-25T22:53:36.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7980999999999998e-05 2024-04-25T22:53:36.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:36.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059757+0000", 2024-04-25T22:53:36.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6340000000000003e-05 2024-04-25T22:53:36.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:36.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.064487+0000", 2024-04-25T22:53:36.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004730621 2024-04-25T22:53:36.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:36.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.064538+0000", 2024-04-25T22:53:36.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0801999999999999e-05 2024-04-25T22:53:36.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:36.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.064622+0000", 2024-04-25T22:53:36.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3595000000000002e-05 2024-04-25T22:53:36.754 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:36.754 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:36.754 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:36.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.755 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:97 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-25T22:53:36.755 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:53:33.026298+0000", 2024-04-25T22:53:36.755 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 3.6082155810000001, 2024-04-25T22:53:36.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015641848999999999, 2024-04-25T22:53:36.755 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:36.755 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:36.755 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:36.755 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:36.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:36.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026298+0000", 2024-04-25T22:53:36.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:36.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:36.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026298+0000", 2024-04-25T22:53:36.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:36.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:36.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026299+0000", 2024-04-25T22:53:36.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7299999999999996e-07 2024-04-25T22:53:36.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:36.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026464+0000", 2024-04-25T22:53:36.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016477700000000001 2024-04-25T22:53:36.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:36.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026472+0000", 2024-04-25T22:53:36.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1589999999999993e-06 2024-04-25T22:53:36.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:36.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026476+0000", 2024-04-25T22:53:36.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4580000000000003e-06 2024-04-25T22:53:36.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:36.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026550+0000", 2024-04-25T22:53:36.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3836000000000003e-05 2024-04-25T22:53:36.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:36.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026644+0000", 2024-04-25T22:53:36.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4022000000000002e-05 2024-04-25T22:53:36.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:36.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.041838+0000", 2024-04-25T22:53:36.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015193814999999999 2024-04-25T22:53:36.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:36.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.041874+0000", 2024-04-25T22:53:36.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5856999999999999e-05 2024-04-25T22:53:36.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:36.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:36.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:36.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.041940+0000", 2024-04-25T22:53:36.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6352000000000004e-05 2024-04-25T22:53:36.759 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:36.759 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:36.759 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:36.759 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:36.759 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:36.759 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:36.761 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:36.761 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:36.760+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:36.861 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:36.860+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:36.870 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:36.870 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:53:36.870 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.870 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:4584 4.33 4:cf4a1181:::10000001421.00000000:head [write 0~398 in=398b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-25T22:53:36.870 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:36.869253+0000", 2024-04-25T22:53:36.870 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.00068113899999999998, 2024-04-25T22:53:36.870 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00069777399999999996, 2024-04-25T22:53:36.870 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:36.870 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:36.870 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:36.870 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:36.871 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:36.871 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:36.871 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 4584 2024-04-25T22:53:36.871 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.871 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:36.871 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.871 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:36.871 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.869253+0000", 2024-04-25T22:53:36.871 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:36.871 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.871 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.871 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:36.871 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.869253+0000", 2024-04-25T22:53:36.871 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:36.871 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.872 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.872 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:36.872 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.869254+0000", 2024-04-25T22:53:36.872 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.99e-07 2024-04-25T22:53:36.872 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.872 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.872 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:36.872 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.869264+0000", 2024-04-25T22:53:36.872 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.8109999999999997e-06 2024-04-25T22:53:36.872 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.872 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.872 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:36.872 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.869274+0000", 2024-04-25T22:53:36.873 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.8789999999999998e-06 2024-04-25T22:53:36.873 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.873 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.873 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:36.873 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.869279+0000", 2024-04-25T22:53:36.873 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2009999999999998e-06 2024-04-25T22:53:36.873 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.873 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.873 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:36.873 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.869325+0000", 2024-04-25T22:53:36.873 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5639999999999997e-05 2024-04-25T22:53:36.873 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:36.873 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:36.874 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:36.874 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.869399+0000", 2024-04-25T22:53:36.874 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4356000000000004e-05 2024-04-25T22:53:36.874 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:36.874 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:36.874 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:36.874 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:36.874 INFO:teuthology.orchestra.run.smithi191.stdout: ], 2024-04-25T22:53:36.874 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 1 2024-04-25T22:53:36.874 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:36.879 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:36.964 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:36.963+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:37.026 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:37.026 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:37.026 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-25T22:53:37.026 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-25T22:53:37.026 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:37.036 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:37.063 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:37.062+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:37.165 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:37.165+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:37.185 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:37.185 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:53:37.185 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:53:37.185 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:53:37.185 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.185 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:53:37.185 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:37.185 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 109.21593866800001, 2024-04-25T22:53:37.185 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:53:37.186 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:37.186 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:37.186 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:37.186 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:37.186 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.186 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:37.186 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:37.186 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:37.186 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.186 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.186 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:37.186 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:37.186 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:37.187 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.187 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.187 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:37.187 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:53:37.187 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:53:37.187 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.187 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.187 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:37.187 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:53:37.187 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:53:37.187 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.187 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.187 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:37.188 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:53:37.188 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:53:37.188 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.188 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.188 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:37.188 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:53:37.188 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:53:37.188 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.188 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.188 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:37.188 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:53:37.188 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:53:37.188 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.189 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.189 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:37.189 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:53:37.189 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:53:37.189 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.189 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.189 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:37.189 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:53:37.189 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:53:37.189 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.189 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.189 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:37.189 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:53:37.189 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:53:37.190 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:37.190 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:37.190 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:37.190 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.190 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.190 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:110 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'72, mlcod=10'68)", 2024-04-25T22:53:37.190 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:37.190 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 109.215304668, 2024-04-25T22:53:37.190 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065316630000000001, 2024-04-25T22:53:37.190 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:37.190 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:37.190 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:37.191 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:37.191 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.191 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:37.191 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:37.191 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:37.191 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.191 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.191 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:37.191 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:37.191 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:37.191 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.192 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.192 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:37.192 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:37.192 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.58e-07 2024-04-25T22:53:37.192 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.192 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.192 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:37.192 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967811+0000", 2024-04-25T22:53:37.192 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.118e-06 2024-04-25T22:53:37.192 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.192 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.192 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:37.192 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967817+0000", 2024-04-25T22:53:37.192 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3709999999999996e-06 2024-04-25T22:53:37.193 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.193 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.193 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:37.193 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967820+0000", 2024-04-25T22:53:37.193 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2210000000000002e-06 2024-04-25T22:53:37.193 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.193 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.193 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:37.193 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967876+0000", 2024-04-25T22:53:37.193 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5507000000000002e-05 2024-04-25T22:53:37.193 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.193 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.193 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:37.194 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967893+0000", 2024-04-25T22:53:37.194 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7812000000000002e-05 2024-04-25T22:53:37.194 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.194 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.194 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:37.194 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974317+0000", 2024-04-25T22:53:37.194 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064237160000000003 2024-04-25T22:53:37.194 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.194 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.194 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:37.194 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:53:37.194 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.156e-05 2024-04-25T22:53:37.194 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:37.195 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:37.195 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:37.195 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.195 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.195 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:37.195 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:37.195 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 104.171442969, 2024-04-25T22:53:37.195 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:53:37.195 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:37.195 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:37.195 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:37.195 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:37.195 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.195 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:37.196 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:37.196 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:37.196 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.196 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.196 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:37.196 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:37.196 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:37.196 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.196 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.196 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:37.196 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:53:37.196 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:53:37.196 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.197 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.197 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:37.197 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:53:37.197 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:53:37.197 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.197 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.197 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:37.197 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:53:37.197 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:53:37.197 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.197 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.197 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:37.197 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:53:37.197 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:53:37.197 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.198 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.198 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:37.198 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:53:37.198 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:53:37.198 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.198 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.198 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:37.198 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:53:37.198 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:53:37.198 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.198 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.198 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:37.199 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:53:37.199 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:53:37.199 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.199 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.199 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:37.199 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:53:37.199 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:53:37.199 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.199 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.199 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:37.199 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:53:37.199 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:53:37.199 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.200 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.200 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:37.200 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:53:37.200 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:53:37.200 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.200 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.200 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:37.200 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:53:37.200 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:53:37.200 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:37.200 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:37.200 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:37.200 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.200 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.201 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:37.201 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:37.201 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 104.17076859300001, 2024-04-25T22:53:37.201 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:53:37.201 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:37.201 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:37.201 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:37.201 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:37.201 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.201 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:37.201 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:37.201 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:37.201 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.202 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.202 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:37.202 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:37.202 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:37.202 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.202 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.202 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:37.202 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:53:37.202 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:53:37.202 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.202 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.202 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:37.202 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:53:37.202 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:53:37.203 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.203 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.203 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:37.203 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:53:37.203 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:53:37.203 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.203 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.203 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:37.203 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:53:37.204 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:53:37.204 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.204 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.204 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:37.204 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:53:37.204 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:53:37.204 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.204 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.204 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:37.204 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:53:37.204 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:53:37.204 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.204 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.204 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:37.205 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:53:37.205 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:53:37.205 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.205 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.205 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:37.205 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:53:37.205 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:53:37.205 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.205 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.205 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:37.205 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:53:37.205 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:53:37.205 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.206 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.206 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:37.206 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:53:37.206 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:53:37.206 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.206 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.206 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:37.206 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:53:37.206 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:53:37.206 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:37.206 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:37.206 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:37.206 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.207 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.207 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:37.207 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:37.207 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 104.17025938099999, 2024-04-25T22:53:37.207 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:53:37.207 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:37.207 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:37.207 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:37.207 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:37.207 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.207 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:37.208 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:37.208 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:37.208 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.208 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.208 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:37.208 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:37.208 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:37.208 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.208 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.208 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:37.208 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:53:37.208 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:53:37.208 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.209 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.209 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:37.209 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:53:37.209 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:53:37.209 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.209 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.209 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:37.209 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:53:37.209 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:53:37.209 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.209 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.209 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:37.210 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:53:37.210 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:53:37.210 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.210 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.210 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:37.210 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:53:37.210 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:53:37.210 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.210 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.210 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:37.210 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:53:37.210 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:53:37.210 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.210 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.211 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:37.211 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:53:37.211 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:53:37.211 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.211 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.211 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:37.211 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:53:37.211 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:53:37.211 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.211 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.211 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:37.211 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:53:37.212 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:53:37.212 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.212 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.212 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:37.212 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:53:37.212 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:53:37.212 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.212 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.212 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:37.212 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:53:37.212 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:53:37.212 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:37.212 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:37.213 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:37.213 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.213 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.213 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:37.213 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:37.213 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 104.169846183, 2024-04-25T22:53:37.213 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:53:37.213 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:37.213 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:37.213 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:37.213 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:37.213 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.213 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:37.213 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:37.214 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:37.214 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.214 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.214 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:37.214 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:37.214 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:37.214 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.214 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.214 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:37.214 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:37.214 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:53:37.214 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.214 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.214 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:37.215 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:37.215 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:53:37.215 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.215 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.215 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:37.215 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:53:37.215 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:53:37.215 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.215 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.216 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:37.216 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:53:37.216 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:53:37.216 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.216 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.216 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:37.216 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:53:37.216 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:53:37.216 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.216 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.216 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:37.216 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:53:37.216 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:53:37.216 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.216 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.217 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:37.217 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:53:37.217 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:53:37.217 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.217 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.217 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:37.217 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:53:37.217 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:53:37.217 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.217 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.217 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:37.217 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:53:37.217 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:53:37.218 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.218 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.218 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:37.218 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:53:37.218 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:53:37.218 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.218 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.218 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:37.218 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:53:37.218 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:53:37.218 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:37.218 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:37.218 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:37.219 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.219 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.219 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:37.219 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:37.219 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 104.169795513, 2024-04-25T22:53:37.219 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:53:37.219 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:37.219 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:37.219 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:37.219 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:37.219 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.219 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:37.219 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:37.219 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:37.220 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.220 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.220 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:37.220 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:37.220 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:37.220 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.220 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.220 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:37.220 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:53:37.220 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:53:37.220 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.220 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.220 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:37.221 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:53:37.221 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:53:37.221 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.221 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.221 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:37.221 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:53:37.221 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:53:37.221 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.221 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.221 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:37.221 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:53:37.221 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:53:37.221 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.221 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.222 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:37.222 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:53:37.222 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:53:37.222 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.222 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.222 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:37.222 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:53:37.222 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:53:37.222 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.222 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.222 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:37.222 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:53:37.222 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:53:37.223 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.223 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.223 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:37.223 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:53:37.223 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:53:37.223 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.223 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.223 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:37.223 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:53:37.223 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:53:37.223 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.223 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.223 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:37.223 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:53:37.224 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:53:37.224 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.224 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.224 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:37.224 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:53:37.224 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:53:37.224 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.224 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.224 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:37.224 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:53:37.224 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:53:37.224 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.224 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.224 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:37.225 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:53:37.225 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:53:37.225 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:37.225 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:37.225 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:37.225 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.225 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.225 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:37.225 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:37.225 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 104.169758644, 2024-04-25T22:53:37.225 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:53:37.225 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:37.225 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:37.225 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:37.226 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:37.226 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.226 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:37.226 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:37.226 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:37.226 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.226 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.226 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:37.226 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:37.226 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:37.226 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.226 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.226 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:37.227 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:53:37.227 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:53:37.227 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.227 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.227 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:37.227 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:53:37.227 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:53:37.227 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.227 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.227 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:37.227 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:53:37.227 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:53:37.227 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.227 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.228 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:37.228 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:53:37.228 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:53:37.228 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.228 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.228 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:37.228 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:53:37.228 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:53:37.228 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.228 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.228 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:53:37.228 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:53:37.228 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:53:37.229 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.229 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.229 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:37.229 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:53:37.229 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:53:37.229 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.229 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.229 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:37.229 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:53:37.229 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:53:37.229 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.229 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.229 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:37.230 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:53:37.230 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:53:37.230 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.230 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.230 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:37.230 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:53:37.230 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:53:37.230 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.230 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.230 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:37.230 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:53:37.230 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:53:37.230 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.231 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.231 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:37.231 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:53:37.231 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:53:37.231 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.231 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.231 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:37.231 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:53:37.231 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:53:37.231 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:37.231 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:37.231 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:37.231 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.232 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.232 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:37.232 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:37.232 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 104.169733678, 2024-04-25T22:53:37.232 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:53:37.232 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:37.232 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:37.232 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:37.232 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:37.232 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.232 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:37.232 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:37.232 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:37.232 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.233 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.233 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:37.233 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:37.233 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:37.233 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.233 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.233 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:37.233 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:53:37.233 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:53:37.233 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.233 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.233 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:37.233 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:53:37.233 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:53:37.234 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.234 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.234 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:37.234 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:37.234 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:53:37.234 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.234 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.234 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:37.234 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:53:37.234 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:53:37.234 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.234 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.234 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:37.234 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:53:37.235 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:53:37.235 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.235 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.235 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:37.235 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:53:37.235 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:53:37.235 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.235 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.235 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:37.235 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:53:37.235 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:53:37.235 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.235 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.235 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:37.236 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:53:37.236 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:53:37.236 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.236 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.236 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:37.236 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:53:37.236 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:53:37.236 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.236 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.236 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:37.236 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:53:37.236 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:53:37.236 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.236 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.237 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:37.237 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:53:37.237 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:53:37.237 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:37.237 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:37.237 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:37.237 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.237 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.237 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:37.237 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:37.237 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 104.169697314, 2024-04-25T22:53:37.237 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:53:37.237 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:37.237 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:37.238 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:37.238 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:37.238 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.238 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:37.238 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:37.238 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:37.238 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.238 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.238 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:37.238 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:37.238 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:37.238 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.238 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.238 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:37.239 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:53:37.239 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:53:37.239 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.239 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.239 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:37.239 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:53:37.239 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:53:37.239 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.239 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.239 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:37.239 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:53:37.239 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:53:37.239 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.239 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.240 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:37.240 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:53:37.240 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:53:37.240 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.240 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.240 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:37.240 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:53:37.240 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:53:37.240 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.240 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.240 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:37.240 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:53:37.240 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:53:37.240 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.240 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.241 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:37.241 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:53:37.241 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:53:37.241 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.241 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.241 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:37.241 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:53:37.241 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:53:37.241 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.241 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.241 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:37.241 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:53:37.241 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:53:37.241 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:37.242 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:37.242 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:37.242 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.242 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.242 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:37.242 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:37.242 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 104.169666233, 2024-04-25T22:53:37.242 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:53:37.242 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:37.242 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:37.242 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:37.242 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:37.242 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.242 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:37.243 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:37.243 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:37.243 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.243 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.243 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:37.243 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:37.243 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:37.243 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.243 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.243 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:37.243 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:37.243 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:37.243 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.244 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.244 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:37.244 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:53:37.244 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:53:37.244 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.244 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.244 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:37.244 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:53:37.244 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:53:37.244 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.244 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.244 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:37.244 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:53:37.244 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:53:37.245 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.245 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.245 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:37.245 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:53:37.245 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:53:37.245 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.245 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.245 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:37.245 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:53:37.245 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:53:37.245 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.245 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.245 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:37.245 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:53:37.246 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:53:37.246 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:37.246 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:37.246 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:37.246 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.246 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.246 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:53:37.246 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:37.246 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 104.169225264, 2024-04-25T22:53:37.246 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064881979999999997, 2024-04-25T22:53:37.246 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:37.246 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:37.246 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:37.247 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:37.247 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.247 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:37.247 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:37.247 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:37.247 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.247 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.247 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:37.247 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:37.247 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:37.247 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.247 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.247 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:37.248 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:37.248 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2699999999999999e-07 2024-04-25T22:53:37.248 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.248 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.248 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:37.248 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013898+0000", 2024-04-25T22:53:37.248 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0796e-05 2024-04-25T22:53:37.248 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.248 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.248 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:37.248 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013907+0000", 2024-04-25T22:53:37.248 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5140000000000007e-06 2024-04-25T22:53:37.248 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.248 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.249 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:37.249 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013952+0000", 2024-04-25T22:53:37.249 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4134000000000001e-05 2024-04-25T22:53:37.249 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.249 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.249 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:37.249 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016812+0000", 2024-04-25T22:53:37.249 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028601059999999998 2024-04-25T22:53:37.249 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.249 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.249 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:37.249 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.017052+0000", 2024-04-25T22:53:37.249 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024056500000000001 2024-04-25T22:53:37.249 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.250 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.250 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:37.250 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020350+0000", 2024-04-25T22:53:37.250 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032978320000000001 2024-04-25T22:53:37.250 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.250 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.250 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:37.250 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020375+0000", 2024-04-25T22:53:37.250 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4624e-05 2024-04-25T22:53:37.250 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:37.250 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:37.250 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:37.250 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.251 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.251 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:30 4.31 4:8ebfc112:::1000000021d.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-25T22:53:37.251 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:53:37.251 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 6.1299803629999996, 2024-04-25T22:53:37.251 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015003005, 2024-04-25T22:53:37.251 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:37.251 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:37.251 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:37.251 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:37.251 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:37.251 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:37.251 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 30 2024-04-25T22:53:37.251 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.251 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:37.251 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.252 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:37.252 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:53:37.252 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:37.252 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.252 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.252 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:37.252 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:53:37.252 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:37.252 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.252 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.252 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:37.252 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053133+0000", 2024-04-25T22:53:37.252 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0370000000000001e-06 2024-04-25T22:53:37.253 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.253 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.253 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:37.253 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060377+0000", 2024-04-25T22:53:37.253 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0072431070000000004 2024-04-25T22:53:37.253 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.253 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.253 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:37.253 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060388+0000", 2024-04-25T22:53:37.253 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1285e-05 2024-04-25T22:53:37.253 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.253 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.253 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:37.253 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060394+0000", 2024-04-25T22:53:37.254 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1040000000000003e-06 2024-04-25T22:53:37.254 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.254 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.254 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:37.254 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060483+0000", 2024-04-25T22:53:37.254 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.9345000000000006e-05 2024-04-25T22:53:37.254 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.254 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.254 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:37.254 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060566+0000", 2024-04-25T22:53:37.254 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2237999999999994e-05 2024-04-25T22:53:37.254 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.254 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.254 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:37.255 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068057+0000", 2024-04-25T22:53:37.255 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074912210000000002 2024-04-25T22:53:37.255 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.255 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.255 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:37.255 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068090+0000", 2024-04-25T22:53:37.255 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3501000000000003e-05 2024-04-25T22:53:37.255 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.255 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.255 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:37.255 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068134+0000", 2024-04-25T22:53:37.255 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4166999999999999e-05 2024-04-25T22:53:37.255 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:37.255 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:37.255 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:37.256 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.256 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.256 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:66 4.27 4:e5671758:::1000000024f.00000000:head [write 0~6641] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:37.256 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:37.256 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 5.8698700270000002, 2024-04-25T22:53:37.256 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075166540000000002, 2024-04-25T22:53:37.256 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:37.256 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:37.256 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:37.256 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:37.256 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:37.256 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:37.256 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 66 2024-04-25T22:53:37.256 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.257 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:37.257 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.257 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:37.257 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:37.257 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:37.257 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.257 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.257 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:37.257 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:37.257 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:37.257 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.257 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.257 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:37.258 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:37.258 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4099999999999998e-07 2024-04-25T22:53:37.258 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.258 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.258 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:37.258 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313252+0000", 2024-04-25T22:53:37.258 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5380000000000008e-06 2024-04-25T22:53:37.258 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.258 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.258 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:37.258 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313260+0000", 2024-04-25T22:53:37.258 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2609999999999993e-06 2024-04-25T22:53:37.258 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.258 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.259 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:37.259 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313265+0000", 2024-04-25T22:53:37.259 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4850000000000003e-06 2024-04-25T22:53:37.259 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.259 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.259 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:37.259 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313310+0000", 2024-04-25T22:53:37.259 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5247999999999998e-05 2024-04-25T22:53:37.259 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.259 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.259 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:37.259 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313370+0000", 2024-04-25T22:53:37.260 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0275000000000001e-05 2024-04-25T22:53:37.260 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.260 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.260 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:37.260 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313435+0000", 2024-04-25T22:53:37.260 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4647000000000006e-05 2024-04-25T22:53:37.260 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.260 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.260 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:37.260 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314174+0000", 2024-04-25T22:53:37.260 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00073925 2024-04-25T22:53:37.260 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.260 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.261 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:37.261 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320688+0000", 2024-04-25T22:53:37.261 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.006513418 2024-04-25T22:53:37.261 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.261 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.261 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:37.261 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320736+0000", 2024-04-25T22:53:37.261 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.8114e-05 2024-04-25T22:53:37.261 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.261 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.261 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:37.261 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320758+0000", 2024-04-25T22:53:37.261 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2776999999999999e-05 2024-04-25T22:53:37.262 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:37.262 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:37.262 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:37.262 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.262 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.262 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:68 4.31 4:8fb7f7b7:::10000000251.00000000:head [write 0~2067] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:37.262 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:37.262 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 5.8681842490000005, 2024-04-25T22:53:37.262 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0087011669999999992, 2024-04-25T22:53:37.262 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:37.262 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:37.262 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:37.262 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:37.262 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:37.263 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:37.263 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 68 2024-04-25T22:53:37.263 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.263 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:37.263 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.263 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:37.263 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:37.263 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:37.263 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.263 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.263 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:37.263 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:37.263 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:37.264 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.264 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.264 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:37.264 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:37.264 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:53:37.264 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.264 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.264 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:37.264 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314933+0000", 2024-04-25T22:53:37.264 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5430000000000004e-06 2024-04-25T22:53:37.264 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.264 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.264 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:37.264 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314944+0000", 2024-04-25T22:53:37.265 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.076e-05 2024-04-25T22:53:37.265 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.265 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.265 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:37.265 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314949+0000", 2024-04-25T22:53:37.265 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1019999999999996e-06 2024-04-25T22:53:37.265 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.265 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.265 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:37.265 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314996+0000", 2024-04-25T22:53:37.265 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7018999999999998e-05 2024-04-25T22:53:37.265 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.265 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.266 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:37.266 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315064+0000", 2024-04-25T22:53:37.266 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8738000000000005e-05 2024-04-25T22:53:37.266 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.266 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.266 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:37.266 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323531+0000", 2024-04-25T22:53:37.266 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084664739999999999 2024-04-25T22:53:37.266 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.266 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.266 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:37.266 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323574+0000", 2024-04-25T22:53:37.266 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3449999999999999e-05 2024-04-25T22:53:37.267 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.267 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.267 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:37.267 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323629+0000", 2024-04-25T22:53:37.267 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4296999999999999e-05 2024-04-25T22:53:37.267 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:37.267 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:37.267 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:37.267 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.267 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.267 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4734.0:69 4.32 e46/13 4:4e8c6251:::10000000252.00000000:head v 46'1, mlcod=0'0)", 2024-04-25T22:53:37.267 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:37.267 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 5.8671529810000003, 2024-04-25T22:53:37.267 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076063240000000002, 2024-04-25T22:53:37.268 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:37.268 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:37.268 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:37.268 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:37.268 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.268 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:37.268 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:37.268 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:37.268 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.268 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.268 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:37.268 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:37.268 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:37.268 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.269 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.269 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:37.269 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:37.269 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3099999999999997e-07 2024-04-25T22:53:37.269 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.269 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.269 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:37.269 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315964+0000", 2024-04-25T22:53:37.269 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3229999999999999e-06 2024-04-25T22:53:37.269 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.269 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.269 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:37.269 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315973+0000", 2024-04-25T22:53:37.270 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7249999999999992e-06 2024-04-25T22:53:37.270 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.270 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.270 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:37.270 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315978+0000", 2024-04-25T22:53:37.270 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4830000000000001e-06 2024-04-25T22:53:37.270 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.270 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.270 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:37.270 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.316043+0000", 2024-04-25T22:53:37.270 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.5036000000000005e-05 2024-04-25T22:53:37.270 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.270 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.271 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:37.271 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.316055+0000", 2024-04-25T22:53:37.271 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1973999999999999e-05 2024-04-25T22:53:37.271 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.271 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.271 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:37.271 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323521+0000", 2024-04-25T22:53:37.271 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074660239999999999 2024-04-25T22:53:37.271 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.271 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.271 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:37.271 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323565+0000", 2024-04-25T22:53:37.271 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4128000000000002e-05 2024-04-25T22:53:37.271 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:37.272 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:37.272 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:37.272 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.272 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.272 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:72 4.36 4:6cdfec98:::10000000255.00000000:head [write 0~4131] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:37.272 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:37.272 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 5.8651090689999998, 2024-04-25T22:53:37.272 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084820680000000006, 2024-04-25T22:53:37.272 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:37.272 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:37.272 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:37.272 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:37.272 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:37.273 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:37.273 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 72 2024-04-25T22:53:37.273 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.273 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:37.273 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.273 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:37.273 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:37.273 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:37.273 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.273 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.273 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:37.273 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:37.273 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:37.274 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.274 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.274 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:37.274 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:37.274 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1800000000000005e-07 2024-04-25T22:53:37.274 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.274 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.274 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:37.274 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318010+0000", 2024-04-25T22:53:37.274 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7399999999999998e-06 2024-04-25T22:53:37.274 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.274 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.275 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:37.275 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318019+0000", 2024-04-25T22:53:37.275 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0170000000000002e-06 2024-04-25T22:53:37.275 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.275 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.275 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:37.275 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318024+0000", 2024-04-25T22:53:37.275 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0150000000000003e-06 2024-04-25T22:53:37.275 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.275 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.275 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:37.275 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318075+0000", 2024-04-25T22:53:37.275 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0537000000000001e-05 2024-04-25T22:53:37.275 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.276 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.276 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:37.276 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318144+0000", 2024-04-25T22:53:37.276 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9432999999999997e-05 2024-04-25T22:53:37.276 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.276 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.276 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:37.276 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326392+0000", 2024-04-25T22:53:37.276 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0082482979999999994 2024-04-25T22:53:37.276 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.276 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.276 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:37.276 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326432+0000", 2024-04-25T22:53:37.277 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9870000000000003e-05 2024-04-25T22:53:37.277 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.277 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.277 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:37.277 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326485+0000", 2024-04-25T22:53:37.277 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2439999999999999e-05 2024-04-25T22:53:37.277 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:37.277 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:37.277 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:37.277 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.277 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.277 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:74 4.10 4:08e6f8ca:::10000000257.00000000:head [write 0~839] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:37.277 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:53:37.277 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 5.8636353410000002, 2024-04-25T22:53:37.278 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070370720000000001, 2024-04-25T22:53:37.278 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:37.278 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:37.278 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:37.278 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:37.278 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:37.278 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:37.278 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 74 2024-04-25T22:53:37.278 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.278 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:37.278 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.278 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:37.278 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:53:37.279 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:37.279 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.279 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.279 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:37.279 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:53:37.279 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:37.279 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.279 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.279 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:37.279 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319477+0000", 2024-04-25T22:53:37.279 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1999999999999999e-07 2024-04-25T22:53:37.279 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.279 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.280 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:37.280 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319483+0000", 2024-04-25T22:53:37.280 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4260000000000002e-06 2024-04-25T22:53:37.280 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.280 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.280 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:37.280 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319494+0000", 2024-04-25T22:53:37.280 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.094e-05 2024-04-25T22:53:37.280 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.280 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.280 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:37.280 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319499+0000", 2024-04-25T22:53:37.281 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3789999999999997e-06 2024-04-25T22:53:37.281 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.281 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.281 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:37.281 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319545+0000", 2024-04-25T22:53:37.281 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6149000000000001e-05 2024-04-25T22:53:37.281 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.281 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.281 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:37.281 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319617+0000", 2024-04-25T22:53:37.281 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1792999999999995e-05 2024-04-25T22:53:37.281 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.281 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.282 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:37.282 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326406+0000", 2024-04-25T22:53:37.282 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067895999999999998 2024-04-25T22:53:37.282 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.282 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.282 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:37.282 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326443+0000", 2024-04-25T22:53:37.282 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6828e-05 2024-04-25T22:53:37.282 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.282 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.282 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:37.282 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326514+0000", 2024-04-25T22:53:37.282 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0236999999999999e-05 2024-04-25T22:53:37.283 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:37.283 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:37.283 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:37.283 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.283 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.283 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:126 3.1f 3:f83d65d8:::200.00000004:head [write 0~857927 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e48)", 2024-04-25T22:53:37.283 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:36.368176+0000", 2024-04-25T22:53:37.283 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.81493579199999999, 2024-04-25T22:53:37.283 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064480370000000002, 2024-04-25T22:53:37.283 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:37.283 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:37.283 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:37.283 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:37.284 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.284 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:37.284 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.368176+0000", 2024-04-25T22:53:37.284 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:37.284 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.284 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.284 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:37.284 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.368176+0000", 2024-04-25T22:53:37.284 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:37.284 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.284 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.284 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:37.285 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.368178+0000", 2024-04-25T22:53:37.285 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.897e-06 2024-04-25T22:53:37.285 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.285 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.285 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:37.285 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.369115+0000", 2024-04-25T22:53:37.285 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00093664499999999995 2024-04-25T22:53:37.285 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.285 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.285 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:37.285 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.369126+0000", 2024-04-25T22:53:37.285 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1564e-05 2024-04-25T22:53:37.285 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.285 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.286 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:37.286 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.369132+0000", 2024-04-25T22:53:37.286 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7540000000000003e-06 2024-04-25T22:53:37.286 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.286 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.286 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:37.286 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.369212+0000", 2024-04-25T22:53:37.286 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0576999999999998e-05 2024-04-25T22:53:37.286 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.286 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.286 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:37.286 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.369221+0000", 2024-04-25T22:53:37.286 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.9670000000000007e-06 2024-04-25T22:53:37.287 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.287 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.287 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:37.287 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.373150+0000", 2024-04-25T22:53:37.287 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0039289269999999996 2024-04-25T22:53:37.287 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.287 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.287 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:37.287 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.373233+0000", 2024-04-25T22:53:37.287 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2558000000000005e-05 2024-04-25T22:53:37.287 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.287 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.288 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:37.288 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.374505+0000", 2024-04-25T22:53:37.288 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0012719840000000001 2024-04-25T22:53:37.288 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.288 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.288 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:37.288 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.374563+0000", 2024-04-25T22:53:37.288 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8387000000000002e-05 2024-04-25T22:53:37.288 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.288 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.288 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:37.288 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.374624+0000", 2024-04-25T22:53:37.288 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0776999999999998e-05 2024-04-25T22:53:37.289 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:37.289 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:37.289 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:37.289 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.289 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.289 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:128 3.1f 3:f83d65d8:::200.00000004:head [write 876784~3317520 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e48)", 2024-04-25T22:53:37.289 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:36.985410+0000", 2024-04-25T22:53:37.289 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.197701723, 2024-04-25T22:53:37.289 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0090177360000000002, 2024-04-25T22:53:37.289 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:37.289 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:37.289 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:37.289 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:37.289 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.290 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:37.290 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.985410+0000", 2024-04-25T22:53:37.290 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:37.290 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.290 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.290 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:37.290 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.985410+0000", 2024-04-25T22:53:37.290 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:37.290 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.290 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.290 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:37.290 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.985411+0000", 2024-04-25T22:53:37.290 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8400000000000003e-07 2024-04-25T22:53:37.291 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.291 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.291 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:37.291 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989116+0000", 2024-04-25T22:53:37.291 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037047389999999999 2024-04-25T22:53:37.291 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.291 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.291 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:37.291 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989128+0000", 2024-04-25T22:53:37.291 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1977999999999999e-05 2024-04-25T22:53:37.291 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.291 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.291 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:37.292 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989135+0000", 2024-04-25T22:53:37.292 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5290000000000003e-06 2024-04-25T22:53:37.292 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.292 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.292 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:37.292 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989181+0000", 2024-04-25T22:53:37.292 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6122999999999999e-05 2024-04-25T22:53:37.292 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.292 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.292 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:37.292 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989250+0000", 2024-04-25T22:53:37.292 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8535999999999996e-05 2024-04-25T22:53:37.292 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.293 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.293 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:37.293 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.994272+0000", 2024-04-25T22:53:37.293 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050224889999999998 2024-04-25T22:53:37.293 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.293 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.293 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:37.293 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.994335+0000", 2024-04-25T22:53:37.293 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2588000000000005e-05 2024-04-25T22:53:37.293 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:37.293 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:37.293 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:37.293 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.994428+0000", 2024-04-25T22:53:37.293 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2869999999999997e-05 2024-04-25T22:53:37.294 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:37.294 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:37.294 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:37.294 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:37.294 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:37.294 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:37.295 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:37.294+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:37.296 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:37.383 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:53:37.395 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:37.395+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:37.403 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:37.403 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:37.403 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-04-25T22:53:37.404 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:37.413 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:37.498 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:37.497+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:37.526 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-25T22:53:37.527 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:53:37.527 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:53:37.548 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-25T22:53:37.549 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:53:37.551 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:53:37.552 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:53:37.561 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:37.561 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:37.570 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:37.597 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:37.596+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:37.697 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:37.697+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:37.722 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:37.722 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:37.731 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:37.798 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:37.797+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:37.840 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:37.840 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:37.849 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:37.899 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:37.899+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:38.000 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:38.000+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:38.002 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:38.002 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:38.011 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:38.101 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:38.100+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:38.121 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:38.122 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:38.131 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:38.202 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:38.201+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:38.240 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:38.240 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:38.250 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:38.335 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:38.334+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:38.344 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-25T22:53:38.399 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:38.399 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:38.405 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:38.404+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:38.408 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:38.505 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:38.504+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:38.555 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:38.556 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:38.565 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:38.608 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:38.607+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:38.675 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:38.675 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:38.685 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:38.726 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:38.725+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:38.808 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:38.807+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:38.834 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:38.834 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:38.844 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:38.909 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:38.908+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:38.952 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:38.952 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:38.962 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:39.010 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:39.009+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:39.079 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:39.079 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:39.089 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:39.111 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:39.110+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:39.196 INFO:tasks.workunit.client.0.smithi052.stderr:Note: switching to '12973fc04fd10d4af086901e10ffa8e48866b735'. 2024-04-25T22:53:39.196 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-04-25T22:53:39.196 INFO:tasks.workunit.client.0.smithi052.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-25T22:53:39.196 INFO:tasks.workunit.client.0.smithi052.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-25T22:53:39.196 INFO:tasks.workunit.client.0.smithi052.stderr:state without impacting any branches by switching back to a branch. 2024-04-25T22:53:39.196 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-04-25T22:53:39.196 INFO:tasks.workunit.client.0.smithi052.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-25T22:53:39.196 INFO:tasks.workunit.client.0.smithi052.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-25T22:53:39.196 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-04-25T22:53:39.196 INFO:tasks.workunit.client.0.smithi052.stderr: git switch -c 2024-04-25T22:53:39.196 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-04-25T22:53:39.196 INFO:tasks.workunit.client.0.smithi052.stderr:Or undo this operation with: 2024-04-25T22:53:39.197 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-04-25T22:53:39.197 INFO:tasks.workunit.client.0.smithi052.stderr: git switch - 2024-04-25T22:53:39.197 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-04-25T22:53:39.197 INFO:tasks.workunit.client.0.smithi052.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-25T22:53:39.197 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-04-25T22:53:39.197 INFO:tasks.workunit.client.0.smithi052.stderr:HEAD is now at 12973fc0 btrfs/022: Correct seq number in golden output 2024-04-25T22:53:39.199 INFO:tasks.workunit.client.0.smithi052.stderr:+ make -j4 2024-04-25T22:53:39.212 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:39.211+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:39.213 INFO:tasks.workunit.client.0.smithi052.stdout:libtoolize -cfi 2024-04-25T22:53:39.227 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:39.227 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:39.235 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:39.319 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:39.319+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:39.334 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is set 2024-04-25T22:53:39.378 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:39.378 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:39.387 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:39.431 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:39.430+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:39.492 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:39.492 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:39.500 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:39.515 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:39.515+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:39.553 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:53:39.592 INFO:tasks.workunit.client.0.smithi052.stdout:libtoolize: putting auxiliary files in '.'. 2024-04-25T22:53:39.592 INFO:tasks.workunit.client.0.smithi052.stdout:libtoolize: copying file './config.guess' 2024-04-25T22:53:39.605 INFO:tasks.workunit.client.0.smithi052.stdout:libtoolize: copying file './config.sub' 2024-04-25T22:53:39.612 INFO:tasks.workunit.client.0.smithi052.stdout:libtoolize: copying file './install-sh' 2024-04-25T22:53:39.615 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:39.615+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:39.619 INFO:tasks.workunit.client.0.smithi052.stdout:libtoolize: copying file './ltmain.sh' 2024-04-25T22:53:39.646 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:39.646 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:39.650 INFO:tasks.workunit.client.0.smithi052.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2024-04-25T22:53:39.650 INFO:tasks.workunit.client.0.smithi052.stdout:libtoolize: copying file 'm4/libtool.m4' 2024-04-25T22:53:39.655 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:39.658 INFO:tasks.workunit.client.0.smithi052.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2024-04-25T22:53:39.667 INFO:tasks.workunit.client.0.smithi052.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2024-04-25T22:53:39.674 INFO:tasks.workunit.client.0.smithi052.stdout:libtoolize: copying file 'm4/ltversion.m4' 2024-04-25T22:53:39.681 INFO:tasks.workunit.client.0.smithi052.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2024-04-25T22:53:39.685 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-25T22:53:39.685 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:53:39.685 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:53:39.688 INFO:tasks.workunit.client.0.smithi052.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2024-04-25T22:53:39.690 INFO:tasks.workunit.client.0.smithi052.stdout:cp include/install-sh . 2024-04-25T22:53:39.695 INFO:tasks.workunit.client.0.smithi052.stdout:aclocal -I m4 2024-04-25T22:53:39.704 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-25T22:53:39.704 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:53:39.707 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:53:39.707 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:53:39.716 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:39.716+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:39.760 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:39.760 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:53:39.760 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:53:39.760 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:53:39.760 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.760 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:53:39.760 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:39.760 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 111.791029736, 2024-04-25T22:53:39.760 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:53:39.760 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:39.760 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:39.760 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:39.761 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:39.761 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.761 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:39.761 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:39.761 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:39.761 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.761 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.761 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:39.761 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:39.761 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:39.761 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.761 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.761 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:39.762 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:53:39.762 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:53:39.762 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.762 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.762 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:39.762 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:53:39.762 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:53:39.762 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.762 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.762 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:39.762 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:53:39.762 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:53:39.763 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.763 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.763 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:39.763 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:53:39.763 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:53:39.763 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.763 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.763 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:39.763 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:53:39.763 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:53:39.764 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.764 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.764 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:39.764 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:53:39.764 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:53:39.764 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.764 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.764 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:39.764 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:53:39.764 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:53:39.764 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.764 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.764 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:39.765 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:53:39.765 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:53:39.765 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:39.765 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:39.765 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:39.765 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.765 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.765 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:110 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'72, mlcod=10'68)", 2024-04-25T22:53:39.765 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:39.765 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 111.79039573599999, 2024-04-25T22:53:39.765 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065316630000000001, 2024-04-25T22:53:39.765 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:39.765 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:39.766 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:39.766 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:39.766 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.766 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:39.766 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:39.766 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:39.766 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.766 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.766 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:39.766 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:39.766 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:39.766 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.766 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.767 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:39.767 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:39.767 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.58e-07 2024-04-25T22:53:39.767 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.767 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.767 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:39.767 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967811+0000", 2024-04-25T22:53:39.767 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.118e-06 2024-04-25T22:53:39.767 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.767 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.767 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:39.767 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967817+0000", 2024-04-25T22:53:39.767 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3709999999999996e-06 2024-04-25T22:53:39.768 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.768 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.768 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:39.768 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967820+0000", 2024-04-25T22:53:39.768 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2210000000000002e-06 2024-04-25T22:53:39.768 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.768 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.768 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:39.768 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967876+0000", 2024-04-25T22:53:39.768 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5507000000000002e-05 2024-04-25T22:53:39.768 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.768 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.769 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:39.769 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967893+0000", 2024-04-25T22:53:39.769 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7812000000000002e-05 2024-04-25T22:53:39.769 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.769 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.769 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:39.769 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974317+0000", 2024-04-25T22:53:39.769 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064237160000000003 2024-04-25T22:53:39.769 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.769 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.769 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:39.769 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:53:39.769 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.156e-05 2024-04-25T22:53:39.770 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:39.770 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:39.770 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:39.770 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.770 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.770 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:39.770 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:39.770 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 106.746534037, 2024-04-25T22:53:39.770 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:53:39.770 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:39.770 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:39.770 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:39.770 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:39.771 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.771 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:39.771 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:39.771 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:39.771 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.771 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.771 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:39.771 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:39.771 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:39.771 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.771 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.771 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:39.771 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:53:39.771 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:53:39.772 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.772 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.772 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:39.772 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:53:39.772 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:53:39.772 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.772 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.772 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:39.772 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:53:39.772 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:53:39.772 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.772 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.773 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:39.773 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:53:39.773 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:53:39.773 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.773 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.773 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:39.773 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:53:39.773 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:53:39.773 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.773 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.773 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:39.773 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:53:39.773 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:53:39.774 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.774 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.774 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:39.774 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:53:39.774 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:53:39.774 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.774 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.774 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:39.774 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:53:39.774 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:53:39.774 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.774 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.775 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:39.775 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:53:39.775 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:53:39.775 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.775 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.775 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:39.775 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:53:39.775 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:53:39.775 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.775 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.775 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:39.775 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:53:39.775 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:53:39.776 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:39.776 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:39.776 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:39.776 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.776 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.776 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:39.776 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:39.776 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 106.745859661, 2024-04-25T22:53:39.776 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:53:39.776 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:39.776 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:39.776 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:39.776 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:39.776 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.777 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:39.777 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:39.777 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:39.777 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.777 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.777 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:39.777 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:39.777 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:39.777 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.777 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.777 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:39.777 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:53:39.777 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:53:39.777 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.777 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.778 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:39.778 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:53:39.778 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:53:39.778 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.778 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.778 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:39.778 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:53:39.778 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:53:39.778 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.778 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.779 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:39.779 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:53:39.779 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:53:39.779 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.779 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.779 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:39.779 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:53:39.779 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:53:39.779 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.779 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.780 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:39.780 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:53:39.780 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:53:39.780 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.780 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.780 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:39.780 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:53:39.780 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:53:39.780 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.780 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.780 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:39.780 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:53:39.781 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:53:39.781 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.781 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.781 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:39.781 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:53:39.781 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:53:39.781 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.781 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.781 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:39.781 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:53:39.781 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:53:39.781 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.782 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.782 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:39.782 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:53:39.782 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:53:39.782 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:39.782 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:39.782 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:39.782 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.782 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.782 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:39.783 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:39.783 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 106.745350449, 2024-04-25T22:53:39.783 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:53:39.783 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:39.783 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:39.783 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:39.783 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:39.783 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.783 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:39.783 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:39.783 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:39.783 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.783 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.784 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:39.784 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:39.784 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:39.784 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.784 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.784 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:39.784 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:53:39.784 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:53:39.784 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.784 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.784 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:39.784 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:53:39.784 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:53:39.785 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.785 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.785 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:39.785 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:53:39.785 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:53:39.785 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.785 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.785 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:39.785 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:53:39.785 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:53:39.785 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.785 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.785 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:39.786 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:53:39.786 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:53:39.786 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.786 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.786 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:39.786 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:53:39.786 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:53:39.786 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.786 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.786 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:39.787 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:53:39.787 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:53:39.787 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.787 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.787 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:39.787 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:53:39.787 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:53:39.787 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.787 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.787 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:39.787 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:53:39.787 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:53:39.787 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.788 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.788 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:39.788 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:53:39.788 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:53:39.788 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.788 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.788 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:39.788 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:53:39.788 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:53:39.788 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:39.788 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:39.788 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:39.788 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.788 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.789 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:39.789 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:39.789 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 106.744937251, 2024-04-25T22:53:39.789 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:53:39.789 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:39.789 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:39.789 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:39.789 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:39.789 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.789 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:39.789 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:39.789 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:39.789 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.789 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.789 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:39.790 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:39.790 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:39.790 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.790 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.790 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:39.790 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:39.790 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:53:39.790 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.790 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.790 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:39.790 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:39.790 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:53:39.790 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.791 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.791 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:39.791 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:53:39.791 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:53:39.791 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.791 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.791 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:39.791 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:53:39.791 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:53:39.791 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.791 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.791 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:39.791 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:53:39.791 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:53:39.792 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.792 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.792 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:39.792 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:53:39.792 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:53:39.792 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.792 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.792 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:39.792 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:53:39.792 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:53:39.792 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.792 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.792 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:39.793 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:53:39.793 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:53:39.793 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.793 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.793 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:39.793 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:53:39.793 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:53:39.793 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.793 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.793 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:39.794 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:53:39.794 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:53:39.794 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.794 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.794 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:39.794 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:53:39.794 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:53:39.794 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:39.794 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:39.794 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:39.794 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.794 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.794 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:39.795 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:39.795 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 106.744886581, 2024-04-25T22:53:39.795 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:53:39.795 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:39.795 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:39.795 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:39.795 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:39.795 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.795 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:39.795 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:39.795 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:39.795 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.795 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.796 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:39.796 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:39.796 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:39.796 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.796 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.796 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:39.796 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:53:39.796 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:53:39.796 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.796 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.796 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:39.796 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:53:39.796 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:53:39.796 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.797 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.797 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:39.797 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:53:39.797 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:53:39.797 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.797 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.797 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:39.797 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:53:39.797 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:53:39.797 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.797 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.797 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:39.797 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:53:39.798 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:53:39.798 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.798 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.798 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:39.798 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:53:39.798 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:53:39.798 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.798 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.798 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:39.798 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:53:39.798 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:53:39.798 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.798 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.799 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:39.799 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:53:39.799 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:53:39.799 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.799 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.799 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:39.799 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:53:39.799 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:53:39.799 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.799 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.799 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:39.799 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:53:39.799 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:53:39.800 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.800 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.800 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:39.800 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:53:39.800 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:53:39.800 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.800 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.800 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:39.800 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:53:39.800 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:53:39.800 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.800 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.800 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:39.801 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:53:39.801 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:53:39.801 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:39.801 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:39.801 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:39.801 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.801 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.801 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:39.801 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:39.801 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 106.744849712, 2024-04-25T22:53:39.801 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:53:39.801 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:39.801 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:39.801 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:39.802 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:39.802 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.802 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:39.802 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:39.802 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:39.802 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.802 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.802 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:39.802 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:39.802 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:39.802 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.802 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.803 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:39.803 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:53:39.803 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:53:39.803 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.803 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.803 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:39.803 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:53:39.803 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:53:39.803 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.803 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.803 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:39.803 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:53:39.803 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:53:39.803 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.804 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.804 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:39.804 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:53:39.804 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:53:39.804 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.804 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.804 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:39.804 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:53:39.804 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:53:39.804 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.804 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.804 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:53:39.804 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:53:39.805 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:53:39.805 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.805 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.805 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:39.805 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:53:39.805 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:53:39.805 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.805 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.805 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:39.805 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:53:39.805 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:53:39.805 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.805 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.806 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:39.806 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:53:39.806 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:53:39.806 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.806 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.806 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:39.806 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:53:39.806 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:53:39.806 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.806 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.806 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:39.806 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:53:39.806 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:53:39.807 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.807 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.807 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:39.807 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:53:39.807 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:53:39.807 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.807 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.807 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:39.807 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:53:39.807 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:53:39.807 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:39.807 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:39.807 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:39.808 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.808 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.808 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:39.808 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:39.808 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 106.74482474600001, 2024-04-25T22:53:39.808 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:53:39.808 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:39.808 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:39.808 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:39.808 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:39.808 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.808 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:39.808 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:39.809 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:39.809 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.809 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.809 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:39.809 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:39.809 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:39.809 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.809 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.809 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:39.809 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:53:39.809 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:53:39.809 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.809 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.809 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:39.810 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:53:39.810 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:53:39.810 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.810 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.810 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:39.810 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:39.810 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:53:39.810 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.810 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.810 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:39.810 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:53:39.810 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:53:39.811 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.811 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.811 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:39.811 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:53:39.811 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:53:39.811 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.811 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.811 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:39.811 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:53:39.811 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:53:39.811 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.811 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.811 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:39.811 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:53:39.812 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:53:39.812 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.812 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.812 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:39.812 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:53:39.812 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:53:39.812 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.812 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.812 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:39.812 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:53:39.812 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:53:39.812 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.812 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.813 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:39.813 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:53:39.813 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:53:39.813 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.813 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.813 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:39.813 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:53:39.813 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:53:39.813 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:39.813 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:39.813 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:39.813 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.813 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.814 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:39.814 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:39.814 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 106.744788382, 2024-04-25T22:53:39.814 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:53:39.814 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:39.814 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:39.814 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:39.814 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:39.814 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.814 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:39.814 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:39.814 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:39.814 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.814 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.815 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:39.815 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:39.815 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:39.815 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.815 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.815 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:39.815 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:53:39.815 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:53:39.815 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.815 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.815 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:39.815 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:53:39.815 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:53:39.816 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.816 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.816 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:39.816 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:53:39.816 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:53:39.816 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.816 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.816 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:39.816 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:53:39.816 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:53:39.816 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.816 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.816 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:39.816 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:53:39.817 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:53:39.817 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.817 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.817 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:39.817 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:53:39.817 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:53:39.817 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.817 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.817 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:39.817 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:53:39.817 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:53:39.817 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.817 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.817 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:39.818 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:53:39.818 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:53:39.818 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.818 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.818 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:39.818 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:53:39.818 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:53:39.818 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:39.818 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:39.818 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:39.818 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.818 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.818 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:39.819 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:39.819 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 106.74475730100001, 2024-04-25T22:53:39.819 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:53:39.819 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:39.819 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:39.819 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:39.819 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:39.819 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.819 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:39.819 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:39.819 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:39.819 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.819 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.820 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:39.820 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:39.820 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:39.820 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.820 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.820 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:39.820 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:39.820 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:39.820 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.820 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.820 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:39.820 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:53:39.820 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:53:39.821 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.821 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.821 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:39.821 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:53:39.821 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:53:39.821 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.821 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.821 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:39.821 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:53:39.821 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:53:39.821 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.821 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.821 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:39.822 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:53:39.822 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:53:39.822 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.822 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.822 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:39.822 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:53:39.822 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:53:39.822 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.822 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.822 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:39.822 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:53:39.822 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:53:39.822 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:39.823 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:39.823 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:39.823 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.823 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.823 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:53:39.823 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:39.823 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 106.744316332, 2024-04-25T22:53:39.823 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064881979999999997, 2024-04-25T22:53:39.823 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:39.823 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:39.823 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:39.823 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:39.823 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.824 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:39.824 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:39.824 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:39.824 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.824 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.824 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:39.824 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:39.824 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:39.824 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.824 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.824 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:39.824 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:39.824 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2699999999999999e-07 2024-04-25T22:53:39.825 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.825 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.825 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:39.825 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013898+0000", 2024-04-25T22:53:39.825 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0796e-05 2024-04-25T22:53:39.825 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.825 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.825 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:39.825 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013907+0000", 2024-04-25T22:53:39.825 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5140000000000007e-06 2024-04-25T22:53:39.825 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.825 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.825 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:39.826 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013952+0000", 2024-04-25T22:53:39.826 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4134000000000001e-05 2024-04-25T22:53:39.826 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.826 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.826 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:39.826 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016812+0000", 2024-04-25T22:53:39.826 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028601059999999998 2024-04-25T22:53:39.826 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.826 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.826 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:39.826 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.017052+0000", 2024-04-25T22:53:39.826 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024056500000000001 2024-04-25T22:53:39.826 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.826 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.827 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:39.827 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020350+0000", 2024-04-25T22:53:39.827 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032978320000000001 2024-04-25T22:53:39.827 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.827 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.827 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:39.827 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020375+0000", 2024-04-25T22:53:39.827 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4624e-05 2024-04-25T22:53:39.827 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:39.827 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:39.827 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:39.827 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.827 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.827 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:30 4.31 4:8ebfc112:::1000000021d.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-25T22:53:39.828 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:53:39.828 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 8.7050714310000004, 2024-04-25T22:53:39.828 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015003005, 2024-04-25T22:53:39.828 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:39.828 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:39.828 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:39.828 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:39.828 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:39.828 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:39.828 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 30 2024-04-25T22:53:39.828 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.828 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:39.828 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.829 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:39.829 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:53:39.829 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:39.829 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.829 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.829 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:39.829 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:53:39.829 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:39.829 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.829 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.829 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:39.829 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053133+0000", 2024-04-25T22:53:39.829 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0370000000000001e-06 2024-04-25T22:53:39.829 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.830 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.830 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:39.830 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060377+0000", 2024-04-25T22:53:39.830 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0072431070000000004 2024-04-25T22:53:39.830 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.830 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.830 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:39.830 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060388+0000", 2024-04-25T22:53:39.830 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1285e-05 2024-04-25T22:53:39.830 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.830 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.830 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:39.830 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060394+0000", 2024-04-25T22:53:39.831 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1040000000000003e-06 2024-04-25T22:53:39.831 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.831 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.831 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:39.831 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060483+0000", 2024-04-25T22:53:39.831 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.9345000000000006e-05 2024-04-25T22:53:39.831 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.831 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.831 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:39.831 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060566+0000", 2024-04-25T22:53:39.831 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2237999999999994e-05 2024-04-25T22:53:39.831 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.831 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.832 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:39.832 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068057+0000", 2024-04-25T22:53:39.832 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074912210000000002 2024-04-25T22:53:39.832 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.832 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.832 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:39.832 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068090+0000", 2024-04-25T22:53:39.832 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3501000000000003e-05 2024-04-25T22:53:39.832 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.832 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.832 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:39.832 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068134+0000", 2024-04-25T22:53:39.832 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4166999999999999e-05 2024-04-25T22:53:39.832 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:39.833 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:39.833 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:39.833 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.833 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.833 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:66 4.27 4:e5671758:::1000000024f.00000000:head [write 0~6641] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:39.833 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:39.833 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 8.444961095, 2024-04-25T22:53:39.833 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075166540000000002, 2024-04-25T22:53:39.833 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:39.833 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:39.833 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:39.833 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:39.833 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:39.834 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:39.834 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 66 2024-04-25T22:53:39.834 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.834 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:39.834 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.834 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:39.834 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:39.834 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:39.834 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.834 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.834 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:39.834 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:39.834 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:39.835 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.835 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.835 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:39.835 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:39.835 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4099999999999998e-07 2024-04-25T22:53:39.835 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.835 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.835 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:39.835 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313252+0000", 2024-04-25T22:53:39.835 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5380000000000008e-06 2024-04-25T22:53:39.835 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.835 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.835 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:39.835 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313260+0000", 2024-04-25T22:53:39.836 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2609999999999993e-06 2024-04-25T22:53:39.836 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.836 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.836 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:39.836 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313265+0000", 2024-04-25T22:53:39.836 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4850000000000003e-06 2024-04-25T22:53:39.836 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.836 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.836 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:39.836 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313310+0000", 2024-04-25T22:53:39.836 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5247999999999998e-05 2024-04-25T22:53:39.836 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.836 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.837 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:39.837 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313370+0000", 2024-04-25T22:53:39.837 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0275000000000001e-05 2024-04-25T22:53:39.837 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.837 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.837 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:39.837 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313435+0000", 2024-04-25T22:53:39.837 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4647000000000006e-05 2024-04-25T22:53:39.837 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.837 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.837 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:39.837 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314174+0000", 2024-04-25T22:53:39.837 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00073925 2024-04-25T22:53:39.838 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.838 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.838 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:39.838 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320688+0000", 2024-04-25T22:53:39.838 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.006513418 2024-04-25T22:53:39.838 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.838 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.838 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:39.838 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320736+0000", 2024-04-25T22:53:39.838 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.8114e-05 2024-04-25T22:53:39.838 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.838 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.838 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:39.838 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320758+0000", 2024-04-25T22:53:39.839 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2776999999999999e-05 2024-04-25T22:53:39.839 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:39.839 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:39.839 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:39.839 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.839 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.839 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:68 4.31 4:8fb7f7b7:::10000000251.00000000:head [write 0~2067] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:39.839 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:39.839 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 8.4432753169999994, 2024-04-25T22:53:39.839 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0087011669999999992, 2024-04-25T22:53:39.839 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:39.839 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:39.839 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:39.840 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:39.840 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:39.840 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:39.840 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 68 2024-04-25T22:53:39.840 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.840 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:39.840 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.840 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:39.840 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:39.840 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:39.840 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.840 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.840 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:39.841 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:39.841 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:39.841 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.841 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.841 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:39.841 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:39.841 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:53:39.841 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.841 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.841 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:39.841 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314933+0000", 2024-04-25T22:53:39.841 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5430000000000004e-06 2024-04-25T22:53:39.841 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.842 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.842 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:39.842 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314944+0000", 2024-04-25T22:53:39.842 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.076e-05 2024-04-25T22:53:39.842 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.842 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.842 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:39.842 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314949+0000", 2024-04-25T22:53:39.842 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1019999999999996e-06 2024-04-25T22:53:39.842 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.842 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.842 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:39.842 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314996+0000", 2024-04-25T22:53:39.843 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7018999999999998e-05 2024-04-25T22:53:39.843 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.843 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.843 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:39.843 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315064+0000", 2024-04-25T22:53:39.843 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8738000000000005e-05 2024-04-25T22:53:39.843 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.843 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.843 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:39.843 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323531+0000", 2024-04-25T22:53:39.843 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084664739999999999 2024-04-25T22:53:39.843 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.843 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.844 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:39.844 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323574+0000", 2024-04-25T22:53:39.844 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3449999999999999e-05 2024-04-25T22:53:39.844 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.844 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.844 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:39.844 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323629+0000", 2024-04-25T22:53:39.844 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4296999999999999e-05 2024-04-25T22:53:39.844 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:39.844 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:39.844 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:39.844 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.844 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.845 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4734.0:69 4.32 e46/13 4:4e8c6251:::10000000252.00000000:head v 46'1, mlcod=0'0)", 2024-04-25T22:53:39.845 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:39.845 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 8.4422440489999993, 2024-04-25T22:53:39.845 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076063240000000002, 2024-04-25T22:53:39.845 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:39.845 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:39.845 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:39.845 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:39.845 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.845 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:39.845 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:39.845 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:39.845 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.845 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.846 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:39.846 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:39.846 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:39.846 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.846 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.846 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:39.846 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:39.846 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3099999999999997e-07 2024-04-25T22:53:39.846 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.846 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.846 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:39.846 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315964+0000", 2024-04-25T22:53:39.846 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3229999999999999e-06 2024-04-25T22:53:39.847 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.847 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.847 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:39.847 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315973+0000", 2024-04-25T22:53:39.847 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7249999999999992e-06 2024-04-25T22:53:39.847 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.847 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.847 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:39.847 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315978+0000", 2024-04-25T22:53:39.847 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4830000000000001e-06 2024-04-25T22:53:39.847 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.847 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.847 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:39.848 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.316043+0000", 2024-04-25T22:53:39.848 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.5036000000000005e-05 2024-04-25T22:53:39.848 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.848 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.848 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:39.848 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.316055+0000", 2024-04-25T22:53:39.848 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1973999999999999e-05 2024-04-25T22:53:39.848 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.848 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.848 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:39.848 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323521+0000", 2024-04-25T22:53:39.848 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074660239999999999 2024-04-25T22:53:39.848 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.848 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.849 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:39.849 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323565+0000", 2024-04-25T22:53:39.849 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4128000000000002e-05 2024-04-25T22:53:39.849 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:39.849 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:39.849 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:39.849 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.849 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.849 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:72 4.36 4:6cdfec98:::10000000255.00000000:head [write 0~4131] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:39.849 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:39.849 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 8.4402001369999997, 2024-04-25T22:53:39.849 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084820680000000006, 2024-04-25T22:53:39.850 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:39.850 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:39.850 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:39.850 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:39.850 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:39.850 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:39.850 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 72 2024-04-25T22:53:39.850 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.850 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:39.850 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.850 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:39.850 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:39.850 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:39.851 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.851 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.851 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:39.851 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:39.851 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:39.851 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.851 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.851 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:39.851 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:39.851 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1800000000000005e-07 2024-04-25T22:53:39.851 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.851 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.851 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:39.851 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318010+0000", 2024-04-25T22:53:39.852 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7399999999999998e-06 2024-04-25T22:53:39.852 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.852 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.852 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:39.852 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318019+0000", 2024-04-25T22:53:39.852 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0170000000000002e-06 2024-04-25T22:53:39.852 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.852 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.852 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:39.852 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318024+0000", 2024-04-25T22:53:39.852 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0150000000000003e-06 2024-04-25T22:53:39.852 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.852 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.852 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:39.853 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318075+0000", 2024-04-25T22:53:39.853 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0537000000000001e-05 2024-04-25T22:53:39.853 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.853 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.853 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:39.853 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318144+0000", 2024-04-25T22:53:39.853 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9432999999999997e-05 2024-04-25T22:53:39.853 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.853 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.853 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:39.853 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326392+0000", 2024-04-25T22:53:39.853 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0082482979999999994 2024-04-25T22:53:39.853 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.853 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.854 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:39.854 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326432+0000", 2024-04-25T22:53:39.854 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9870000000000003e-05 2024-04-25T22:53:39.854 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.854 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.854 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:39.854 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326485+0000", 2024-04-25T22:53:39.854 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2439999999999999e-05 2024-04-25T22:53:39.854 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:39.854 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:39.854 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:39.854 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.854 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.855 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:74 4.10 4:08e6f8ca:::10000000257.00000000:head [write 0~839] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:39.855 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:53:39.855 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 8.4387264089999992, 2024-04-25T22:53:39.855 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070370720000000001, 2024-04-25T22:53:39.855 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:39.855 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:39.855 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:39.855 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:39.855 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:39.855 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:39.855 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 74 2024-04-25T22:53:39.855 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.855 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:39.855 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.855 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:39.856 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:53:39.856 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:39.856 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.856 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.856 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:39.856 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:53:39.856 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:39.856 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.856 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.856 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:39.856 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319477+0000", 2024-04-25T22:53:39.856 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1999999999999999e-07 2024-04-25T22:53:39.856 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.857 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.857 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:39.857 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319483+0000", 2024-04-25T22:53:39.857 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4260000000000002e-06 2024-04-25T22:53:39.857 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.857 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.857 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:39.857 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319494+0000", 2024-04-25T22:53:39.857 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.094e-05 2024-04-25T22:53:39.857 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.857 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.857 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:39.857 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319499+0000", 2024-04-25T22:53:39.857 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3789999999999997e-06 2024-04-25T22:53:39.858 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.858 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.858 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:39.858 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319545+0000", 2024-04-25T22:53:39.858 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6149000000000001e-05 2024-04-25T22:53:39.858 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.858 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.858 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:39.858 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319617+0000", 2024-04-25T22:53:39.858 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1792999999999995e-05 2024-04-25T22:53:39.858 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.858 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.858 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:39.859 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326406+0000", 2024-04-25T22:53:39.859 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067895999999999998 2024-04-25T22:53:39.859 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.859 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.859 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:39.859 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326443+0000", 2024-04-25T22:53:39.859 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6828e-05 2024-04-25T22:53:39.859 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.859 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.859 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:39.859 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326514+0000", 2024-04-25T22:53:39.859 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0236999999999999e-05 2024-04-25T22:53:39.859 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:39.859 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:39.860 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:39.860 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.860 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.860 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:126 3.1f 3:f83d65d8:::200.00000004:head [write 0~857927 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e48)", 2024-04-25T22:53:39.860 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:36.368176+0000", 2024-04-25T22:53:39.860 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 3.3900268599999999, 2024-04-25T22:53:39.860 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064480370000000002, 2024-04-25T22:53:39.860 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:39.860 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:39.860 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:39.860 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:39.860 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.860 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:39.861 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.368176+0000", 2024-04-25T22:53:39.861 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:39.861 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.861 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.861 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:39.861 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.368176+0000", 2024-04-25T22:53:39.861 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:39.861 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.861 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.861 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:39.861 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.368178+0000", 2024-04-25T22:53:39.861 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.897e-06 2024-04-25T22:53:39.861 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.862 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.862 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:39.862 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.369115+0000", 2024-04-25T22:53:39.862 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00093664499999999995 2024-04-25T22:53:39.862 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.862 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.862 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:39.862 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.369126+0000", 2024-04-25T22:53:39.862 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1564e-05 2024-04-25T22:53:39.862 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.862 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.862 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:39.863 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.369132+0000", 2024-04-25T22:53:39.863 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7540000000000003e-06 2024-04-25T22:53:39.863 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.863 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.863 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:39.863 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.369212+0000", 2024-04-25T22:53:39.863 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0576999999999998e-05 2024-04-25T22:53:39.863 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.863 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.863 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:39.863 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.369221+0000", 2024-04-25T22:53:39.863 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.9670000000000007e-06 2024-04-25T22:53:39.863 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.863 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.864 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:39.864 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.373150+0000", 2024-04-25T22:53:39.864 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0039289269999999996 2024-04-25T22:53:39.864 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.864 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.864 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:39.864 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.373233+0000", 2024-04-25T22:53:39.864 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2558000000000005e-05 2024-04-25T22:53:39.864 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.864 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.864 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:39.864 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.374505+0000", 2024-04-25T22:53:39.864 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0012719840000000001 2024-04-25T22:53:39.865 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.865 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.865 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:39.865 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.374563+0000", 2024-04-25T22:53:39.865 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8387000000000002e-05 2024-04-25T22:53:39.865 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.865 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.865 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:39.865 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.374624+0000", 2024-04-25T22:53:39.865 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0776999999999998e-05 2024-04-25T22:53:39.865 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:39.865 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:39.865 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:39.866 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.866 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.866 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:128 3.1f 3:f83d65d8:::200.00000004:head [write 876784~3317520 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e48)", 2024-04-25T22:53:39.866 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:36.985410+0000", 2024-04-25T22:53:39.866 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 2.7727927910000001, 2024-04-25T22:53:39.866 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0090177360000000002, 2024-04-25T22:53:39.866 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:39.866 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:39.866 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:39.866 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:39.866 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.866 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:39.866 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.985410+0000", 2024-04-25T22:53:39.867 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:39.867 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.867 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.867 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:39.867 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.985410+0000", 2024-04-25T22:53:39.867 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:39.867 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.867 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.867 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:39.867 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.985411+0000", 2024-04-25T22:53:39.867 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8400000000000003e-07 2024-04-25T22:53:39.867 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.867 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.868 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:39.868 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989116+0000", 2024-04-25T22:53:39.868 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037047389999999999 2024-04-25T22:53:39.868 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.868 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.868 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:39.868 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989128+0000", 2024-04-25T22:53:39.868 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1977999999999999e-05 2024-04-25T22:53:39.868 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.868 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.868 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:39.868 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989135+0000", 2024-04-25T22:53:39.868 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5290000000000003e-06 2024-04-25T22:53:39.868 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.869 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.869 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:39.869 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989181+0000", 2024-04-25T22:53:39.869 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6122999999999999e-05 2024-04-25T22:53:39.869 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.869 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.869 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:39.869 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989250+0000", 2024-04-25T22:53:39.869 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8535999999999996e-05 2024-04-25T22:53:39.869 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.869 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.869 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:39.869 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.994272+0000", 2024-04-25T22:53:39.869 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050224889999999998 2024-04-25T22:53:39.870 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.870 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.870 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:39.870 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.994335+0000", 2024-04-25T22:53:39.870 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2588000000000005e-05 2024-04-25T22:53:39.870 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:39.870 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:39.870 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:39.870 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.994428+0000", 2024-04-25T22:53:39.870 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2869999999999997e-05 2024-04-25T22:53:39.870 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:39.870 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:39.871 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:39.871 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:39.871 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:39.871 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:39.872 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:39.873 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:39.872+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:39.973 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:39.972+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:39.986 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:39.986 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:39.986 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-04-25T22:53:39.986 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:39.995 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:40.078 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:40.078+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:40.159 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:40.159 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:40.159 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:53:40.159 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:53:40.159 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:40.167 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:40.209 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:40.208+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:40.275 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:40.274+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:40.312 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:40.313 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-04-25T22:53:40.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-04-25T22:53:40.313 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:53:40.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.313 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:40.313 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:40.313 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 112.345875357, 2024-04-25T22:53:40.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010384338999999999, 2024-04-25T22:53:40.313 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:40.313 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:40.313 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:40.313 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:40.314 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:40.314 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:40.314 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-04-25T22:53:40.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.314 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:40.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:40.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:40.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:40.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:40.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:40.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:40.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:40.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:40.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3600000000000004e-07 2024-04-25T22:53:40.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:40.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965185+0000", 2024-04-25T22:53:40.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.117e-06 2024-04-25T22:53:40.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:40.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965192+0000", 2024-04-25T22:53:40.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3239999999999997e-06 2024-04-25T22:53:40.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:40.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965198+0000", 2024-04-25T22:53:40.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6370000000000004e-06 2024-04-25T22:53:40.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:40.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970973+0000", 2024-04-25T22:53:40.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057748239999999996 2024-04-25T22:53:40.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:40.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971049+0000", 2024-04-25T22:53:40.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6029e-05 2024-04-25T22:53:40.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:40.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971174+0000", 2024-04-25T22:53:40.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012462399999999999 2024-04-25T22:53:40.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:40.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971553+0000", 2024-04-25T22:53:40.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037896499999999999 2024-04-25T22:53:40.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:40.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975482+0000", 2024-04-25T22:53:40.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039297459999999996 2024-04-25T22:53:40.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:40.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975529+0000", 2024-04-25T22:53:40.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6387000000000002e-05 2024-04-25T22:53:40.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:40.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975563+0000", 2024-04-25T22:53:40.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4150000000000003e-05 2024-04-25T22:53:40.319 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:40.319 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:40.319 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:40.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.319 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:40.319 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:40.319 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 107.29882903399999, 2024-04-25T22:53:40.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012637705000000001, 2024-04-25T22:53:40.319 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:40.320 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:40.320 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:40.320 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:40.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:40.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:40.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:40.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:40.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:40.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:40.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:40.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012227+0000", 2024-04-25T22:53:40.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.863e-06 2024-04-25T22:53:40.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:40.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012236+0000", 2024-04-25T22:53:40.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1109999999999997e-06 2024-04-25T22:53:40.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:40.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012309+0000", 2024-04-25T22:53:40.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3242000000000001e-05 2024-04-25T22:53:40.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:40.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012324+0000", 2024-04-25T22:53:40.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4837e-05 2024-04-25T22:53:40.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:40.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015060+0000", 2024-04-25T22:53:40.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027363349999999999 2024-04-25T22:53:40.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:40.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015169+0000", 2024-04-25T22:53:40.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108372 2024-04-25T22:53:40.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:40.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015498+0000", 2024-04-25T22:53:40.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032949999999999999 2024-04-25T22:53:40.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:40.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021282+0000", 2024-04-25T22:53:40.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057836429999999998 2024-04-25T22:53:40.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:40.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024709+0000", 2024-04-25T22:53:40.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034271979999999998 2024-04-25T22:53:40.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:40.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024802+0000", 2024-04-25T22:53:40.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2960000000000004e-05 2024-04-25T22:53:40.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:40.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024863+0000", 2024-04-25T22:53:40.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0643999999999997e-05 2024-04-25T22:53:40.324 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:40.324 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:40.324 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:40.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.325 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:40.325 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:40.325 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 107.298705263, 2024-04-25T22:53:40.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012979447999999999, 2024-04-25T22:53:40.325 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:40.325 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:40.325 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:40.325 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:40.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:40.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:40.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:40.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:40.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:40.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:40.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:40.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:40.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:53:40.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:40.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012354+0000", 2024-04-25T22:53:40.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7740000000000004e-06 2024-04-25T22:53:40.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:40.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012365+0000", 2024-04-25T22:53:40.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.064e-05 2024-04-25T22:53:40.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:40.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012382+0000", 2024-04-25T22:53:40.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6999000000000001e-05 2024-04-25T22:53:40.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:40.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015958+0000", 2024-04-25T22:53:40.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035765699999999998 2024-04-25T22:53:40.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:40.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016037+0000", 2024-04-25T22:53:40.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8242000000000001e-05 2024-04-25T22:53:40.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:40.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016404+0000", 2024-04-25T22:53:40.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036784300000000002 2024-04-25T22:53:40.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:40.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021294+0000", 2024-04-25T22:53:40.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048890629999999999 2024-04-25T22:53:40.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:40.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024959+0000", 2024-04-25T22:53:40.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036651570000000001 2024-04-25T22:53:40.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:40.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025097+0000", 2024-04-25T22:53:40.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013788099999999999 2024-04-25T22:53:40.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:40.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025328+0000", 2024-04-25T22:53:40.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231492 2024-04-25T22:53:40.331 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:40.331 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:40.331 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:40.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.331 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:40.331 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:40.331 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 107.298617494, 2024-04-25T22:53:40.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013049827, 2024-04-25T22:53:40.331 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:40.331 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:40.331 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:40.331 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:40.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:40.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:40.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:40.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:40.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:40.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:40.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:40.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012437+0000", 2024-04-25T22:53:40.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-04-25T22:53:40.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:40.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012440+0000", 2024-04-25T22:53:40.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7609999999999999e-06 2024-04-25T22:53:40.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:40.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012449+0000", 2024-04-25T22:53:40.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.285e-06 2024-04-25T22:53:40.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:40.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012457+0000", 2024-04-25T22:53:40.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9510000000000006e-06 2024-04-25T22:53:40.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:40.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017106+0000", 2024-04-25T22:53:40.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046494220000000003 2024-04-25T22:53:40.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:40.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017223+0000", 2024-04-25T22:53:40.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116824 2024-04-25T22:53:40.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:40.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017345+0000", 2024-04-25T22:53:40.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122175 2024-04-25T22:53:40.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:40.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021299+0000", 2024-04-25T22:53:40.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039534879999999998 2024-04-25T22:53:40.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:40.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025398+0000", 2024-04-25T22:53:40.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040988960000000003 2024-04-25T22:53:40.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:40.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025439+0000", 2024-04-25T22:53:40.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0915999999999999e-05 2024-04-25T22:53:40.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:40.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025486+0000", 2024-04-25T22:53:40.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7534999999999998e-05 2024-04-25T22:53:40.336 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:40.336 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:40.336 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:40.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.337 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:40.337 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:40.337 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 107.29858734299999, 2024-04-25T22:53:40.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020988041999999998, 2024-04-25T22:53:40.337 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:40.337 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:40.337 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:40.337 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:40.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:40.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:40.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:40.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:40.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:40.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:40.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:40.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:40.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.99e-07 2024-04-25T22:53:40.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:40.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012470+0000", 2024-04-25T22:53:40.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2789999999999999e-06 2024-04-25T22:53:40.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:40.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012477+0000", 2024-04-25T22:53:40.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:53:40.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:40.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012500+0000", 2024-04-25T22:53:40.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2490999999999999e-05 2024-04-25T22:53:40.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:40.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021911+0000", 2024-04-25T22:53:40.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094114160000000006 2024-04-25T22:53:40.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:40.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022000+0000", 2024-04-25T22:53:40.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8601000000000001e-05 2024-04-25T22:53:40.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:40.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022359+0000", 2024-04-25T22:53:40.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035921999999999999 2024-04-25T22:53:40.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:40.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025541+0000", 2024-04-25T22:53:40.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031820619999999998 2024-04-25T22:53:40.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:40.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033375+0000", 2024-04-25T22:53:40.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078338379999999992 2024-04-25T22:53:40.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:40.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033415+0000", 2024-04-25T22:53:40.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9527000000000003e-05 2024-04-25T22:53:40.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:40.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033455+0000", 2024-04-25T22:53:40.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9932000000000003e-05 2024-04-25T22:53:40.342 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:40.342 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:40.343 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:40.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.343 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:40.343 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:40.343 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 107.29853215, 2024-04-25T22:53:40.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021043857999999999, 2024-04-25T22:53:40.343 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:40.343 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:40.343 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:40.343 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:40.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:40.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:40.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:40.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:40.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:40.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:40.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:40.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012523+0000", 2024-04-25T22:53:40.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.361e-06 2024-04-25T22:53:40.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:40.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012530+0000", 2024-04-25T22:53:40.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5440000000000004e-06 2024-04-25T22:53:40.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:40.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012541+0000", 2024-04-25T22:53:40.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1745e-05 2024-04-25T22:53:40.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:40.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012551+0000", 2024-04-25T22:53:40.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5789999999999993e-06 2024-04-25T22:53:40.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:40.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022709+0000", 2024-04-25T22:53:40.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010157685 2024-04-25T22:53:40.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:40.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022957+0000", 2024-04-25T22:53:40.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024824599999999998 2024-04-25T22:53:40.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:40.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023443+0000", 2024-04-25T22:53:40.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048578599999999999 2024-04-25T22:53:40.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:40.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025547+0000", 2024-04-25T22:53:40.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021044789999999998 2024-04-25T22:53:40.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:40.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033509+0000", 2024-04-25T22:53:40.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0079622180000000001 2024-04-25T22:53:40.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:40.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033542+0000", 2024-04-25T22:53:40.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3018000000000001e-05 2024-04-25T22:53:40.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:40.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033566+0000", 2024-04-25T22:53:40.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3197000000000002e-05 2024-04-25T22:53:40.349 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:40.349 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:40.349 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:40.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.349 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:40.349 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:40.349 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 107.298492185, 2024-04-25T22:53:40.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021122696, 2024-04-25T22:53:40.349 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:40.349 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:40.349 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:40.349 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:40.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:40.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:40.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:40.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:40.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:40.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:40.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:40.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:40.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:53:40.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:40.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012566+0000", 2024-04-25T22:53:40.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-04-25T22:53:40.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:40.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012619+0000", 2024-04-25T22:53:40.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2607e-05 2024-04-25T22:53:40.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:40.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012628+0000", 2024-04-25T22:53:40.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6500000000000008e-06 2024-04-25T22:53:40.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:40.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024024+0000", 2024-04-25T22:53:40.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011396007999999999 2024-04-25T22:53:40.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:40.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024198+0000", 2024-04-25T22:53:40.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000173215 2024-04-25T22:53:40.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:40.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024447+0000", 2024-04-25T22:53:40.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024898500000000002 2024-04-25T22:53:40.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:40.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026431+0000", 2024-04-25T22:53:40.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001984923 2024-04-25T22:53:40.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:40.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033608+0000", 2024-04-25T22:53:40.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071768459999999997 2024-04-25T22:53:40.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:40.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033646+0000", 2024-04-25T22:53:40.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299000000000003e-05 2024-04-25T22:53:40.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:40.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033684+0000", 2024-04-25T22:53:40.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8773000000000003e-05 2024-04-25T22:53:40.354 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:40.354 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:40.355 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:40.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.355 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:40.355 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:40.355 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 107.29840358600001, 2024-04-25T22:53:40.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021175381, 2024-04-25T22:53:40.355 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:40.355 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:40.355 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:40.355 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:40.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:40.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:40.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:40.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:40.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:40.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:40.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:40.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012651+0000", 2024-04-25T22:53:40.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:53:40.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:40.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012656+0000", 2024-04-25T22:53:40.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8899999999999998e-06 2024-04-25T22:53:40.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:40.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012666+0000", 2024-04-25T22:53:40.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0346999999999999e-05 2024-04-25T22:53:40.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:40.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012675+0000", 2024-04-25T22:53:40.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9930000000000001e-06 2024-04-25T22:53:40.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:40.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025661+0000", 2024-04-25T22:53:40.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01298531 2024-04-25T22:53:40.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:40.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025757+0000", 2024-04-25T22:53:40.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5822000000000005e-05 2024-04-25T22:53:40.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:40.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025907+0000", 2024-04-25T22:53:40.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015051499999999999 2024-04-25T22:53:40.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:40.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026435+0000", 2024-04-25T22:53:40.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052762200000000005 2024-04-25T22:53:40.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:40.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033732+0000", 2024-04-25T22:53:40.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072978419999999997 2024-04-25T22:53:40.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:40.360 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033787+0000", 2024-04-25T22:53:40.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4703999999999997e-05 2024-04-25T22:53:40.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.360 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:40.360 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033826+0000", 2024-04-25T22:53:40.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8458999999999999e-05 2024-04-25T22:53:40.360 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:40.360 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:40.360 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:40.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.360 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:40.361 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:40.361 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 107.298348172, 2024-04-25T22:53:40.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021244174000000001, 2024-04-25T22:53:40.361 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:40.361 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:40.361 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:40.361 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:40.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.361 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:40.361 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:40.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:40.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:40.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:40.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:40.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:40.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:40.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:40.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:40.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012712+0000", 2024-04-25T22:53:40.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.913e-06 2024-04-25T22:53:40.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:40.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012722+0000", 2024-04-25T22:53:40.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2879999999999998e-06 2024-04-25T22:53:40.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:40.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012727+0000", 2024-04-25T22:53:40.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8429999999999998e-06 2024-04-25T22:53:40.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:40.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026099+0000", 2024-04-25T22:53:40.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013371450999999999 2024-04-25T22:53:40.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:40.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026147+0000", 2024-04-25T22:53:40.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7837999999999998e-05 2024-04-25T22:53:40.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:40.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026254+0000", 2024-04-25T22:53:40.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107314 2024-04-25T22:53:40.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:40.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026686+0000", 2024-04-25T22:53:40.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000432428 2024-04-25T22:53:40.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:40.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033873+0000", 2024-04-25T22:53:40.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071864399999999997 2024-04-25T22:53:40.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:40.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033904+0000", 2024-04-25T22:53:40.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1321e-05 2024-04-25T22:53:40.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:40.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033950+0000", 2024-04-25T22:53:40.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5707999999999997e-05 2024-04-25T22:53:40.366 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:40.366 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:40.366 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:40.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.366 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:40.366 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:40.366 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 107.298317787, 2024-04-25T22:53:40.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01096505, 2024-04-25T22:53:40.367 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:40.367 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:40.367 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:40.367 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:40.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:40.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:40.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:40.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:40.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:40.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:40.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:40.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012737+0000", 2024-04-25T22:53:40.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:40.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:40.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012739+0000", 2024-04-25T22:53:40.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-04-25T22:53:40.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:40.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012743+0000", 2024-04-25T22:53:40.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3239999999999996e-06 2024-04-25T22:53:40.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:40.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012746+0000", 2024-04-25T22:53:40.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.129e-06 2024-04-25T22:53:40.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:40.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012796+0000", 2024-04-25T22:53:40.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9231999999999999e-05 2024-04-25T22:53:40.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:40.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012915+0000", 2024-04-25T22:53:40.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119021 2024-04-25T22:53:40.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:40.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013069+0000", 2024-04-25T22:53:40.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015463900000000001 2024-04-25T22:53:40.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:40.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019237+0000", 2024-04-25T22:53:40.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061680329999999998 2024-04-25T22:53:40.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:40.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023603+0000", 2024-04-25T22:53:40.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043655860000000003 2024-04-25T22:53:40.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:40.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023659+0000", 2024-04-25T22:53:40.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6484000000000003e-05 2024-04-25T22:53:40.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:40.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023701+0000", 2024-04-25T22:53:40.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1761999999999998e-05 2024-04-25T22:53:40.372 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:40.372 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:40.372 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:40.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.372 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:40.372 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:40.372 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 107.298292839, 2024-04-25T22:53:40.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011234429000000001, 2024-04-25T22:53:40.372 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:40.373 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:40.373 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:40.373 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:40.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:40.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:40.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:40.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:40.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:40.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:40.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:40.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012762+0000", 2024-04-25T22:53:40.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-04-25T22:53:40.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:40.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012765+0000", 2024-04-25T22:53:40.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2569999999999999e-06 2024-04-25T22:53:40.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:40.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012783+0000", 2024-04-25T22:53:40.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8431999999999999e-05 2024-04-25T22:53:40.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:40.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012799+0000", 2024-04-25T22:53:40.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5438999999999999e-05 2024-04-25T22:53:40.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:40.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013826+0000", 2024-04-25T22:53:40.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010275060000000001 2024-04-25T22:53:40.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:40.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013913+0000", 2024-04-25T22:53:40.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.708e-05 2024-04-25T22:53:40.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:40.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014098+0000", 2024-04-25T22:53:40.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018519399999999999 2024-04-25T22:53:40.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:40.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019684+0000", 2024-04-25T22:53:40.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055860079999999999 2024-04-25T22:53:40.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:40.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023876+0000", 2024-04-25T22:53:40.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041918800000000003 2024-04-25T22:53:40.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:40.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023957+0000", 2024-04-25T22:53:40.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1165e-05 2024-04-25T22:53:40.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:40.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023995+0000", 2024-04-25T22:53:40.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:53:40.377 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:40.378 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:40.378 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:40.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.378 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:40.378 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:40.378 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 107.29819506, 2024-04-25T22:53:40.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011131200000000001, 2024-04-25T22:53:40.378 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:40.378 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:40.378 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:40.378 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:40.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:40.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:40.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:40.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:40.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:40.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:40.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:40.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012860+0000", 2024-04-25T22:53:40.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3900000000000004e-07 2024-04-25T22:53:40.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:40.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012865+0000", 2024-04-25T22:53:40.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5609999999999998e-06 2024-04-25T22:53:40.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:40.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012895+0000", 2024-04-25T22:53:40.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9847000000000001e-05 2024-04-25T22:53:40.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:40.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012905+0000", 2024-04-25T22:53:40.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.03e-05 2024-04-25T22:53:40.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:40.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015020+0000", 2024-04-25T22:53:40.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021142940000000001 2024-04-25T22:53:40.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:40.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015182+0000", 2024-04-25T22:53:40.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016248099999999999 2024-04-25T22:53:40.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:40.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015357+0000", 2024-04-25T22:53:40.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017471000000000001 2024-04-25T22:53:40.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:40.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021021+0000", 2024-04-25T22:53:40.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056638340000000004 2024-04-25T22:53:40.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:40.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023712+0000", 2024-04-25T22:53:40.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026910380000000002 2024-04-25T22:53:40.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:40.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023763+0000", 2024-04-25T22:53:40.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1477999999999997e-05 2024-04-25T22:53:40.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:40.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023990+0000", 2024-04-25T22:53:40.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000226818 2024-04-25T22:53:40.383 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:40.383 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:40.383 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:40.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.384 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:40.384 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:40.384 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 107.298071964, 2024-04-25T22:53:40.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011705299000000001, 2024-04-25T22:53:40.384 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:40.384 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:40.384 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:40.384 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:40.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:40.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:40.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:40.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:40.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:40.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:40.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:40.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012983+0000", 2024-04-25T22:53:40.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:53:40.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:40.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012986+0000", 2024-04-25T22:53:40.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5700000000000001e-06 2024-04-25T22:53:40.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:40.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012993+0000", 2024-04-25T22:53:40.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8730000000000001e-06 2024-04-25T22:53:40.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:40.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013000+0000", 2024-04-25T22:53:40.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1890000000000001e-06 2024-04-25T22:53:40.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:40.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:53:40.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002147866 2024-04-25T22:53:40.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:40.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015351+0000", 2024-04-25T22:53:40.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020300799999999999 2024-04-25T22:53:40.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:40.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016260+0000", 2024-04-25T22:53:40.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00090926799999999997 2024-04-25T22:53:40.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:40.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022669+0000", 2024-04-25T22:53:40.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064082849999999997 2024-04-25T22:53:40.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:40.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024584+0000", 2024-04-25T22:53:40.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019151699999999999 2024-04-25T22:53:40.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:40.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024643+0000", 2024-04-25T22:53:40.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8888999999999998e-05 2024-04-25T22:53:40.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:40.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024687+0000", 2024-04-25T22:53:40.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4444999999999999e-05 2024-04-25T22:53:40.389 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:40.389 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:40.389 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:40.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.389 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:40.389 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:40.389 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 107.298044373, 2024-04-25T22:53:40.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011249699, 2024-04-25T22:53:40.390 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:40.390 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:40.390 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:40.390 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:40.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:40.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:40.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:40.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:40.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:40.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:40.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:40.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013010+0000", 2024-04-25T22:53:40.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2099999999999996e-07 2024-04-25T22:53:40.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:40.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013013+0000", 2024-04-25T22:53:40.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1310000000000002e-06 2024-04-25T22:53:40.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:40.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013020+0000", 2024-04-25T22:53:40.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3330000000000002e-06 2024-04-25T22:53:40.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:40.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013025+0000", 2024-04-25T22:53:40.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6760000000000004e-06 2024-04-25T22:53:40.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:40.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013163+0000", 2024-04-25T22:53:40.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013824599999999999 2024-04-25T22:53:40.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.393 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:40.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013504+0000", 2024-04-25T22:53:40.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034080299999999998 2024-04-25T22:53:40.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.393 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:40.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013613+0000", 2024-04-25T22:53:40.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108705 2024-04-25T22:53:40.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.393 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:40.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015831+0000", 2024-04-25T22:53:40.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002217672 2024-04-25T22:53:40.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:40.394 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024137+0000", 2024-04-25T22:53:40.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0083060489999999994 2024-04-25T22:53:40.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:40.394 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024218+0000", 2024-04-25T22:53:40.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1351000000000001e-05 2024-04-25T22:53:40.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:40.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024259+0000", 2024-04-25T22:53:40.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1112000000000002e-05 2024-04-25T22:53:40.395 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:40.395 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:40.395 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:40.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.395 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:40.395 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:40.395 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 107.29795664700001, 2024-04-25T22:53:40.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020379749999999999, 2024-04-25T22:53:40.395 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:40.395 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:40.395 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:40.396 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:40.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:40.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:40.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:40.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:40.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:40.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:40.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:40.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013098+0000", 2024-04-25T22:53:40.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:53:40.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:40.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013105+0000", 2024-04-25T22:53:40.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5969999999999997e-06 2024-04-25T22:53:40.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:40.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013190+0000", 2024-04-25T22:53:40.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5618999999999995e-05 2024-04-25T22:53:40.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:40.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013200+0000", 2024-04-25T22:53:40.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5859999999999994e-06 2024-04-25T22:53:40.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:40.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020265+0000", 2024-04-25T22:53:40.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070653349999999998 2024-04-25T22:53:40.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:40.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020454+0000", 2024-04-25T22:53:40.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189316 2024-04-25T22:53:40.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:40.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020586+0000", 2024-04-25T22:53:40.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013195700000000001 2024-04-25T22:53:40.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:40.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023822+0000", 2024-04-25T22:53:40.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032358529999999999 2024-04-25T22:53:40.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:40.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033409+0000", 2024-04-25T22:53:40.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095870520000000004 2024-04-25T22:53:40.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:40.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033447+0000", 2024-04-25T22:53:40.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7261999999999997e-05 2024-04-25T22:53:40.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:40.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033477+0000", 2024-04-25T22:53:40.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0389e-05 2024-04-25T22:53:40.400 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:40.401 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:40.401 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:40.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.401 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:40.401 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:40.401 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 107.29784014099999, 2024-04-25T22:53:40.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010857383999999999, 2024-04-25T22:53:40.401 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:40.401 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:40.401 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:40.401 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:40.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:40.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:40.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:40.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:40.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:40.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:40.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:40.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:40.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:40.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:40.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013218+0000", 2024-04-25T22:53:40.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8199999999999998e-06 2024-04-25T22:53:40.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:40.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013226+0000", 2024-04-25T22:53:40.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7649999999999993e-06 2024-04-25T22:53:40.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:40.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013259+0000", 2024-04-25T22:53:40.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2727e-05 2024-04-25T22:53:40.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:40.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014809+0000", 2024-04-25T22:53:40.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001550144 2024-04-25T22:53:40.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:40.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014958+0000", 2024-04-25T22:53:40.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014890300000000001 2024-04-25T22:53:40.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:40.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015087+0000", 2024-04-25T22:53:40.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012939200000000001 2024-04-25T22:53:40.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:40.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020212+0000", 2024-04-25T22:53:40.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051248939999999996 2024-04-25T22:53:40.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:40.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023699+0000", 2024-04-25T22:53:40.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034873289999999999 2024-04-25T22:53:40.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:40.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024014+0000", 2024-04-25T22:53:40.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031473999999999999 2024-04-25T22:53:40.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:40.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024071+0000", 2024-04-25T22:53:40.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7040000000000003e-05 2024-04-25T22:53:40.406 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:40.406 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:40.406 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:40.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.407 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:40.407 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:40.407 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 107.297785436, 2024-04-25T22:53:40.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012329677000000001, 2024-04-25T22:53:40.407 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:40.407 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:40.407 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:40.407 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:40.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:40.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:40.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:40.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:40.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:40.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:40.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:40.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013269+0000", 2024-04-25T22:53:40.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5000000000000002e-07 2024-04-25T22:53:40.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:40.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:40.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6909999999999999e-06 2024-04-25T22:53:40.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:40.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013284+0000", 2024-04-25T22:53:40.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0963e-05 2024-04-25T22:53:40.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:40.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013361+0000", 2024-04-25T22:53:40.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7379999999999994e-05 2024-04-25T22:53:40.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:40.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013448+0000", 2024-04-25T22:53:40.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6990000000000006e-05 2024-04-25T22:53:40.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:40.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013632+0000", 2024-04-25T22:53:40.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018396800000000001 2024-04-25T22:53:40.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:40.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013800+0000", 2024-04-25T22:53:40.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167467 2024-04-25T22:53:40.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:40.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.018570+0000", 2024-04-25T22:53:40.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047701460000000003 2024-04-25T22:53:40.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:40.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025507+0000", 2024-04-25T22:53:40.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069372039999999998 2024-04-25T22:53:40.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:40.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025562+0000", 2024-04-25T22:53:40.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4858999999999998e-05 2024-04-25T22:53:40.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:40.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025598+0000", 2024-04-25T22:53:40.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6259e-05 2024-04-25T22:53:40.412 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:40.412 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:40.412 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:40.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.412 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:40.412 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:40.412 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 107.297653563, 2024-04-25T22:53:40.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020176666999999999, 2024-04-25T22:53:40.413 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:40.413 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:40.413 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:53:40.413 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:40.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:40.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:40.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:40.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:40.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:40.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:40.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:40.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:40.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-04-25T22:53:40.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:40.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013405+0000", 2024-04-25T22:53:40.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0559999999999998e-06 2024-04-25T22:53:40.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:40.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013422+0000", 2024-04-25T22:53:40.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6770999999999999e-05 2024-04-25T22:53:40.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:40.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013431+0000", 2024-04-25T22:53:40.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5019999999999998e-06 2024-04-25T22:53:40.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:40.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021720+0000", 2024-04-25T22:53:40.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082884340000000008 2024-04-25T22:53:40.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:40.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022122+0000", 2024-04-25T22:53:40.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000401634 2024-04-25T22:53:40.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:40.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033577+0000", 2024-04-25T22:53:40.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011455435999999999 2024-04-25T22:53:40.416 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:40.416 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:40.416 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:40.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.417 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4734.0:31 4.1b 4:d9872866:::1000000021d.00000002:head [write 0~3618035] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-25T22:53:40.417 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:53:40.417 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.2580793010000004, 2024-04-25T22:53:40.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011647062, 2024-04-25T22:53:40.417 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:40.417 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:40.417 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:40.417 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:40.417 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4734", 2024-04-25T22:53:40.417 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:40.417 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 31 2024-04-25T22:53:40.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.418 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:40.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:40.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:53:40.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:40.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:40.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:53:40.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:40.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:40.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:53:40.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5700000000000001e-07 2024-04-25T22:53:40.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:40.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059575+0000", 2024-04-25T22:53:40.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0065991380000000001 2024-04-25T22:53:40.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:40.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059586+0000", 2024-04-25T22:53:40.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1438e-05 2024-04-25T22:53:40.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.420 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:40.420 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059592+0000", 2024-04-25T22:53:40.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2899999999999999e-06 2024-04-25T22:53:40.420 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.420 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:40.420 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059660+0000", 2024-04-25T22:53:40.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7980999999999998e-05 2024-04-25T22:53:40.420 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.420 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:40.420 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059757+0000", 2024-04-25T22:53:40.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6340000000000003e-05 2024-04-25T22:53:40.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:40.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.064487+0000", 2024-04-25T22:53:40.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004730621 2024-04-25T22:53:40.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:40.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.064538+0000", 2024-04-25T22:53:40.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0801999999999999e-05 2024-04-25T22:53:40.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:40.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.064622+0000", 2024-04-25T22:53:40.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3595000000000002e-05 2024-04-25T22:53:40.422 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:40.422 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:40.422 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:40.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.422 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:97 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-25T22:53:40.422 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:53:33.026298+0000", 2024-04-25T22:53:40.422 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 7.284755487, 2024-04-25T22:53:40.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015641848999999999, 2024-04-25T22:53:40.422 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:40.422 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:40.422 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:40.423 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:40.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:40.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026298+0000", 2024-04-25T22:53:40.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:40.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:40.425 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026298+0000", 2024-04-25T22:53:40.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:40.425 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.425 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.425 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:40.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026299+0000", 2024-04-25T22:53:40.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7299999999999996e-07 2024-04-25T22:53:40.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.426 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:40.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026464+0000", 2024-04-25T22:53:40.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016477700000000001 2024-04-25T22:53:40.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.426 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:40.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026472+0000", 2024-04-25T22:53:40.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1589999999999993e-06 2024-04-25T22:53:40.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:40.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026476+0000", 2024-04-25T22:53:40.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4580000000000003e-06 2024-04-25T22:53:40.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:40.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026550+0000", 2024-04-25T22:53:40.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3836000000000003e-05 2024-04-25T22:53:40.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:40.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026644+0000", 2024-04-25T22:53:40.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4022000000000002e-05 2024-04-25T22:53:40.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:40.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.041838+0000", 2024-04-25T22:53:40.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015193814999999999 2024-04-25T22:53:40.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:40.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.041874+0000", 2024-04-25T22:53:40.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5856999999999999e-05 2024-04-25T22:53:40.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:40.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:40.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:40.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.041940+0000", 2024-04-25T22:53:40.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6352000000000004e-05 2024-04-25T22:53:40.429 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:40.429 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:40.429 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:40.429 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:40.429 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:40.429 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:40.430 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:40.431 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:40.429+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:40.531 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:40.531+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:40.533 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:40.533 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:40.533 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-25T22:53:40.533 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:40.541 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:40.633 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:40.631+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:40.643 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:40.643 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:40.643 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-25T22:53:40.643 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-25T22:53:40.643 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:40.652 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:40.733 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:40.732+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:40.755 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:40.756 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:53:40.756 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:53:40.756 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:53:40.756 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.756 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:53:40.756 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:40.756 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 112.78683098099999, 2024-04-25T22:53:40.756 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:53:40.756 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:40.756 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:40.756 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:40.756 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:40.756 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.756 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:40.757 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:40.757 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:40.757 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.757 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.757 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:40.757 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:40.757 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:40.757 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.757 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.757 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:40.757 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:53:40.757 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:53:40.757 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.758 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.758 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:40.758 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:53:40.758 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:53:40.758 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.758 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.758 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:40.758 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:53:40.758 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:53:40.758 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.758 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.758 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:40.758 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:53:40.759 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:53:40.759 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.759 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.759 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:40.759 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:53:40.759 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:53:40.759 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.759 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.759 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:40.759 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:53:40.759 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:53:40.759 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.759 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.760 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:40.760 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:53:40.760 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:53:40.760 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.760 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.760 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:40.760 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:53:40.760 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:53:40.760 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:40.760 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:40.760 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:40.760 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.760 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.761 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:110 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'72, mlcod=10'68)", 2024-04-25T22:53:40.761 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:40.761 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 112.786196981, 2024-04-25T22:53:40.761 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0065316630000000001, 2024-04-25T22:53:40.761 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:40.761 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:40.761 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:40.761 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:40.761 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.761 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:40.761 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:40.761 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:40.761 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.761 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.762 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:40.762 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:40.762 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:40.762 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.762 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.762 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:40.762 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967807+0000", 2024-04-25T22:53:40.762 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.58e-07 2024-04-25T22:53:40.762 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.762 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.762 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:40.762 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967811+0000", 2024-04-25T22:53:40.762 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.118e-06 2024-04-25T22:53:40.762 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.763 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.763 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:40.763 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967817+0000", 2024-04-25T22:53:40.763 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3709999999999996e-06 2024-04-25T22:53:40.763 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.763 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.763 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:40.763 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967820+0000", 2024-04-25T22:53:40.763 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2210000000000002e-06 2024-04-25T22:53:40.763 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.763 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.763 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:40.763 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967876+0000", 2024-04-25T22:53:40.763 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5507000000000002e-05 2024-04-25T22:53:40.764 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.764 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.764 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:40.764 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967893+0000", 2024-04-25T22:53:40.764 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7812000000000002e-05 2024-04-25T22:53:40.764 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.764 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.764 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:40.764 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974317+0000", 2024-04-25T22:53:40.764 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064237160000000003 2024-04-25T22:53:40.764 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.764 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.764 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:40.764 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974339+0000", 2024-04-25T22:53:40.764 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.156e-05 2024-04-25T22:53:40.765 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:40.765 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:40.765 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:40.765 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.765 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.765 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:40.765 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:40.765 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 107.742335282, 2024-04-25T22:53:40.765 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:53:40.765 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:40.765 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:40.765 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:40.765 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:40.765 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.765 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:40.765 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:40.766 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:40.766 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.766 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.766 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:40.766 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:40.766 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:40.766 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.766 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.766 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:40.766 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:53:40.766 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:53:40.766 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.766 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.766 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:40.767 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:53:40.767 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:53:40.767 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.767 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.767 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:40.767 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:53:40.767 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:53:40.767 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.767 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.767 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:40.767 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:53:40.767 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:53:40.767 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.767 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.768 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:40.768 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:53:40.768 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:53:40.768 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.768 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.768 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:40.768 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:53:40.768 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:53:40.768 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.768 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.768 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:40.768 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:53:40.768 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:53:40.768 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.769 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.769 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:40.769 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:53:40.769 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:53:40.769 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.769 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.769 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:40.769 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:53:40.769 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:53:40.769 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.769 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.769 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:40.769 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:53:40.770 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:53:40.770 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.770 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.770 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:40.770 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:53:40.770 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:53:40.770 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:40.770 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:40.770 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:40.770 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.770 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.770 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:40.770 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:40.771 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 107.74166090600001, 2024-04-25T22:53:40.771 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:53:40.771 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:40.771 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:40.771 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:40.771 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:40.771 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.771 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:40.771 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:40.771 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:40.771 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.771 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.771 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:40.771 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:40.772 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:40.772 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.772 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.772 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:40.772 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:53:40.772 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:53:40.772 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.772 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.772 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:40.772 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:53:40.772 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:53:40.772 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.772 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.773 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:40.773 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:53:40.773 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:53:40.773 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.773 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.773 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:40.773 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:53:40.773 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:53:40.773 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.773 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.773 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:40.773 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:53:40.773 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:53:40.773 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.774 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.774 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:40.774 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:53:40.774 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:53:40.774 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.774 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.774 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:40.774 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:53:40.774 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:53:40.774 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.774 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.774 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:40.774 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:53:40.775 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:53:40.775 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.775 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.775 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:40.775 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:53:40.775 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:53:40.775 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.775 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.775 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:40.775 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:53:40.775 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:53:40.775 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.775 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.775 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:40.776 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:53:40.776 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:53:40.776 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:40.776 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:40.776 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:40.776 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.776 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.776 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:40.776 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:40.776 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 107.741151694, 2024-04-25T22:53:40.776 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:53:40.776 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:40.776 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:40.776 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:40.776 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:40.777 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.777 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:40.777 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:40.777 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:40.777 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.777 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.777 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:40.777 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:40.777 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:40.777 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.777 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.777 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:40.777 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:53:40.777 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:53:40.778 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.778 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.778 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:40.778 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:53:40.778 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:53:40.778 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.778 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.778 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:40.778 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:53:40.778 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:53:40.778 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.778 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.778 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:40.778 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:53:40.779 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:53:40.779 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.779 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.779 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:40.779 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:53:40.779 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:53:40.779 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.779 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.779 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:40.779 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:53:40.779 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:53:40.779 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.779 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.779 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:40.780 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:53:40.780 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:53:40.780 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.780 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.780 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:40.780 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:53:40.780 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:53:40.780 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.780 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.780 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:40.780 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:53:40.780 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:53:40.780 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.780 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.781 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:40.781 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:53:40.781 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:53:40.781 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.781 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.781 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:40.781 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:53:40.781 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:53:40.781 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:40.781 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:40.781 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:40.781 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.781 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.781 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:40.781 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:40.782 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 107.74073849600001, 2024-04-25T22:53:40.782 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:53:40.782 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:40.782 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:40.782 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:40.782 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:40.782 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.782 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:40.782 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:40.782 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:40.782 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.782 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.782 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:40.782 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:40.783 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:40.783 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.783 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.783 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:40.783 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:40.783 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:53:40.783 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.783 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.783 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:40.783 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:40.783 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:53:40.783 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.784 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.784 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:40.784 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:53:40.784 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:53:40.784 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.784 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.784 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:40.784 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:53:40.784 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:53:40.784 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.784 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.784 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:40.784 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:53:40.784 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:53:40.785 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.785 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.785 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:40.785 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:53:40.785 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:53:40.785 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.785 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.785 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:40.785 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:53:40.785 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:53:40.785 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.785 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.785 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:40.785 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:53:40.786 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:53:40.786 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.786 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.786 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:40.786 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:53:40.786 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:53:40.786 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.786 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.786 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:40.786 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:53:40.786 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:53:40.786 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.786 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.786 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:40.787 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:53:40.787 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:53:40.787 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:40.787 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:40.787 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:40.787 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.787 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.787 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:40.787 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:40.787 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 107.740687826, 2024-04-25T22:53:40.787 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:53:40.787 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:40.787 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:40.788 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:40.788 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:40.788 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.788 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:40.788 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:40.788 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:40.788 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.788 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.788 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:40.788 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:40.788 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:40.788 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.788 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.788 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:40.789 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:53:40.789 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:53:40.789 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.789 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.789 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:40.789 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:53:40.789 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:53:40.789 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.789 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.789 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:40.789 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:53:40.789 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:53:40.789 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.789 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.790 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:40.790 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:53:40.790 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:53:40.790 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.790 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.790 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:40.790 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:53:40.790 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:53:40.790 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.790 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.790 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:40.790 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:53:40.790 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:53:40.791 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.791 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.791 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:40.791 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:53:40.791 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:53:40.791 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.791 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.791 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:40.791 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:53:40.791 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:53:40.791 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.791 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.791 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:40.791 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:53:40.791 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:53:40.792 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.792 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.792 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:40.792 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:53:40.792 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:53:40.792 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.792 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.792 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:40.792 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:53:40.792 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:53:40.792 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.792 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.792 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:40.793 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:53:40.793 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:53:40.793 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.793 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.793 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:40.793 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:53:40.793 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:53:40.793 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:40.793 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:40.793 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:40.793 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.793 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.793 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:40.793 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:40.794 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 107.740650957, 2024-04-25T22:53:40.794 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:53:40.794 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:40.794 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:40.794 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:40.794 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:40.794 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.794 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:40.794 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:40.794 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:40.794 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.794 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.794 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:40.794 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:40.795 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:40.795 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.795 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.795 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:40.795 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:53:40.795 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:53:40.795 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.795 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.795 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:40.795 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:53:40.795 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:53:40.795 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.795 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.795 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:40.795 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:53:40.796 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:53:40.796 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.796 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.796 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:40.796 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:53:40.796 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:53:40.796 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.796 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.796 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:40.796 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:53:40.796 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:53:40.796 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.796 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.796 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:53:40.796 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:53:40.796 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:53:40.797 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.797 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.797 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:40.797 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:53:40.797 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:53:40.797 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.797 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.797 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:40.797 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:53:40.797 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:53:40.797 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.797 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.797 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:40.797 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:53:40.797 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:53:40.798 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.798 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.798 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:40.798 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:53:40.798 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:53:40.798 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.798 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.798 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:40.798 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:53:40.798 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:53:40.798 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.798 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.798 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:40.799 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:53:40.799 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:53:40.799 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.799 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.799 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:40.799 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:53:40.799 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:53:40.799 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:40.799 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:40.799 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:40.799 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.799 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.799 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:40.799 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:40.800 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 107.740625991, 2024-04-25T22:53:40.800 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:53:40.800 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:40.800 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:40.800 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:40.800 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:40.800 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.800 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:40.800 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:40.800 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:40.800 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.800 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.800 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:40.801 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:40.801 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:40.801 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.801 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.801 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:40.801 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:53:40.801 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:53:40.801 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.801 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.801 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:40.801 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:53:40.801 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:53:40.801 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.801 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.802 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:40.802 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:40.802 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:53:40.802 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.802 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.802 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:40.802 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:53:40.802 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:53:40.802 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.802 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.802 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:40.802 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:53:40.802 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:53:40.803 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.803 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.803 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:40.803 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:53:40.803 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:53:40.803 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.803 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.803 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:40.803 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:53:40.803 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:53:40.803 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.803 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.803 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:40.803 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:53:40.804 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:53:40.804 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.804 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.804 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:40.804 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:53:40.804 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:53:40.804 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.804 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.804 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:40.804 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:53:40.804 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:53:40.804 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.804 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.805 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:40.805 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:53:40.805 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:53:40.805 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:40.805 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:40.805 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:40.805 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.805 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.805 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:40.805 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:40.805 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 107.74058962700001, 2024-04-25T22:53:40.805 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:53:40.805 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:40.805 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:40.806 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:40.806 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:40.806 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.806 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:40.806 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:40.806 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:40.806 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.806 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.806 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:40.806 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:40.806 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:40.806 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.806 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.807 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:40.807 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:53:40.807 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:53:40.807 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.807 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.807 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:40.807 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:53:40.807 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:53:40.807 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.807 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.807 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:40.807 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:53:40.807 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:53:40.807 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.808 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.808 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:40.808 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:53:40.808 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:53:40.808 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.808 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.808 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:40.808 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:53:40.808 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:53:40.808 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.808 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.808 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:40.808 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:53:40.808 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:53:40.808 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.809 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.809 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:40.809 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:53:40.809 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:53:40.809 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.809 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.809 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:40.809 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:53:40.809 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:53:40.809 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.809 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.809 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:40.809 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:53:40.809 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:53:40.809 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:40.810 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:40.810 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:40.810 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.810 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.810 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:40.810 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:40.810 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 107.740558546, 2024-04-25T22:53:40.810 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:53:40.810 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:40.810 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:40.810 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:40.810 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:40.810 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.811 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:40.811 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:40.811 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:40.811 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.811 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.811 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:40.811 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:40.811 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:40.811 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.811 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.811 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:40.811 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:40.811 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:40.812 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.812 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.812 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:40.812 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:53:40.812 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:53:40.812 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.812 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.812 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:40.812 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:53:40.812 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:53:40.812 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.812 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.812 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:40.812 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:53:40.812 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:53:40.813 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.813 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.813 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:40.813 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:53:40.813 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:53:40.813 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.813 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.813 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:40.813 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:53:40.813 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:53:40.813 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.813 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.813 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:40.813 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:53:40.813 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:53:40.814 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:40.814 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:40.814 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:40.814 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.814 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.814 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-25T22:53:40.814 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:40.814 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 107.74011757700001, 2024-04-25T22:53:40.814 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064881979999999997, 2024-04-25T22:53:40.814 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:40.814 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:40.814 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:40.814 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:40.814 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.815 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:40.815 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:40.815 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:40.815 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.815 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.815 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:40.815 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:40.815 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:40.815 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.815 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.815 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:40.815 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013887+0000", 2024-04-25T22:53:40.815 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2699999999999999e-07 2024-04-25T22:53:40.815 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.816 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.816 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:40.816 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013898+0000", 2024-04-25T22:53:40.816 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0796e-05 2024-04-25T22:53:40.816 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.816 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.816 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:40.816 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013907+0000", 2024-04-25T22:53:40.816 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5140000000000007e-06 2024-04-25T22:53:40.816 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.816 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.816 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:40.816 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013952+0000", 2024-04-25T22:53:40.816 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4134000000000001e-05 2024-04-25T22:53:40.817 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.817 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.817 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:40.817 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016812+0000", 2024-04-25T22:53:40.817 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028601059999999998 2024-04-25T22:53:40.817 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.817 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.817 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:40.817 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.017052+0000", 2024-04-25T22:53:40.817 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00024056500000000001 2024-04-25T22:53:40.817 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.817 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.817 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:40.817 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020350+0000", 2024-04-25T22:53:40.818 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0032978320000000001 2024-04-25T22:53:40.818 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.818 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.818 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:40.818 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020375+0000", 2024-04-25T22:53:40.818 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.4624e-05 2024-04-25T22:53:40.818 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:40.818 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:40.818 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:40.818 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.818 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.818 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:30 4.31 4:8ebfc112:::1000000021d.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-25T22:53:40.818 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:53:40.818 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.7008726759999995, 2024-04-25T22:53:40.819 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015003005, 2024-04-25T22:53:40.819 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:40.819 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:40.819 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:40.819 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:40.819 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:40.819 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:40.819 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 30 2024-04-25T22:53:40.819 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.819 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:40.819 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.819 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:40.819 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:53:40.819 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:40.820 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.820 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.820 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:40.820 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:53:40.820 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:40.820 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.820 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.820 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:40.820 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053133+0000", 2024-04-25T22:53:40.820 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0370000000000001e-06 2024-04-25T22:53:40.820 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.820 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.820 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:40.821 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060377+0000", 2024-04-25T22:53:40.821 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0072431070000000004 2024-04-25T22:53:40.821 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.821 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.821 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:40.821 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060388+0000", 2024-04-25T22:53:40.821 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1285e-05 2024-04-25T22:53:40.821 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.821 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.821 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:40.821 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060394+0000", 2024-04-25T22:53:40.821 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1040000000000003e-06 2024-04-25T22:53:40.821 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.821 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.821 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:40.822 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060483+0000", 2024-04-25T22:53:40.822 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.9345000000000006e-05 2024-04-25T22:53:40.822 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.822 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.822 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:40.822 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060566+0000", 2024-04-25T22:53:40.822 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2237999999999994e-05 2024-04-25T22:53:40.822 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.822 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.822 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:40.822 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068057+0000", 2024-04-25T22:53:40.822 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074912210000000002 2024-04-25T22:53:40.822 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.822 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.823 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:40.823 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068090+0000", 2024-04-25T22:53:40.823 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3501000000000003e-05 2024-04-25T22:53:40.823 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.823 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.823 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:40.823 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068134+0000", 2024-04-25T22:53:40.823 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4166999999999999e-05 2024-04-25T22:53:40.823 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:40.823 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:40.823 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:40.823 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.823 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.823 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:66 4.27 4:e5671758:::1000000024f.00000000:head [write 0~6641] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:40.823 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:40.824 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.4407623399999991, 2024-04-25T22:53:40.824 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075166540000000002, 2024-04-25T22:53:40.824 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:40.824 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:40.824 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:40.824 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:40.824 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:40.824 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:40.824 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 66 2024-04-25T22:53:40.824 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.824 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:40.824 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.824 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:40.824 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:40.824 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:40.825 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.825 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.825 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:40.825 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:40.825 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:40.825 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.825 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.825 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:40.825 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:40.825 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4099999999999998e-07 2024-04-25T22:53:40.825 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.825 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.825 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:40.825 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313252+0000", 2024-04-25T22:53:40.826 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5380000000000008e-06 2024-04-25T22:53:40.826 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.826 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.826 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:40.826 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313260+0000", 2024-04-25T22:53:40.826 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2609999999999993e-06 2024-04-25T22:53:40.826 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.826 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.826 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:40.826 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313265+0000", 2024-04-25T22:53:40.826 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4850000000000003e-06 2024-04-25T22:53:40.826 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.826 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.826 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:40.827 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313310+0000", 2024-04-25T22:53:40.827 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5247999999999998e-05 2024-04-25T22:53:40.827 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.827 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.827 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:40.827 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313370+0000", 2024-04-25T22:53:40.827 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0275000000000001e-05 2024-04-25T22:53:40.827 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.827 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.827 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:40.827 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313435+0000", 2024-04-25T22:53:40.827 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4647000000000006e-05 2024-04-25T22:53:40.827 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.827 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.828 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:40.828 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314174+0000", 2024-04-25T22:53:40.828 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00073925 2024-04-25T22:53:40.828 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.828 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.828 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:40.828 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320688+0000", 2024-04-25T22:53:40.828 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.006513418 2024-04-25T22:53:40.828 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.828 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.828 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:40.828 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320736+0000", 2024-04-25T22:53:40.828 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.8114e-05 2024-04-25T22:53:40.828 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.829 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.829 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:40.829 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320758+0000", 2024-04-25T22:53:40.829 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2776999999999999e-05 2024-04-25T22:53:40.829 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:40.829 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:40.829 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:40.829 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.829 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.829 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:68 4.31 4:8fb7f7b7:::10000000251.00000000:head [write 0~2067] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:40.829 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:40.829 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.4390765620000003, 2024-04-25T22:53:40.829 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0087011669999999992, 2024-04-25T22:53:40.829 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:40.829 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:40.830 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:40.830 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:40.830 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:40.830 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:40.830 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 68 2024-04-25T22:53:40.830 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.830 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:40.830 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.830 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:40.830 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:40.830 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:40.830 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.831 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.831 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:40.831 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:40.831 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:40.831 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.831 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.831 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:40.831 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:40.831 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:53:40.831 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.831 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.831 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:40.831 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314933+0000", 2024-04-25T22:53:40.831 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5430000000000004e-06 2024-04-25T22:53:40.831 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.832 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.832 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:40.832 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314944+0000", 2024-04-25T22:53:40.832 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.076e-05 2024-04-25T22:53:40.832 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.832 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.832 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:40.832 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314949+0000", 2024-04-25T22:53:40.832 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1019999999999996e-06 2024-04-25T22:53:40.832 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.832 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.832 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:40.832 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314996+0000", 2024-04-25T22:53:40.833 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7018999999999998e-05 2024-04-25T22:53:40.833 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.833 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.833 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:40.833 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315064+0000", 2024-04-25T22:53:40.833 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8738000000000005e-05 2024-04-25T22:53:40.833 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.833 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.833 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:40.833 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323531+0000", 2024-04-25T22:53:40.833 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084664739999999999 2024-04-25T22:53:40.833 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.833 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.833 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:40.834 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323574+0000", 2024-04-25T22:53:40.834 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3449999999999999e-05 2024-04-25T22:53:40.834 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.834 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.834 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:40.834 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323629+0000", 2024-04-25T22:53:40.834 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4296999999999999e-05 2024-04-25T22:53:40.834 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:40.834 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:40.834 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:40.834 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.834 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.834 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4734.0:69 4.32 e46/13 4:4e8c6251:::10000000252.00000000:head v 46'1, mlcod=0'0)", 2024-04-25T22:53:40.835 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:40.835 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.4380452940000001, 2024-04-25T22:53:40.835 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076063240000000002, 2024-04-25T22:53:40.835 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:40.835 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:40.835 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:40.835 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:40.835 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.835 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:40.835 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:40.835 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:40.835 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.835 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.835 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:40.835 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:40.836 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:40.836 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.836 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.836 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:40.836 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:40.836 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3099999999999997e-07 2024-04-25T22:53:40.837 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.837 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.837 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:40.837 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315964+0000", 2024-04-25T22:53:40.837 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3229999999999999e-06 2024-04-25T22:53:40.837 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.837 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.837 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:40.837 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315973+0000", 2024-04-25T22:53:40.837 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7249999999999992e-06 2024-04-25T22:53:40.837 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.838 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.838 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:40.838 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315978+0000", 2024-04-25T22:53:40.838 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4830000000000001e-06 2024-04-25T22:53:40.838 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.838 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.838 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:40.838 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.316043+0000", 2024-04-25T22:53:40.838 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.5036000000000005e-05 2024-04-25T22:53:40.838 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.838 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.838 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:40.838 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.316055+0000", 2024-04-25T22:53:40.838 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1973999999999999e-05 2024-04-25T22:53:40.839 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.839 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.839 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:40.839 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323521+0000", 2024-04-25T22:53:40.839 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074660239999999999 2024-04-25T22:53:40.839 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.839 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.839 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:40.839 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323565+0000", 2024-04-25T22:53:40.839 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4128000000000002e-05 2024-04-25T22:53:40.839 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:40.839 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:40.839 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:40.840 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.840 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.840 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:72 4.36 4:6cdfec98:::10000000255.00000000:head [write 0~4131] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:40.840 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:40.840 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.4360013820000006, 2024-04-25T22:53:40.840 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084820680000000006, 2024-04-25T22:53:40.840 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:40.840 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:40.840 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:40.840 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:40.840 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:40.840 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:40.840 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 72 2024-04-25T22:53:40.840 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.841 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:40.841 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.841 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:40.841 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:40.841 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:40.841 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.841 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.841 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:40.841 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:40.841 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:40.841 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.841 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.841 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:40.842 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:40.842 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1800000000000005e-07 2024-04-25T22:53:40.842 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.842 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.842 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:40.842 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318010+0000", 2024-04-25T22:53:40.842 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7399999999999998e-06 2024-04-25T22:53:40.842 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.842 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.842 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:40.842 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318019+0000", 2024-04-25T22:53:40.842 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0170000000000002e-06 2024-04-25T22:53:40.842 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.843 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.843 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:40.843 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318024+0000", 2024-04-25T22:53:40.843 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0150000000000003e-06 2024-04-25T22:53:40.843 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.843 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.843 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:40.843 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318075+0000", 2024-04-25T22:53:40.843 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0537000000000001e-05 2024-04-25T22:53:40.843 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.843 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.843 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:40.843 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318144+0000", 2024-04-25T22:53:40.843 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9432999999999997e-05 2024-04-25T22:53:40.844 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.844 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.844 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:40.844 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326392+0000", 2024-04-25T22:53:40.844 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0082482979999999994 2024-04-25T22:53:40.844 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.844 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.844 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:40.844 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326432+0000", 2024-04-25T22:53:40.844 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9870000000000003e-05 2024-04-25T22:53:40.844 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.844 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.844 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:40.844 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326485+0000", 2024-04-25T22:53:40.845 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2439999999999999e-05 2024-04-25T22:53:40.845 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:40.845 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:40.845 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:40.845 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.845 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.845 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:74 4.10 4:08e6f8ca:::10000000257.00000000:head [write 0~839] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:40.845 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:53:40.845 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.434527654, 2024-04-25T22:53:40.845 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070370720000000001, 2024-04-25T22:53:40.845 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:40.845 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:40.845 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:40.845 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:40.846 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:40.846 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:40.846 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 74 2024-04-25T22:53:40.846 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.846 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:40.846 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.846 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:40.846 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:53:40.846 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:40.846 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.846 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.846 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:40.846 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:53:40.846 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:40.847 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.847 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.847 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:40.847 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319477+0000", 2024-04-25T22:53:40.847 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1999999999999999e-07 2024-04-25T22:53:40.847 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.847 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.847 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:40.847 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319483+0000", 2024-04-25T22:53:40.847 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4260000000000002e-06 2024-04-25T22:53:40.847 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.847 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.847 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:40.847 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319494+0000", 2024-04-25T22:53:40.847 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.094e-05 2024-04-25T22:53:40.848 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.848 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.848 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:40.848 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319499+0000", 2024-04-25T22:53:40.848 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3789999999999997e-06 2024-04-25T22:53:40.848 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.848 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.848 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:40.848 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319545+0000", 2024-04-25T22:53:40.848 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6149000000000001e-05 2024-04-25T22:53:40.848 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.848 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.848 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:40.849 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319617+0000", 2024-04-25T22:53:40.849 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1792999999999995e-05 2024-04-25T22:53:40.849 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.849 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.849 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:40.849 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326406+0000", 2024-04-25T22:53:40.849 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067895999999999998 2024-04-25T22:53:40.849 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.849 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.849 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:40.849 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326443+0000", 2024-04-25T22:53:40.849 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6828e-05 2024-04-25T22:53:40.849 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.849 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.850 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:40.850 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326514+0000", 2024-04-25T22:53:40.850 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0236999999999999e-05 2024-04-25T22:53:40.850 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:40.850 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:40.850 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:40.850 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.850 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.850 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:126 3.1f 3:f83d65d8:::200.00000004:head [write 0~857927 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e48)", 2024-04-25T22:53:40.850 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:36.368176+0000", 2024-04-25T22:53:40.850 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 4.3858281049999999, 2024-04-25T22:53:40.850 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0064480370000000002, 2024-04-25T22:53:40.850 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:40.850 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:40.851 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:40.851 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:40.851 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.851 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:40.851 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.368176+0000", 2024-04-25T22:53:40.851 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:40.851 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.851 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.851 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:40.851 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.368176+0000", 2024-04-25T22:53:40.851 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:40.851 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.851 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.851 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:40.852 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.368178+0000", 2024-04-25T22:53:40.852 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.897e-06 2024-04-25T22:53:40.852 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.852 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.852 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:40.852 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.369115+0000", 2024-04-25T22:53:40.852 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00093664499999999995 2024-04-25T22:53:40.852 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.852 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.852 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:40.852 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.369126+0000", 2024-04-25T22:53:40.852 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1564e-05 2024-04-25T22:53:40.852 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.852 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.853 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:40.853 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.369132+0000", 2024-04-25T22:53:40.853 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7540000000000003e-06 2024-04-25T22:53:40.853 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.853 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.853 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:40.853 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.369212+0000", 2024-04-25T22:53:40.853 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0576999999999998e-05 2024-04-25T22:53:40.853 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.853 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.853 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:40.853 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.369221+0000", 2024-04-25T22:53:40.853 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.9670000000000007e-06 2024-04-25T22:53:40.853 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.854 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.854 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:40.854 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.373150+0000", 2024-04-25T22:53:40.854 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0039289269999999996 2024-04-25T22:53:40.854 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.854 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.854 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:40.854 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.373233+0000", 2024-04-25T22:53:40.854 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2558000000000005e-05 2024-04-25T22:53:40.854 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.854 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.854 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:40.854 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.374505+0000", 2024-04-25T22:53:40.855 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0012719840000000001 2024-04-25T22:53:40.855 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.855 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.855 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:40.855 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.374563+0000", 2024-04-25T22:53:40.855 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.8387000000000002e-05 2024-04-25T22:53:40.855 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.855 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.855 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:40.855 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.374624+0000", 2024-04-25T22:53:40.855 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0776999999999998e-05 2024-04-25T22:53:40.855 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:40.855 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:40.855 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:40.855 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.856 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.856 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:128 3.1f 3:f83d65d8:::200.00000004:head [write 876784~3317520 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e48)", 2024-04-25T22:53:40.856 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:36.985410+0000", 2024-04-25T22:53:40.856 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 3.7685940360000001, 2024-04-25T22:53:40.856 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0090177360000000002, 2024-04-25T22:53:40.856 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:40.856 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:40.856 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:40.856 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:40.856 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.856 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:40.856 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.985410+0000", 2024-04-25T22:53:40.856 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:40.856 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.857 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.857 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:40.857 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.985410+0000", 2024-04-25T22:53:40.857 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:40.857 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.857 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.857 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:40.857 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.985411+0000", 2024-04-25T22:53:40.857 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8400000000000003e-07 2024-04-25T22:53:40.857 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.857 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.857 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:40.857 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989116+0000", 2024-04-25T22:53:40.858 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037047389999999999 2024-04-25T22:53:40.858 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.858 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.858 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:40.858 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989128+0000", 2024-04-25T22:53:40.858 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1977999999999999e-05 2024-04-25T22:53:40.858 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.858 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.858 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:40.858 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989135+0000", 2024-04-25T22:53:40.858 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5290000000000003e-06 2024-04-25T22:53:40.858 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.858 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.859 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:40.859 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989181+0000", 2024-04-25T22:53:40.859 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6122999999999999e-05 2024-04-25T22:53:40.859 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.859 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.859 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:40.859 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989250+0000", 2024-04-25T22:53:40.859 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8535999999999996e-05 2024-04-25T22:53:40.859 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.859 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.859 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:40.859 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.994272+0000", 2024-04-25T22:53:40.859 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050224889999999998 2024-04-25T22:53:40.859 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.859 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.860 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:40.860 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.994335+0000", 2024-04-25T22:53:40.860 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2588000000000005e-05 2024-04-25T22:53:40.860 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:40.860 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:40.860 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:40.860 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.994428+0000", 2024-04-25T22:53:40.860 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2869999999999997e-05 2024-04-25T22:53:40.860 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:40.860 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:40.860 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:40.860 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:40.860 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:40.860 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:40.862 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:40.862 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:40.861+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:40.865 INFO:tasks.workunit.client.0.smithi052.stdout:autoheader 2024-04-25T22:53:40.962 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:40.961+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:40.967 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:40.967 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:40.967 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-04-25T22:53:40.967 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:40.975 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:41.063 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:41.062+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:41.079 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:41.079 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:41.079 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:53:41.079 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:53:41.079 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:41.092 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:41.175 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:41.174+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:41.212 INFO:tasks.workunit.client.0.smithi052.stdout:autoconf 2024-04-25T22:53:41.237 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:41.237 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-04-25T22:53:41.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-04-25T22:53:41.237 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:53:41.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.237 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:41.237 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:41.237 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 113.270345732, 2024-04-25T22:53:41.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010384338999999999, 2024-04-25T22:53:41.238 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:41.238 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:41.238 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:41.238 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:41.238 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:41.238 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:41.238 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-04-25T22:53:41.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.238 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:41.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:41.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:41.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:41.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:41.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:41.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:41.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:41.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:41.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3600000000000004e-07 2024-04-25T22:53:41.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:41.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965185+0000", 2024-04-25T22:53:41.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.117e-06 2024-04-25T22:53:41.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:41.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965192+0000", 2024-04-25T22:53:41.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3239999999999997e-06 2024-04-25T22:53:41.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:41.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965198+0000", 2024-04-25T22:53:41.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6370000000000004e-06 2024-04-25T22:53:41.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:41.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970973+0000", 2024-04-25T22:53:41.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057748239999999996 2024-04-25T22:53:41.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:41.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971049+0000", 2024-04-25T22:53:41.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6029e-05 2024-04-25T22:53:41.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:41.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971174+0000", 2024-04-25T22:53:41.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012462399999999999 2024-04-25T22:53:41.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:41.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971553+0000", 2024-04-25T22:53:41.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037896499999999999 2024-04-25T22:53:41.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:41.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975482+0000", 2024-04-25T22:53:41.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039297459999999996 2024-04-25T22:53:41.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:41.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975529+0000", 2024-04-25T22:53:41.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6387000000000002e-05 2024-04-25T22:53:41.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:41.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975563+0000", 2024-04-25T22:53:41.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4150000000000003e-05 2024-04-25T22:53:41.246 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:41.246 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:41.246 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:41.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.246 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:41.246 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:41.246 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 108.22329940900001, 2024-04-25T22:53:41.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012637705000000001, 2024-04-25T22:53:41.247 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:41.247 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:41.247 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:41.247 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:41.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.247 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:41.247 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:41.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:41.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.247 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:41.247 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:41.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:41.248 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.248 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:41.248 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012227+0000", 2024-04-25T22:53:41.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.863e-06 2024-04-25T22:53:41.248 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.248 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:41.248 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012236+0000", 2024-04-25T22:53:41.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1109999999999997e-06 2024-04-25T22:53:41.248 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.248 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:41.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012309+0000", 2024-04-25T22:53:41.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3242000000000001e-05 2024-04-25T22:53:41.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:41.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012324+0000", 2024-04-25T22:53:41.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4837e-05 2024-04-25T22:53:41.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:41.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015060+0000", 2024-04-25T22:53:41.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027363349999999999 2024-04-25T22:53:41.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:41.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015169+0000", 2024-04-25T22:53:41.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108372 2024-04-25T22:53:41.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:41.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015498+0000", 2024-04-25T22:53:41.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032949999999999999 2024-04-25T22:53:41.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:41.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021282+0000", 2024-04-25T22:53:41.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057836429999999998 2024-04-25T22:53:41.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:41.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024709+0000", 2024-04-25T22:53:41.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034271979999999998 2024-04-25T22:53:41.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:41.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024802+0000", 2024-04-25T22:53:41.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2960000000000004e-05 2024-04-25T22:53:41.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:41.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024863+0000", 2024-04-25T22:53:41.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0643999999999997e-05 2024-04-25T22:53:41.252 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:41.252 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:41.252 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:41.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.252 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:41.252 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:41.252 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 108.223175638, 2024-04-25T22:53:41.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012979447999999999, 2024-04-25T22:53:41.252 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:41.252 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:41.252 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:41.252 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:41.253 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.253 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:41.253 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:41.253 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:41.253 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.253 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.253 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:41.253 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:41.253 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:41.253 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.253 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.253 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:41.253 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:41.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:53:41.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:41.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012354+0000", 2024-04-25T22:53:41.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7740000000000004e-06 2024-04-25T22:53:41.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:41.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012365+0000", 2024-04-25T22:53:41.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.064e-05 2024-04-25T22:53:41.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:41.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012382+0000", 2024-04-25T22:53:41.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6999000000000001e-05 2024-04-25T22:53:41.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:41.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015958+0000", 2024-04-25T22:53:41.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035765699999999998 2024-04-25T22:53:41.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:41.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016037+0000", 2024-04-25T22:53:41.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8242000000000001e-05 2024-04-25T22:53:41.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.256 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:41.256 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016404+0000", 2024-04-25T22:53:41.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036784300000000002 2024-04-25T22:53:41.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.256 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:41.256 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021294+0000", 2024-04-25T22:53:41.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048890629999999999 2024-04-25T22:53:41.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.257 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:41.257 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024959+0000", 2024-04-25T22:53:41.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036651570000000001 2024-04-25T22:53:41.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.257 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:41.257 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025097+0000", 2024-04-25T22:53:41.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013788099999999999 2024-04-25T22:53:41.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.257 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:41.257 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025328+0000", 2024-04-25T22:53:41.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231492 2024-04-25T22:53:41.258 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:41.258 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:41.258 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:41.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.258 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:41.258 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:41.258 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 108.223087869, 2024-04-25T22:53:41.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013049827, 2024-04-25T22:53:41.258 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:41.258 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:41.258 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:41.259 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:41.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.259 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:41.259 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:41.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:41.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.259 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:41.259 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:41.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:41.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.260 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:41.260 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012437+0000", 2024-04-25T22:53:41.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-04-25T22:53:41.260 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.260 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.260 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:41.260 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012440+0000", 2024-04-25T22:53:41.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7609999999999999e-06 2024-04-25T22:53:41.260 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.260 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.260 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:41.260 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012449+0000", 2024-04-25T22:53:41.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.285e-06 2024-04-25T22:53:41.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.261 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:41.261 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012457+0000", 2024-04-25T22:53:41.261 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9510000000000006e-06 2024-04-25T22:53:41.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.261 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:41.261 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017106+0000", 2024-04-25T22:53:41.261 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046494220000000003 2024-04-25T22:53:41.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:41.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017223+0000", 2024-04-25T22:53:41.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116824 2024-04-25T22:53:41.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:41.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017345+0000", 2024-04-25T22:53:41.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122175 2024-04-25T22:53:41.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:41.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021299+0000", 2024-04-25T22:53:41.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039534879999999998 2024-04-25T22:53:41.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:41.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025398+0000", 2024-04-25T22:53:41.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040988960000000003 2024-04-25T22:53:41.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:41.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025439+0000", 2024-04-25T22:53:41.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0915999999999999e-05 2024-04-25T22:53:41.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:41.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025486+0000", 2024-04-25T22:53:41.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7534999999999998e-05 2024-04-25T22:53:41.264 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:41.264 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:41.264 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:41.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.264 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:41.264 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:41.264 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 108.22305771800001, 2024-04-25T22:53:41.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020988041999999998, 2024-04-25T22:53:41.264 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:41.264 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:41.265 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:41.265 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:41.265 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.265 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:41.265 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:41.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:41.265 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.265 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.265 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:41.265 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:41.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:41.265 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.265 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.266 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:41.266 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:41.266 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.99e-07 2024-04-25T22:53:41.266 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.266 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.266 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:41.266 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012470+0000", 2024-04-25T22:53:41.266 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2789999999999999e-06 2024-04-25T22:53:41.266 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.266 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.266 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:41.266 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012477+0000", 2024-04-25T22:53:41.266 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:53:41.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.267 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:41.267 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012500+0000", 2024-04-25T22:53:41.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2490999999999999e-05 2024-04-25T22:53:41.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.267 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:41.267 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021911+0000", 2024-04-25T22:53:41.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094114160000000006 2024-04-25T22:53:41.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.267 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:41.267 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022000+0000", 2024-04-25T22:53:41.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8601000000000001e-05 2024-04-25T22:53:41.268 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.268 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.268 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:41.268 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022359+0000", 2024-04-25T22:53:41.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035921999999999999 2024-04-25T22:53:41.268 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.268 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.268 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:41.268 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025541+0000", 2024-04-25T22:53:41.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031820619999999998 2024-04-25T22:53:41.268 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.268 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.268 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:41.269 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033375+0000", 2024-04-25T22:53:41.269 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078338379999999992 2024-04-25T22:53:41.269 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.269 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.269 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:41.269 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033415+0000", 2024-04-25T22:53:41.269 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9527000000000003e-05 2024-04-25T22:53:41.269 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.269 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.269 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:41.269 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033455+0000", 2024-04-25T22:53:41.269 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9932000000000003e-05 2024-04-25T22:53:41.270 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:41.270 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:41.270 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:41.270 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.270 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.270 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:41.270 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:41.270 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 108.223002525, 2024-04-25T22:53:41.270 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021043857999999999, 2024-04-25T22:53:41.270 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:41.270 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:41.270 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:41.270 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:41.270 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.271 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:41.271 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:41.271 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:41.271 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.271 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.271 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:41.271 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:41.271 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:41.271 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.271 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.271 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:41.271 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012523+0000", 2024-04-25T22:53:41.271 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.361e-06 2024-04-25T22:53:41.271 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.272 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.272 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:41.272 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012530+0000", 2024-04-25T22:53:41.272 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5440000000000004e-06 2024-04-25T22:53:41.272 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.272 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.272 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:41.272 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012541+0000", 2024-04-25T22:53:41.272 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1745e-05 2024-04-25T22:53:41.272 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.272 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.272 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:41.272 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012551+0000", 2024-04-25T22:53:41.272 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5789999999999993e-06 2024-04-25T22:53:41.273 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.273 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.273 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:41.273 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022709+0000", 2024-04-25T22:53:41.273 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010157685 2024-04-25T22:53:41.273 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.273 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.273 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:41.273 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022957+0000", 2024-04-25T22:53:41.273 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024824599999999998 2024-04-25T22:53:41.273 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.273 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.273 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:41.274 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023443+0000", 2024-04-25T22:53:41.274 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048578599999999999 2024-04-25T22:53:41.274 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.274 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.274 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:41.274 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025547+0000", 2024-04-25T22:53:41.274 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021044789999999998 2024-04-25T22:53:41.274 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.274 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.274 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:41.274 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033509+0000", 2024-04-25T22:53:41.274 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0079622180000000001 2024-04-25T22:53:41.274 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.275 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.275 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:41.275 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033542+0000", 2024-04-25T22:53:41.275 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3018000000000001e-05 2024-04-25T22:53:41.275 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.275 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.275 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:41.275 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033566+0000", 2024-04-25T22:53:41.275 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3197000000000002e-05 2024-04-25T22:53:41.275 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:41.275 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:41.275 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:41.275 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.276 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.276 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:41.276 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:41.276 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 108.22296256, 2024-04-25T22:53:41.276 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021122696, 2024-04-25T22:53:41.276 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:41.276 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:41.276 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:41.276 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:41.276 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.276 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:41.276 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:41.276 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:41.276 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.277 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.277 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:41.277 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:41.277 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:41.277 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.277 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.277 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:41.277 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:41.277 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:53:41.277 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.277 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.277 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:41.277 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012566+0000", 2024-04-25T22:53:41.277 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-04-25T22:53:41.278 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.278 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.278 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:41.278 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012619+0000", 2024-04-25T22:53:41.278 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2607e-05 2024-04-25T22:53:41.278 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.278 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.278 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:41.278 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012628+0000", 2024-04-25T22:53:41.278 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6500000000000008e-06 2024-04-25T22:53:41.278 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.278 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.279 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:41.279 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024024+0000", 2024-04-25T22:53:41.279 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011396007999999999 2024-04-25T22:53:41.279 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.279 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.279 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:41.279 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024198+0000", 2024-04-25T22:53:41.279 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000173215 2024-04-25T22:53:41.279 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.279 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.279 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:41.279 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024447+0000", 2024-04-25T22:53:41.279 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024898500000000002 2024-04-25T22:53:41.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:41.280 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026431+0000", 2024-04-25T22:53:41.280 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001984923 2024-04-25T22:53:41.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:41.280 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033608+0000", 2024-04-25T22:53:41.280 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071768459999999997 2024-04-25T22:53:41.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:41.280 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033646+0000", 2024-04-25T22:53:41.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299000000000003e-05 2024-04-25T22:53:41.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.281 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:41.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033684+0000", 2024-04-25T22:53:41.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8773000000000003e-05 2024-04-25T22:53:41.281 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:41.281 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:41.281 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:41.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.281 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:41.281 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:41.282 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 108.222873961, 2024-04-25T22:53:41.282 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021175381, 2024-04-25T22:53:41.282 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:41.282 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:41.282 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:41.282 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:41.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:41.282 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:41.282 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:41.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:41.282 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:41.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:41.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.283 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:41.283 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012651+0000", 2024-04-25T22:53:41.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:53:41.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.283 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:41.283 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012656+0000", 2024-04-25T22:53:41.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8899999999999998e-06 2024-04-25T22:53:41.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.284 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:41.284 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012666+0000", 2024-04-25T22:53:41.284 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0346999999999999e-05 2024-04-25T22:53:41.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.284 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.284 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:41.284 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012675+0000", 2024-04-25T22:53:41.284 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9930000000000001e-06 2024-04-25T22:53:41.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.284 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.284 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:41.284 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025661+0000", 2024-04-25T22:53:41.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01298531 2024-04-25T22:53:41.285 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.285 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.285 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:41.285 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025757+0000", 2024-04-25T22:53:41.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5822000000000005e-05 2024-04-25T22:53:41.285 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.285 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.285 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:41.285 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025907+0000", 2024-04-25T22:53:41.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015051499999999999 2024-04-25T22:53:41.285 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.285 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.286 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:41.286 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026435+0000", 2024-04-25T22:53:41.286 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052762200000000005 2024-04-25T22:53:41.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.286 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:41.286 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033732+0000", 2024-04-25T22:53:41.286 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072978419999999997 2024-04-25T22:53:41.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.286 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:41.286 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033787+0000", 2024-04-25T22:53:41.286 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4703999999999997e-05 2024-04-25T22:53:41.287 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.287 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.287 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:41.287 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033826+0000", 2024-04-25T22:53:41.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8458999999999999e-05 2024-04-25T22:53:41.287 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:41.287 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:41.287 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:41.287 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.287 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.287 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:41.287 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:41.287 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 108.222818547, 2024-04-25T22:53:41.288 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021244174000000001, 2024-04-25T22:53:41.288 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:41.288 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:41.288 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:41.288 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:41.288 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.288 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:41.288 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:41.288 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:41.288 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.288 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.288 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:41.288 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:41.289 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:41.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.289 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:41.289 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:41.289 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:41.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.289 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:41.289 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012712+0000", 2024-04-25T22:53:41.289 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.913e-06 2024-04-25T22:53:41.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:41.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012722+0000", 2024-04-25T22:53:41.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2879999999999998e-06 2024-04-25T22:53:41.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:41.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012727+0000", 2024-04-25T22:53:41.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8429999999999998e-06 2024-04-25T22:53:41.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:41.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026099+0000", 2024-04-25T22:53:41.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013371450999999999 2024-04-25T22:53:41.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.291 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.291 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:41.291 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026147+0000", 2024-04-25T22:53:41.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7837999999999998e-05 2024-04-25T22:53:41.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.291 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.291 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:41.291 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026254+0000", 2024-04-25T22:53:41.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107314 2024-04-25T22:53:41.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.291 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.291 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:41.292 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026686+0000", 2024-04-25T22:53:41.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000432428 2024-04-25T22:53:41.292 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.292 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.292 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:41.292 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033873+0000", 2024-04-25T22:53:41.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071864399999999997 2024-04-25T22:53:41.292 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.292 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.292 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:41.292 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033904+0000", 2024-04-25T22:53:41.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1321e-05 2024-04-25T22:53:41.292 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.292 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:41.293 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033950+0000", 2024-04-25T22:53:41.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5707999999999997e-05 2024-04-25T22:53:41.293 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:41.293 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:41.293 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:41.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.293 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:41.293 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:41.293 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 108.222788162, 2024-04-25T22:53:41.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01096505, 2024-04-25T22:53:41.294 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:41.294 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:41.294 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:41.294 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:41.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:41.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:41.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:41.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:41.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:41.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:41.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:41.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012737+0000", 2024-04-25T22:53:41.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:41.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:41.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012739+0000", 2024-04-25T22:53:41.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-04-25T22:53:41.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:41.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012743+0000", 2024-04-25T22:53:41.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3239999999999996e-06 2024-04-25T22:53:41.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.296 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:41.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012746+0000", 2024-04-25T22:53:41.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.129e-06 2024-04-25T22:53:41.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.296 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:41.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012796+0000", 2024-04-25T22:53:41.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9231999999999999e-05 2024-04-25T22:53:41.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.296 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:41.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012915+0000", 2024-04-25T22:53:41.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119021 2024-04-25T22:53:41.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.297 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:41.297 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013069+0000", 2024-04-25T22:53:41.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015463900000000001 2024-04-25T22:53:41.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.297 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:41.297 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019237+0000", 2024-04-25T22:53:41.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061680329999999998 2024-04-25T22:53:41.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:41.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023603+0000", 2024-04-25T22:53:41.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043655860000000003 2024-04-25T22:53:41.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:41.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023659+0000", 2024-04-25T22:53:41.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6484000000000003e-05 2024-04-25T22:53:41.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:41.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023701+0000", 2024-04-25T22:53:41.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1761999999999998e-05 2024-04-25T22:53:41.298 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:41.299 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:41.299 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:41.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.299 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:41.299 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:41.299 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 108.222763214, 2024-04-25T22:53:41.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011234429000000001, 2024-04-25T22:53:41.299 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:41.299 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:41.299 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:41.299 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:41.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:41.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:41.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:41.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:41.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:41.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:41.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:41.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012762+0000", 2024-04-25T22:53:41.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-04-25T22:53:41.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:41.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012765+0000", 2024-04-25T22:53:41.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2569999999999999e-06 2024-04-25T22:53:41.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:41.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012783+0000", 2024-04-25T22:53:41.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8431999999999999e-05 2024-04-25T22:53:41.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:41.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012799+0000", 2024-04-25T22:53:41.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5438999999999999e-05 2024-04-25T22:53:41.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:41.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013826+0000", 2024-04-25T22:53:41.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010275060000000001 2024-04-25T22:53:41.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:41.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013913+0000", 2024-04-25T22:53:41.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.708e-05 2024-04-25T22:53:41.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:41.303 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014098+0000", 2024-04-25T22:53:41.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018519399999999999 2024-04-25T22:53:41.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.303 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:41.303 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019684+0000", 2024-04-25T22:53:41.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055860079999999999 2024-04-25T22:53:41.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.303 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:41.303 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023876+0000", 2024-04-25T22:53:41.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041918800000000003 2024-04-25T22:53:41.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:41.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023957+0000", 2024-04-25T22:53:41.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1165e-05 2024-04-25T22:53:41.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:41.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023995+0000", 2024-04-25T22:53:41.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:53:41.304 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:41.304 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:41.304 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:41.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.304 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:41.305 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:41.305 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 108.222665435, 2024-04-25T22:53:41.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011131200000000001, 2024-04-25T22:53:41.305 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:41.305 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:41.305 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:41.305 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:41.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:41.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:41.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:41.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:41.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:41.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:41.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:41.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012860+0000", 2024-04-25T22:53:41.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3900000000000004e-07 2024-04-25T22:53:41.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:41.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012865+0000", 2024-04-25T22:53:41.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5609999999999998e-06 2024-04-25T22:53:41.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:41.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012895+0000", 2024-04-25T22:53:41.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9847000000000001e-05 2024-04-25T22:53:41.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:41.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012905+0000", 2024-04-25T22:53:41.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.03e-05 2024-04-25T22:53:41.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:41.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015020+0000", 2024-04-25T22:53:41.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021142940000000001 2024-04-25T22:53:41.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:41.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015182+0000", 2024-04-25T22:53:41.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016248099999999999 2024-04-25T22:53:41.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:41.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015357+0000", 2024-04-25T22:53:41.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017471000000000001 2024-04-25T22:53:41.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:41.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021021+0000", 2024-04-25T22:53:41.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056638340000000004 2024-04-25T22:53:41.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:41.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023712+0000", 2024-04-25T22:53:41.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026910380000000002 2024-04-25T22:53:41.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:41.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023763+0000", 2024-04-25T22:53:41.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1477999999999997e-05 2024-04-25T22:53:41.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:41.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023990+0000", 2024-04-25T22:53:41.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000226818 2024-04-25T22:53:41.310 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:41.310 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:41.310 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:41.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.310 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:41.310 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:41.310 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 108.222542339, 2024-04-25T22:53:41.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011705299000000001, 2024-04-25T22:53:41.310 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:41.310 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:41.310 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:41.310 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:41.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:41.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:41.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:41.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:41.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:41.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:41.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:41.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012983+0000", 2024-04-25T22:53:41.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:53:41.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:41.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012986+0000", 2024-04-25T22:53:41.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5700000000000001e-06 2024-04-25T22:53:41.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:41.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012993+0000", 2024-04-25T22:53:41.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8730000000000001e-06 2024-04-25T22:53:41.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:41.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013000+0000", 2024-04-25T22:53:41.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1890000000000001e-06 2024-04-25T22:53:41.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:41.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:53:41.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002147866 2024-04-25T22:53:41.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:41.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015351+0000", 2024-04-25T22:53:41.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020300799999999999 2024-04-25T22:53:41.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:41.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016260+0000", 2024-04-25T22:53:41.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00090926799999999997 2024-04-25T22:53:41.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:41.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022669+0000", 2024-04-25T22:53:41.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064082849999999997 2024-04-25T22:53:41.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:41.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024584+0000", 2024-04-25T22:53:41.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019151699999999999 2024-04-25T22:53:41.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:41.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024643+0000", 2024-04-25T22:53:41.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8888999999999998e-05 2024-04-25T22:53:41.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:41.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024687+0000", 2024-04-25T22:53:41.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4444999999999999e-05 2024-04-25T22:53:41.315 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:41.315 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:41.315 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:41.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.316 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:41.316 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:41.316 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 108.22251474799999, 2024-04-25T22:53:41.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011249699, 2024-04-25T22:53:41.316 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:41.316 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:41.316 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:41.316 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:41.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:41.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:41.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:41.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:41.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:41.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:41.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:41.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013010+0000", 2024-04-25T22:53:41.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2099999999999996e-07 2024-04-25T22:53:41.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:41.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013013+0000", 2024-04-25T22:53:41.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1310000000000002e-06 2024-04-25T22:53:41.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:41.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013020+0000", 2024-04-25T22:53:41.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3330000000000002e-06 2024-04-25T22:53:41.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:41.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013025+0000", 2024-04-25T22:53:41.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6760000000000004e-06 2024-04-25T22:53:41.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:41.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013163+0000", 2024-04-25T22:53:41.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013824599999999999 2024-04-25T22:53:41.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:41.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013504+0000", 2024-04-25T22:53:41.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034080299999999998 2024-04-25T22:53:41.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:41.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013613+0000", 2024-04-25T22:53:41.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108705 2024-04-25T22:53:41.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:41.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015831+0000", 2024-04-25T22:53:41.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002217672 2024-04-25T22:53:41.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:41.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024137+0000", 2024-04-25T22:53:41.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0083060489999999994 2024-04-25T22:53:41.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:41.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024218+0000", 2024-04-25T22:53:41.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1351000000000001e-05 2024-04-25T22:53:41.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:41.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024259+0000", 2024-04-25T22:53:41.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1112000000000002e-05 2024-04-25T22:53:41.321 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:41.321 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:41.321 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:41.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.321 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:41.321 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:41.321 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 108.22242702200001, 2024-04-25T22:53:41.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020379749999999999, 2024-04-25T22:53:41.322 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:41.322 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:41.322 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:41.322 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:41.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:41.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:41.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:41.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:41.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:41.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:41.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:41.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013098+0000", 2024-04-25T22:53:41.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:53:41.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:41.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013105+0000", 2024-04-25T22:53:41.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5969999999999997e-06 2024-04-25T22:53:41.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:41.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013190+0000", 2024-04-25T22:53:41.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5618999999999995e-05 2024-04-25T22:53:41.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:41.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013200+0000", 2024-04-25T22:53:41.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5859999999999994e-06 2024-04-25T22:53:41.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:41.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020265+0000", 2024-04-25T22:53:41.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070653349999999998 2024-04-25T22:53:41.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:41.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020454+0000", 2024-04-25T22:53:41.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189316 2024-04-25T22:53:41.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:41.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020586+0000", 2024-04-25T22:53:41.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013195700000000001 2024-04-25T22:53:41.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:41.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023822+0000", 2024-04-25T22:53:41.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032358529999999999 2024-04-25T22:53:41.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:41.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033409+0000", 2024-04-25T22:53:41.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095870520000000004 2024-04-25T22:53:41.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:41.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033447+0000", 2024-04-25T22:53:41.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7261999999999997e-05 2024-04-25T22:53:41.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:41.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033477+0000", 2024-04-25T22:53:41.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0389e-05 2024-04-25T22:53:41.327 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:41.327 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:41.327 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:41.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.327 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:41.327 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:41.327 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 108.22231051599999, 2024-04-25T22:53:41.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010857383999999999, 2024-04-25T22:53:41.327 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:41.327 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:41.327 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:41.327 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:41.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:41.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:41.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:41.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:41.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:41.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:41.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:41.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:41.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:41.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:41.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013218+0000", 2024-04-25T22:53:41.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8199999999999998e-06 2024-04-25T22:53:41.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:41.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013226+0000", 2024-04-25T22:53:41.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7649999999999993e-06 2024-04-25T22:53:41.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:41.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013259+0000", 2024-04-25T22:53:41.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2727e-05 2024-04-25T22:53:41.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:41.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014809+0000", 2024-04-25T22:53:41.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001550144 2024-04-25T22:53:41.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:41.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014958+0000", 2024-04-25T22:53:41.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014890300000000001 2024-04-25T22:53:41.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:41.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015087+0000", 2024-04-25T22:53:41.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012939200000000001 2024-04-25T22:53:41.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:41.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020212+0000", 2024-04-25T22:53:41.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051248939999999996 2024-04-25T22:53:41.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:41.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023699+0000", 2024-04-25T22:53:41.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034873289999999999 2024-04-25T22:53:41.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:41.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024014+0000", 2024-04-25T22:53:41.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031473999999999999 2024-04-25T22:53:41.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:41.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024071+0000", 2024-04-25T22:53:41.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7040000000000003e-05 2024-04-25T22:53:41.332 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:41.333 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:41.333 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:41.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.333 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:41.333 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:41.333 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 108.222255811, 2024-04-25T22:53:41.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012329677000000001, 2024-04-25T22:53:41.333 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:41.333 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:41.333 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:41.333 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:41.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:41.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:41.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:41.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:41.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:41.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:41.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:41.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013269+0000", 2024-04-25T22:53:41.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5000000000000002e-07 2024-04-25T22:53:41.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:41.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:41.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6909999999999999e-06 2024-04-25T22:53:41.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:41.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013284+0000", 2024-04-25T22:53:41.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0963e-05 2024-04-25T22:53:41.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:41.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013361+0000", 2024-04-25T22:53:41.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7379999999999994e-05 2024-04-25T22:53:41.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:41.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013448+0000", 2024-04-25T22:53:41.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6990000000000006e-05 2024-04-25T22:53:41.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:41.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013632+0000", 2024-04-25T22:53:41.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018396800000000001 2024-04-25T22:53:41.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:41.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013800+0000", 2024-04-25T22:53:41.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167467 2024-04-25T22:53:41.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:41.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.018570+0000", 2024-04-25T22:53:41.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047701460000000003 2024-04-25T22:53:41.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:41.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025507+0000", 2024-04-25T22:53:41.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069372039999999998 2024-04-25T22:53:41.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:41.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025562+0000", 2024-04-25T22:53:41.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4858999999999998e-05 2024-04-25T22:53:41.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:41.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025598+0000", 2024-04-25T22:53:41.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6259e-05 2024-04-25T22:53:41.338 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:41.338 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:41.338 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:41.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.339 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:41.339 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:41.339 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 108.222123938, 2024-04-25T22:53:41.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020176666999999999, 2024-04-25T22:53:41.339 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:41.339 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:41.339 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:53:41.339 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:41.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:41.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:41.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:41.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:41.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:41.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:41.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:41.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:41.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-04-25T22:53:41.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:41.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013405+0000", 2024-04-25T22:53:41.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0559999999999998e-06 2024-04-25T22:53:41.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:41.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013422+0000", 2024-04-25T22:53:41.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6770999999999999e-05 2024-04-25T22:53:41.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:41.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013431+0000", 2024-04-25T22:53:41.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5019999999999998e-06 2024-04-25T22:53:41.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:41.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021720+0000", 2024-04-25T22:53:41.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082884340000000008 2024-04-25T22:53:41.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:41.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022122+0000", 2024-04-25T22:53:41.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000401634 2024-04-25T22:53:41.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:41.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033577+0000", 2024-04-25T22:53:41.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011455435999999999 2024-04-25T22:53:41.343 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:41.343 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:41.343 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:41.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.343 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4734.0:31 4.1b 4:d9872866:::1000000021d.00000002:head [write 0~3618035] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-25T22:53:41.343 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:53:41.343 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 10.182549676000001, 2024-04-25T22:53:41.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011647062, 2024-04-25T22:53:41.343 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:41.343 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:41.343 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:41.343 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:41.343 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4734", 2024-04-25T22:53:41.344 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:41.344 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 31 2024-04-25T22:53:41.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.344 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:41.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:41.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:53:41.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:41.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:41.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:53:41.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:41.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:41.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:53:41.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5700000000000001e-07 2024-04-25T22:53:41.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:41.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059575+0000", 2024-04-25T22:53:41.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0065991380000000001 2024-04-25T22:53:41.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:41.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059586+0000", 2024-04-25T22:53:41.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1438e-05 2024-04-25T22:53:41.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:41.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059592+0000", 2024-04-25T22:53:41.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2899999999999999e-06 2024-04-25T22:53:41.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:41.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059660+0000", 2024-04-25T22:53:41.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7980999999999998e-05 2024-04-25T22:53:41.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:41.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059757+0000", 2024-04-25T22:53:41.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6340000000000003e-05 2024-04-25T22:53:41.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:41.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.064487+0000", 2024-04-25T22:53:41.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004730621 2024-04-25T22:53:41.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:41.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.064538+0000", 2024-04-25T22:53:41.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0801999999999999e-05 2024-04-25T22:53:41.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:41.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.064622+0000", 2024-04-25T22:53:41.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3595000000000002e-05 2024-04-25T22:53:41.348 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:41.348 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:41.348 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:41.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.348 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:97 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-25T22:53:41.348 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:53:33.026298+0000", 2024-04-25T22:53:41.348 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 8.2092258620000003, 2024-04-25T22:53:41.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015641848999999999, 2024-04-25T22:53:41.349 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:41.349 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:41.349 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:41.349 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:41.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:41.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026298+0000", 2024-04-25T22:53:41.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:41.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:41.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026298+0000", 2024-04-25T22:53:41.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:41.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:41.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026299+0000", 2024-04-25T22:53:41.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7299999999999996e-07 2024-04-25T22:53:41.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:41.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026464+0000", 2024-04-25T22:53:41.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016477700000000001 2024-04-25T22:53:41.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:41.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026472+0000", 2024-04-25T22:53:41.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1589999999999993e-06 2024-04-25T22:53:41.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:41.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026476+0000", 2024-04-25T22:53:41.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4580000000000003e-06 2024-04-25T22:53:41.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:41.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026550+0000", 2024-04-25T22:53:41.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3836000000000003e-05 2024-04-25T22:53:41.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:41.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026644+0000", 2024-04-25T22:53:41.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4022000000000002e-05 2024-04-25T22:53:41.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:41.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.041838+0000", 2024-04-25T22:53:41.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015193814999999999 2024-04-25T22:53:41.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:41.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.041874+0000", 2024-04-25T22:53:41.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5856999999999999e-05 2024-04-25T22:53:41.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:41.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:41.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:41.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.041940+0000", 2024-04-25T22:53:41.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6352000000000004e-05 2024-04-25T22:53:41.353 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:41.353 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:41.353 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:41.353 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:41.353 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:41.353 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:41.354 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-25T22:53:41.356 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:41.354+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:41.357 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:41.425 INFO:tasks.workunit.client.0.smithi052.stdout:./configure \ 2024-04-25T22:53:41.425 INFO:tasks.workunit.client.0.smithi052.stdout: --libexecdir=/usr/lib \ 2024-04-25T22:53:41.425 INFO:tasks.workunit.client.0.smithi052.stdout: --exec_prefix=/var/lib 2024-04-25T22:53:41.456 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:41.455+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:41.460 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:41.460 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:41.460 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-25T22:53:41.461 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:41.469 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:41.557 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:41.557+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:41.582 INFO:tasks.workunit.client.0.smithi052.stdout:checking build system type... x86_64-pc-linux-gnu 2024-04-25T22:53:41.582 INFO:tasks.workunit.client.0.smithi052.stdout:checking host system type... x86_64-pc-linux-gnu 2024-04-25T22:53:41.584 INFO:tasks.workunit.client.0.smithi052.stdout:checking how to print strings... printf 2024-04-25T22:53:41.584 INFO:tasks.workunit.client.0.smithi052.stdout:checking for gcc... gcc 2024-04-25T22:53:41.612 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:41.613 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:41.613 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-25T22:53:41.613 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-25T22:53:41.613 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:41.622 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:41.665 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:41.664+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:41.666 INFO:tasks.workunit.client.0.smithi052.stdout:checking whether the C compiler works... yes 2024-04-25T22:53:41.666 INFO:tasks.workunit.client.0.smithi052.stdout:checking for C compiler default output file name... a.out 2024-04-25T22:53:41.709 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:53:41.712 INFO:tasks.workunit.client.0.smithi052.stdout:checking for suffix of executables... 2024-04-25T22:53:41.728 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:41.728 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:53:41.728 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:53:41.728 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:53:41.728 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.728 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:53:41.729 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:41.729 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 113.759371524, 2024-04-25T22:53:41.729 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:53:41.729 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:41.729 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:41.729 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:41.729 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:41.729 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.729 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:41.729 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:41.729 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:41.729 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.729 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.729 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:41.730 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:41.730 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:41.730 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.730 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.730 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:41.730 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:53:41.730 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:53:41.730 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.730 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.730 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:41.730 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:53:41.730 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:53:41.730 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.731 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.731 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:41.731 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:53:41.731 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:53:41.731 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.731 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.731 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:41.731 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:53:41.731 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:53:41.731 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.731 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.731 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:41.731 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:53:41.732 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:53:41.732 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.732 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.732 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:41.732 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:53:41.732 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:53:41.732 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.732 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.732 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:41.732 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:53:41.732 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:53:41.732 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.732 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.732 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:41.733 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:53:41.733 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:53:41.733 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:41.733 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:41.733 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:41.733 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.733 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.733 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:41.733 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:41.733 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 108.71487582500001, 2024-04-25T22:53:41.733 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:53:41.733 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:41.733 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:41.734 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:41.734 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:41.734 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.734 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:41.734 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:41.734 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:41.734 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.734 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.734 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:41.734 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:41.734 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:41.734 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.735 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.735 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:41.735 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:53:41.735 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:53:41.735 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.735 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.735 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:41.735 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:53:41.735 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:53:41.735 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.735 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.735 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:41.736 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:53:41.736 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:53:41.736 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.736 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.736 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:41.736 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:53:41.736 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:53:41.736 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.736 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.736 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:41.736 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:53:41.736 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:53:41.736 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.737 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.737 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:41.737 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:53:41.737 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:53:41.737 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.737 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.737 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:41.737 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:53:41.737 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:53:41.737 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.737 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.737 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:41.738 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:53:41.738 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:53:41.738 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.738 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.738 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:41.738 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:53:41.738 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:53:41.738 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.738 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.738 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:41.738 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:53:41.738 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:53:41.738 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.739 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.739 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:41.739 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:53:41.739 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:53:41.739 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:41.739 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:41.739 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:41.739 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.739 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.739 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:41.739 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:41.739 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 108.714201449, 2024-04-25T22:53:41.739 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:53:41.740 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:41.740 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:41.740 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:41.740 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:41.740 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.740 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:41.740 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:41.740 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:41.740 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.740 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.740 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:41.740 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:41.740 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:41.741 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.741 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.741 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:41.741 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:53:41.741 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:53:41.741 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.741 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.741 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:41.741 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:53:41.741 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:53:41.741 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.741 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.741 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:41.742 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:53:41.742 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:53:41.742 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.742 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.742 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:41.742 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:53:41.742 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:53:41.742 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.742 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.743 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:41.743 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:53:41.743 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:53:41.743 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.743 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.743 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:41.743 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:53:41.743 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:53:41.743 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.743 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.743 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:41.743 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:53:41.743 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:53:41.743 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.744 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.744 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:41.744 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:53:41.744 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:53:41.744 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.744 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.744 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:41.744 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:53:41.744 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:53:41.744 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.744 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.744 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:41.744 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:53:41.745 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:53:41.745 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.745 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.745 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:41.745 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:53:41.745 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:53:41.745 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:41.745 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:41.745 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:41.745 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.745 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.745 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:41.745 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:41.746 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 108.713692237, 2024-04-25T22:53:41.746 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:53:41.746 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:41.746 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:41.746 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:41.746 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:41.746 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.746 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:41.746 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:41.746 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:41.746 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.746 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.746 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:41.746 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:41.747 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:41.747 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.747 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.747 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:41.747 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:53:41.747 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:53:41.747 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.747 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.747 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:41.747 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:53:41.747 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:53:41.747 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.747 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.748 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:41.748 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:53:41.748 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:53:41.748 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.748 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.748 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:41.748 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:53:41.748 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:53:41.748 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.748 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.748 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:41.748 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:53:41.749 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:53:41.749 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.749 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.749 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:41.749 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:53:41.749 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:53:41.749 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.749 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.749 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:41.749 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:53:41.749 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:53:41.749 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.749 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.750 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:41.750 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:53:41.750 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:53:41.750 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.750 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.750 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:41.750 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:53:41.750 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:53:41.750 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.750 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.750 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:41.750 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:53:41.750 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:53:41.751 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.751 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.751 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:41.751 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:53:41.751 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:53:41.751 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:41.751 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:41.751 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:41.751 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.751 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.751 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:41.751 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:41.751 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 108.713279039, 2024-04-25T22:53:41.752 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:53:41.752 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:41.752 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:41.752 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:41.752 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:41.752 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.752 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:41.752 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:41.752 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:41.752 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.752 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.752 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:41.752 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:41.752 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:41.753 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.753 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.753 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:41.753 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:41.753 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:53:41.753 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.753 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.753 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:41.753 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:41.753 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:53:41.753 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.753 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.753 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:41.753 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:53:41.754 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:53:41.754 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.754 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.754 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:41.754 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:53:41.754 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:53:41.754 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.754 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.754 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:41.754 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:53:41.754 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:53:41.754 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.754 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.754 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:41.755 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:53:41.755 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:53:41.755 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.755 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.755 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:41.755 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:53:41.755 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:53:41.755 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.755 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.755 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:41.755 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:53:41.755 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:53:41.755 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.756 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.756 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:41.756 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:53:41.756 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:53:41.756 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.756 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.756 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:41.756 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:53:41.756 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:53:41.756 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.756 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.756 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:41.756 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:53:41.757 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:53:41.757 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:41.757 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:41.757 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:41.757 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.757 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.757 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:41.757 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:41.757 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 108.71322836900001, 2024-04-25T22:53:41.757 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:53:41.757 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:41.757 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:41.757 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:41.757 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:41.758 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.758 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:41.758 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:41.758 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:41.758 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.758 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.758 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:41.758 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:41.758 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:41.758 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.758 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.758 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:41.759 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:53:41.759 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:53:41.759 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.759 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.759 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:41.759 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:53:41.759 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:53:41.759 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.759 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.759 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:41.759 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:53:41.759 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:53:41.759 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.759 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.760 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:41.760 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:53:41.760 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:53:41.760 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.760 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.760 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:41.760 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:53:41.760 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:53:41.760 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.760 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.760 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:41.760 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:53:41.760 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:53:41.760 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.761 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.761 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:41.761 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:53:41.761 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:53:41.761 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.761 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.761 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:41.761 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:53:41.761 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:53:41.761 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.761 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.761 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:41.761 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:53:41.761 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:53:41.762 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.762 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.762 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:41.762 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:53:41.762 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:53:41.762 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.762 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.762 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:41.762 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:53:41.762 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:53:41.762 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.762 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.762 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:41.762 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:53:41.763 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:53:41.763 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.763 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.763 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:41.763 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:53:41.763 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:53:41.763 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:41.763 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:41.763 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:41.763 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.763 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.763 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:41.763 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:41.764 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 108.71319149999999, 2024-04-25T22:53:41.764 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:53:41.764 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:41.764 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:41.764 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:41.764 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:41.764 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.764 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:41.764 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:41.764 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:41.764 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.764 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.764 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:41.765 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:41.765 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:41.765 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.765 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.765 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:41.765 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:53:41.765 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:53:41.765 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.765 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.765 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:41.765 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:53:41.765 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:53:41.765 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.765 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.766 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:41.766 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:53:41.766 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:53:41.766 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.766 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.766 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:41.766 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:53:41.766 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:53:41.766 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.766 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.766 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:41.766 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:53:41.766 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:53:41.766 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.767 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.767 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:53:41.767 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:53:41.767 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:53:41.767 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.767 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.767 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:41.767 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:53:41.767 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:53:41.767 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.767 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.767 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:41.767 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:53:41.767 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:53:41.768 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.768 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.768 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:41.768 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:53:41.768 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:53:41.768 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.768 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.768 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:41.768 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:53:41.768 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:53:41.768 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.768 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.768 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:41.768 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:53:41.769 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:53:41.769 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.769 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.769 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:41.769 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:53:41.769 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:53:41.769 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.769 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.769 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:41.769 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:53:41.769 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:53:41.769 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:41.769 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:41.769 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:41.770 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.770 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.770 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:41.770 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:41.770 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 108.713166534, 2024-04-25T22:53:41.770 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:53:41.770 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:41.770 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:41.770 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:41.770 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:41.770 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.770 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:41.770 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:41.770 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:41.771 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.771 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.771 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:41.771 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:41.771 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:41.771 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.771 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.771 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:41.771 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:53:41.771 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:53:41.771 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.771 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.771 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:41.771 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:53:41.772 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:53:41.772 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.772 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.772 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:41.772 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:41.772 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:53:41.772 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.772 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.772 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:41.772 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:53:41.772 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:53:41.772 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.772 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.772 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:41.772 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:53:41.773 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:53:41.773 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.773 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.773 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:41.773 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:53:41.773 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:53:41.773 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.773 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.773 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:41.773 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:53:41.773 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:53:41.773 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.773 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.774 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:41.774 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:53:41.774 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:53:41.774 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.774 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.774 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:41.774 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:53:41.774 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:53:41.774 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.774 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.774 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:41.774 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:53:41.774 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:53:41.774 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.775 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.775 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:41.775 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:53:41.775 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:53:41.775 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:41.775 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:41.775 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:41.775 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.775 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.775 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:41.775 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:41.775 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 108.71313017, 2024-04-25T22:53:41.775 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:53:41.775 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:41.776 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:41.776 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:41.776 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:41.776 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.776 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:41.776 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:41.776 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:41.776 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.776 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.776 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:41.776 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:41.776 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:41.776 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.776 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.776 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:41.777 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:53:41.777 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:53:41.777 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.777 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.777 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:41.777 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:53:41.777 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:53:41.777 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.777 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.777 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:41.777 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:53:41.777 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:53:41.777 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.777 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.777 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:41.778 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:53:41.778 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:53:41.778 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.778 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.778 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:41.778 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:53:41.778 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:53:41.778 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.778 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.778 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:41.778 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:53:41.778 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:53:41.778 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.778 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.779 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:41.779 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:53:41.779 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:53:41.779 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.779 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.779 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:41.779 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:53:41.779 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:53:41.779 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.779 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.779 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:41.779 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:53:41.779 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:53:41.779 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:41.779 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:41.779 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:41.780 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.780 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.780 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:41.780 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:41.780 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 108.713099089, 2024-04-25T22:53:41.780 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:53:41.780 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:41.780 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:41.780 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:41.780 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:41.780 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.780 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:41.780 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:41.781 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:41.781 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.781 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.781 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:41.781 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:41.781 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:41.781 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.781 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.781 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:41.781 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:41.781 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:41.781 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.781 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.781 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:41.781 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:53:41.781 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:53:41.782 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.782 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.782 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:41.782 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:53:41.782 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:53:41.782 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.782 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.782 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:41.782 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:53:41.782 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:53:41.782 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.782 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.782 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:41.783 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:53:41.783 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:53:41.783 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.783 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.783 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:41.783 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:53:41.783 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:53:41.783 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.783 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.783 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:41.783 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:53:41.783 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:53:41.783 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:41.783 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:41.783 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:41.784 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.784 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.784 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:30 4.31 4:8ebfc112:::1000000021d.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-25T22:53:41.784 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:53:41.784 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 10.673413219, 2024-04-25T22:53:41.784 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015003005, 2024-04-25T22:53:41.784 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:41.784 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:41.784 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:41.784 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:41.784 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:41.784 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:41.784 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 30 2024-04-25T22:53:41.784 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.784 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:41.785 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.785 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:41.785 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:53:41.785 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:41.785 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.785 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.785 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:41.785 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:53:41.785 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:41.785 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.785 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.785 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:41.785 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053133+0000", 2024-04-25T22:53:41.785 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0370000000000001e-06 2024-04-25T22:53:41.785 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.786 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.786 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:41.786 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060377+0000", 2024-04-25T22:53:41.786 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0072431070000000004 2024-04-25T22:53:41.786 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.786 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.786 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:41.786 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060388+0000", 2024-04-25T22:53:41.786 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1285e-05 2024-04-25T22:53:41.786 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.786 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.786 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:41.786 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060394+0000", 2024-04-25T22:53:41.786 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1040000000000003e-06 2024-04-25T22:53:41.787 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.787 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.787 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:41.787 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060483+0000", 2024-04-25T22:53:41.787 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.9345000000000006e-05 2024-04-25T22:53:41.787 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.787 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.787 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:41.787 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060566+0000", 2024-04-25T22:53:41.787 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2237999999999994e-05 2024-04-25T22:53:41.787 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.787 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.787 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:41.787 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068057+0000", 2024-04-25T22:53:41.787 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074912210000000002 2024-04-25T22:53:41.787 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.788 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.788 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:41.788 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068090+0000", 2024-04-25T22:53:41.788 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3501000000000003e-05 2024-04-25T22:53:41.788 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.788 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.788 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:41.788 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068134+0000", 2024-04-25T22:53:41.788 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4166999999999999e-05 2024-04-25T22:53:41.788 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:41.788 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:41.788 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:41.788 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.788 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.788 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:66 4.27 4:e5671758:::1000000024f.00000000:head [write 0~6641] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:41.789 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:41.789 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 10.413302883, 2024-04-25T22:53:41.789 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075166540000000002, 2024-04-25T22:53:41.789 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:41.789 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:41.789 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:41.789 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:41.789 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:41.789 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:41.789 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 66 2024-04-25T22:53:41.789 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.789 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:41.789 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.789 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:41.789 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:41.790 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:41.790 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.790 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.790 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:41.790 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:41.790 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:41.790 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.790 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.790 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:41.790 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:41.790 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4099999999999998e-07 2024-04-25T22:53:41.790 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.790 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.790 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:41.791 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313252+0000", 2024-04-25T22:53:41.791 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5380000000000008e-06 2024-04-25T22:53:41.791 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.791 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.791 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:41.791 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313260+0000", 2024-04-25T22:53:41.791 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2609999999999993e-06 2024-04-25T22:53:41.791 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.791 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.791 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:41.791 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313265+0000", 2024-04-25T22:53:41.791 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4850000000000003e-06 2024-04-25T22:53:41.791 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.791 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.792 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:41.792 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313310+0000", 2024-04-25T22:53:41.792 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5247999999999998e-05 2024-04-25T22:53:41.792 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.792 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.792 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:41.792 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313370+0000", 2024-04-25T22:53:41.792 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0275000000000001e-05 2024-04-25T22:53:41.792 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.792 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.792 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:41.792 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313435+0000", 2024-04-25T22:53:41.792 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4647000000000006e-05 2024-04-25T22:53:41.792 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.792 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.793 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:41.793 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314174+0000", 2024-04-25T22:53:41.793 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00073925 2024-04-25T22:53:41.793 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.793 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.793 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:41.793 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320688+0000", 2024-04-25T22:53:41.793 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.006513418 2024-04-25T22:53:41.793 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.793 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.793 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:41.793 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320736+0000", 2024-04-25T22:53:41.793 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.8114e-05 2024-04-25T22:53:41.793 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.794 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.794 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:41.794 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320758+0000", 2024-04-25T22:53:41.794 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2776999999999999e-05 2024-04-25T22:53:41.794 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:41.794 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:41.794 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:41.794 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.794 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.794 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:68 4.31 4:8fb7f7b7:::10000000251.00000000:head [write 0~2067] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:41.794 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:41.794 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 10.411617104999999, 2024-04-25T22:53:41.794 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0087011669999999992, 2024-04-25T22:53:41.795 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:41.795 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:41.795 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:41.795 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:41.795 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:41.795 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:41.795 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 68 2024-04-25T22:53:41.795 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.795 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:41.795 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.795 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:41.795 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:41.795 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:41.795 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.796 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.796 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:41.796 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:41.796 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:41.796 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.796 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.796 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:41.796 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:41.796 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:53:41.796 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.796 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.796 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:41.796 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314933+0000", 2024-04-25T22:53:41.797 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5430000000000004e-06 2024-04-25T22:53:41.797 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.797 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.797 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:41.797 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314944+0000", 2024-04-25T22:53:41.797 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.076e-05 2024-04-25T22:53:41.797 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.797 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.797 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:41.797 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314949+0000", 2024-04-25T22:53:41.797 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1019999999999996e-06 2024-04-25T22:53:41.797 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.797 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.797 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:41.797 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314996+0000", 2024-04-25T22:53:41.798 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7018999999999998e-05 2024-04-25T22:53:41.798 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.798 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.798 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:41.798 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315064+0000", 2024-04-25T22:53:41.798 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8738000000000005e-05 2024-04-25T22:53:41.798 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.798 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.798 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:41.798 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323531+0000", 2024-04-25T22:53:41.798 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084664739999999999 2024-04-25T22:53:41.798 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.798 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.799 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:41.799 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323574+0000", 2024-04-25T22:53:41.799 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3449999999999999e-05 2024-04-25T22:53:41.799 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.799 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.799 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:41.799 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323629+0000", 2024-04-25T22:53:41.799 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4296999999999999e-05 2024-04-25T22:53:41.799 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:41.799 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:41.799 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:41.799 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.799 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.799 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4734.0:69 4.32 e46/13 4:4e8c6251:::10000000252.00000000:head v 46'1, mlcod=0'0)", 2024-04-25T22:53:41.800 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:41.800 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 10.410585836999999, 2024-04-25T22:53:41.800 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076063240000000002, 2024-04-25T22:53:41.800 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:41.800 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:41.800 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:41.800 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:41.800 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.800 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:41.800 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:41.800 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:41.800 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.800 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.801 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:41.801 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:41.801 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:41.801 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.801 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.801 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:41.801 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:41.801 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3099999999999997e-07 2024-04-25T22:53:41.801 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.801 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.801 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:41.801 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315964+0000", 2024-04-25T22:53:41.801 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3229999999999999e-06 2024-04-25T22:53:41.801 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.802 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.802 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:41.802 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315973+0000", 2024-04-25T22:53:41.802 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7249999999999992e-06 2024-04-25T22:53:41.802 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.802 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.802 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:41.802 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315978+0000", 2024-04-25T22:53:41.802 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4830000000000001e-06 2024-04-25T22:53:41.802 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.802 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.802 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:41.803 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.316043+0000", 2024-04-25T22:53:41.803 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.5036000000000005e-05 2024-04-25T22:53:41.803 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.803 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.803 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:41.803 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.316055+0000", 2024-04-25T22:53:41.803 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1973999999999999e-05 2024-04-25T22:53:41.803 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.803 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.803 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:41.803 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323521+0000", 2024-04-25T22:53:41.803 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074660239999999999 2024-04-25T22:53:41.803 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.804 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.804 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:41.804 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323565+0000", 2024-04-25T22:53:41.804 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4128000000000002e-05 2024-04-25T22:53:41.804 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:41.804 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:41.804 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:41.804 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.804 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.804 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:72 4.36 4:6cdfec98:::10000000255.00000000:head [write 0~4131] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:41.804 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:41.804 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 10.408541925, 2024-04-25T22:53:41.804 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084820680000000006, 2024-04-25T22:53:41.804 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:41.805 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:41.805 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:41.805 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:41.805 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:41.805 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:41.805 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 72 2024-04-25T22:53:41.805 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.805 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:41.805 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.805 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:41.805 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:41.805 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:41.805 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.806 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.806 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:41.806 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:41.806 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:41.806 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.806 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.806 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:41.806 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:41.806 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1800000000000005e-07 2024-04-25T22:53:41.806 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.806 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.806 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:41.806 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318010+0000", 2024-04-25T22:53:41.806 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7399999999999998e-06 2024-04-25T22:53:41.807 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.807 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.807 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:41.807 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318019+0000", 2024-04-25T22:53:41.807 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0170000000000002e-06 2024-04-25T22:53:41.807 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.807 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.807 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:41.807 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318024+0000", 2024-04-25T22:53:41.807 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0150000000000003e-06 2024-04-25T22:53:41.807 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.807 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.807 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:41.807 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318075+0000", 2024-04-25T22:53:41.808 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0537000000000001e-05 2024-04-25T22:53:41.808 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.808 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.808 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:41.808 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318144+0000", 2024-04-25T22:53:41.808 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9432999999999997e-05 2024-04-25T22:53:41.808 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.808 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.808 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:41.808 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326392+0000", 2024-04-25T22:53:41.808 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0082482979999999994 2024-04-25T22:53:41.808 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.808 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.808 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:41.809 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326432+0000", 2024-04-25T22:53:41.809 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9870000000000003e-05 2024-04-25T22:53:41.809 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.809 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.809 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:41.809 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326485+0000", 2024-04-25T22:53:41.809 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2439999999999999e-05 2024-04-25T22:53:41.809 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:41.809 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:41.809 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:41.809 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.809 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.809 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:74 4.10 4:08e6f8ca:::10000000257.00000000:head [write 0~839] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:41.809 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:53:41.809 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 10.407068196999999, 2024-04-25T22:53:41.810 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070370720000000001, 2024-04-25T22:53:41.810 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:41.810 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:41.810 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:41.810 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:41.810 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:41.810 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:41.810 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 74 2024-04-25T22:53:41.810 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.810 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:41.810 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.810 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:41.811 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:53:41.811 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:41.811 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.811 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.811 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:41.811 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:53:41.811 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:41.811 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.811 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.811 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:41.811 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319477+0000", 2024-04-25T22:53:41.811 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1999999999999999e-07 2024-04-25T22:53:41.811 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.811 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.812 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:41.812 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319483+0000", 2024-04-25T22:53:41.812 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4260000000000002e-06 2024-04-25T22:53:41.812 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.812 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.812 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:41.812 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319494+0000", 2024-04-25T22:53:41.812 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.094e-05 2024-04-25T22:53:41.812 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.812 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.812 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:41.812 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319499+0000", 2024-04-25T22:53:41.812 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3789999999999997e-06 2024-04-25T22:53:41.812 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.812 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.813 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:41.813 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319545+0000", 2024-04-25T22:53:41.813 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6149000000000001e-05 2024-04-25T22:53:41.813 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.813 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.813 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:41.813 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319617+0000", 2024-04-25T22:53:41.813 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1792999999999995e-05 2024-04-25T22:53:41.813 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.813 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.813 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:41.813 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326406+0000", 2024-04-25T22:53:41.813 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067895999999999998 2024-04-25T22:53:41.814 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.814 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.814 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:41.814 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326443+0000", 2024-04-25T22:53:41.814 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6828e-05 2024-04-25T22:53:41.814 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.814 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.814 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:41.814 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326514+0000", 2024-04-25T22:53:41.814 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0236999999999999e-05 2024-04-25T22:53:41.814 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:41.814 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:41.814 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:41.814 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.815 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.815 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:128 3.1f 3:f83d65d8:::200.00000004:head [write 876784~3317520 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e48)", 2024-04-25T22:53:41.815 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:36.985410+0000", 2024-04-25T22:53:41.815 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 4.7411345789999997, 2024-04-25T22:53:41.815 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0090177360000000002, 2024-04-25T22:53:41.815 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:41.815 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:41.815 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:41.815 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:41.815 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.815 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:41.815 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.985410+0000", 2024-04-25T22:53:41.815 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:41.816 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.816 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.816 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:41.816 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.985410+0000", 2024-04-25T22:53:41.816 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:41.816 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.816 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.816 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:41.816 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.985411+0000", 2024-04-25T22:53:41.816 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8400000000000003e-07 2024-04-25T22:53:41.816 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.816 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.816 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:41.816 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989116+0000", 2024-04-25T22:53:41.816 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037047389999999999 2024-04-25T22:53:41.816 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.817 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.817 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:41.817 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989128+0000", 2024-04-25T22:53:41.817 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1977999999999999e-05 2024-04-25T22:53:41.817 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.817 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.817 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:41.817 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989135+0000", 2024-04-25T22:53:41.817 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5290000000000003e-06 2024-04-25T22:53:41.817 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.817 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.817 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:41.817 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989181+0000", 2024-04-25T22:53:41.817 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6122999999999999e-05 2024-04-25T22:53:41.817 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.818 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.818 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:41.818 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989250+0000", 2024-04-25T22:53:41.818 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8535999999999996e-05 2024-04-25T22:53:41.818 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.818 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.818 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:41.818 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.994272+0000", 2024-04-25T22:53:41.818 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050224889999999998 2024-04-25T22:53:41.818 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.818 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.818 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:41.818 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.994335+0000", 2024-04-25T22:53:41.818 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2588000000000005e-05 2024-04-25T22:53:41.819 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.819 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.819 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:41.819 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.994428+0000", 2024-04-25T22:53:41.819 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2869999999999997e-05 2024-04-25T22:53:41.819 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:41.819 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:41.819 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:41.819 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.819 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.819 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:2150 4.22 4:47cffac6:::10000000a2b.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T22:53:41.819 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:41.078233+0000", 2024-04-25T22:53:41.819 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.64831126900000002, 2024-04-25T22:53:41.819 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069201510000000003, 2024-04-25T22:53:41.820 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:41.820 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:41.820 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:41.820 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:41.820 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.820 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:41.820 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078233+0000", 2024-04-25T22:53:41.820 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:41.820 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.820 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.820 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:41.820 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078233+0000", 2024-04-25T22:53:41.821 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:41.821 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.821 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.821 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:41.821 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078234+0000", 2024-04-25T22:53:41.821 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1699999999999998e-07 2024-04-25T22:53:41.821 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.821 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.821 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:41.821 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078236+0000", 2024-04-25T22:53:41.821 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.875e-06 2024-04-25T22:53:41.821 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.821 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.821 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:41.822 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078242+0000", 2024-04-25T22:53:41.822 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2450000000000003e-06 2024-04-25T22:53:41.822 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.822 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.822 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:41.822 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078247+0000", 2024-04-25T22:53:41.822 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7450000000000003e-06 2024-04-25T22:53:41.822 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.822 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.822 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:41.822 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078641+0000", 2024-04-25T22:53:41.822 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00039420200000000002 2024-04-25T22:53:41.822 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.823 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.823 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:41.823 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078840+0000", 2024-04-25T22:53:41.823 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000199063 2024-04-25T22:53:41.823 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.823 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.823 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:41.823 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078919+0000", 2024-04-25T22:53:41.823 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9182000000000002e-05 2024-04-25T22:53:41.823 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.823 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.823 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:41.823 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.080906+0000", 2024-04-25T22:53:41.823 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0019866390000000001 2024-04-25T22:53:41.824 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.824 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.824 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:41.824 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085074+0000", 2024-04-25T22:53:41.824 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0041683639999999999 2024-04-25T22:53:41.824 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.824 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.824 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:41.824 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085117+0000", 2024-04-25T22:53:41.824 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2849999999999998e-05 2024-04-25T22:53:41.824 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.824 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.824 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:41.825 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085154+0000", 2024-04-25T22:53:41.825 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6468999999999999e-05 2024-04-25T22:53:41.825 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:41.825 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:41.825 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:41.825 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.825 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.825 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:2160 4.2a 4:57f9ed86:::10000000a3d.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T22:53:41.825 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:53:41.825 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.64784197899999996, 2024-04-25T22:53:41.825 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0068959959999999997, 2024-04-25T22:53:41.825 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:41.825 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:41.825 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:41.825 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:41.825 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.826 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:41.826 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:53:41.826 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:41.826 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.826 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.826 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:41.826 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:53:41.826 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:41.826 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.826 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.826 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:41.826 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:53:41.826 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7000000000000004e-07 2024-04-25T22:53:41.826 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.827 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.827 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:41.827 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078707+0000", 2024-04-25T22:53:41.827 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.783e-06 2024-04-25T22:53:41.827 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.827 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.827 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:41.827 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078716+0000", 2024-04-25T22:53:41.827 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4800000000000001e-06 2024-04-25T22:53:41.827 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.827 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.827 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:41.827 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078724+0000", 2024-04-25T22:53:41.828 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1519999999999992e-06 2024-04-25T22:53:41.828 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.828 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.828 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:41.828 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078794+0000", 2024-04-25T22:53:41.828 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0500999999999995e-05 2024-04-25T22:53:41.828 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.828 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.828 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:41.828 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078912+0000", 2024-04-25T22:53:41.828 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000117439 2024-04-25T22:53:41.828 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.828 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.828 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:41.828 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079000+0000", 2024-04-25T22:53:41.829 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8092999999999998e-05 2024-04-25T22:53:41.829 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.829 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.829 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:41.829 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.080897+0000", 2024-04-25T22:53:41.829 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0018970899999999999 2024-04-25T22:53:41.829 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.829 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.829 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:41.829 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085517+0000", 2024-04-25T22:53:41.829 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0046198929999999999 2024-04-25T22:53:41.829 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.829 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.829 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:41.829 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085565+0000", 2024-04-25T22:53:41.830 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7777e-05 2024-04-25T22:53:41.830 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.830 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.830 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:41.830 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085599+0000", 2024-04-25T22:53:41.830 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4017999999999999e-05 2024-04-25T22:53:41.830 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:41.830 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:41.830 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:41.830 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.830 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.830 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:2163 4.2a 4:549f79e3:::10000000a43.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T22:53:41.830 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:53:41.830 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 0.647808626, 2024-04-25T22:53:41.831 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069469190000000002, 2024-04-25T22:53:41.831 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:41.831 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:41.831 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:41.831 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:41.831 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.831 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:41.831 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:53:41.831 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:41.831 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.831 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.831 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:41.831 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:53:41.831 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:41.832 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.832 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.832 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:41.832 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:53:41.832 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1399999999999997e-07 2024-04-25T22:53:41.832 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.832 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.832 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:41.832 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078739+0000", 2024-04-25T22:53:41.832 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2960000000000001e-06 2024-04-25T22:53:41.832 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.832 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.832 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:41.832 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078745+0000", 2024-04-25T22:53:41.832 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3439999999999997e-06 2024-04-25T22:53:41.833 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.833 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.833 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:41.833 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078750+0000", 2024-04-25T22:53:41.833 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3179999999999997e-06 2024-04-25T22:53:41.833 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.833 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.833 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:41.833 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079224+0000", 2024-04-25T22:53:41.833 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00047334999999999999 2024-04-25T22:53:41.833 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.833 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.833 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:41.833 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079292+0000", 2024-04-25T22:53:41.834 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8708999999999996e-05 2024-04-25T22:53:41.834 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.834 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.834 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:41.834 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079342+0000", 2024-04-25T22:53:41.834 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9299999999999999e-05 2024-04-25T22:53:41.834 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.834 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.834 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:41.834 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.081611+0000", 2024-04-25T22:53:41.834 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0022695229999999999 2024-04-25T22:53:41.834 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.834 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.834 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:41.835 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085605+0000", 2024-04-25T22:53:41.835 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0039933679999999997 2024-04-25T22:53:41.835 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.835 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.835 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:41.835 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085650+0000", 2024-04-25T22:53:41.835 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5111000000000002e-05 2024-04-25T22:53:41.835 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:41.835 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:41.835 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:41.835 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085683+0000", 2024-04-25T22:53:41.835 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3185999999999997e-05 2024-04-25T22:53:41.835 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:41.835 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:41.835 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:41.835 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:41.836 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:41.836 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:41.837 INFO:tasks.workunit.client.0.smithi052.stdout:checking whether we are cross compiling... no 2024-04-25T22:53:41.838 INFO:tasks.workunit.client.0.smithi052.stdout:checking for suffix of object files... o 2024-04-25T22:53:41.838 INFO:tasks.workunit.client.0.smithi052.stdout:checking whether we are using the GNU C compiler... yes 2024-04-25T22:53:41.838 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:41.839 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:41.836+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:41.840 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-25T22:53:41.841 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:53:41.841 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:53:41.845 INFO:tasks.workunit.client.0.smithi052.stdout:checking whether gcc accepts -g... yes 2024-04-25T22:53:41.862 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-25T22:53:41.862 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:53:41.865 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:53:41.865 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:53:41.931 INFO:tasks.workunit.client.0.smithi052.stdout:checking for gcc option to accept ISO C89... none needed 2024-04-25T22:53:41.935 INFO:tasks.workunit.client.0.smithi052.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2024-04-25T22:53:41.938 INFO:tasks.workunit.client.0.smithi052.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-04-25T22:53:41.938 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:41.936+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:41.939 INFO:tasks.workunit.client.0.smithi052.stdout:checking for egrep... /usr/bin/grep -E 2024-04-25T22:53:41.940 INFO:tasks.workunit.client.0.smithi052.stdout:checking for fgrep... /usr/bin/grep -F 2024-04-25T22:53:41.943 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:41.943 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:41.944 INFO:tasks.workunit.client.0.smithi052.stdout:checking for ld used by gcc... /usr/bin/ld 2024-04-25T22:53:41.946 INFO:tasks.workunit.client.0.smithi052.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2024-04-25T22:53:41.951 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:41.952 INFO:tasks.workunit.client.0.smithi052.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2024-04-25T22:53:42.038 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~59s 2024-04-25T22:53:42.039 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:42.037+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:42.096 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:42.097 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:42.105 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:42.140 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:42.139+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:42.241 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:42.239+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:42.248 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:42.248 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:42.257 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:42.341 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is set 2024-04-25T22:53:42.341 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:42.340+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:42.364 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:42.365 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:42.374 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:42.458 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:42.457+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:42.516 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:42.516 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:42.525 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:42.543 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:42.542+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:42.644 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:42.643+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:42.667 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:42.667 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:42.676 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:42.744 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:42.743+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:42.780 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:42.781 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:42.789 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:42.826 INFO:tasks.workunit.client.0.smithi052.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2024-04-25T22:53:42.827 INFO:tasks.workunit.client.0.smithi052.stdout:checking whether ln -s works... yes 2024-04-25T22:53:42.835 INFO:tasks.workunit.client.0.smithi052.stdout:checking the maximum length of command line arguments... 1572864 2024-04-25T22:53:42.838 INFO:tasks.workunit.client.0.smithi052.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2024-04-25T22:53:42.838 INFO:tasks.workunit.client.0.smithi052.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2024-04-25T22:53:42.839 INFO:tasks.workunit.client.0.smithi052.stdout:checking for /usr/bin/ld option to reload object files... -r 2024-04-25T22:53:42.839 INFO:tasks.workunit.client.0.smithi052.stdout:checking for objdump... objdump 2024-04-25T22:53:42.840 INFO:tasks.workunit.client.0.smithi052.stdout:checking how to recognize dependent libraries... pass_all 2024-04-25T22:53:42.841 INFO:tasks.workunit.client.0.smithi052.stdout:checking for dlltool... no 2024-04-25T22:53:42.841 INFO:tasks.workunit.client.0.smithi052.stdout:checking how to associate runtime and link libraries... printf %s\n 2024-04-25T22:53:42.842 INFO:tasks.workunit.client.0.smithi052.stdout:checking for ar... ar 2024-04-25T22:53:42.845 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:42.844+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:42.909 INFO:tasks.workunit.client.0.smithi052.stdout:checking for archiver @FILE support... @ 2024-04-25T22:53:42.909 INFO:tasks.workunit.client.0.smithi052.stdout:checking for strip... strip 2024-04-25T22:53:42.910 INFO:tasks.workunit.client.0.smithi052.stdout:checking for ranlib... ranlib 2024-04-25T22:53:42.911 INFO:tasks.workunit.client.0.smithi052.stdout:checking for gawk... gawk 2024-04-25T22:53:42.932 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:42.933 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:42.941 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:42.946 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:42.945+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:43.018 INFO:tasks.workunit.client.0.smithi052.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2024-04-25T22:53:43.020 INFO:tasks.workunit.client.0.smithi052.stdout:checking for sysroot... no 2024-04-25T22:53:43.028 INFO:tasks.workunit.client.0.smithi052.stdout:checking for a working dd... /usr/bin/dd 2024-04-25T22:53:43.036 INFO:tasks.workunit.client.0.smithi052.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2024-04-25T22:53:43.044 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:43.044 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:43.046 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:43.046+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:43.053 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:43.059 INFO:tasks.workunit.client.0.smithi052.stdout:checking for mt... no 2024-04-25T22:53:43.067 INFO:tasks.workunit.client.0.smithi052.stdout:checking if : is a manifest tool... no 2024-04-25T22:53:43.136 INFO:tasks.workunit.client.0.smithi052.stdout:checking how to run the C preprocessor... gcc -E 2024-04-25T22:53:43.147 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:43.146+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:43.157 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:43.157 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:43.166 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:43.249 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:43.247+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:43.269 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:43.269 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:43.278 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:43.340 INFO:tasks.workunit.client.0.smithi052.stdout:checking for ANSI C header files... yes 2024-04-25T22:53:43.349 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:43.348+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:43.374 INFO:tasks.workunit.client.0.smithi052.stdout:checking for sys/types.h... yes 2024-04-25T22:53:43.382 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:43.382 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:43.391 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:43.413 INFO:tasks.workunit.client.0.smithi052.stdout:checking for sys/stat.h... yes 2024-04-25T22:53:43.450 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:43.449+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:43.452 INFO:tasks.workunit.client.0.smithi052.stdout:checking for stdlib.h... yes 2024-04-25T22:53:43.492 INFO:tasks.workunit.client.0.smithi052.stdout:checking for string.h... yes 2024-04-25T22:53:43.497 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:43.497 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:43.504 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:43.533 INFO:tasks.workunit.client.0.smithi052.stdout:checking for memory.h... yes 2024-04-25T22:53:43.551 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:43.549+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:43.573 INFO:tasks.workunit.client.0.smithi052.stdout:checking for strings.h... yes 2024-04-25T22:53:43.607 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:43.607 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:43.614 INFO:tasks.workunit.client.0.smithi052.stdout:checking for inttypes.h... yes 2024-04-25T22:53:43.616 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:43.655 INFO:tasks.workunit.client.0.smithi052.stdout:checking for stdint.h... yes 2024-04-25T22:53:43.657 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:43.656+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:43.697 INFO:tasks.workunit.client.0.smithi052.stdout:checking for unistd.h... yes 2024-04-25T22:53:43.736 INFO:tasks.workunit.client.0.smithi052.stdout:checking for dlfcn.h... yes 2024-04-25T22:53:43.742 INFO:tasks.workunit.client.0.smithi052.stdout:checking for objdir... .libs 2024-04-25T22:53:43.753 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:43.752+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:43.759 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:43.759 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:43.768 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:43.848 INFO:tasks.workunit.client.0.smithi052.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2024-04-25T22:53:43.972 INFO:tasks.workunit.client.0.smithi052.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2024-04-25T22:53:43.972 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:53:43.973 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:43.972+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:43.975 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:43.975 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:43.975 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:43.976 INFO:tasks.workunit.client.0.smithi052.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2024-04-25T22:53:43.976 INFO:tasks.workunit.client.0.smithi052.stdout:checking if gcc static flag -static works... no 2024-04-25T22:53:43.976 INFO:tasks.workunit.client.0.smithi052.stdout:checking if gcc supports -c -o file.o... yes 2024-04-25T22:53:43.976 INFO:tasks.workunit.client.0.smithi052.stdout:checking if gcc supports -c -o file.o... (cached) yes 2024-04-25T22:53:43.976 INFO:tasks.workunit.client.0.smithi052.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2024-04-25T22:53:44.023 INFO:tasks.workunit.client.0.smithi052.stdout:checking whether -lc should be explicitly linked in... no 2024-04-25T22:53:44.073 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:44.072+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:44.079 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:44.079 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:44.089 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:44.095 INFO:tasks.workunit.client.0.smithi052.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2024-04-25T22:53:44.095 INFO:tasks.workunit.client.0.smithi052.stdout:checking how to hardcode library paths into programs... immediate 2024-04-25T22:53:44.097 INFO:tasks.workunit.client.0.smithi052.stdout:checking whether stripping libraries is possible... yes 2024-04-25T22:53:44.097 INFO:tasks.workunit.client.0.smithi052.stdout:checking if libtool supports shared libraries... yes 2024-04-25T22:53:44.097 INFO:tasks.workunit.client.0.smithi052.stdout:checking whether to build shared libraries... yes 2024-04-25T22:53:44.098 INFO:tasks.workunit.client.0.smithi052.stdout:checking whether to build static libraries... yes 2024-04-25T22:53:44.105 INFO:tasks.workunit.client.0.smithi052.stdout:checking for gcc... (cached) gcc 2024-04-25T22:53:44.106 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-25T22:53:44.107 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:53:44.107 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:53:44.128 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-25T22:53:44.128 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:53:44.131 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:53:44.132 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:53:44.137 INFO:tasks.workunit.client.0.smithi052.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-04-25T22:53:44.137 INFO:tasks.workunit.client.0.smithi052.stdout:checking whether gcc accepts -g... (cached) yes 2024-04-25T22:53:44.137 INFO:tasks.workunit.client.0.smithi052.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-04-25T22:53:44.139 INFO:tasks.workunit.client.0.smithi052.stdout:checking for gmake... /usr/bin/gmake 2024-04-25T22:53:44.140 INFO:tasks.workunit.client.0.smithi052.stderr:./configure: line 11968: test: $(SHELL): binary operator expected 2024-04-25T22:53:44.141 INFO:tasks.workunit.client.0.smithi052.stdout:checking for tar... /bin/tar 2024-04-25T22:53:44.141 INFO:tasks.workunit.client.0.smithi052.stdout:checking for gzip... /bin/gzip 2024-04-25T22:53:44.173 INFO:tasks.workunit.client.0.smithi052.stdout:checking whether gcc -MM is supported... yes 2024-04-25T22:53:44.174 INFO:tasks.workunit.client.0.smithi052.stdout:checking for sort... /bin/sort 2024-04-25T22:53:44.174 INFO:tasks.workunit.client.0.smithi052.stdout:checking whether ln -s works... yes 2024-04-25T22:53:44.174 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:44.173+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:44.175 INFO:tasks.workunit.client.0.smithi052.stdout:checking for rpm... /bin/rpm 2024-04-25T22:53:44.178 INFO:tasks.workunit.client.0.smithi052.stdout:checking for rpmbuild... no 2024-04-25T22:53:44.178 INFO:tasks.workunit.client.0.smithi052.stdout:checking for ANSI C header files... (cached) yes 2024-04-25T22:53:44.230 INFO:tasks.workunit.client.0.smithi052.stdout:checking assert.h usability... yes 2024-04-25T22:53:44.235 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:44.235 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:53:44.235 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:53:44.235 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:53:44.235 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.236 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:53:44.236 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:44.236 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 116.266355093, 2024-04-25T22:53:44.236 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:53:44.236 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:44.236 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:44.236 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:44.236 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:44.236 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.236 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:44.236 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:44.236 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:44.236 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.237 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.237 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:44.237 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:44.237 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:44.237 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.237 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.237 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:44.237 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:53:44.237 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:53:44.237 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.237 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.237 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:44.237 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:53:44.237 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:53:44.238 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.238 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.238 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:44.238 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:53:44.238 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:53:44.238 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.238 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.238 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:44.238 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:53:44.238 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:53:44.239 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.239 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.239 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:44.239 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:53:44.239 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:53:44.239 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.239 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.239 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:44.239 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:53:44.239 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:53:44.239 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.240 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.240 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:44.240 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:53:44.240 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:53:44.240 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.240 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.240 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:44.240 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:53:44.240 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:53:44.240 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:44.240 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:44.240 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:44.240 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.240 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.241 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:44.241 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:44.241 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 111.22185939400001, 2024-04-25T22:53:44.241 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:53:44.241 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:44.241 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:44.241 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:44.241 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:44.241 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.241 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:44.241 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:44.241 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:44.242 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.242 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.242 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:44.242 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:44.242 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:44.242 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.242 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.242 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:44.242 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:53:44.242 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:53:44.242 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.242 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.242 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:44.243 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:53:44.243 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:53:44.243 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.243 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.243 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:44.243 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:53:44.243 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:53:44.243 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.243 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.243 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:44.243 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:53:44.243 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:53:44.243 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.243 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.243 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:44.244 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:53:44.244 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:53:44.244 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.244 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.244 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:44.244 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:53:44.244 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:53:44.244 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.244 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.244 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:44.244 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:53:44.244 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:53:44.244 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.244 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.245 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:44.245 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:53:44.245 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:53:44.245 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.245 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.245 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:44.245 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:53:44.245 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:53:44.245 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.245 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.245 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:44.245 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:53:44.245 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:53:44.245 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.246 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.246 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:44.246 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:53:44.246 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:53:44.246 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:44.246 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:44.246 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:44.246 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.246 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.246 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:44.246 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:44.246 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 111.221185018, 2024-04-25T22:53:44.247 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:53:44.247 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:44.247 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:44.247 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:44.247 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:44.247 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.247 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:44.247 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:44.247 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:44.247 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.247 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.247 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:44.247 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:44.247 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:44.248 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.248 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.248 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:44.248 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:53:44.248 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:53:44.248 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.248 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.248 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:44.248 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:53:44.248 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:53:44.248 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.248 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.248 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:44.249 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:53:44.249 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:53:44.249 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.249 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.249 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:44.249 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:53:44.249 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:53:44.249 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.249 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.249 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:44.249 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:53:44.249 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:53:44.249 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.249 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.250 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:44.250 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:53:44.250 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:53:44.250 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.250 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.250 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:44.250 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:53:44.250 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:53:44.250 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.250 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.250 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:44.250 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:53:44.251 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:53:44.251 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.251 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.251 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:44.251 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:53:44.251 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:53:44.251 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.251 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.251 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:44.251 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:53:44.251 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:53:44.251 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.251 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.252 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:44.252 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:53:44.252 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:53:44.252 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:44.252 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:44.252 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:44.252 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.252 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.252 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:44.252 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:44.252 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 111.220675806, 2024-04-25T22:53:44.252 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:53:44.252 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:44.252 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:44.253 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:44.253 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:44.253 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.253 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:44.253 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:44.253 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:44.253 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.253 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.253 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:44.253 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:44.253 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:44.253 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.253 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.253 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:44.253 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:53:44.254 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:53:44.254 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.254 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.254 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:44.254 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:53:44.254 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:53:44.254 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.254 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.254 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:44.254 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:53:44.254 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:53:44.254 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.254 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.255 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:44.255 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:53:44.255 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:53:44.255 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.255 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.255 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:44.255 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:53:44.255 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:53:44.255 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.255 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.255 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:44.255 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:53:44.255 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:53:44.255 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.256 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.256 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:44.256 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:53:44.256 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:53:44.256 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.256 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.256 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:44.256 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:53:44.256 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:53:44.256 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.256 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.256 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:44.256 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:53:44.256 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:53:44.257 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.257 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.257 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:44.257 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:53:44.257 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:53:44.257 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.257 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.257 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:44.257 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:53:44.257 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:53:44.257 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:44.257 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:44.257 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:44.257 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.258 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.258 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:44.258 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:44.258 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 111.220262608, 2024-04-25T22:53:44.258 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:53:44.258 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:44.258 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:44.258 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:44.258 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:44.258 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.258 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:44.258 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:44.258 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:44.259 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.259 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.259 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:44.259 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:44.259 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:44.259 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.259 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.259 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:44.259 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:44.259 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:53:44.259 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.259 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.259 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:44.259 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:44.260 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:53:44.260 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.260 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.260 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:44.260 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:53:44.260 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:53:44.260 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.260 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.260 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:44.260 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:53:44.260 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:53:44.260 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.260 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.260 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:44.260 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:53:44.261 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:53:44.261 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.261 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.261 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:44.261 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:53:44.261 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:53:44.261 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.261 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.261 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:44.261 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:53:44.261 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:53:44.261 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.261 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.261 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:44.262 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:53:44.262 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:53:44.262 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.262 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.262 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:44.262 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:53:44.262 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:53:44.262 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.262 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.262 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:44.262 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:53:44.262 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:53:44.262 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.262 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.263 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:44.263 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:53:44.263 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:53:44.263 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:44.263 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:44.263 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:44.263 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.263 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.263 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:44.263 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:44.263 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 111.22021193800001, 2024-04-25T22:53:44.263 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:53:44.263 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:44.263 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:44.264 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:44.264 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:44.264 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.264 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:44.264 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:44.264 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:44.264 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.264 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.264 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:44.264 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:44.264 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:44.264 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.264 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.264 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:44.265 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:53:44.265 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:53:44.265 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.265 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.265 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:44.265 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:53:44.265 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:53:44.265 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.265 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.265 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:44.265 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:53:44.265 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:53:44.265 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.265 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.266 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:44.266 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:53:44.266 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:53:44.266 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.266 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.266 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:44.266 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:53:44.266 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:53:44.266 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.266 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.266 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:44.266 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:53:44.266 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:53:44.267 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.267 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.267 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:44.267 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:53:44.267 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:53:44.267 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.267 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.267 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:44.267 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:53:44.267 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:53:44.267 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.267 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.267 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:44.268 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:53:44.268 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:53:44.268 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.268 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.268 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:44.268 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:53:44.268 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:53:44.268 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.268 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.268 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:44.268 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:53:44.268 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:53:44.268 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.269 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.269 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:44.269 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:53:44.269 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:53:44.269 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.269 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.269 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:44.269 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:53:44.269 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:53:44.269 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:44.269 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:44.269 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:44.269 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.269 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.270 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:44.270 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:44.270 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 111.22017506900001, 2024-04-25T22:53:44.270 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:53:44.270 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:44.270 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:44.270 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:44.270 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:44.270 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.270 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:44.270 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:44.270 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:44.270 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.270 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.271 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:44.271 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:44.271 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:44.271 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.271 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.271 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:44.271 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:53:44.271 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:53:44.271 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.271 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.271 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:44.271 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:53:44.271 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:53:44.271 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.272 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.272 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:44.272 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:53:44.272 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:53:44.272 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.272 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.272 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:44.272 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:53:44.272 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:53:44.272 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.272 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.272 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:44.272 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:53:44.272 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:53:44.272 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.273 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.273 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:53:44.273 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:53:44.273 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:53:44.273 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.273 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.273 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:44.273 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:53:44.273 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:53:44.273 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.273 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.273 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:44.273 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:53:44.273 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:53:44.274 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.274 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.274 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:44.274 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:53:44.274 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:53:44.274 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.274 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.274 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:44.274 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:53:44.274 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:53:44.274 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.274 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.274 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:44.274 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:53:44.275 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:53:44.275 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.275 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.275 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:44.275 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:53:44.275 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:53:44.275 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.275 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.275 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:44.275 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:53:44.275 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:53:44.275 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:44.276 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:44.276 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:44.276 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.276 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.276 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:44.276 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:44.276 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 111.22015010299999, 2024-04-25T22:53:44.276 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:53:44.276 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:44.276 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:44.276 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:44.276 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:44.276 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.276 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:44.277 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:44.277 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:44.277 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.277 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.277 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:44.277 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:44.277 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:44.277 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.277 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.277 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:44.277 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:53:44.277 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:53:44.277 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.277 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.277 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:44.278 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:53:44.278 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:53:44.278 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.278 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.278 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:44.278 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:44.278 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:53:44.278 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.278 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.278 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:44.278 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:53:44.278 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:53:44.278 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.279 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.279 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:44.279 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:53:44.279 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:53:44.279 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.279 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.279 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:44.279 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:53:44.279 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:53:44.279 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.279 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.279 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:44.279 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:53:44.279 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:53:44.280 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.280 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.280 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:44.280 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:53:44.280 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:53:44.280 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.280 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.280 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:44.280 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:53:44.280 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:53:44.280 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.280 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.280 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:44.280 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:53:44.281 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:53:44.281 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.281 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.281 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:44.281 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:53:44.281 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:53:44.281 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:44.281 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:44.281 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:44.281 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.281 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.281 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:44.281 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:44.282 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 111.220113739, 2024-04-25T22:53:44.282 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:53:44.282 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:44.282 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:44.282 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:44.282 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:44.282 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.282 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:44.282 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:44.282 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:44.282 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.282 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.282 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:44.282 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:44.283 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:44.283 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.283 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.283 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:44.283 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:53:44.283 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:53:44.283 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.283 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.283 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:44.283 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:53:44.283 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:53:44.283 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.283 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.283 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:44.284 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:53:44.284 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:53:44.284 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.284 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.284 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:44.284 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:53:44.284 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:53:44.284 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.284 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.284 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:44.284 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:53:44.284 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:53:44.284 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.285 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.285 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:44.285 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:53:44.285 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:53:44.285 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.285 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.285 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:44.285 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:53:44.285 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:53:44.285 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.285 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.285 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:44.286 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:53:44.286 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:53:44.286 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.286 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.286 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:44.286 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:53:44.286 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:53:44.286 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:44.286 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:44.286 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:44.286 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.286 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.286 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:44.286 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:44.287 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 111.220082658, 2024-04-25T22:53:44.287 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:53:44.287 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:44.287 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:44.287 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:44.287 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:44.287 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.287 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:44.287 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:44.287 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:44.287 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.287 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.287 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:44.287 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:44.288 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:44.288 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.288 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.288 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:44.288 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:44.288 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:44.288 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.288 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.288 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:44.288 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:53:44.288 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:53:44.288 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.288 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.289 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:44.289 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:53:44.289 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:53:44.289 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.289 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.289 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:44.289 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:53:44.289 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:53:44.289 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.289 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.289 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:44.289 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:53:44.289 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:53:44.289 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.290 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.290 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:44.290 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:53:44.290 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:53:44.290 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.290 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.290 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:44.290 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:53:44.290 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:53:44.290 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:44.290 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:44.290 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:44.290 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.290 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.291 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:30 4.31 4:8ebfc112:::1000000021d.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-25T22:53:44.291 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:53:44.291 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 13.180396787999999, 2024-04-25T22:53:44.291 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015003005, 2024-04-25T22:53:44.291 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:44.291 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:44.291 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:44.291 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:44.291 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:44.291 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:44.291 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 30 2024-04-25T22:53:44.291 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.291 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:44.291 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.292 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:44.292 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:53:44.292 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:44.292 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.292 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.292 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:44.292 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:53:44.292 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:44.292 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.292 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.292 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:44.292 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053133+0000", 2024-04-25T22:53:44.292 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0370000000000001e-06 2024-04-25T22:53:44.293 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.293 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.293 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:44.293 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060377+0000", 2024-04-25T22:53:44.293 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0072431070000000004 2024-04-25T22:53:44.293 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.293 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.293 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:44.293 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060388+0000", 2024-04-25T22:53:44.293 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1285e-05 2024-04-25T22:53:44.293 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.293 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.293 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:44.293 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060394+0000", 2024-04-25T22:53:44.293 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1040000000000003e-06 2024-04-25T22:53:44.294 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.294 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.294 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:44.294 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060483+0000", 2024-04-25T22:53:44.294 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.9345000000000006e-05 2024-04-25T22:53:44.294 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.294 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.294 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:44.294 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060566+0000", 2024-04-25T22:53:44.294 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2237999999999994e-05 2024-04-25T22:53:44.294 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.294 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.294 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:44.295 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068057+0000", 2024-04-25T22:53:44.295 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074912210000000002 2024-04-25T22:53:44.295 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.295 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.295 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:44.295 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068090+0000", 2024-04-25T22:53:44.295 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3501000000000003e-05 2024-04-25T22:53:44.295 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.295 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.295 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:44.295 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068134+0000", 2024-04-25T22:53:44.295 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4166999999999999e-05 2024-04-25T22:53:44.295 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:44.295 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:44.296 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:44.296 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.296 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.296 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:66 4.27 4:e5671758:::1000000024f.00000000:head [write 0~6641] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:44.296 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:44.296 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 12.920286451999999, 2024-04-25T22:53:44.296 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075166540000000002, 2024-04-25T22:53:44.296 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:44.296 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:44.296 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:44.296 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:44.296 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:44.296 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:44.296 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 66 2024-04-25T22:53:44.297 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.297 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:44.297 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.297 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:44.297 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:44.297 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:44.297 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.297 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.297 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:44.297 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:44.297 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:44.297 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.297 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.297 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:44.298 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:44.298 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4099999999999998e-07 2024-04-25T22:53:44.298 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.298 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.298 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:44.298 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313252+0000", 2024-04-25T22:53:44.298 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5380000000000008e-06 2024-04-25T22:53:44.298 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.298 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.298 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:44.298 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313260+0000", 2024-04-25T22:53:44.298 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2609999999999993e-06 2024-04-25T22:53:44.298 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.299 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.299 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:44.299 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313265+0000", 2024-04-25T22:53:44.299 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4850000000000003e-06 2024-04-25T22:53:44.299 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.299 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.299 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:44.299 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313310+0000", 2024-04-25T22:53:44.299 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5247999999999998e-05 2024-04-25T22:53:44.299 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.299 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.299 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:44.299 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313370+0000", 2024-04-25T22:53:44.299 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0275000000000001e-05 2024-04-25T22:53:44.300 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.300 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.300 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:44.300 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313435+0000", 2024-04-25T22:53:44.300 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4647000000000006e-05 2024-04-25T22:53:44.300 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.300 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.300 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:44.300 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314174+0000", 2024-04-25T22:53:44.300 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00073925 2024-04-25T22:53:44.300 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.300 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.300 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:44.300 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320688+0000", 2024-04-25T22:53:44.301 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.006513418 2024-04-25T22:53:44.301 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.301 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.301 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:44.301 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320736+0000", 2024-04-25T22:53:44.301 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.8114e-05 2024-04-25T22:53:44.301 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.301 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.301 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:44.301 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320758+0000", 2024-04-25T22:53:44.301 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2776999999999999e-05 2024-04-25T22:53:44.301 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:44.301 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:44.301 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:44.302 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.302 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.302 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:68 4.31 4:8fb7f7b7:::10000000251.00000000:head [write 0~2067] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:44.302 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:44.302 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 12.918600674, 2024-04-25T22:53:44.302 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0087011669999999992, 2024-04-25T22:53:44.302 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:44.302 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:44.302 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:44.302 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:44.302 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:44.302 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:44.302 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 68 2024-04-25T22:53:44.302 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.303 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:44.303 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.303 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:44.303 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:44.303 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:44.303 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.303 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.303 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:44.303 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:44.303 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:44.303 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.303 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.303 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:44.303 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:44.304 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:53:44.304 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.304 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.304 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:44.304 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314933+0000", 2024-04-25T22:53:44.304 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5430000000000004e-06 2024-04-25T22:53:44.304 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.304 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.304 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:44.304 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314944+0000", 2024-04-25T22:53:44.304 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.076e-05 2024-04-25T22:53:44.304 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.304 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.304 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:44.304 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314949+0000", 2024-04-25T22:53:44.305 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1019999999999996e-06 2024-04-25T22:53:44.305 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.305 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.305 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:44.305 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314996+0000", 2024-04-25T22:53:44.305 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7018999999999998e-05 2024-04-25T22:53:44.305 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.305 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.305 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:44.305 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315064+0000", 2024-04-25T22:53:44.305 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8738000000000005e-05 2024-04-25T22:53:44.305 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.305 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.305 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:44.306 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323531+0000", 2024-04-25T22:53:44.306 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084664739999999999 2024-04-25T22:53:44.306 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.306 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.306 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:44.306 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323574+0000", 2024-04-25T22:53:44.306 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3449999999999999e-05 2024-04-25T22:53:44.306 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.306 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.306 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:44.306 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323629+0000", 2024-04-25T22:53:44.306 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4296999999999999e-05 2024-04-25T22:53:44.306 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:44.307 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:44.307 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:44.307 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.307 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.307 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4734.0:69 4.32 e46/13 4:4e8c6251:::10000000252.00000000:head v 46'1, mlcod=0'0)", 2024-04-25T22:53:44.307 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:44.307 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 12.917569406, 2024-04-25T22:53:44.307 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076063240000000002, 2024-04-25T22:53:44.307 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:44.307 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:44.307 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:44.307 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:44.307 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.307 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:44.308 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:44.308 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:44.308 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.308 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.308 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:44.308 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:44.308 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:44.308 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.308 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.308 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:44.308 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:44.308 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3099999999999997e-07 2024-04-25T22:53:44.308 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.308 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.308 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:44.309 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315964+0000", 2024-04-25T22:53:44.309 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3229999999999999e-06 2024-04-25T22:53:44.309 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.309 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.309 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:44.309 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315973+0000", 2024-04-25T22:53:44.309 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7249999999999992e-06 2024-04-25T22:53:44.309 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.309 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.309 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:44.309 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315978+0000", 2024-04-25T22:53:44.309 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4830000000000001e-06 2024-04-25T22:53:44.309 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.310 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.310 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:44.310 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.316043+0000", 2024-04-25T22:53:44.310 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.5036000000000005e-05 2024-04-25T22:53:44.310 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.310 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.310 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:44.310 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.316055+0000", 2024-04-25T22:53:44.310 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1973999999999999e-05 2024-04-25T22:53:44.310 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.310 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.310 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:44.311 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323521+0000", 2024-04-25T22:53:44.311 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074660239999999999 2024-04-25T22:53:44.311 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.311 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.311 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:44.311 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323565+0000", 2024-04-25T22:53:44.311 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4128000000000002e-05 2024-04-25T22:53:44.311 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:44.311 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:44.311 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:44.311 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.311 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.311 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:72 4.36 4:6cdfec98:::10000000255.00000000:head [write 0~4131] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:44.311 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:44.313 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 12.915525494000001, 2024-04-25T22:53:44.313 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084820680000000006, 2024-04-25T22:53:44.313 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:44.313 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:44.313 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:44.313 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:44.313 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:44.314 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:44.314 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 72 2024-04-25T22:53:44.314 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.314 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:44.314 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.314 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:44.314 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:44.314 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:44.314 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.314 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.314 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:44.314 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:44.315 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:44.315 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.315 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.315 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:44.315 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:44.315 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1800000000000005e-07 2024-04-25T22:53:44.315 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.315 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.315 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:44.315 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318010+0000", 2024-04-25T22:53:44.315 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7399999999999998e-06 2024-04-25T22:53:44.315 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.315 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.315 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:44.316 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318019+0000", 2024-04-25T22:53:44.316 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0170000000000002e-06 2024-04-25T22:53:44.316 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.316 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.316 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:44.316 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318024+0000", 2024-04-25T22:53:44.316 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0150000000000003e-06 2024-04-25T22:53:44.316 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.316 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.316 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:44.316 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318075+0000", 2024-04-25T22:53:44.316 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0537000000000001e-05 2024-04-25T22:53:44.316 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.316 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.317 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:44.317 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318144+0000", 2024-04-25T22:53:44.317 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9432999999999997e-05 2024-04-25T22:53:44.317 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.317 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.317 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:44.317 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326392+0000", 2024-04-25T22:53:44.317 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0082482979999999994 2024-04-25T22:53:44.317 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.317 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.317 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:44.317 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326432+0000", 2024-04-25T22:53:44.317 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9870000000000003e-05 2024-04-25T22:53:44.317 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.318 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.318 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:44.318 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326485+0000", 2024-04-25T22:53:44.318 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2439999999999999e-05 2024-04-25T22:53:44.318 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:44.318 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:44.318 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:44.318 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.318 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.318 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:74 4.10 4:08e6f8ca:::10000000257.00000000:head [write 0~839] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:44.318 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:53:44.318 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 12.914051766, 2024-04-25T22:53:44.318 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070370720000000001, 2024-04-25T22:53:44.318 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:44.319 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:44.319 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:44.319 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:44.319 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:44.319 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:44.319 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 74 2024-04-25T22:53:44.319 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.319 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:44.319 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.319 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:44.319 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:53:44.319 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:44.319 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.319 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.320 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:44.320 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:53:44.320 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:44.320 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.320 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.320 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:44.320 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319477+0000", 2024-04-25T22:53:44.320 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1999999999999999e-07 2024-04-25T22:53:44.320 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.320 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.320 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:44.320 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319483+0000", 2024-04-25T22:53:44.320 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4260000000000002e-06 2024-04-25T22:53:44.320 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.320 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.321 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:44.321 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319494+0000", 2024-04-25T22:53:44.321 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.094e-05 2024-04-25T22:53:44.321 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.321 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.321 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:44.321 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319499+0000", 2024-04-25T22:53:44.321 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3789999999999997e-06 2024-04-25T22:53:44.321 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.321 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.321 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:44.321 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319545+0000", 2024-04-25T22:53:44.321 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6149000000000001e-05 2024-04-25T22:53:44.321 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.322 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.322 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:44.322 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319617+0000", 2024-04-25T22:53:44.322 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1792999999999995e-05 2024-04-25T22:53:44.322 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.322 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.322 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:44.322 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326406+0000", 2024-04-25T22:53:44.322 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067895999999999998 2024-04-25T22:53:44.322 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.322 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.322 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:44.322 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326443+0000", 2024-04-25T22:53:44.323 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6828e-05 2024-04-25T22:53:44.323 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.323 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.323 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:44.323 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326514+0000", 2024-04-25T22:53:44.323 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0236999999999999e-05 2024-04-25T22:53:44.323 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:44.323 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:44.323 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:44.323 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.323 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.323 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:128 3.1f 3:f83d65d8:::200.00000004:head [write 876784~3317520 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e48)", 2024-04-25T22:53:44.323 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:36.985410+0000", 2024-04-25T22:53:44.323 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 7.2481181479999996, 2024-04-25T22:53:44.324 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0090177360000000002, 2024-04-25T22:53:44.324 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:44.324 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:44.324 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:44.324 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:44.324 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.324 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:44.324 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.985410+0000", 2024-04-25T22:53:44.324 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:44.325 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.325 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.325 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:44.325 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.985410+0000", 2024-04-25T22:53:44.325 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:44.325 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.325 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.325 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:44.325 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.985411+0000", 2024-04-25T22:53:44.325 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8400000000000003e-07 2024-04-25T22:53:44.325 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.325 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.325 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:44.326 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989116+0000", 2024-04-25T22:53:44.326 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037047389999999999 2024-04-25T22:53:44.326 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.326 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.326 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:44.326 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989128+0000", 2024-04-25T22:53:44.326 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1977999999999999e-05 2024-04-25T22:53:44.326 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.326 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.326 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:44.326 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989135+0000", 2024-04-25T22:53:44.326 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5290000000000003e-06 2024-04-25T22:53:44.326 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.326 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.327 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:44.327 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989181+0000", 2024-04-25T22:53:44.327 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6122999999999999e-05 2024-04-25T22:53:44.327 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.327 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.327 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:44.327 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989250+0000", 2024-04-25T22:53:44.327 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8535999999999996e-05 2024-04-25T22:53:44.327 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.327 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.327 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:44.327 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.994272+0000", 2024-04-25T22:53:44.327 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050224889999999998 2024-04-25T22:53:44.327 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.327 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.328 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:44.328 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.994335+0000", 2024-04-25T22:53:44.328 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2588000000000005e-05 2024-04-25T22:53:44.328 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.328 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.328 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:44.328 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.994428+0000", 2024-04-25T22:53:44.328 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2869999999999997e-05 2024-04-25T22:53:44.328 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:44.328 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:44.328 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:44.328 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.328 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.328 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:2150 4.22 4:47cffac6:::10000000a2b.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T22:53:44.329 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:41.078233+0000", 2024-04-25T22:53:44.329 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 3.1552948380000001, 2024-04-25T22:53:44.329 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069201510000000003, 2024-04-25T22:53:44.329 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:44.329 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:44.329 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:44.329 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:44.329 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.329 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:44.329 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078233+0000", 2024-04-25T22:53:44.329 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:44.329 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.329 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.329 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:44.330 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078233+0000", 2024-04-25T22:53:44.330 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:44.330 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.330 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.330 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:44.330 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078234+0000", 2024-04-25T22:53:44.330 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1699999999999998e-07 2024-04-25T22:53:44.330 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.330 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.330 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:44.330 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078236+0000", 2024-04-25T22:53:44.330 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.875e-06 2024-04-25T22:53:44.330 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.331 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.331 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:44.331 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078242+0000", 2024-04-25T22:53:44.331 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2450000000000003e-06 2024-04-25T22:53:44.331 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.331 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.331 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:44.331 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078247+0000", 2024-04-25T22:53:44.331 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7450000000000003e-06 2024-04-25T22:53:44.331 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.331 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.331 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:44.331 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078641+0000", 2024-04-25T22:53:44.331 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00039420200000000002 2024-04-25T22:53:44.331 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.332 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.332 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:44.332 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078840+0000", 2024-04-25T22:53:44.332 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000199063 2024-04-25T22:53:44.332 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.332 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.332 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:44.332 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078919+0000", 2024-04-25T22:53:44.332 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9182000000000002e-05 2024-04-25T22:53:44.332 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.332 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.332 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:44.332 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.080906+0000", 2024-04-25T22:53:44.332 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0019866390000000001 2024-04-25T22:53:44.333 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.333 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.333 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:44.333 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085074+0000", 2024-04-25T22:53:44.333 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0041683639999999999 2024-04-25T22:53:44.333 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.333 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.333 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:44.333 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085117+0000", 2024-04-25T22:53:44.333 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2849999999999998e-05 2024-04-25T22:53:44.333 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.333 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.333 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:44.333 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085154+0000", 2024-04-25T22:53:44.334 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6468999999999999e-05 2024-04-25T22:53:44.334 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:44.334 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:44.334 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:44.334 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.334 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.334 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:2160 4.2a 4:57f9ed86:::10000000a3d.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T22:53:44.334 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:53:44.334 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 3.1548255479999998, 2024-04-25T22:53:44.334 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0068959959999999997, 2024-04-25T22:53:44.334 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:44.334 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:44.334 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:44.334 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:44.335 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.335 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:44.335 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:53:44.335 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:44.335 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.335 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.335 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:44.335 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:53:44.335 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:44.335 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.335 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.335 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:44.335 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:53:44.336 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7000000000000004e-07 2024-04-25T22:53:44.336 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.336 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.336 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:44.336 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078707+0000", 2024-04-25T22:53:44.336 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.783e-06 2024-04-25T22:53:44.336 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.337 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.337 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:44.337 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078716+0000", 2024-04-25T22:53:44.337 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4800000000000001e-06 2024-04-25T22:53:44.337 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.337 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.338 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:44.338 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078724+0000", 2024-04-25T22:53:44.338 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1519999999999992e-06 2024-04-25T22:53:44.338 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.338 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.338 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:44.338 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078794+0000", 2024-04-25T22:53:44.338 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0500999999999995e-05 2024-04-25T22:53:44.338 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.338 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.338 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:44.338 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078912+0000", 2024-04-25T22:53:44.338 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000117439 2024-04-25T22:53:44.339 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.339 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.339 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:44.339 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079000+0000", 2024-04-25T22:53:44.339 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8092999999999998e-05 2024-04-25T22:53:44.339 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.339 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.339 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:44.339 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.080897+0000", 2024-04-25T22:53:44.339 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0018970899999999999 2024-04-25T22:53:44.339 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.339 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.339 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:44.339 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085517+0000", 2024-04-25T22:53:44.340 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0046198929999999999 2024-04-25T22:53:44.340 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.340 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.340 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:44.340 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085565+0000", 2024-04-25T22:53:44.340 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7777e-05 2024-04-25T22:53:44.340 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.340 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.340 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:44.340 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085599+0000", 2024-04-25T22:53:44.340 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4017999999999999e-05 2024-04-25T22:53:44.340 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:44.340 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:44.341 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:44.341 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.341 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.341 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:2163 4.2a 4:549f79e3:::10000000a43.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T22:53:44.341 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:53:44.341 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 3.1547921950000002, 2024-04-25T22:53:44.341 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069469190000000002, 2024-04-25T22:53:44.341 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:44.341 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:44.341 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:44.341 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:44.341 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.341 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:44.341 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:53:44.342 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:44.342 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.342 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.342 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:44.342 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:53:44.342 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:44.342 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.342 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.342 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:44.342 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:53:44.342 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1399999999999997e-07 2024-04-25T22:53:44.342 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.342 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.342 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:44.343 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078739+0000", 2024-04-25T22:53:44.343 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2960000000000001e-06 2024-04-25T22:53:44.343 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.343 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.343 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:44.343 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078745+0000", 2024-04-25T22:53:44.343 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3439999999999997e-06 2024-04-25T22:53:44.343 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.343 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.343 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:44.343 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078750+0000", 2024-04-25T22:53:44.343 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3179999999999997e-06 2024-04-25T22:53:44.343 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.343 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.343 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:44.344 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079224+0000", 2024-04-25T22:53:44.344 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00047334999999999999 2024-04-25T22:53:44.344 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.344 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.344 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:44.344 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079292+0000", 2024-04-25T22:53:44.344 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8708999999999996e-05 2024-04-25T22:53:44.344 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.344 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.344 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:44.344 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079342+0000", 2024-04-25T22:53:44.344 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9299999999999999e-05 2024-04-25T22:53:44.344 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.344 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.345 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:44.345 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.081611+0000", 2024-04-25T22:53:44.345 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0022695229999999999 2024-04-25T22:53:44.345 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.345 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.345 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:44.345 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085605+0000", 2024-04-25T22:53:44.345 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0039933679999999997 2024-04-25T22:53:44.345 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.345 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.345 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:44.345 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085650+0000", 2024-04-25T22:53:44.345 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5111000000000002e-05 2024-04-25T22:53:44.345 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:44.346 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:44.346 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:44.346 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085683+0000", 2024-04-25T22:53:44.346 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3185999999999997e-05 2024-04-25T22:53:44.346 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:44.346 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:44.346 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:44.346 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:44.346 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:44.346 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:44.348 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:44.346+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:44.349 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:44.350 INFO:tasks.workunit.client.0.smithi052.stdout:checking assert.h presence... yes 2024-04-25T22:53:44.350 INFO:tasks.workunit.client.0.smithi052.stdout:checking for assert.h... yes 2024-04-25T22:53:44.351 INFO:tasks.workunit.client.0.smithi052.stdout:checking bstring.h usability... no 2024-04-25T22:53:44.351 INFO:tasks.workunit.client.0.smithi052.stdout:checking bstring.h presence... no 2024-04-25T22:53:44.351 INFO:tasks.workunit.client.0.smithi052.stdout:checking for bstring.h... no 2024-04-25T22:53:44.351 INFO:tasks.workunit.client.0.smithi052.stdout:checking libgen.h usability... yes 2024-04-25T22:53:44.357 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-25T22:53:44.365 INFO:tasks.workunit.client.0.smithi052.stdout:checking libgen.h presence... yes 2024-04-25T22:53:44.365 INFO:tasks.workunit.client.0.smithi052.stdout:checking for libgen.h... yes 2024-04-25T22:53:44.411 INFO:tasks.workunit.client.0.smithi052.stdout:checking dirent.h usability... yes 2024-04-25T22:53:44.425 INFO:tasks.workunit.client.0.smithi052.stdout:checking dirent.h presence... yes 2024-04-25T22:53:44.425 INFO:tasks.workunit.client.0.smithi052.stdout:checking for dirent.h... yes 2024-04-25T22:53:44.448 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:44.447+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:44.455 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:44.455 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:44.455 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-04-25T22:53:44.455 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:44.464 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:44.478 INFO:tasks.workunit.client.0.smithi052.stdout:checking errno.h usability... yes 2024-04-25T22:53:44.493 INFO:tasks.workunit.client.0.smithi052.stdout:checking errno.h presence... yes 2024-04-25T22:53:44.493 INFO:tasks.workunit.client.0.smithi052.stdout:checking for errno.h... yes 2024-04-25T22:53:44.538 INFO:tasks.workunit.client.0.smithi052.stdout:checking malloc.h usability... yes 2024-04-25T22:53:44.549 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:44.547+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:44.553 INFO:tasks.workunit.client.0.smithi052.stdout:checking malloc.h presence... yes 2024-04-25T22:53:44.553 INFO:tasks.workunit.client.0.smithi052.stdout:checking for malloc.h... yes 2024-04-25T22:53:44.568 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:44.568 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:44.568 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:53:44.568 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:53:44.568 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:44.576 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:44.599 INFO:tasks.workunit.client.0.smithi052.stdout:checking uuid.h usability... no 2024-04-25T22:53:44.621 INFO:tasks.workunit.client.0.smithi052.stdout:checking uuid.h presence... no 2024-04-25T22:53:44.621 INFO:tasks.workunit.client.0.smithi052.stdout:checking for uuid.h... no 2024-04-25T22:53:44.650 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:44.649+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:44.663 INFO:tasks.workunit.client.0.smithi052.stdout:checking uuid/uuid.h usability... yes 2024-04-25T22:53:44.679 INFO:tasks.workunit.client.0.smithi052.stdout:checking uuid/uuid.h presence... yes 2024-04-25T22:53:44.679 INFO:tasks.workunit.client.0.smithi052.stdout:checking for uuid/uuid.h... yes 2024-04-25T22:53:44.721 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:44.722 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-04-25T22:53:44.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-04-25T22:53:44.722 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:53:44.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.722 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:44.722 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:44.722 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 116.754893647, 2024-04-25T22:53:44.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010384338999999999, 2024-04-25T22:53:44.722 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:44.722 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:44.722 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:44.722 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:44.722 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:44.723 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:44.723 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-04-25T22:53:44.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.723 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:44.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:44.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:44.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:44.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:44.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:44.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:44.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:44.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:44.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3600000000000004e-07 2024-04-25T22:53:44.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:44.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965185+0000", 2024-04-25T22:53:44.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.117e-06 2024-04-25T22:53:44.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:44.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965192+0000", 2024-04-25T22:53:44.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3239999999999997e-06 2024-04-25T22:53:44.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:44.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965198+0000", 2024-04-25T22:53:44.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6370000000000004e-06 2024-04-25T22:53:44.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:44.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970973+0000", 2024-04-25T22:53:44.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057748239999999996 2024-04-25T22:53:44.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:44.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971049+0000", 2024-04-25T22:53:44.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6029e-05 2024-04-25T22:53:44.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:44.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971174+0000", 2024-04-25T22:53:44.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012462399999999999 2024-04-25T22:53:44.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:44.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971553+0000", 2024-04-25T22:53:44.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037896499999999999 2024-04-25T22:53:44.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:44.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975482+0000", 2024-04-25T22:53:44.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039297459999999996 2024-04-25T22:53:44.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:44.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975529+0000", 2024-04-25T22:53:44.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6387000000000002e-05 2024-04-25T22:53:44.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:44.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975563+0000", 2024-04-25T22:53:44.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4150000000000003e-05 2024-04-25T22:53:44.728 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:44.728 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:44.728 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:44.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.728 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:44.728 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:44.729 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 111.707847324, 2024-04-25T22:53:44.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012637705000000001, 2024-04-25T22:53:44.729 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:44.729 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:44.729 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:44.729 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:44.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:44.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:44.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:44.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:44.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:44.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:44.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:44.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012227+0000", 2024-04-25T22:53:44.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.863e-06 2024-04-25T22:53:44.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:44.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012236+0000", 2024-04-25T22:53:44.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1109999999999997e-06 2024-04-25T22:53:44.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:44.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012309+0000", 2024-04-25T22:53:44.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3242000000000001e-05 2024-04-25T22:53:44.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:44.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012324+0000", 2024-04-25T22:53:44.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4837e-05 2024-04-25T22:53:44.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:44.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015060+0000", 2024-04-25T22:53:44.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027363349999999999 2024-04-25T22:53:44.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:44.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015169+0000", 2024-04-25T22:53:44.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108372 2024-04-25T22:53:44.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:44.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015498+0000", 2024-04-25T22:53:44.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032949999999999999 2024-04-25T22:53:44.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:44.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021282+0000", 2024-04-25T22:53:44.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057836429999999998 2024-04-25T22:53:44.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:44.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024709+0000", 2024-04-25T22:53:44.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034271979999999998 2024-04-25T22:53:44.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:44.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024802+0000", 2024-04-25T22:53:44.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2960000000000004e-05 2024-04-25T22:53:44.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:44.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024863+0000", 2024-04-25T22:53:44.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0643999999999997e-05 2024-04-25T22:53:44.733 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:44.734 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:44.734 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:44.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.734 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:44.734 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:44.734 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 111.70772355299999, 2024-04-25T22:53:44.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012979447999999999, 2024-04-25T22:53:44.734 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:44.734 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:44.734 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:44.734 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:44.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:44.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:44.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:44.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:44.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:44.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:44.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:44.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:44.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:53:44.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:44.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012354+0000", 2024-04-25T22:53:44.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7740000000000004e-06 2024-04-25T22:53:44.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:44.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012365+0000", 2024-04-25T22:53:44.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.064e-05 2024-04-25T22:53:44.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:44.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012382+0000", 2024-04-25T22:53:44.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6999000000000001e-05 2024-04-25T22:53:44.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:44.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015958+0000", 2024-04-25T22:53:44.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035765699999999998 2024-04-25T22:53:44.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:44.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016037+0000", 2024-04-25T22:53:44.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8242000000000001e-05 2024-04-25T22:53:44.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:44.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016404+0000", 2024-04-25T22:53:44.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036784300000000002 2024-04-25T22:53:44.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:44.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021294+0000", 2024-04-25T22:53:44.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048890629999999999 2024-04-25T22:53:44.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:44.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024959+0000", 2024-04-25T22:53:44.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036651570000000001 2024-04-25T22:53:44.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:44.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025097+0000", 2024-04-25T22:53:44.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013788099999999999 2024-04-25T22:53:44.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:44.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025328+0000", 2024-04-25T22:53:44.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231492 2024-04-25T22:53:44.739 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:44.739 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:44.739 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:44.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.739 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:44.739 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:44.740 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 111.707635784, 2024-04-25T22:53:44.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013049827, 2024-04-25T22:53:44.740 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:44.740 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:44.740 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:44.740 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:44.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:44.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:44.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:44.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:44.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:44.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:44.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:44.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012437+0000", 2024-04-25T22:53:44.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-04-25T22:53:44.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:44.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012440+0000", 2024-04-25T22:53:44.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7609999999999999e-06 2024-04-25T22:53:44.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:44.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012449+0000", 2024-04-25T22:53:44.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.285e-06 2024-04-25T22:53:44.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:44.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012457+0000", 2024-04-25T22:53:44.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9510000000000006e-06 2024-04-25T22:53:44.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:44.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017106+0000", 2024-04-25T22:53:44.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046494220000000003 2024-04-25T22:53:44.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:44.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017223+0000", 2024-04-25T22:53:44.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116824 2024-04-25T22:53:44.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:44.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017345+0000", 2024-04-25T22:53:44.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122175 2024-04-25T22:53:44.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:44.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021299+0000", 2024-04-25T22:53:44.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039534879999999998 2024-04-25T22:53:44.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:44.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025398+0000", 2024-04-25T22:53:44.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040988960000000003 2024-04-25T22:53:44.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:44.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025439+0000", 2024-04-25T22:53:44.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0915999999999999e-05 2024-04-25T22:53:44.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:44.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025486+0000", 2024-04-25T22:53:44.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7534999999999998e-05 2024-04-25T22:53:44.745 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:44.745 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:44.745 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:44.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.745 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:44.745 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:44.745 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 111.707605633, 2024-04-25T22:53:44.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020988041999999998, 2024-04-25T22:53:44.745 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:44.745 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:44.745 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:44.746 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:44.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:44.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:44.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:44.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:44.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:44.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:44.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:44.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:44.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.99e-07 2024-04-25T22:53:44.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:44.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012470+0000", 2024-04-25T22:53:44.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2789999999999999e-06 2024-04-25T22:53:44.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:44.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012477+0000", 2024-04-25T22:53:44.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:53:44.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:44.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012500+0000", 2024-04-25T22:53:44.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2490999999999999e-05 2024-04-25T22:53:44.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:44.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021911+0000", 2024-04-25T22:53:44.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094114160000000006 2024-04-25T22:53:44.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:44.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022000+0000", 2024-04-25T22:53:44.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8601000000000001e-05 2024-04-25T22:53:44.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:44.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022359+0000", 2024-04-25T22:53:44.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035921999999999999 2024-04-25T22:53:44.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:44.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025541+0000", 2024-04-25T22:53:44.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031820619999999998 2024-04-25T22:53:44.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:44.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033375+0000", 2024-04-25T22:53:44.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078338379999999992 2024-04-25T22:53:44.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:44.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033415+0000", 2024-04-25T22:53:44.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9527000000000003e-05 2024-04-25T22:53:44.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:44.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033455+0000", 2024-04-25T22:53:44.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9932000000000003e-05 2024-04-25T22:53:44.751 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:44.751 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:44.751 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:44.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.751 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:44.751 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:44.751 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 111.70755044000001, 2024-04-25T22:53:44.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021043857999999999, 2024-04-25T22:53:44.751 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:44.751 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:44.751 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:44.751 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:44.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:44.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:44.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:44.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:44.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:44.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:44.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:44.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012523+0000", 2024-04-25T22:53:44.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.361e-06 2024-04-25T22:53:44.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:44.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012530+0000", 2024-04-25T22:53:44.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5440000000000004e-06 2024-04-25T22:53:44.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:44.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012541+0000", 2024-04-25T22:53:44.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1745e-05 2024-04-25T22:53:44.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:44.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012551+0000", 2024-04-25T22:53:44.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5789999999999993e-06 2024-04-25T22:53:44.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:44.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022709+0000", 2024-04-25T22:53:44.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010157685 2024-04-25T22:53:44.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:44.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022957+0000", 2024-04-25T22:53:44.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024824599999999998 2024-04-25T22:53:44.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:44.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023443+0000", 2024-04-25T22:53:44.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048578599999999999 2024-04-25T22:53:44.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:44.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025547+0000", 2024-04-25T22:53:44.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021044789999999998 2024-04-25T22:53:44.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:44.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033509+0000", 2024-04-25T22:53:44.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0079622180000000001 2024-04-25T22:53:44.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:44.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033542+0000", 2024-04-25T22:53:44.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3018000000000001e-05 2024-04-25T22:53:44.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:44.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033566+0000", 2024-04-25T22:53:44.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3197000000000002e-05 2024-04-25T22:53:44.756 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:44.756 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:44.756 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:44.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.756 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:44.757 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:44.757 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 111.70751047500001, 2024-04-25T22:53:44.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021122696, 2024-04-25T22:53:44.757 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:44.757 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:44.757 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:44.757 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:44.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:44.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:44.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:44.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:44.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:44.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:44.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:44.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:44.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:53:44.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:44.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012566+0000", 2024-04-25T22:53:44.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-04-25T22:53:44.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:44.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012619+0000", 2024-04-25T22:53:44.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2607e-05 2024-04-25T22:53:44.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:44.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012628+0000", 2024-04-25T22:53:44.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6500000000000008e-06 2024-04-25T22:53:44.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:44.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024024+0000", 2024-04-25T22:53:44.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011396007999999999 2024-04-25T22:53:44.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:44.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024198+0000", 2024-04-25T22:53:44.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000173215 2024-04-25T22:53:44.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:44.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024447+0000", 2024-04-25T22:53:44.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024898500000000002 2024-04-25T22:53:44.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:44.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026431+0000", 2024-04-25T22:53:44.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001984923 2024-04-25T22:53:44.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:44.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033608+0000", 2024-04-25T22:53:44.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071768459999999997 2024-04-25T22:53:44.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:44.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033646+0000", 2024-04-25T22:53:44.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299000000000003e-05 2024-04-25T22:53:44.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:44.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033684+0000", 2024-04-25T22:53:44.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8773000000000003e-05 2024-04-25T22:53:44.762 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:44.762 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:44.762 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:44.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.762 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:44.762 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:44.762 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 111.707421876, 2024-04-25T22:53:44.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021175381, 2024-04-25T22:53:44.762 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:44.762 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:44.762 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:44.762 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:44.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:44.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:44.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:44.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:44.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:44.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:44.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:44.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012651+0000", 2024-04-25T22:53:44.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:53:44.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:44.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012656+0000", 2024-04-25T22:53:44.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8899999999999998e-06 2024-04-25T22:53:44.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:44.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012666+0000", 2024-04-25T22:53:44.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0346999999999999e-05 2024-04-25T22:53:44.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:44.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012675+0000", 2024-04-25T22:53:44.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9930000000000001e-06 2024-04-25T22:53:44.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:44.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025661+0000", 2024-04-25T22:53:44.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01298531 2024-04-25T22:53:44.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:44.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025757+0000", 2024-04-25T22:53:44.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5822000000000005e-05 2024-04-25T22:53:44.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:44.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025907+0000", 2024-04-25T22:53:44.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015051499999999999 2024-04-25T22:53:44.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:44.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026435+0000", 2024-04-25T22:53:44.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052762200000000005 2024-04-25T22:53:44.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:44.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033732+0000", 2024-04-25T22:53:44.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072978419999999997 2024-04-25T22:53:44.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:44.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033787+0000", 2024-04-25T22:53:44.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4703999999999997e-05 2024-04-25T22:53:44.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:44.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033826+0000", 2024-04-25T22:53:44.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8458999999999999e-05 2024-04-25T22:53:44.767 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:44.767 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:44.767 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:44.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.767 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:44.767 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:44.767 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 111.707366462, 2024-04-25T22:53:44.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021244174000000001, 2024-04-25T22:53:44.768 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:44.768 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:44.768 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:44.768 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:44.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:44.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:44.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:44.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:44.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:44.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:44.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:44.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:44.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:44.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:44.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012712+0000", 2024-04-25T22:53:44.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.913e-06 2024-04-25T22:53:44.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:44.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012722+0000", 2024-04-25T22:53:44.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2879999999999998e-06 2024-04-25T22:53:44.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:44.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012727+0000", 2024-04-25T22:53:44.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8429999999999998e-06 2024-04-25T22:53:44.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:44.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026099+0000", 2024-04-25T22:53:44.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013371450999999999 2024-04-25T22:53:44.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:44.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026147+0000", 2024-04-25T22:53:44.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7837999999999998e-05 2024-04-25T22:53:44.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:44.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026254+0000", 2024-04-25T22:53:44.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107314 2024-04-25T22:53:44.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:44.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026686+0000", 2024-04-25T22:53:44.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000432428 2024-04-25T22:53:44.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:44.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033873+0000", 2024-04-25T22:53:44.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071864399999999997 2024-04-25T22:53:44.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:44.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033904+0000", 2024-04-25T22:53:44.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1321e-05 2024-04-25T22:53:44.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:44.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033950+0000", 2024-04-25T22:53:44.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5707999999999997e-05 2024-04-25T22:53:44.772 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:44.772 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:44.773 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:44.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.773 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:44.773 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:44.773 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 111.70733607699999, 2024-04-25T22:53:44.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01096505, 2024-04-25T22:53:44.773 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:44.773 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:44.773 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:44.773 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:44.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:44.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:44.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:44.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:44.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:44.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:44.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:44.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012737+0000", 2024-04-25T22:53:44.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:44.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:44.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012739+0000", 2024-04-25T22:53:44.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-04-25T22:53:44.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:44.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012743+0000", 2024-04-25T22:53:44.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3239999999999996e-06 2024-04-25T22:53:44.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:44.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012746+0000", 2024-04-25T22:53:44.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.129e-06 2024-04-25T22:53:44.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:44.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012796+0000", 2024-04-25T22:53:44.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9231999999999999e-05 2024-04-25T22:53:44.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:44.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012915+0000", 2024-04-25T22:53:44.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119021 2024-04-25T22:53:44.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:44.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013069+0000", 2024-04-25T22:53:44.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015463900000000001 2024-04-25T22:53:44.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:44.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019237+0000", 2024-04-25T22:53:44.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061680329999999998 2024-04-25T22:53:44.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:44.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023603+0000", 2024-04-25T22:53:44.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043655860000000003 2024-04-25T22:53:44.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:44.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023659+0000", 2024-04-25T22:53:44.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6484000000000003e-05 2024-04-25T22:53:44.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:44.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023701+0000", 2024-04-25T22:53:44.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1761999999999998e-05 2024-04-25T22:53:44.777 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:44.778 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:44.778 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:44.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.778 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:44.778 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:44.778 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 111.707311129, 2024-04-25T22:53:44.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011234429000000001, 2024-04-25T22:53:44.778 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:44.778 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:44.778 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:44.778 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:44.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:44.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:44.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:44.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:44.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:44.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:44.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:44.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012762+0000", 2024-04-25T22:53:44.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-04-25T22:53:44.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:44.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012765+0000", 2024-04-25T22:53:44.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2569999999999999e-06 2024-04-25T22:53:44.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:44.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012783+0000", 2024-04-25T22:53:44.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8431999999999999e-05 2024-04-25T22:53:44.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:44.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012799+0000", 2024-04-25T22:53:44.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5438999999999999e-05 2024-04-25T22:53:44.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:44.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013826+0000", 2024-04-25T22:53:44.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010275060000000001 2024-04-25T22:53:44.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:44.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013913+0000", 2024-04-25T22:53:44.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.708e-05 2024-04-25T22:53:44.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:44.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014098+0000", 2024-04-25T22:53:44.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018519399999999999 2024-04-25T22:53:44.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:44.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019684+0000", 2024-04-25T22:53:44.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055860079999999999 2024-04-25T22:53:44.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:44.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023876+0000", 2024-04-25T22:53:44.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041918800000000003 2024-04-25T22:53:44.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:44.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023957+0000", 2024-04-25T22:53:44.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1165e-05 2024-04-25T22:53:44.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:44.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023995+0000", 2024-04-25T22:53:44.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:53:44.783 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:44.783 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:44.783 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:44.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.783 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:44.783 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:44.783 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 111.70721335, 2024-04-25T22:53:44.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011131200000000001, 2024-04-25T22:53:44.783 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:44.783 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:44.784 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:44.784 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:44.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:44.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:44.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:44.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:44.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:44.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:44.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:44.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012860+0000", 2024-04-25T22:53:44.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3900000000000004e-07 2024-04-25T22:53:44.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:44.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012865+0000", 2024-04-25T22:53:44.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5609999999999998e-06 2024-04-25T22:53:44.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:44.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012895+0000", 2024-04-25T22:53:44.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9847000000000001e-05 2024-04-25T22:53:44.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:44.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012905+0000", 2024-04-25T22:53:44.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.03e-05 2024-04-25T22:53:44.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:44.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015020+0000", 2024-04-25T22:53:44.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021142940000000001 2024-04-25T22:53:44.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:44.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015182+0000", 2024-04-25T22:53:44.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016248099999999999 2024-04-25T22:53:44.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:44.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015357+0000", 2024-04-25T22:53:44.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017471000000000001 2024-04-25T22:53:44.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:44.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021021+0000", 2024-04-25T22:53:44.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056638340000000004 2024-04-25T22:53:44.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:44.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023712+0000", 2024-04-25T22:53:44.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026910380000000002 2024-04-25T22:53:44.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:44.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023763+0000", 2024-04-25T22:53:44.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1477999999999997e-05 2024-04-25T22:53:44.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:44.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023990+0000", 2024-04-25T22:53:44.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000226818 2024-04-25T22:53:44.788 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:44.788 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:44.788 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:44.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.788 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:44.788 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:44.788 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 111.70709025399999, 2024-04-25T22:53:44.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011705299000000001, 2024-04-25T22:53:44.789 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:44.789 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:44.789 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:44.789 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:44.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:44.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:44.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:44.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:44.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:44.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:44.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:44.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012983+0000", 2024-04-25T22:53:44.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:53:44.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:44.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012986+0000", 2024-04-25T22:53:44.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5700000000000001e-06 2024-04-25T22:53:44.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:44.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012993+0000", 2024-04-25T22:53:44.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8730000000000001e-06 2024-04-25T22:53:44.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:44.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013000+0000", 2024-04-25T22:53:44.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1890000000000001e-06 2024-04-25T22:53:44.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:44.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:53:44.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002147866 2024-04-25T22:53:44.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:44.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015351+0000", 2024-04-25T22:53:44.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020300799999999999 2024-04-25T22:53:44.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:44.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016260+0000", 2024-04-25T22:53:44.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00090926799999999997 2024-04-25T22:53:44.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:44.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022669+0000", 2024-04-25T22:53:44.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064082849999999997 2024-04-25T22:53:44.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:44.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024584+0000", 2024-04-25T22:53:44.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019151699999999999 2024-04-25T22:53:44.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:44.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024643+0000", 2024-04-25T22:53:44.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8888999999999998e-05 2024-04-25T22:53:44.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:44.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024687+0000", 2024-04-25T22:53:44.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4444999999999999e-05 2024-04-25T22:53:44.794 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:44.794 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:44.794 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:44.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.794 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:44.794 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:44.794 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 111.707062663, 2024-04-25T22:53:44.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011249699, 2024-04-25T22:53:44.794 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:44.794 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:44.794 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:44.794 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:44.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:44.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:44.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:44.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:44.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:44.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:44.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:44.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013010+0000", 2024-04-25T22:53:44.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2099999999999996e-07 2024-04-25T22:53:44.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:44.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013013+0000", 2024-04-25T22:53:44.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1310000000000002e-06 2024-04-25T22:53:44.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:44.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013020+0000", 2024-04-25T22:53:44.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3330000000000002e-06 2024-04-25T22:53:44.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:44.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013025+0000", 2024-04-25T22:53:44.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6760000000000004e-06 2024-04-25T22:53:44.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:44.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013163+0000", 2024-04-25T22:53:44.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013824599999999999 2024-04-25T22:53:44.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:44.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013504+0000", 2024-04-25T22:53:44.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034080299999999998 2024-04-25T22:53:44.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:44.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013613+0000", 2024-04-25T22:53:44.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108705 2024-04-25T22:53:44.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:44.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015831+0000", 2024-04-25T22:53:44.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002217672 2024-04-25T22:53:44.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:44.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024137+0000", 2024-04-25T22:53:44.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0083060489999999994 2024-04-25T22:53:44.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:44.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024218+0000", 2024-04-25T22:53:44.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1351000000000001e-05 2024-04-25T22:53:44.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:44.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024259+0000", 2024-04-25T22:53:44.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1112000000000002e-05 2024-04-25T22:53:44.799 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:44.799 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:44.799 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:44.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.799 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:44.799 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:44.799 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 111.706974937, 2024-04-25T22:53:44.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020379749999999999, 2024-04-25T22:53:44.800 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:44.800 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:44.800 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:44.800 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:44.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:44.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:44.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:44.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:44.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:44.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:44.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:44.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013098+0000", 2024-04-25T22:53:44.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:53:44.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:44.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013105+0000", 2024-04-25T22:53:44.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5969999999999997e-06 2024-04-25T22:53:44.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:44.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013190+0000", 2024-04-25T22:53:44.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5618999999999995e-05 2024-04-25T22:53:44.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:44.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013200+0000", 2024-04-25T22:53:44.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5859999999999994e-06 2024-04-25T22:53:44.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:44.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020265+0000", 2024-04-25T22:53:44.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070653349999999998 2024-04-25T22:53:44.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:44.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020454+0000", 2024-04-25T22:53:44.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189316 2024-04-25T22:53:44.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:44.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020586+0000", 2024-04-25T22:53:44.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013195700000000001 2024-04-25T22:53:44.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:44.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023822+0000", 2024-04-25T22:53:44.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032358529999999999 2024-04-25T22:53:44.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:44.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033409+0000", 2024-04-25T22:53:44.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095870520000000004 2024-04-25T22:53:44.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:44.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033447+0000", 2024-04-25T22:53:44.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7261999999999997e-05 2024-04-25T22:53:44.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:44.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033477+0000", 2024-04-25T22:53:44.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0389e-05 2024-04-25T22:53:44.805 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:44.805 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:44.805 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:44.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.805 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:44.805 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:44.805 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 111.706858431, 2024-04-25T22:53:44.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010857383999999999, 2024-04-25T22:53:44.805 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:44.805 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:44.805 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:44.805 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:44.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:44.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:44.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:44.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:44.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:44.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:44.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:44.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:44.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:44.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:44.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013218+0000", 2024-04-25T22:53:44.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8199999999999998e-06 2024-04-25T22:53:44.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:44.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013226+0000", 2024-04-25T22:53:44.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7649999999999993e-06 2024-04-25T22:53:44.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:44.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013259+0000", 2024-04-25T22:53:44.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2727e-05 2024-04-25T22:53:44.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:44.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014809+0000", 2024-04-25T22:53:44.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001550144 2024-04-25T22:53:44.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:44.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014958+0000", 2024-04-25T22:53:44.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014890300000000001 2024-04-25T22:53:44.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:44.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015087+0000", 2024-04-25T22:53:44.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012939200000000001 2024-04-25T22:53:44.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:44.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020212+0000", 2024-04-25T22:53:44.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051248939999999996 2024-04-25T22:53:44.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:44.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023699+0000", 2024-04-25T22:53:44.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034873289999999999 2024-04-25T22:53:44.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:44.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024014+0000", 2024-04-25T22:53:44.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031473999999999999 2024-04-25T22:53:44.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:44.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024071+0000", 2024-04-25T22:53:44.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7040000000000003e-05 2024-04-25T22:53:44.810 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:44.810 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:44.810 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:44.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.810 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:44.810 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:44.810 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 111.706803726, 2024-04-25T22:53:44.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012329677000000001, 2024-04-25T22:53:44.810 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:44.810 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:44.810 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:44.811 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:44.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:44.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:44.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:44.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:44.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:44.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:44.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:44.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013269+0000", 2024-04-25T22:53:44.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5000000000000002e-07 2024-04-25T22:53:44.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:44.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:44.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6909999999999999e-06 2024-04-25T22:53:44.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:44.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013284+0000", 2024-04-25T22:53:44.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0963e-05 2024-04-25T22:53:44.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:44.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013361+0000", 2024-04-25T22:53:44.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7379999999999994e-05 2024-04-25T22:53:44.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:44.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013448+0000", 2024-04-25T22:53:44.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6990000000000006e-05 2024-04-25T22:53:44.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:44.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013632+0000", 2024-04-25T22:53:44.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018396800000000001 2024-04-25T22:53:44.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:44.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013800+0000", 2024-04-25T22:53:44.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167467 2024-04-25T22:53:44.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:44.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.018570+0000", 2024-04-25T22:53:44.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047701460000000003 2024-04-25T22:53:44.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:44.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025507+0000", 2024-04-25T22:53:44.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069372039999999998 2024-04-25T22:53:44.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:44.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025562+0000", 2024-04-25T22:53:44.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4858999999999998e-05 2024-04-25T22:53:44.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:44.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025598+0000", 2024-04-25T22:53:44.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6259e-05 2024-04-25T22:53:44.815 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:44.815 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:44.815 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:44.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.815 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:44.815 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:44.815 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 111.706671853, 2024-04-25T22:53:44.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020176666999999999, 2024-04-25T22:53:44.815 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:44.816 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:44.816 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:53:44.816 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:44.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:44.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:44.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:44.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:44.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:44.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:44.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:44.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:44.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-04-25T22:53:44.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:44.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013405+0000", 2024-04-25T22:53:44.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0559999999999998e-06 2024-04-25T22:53:44.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:44.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013422+0000", 2024-04-25T22:53:44.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6770999999999999e-05 2024-04-25T22:53:44.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:44.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013431+0000", 2024-04-25T22:53:44.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5019999999999998e-06 2024-04-25T22:53:44.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:44.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021720+0000", 2024-04-25T22:53:44.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082884340000000008 2024-04-25T22:53:44.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:44.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022122+0000", 2024-04-25T22:53:44.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000401634 2024-04-25T22:53:44.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:44.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033577+0000", 2024-04-25T22:53:44.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011455435999999999 2024-04-25T22:53:44.819 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:44.819 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:44.819 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:44.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.819 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4734.0:31 4.1b 4:d9872866:::1000000021d.00000002:head [write 0~3618035] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-25T22:53:44.819 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:53:44.819 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.667097590999999, 2024-04-25T22:53:44.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011647062, 2024-04-25T22:53:44.819 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:44.819 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:44.819 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:44.820 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:44.820 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4734", 2024-04-25T22:53:44.820 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:44.820 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 31 2024-04-25T22:53:44.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.820 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:44.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:44.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:53:44.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:44.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:44.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:53:44.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:44.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:44.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:53:44.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5700000000000001e-07 2024-04-25T22:53:44.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:44.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059575+0000", 2024-04-25T22:53:44.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0065991380000000001 2024-04-25T22:53:44.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:44.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059586+0000", 2024-04-25T22:53:44.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1438e-05 2024-04-25T22:53:44.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.822 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:44.822 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059592+0000", 2024-04-25T22:53:44.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2899999999999999e-06 2024-04-25T22:53:44.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.822 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:44.822 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059660+0000", 2024-04-25T22:53:44.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7980999999999998e-05 2024-04-25T22:53:44.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.822 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:44.822 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059757+0000", 2024-04-25T22:53:44.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6340000000000003e-05 2024-04-25T22:53:44.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:44.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.064487+0000", 2024-04-25T22:53:44.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004730621 2024-04-25T22:53:44.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:44.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.064538+0000", 2024-04-25T22:53:44.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0801999999999999e-05 2024-04-25T22:53:44.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:44.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.064622+0000", 2024-04-25T22:53:44.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3595000000000002e-05 2024-04-25T22:53:44.823 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:44.824 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:44.824 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:44.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.824 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:97 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-25T22:53:44.824 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:53:33.026298+0000", 2024-04-25T22:53:44.824 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 11.693773777000001, 2024-04-25T22:53:44.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015641848999999999, 2024-04-25T22:53:44.824 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:44.824 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:44.824 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:44.824 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:44.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:44.824 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026298+0000", 2024-04-25T22:53:44.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:44.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:44.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026298+0000", 2024-04-25T22:53:44.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:44.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:44.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026299+0000", 2024-04-25T22:53:44.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7299999999999996e-07 2024-04-25T22:53:44.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:44.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026464+0000", 2024-04-25T22:53:44.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016477700000000001 2024-04-25T22:53:44.826 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.826 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.826 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:44.826 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026472+0000", 2024-04-25T22:53:44.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1589999999999993e-06 2024-04-25T22:53:44.826 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.826 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.826 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:44.826 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026476+0000", 2024-04-25T22:53:44.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4580000000000003e-06 2024-04-25T22:53:44.826 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.826 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.826 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:44.826 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026550+0000", 2024-04-25T22:53:44.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3836000000000003e-05 2024-04-25T22:53:44.827 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.827 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:44.827 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026644+0000", 2024-04-25T22:53:44.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4022000000000002e-05 2024-04-25T22:53:44.827 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.827 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:44.827 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.041838+0000", 2024-04-25T22:53:44.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015193814999999999 2024-04-25T22:53:44.827 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.828 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:44.828 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.041874+0000", 2024-04-25T22:53:44.828 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5856999999999999e-05 2024-04-25T22:53:44.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:44.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:44.828 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:44.828 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.041940+0000", 2024-04-25T22:53:44.828 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6352000000000004e-05 2024-04-25T22:53:44.828 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:44.828 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:44.828 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:44.828 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:44.828 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:44.828 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:44.830 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:44.831 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:44.829+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:44.831 INFO:tasks.workunit.client.0.smithi052.stdout:checking sys/uuid.h usability... no 2024-04-25T22:53:44.831 INFO:tasks.workunit.client.0.smithi052.stdout:checking sys/uuid.h presence... no 2024-04-25T22:53:44.832 INFO:tasks.workunit.client.0.smithi052.stdout:checking for sys/uuid.h... no 2024-04-25T22:53:44.832 INFO:tasks.workunit.client.0.smithi052.stdout:checking sys/file.h usability... yes 2024-04-25T22:53:44.832 INFO:tasks.workunit.client.0.smithi052.stdout:checking sys/file.h presence... yes 2024-04-25T22:53:44.832 INFO:tasks.workunit.client.0.smithi052.stdout:checking for sys/file.h... yes 2024-04-25T22:53:44.852 INFO:tasks.workunit.client.0.smithi052.stdout:checking sys/fcntl.h usability... yes 2024-04-25T22:53:44.867 INFO:tasks.workunit.client.0.smithi052.stdout:checking sys/fcntl.h presence... yes 2024-04-25T22:53:44.867 INFO:tasks.workunit.client.0.smithi052.stdout:checking for sys/fcntl.h... yes 2024-04-25T22:53:44.912 INFO:tasks.workunit.client.0.smithi052.stdout:checking sys/syssgi.h usability... no 2024-04-25T22:53:44.930 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:44.929+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:44.933 INFO:tasks.workunit.client.0.smithi052.stdout:checking sys/syssgi.h presence... no 2024-04-25T22:53:44.933 INFO:tasks.workunit.client.0.smithi052.stdout:checking for sys/syssgi.h... no 2024-04-25T22:53:44.937 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:44.937 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:44.937 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-25T22:53:44.937 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:44.946 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:44.993 INFO:tasks.workunit.client.0.smithi052.stdout:checking sys/param.h usability... yes 2024-04-25T22:53:45.010 INFO:tasks.workunit.client.0.smithi052.stdout:checking sys/param.h presence... yes 2024-04-25T22:53:45.010 INFO:tasks.workunit.client.0.smithi052.stdout:checking for sys/param.h... yes 2024-04-25T22:53:45.021 INFO:tasks.workunit.client.0.smithi052.stdout:checking for sys/stat.h... (cached) yes 2024-04-25T22:53:45.030 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:45.029+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:45.050 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:45.051 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:45.051 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-25T22:53:45.051 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-25T22:53:45.051 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:45.060 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:45.063 INFO:tasks.workunit.client.0.smithi052.stdout:checking sys/statvfs.h usability... yes 2024-04-25T22:53:45.076 INFO:tasks.workunit.client.0.smithi052.stdout:checking sys/statvfs.h presence... yes 2024-04-25T22:53:45.076 INFO:tasks.workunit.client.0.smithi052.stdout:checking for sys/statvfs.h... yes 2024-04-25T22:53:45.120 INFO:tasks.workunit.client.0.smithi052.stdout:checking sys/time.h usability... yes 2024-04-25T22:53:45.135 INFO:tasks.workunit.client.0.smithi052.stdout:checking sys/time.h presence... yes 2024-04-25T22:53:45.135 INFO:tasks.workunit.client.0.smithi052.stdout:checking for sys/time.h... yes 2024-04-25T22:53:45.144 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:45.143+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:45.178 INFO:tasks.workunit.client.0.smithi052.stdout:checking sys/ioctl.h usability... yes 2024-04-25T22:53:45.192 INFO:tasks.workunit.client.0.smithi052.stdout:checking sys/ioctl.h presence... yes 2024-04-25T22:53:45.192 INFO:tasks.workunit.client.0.smithi052.stdout:checking for sys/ioctl.h... yes 2024-04-25T22:53:45.205 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:45.205 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:53:45.206 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:53:45.206 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:53:45.206 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.206 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:53:45.206 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:45.206 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 117.236918051, 2024-04-25T22:53:45.206 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:53:45.206 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:45.206 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:45.206 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:45.206 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:45.206 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.206 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:45.207 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:45.207 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:45.207 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.207 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.207 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:45.207 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:45.207 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:45.207 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.207 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.207 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:45.207 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:53:45.207 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:53:45.207 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.208 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.208 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:45.208 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:53:45.208 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:53:45.208 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.208 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.208 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:45.208 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:53:45.208 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:53:45.208 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.208 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.208 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:45.208 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:53:45.208 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:53:45.208 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.209 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.209 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:45.209 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:53:45.209 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:53:45.209 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.209 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.209 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:45.209 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:53:45.209 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:53:45.209 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.209 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.209 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:45.209 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:53:45.209 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:53:45.210 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.210 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.210 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:45.210 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:53:45.210 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:53:45.210 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:45.210 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:45.210 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:45.210 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.210 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.210 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:45.210 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:45.210 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 112.19242235199999, 2024-04-25T22:53:45.210 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:53:45.211 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:45.211 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:45.211 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:45.211 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:45.211 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.211 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:45.211 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:45.211 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:45.211 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.211 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.211 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:45.211 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:45.211 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:45.211 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.211 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.212 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:45.212 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:53:45.212 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:53:45.212 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.212 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.212 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:45.212 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:53:45.212 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:53:45.212 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.212 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.212 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:45.212 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:53:45.212 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:53:45.212 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.213 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.213 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:45.213 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:53:45.213 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:53:45.213 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.213 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.213 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:45.213 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:53:45.213 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:53:45.213 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.213 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.213 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:45.213 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:53:45.213 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:53:45.213 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.214 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.214 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:45.214 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:53:45.214 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:53:45.214 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.214 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.214 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:45.214 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:53:45.214 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:53:45.214 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.214 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.214 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:45.214 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:53:45.215 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:53:45.215 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.215 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.215 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:45.215 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:53:45.215 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:53:45.215 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.215 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.215 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:45.215 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:53:45.215 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:53:45.215 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:45.215 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:45.215 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:45.215 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.216 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.216 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:45.216 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:45.216 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 112.191747976, 2024-04-25T22:53:45.216 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:53:45.216 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:45.216 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:45.216 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:45.216 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:45.216 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.216 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:45.216 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:45.216 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:45.217 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.217 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.217 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:45.217 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:45.217 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:45.217 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.217 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.217 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:45.217 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:53:45.217 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:53:45.217 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.217 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.217 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:45.217 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:53:45.217 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:53:45.218 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.218 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.218 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:45.218 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:53:45.218 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:53:45.218 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.218 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.218 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:45.218 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:53:45.218 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:53:45.218 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.218 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.218 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:45.218 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:53:45.219 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:53:45.219 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.219 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.219 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:45.219 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:53:45.219 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:53:45.219 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.219 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.219 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:45.219 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:53:45.219 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:53:45.219 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.219 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.219 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:45.220 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:53:45.220 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:53:45.220 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.220 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.220 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:45.220 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:53:45.220 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:53:45.220 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.220 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.220 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:45.220 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:53:45.220 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:53:45.220 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.220 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.220 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:45.220 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:53:45.221 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:53:45.221 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:45.221 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:45.221 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:45.221 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.221 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.221 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:45.221 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:45.221 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 112.191238764, 2024-04-25T22:53:45.221 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:53:45.221 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:45.221 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:45.221 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:45.221 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:45.221 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.221 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:45.222 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:45.222 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:45.222 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.222 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.222 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:45.222 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:45.222 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:45.222 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.222 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.222 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:45.222 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:53:45.222 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:53:45.222 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.222 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.223 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:45.223 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:53:45.223 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:53:45.223 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.223 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.223 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:45.223 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:53:45.223 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:53:45.223 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.223 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.223 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:45.223 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:53:45.223 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:53:45.223 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.223 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.224 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:45.224 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:53:45.224 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:53:45.224 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.224 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.224 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:45.224 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:53:45.224 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:53:45.224 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.224 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.224 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:45.224 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:53:45.224 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:53:45.224 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.224 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.225 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:45.225 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:53:45.225 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:53:45.225 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.225 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.225 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:45.225 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:53:45.225 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:53:45.225 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.225 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.225 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:45.225 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:53:45.225 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:53:45.225 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.226 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.226 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:45.226 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:53:45.226 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:53:45.226 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:45.226 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:45.226 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:45.226 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.226 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.226 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:45.226 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:45.226 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 112.190825566, 2024-04-25T22:53:45.226 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:53:45.226 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:45.227 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:45.227 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:45.227 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:45.227 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.227 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:45.227 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:45.227 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:45.227 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.227 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.227 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:45.227 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:45.227 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:45.227 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.227 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.227 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:45.228 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:45.228 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:53:45.228 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.228 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.228 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:45.228 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:45.228 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:53:45.228 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.228 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.228 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:45.228 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:53:45.228 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:53:45.228 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.228 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.228 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:45.229 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:53:45.229 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:53:45.229 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.229 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.229 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:45.229 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:53:45.229 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:53:45.229 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.229 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.229 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:45.229 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:53:45.229 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:53:45.229 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.229 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.229 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:45.230 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:53:45.230 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:53:45.230 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.230 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.230 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:45.230 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:53:45.230 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:53:45.230 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.230 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.230 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:45.230 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:53:45.230 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:53:45.230 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.230 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.231 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:45.231 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:53:45.231 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:53:45.231 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.231 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.231 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:45.231 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:53:45.231 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:53:45.231 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:45.231 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:45.231 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:45.231 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.231 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.231 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:45.231 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:45.231 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 112.19077489599999, 2024-04-25T22:53:45.232 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:53:45.232 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:45.232 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:45.232 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:45.232 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:45.232 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.232 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:45.232 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:45.232 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:45.232 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.232 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.232 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:45.232 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:45.232 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:45.232 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.232 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.233 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:45.233 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:53:45.233 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:53:45.233 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.233 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.233 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:45.233 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:53:45.233 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:53:45.233 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.233 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.233 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:45.233 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:53:45.233 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:53:45.233 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.234 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.234 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:45.234 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:53:45.234 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:53:45.234 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.234 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.234 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:45.234 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:53:45.234 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:53:45.234 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.234 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.234 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:45.234 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:53:45.234 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:53:45.235 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.235 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.235 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:45.235 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:53:45.235 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:53:45.235 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.235 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.235 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:45.235 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:53:45.235 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:53:45.235 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.235 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.235 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:45.235 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:53:45.236 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:53:45.236 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.236 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.236 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:45.236 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:53:45.236 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:53:45.236 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.236 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.236 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:45.236 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:53:45.236 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:53:45.236 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.236 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.236 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:45.236 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:53:45.237 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:53:45.237 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.237 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.237 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:45.237 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:53:45.237 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:53:45.237 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:45.237 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:45.237 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:45.237 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.237 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.237 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:45.237 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:45.237 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 112.19073802699999, 2024-04-25T22:53:45.237 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:53:45.237 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:45.238 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:45.238 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:45.238 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:45.238 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.238 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:45.238 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:45.238 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:45.238 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.238 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.238 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:45.238 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:45.238 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:45.238 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.238 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.239 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:45.239 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:53:45.239 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:53:45.239 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.239 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.239 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:45.239 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:53:45.239 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:53:45.239 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.239 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.239 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:45.239 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:53:45.239 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:53:45.239 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.239 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.240 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:45.240 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:53:45.240 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:53:45.240 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.240 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.240 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:45.240 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:53:45.240 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:53:45.240 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.240 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.240 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:53:45.240 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:53:45.240 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:53:45.240 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.241 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.241 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:45.241 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:53:45.241 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:53:45.241 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.241 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.241 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:45.241 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:53:45.241 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:53:45.241 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.241 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.241 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:45.241 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:53:45.241 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:53:45.241 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.241 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.242 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:45.242 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:53:45.242 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:53:45.242 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.242 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.242 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:45.242 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:53:45.242 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:53:45.242 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.242 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.242 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:45.242 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:53:45.242 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:53:45.242 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.243 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.243 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:45.243 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:53:45.243 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:53:45.243 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:45.243 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:45.243 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:45.243 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.243 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.243 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:45.243 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:45.243 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 112.190713061, 2024-04-25T22:53:45.243 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:53:45.243 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:45.243 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:45.244 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:45.244 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:45.244 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.244 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:45.244 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:45.244 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:45.244 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.244 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.244 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:45.244 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:45.244 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:45.244 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.244 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.244 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:45.244 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:53:45.245 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:53:45.245 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.245 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.245 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:45.245 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:53:45.245 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:53:45.245 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.245 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.245 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:45.245 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:45.245 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:53:45.245 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.245 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.245 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:45.246 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:53:45.246 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:53:45.246 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.246 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.246 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:45.246 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:53:45.246 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:53:45.246 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.246 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.246 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:45.246 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:53:45.246 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:53:45.246 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.246 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.247 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:45.247 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:53:45.247 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:53:45.247 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.247 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.247 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:45.247 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:53:45.247 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:53:45.247 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.247 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.247 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:45.247 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:53:45.247 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:53:45.247 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.247 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.248 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:45.248 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:53:45.248 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:53:45.248 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.248 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.248 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:45.248 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:53:45.248 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:53:45.248 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:45.248 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:45.248 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:45.248 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.248 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.248 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:45.249 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:45.249 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 112.190676697, 2024-04-25T22:53:45.249 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:53:45.249 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:45.249 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:45.249 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:45.249 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:45.249 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.249 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:45.249 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:45.249 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:45.249 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.249 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.249 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:45.250 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:45.250 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:45.250 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.250 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.250 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:45.250 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:53:45.250 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:53:45.250 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.250 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.250 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:45.250 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:53:45.250 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:53:45.250 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.250 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.250 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:45.251 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:53:45.251 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:53:45.251 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.251 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.251 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:45.251 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:53:45.251 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:53:45.251 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.251 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.251 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:45.251 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:53:45.251 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:53:45.251 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.251 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.251 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:45.252 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:53:45.252 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:53:45.252 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.252 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.252 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:45.252 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:53:45.252 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:53:45.252 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.252 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.252 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:45.252 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:53:45.252 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:53:45.252 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.252 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.252 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:45.253 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:53:45.253 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:53:45.253 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:45.253 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:45.253 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:45.253 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.253 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.253 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:45.253 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:45.253 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 112.190645616, 2024-04-25T22:53:45.253 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:53:45.253 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:45.253 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:45.253 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:45.253 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:45.254 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.254 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:45.254 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:45.254 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:45.254 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.254 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.254 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:45.254 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:45.254 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:45.254 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.254 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.254 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:45.254 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:45.254 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:45.254 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.255 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.255 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:45.255 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:53:45.255 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:53:45.255 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.255 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.255 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:45.255 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:53:45.255 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:53:45.255 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.255 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.255 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:45.255 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:53:45.255 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:53:45.256 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.256 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.256 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:45.256 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:53:45.256 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:53:45.256 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.256 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.256 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:45.256 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:53:45.256 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:53:45.256 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.256 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.256 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:45.256 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:53:45.256 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:53:45.257 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:45.257 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:45.257 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:45.257 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.257 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.257 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:30 4.31 4:8ebfc112:::1000000021d.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-25T22:53:45.257 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:53:45.257 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 14.150959746, 2024-04-25T22:53:45.257 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015003005, 2024-04-25T22:53:45.257 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:45.257 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:45.257 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:45.257 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:45.257 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:45.257 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:45.258 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 30 2024-04-25T22:53:45.258 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.258 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:45.258 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.258 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:45.258 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:53:45.258 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:45.258 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.258 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.258 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:45.258 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:53:45.258 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:45.258 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.258 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.259 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:45.259 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053133+0000", 2024-04-25T22:53:45.259 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0370000000000001e-06 2024-04-25T22:53:45.259 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.259 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.259 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:45.259 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060377+0000", 2024-04-25T22:53:45.259 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0072431070000000004 2024-04-25T22:53:45.259 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.259 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.259 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:45.259 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060388+0000", 2024-04-25T22:53:45.259 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1285e-05 2024-04-25T22:53:45.259 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.259 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.260 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:45.260 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060394+0000", 2024-04-25T22:53:45.260 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1040000000000003e-06 2024-04-25T22:53:45.260 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.260 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.260 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:45.260 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060483+0000", 2024-04-25T22:53:45.260 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.9345000000000006e-05 2024-04-25T22:53:45.260 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.260 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.260 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:45.260 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060566+0000", 2024-04-25T22:53:45.260 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2237999999999994e-05 2024-04-25T22:53:45.261 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.261 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.261 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:45.261 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068057+0000", 2024-04-25T22:53:45.261 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074912210000000002 2024-04-25T22:53:45.261 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.261 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.261 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:45.261 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068090+0000", 2024-04-25T22:53:45.261 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3501000000000003e-05 2024-04-25T22:53:45.261 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.261 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.261 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:45.261 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068134+0000", 2024-04-25T22:53:45.261 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4166999999999999e-05 2024-04-25T22:53:45.262 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:45.262 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:45.262 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:45.262 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.262 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.262 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:66 4.27 4:e5671758:::1000000024f.00000000:head [write 0~6641] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:45.262 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:45.262 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 13.89084941, 2024-04-25T22:53:45.262 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075166540000000002, 2024-04-25T22:53:45.262 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:45.262 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:45.262 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:45.263 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:45.263 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:45.263 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:45.263 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 66 2024-04-25T22:53:45.263 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.263 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:45.263 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.263 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:45.263 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:45.263 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:45.263 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.263 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.263 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:45.263 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:45.263 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:45.264 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.264 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.264 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:45.264 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:45.264 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4099999999999998e-07 2024-04-25T22:53:45.264 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.264 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.264 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:45.264 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313252+0000", 2024-04-25T22:53:45.264 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5380000000000008e-06 2024-04-25T22:53:45.264 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.264 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.264 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:45.264 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313260+0000", 2024-04-25T22:53:45.264 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2609999999999993e-06 2024-04-25T22:53:45.265 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.265 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.265 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:45.265 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313265+0000", 2024-04-25T22:53:45.265 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4850000000000003e-06 2024-04-25T22:53:45.265 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.265 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.265 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:45.265 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313310+0000", 2024-04-25T22:53:45.265 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5247999999999998e-05 2024-04-25T22:53:45.265 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.265 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.265 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:45.265 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313370+0000", 2024-04-25T22:53:45.265 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0275000000000001e-05 2024-04-25T22:53:45.266 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.266 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.266 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:45.266 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313435+0000", 2024-04-25T22:53:45.266 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4647000000000006e-05 2024-04-25T22:53:45.266 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.266 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.266 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:45.266 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314174+0000", 2024-04-25T22:53:45.266 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00073925 2024-04-25T22:53:45.266 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.266 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.266 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:45.267 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320688+0000", 2024-04-25T22:53:45.267 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.006513418 2024-04-25T22:53:45.267 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.267 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.267 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:45.267 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320736+0000", 2024-04-25T22:53:45.267 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.8114e-05 2024-04-25T22:53:45.267 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.267 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.267 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:45.267 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320758+0000", 2024-04-25T22:53:45.267 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2776999999999999e-05 2024-04-25T22:53:45.267 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:45.267 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:45.267 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:45.268 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.268 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.268 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:68 4.31 4:8fb7f7b7:::10000000251.00000000:head [write 0~2067] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:45.268 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:45.268 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 13.889163632000001, 2024-04-25T22:53:45.268 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0087011669999999992, 2024-04-25T22:53:45.268 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:45.268 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:45.268 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:45.268 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:45.268 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:45.268 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:45.268 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 68 2024-04-25T22:53:45.268 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.269 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:45.269 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.269 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:45.269 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:45.269 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:45.269 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.269 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.269 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:45.269 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:45.269 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:45.269 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.269 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.269 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:45.269 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:45.269 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:53:45.270 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.270 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.270 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:45.270 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314933+0000", 2024-04-25T22:53:45.270 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5430000000000004e-06 2024-04-25T22:53:45.270 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.270 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.270 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:45.270 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314944+0000", 2024-04-25T22:53:45.270 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.076e-05 2024-04-25T22:53:45.270 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.270 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.270 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:45.270 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314949+0000", 2024-04-25T22:53:45.271 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1019999999999996e-06 2024-04-25T22:53:45.271 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.271 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.271 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:45.271 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314996+0000", 2024-04-25T22:53:45.271 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7018999999999998e-05 2024-04-25T22:53:45.271 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.271 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.271 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:45.271 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315064+0000", 2024-04-25T22:53:45.271 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8738000000000005e-05 2024-04-25T22:53:45.271 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.271 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.271 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:45.271 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323531+0000", 2024-04-25T22:53:45.272 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084664739999999999 2024-04-25T22:53:45.272 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.272 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.272 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:45.272 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323574+0000", 2024-04-25T22:53:45.272 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3449999999999999e-05 2024-04-25T22:53:45.272 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.272 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.272 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:45.272 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323629+0000", 2024-04-25T22:53:45.272 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4296999999999999e-05 2024-04-25T22:53:45.272 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:45.272 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:45.272 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:45.272 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.273 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.273 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4734.0:69 4.32 e46/13 4:4e8c6251:::10000000252.00000000:head v 46'1, mlcod=0'0)", 2024-04-25T22:53:45.273 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:45.273 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 13.888132364000001, 2024-04-25T22:53:45.273 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076063240000000002, 2024-04-25T22:53:45.273 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:45.273 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:45.273 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:45.273 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:45.273 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.273 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:45.273 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:45.273 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:45.273 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.273 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.274 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:45.274 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:45.274 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:45.274 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.274 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.274 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:45.274 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:45.274 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3099999999999997e-07 2024-04-25T22:53:45.274 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.274 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.274 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:45.274 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315964+0000", 2024-04-25T22:53:45.274 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3229999999999999e-06 2024-04-25T22:53:45.274 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.275 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.275 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:45.275 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315973+0000", 2024-04-25T22:53:45.275 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7249999999999992e-06 2024-04-25T22:53:45.275 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.275 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.275 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:45.275 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315978+0000", 2024-04-25T22:53:45.275 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4830000000000001e-06 2024-04-25T22:53:45.275 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.275 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.275 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:45.275 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.316043+0000", 2024-04-25T22:53:45.275 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.5036000000000005e-05 2024-04-25T22:53:45.276 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.276 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.276 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:45.276 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.316055+0000", 2024-04-25T22:53:45.276 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1973999999999999e-05 2024-04-25T22:53:45.276 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.276 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.276 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:45.276 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323521+0000", 2024-04-25T22:53:45.276 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074660239999999999 2024-04-25T22:53:45.276 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.276 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.276 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:45.276 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323565+0000", 2024-04-25T22:53:45.277 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4128000000000002e-05 2024-04-25T22:53:45.277 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:45.277 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:45.277 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:45.277 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.277 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.277 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:72 4.36 4:6cdfec98:::10000000255.00000000:head [write 0~4131] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:45.277 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:45.277 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 13.886088451999999, 2024-04-25T22:53:45.277 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084820680000000006, 2024-04-25T22:53:45.277 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:45.277 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:45.277 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:45.277 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:45.278 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:45.278 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:45.278 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 72 2024-04-25T22:53:45.278 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.278 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:45.278 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.278 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:45.278 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:45.278 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:45.278 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.278 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.278 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:45.278 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:45.278 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:45.279 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.279 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.279 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:45.279 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:45.279 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1800000000000005e-07 2024-04-25T22:53:45.279 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.279 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.279 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:45.279 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318010+0000", 2024-04-25T22:53:45.279 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7399999999999998e-06 2024-04-25T22:53:45.279 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.279 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.279 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:45.279 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318019+0000", 2024-04-25T22:53:45.280 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0170000000000002e-06 2024-04-25T22:53:45.280 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.280 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.280 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:45.280 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318024+0000", 2024-04-25T22:53:45.280 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0150000000000003e-06 2024-04-25T22:53:45.280 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.280 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.280 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:45.280 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318075+0000", 2024-04-25T22:53:45.280 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0537000000000001e-05 2024-04-25T22:53:45.280 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.280 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.280 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:45.281 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318144+0000", 2024-04-25T22:53:45.281 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9432999999999997e-05 2024-04-25T22:53:45.281 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.281 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.281 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:45.281 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326392+0000", 2024-04-25T22:53:45.281 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0082482979999999994 2024-04-25T22:53:45.281 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.281 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.281 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:45.281 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326432+0000", 2024-04-25T22:53:45.281 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9870000000000003e-05 2024-04-25T22:53:45.281 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.281 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.281 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:45.282 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326485+0000", 2024-04-25T22:53:45.282 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2439999999999999e-05 2024-04-25T22:53:45.282 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:45.282 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:45.282 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:45.282 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.282 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.282 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:74 4.10 4:08e6f8ca:::10000000257.00000000:head [write 0~839] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:45.282 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:53:45.282 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 13.884614724, 2024-04-25T22:53:45.282 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070370720000000001, 2024-04-25T22:53:45.282 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:45.282 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:45.283 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:45.283 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:45.283 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:45.283 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:45.283 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 74 2024-04-25T22:53:45.283 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.283 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:45.283 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.283 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:45.283 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:53:45.283 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:45.283 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.283 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.283 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:45.283 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:53:45.284 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:45.284 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.284 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.284 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:45.284 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319477+0000", 2024-04-25T22:53:45.284 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1999999999999999e-07 2024-04-25T22:53:45.284 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.284 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.284 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:45.284 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319483+0000", 2024-04-25T22:53:45.284 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4260000000000002e-06 2024-04-25T22:53:45.284 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.284 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.284 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:45.284 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319494+0000", 2024-04-25T22:53:45.284 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.094e-05 2024-04-25T22:53:45.285 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.285 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.285 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:45.285 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319499+0000", 2024-04-25T22:53:45.285 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3789999999999997e-06 2024-04-25T22:53:45.285 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.285 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.285 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:45.285 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319545+0000", 2024-04-25T22:53:45.285 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6149000000000001e-05 2024-04-25T22:53:45.285 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.285 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.285 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:45.285 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319617+0000", 2024-04-25T22:53:45.285 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1792999999999995e-05 2024-04-25T22:53:45.286 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.286 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.286 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:45.286 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326406+0000", 2024-04-25T22:53:45.286 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067895999999999998 2024-04-25T22:53:45.286 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.286 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.286 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:45.286 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326443+0000", 2024-04-25T22:53:45.286 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6828e-05 2024-04-25T22:53:45.286 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.286 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.286 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:45.286 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326514+0000", 2024-04-25T22:53:45.287 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0236999999999999e-05 2024-04-25T22:53:45.287 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:45.287 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:45.287 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:45.287 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.287 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.287 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:128 3.1f 3:f83d65d8:::200.00000004:head [write 876784~3317520 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e48)", 2024-04-25T22:53:45.287 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:36.985410+0000", 2024-04-25T22:53:45.287 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 8.218681106, 2024-04-25T22:53:45.287 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0090177360000000002, 2024-04-25T22:53:45.287 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:45.287 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:45.287 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:45.287 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:45.288 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.288 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:45.288 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.985410+0000", 2024-04-25T22:53:45.288 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:45.288 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.288 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.288 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:45.288 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.985410+0000", 2024-04-25T22:53:45.288 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:45.288 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.288 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.288 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:45.288 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.985411+0000", 2024-04-25T22:53:45.288 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8400000000000003e-07 2024-04-25T22:53:45.288 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.289 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.289 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:45.289 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989116+0000", 2024-04-25T22:53:45.289 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037047389999999999 2024-04-25T22:53:45.289 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.289 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.289 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:45.289 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989128+0000", 2024-04-25T22:53:45.289 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1977999999999999e-05 2024-04-25T22:53:45.289 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.289 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.289 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:45.289 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989135+0000", 2024-04-25T22:53:45.289 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5290000000000003e-06 2024-04-25T22:53:45.290 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.290 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.290 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:45.290 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989181+0000", 2024-04-25T22:53:45.290 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6122999999999999e-05 2024-04-25T22:53:45.290 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.290 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.290 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:45.290 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989250+0000", 2024-04-25T22:53:45.290 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8535999999999996e-05 2024-04-25T22:53:45.290 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.290 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.290 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:45.291 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.994272+0000", 2024-04-25T22:53:45.291 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050224889999999998 2024-04-25T22:53:45.291 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.291 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.291 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:45.291 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.994335+0000", 2024-04-25T22:53:45.291 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2588000000000005e-05 2024-04-25T22:53:45.291 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.291 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.291 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:45.291 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.994428+0000", 2024-04-25T22:53:45.291 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2869999999999997e-05 2024-04-25T22:53:45.291 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:45.291 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:45.291 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:45.292 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.292 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.292 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:2150 4.22 4:47cffac6:::10000000a2b.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T22:53:45.292 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:41.078233+0000", 2024-04-25T22:53:45.292 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 4.125857796, 2024-04-25T22:53:45.292 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069201510000000003, 2024-04-25T22:53:45.292 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:45.292 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:45.292 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:45.292 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:45.292 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.292 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:45.292 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078233+0000", 2024-04-25T22:53:45.292 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:45.292 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.293 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.293 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:45.293 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078233+0000", 2024-04-25T22:53:45.293 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:45.293 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.293 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.293 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:45.293 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078234+0000", 2024-04-25T22:53:45.293 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1699999999999998e-07 2024-04-25T22:53:45.293 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.293 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.293 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:45.293 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078236+0000", 2024-04-25T22:53:45.293 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.875e-06 2024-04-25T22:53:45.293 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.294 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.294 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:45.294 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078242+0000", 2024-04-25T22:53:45.294 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2450000000000003e-06 2024-04-25T22:53:45.294 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.294 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.294 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:45.294 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078247+0000", 2024-04-25T22:53:45.294 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7450000000000003e-06 2024-04-25T22:53:45.294 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.294 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.294 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:45.294 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078641+0000", 2024-04-25T22:53:45.294 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00039420200000000002 2024-04-25T22:53:45.295 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.295 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.295 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:45.295 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078840+0000", 2024-04-25T22:53:45.295 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000199063 2024-04-25T22:53:45.295 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.295 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.295 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:45.295 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078919+0000", 2024-04-25T22:53:45.295 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9182000000000002e-05 2024-04-25T22:53:45.295 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.295 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.295 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:45.295 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.080906+0000", 2024-04-25T22:53:45.296 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0019866390000000001 2024-04-25T22:53:45.296 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.296 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.296 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:45.296 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085074+0000", 2024-04-25T22:53:45.296 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0041683639999999999 2024-04-25T22:53:45.296 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.296 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.296 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:45.296 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085117+0000", 2024-04-25T22:53:45.296 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2849999999999998e-05 2024-04-25T22:53:45.296 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.296 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.296 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:45.297 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085154+0000", 2024-04-25T22:53:45.297 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6468999999999999e-05 2024-04-25T22:53:45.297 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:45.297 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:45.297 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:45.297 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.297 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.297 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:2160 4.2a 4:57f9ed86:::10000000a3d.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T22:53:45.297 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:53:45.297 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 4.1253885060000002, 2024-04-25T22:53:45.297 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0068959959999999997, 2024-04-25T22:53:45.297 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:45.297 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:45.297 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:45.297 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:45.298 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.298 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:45.298 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:53:45.298 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:45.298 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.298 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.298 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:45.298 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:53:45.298 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:45.298 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.298 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.298 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:45.298 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:53:45.299 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7000000000000004e-07 2024-04-25T22:53:45.299 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.299 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.299 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:45.299 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078707+0000", 2024-04-25T22:53:45.299 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.783e-06 2024-04-25T22:53:45.299 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.299 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.299 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:45.299 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078716+0000", 2024-04-25T22:53:45.299 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4800000000000001e-06 2024-04-25T22:53:45.299 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.299 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.299 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:45.299 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078724+0000", 2024-04-25T22:53:45.300 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1519999999999992e-06 2024-04-25T22:53:45.300 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.300 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.300 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:45.300 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078794+0000", 2024-04-25T22:53:45.300 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0500999999999995e-05 2024-04-25T22:53:45.300 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.300 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.300 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:45.300 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078912+0000", 2024-04-25T22:53:45.300 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000117439 2024-04-25T22:53:45.300 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.300 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.300 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:45.301 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079000+0000", 2024-04-25T22:53:45.301 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8092999999999998e-05 2024-04-25T22:53:45.301 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.301 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.301 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:45.301 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.080897+0000", 2024-04-25T22:53:45.301 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0018970899999999999 2024-04-25T22:53:45.301 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.301 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.301 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:45.301 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085517+0000", 2024-04-25T22:53:45.301 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0046198929999999999 2024-04-25T22:53:45.301 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.301 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.301 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:45.302 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085565+0000", 2024-04-25T22:53:45.302 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7777e-05 2024-04-25T22:53:45.302 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.302 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.302 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:45.302 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085599+0000", 2024-04-25T22:53:45.302 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4017999999999999e-05 2024-04-25T22:53:45.302 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:45.302 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:45.302 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:45.302 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.302 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.302 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:2163 4.2a 4:549f79e3:::10000000a43.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T22:53:45.303 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:53:45.303 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 4.1253551530000001, 2024-04-25T22:53:45.303 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069469190000000002, 2024-04-25T22:53:45.303 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:45.303 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:45.303 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:45.303 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:45.303 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.303 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:45.303 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:53:45.303 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:45.303 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.303 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.303 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:45.303 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:53:45.304 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:45.304 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.304 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.304 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:45.304 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:53:45.304 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1399999999999997e-07 2024-04-25T22:53:45.304 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.304 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.304 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:45.304 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078739+0000", 2024-04-25T22:53:45.304 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2960000000000001e-06 2024-04-25T22:53:45.304 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.304 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.304 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:45.304 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078745+0000", 2024-04-25T22:53:45.305 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3439999999999997e-06 2024-04-25T22:53:45.305 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.305 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.305 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:45.305 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078750+0000", 2024-04-25T22:53:45.305 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3179999999999997e-06 2024-04-25T22:53:45.305 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.305 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.305 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:45.305 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079224+0000", 2024-04-25T22:53:45.305 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00047334999999999999 2024-04-25T22:53:45.305 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.305 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.305 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:45.305 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079292+0000", 2024-04-25T22:53:45.306 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8708999999999996e-05 2024-04-25T22:53:45.306 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.306 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.306 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:45.306 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079342+0000", 2024-04-25T22:53:45.306 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9299999999999999e-05 2024-04-25T22:53:45.306 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.306 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.306 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:45.306 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.081611+0000", 2024-04-25T22:53:45.306 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0022695229999999999 2024-04-25T22:53:45.306 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.306 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.306 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:45.306 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085605+0000", 2024-04-25T22:53:45.307 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0039933679999999997 2024-04-25T22:53:45.307 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.307 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.307 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:45.307 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085650+0000", 2024-04-25T22:53:45.307 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5111000000000002e-05 2024-04-25T22:53:45.307 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:45.307 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:45.307 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:45.307 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085683+0000", 2024-04-25T22:53:45.307 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3185999999999997e-05 2024-04-25T22:53:45.307 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:45.307 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:45.307 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:45.307 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:45.308 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:45.308 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:45.310 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:45.311 INFO:tasks.workunit.client.0.smithi052.stdout:checking sys/wait.h usability... yes 2024-04-25T22:53:45.311 INFO:tasks.workunit.client.0.smithi052.stdout:checking sys/wait.h presence... yes 2024-04-25T22:53:45.311 INFO:tasks.workunit.client.0.smithi052.stdout:checking for sys/wait.h... yes 2024-04-25T22:53:45.311 INFO:tasks.workunit.client.0.smithi052.stdout:checking for sys/types.h... (cached) yes 2024-04-25T22:53:45.311 INFO:tasks.workunit.client.0.smithi052.stdout:checking for strings.h... (cached) yes 2024-04-25T22:53:45.311 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:45.308+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:45.331 INFO:tasks.workunit.client.0.smithi052.stdout:checking err.h usability... yes 2024-04-25T22:53:45.345 INFO:tasks.workunit.client.0.smithi052.stdout:checking err.h presence... yes 2024-04-25T22:53:45.345 INFO:tasks.workunit.client.0.smithi052.stdout:checking for err.h... yes 2024-04-25T22:53:45.352 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is unset 2024-04-25T22:53:45.392 INFO:tasks.workunit.client.0.smithi052.stdout:checking linux/falloc.h usability... yes 2024-04-25T22:53:45.405 INFO:tasks.workunit.client.0.smithi052.stdout:checking linux/falloc.h presence... yes 2024-04-25T22:53:45.405 INFO:tasks.workunit.client.0.smithi052.stdout:checking for linux/falloc.h... yes 2024-04-25T22:53:45.410 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:45.409+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:45.415 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:45.415 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:45.415 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-04-25T22:53:45.415 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:45.424 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:45.450 INFO:tasks.workunit.client.0.smithi052.stdout:checking sys/fs/xfs_fsops.h usability... no 2024-04-25T22:53:45.472 INFO:tasks.workunit.client.0.smithi052.stdout:checking sys/fs/xfs_fsops.h presence... no 2024-04-25T22:53:45.472 INFO:tasks.workunit.client.0.smithi052.stdout:checking for sys/fs/xfs_fsops.h... no 2024-04-25T22:53:45.510 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:45.510+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:45.511 INFO:tasks.workunit.client.0.smithi052.stdout:checking sys/fs/xfs_itable.h usability... no 2024-04-25T22:53:45.527 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:45.527 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:45.527 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:53:45.527 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:53:45.527 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:45.533 INFO:tasks.workunit.client.0.smithi052.stdout:checking sys/fs/xfs_itable.h presence... no 2024-04-25T22:53:45.533 INFO:tasks.workunit.client.0.smithi052.stdout:checking for sys/fs/xfs_itable.h... no 2024-04-25T22:53:45.536 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:45.572 INFO:tasks.workunit.client.0.smithi052.stdout:checking xfs/platform_defs.h usability... no 2024-04-25T22:53:45.593 INFO:tasks.workunit.client.0.smithi052.stdout:checking xfs/platform_defs.h presence... no 2024-04-25T22:53:45.593 INFO:tasks.workunit.client.0.smithi052.stdout:checking for xfs/platform_defs.h... no 2024-04-25T22:53:45.611 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:45.610+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:45.631 INFO:tasks.workunit.client.0.smithi052.stdout:checking btrfs/ioctl.h usability... no 2024-04-25T22:53:45.652 INFO:tasks.workunit.client.0.smithi052.stdout:checking btrfs/ioctl.h presence... no 2024-04-25T22:53:45.652 INFO:tasks.workunit.client.0.smithi052.stdout:checking for btrfs/ioctl.h... no 2024-04-25T22:53:45.681 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:45.681 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-04-25T22:53:45.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-04-25T22:53:45.681 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:53:45.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.681 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:45.681 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:45.681 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 117.71414270699999, 2024-04-25T22:53:45.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010384338999999999, 2024-04-25T22:53:45.681 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:45.681 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:45.682 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:45.682 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:45.682 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:45.682 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:45.682 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-04-25T22:53:45.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.682 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:45.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:45.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:45.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:45.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:45.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:45.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:45.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:45.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:45.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3600000000000004e-07 2024-04-25T22:53:45.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:45.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965185+0000", 2024-04-25T22:53:45.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.117e-06 2024-04-25T22:53:45.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:45.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965192+0000", 2024-04-25T22:53:45.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3239999999999997e-06 2024-04-25T22:53:45.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:45.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965198+0000", 2024-04-25T22:53:45.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6370000000000004e-06 2024-04-25T22:53:45.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:45.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970973+0000", 2024-04-25T22:53:45.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057748239999999996 2024-04-25T22:53:45.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:45.685 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971049+0000", 2024-04-25T22:53:45.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6029e-05 2024-04-25T22:53:45.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:45.685 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971174+0000", 2024-04-25T22:53:45.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012462399999999999 2024-04-25T22:53:45.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:45.685 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971553+0000", 2024-04-25T22:53:45.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037896499999999999 2024-04-25T22:53:45.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.686 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:45.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975482+0000", 2024-04-25T22:53:45.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039297459999999996 2024-04-25T22:53:45.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.686 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:45.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975529+0000", 2024-04-25T22:53:45.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6387000000000002e-05 2024-04-25T22:53:45.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.686 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:45.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975563+0000", 2024-04-25T22:53:45.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4150000000000003e-05 2024-04-25T22:53:45.687 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:45.687 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:45.687 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:45.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.687 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:45.687 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:45.687 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 112.667096384, 2024-04-25T22:53:45.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012637705000000001, 2024-04-25T22:53:45.687 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:45.687 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:45.687 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:45.687 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:45.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:45.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:45.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:45.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:45.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:45.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:45.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:45.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012227+0000", 2024-04-25T22:53:45.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.863e-06 2024-04-25T22:53:45.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:45.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012236+0000", 2024-04-25T22:53:45.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1109999999999997e-06 2024-04-25T22:53:45.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:45.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012309+0000", 2024-04-25T22:53:45.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3242000000000001e-05 2024-04-25T22:53:45.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:45.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012324+0000", 2024-04-25T22:53:45.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4837e-05 2024-04-25T22:53:45.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:45.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015060+0000", 2024-04-25T22:53:45.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027363349999999999 2024-04-25T22:53:45.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:45.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015169+0000", 2024-04-25T22:53:45.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108372 2024-04-25T22:53:45.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:45.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015498+0000", 2024-04-25T22:53:45.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032949999999999999 2024-04-25T22:53:45.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.691 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:45.691 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021282+0000", 2024-04-25T22:53:45.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057836429999999998 2024-04-25T22:53:45.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.691 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:45.691 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024709+0000", 2024-04-25T22:53:45.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034271979999999998 2024-04-25T22:53:45.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.691 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:45.691 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024802+0000", 2024-04-25T22:53:45.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2960000000000004e-05 2024-04-25T22:53:45.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:45.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024863+0000", 2024-04-25T22:53:45.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0643999999999997e-05 2024-04-25T22:53:45.692 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:45.692 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:45.692 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:45.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.692 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:45.692 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:45.692 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 112.666972613, 2024-04-25T22:53:45.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012979447999999999, 2024-04-25T22:53:45.693 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:45.693 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:45.693 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:45.693 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:45.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.693 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:45.693 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:45.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:45.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.693 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:45.693 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:45.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:45.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:45.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:45.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:53:45.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:45.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012354+0000", 2024-04-25T22:53:45.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7740000000000004e-06 2024-04-25T22:53:45.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:45.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012365+0000", 2024-04-25T22:53:45.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.064e-05 2024-04-25T22:53:45.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:45.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012382+0000", 2024-04-25T22:53:45.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6999000000000001e-05 2024-04-25T22:53:45.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:45.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015958+0000", 2024-04-25T22:53:45.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035765699999999998 2024-04-25T22:53:45.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:45.696 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016037+0000", 2024-04-25T22:53:45.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8242000000000001e-05 2024-04-25T22:53:45.696 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.696 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:45.696 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016404+0000", 2024-04-25T22:53:45.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036784300000000002 2024-04-25T22:53:45.696 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.696 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:45.696 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021294+0000", 2024-04-25T22:53:45.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048890629999999999 2024-04-25T22:53:45.696 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:45.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024959+0000", 2024-04-25T22:53:45.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036651570000000001 2024-04-25T22:53:45.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:45.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025097+0000", 2024-04-25T22:53:45.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013788099999999999 2024-04-25T22:53:45.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:45.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025328+0000", 2024-04-25T22:53:45.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231492 2024-04-25T22:53:45.697 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:45.698 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:45.698 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:45.698 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.698 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.698 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:45.698 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:45.698 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 112.66688484399999, 2024-04-25T22:53:45.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013049827, 2024-04-25T22:53:45.698 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:45.698 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:45.698 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:45.698 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:45.698 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.698 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:45.699 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:45.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:45.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:45.699 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:45.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:45.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:45.699 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012437+0000", 2024-04-25T22:53:45.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-04-25T22:53:45.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:45.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012440+0000", 2024-04-25T22:53:45.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7609999999999999e-06 2024-04-25T22:53:45.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:45.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012449+0000", 2024-04-25T22:53:45.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.285e-06 2024-04-25T22:53:45.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:45.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012457+0000", 2024-04-25T22:53:45.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9510000000000006e-06 2024-04-25T22:53:45.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:45.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017106+0000", 2024-04-25T22:53:45.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046494220000000003 2024-04-25T22:53:45.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:45.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017223+0000", 2024-04-25T22:53:45.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116824 2024-04-25T22:53:45.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:45.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017345+0000", 2024-04-25T22:53:45.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122175 2024-04-25T22:53:45.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:45.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021299+0000", 2024-04-25T22:53:45.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039534879999999998 2024-04-25T22:53:45.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:45.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025398+0000", 2024-04-25T22:53:45.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040988960000000003 2024-04-25T22:53:45.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:45.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025439+0000", 2024-04-25T22:53:45.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0915999999999999e-05 2024-04-25T22:53:45.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:45.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025486+0000", 2024-04-25T22:53:45.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7534999999999998e-05 2024-04-25T22:53:45.703 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:45.703 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:45.703 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:45.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.703 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:45.703 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:45.703 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 112.666854693, 2024-04-25T22:53:45.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020988041999999998, 2024-04-25T22:53:45.704 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:45.704 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:45.704 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:45.704 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:45.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:45.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:45.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:45.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:45.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:45.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:45.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:45.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:45.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.99e-07 2024-04-25T22:53:45.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:45.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012470+0000", 2024-04-25T22:53:45.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2789999999999999e-06 2024-04-25T22:53:45.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:45.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012477+0000", 2024-04-25T22:53:45.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:53:45.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:45.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012500+0000", 2024-04-25T22:53:45.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2490999999999999e-05 2024-04-25T22:53:45.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:45.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021911+0000", 2024-04-25T22:53:45.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094114160000000006 2024-04-25T22:53:45.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:45.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022000+0000", 2024-04-25T22:53:45.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8601000000000001e-05 2024-04-25T22:53:45.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:45.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022359+0000", 2024-04-25T22:53:45.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035921999999999999 2024-04-25T22:53:45.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:45.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025541+0000", 2024-04-25T22:53:45.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031820619999999998 2024-04-25T22:53:45.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:45.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033375+0000", 2024-04-25T22:53:45.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078338379999999992 2024-04-25T22:53:45.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:45.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033415+0000", 2024-04-25T22:53:45.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9527000000000003e-05 2024-04-25T22:53:45.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:45.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033455+0000", 2024-04-25T22:53:45.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9932000000000003e-05 2024-04-25T22:53:45.708 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:45.708 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:45.709 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:45.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.709 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:45.709 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:45.709 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 112.6667995, 2024-04-25T22:53:45.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021043857999999999, 2024-04-25T22:53:45.709 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:45.709 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:45.709 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:45.709 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:45.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:45.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:45.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:45.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:45.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:45.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:45.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:45.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012523+0000", 2024-04-25T22:53:45.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.361e-06 2024-04-25T22:53:45.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:45.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012530+0000", 2024-04-25T22:53:45.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5440000000000004e-06 2024-04-25T22:53:45.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:45.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012541+0000", 2024-04-25T22:53:45.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1745e-05 2024-04-25T22:53:45.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:45.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012551+0000", 2024-04-25T22:53:45.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5789999999999993e-06 2024-04-25T22:53:45.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:45.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022709+0000", 2024-04-25T22:53:45.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010157685 2024-04-25T22:53:45.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:45.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022957+0000", 2024-04-25T22:53:45.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024824599999999998 2024-04-25T22:53:45.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:45.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023443+0000", 2024-04-25T22:53:45.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048578599999999999 2024-04-25T22:53:45.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:45.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025547+0000", 2024-04-25T22:53:45.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021044789999999998 2024-04-25T22:53:45.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:45.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033509+0000", 2024-04-25T22:53:45.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0079622180000000001 2024-04-25T22:53:45.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:45.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033542+0000", 2024-04-25T22:53:45.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3018000000000001e-05 2024-04-25T22:53:45.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:45.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033566+0000", 2024-04-25T22:53:45.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3197000000000002e-05 2024-04-25T22:53:45.714 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:45.714 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:45.714 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:45.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.714 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:45.714 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:45.714 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 112.666759535, 2024-04-25T22:53:45.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021122696, 2024-04-25T22:53:45.715 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:45.715 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:45.715 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:45.715 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:45.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:45.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:45.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:45.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:45.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:45.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:45.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:45.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:45.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:53:45.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:45.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012566+0000", 2024-04-25T22:53:45.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-04-25T22:53:45.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:45.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012619+0000", 2024-04-25T22:53:45.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2607e-05 2024-04-25T22:53:45.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:45.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012628+0000", 2024-04-25T22:53:45.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6500000000000008e-06 2024-04-25T22:53:45.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:45.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024024+0000", 2024-04-25T22:53:45.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011396007999999999 2024-04-25T22:53:45.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:45.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024198+0000", 2024-04-25T22:53:45.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000173215 2024-04-25T22:53:45.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:45.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024447+0000", 2024-04-25T22:53:45.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024898500000000002 2024-04-25T22:53:45.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:45.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026431+0000", 2024-04-25T22:53:45.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001984923 2024-04-25T22:53:45.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:45.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033608+0000", 2024-04-25T22:53:45.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071768459999999997 2024-04-25T22:53:45.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:45.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033646+0000", 2024-04-25T22:53:45.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299000000000003e-05 2024-04-25T22:53:45.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:45.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033684+0000", 2024-04-25T22:53:45.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8773000000000003e-05 2024-04-25T22:53:45.719 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:45.719 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:45.719 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:45.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.720 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:45.720 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:45.720 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 112.666670936, 2024-04-25T22:53:45.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021175381, 2024-04-25T22:53:45.720 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:45.720 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:45.720 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:45.720 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:45.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:45.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:45.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:45.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:45.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:45.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:45.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:45.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012651+0000", 2024-04-25T22:53:45.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:53:45.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:45.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012656+0000", 2024-04-25T22:53:45.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8899999999999998e-06 2024-04-25T22:53:45.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:45.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012666+0000", 2024-04-25T22:53:45.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0346999999999999e-05 2024-04-25T22:53:45.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:45.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012675+0000", 2024-04-25T22:53:45.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9930000000000001e-06 2024-04-25T22:53:45.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:45.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025661+0000", 2024-04-25T22:53:45.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01298531 2024-04-25T22:53:45.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:45.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025757+0000", 2024-04-25T22:53:45.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5822000000000005e-05 2024-04-25T22:53:45.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:45.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025907+0000", 2024-04-25T22:53:45.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015051499999999999 2024-04-25T22:53:45.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:45.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026435+0000", 2024-04-25T22:53:45.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052762200000000005 2024-04-25T22:53:45.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:45.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033732+0000", 2024-04-25T22:53:45.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072978419999999997 2024-04-25T22:53:45.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:45.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033787+0000", 2024-04-25T22:53:45.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4703999999999997e-05 2024-04-25T22:53:45.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:45.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033826+0000", 2024-04-25T22:53:45.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8458999999999999e-05 2024-04-25T22:53:45.725 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:45.725 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:45.725 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:45.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.725 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:45.725 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:45.725 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 112.666615522, 2024-04-25T22:53:45.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021244174000000001, 2024-04-25T22:53:45.725 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:45.725 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:45.726 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:45.726 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:45.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:45.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:45.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:45.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:45.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:45.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:45.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:45.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:45.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:45.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:45.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012712+0000", 2024-04-25T22:53:45.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.913e-06 2024-04-25T22:53:45.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:45.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012722+0000", 2024-04-25T22:53:45.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2879999999999998e-06 2024-04-25T22:53:45.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:45.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012727+0000", 2024-04-25T22:53:45.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8429999999999998e-06 2024-04-25T22:53:45.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:45.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026099+0000", 2024-04-25T22:53:45.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013371450999999999 2024-04-25T22:53:45.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:45.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026147+0000", 2024-04-25T22:53:45.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7837999999999998e-05 2024-04-25T22:53:45.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:45.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026254+0000", 2024-04-25T22:53:45.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107314 2024-04-25T22:53:45.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:45.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026686+0000", 2024-04-25T22:53:45.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000432428 2024-04-25T22:53:45.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:45.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033873+0000", 2024-04-25T22:53:45.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071864399999999997 2024-04-25T22:53:45.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:45.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033904+0000", 2024-04-25T22:53:45.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1321e-05 2024-04-25T22:53:45.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:45.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033950+0000", 2024-04-25T22:53:45.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5707999999999997e-05 2024-04-25T22:53:45.730 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:45.730 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:45.730 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:45.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.730 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:45.731 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:45.731 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 112.666585137, 2024-04-25T22:53:45.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01096505, 2024-04-25T22:53:45.731 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:45.731 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:45.731 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:45.731 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:45.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:45.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:45.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:45.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:45.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:45.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:45.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:45.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012737+0000", 2024-04-25T22:53:45.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:45.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:45.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012739+0000", 2024-04-25T22:53:45.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-04-25T22:53:45.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:45.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012743+0000", 2024-04-25T22:53:45.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3239999999999996e-06 2024-04-25T22:53:45.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:45.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012746+0000", 2024-04-25T22:53:45.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.129e-06 2024-04-25T22:53:45.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:45.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012796+0000", 2024-04-25T22:53:45.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9231999999999999e-05 2024-04-25T22:53:45.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:45.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012915+0000", 2024-04-25T22:53:45.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119021 2024-04-25T22:53:45.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:45.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013069+0000", 2024-04-25T22:53:45.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015463900000000001 2024-04-25T22:53:45.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:45.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019237+0000", 2024-04-25T22:53:45.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061680329999999998 2024-04-25T22:53:45.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:45.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023603+0000", 2024-04-25T22:53:45.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043655860000000003 2024-04-25T22:53:45.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:45.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023659+0000", 2024-04-25T22:53:45.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6484000000000003e-05 2024-04-25T22:53:45.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:45.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023701+0000", 2024-04-25T22:53:45.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1761999999999998e-05 2024-04-25T22:53:45.736 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:45.736 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:45.736 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:45.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.736 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:45.736 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:45.736 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 112.66656018899999, 2024-04-25T22:53:45.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011234429000000001, 2024-04-25T22:53:45.736 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:45.736 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:45.736 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:45.736 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:45.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:45.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:45.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:45.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:45.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:45.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:45.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:45.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012762+0000", 2024-04-25T22:53:45.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-04-25T22:53:45.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:45.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012765+0000", 2024-04-25T22:53:45.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2569999999999999e-06 2024-04-25T22:53:45.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:45.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012783+0000", 2024-04-25T22:53:45.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8431999999999999e-05 2024-04-25T22:53:45.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:45.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012799+0000", 2024-04-25T22:53:45.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5438999999999999e-05 2024-04-25T22:53:45.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:45.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013826+0000", 2024-04-25T22:53:45.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010275060000000001 2024-04-25T22:53:45.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:45.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013913+0000", 2024-04-25T22:53:45.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.708e-05 2024-04-25T22:53:45.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:45.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014098+0000", 2024-04-25T22:53:45.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018519399999999999 2024-04-25T22:53:45.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:45.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019684+0000", 2024-04-25T22:53:45.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055860079999999999 2024-04-25T22:53:45.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:45.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023876+0000", 2024-04-25T22:53:45.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041918800000000003 2024-04-25T22:53:45.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:45.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023957+0000", 2024-04-25T22:53:45.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1165e-05 2024-04-25T22:53:45.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:45.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023995+0000", 2024-04-25T22:53:45.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:53:45.741 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:45.741 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:45.741 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:45.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.741 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:45.741 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:45.741 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 112.66646240999999, 2024-04-25T22:53:45.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011131200000000001, 2024-04-25T22:53:45.742 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:45.742 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:45.742 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:45.742 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:45.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:45.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:45.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:45.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:45.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:45.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:45.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:45.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012860+0000", 2024-04-25T22:53:45.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3900000000000004e-07 2024-04-25T22:53:45.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:45.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012865+0000", 2024-04-25T22:53:45.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5609999999999998e-06 2024-04-25T22:53:45.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:45.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012895+0000", 2024-04-25T22:53:45.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9847000000000001e-05 2024-04-25T22:53:45.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:45.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012905+0000", 2024-04-25T22:53:45.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.03e-05 2024-04-25T22:53:45.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:45.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015020+0000", 2024-04-25T22:53:45.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021142940000000001 2024-04-25T22:53:45.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:45.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015182+0000", 2024-04-25T22:53:45.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016248099999999999 2024-04-25T22:53:45.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:45.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015357+0000", 2024-04-25T22:53:45.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017471000000000001 2024-04-25T22:53:45.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:45.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021021+0000", 2024-04-25T22:53:45.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056638340000000004 2024-04-25T22:53:45.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:45.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023712+0000", 2024-04-25T22:53:45.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026910380000000002 2024-04-25T22:53:45.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:45.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023763+0000", 2024-04-25T22:53:45.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1477999999999997e-05 2024-04-25T22:53:45.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:45.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023990+0000", 2024-04-25T22:53:45.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000226818 2024-04-25T22:53:45.746 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:45.746 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:45.746 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:45.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.747 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:45.747 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:45.747 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 112.666339314, 2024-04-25T22:53:45.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011705299000000001, 2024-04-25T22:53:45.747 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:45.747 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:45.747 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:45.747 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:45.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:45.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:45.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:45.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:45.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:45.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:45.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:45.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012983+0000", 2024-04-25T22:53:45.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:53:45.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:45.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012986+0000", 2024-04-25T22:53:45.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5700000000000001e-06 2024-04-25T22:53:45.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:45.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012993+0000", 2024-04-25T22:53:45.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8730000000000001e-06 2024-04-25T22:53:45.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:45.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013000+0000", 2024-04-25T22:53:45.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1890000000000001e-06 2024-04-25T22:53:45.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:45.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:53:45.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002147866 2024-04-25T22:53:45.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:45.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015351+0000", 2024-04-25T22:53:45.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020300799999999999 2024-04-25T22:53:45.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:45.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016260+0000", 2024-04-25T22:53:45.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00090926799999999997 2024-04-25T22:53:45.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:45.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022669+0000", 2024-04-25T22:53:45.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064082849999999997 2024-04-25T22:53:45.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:45.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024584+0000", 2024-04-25T22:53:45.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019151699999999999 2024-04-25T22:53:45.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:45.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024643+0000", 2024-04-25T22:53:45.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8888999999999998e-05 2024-04-25T22:53:45.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:45.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024687+0000", 2024-04-25T22:53:45.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4444999999999999e-05 2024-04-25T22:53:45.752 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:45.752 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:45.752 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:45.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.752 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:45.752 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:45.752 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 112.66631172300001, 2024-04-25T22:53:45.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011249699, 2024-04-25T22:53:45.752 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:45.752 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:45.752 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:45.753 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:45.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:45.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:45.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:45.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:45.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:45.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:45.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:45.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013010+0000", 2024-04-25T22:53:45.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2099999999999996e-07 2024-04-25T22:53:45.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:45.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013013+0000", 2024-04-25T22:53:45.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1310000000000002e-06 2024-04-25T22:53:45.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:45.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013020+0000", 2024-04-25T22:53:45.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3330000000000002e-06 2024-04-25T22:53:45.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:45.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013025+0000", 2024-04-25T22:53:45.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6760000000000004e-06 2024-04-25T22:53:45.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:45.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013163+0000", 2024-04-25T22:53:45.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013824599999999999 2024-04-25T22:53:45.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:45.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013504+0000", 2024-04-25T22:53:45.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034080299999999998 2024-04-25T22:53:45.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:45.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013613+0000", 2024-04-25T22:53:45.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108705 2024-04-25T22:53:45.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:45.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015831+0000", 2024-04-25T22:53:45.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002217672 2024-04-25T22:53:45.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:45.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024137+0000", 2024-04-25T22:53:45.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0083060489999999994 2024-04-25T22:53:45.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:45.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024218+0000", 2024-04-25T22:53:45.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1351000000000001e-05 2024-04-25T22:53:45.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:45.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024259+0000", 2024-04-25T22:53:45.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1112000000000002e-05 2024-04-25T22:53:45.757 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:45.757 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:45.757 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:45.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.758 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:45.758 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:45.758 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 112.666223997, 2024-04-25T22:53:45.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020379749999999999, 2024-04-25T22:53:45.758 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:45.758 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:45.758 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:45.758 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:45.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:45.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:45.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:45.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:45.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:45.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:45.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:45.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013098+0000", 2024-04-25T22:53:45.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:53:45.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:45.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013105+0000", 2024-04-25T22:53:45.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5969999999999997e-06 2024-04-25T22:53:45.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:45.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013190+0000", 2024-04-25T22:53:45.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5618999999999995e-05 2024-04-25T22:53:45.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:45.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013200+0000", 2024-04-25T22:53:45.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5859999999999994e-06 2024-04-25T22:53:45.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:45.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020265+0000", 2024-04-25T22:53:45.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070653349999999998 2024-04-25T22:53:45.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:45.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020454+0000", 2024-04-25T22:53:45.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189316 2024-04-25T22:53:45.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:45.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020586+0000", 2024-04-25T22:53:45.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013195700000000001 2024-04-25T22:53:45.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:45.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023822+0000", 2024-04-25T22:53:45.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032358529999999999 2024-04-25T22:53:45.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:45.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033409+0000", 2024-04-25T22:53:45.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095870520000000004 2024-04-25T22:53:45.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:45.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033447+0000", 2024-04-25T22:53:45.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7261999999999997e-05 2024-04-25T22:53:45.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:45.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033477+0000", 2024-04-25T22:53:45.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0389e-05 2024-04-25T22:53:45.763 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:45.763 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:45.763 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:45.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.763 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:45.763 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:45.763 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 112.66610749100001, 2024-04-25T22:53:45.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010857383999999999, 2024-04-25T22:53:45.763 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:45.763 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:45.764 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:45.764 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:45.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:45.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:45.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:45.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:45.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:45.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:45.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:45.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:45.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:45.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:45.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013218+0000", 2024-04-25T22:53:45.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8199999999999998e-06 2024-04-25T22:53:45.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:45.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013226+0000", 2024-04-25T22:53:45.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7649999999999993e-06 2024-04-25T22:53:45.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:45.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013259+0000", 2024-04-25T22:53:45.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2727e-05 2024-04-25T22:53:45.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:45.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014809+0000", 2024-04-25T22:53:45.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001550144 2024-04-25T22:53:45.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:45.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014958+0000", 2024-04-25T22:53:45.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014890300000000001 2024-04-25T22:53:45.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:45.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015087+0000", 2024-04-25T22:53:45.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012939200000000001 2024-04-25T22:53:45.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:45.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020212+0000", 2024-04-25T22:53:45.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051248939999999996 2024-04-25T22:53:45.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:45.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023699+0000", 2024-04-25T22:53:45.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034873289999999999 2024-04-25T22:53:45.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:45.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024014+0000", 2024-04-25T22:53:45.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031473999999999999 2024-04-25T22:53:45.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:45.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024071+0000", 2024-04-25T22:53:45.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7040000000000003e-05 2024-04-25T22:53:45.768 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:45.768 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:45.768 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:45.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.769 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:45.769 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:45.769 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 112.66605278599999, 2024-04-25T22:53:45.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012329677000000001, 2024-04-25T22:53:45.769 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:45.769 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:45.769 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:45.769 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:45.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:45.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:45.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:45.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:45.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:45.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:45.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:45.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013269+0000", 2024-04-25T22:53:45.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5000000000000002e-07 2024-04-25T22:53:45.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:45.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:45.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6909999999999999e-06 2024-04-25T22:53:45.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:45.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013284+0000", 2024-04-25T22:53:45.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0963e-05 2024-04-25T22:53:45.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:45.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013361+0000", 2024-04-25T22:53:45.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7379999999999994e-05 2024-04-25T22:53:45.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:45.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013448+0000", 2024-04-25T22:53:45.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6990000000000006e-05 2024-04-25T22:53:45.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:45.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013632+0000", 2024-04-25T22:53:45.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018396800000000001 2024-04-25T22:53:45.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:45.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013800+0000", 2024-04-25T22:53:45.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167467 2024-04-25T22:53:45.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:45.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.018570+0000", 2024-04-25T22:53:45.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047701460000000003 2024-04-25T22:53:45.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:45.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025507+0000", 2024-04-25T22:53:45.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069372039999999998 2024-04-25T22:53:45.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:45.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025562+0000", 2024-04-25T22:53:45.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4858999999999998e-05 2024-04-25T22:53:45.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:45.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025598+0000", 2024-04-25T22:53:45.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6259e-05 2024-04-25T22:53:45.774 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:45.774 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:45.774 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:45.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.774 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:45.774 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:45.774 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 112.66592091299999, 2024-04-25T22:53:45.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020176666999999999, 2024-04-25T22:53:45.774 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:45.774 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:45.774 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:53:45.774 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:45.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:45.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:45.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:45.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:45.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:45.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:45.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:45.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:45.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-04-25T22:53:45.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:45.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013405+0000", 2024-04-25T22:53:45.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0559999999999998e-06 2024-04-25T22:53:45.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:45.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013422+0000", 2024-04-25T22:53:45.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6770999999999999e-05 2024-04-25T22:53:45.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:45.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013431+0000", 2024-04-25T22:53:45.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5019999999999998e-06 2024-04-25T22:53:45.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:45.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021720+0000", 2024-04-25T22:53:45.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082884340000000008 2024-04-25T22:53:45.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:45.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022122+0000", 2024-04-25T22:53:45.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000401634 2024-04-25T22:53:45.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:45.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033577+0000", 2024-04-25T22:53:45.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011455435999999999 2024-04-25T22:53:45.778 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:45.778 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:45.778 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:45.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.778 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4734.0:31 4.1b 4:d9872866:::1000000021d.00000002:head [write 0~3618035] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-25T22:53:45.778 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:53:45.778 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 14.626346651, 2024-04-25T22:53:45.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011647062, 2024-04-25T22:53:45.778 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:45.778 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:45.778 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:45.778 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:45.779 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4734", 2024-04-25T22:53:45.779 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:45.779 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 31 2024-04-25T22:53:45.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.779 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:45.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:45.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:53:45.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:45.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:45.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:53:45.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:45.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:45.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:53:45.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5700000000000001e-07 2024-04-25T22:53:45.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:45.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059575+0000", 2024-04-25T22:53:45.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0065991380000000001 2024-04-25T22:53:45.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:45.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059586+0000", 2024-04-25T22:53:45.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1438e-05 2024-04-25T22:53:45.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:45.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059592+0000", 2024-04-25T22:53:45.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2899999999999999e-06 2024-04-25T22:53:45.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:45.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059660+0000", 2024-04-25T22:53:45.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7980999999999998e-05 2024-04-25T22:53:45.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:45.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059757+0000", 2024-04-25T22:53:45.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6340000000000003e-05 2024-04-25T22:53:45.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:45.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.064487+0000", 2024-04-25T22:53:45.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004730621 2024-04-25T22:53:45.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:45.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.064538+0000", 2024-04-25T22:53:45.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0801999999999999e-05 2024-04-25T22:53:45.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:45.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.064622+0000", 2024-04-25T22:53:45.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3595000000000002e-05 2024-04-25T22:53:45.783 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:45.783 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:45.783 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:45.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.783 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:97 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-25T22:53:45.783 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:53:33.026298+0000", 2024-04-25T22:53:45.783 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 12.653022837, 2024-04-25T22:53:45.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015641848999999999, 2024-04-25T22:53:45.783 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:45.783 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:45.783 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:45.784 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:45.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:45.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026298+0000", 2024-04-25T22:53:45.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:45.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:45.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026298+0000", 2024-04-25T22:53:45.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:45.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:45.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026299+0000", 2024-04-25T22:53:45.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7299999999999996e-07 2024-04-25T22:53:45.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:45.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026464+0000", 2024-04-25T22:53:45.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016477700000000001 2024-04-25T22:53:45.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:45.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026472+0000", 2024-04-25T22:53:45.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1589999999999993e-06 2024-04-25T22:53:45.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:45.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026476+0000", 2024-04-25T22:53:45.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4580000000000003e-06 2024-04-25T22:53:45.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:45.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026550+0000", 2024-04-25T22:53:45.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3836000000000003e-05 2024-04-25T22:53:45.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:45.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026644+0000", 2024-04-25T22:53:45.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4022000000000002e-05 2024-04-25T22:53:45.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:45.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.041838+0000", 2024-04-25T22:53:45.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015193814999999999 2024-04-25T22:53:45.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:45.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.041874+0000", 2024-04-25T22:53:45.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5856999999999999e-05 2024-04-25T22:53:45.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:45.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:45.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:45.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.041940+0000", 2024-04-25T22:53:45.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6352000000000004e-05 2024-04-25T22:53:45.787 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:45.787 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:45.787 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:45.788 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:45.788 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:45.788 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:45.790 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:45.790 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:45.788+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:45.791 INFO:tasks.workunit.client.0.smithi052.stdout:checking cifs/ioctl.h usability... no 2024-04-25T22:53:45.791 INFO:tasks.workunit.client.0.smithi052.stdout:checking cifs/ioctl.h presence... no 2024-04-25T22:53:45.791 INFO:tasks.workunit.client.0.smithi052.stdout:checking for cifs/ioctl.h... no 2024-04-25T22:53:45.791 INFO:tasks.workunit.client.0.smithi052.stdout:checking sys/mman.h usability... yes 2024-04-25T22:53:45.791 INFO:tasks.workunit.client.0.smithi052.stdout:checking sys/mman.h presence... yes 2024-04-25T22:53:45.791 INFO:tasks.workunit.client.0.smithi052.stdout:checking for sys/mman.h... yes 2024-04-25T22:53:45.803 INFO:tasks.workunit.client.0.smithi052.stdout:checking for xfs/xfs_log_format.h... no 2024-04-25T22:53:45.860 INFO:tasks.workunit.client.0.smithi052.stdout:checking for uuid_compare... no 2024-04-25T22:53:45.890 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:45.889+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:45.893 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:45.894 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:45.894 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-25T22:53:45.894 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:45.902 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:45.908 INFO:tasks.workunit.client.0.smithi052.stdout:checking for uuid_compare in -luuid... yes 2024-04-25T22:53:45.971 INFO:tasks.workunit.client.0.smithi052.stdout:checking for xfs/xfs.h... yes 2024-04-25T22:53:45.991 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:45.990+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:45.996 INFO:tasks.workunit.client.0.smithi052.stdout:checking for xfs/libxfs.h... no 2024-04-25T22:53:46.006 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:46.006 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:46.006 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-25T22:53:46.006 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-25T22:53:46.007 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:46.015 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:46.020 INFO:tasks.workunit.client.0.smithi052.stdout:checking whether xlog_assign_lsn is declared... no 2024-04-25T22:53:46.059 INFO:tasks.workunit.client.0.smithi052.stdout:checking for xfs/xqm.h... yes 2024-04-25T22:53:46.092 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:46.091+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:46.126 INFO:tasks.workunit.client.0.smithi052.stdout:checking xfsctl from xfs/xfs.h... ok 2024-04-25T22:53:46.133 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:53:46.163 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:46.163 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:53:46.163 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:53:46.163 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:53:46.163 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.163 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:53:46.163 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:46.163 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 118.194199246, 2024-04-25T22:53:46.163 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:53:46.163 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:46.163 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:46.164 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:46.164 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:46.164 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.164 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:46.164 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:46.164 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:46.164 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.164 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.164 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:46.164 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:46.164 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:46.164 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.164 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.164 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:46.165 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:53:46.165 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:53:46.165 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.165 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.165 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:46.165 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:53:46.165 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:53:46.165 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.165 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.165 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:46.165 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:53:46.165 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:53:46.165 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.165 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.166 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:46.166 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:53:46.166 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:53:46.166 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.166 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.166 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:46.166 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:53:46.166 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:53:46.166 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.166 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.166 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:46.166 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:53:46.166 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:53:46.166 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.167 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.167 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:46.167 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:53:46.167 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:53:46.167 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.167 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.167 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:46.167 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:53:46.167 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:53:46.167 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:46.167 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:46.167 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:46.167 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.168 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.168 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:46.168 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:46.168 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 113.149703547, 2024-04-25T22:53:46.168 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:53:46.168 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:46.168 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:46.168 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:46.168 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:46.168 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.168 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:46.168 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:46.168 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:46.168 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.169 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.169 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:46.169 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:46.169 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:46.169 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.169 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.169 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:46.169 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:53:46.169 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:53:46.169 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.169 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.169 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:46.169 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:53:46.169 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:53:46.169 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.170 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.170 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:46.170 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:53:46.170 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:53:46.170 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.170 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.170 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:46.170 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:53:46.170 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:53:46.170 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.170 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.170 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:46.170 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:53:46.171 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:53:46.171 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.171 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.171 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:46.171 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:53:46.171 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:53:46.171 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.171 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.171 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:46.171 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:53:46.171 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:53:46.171 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.171 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.171 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:46.171 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:53:46.172 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:53:46.172 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.172 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.172 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:46.172 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:53:46.172 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:53:46.172 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.172 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.172 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:46.172 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:53:46.172 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:53:46.172 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.172 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.172 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:46.172 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:53:46.173 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:53:46.173 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:46.173 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:46.173 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:46.173 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.173 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.173 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:46.173 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:46.173 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 113.149029171, 2024-04-25T22:53:46.173 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:53:46.173 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:46.174 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:46.174 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:46.174 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:46.174 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.174 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:46.174 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:46.174 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:46.174 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.174 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.174 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:46.174 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:46.174 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:46.174 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.175 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.175 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:46.175 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:53:46.175 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:53:46.175 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.175 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.175 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:46.175 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:53:46.175 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:53:46.175 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.175 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.175 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:46.175 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:53:46.175 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:53:46.176 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.176 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.176 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:46.176 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:53:46.176 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:53:46.176 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.176 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.176 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:46.176 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:53:46.176 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:53:46.176 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.176 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.176 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:46.176 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:53:46.177 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:53:46.177 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.177 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.177 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:46.177 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:53:46.177 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:53:46.177 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.177 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.177 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:46.177 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:53:46.177 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:53:46.177 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.177 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.177 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:46.178 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:53:46.178 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:53:46.178 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.178 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.178 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:46.178 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:53:46.178 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:53:46.178 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.178 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.178 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:46.178 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:53:46.178 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:53:46.178 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:46.178 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:46.179 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:46.179 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.179 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.179 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:46.179 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:46.179 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 113.148519959, 2024-04-25T22:53:46.179 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:53:46.179 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:46.179 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:46.179 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:46.179 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:46.179 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.179 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:46.180 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:46.180 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:46.180 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.180 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.180 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:46.180 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:46.180 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:46.180 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.180 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.180 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:46.180 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:53:46.180 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:53:46.180 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.180 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.181 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:46.181 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:53:46.181 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:53:46.181 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.181 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.181 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:46.181 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:53:46.181 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:53:46.181 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.181 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.181 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:46.181 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:53:46.181 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:53:46.181 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.182 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.182 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:46.182 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:53:46.182 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:53:46.182 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.182 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.182 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:46.182 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:53:46.182 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:53:46.182 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.182 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.182 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:46.182 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:53:46.182 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:53:46.183 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.183 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.183 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:46.183 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:53:46.183 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:53:46.183 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.183 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.183 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:46.183 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:53:46.183 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:53:46.183 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.183 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.183 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:46.183 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:53:46.183 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:53:46.184 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.184 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.184 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:46.184 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:53:46.184 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:53:46.184 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:46.184 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:46.184 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:46.184 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.184 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.184 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:46.184 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:46.184 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 113.14810676099999, 2024-04-25T22:53:46.184 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:53:46.184 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:46.185 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:46.185 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:46.185 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:46.185 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.185 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:46.185 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:46.185 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:46.185 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.185 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.185 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:46.185 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:46.185 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:46.185 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.185 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.185 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:46.186 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:46.186 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:53:46.186 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.186 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.186 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:46.186 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:46.186 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:53:46.186 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.186 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.186 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:46.186 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:53:46.186 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:53:46.186 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.187 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.187 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:46.187 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:53:46.187 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:53:46.187 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.187 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.187 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:46.187 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:53:46.187 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:53:46.187 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.187 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.187 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:46.187 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:53:46.187 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:53:46.188 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.188 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.188 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:46.188 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:53:46.188 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:53:46.188 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.188 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.188 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:46.188 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:53:46.188 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:53:46.188 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.188 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.188 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:46.188 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:53:46.189 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:53:46.189 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.189 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.189 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:46.189 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:53:46.189 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:53:46.189 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.189 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.189 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:46.189 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:53:46.189 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:53:46.189 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:46.189 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:46.189 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:46.190 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.190 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.190 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:46.190 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:46.190 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 113.148056091, 2024-04-25T22:53:46.190 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:53:46.190 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:46.190 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:46.190 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:46.190 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:46.190 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.190 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:46.190 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:46.190 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:46.191 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.191 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.191 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:46.191 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:46.191 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:46.191 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.191 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.191 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:46.191 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:53:46.191 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:53:46.191 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.191 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.191 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:46.192 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:53:46.192 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:53:46.192 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.192 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.192 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:46.192 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:53:46.192 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:53:46.192 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.192 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.192 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:46.192 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:53:46.192 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:53:46.192 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.192 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.192 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:46.193 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:53:46.193 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:53:46.193 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.193 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.193 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:46.193 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:53:46.193 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:53:46.193 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.193 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.193 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:46.193 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:53:46.193 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:53:46.193 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.193 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.194 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:46.194 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:53:46.194 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:53:46.194 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.194 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.194 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:46.194 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:53:46.194 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:53:46.194 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.194 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.194 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:46.194 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:53:46.194 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:53:46.195 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.195 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.195 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:46.195 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:53:46.195 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:53:46.195 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.195 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.195 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:46.195 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:53:46.195 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:53:46.195 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.195 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.195 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:46.195 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:53:46.196 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:53:46.196 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:46.196 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:46.196 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:46.196 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.196 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.196 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:46.196 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:46.196 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 113.148019222, 2024-04-25T22:53:46.196 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:53:46.196 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:46.196 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:46.196 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:46.196 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:46.197 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.197 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:46.197 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:46.197 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:46.197 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.197 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.197 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:46.197 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:46.197 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:46.197 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.197 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.197 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:46.197 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:53:46.197 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:53:46.198 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.198 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.198 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:46.198 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:53:46.198 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:53:46.198 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.198 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.198 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:46.198 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:53:46.198 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:53:46.198 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.198 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.198 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:46.199 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:53:46.199 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:53:46.199 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.199 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.199 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:46.199 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:53:46.199 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:53:46.199 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.199 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.199 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:53:46.199 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:53:46.199 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:53:46.199 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.199 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.200 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:46.200 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:53:46.200 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:53:46.200 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.200 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.200 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:46.200 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:53:46.200 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:53:46.200 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.200 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.200 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:46.200 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:53:46.200 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:53:46.200 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.201 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.201 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:46.201 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:53:46.201 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:53:46.201 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.201 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.201 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:46.201 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:53:46.201 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:53:46.201 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.201 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.201 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:46.201 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:53:46.201 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:53:46.202 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.202 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.202 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:46.202 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:53:46.202 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:53:46.202 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:46.202 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:46.202 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:46.202 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.202 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.202 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:46.202 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:46.202 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 113.147994256, 2024-04-25T22:53:46.203 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:53:46.203 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:46.203 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:46.203 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:46.203 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:46.203 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.203 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:46.203 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:46.203 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:46.203 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.203 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.203 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:46.203 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:46.203 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:46.204 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.204 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.204 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:46.204 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:53:46.204 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:53:46.204 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.204 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.204 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:46.204 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:53:46.204 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:53:46.204 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.204 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.204 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:46.204 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:46.205 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:53:46.205 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.205 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.205 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:46.205 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:53:46.205 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:53:46.205 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.205 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.205 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:46.205 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:53:46.205 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:53:46.205 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.205 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.205 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:46.206 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:53:46.206 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:53:46.206 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.206 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.206 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:46.206 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:53:46.206 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:53:46.206 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.206 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.206 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:46.206 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:53:46.206 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:53:46.206 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.207 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.207 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:46.207 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:53:46.207 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:53:46.207 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.207 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.207 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:46.207 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:53:46.207 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:53:46.207 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.207 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.207 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:46.207 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:53:46.207 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:53:46.208 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:46.208 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:46.208 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:46.208 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.208 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.208 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:46.208 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:46.208 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 113.14795789199999, 2024-04-25T22:53:46.208 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:53:46.208 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:46.208 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:46.208 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:46.208 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:46.209 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.209 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:46.209 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:46.209 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:46.209 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.209 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.209 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:46.209 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:46.209 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:46.209 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.209 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.209 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:46.209 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:53:46.210 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:53:46.210 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.210 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.210 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:46.210 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:53:46.210 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:53:46.210 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.210 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.210 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:46.210 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:53:46.210 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:53:46.210 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.210 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.210 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:46.211 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:53:46.211 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:53:46.211 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.211 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.211 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:46.211 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:53:46.211 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:53:46.211 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.211 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.211 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:46.211 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:53:46.211 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:53:46.211 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.211 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.212 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:46.212 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:53:46.212 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:53:46.212 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.212 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.212 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:46.212 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:53:46.212 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:53:46.212 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.212 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.212 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:46.212 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:53:46.212 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:53:46.212 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:46.213 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:46.213 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:46.213 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.213 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.213 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:46.213 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:46.213 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 113.147926811, 2024-04-25T22:53:46.213 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:53:46.213 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:46.213 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:46.213 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:46.213 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:46.213 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.213 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:46.214 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:46.214 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:46.214 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.214 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.214 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:46.214 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:46.214 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:46.214 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.214 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.214 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:46.214 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:46.214 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:46.214 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.214 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.215 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:46.215 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:53:46.215 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:53:46.215 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.215 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.215 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:46.215 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:53:46.215 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:53:46.215 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.215 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.215 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:46.215 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:53:46.215 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:53:46.215 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.216 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.216 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:46.216 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:53:46.216 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:53:46.216 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.216 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.216 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:46.216 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:53:46.216 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:53:46.216 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.216 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.216 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:46.216 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:53:46.216 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:53:46.216 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:46.217 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:46.217 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:46.217 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.217 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.217 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:30 4.31 4:8ebfc112:::1000000021d.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-25T22:53:46.217 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:53:46.217 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 15.108240941, 2024-04-25T22:53:46.217 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015003005, 2024-04-25T22:53:46.217 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:46.217 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:46.217 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:46.217 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:46.217 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:46.217 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:46.218 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 30 2024-04-25T22:53:46.218 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.218 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:46.218 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.218 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:46.218 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:53:46.218 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:46.218 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.218 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.218 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:46.218 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:53:46.218 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:46.218 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.219 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.219 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:46.219 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053133+0000", 2024-04-25T22:53:46.219 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0370000000000001e-06 2024-04-25T22:53:46.219 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.219 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.219 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:46.219 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060377+0000", 2024-04-25T22:53:46.219 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0072431070000000004 2024-04-25T22:53:46.219 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.219 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.219 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:46.219 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060388+0000", 2024-04-25T22:53:46.219 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1285e-05 2024-04-25T22:53:46.219 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.220 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.220 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:46.220 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060394+0000", 2024-04-25T22:53:46.220 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1040000000000003e-06 2024-04-25T22:53:46.220 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.220 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.220 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:46.220 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060483+0000", 2024-04-25T22:53:46.220 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.9345000000000006e-05 2024-04-25T22:53:46.220 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.220 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.220 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:46.220 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060566+0000", 2024-04-25T22:53:46.221 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2237999999999994e-05 2024-04-25T22:53:46.221 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.221 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.221 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:46.221 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068057+0000", 2024-04-25T22:53:46.221 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074912210000000002 2024-04-25T22:53:46.221 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.221 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.221 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:46.221 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068090+0000", 2024-04-25T22:53:46.221 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3501000000000003e-05 2024-04-25T22:53:46.221 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.221 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.221 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:46.222 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068134+0000", 2024-04-25T22:53:46.222 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4166999999999999e-05 2024-04-25T22:53:46.222 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:46.222 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:46.222 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:46.222 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.222 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.222 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:66 4.27 4:e5671758:::1000000024f.00000000:head [write 0~6641] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:46.222 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:46.222 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 14.848130605, 2024-04-25T22:53:46.222 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075166540000000002, 2024-04-25T22:53:46.222 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:46.222 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:46.222 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:46.223 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:46.223 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:46.223 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:46.223 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 66 2024-04-25T22:53:46.223 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.223 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:46.223 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.223 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:46.223 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:46.223 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:46.223 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.223 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.223 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:46.223 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:46.224 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:46.224 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.224 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.224 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:46.224 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:46.224 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4099999999999998e-07 2024-04-25T22:53:46.224 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.224 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.224 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:46.224 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313252+0000", 2024-04-25T22:53:46.224 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5380000000000008e-06 2024-04-25T22:53:46.224 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.224 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.224 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:46.224 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313260+0000", 2024-04-25T22:53:46.225 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2609999999999993e-06 2024-04-25T22:53:46.225 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.225 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.225 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:46.225 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313265+0000", 2024-04-25T22:53:46.225 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4850000000000003e-06 2024-04-25T22:53:46.225 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.225 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.225 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:46.225 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313310+0000", 2024-04-25T22:53:46.225 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5247999999999998e-05 2024-04-25T22:53:46.225 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.225 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.225 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:46.226 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313370+0000", 2024-04-25T22:53:46.226 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0275000000000001e-05 2024-04-25T22:53:46.226 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.226 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.226 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:46.226 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313435+0000", 2024-04-25T22:53:46.226 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4647000000000006e-05 2024-04-25T22:53:46.226 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.226 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.226 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:46.226 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314174+0000", 2024-04-25T22:53:46.226 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00073925 2024-04-25T22:53:46.226 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.226 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.227 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:46.227 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320688+0000", 2024-04-25T22:53:46.227 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.006513418 2024-04-25T22:53:46.227 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.227 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.227 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:46.227 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320736+0000", 2024-04-25T22:53:46.227 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.8114e-05 2024-04-25T22:53:46.227 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.227 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.227 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:46.227 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320758+0000", 2024-04-25T22:53:46.227 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2776999999999999e-05 2024-04-25T22:53:46.227 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:46.228 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:46.228 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:46.228 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.228 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.228 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:68 4.31 4:8fb7f7b7:::10000000251.00000000:head [write 0~2067] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:46.228 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:46.228 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 14.846444826999999, 2024-04-25T22:53:46.228 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0087011669999999992, 2024-04-25T22:53:46.228 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:46.228 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:46.228 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:46.228 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:46.228 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:46.228 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:46.229 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 68 2024-04-25T22:53:46.229 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.229 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:46.229 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.229 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:46.229 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:46.229 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:46.229 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.229 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.229 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:46.229 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:46.229 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:46.229 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.229 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.230 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:46.230 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:46.230 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:53:46.230 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.230 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.230 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:46.230 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314933+0000", 2024-04-25T22:53:46.230 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5430000000000004e-06 2024-04-25T22:53:46.230 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.230 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.230 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:46.230 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314944+0000", 2024-04-25T22:53:46.230 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.076e-05 2024-04-25T22:53:46.230 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.231 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.231 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:46.231 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314949+0000", 2024-04-25T22:53:46.231 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1019999999999996e-06 2024-04-25T22:53:46.231 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.231 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.231 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:46.231 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314996+0000", 2024-04-25T22:53:46.231 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7018999999999998e-05 2024-04-25T22:53:46.231 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.231 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.231 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:46.231 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315064+0000", 2024-04-25T22:53:46.231 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8738000000000005e-05 2024-04-25T22:53:46.232 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.232 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.232 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:46.232 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323531+0000", 2024-04-25T22:53:46.232 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084664739999999999 2024-04-25T22:53:46.232 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.232 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.232 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:46.232 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323574+0000", 2024-04-25T22:53:46.232 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3449999999999999e-05 2024-04-25T22:53:46.232 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.232 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.232 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:46.232 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323629+0000", 2024-04-25T22:53:46.233 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4296999999999999e-05 2024-04-25T22:53:46.233 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:46.233 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:46.233 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:46.233 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.233 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.233 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4734.0:69 4.32 e46/13 4:4e8c6251:::10000000252.00000000:head v 46'1, mlcod=0'0)", 2024-04-25T22:53:46.233 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:46.233 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 14.845413559000001, 2024-04-25T22:53:46.233 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076063240000000002, 2024-04-25T22:53:46.233 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:46.233 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:46.233 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:46.234 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:46.234 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.234 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:46.234 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:46.234 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:46.234 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.234 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.234 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:46.234 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:46.234 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:46.234 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.234 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.234 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:46.234 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:46.235 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3099999999999997e-07 2024-04-25T22:53:46.235 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.235 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.235 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:46.235 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315964+0000", 2024-04-25T22:53:46.235 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3229999999999999e-06 2024-04-25T22:53:46.235 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.235 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.235 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:46.235 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315973+0000", 2024-04-25T22:53:46.235 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7249999999999992e-06 2024-04-25T22:53:46.235 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.235 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.235 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:46.236 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315978+0000", 2024-04-25T22:53:46.236 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4830000000000001e-06 2024-04-25T22:53:46.236 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.236 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.236 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:46.236 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.316043+0000", 2024-04-25T22:53:46.236 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.5036000000000005e-05 2024-04-25T22:53:46.236 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.236 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.236 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:46.236 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.316055+0000", 2024-04-25T22:53:46.236 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1973999999999999e-05 2024-04-25T22:53:46.236 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.237 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.237 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:46.237 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323521+0000", 2024-04-25T22:53:46.237 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074660239999999999 2024-04-25T22:53:46.237 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.237 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.237 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:46.237 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323565+0000", 2024-04-25T22:53:46.237 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4128000000000002e-05 2024-04-25T22:53:46.237 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:46.237 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:46.237 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:46.237 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.237 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.237 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:72 4.36 4:6cdfec98:::10000000255.00000000:head [write 0~4131] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:46.238 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:46.238 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 14.843369646999999, 2024-04-25T22:53:46.238 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084820680000000006, 2024-04-25T22:53:46.238 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:46.238 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:46.238 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:46.238 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:46.238 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:46.238 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:46.238 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 72 2024-04-25T22:53:46.238 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.238 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:46.238 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.239 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:46.239 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:46.239 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:46.239 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.239 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.239 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:46.239 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:46.239 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:46.239 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.239 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.239 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:46.239 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:46.239 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1800000000000005e-07 2024-04-25T22:53:46.239 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.240 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.240 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:46.240 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318010+0000", 2024-04-25T22:53:46.240 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7399999999999998e-06 2024-04-25T22:53:46.240 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.240 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.240 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:46.240 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318019+0000", 2024-04-25T22:53:46.240 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0170000000000002e-06 2024-04-25T22:53:46.240 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.240 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.240 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:46.240 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318024+0000", 2024-04-25T22:53:46.240 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0150000000000003e-06 2024-04-25T22:53:46.241 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.241 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.241 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:46.241 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318075+0000", 2024-04-25T22:53:46.241 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0537000000000001e-05 2024-04-25T22:53:46.241 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.241 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.241 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:46.241 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318144+0000", 2024-04-25T22:53:46.241 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9432999999999997e-05 2024-04-25T22:53:46.241 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.241 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.241 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:46.241 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326392+0000", 2024-04-25T22:53:46.242 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0082482979999999994 2024-04-25T22:53:46.242 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.242 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.242 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:46.242 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326432+0000", 2024-04-25T22:53:46.242 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9870000000000003e-05 2024-04-25T22:53:46.242 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.242 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.242 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:46.242 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326485+0000", 2024-04-25T22:53:46.242 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2439999999999999e-05 2024-04-25T22:53:46.242 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:46.242 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:46.243 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:46.243 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.243 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.243 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:74 4.10 4:08e6f8ca:::10000000257.00000000:head [write 0~839] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:46.243 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:53:46.243 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 14.841895919000001, 2024-04-25T22:53:46.243 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070370720000000001, 2024-04-25T22:53:46.243 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:46.243 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:46.243 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:46.243 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:46.243 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:46.243 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:46.243 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 74 2024-04-25T22:53:46.243 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.244 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:46.244 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.244 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:46.244 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:53:46.244 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:46.244 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.244 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.244 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:46.244 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:53:46.244 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:46.244 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.244 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.244 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:46.244 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319477+0000", 2024-04-25T22:53:46.245 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1999999999999999e-07 2024-04-25T22:53:46.245 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.245 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.245 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:46.245 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319483+0000", 2024-04-25T22:53:46.245 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4260000000000002e-06 2024-04-25T22:53:46.245 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.245 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.245 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:46.245 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319494+0000", 2024-04-25T22:53:46.245 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.094e-05 2024-04-25T22:53:46.245 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.245 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.245 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:46.245 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319499+0000", 2024-04-25T22:53:46.246 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3789999999999997e-06 2024-04-25T22:53:46.246 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.246 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.246 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:46.246 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319545+0000", 2024-04-25T22:53:46.246 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6149000000000001e-05 2024-04-25T22:53:46.246 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.246 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.246 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:46.246 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319617+0000", 2024-04-25T22:53:46.246 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1792999999999995e-05 2024-04-25T22:53:46.246 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.246 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.247 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:46.247 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326406+0000", 2024-04-25T22:53:46.247 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067895999999999998 2024-04-25T22:53:46.247 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.247 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.247 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:46.247 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326443+0000", 2024-04-25T22:53:46.247 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6828e-05 2024-04-25T22:53:46.247 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.247 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.247 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:46.247 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326514+0000", 2024-04-25T22:53:46.247 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0236999999999999e-05 2024-04-25T22:53:46.247 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:46.248 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:46.248 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:46.248 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.248 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.248 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:128 3.1f 3:f83d65d8:::200.00000004:head [write 876784~3317520 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e48)", 2024-04-25T22:53:46.248 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:36.985410+0000", 2024-04-25T22:53:46.248 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.1759623010000002, 2024-04-25T22:53:46.248 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0090177360000000002, 2024-04-25T22:53:46.248 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:46.248 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:46.248 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:46.248 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:46.248 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.248 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:46.249 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.985410+0000", 2024-04-25T22:53:46.249 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:46.249 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.249 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.249 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:46.249 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.985410+0000", 2024-04-25T22:53:46.249 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:46.249 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.249 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.249 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:46.249 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.985411+0000", 2024-04-25T22:53:46.249 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8400000000000003e-07 2024-04-25T22:53:46.249 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.249 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.250 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:46.250 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989116+0000", 2024-04-25T22:53:46.250 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037047389999999999 2024-04-25T22:53:46.250 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.250 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.250 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:46.250 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989128+0000", 2024-04-25T22:53:46.250 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1977999999999999e-05 2024-04-25T22:53:46.250 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.250 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.250 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:46.250 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989135+0000", 2024-04-25T22:53:46.250 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5290000000000003e-06 2024-04-25T22:53:46.250 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.251 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.251 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:46.251 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989181+0000", 2024-04-25T22:53:46.251 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6122999999999999e-05 2024-04-25T22:53:46.251 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.251 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.251 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:46.251 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989250+0000", 2024-04-25T22:53:46.251 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8535999999999996e-05 2024-04-25T22:53:46.251 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.251 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.251 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:46.251 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.994272+0000", 2024-04-25T22:53:46.251 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050224889999999998 2024-04-25T22:53:46.252 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.252 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.252 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:46.252 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.994335+0000", 2024-04-25T22:53:46.252 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2588000000000005e-05 2024-04-25T22:53:46.252 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.252 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.252 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:46.252 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.994428+0000", 2024-04-25T22:53:46.252 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2869999999999997e-05 2024-04-25T22:53:46.252 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:46.252 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:46.252 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:46.252 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.253 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.253 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:2150 4.22 4:47cffac6:::10000000a2b.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T22:53:46.253 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:41.078233+0000", 2024-04-25T22:53:46.253 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 5.0831389910000002, 2024-04-25T22:53:46.253 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069201510000000003, 2024-04-25T22:53:46.253 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:46.253 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:46.253 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:46.253 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:46.253 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.253 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:46.253 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078233+0000", 2024-04-25T22:53:46.253 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:46.253 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.254 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.254 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:46.254 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078233+0000", 2024-04-25T22:53:46.254 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:46.254 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.254 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.254 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:46.254 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078234+0000", 2024-04-25T22:53:46.254 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1699999999999998e-07 2024-04-25T22:53:46.254 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.254 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.254 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:46.254 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078236+0000", 2024-04-25T22:53:46.254 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.875e-06 2024-04-25T22:53:46.255 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.255 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.255 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:46.255 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078242+0000", 2024-04-25T22:53:46.255 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2450000000000003e-06 2024-04-25T22:53:46.255 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.255 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.255 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:46.255 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078247+0000", 2024-04-25T22:53:46.255 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7450000000000003e-06 2024-04-25T22:53:46.255 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.255 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.255 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:46.255 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078641+0000", 2024-04-25T22:53:46.255 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00039420200000000002 2024-04-25T22:53:46.256 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.256 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.256 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:46.256 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078840+0000", 2024-04-25T22:53:46.256 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000199063 2024-04-25T22:53:46.256 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.256 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.256 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:46.256 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078919+0000", 2024-04-25T22:53:46.256 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9182000000000002e-05 2024-04-25T22:53:46.256 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.256 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.256 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:46.256 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.080906+0000", 2024-04-25T22:53:46.256 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0019866390000000001 2024-04-25T22:53:46.257 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.257 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.257 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:46.257 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085074+0000", 2024-04-25T22:53:46.257 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0041683639999999999 2024-04-25T22:53:46.257 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.257 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.257 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:46.257 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085117+0000", 2024-04-25T22:53:46.257 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2849999999999998e-05 2024-04-25T22:53:46.257 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.257 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.257 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:46.257 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085154+0000", 2024-04-25T22:53:46.257 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6468999999999999e-05 2024-04-25T22:53:46.258 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:46.258 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:46.258 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:46.258 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.258 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.258 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:2160 4.2a 4:57f9ed86:::10000000a3d.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T22:53:46.258 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:53:46.258 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 5.0826697010000004, 2024-04-25T22:53:46.258 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0068959959999999997, 2024-04-25T22:53:46.258 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:46.258 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:46.258 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:46.258 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:46.258 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.258 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:46.259 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:53:46.259 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:46.259 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.259 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.259 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:46.259 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:53:46.259 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:46.259 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.259 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.259 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:46.259 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:53:46.259 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7000000000000004e-07 2024-04-25T22:53:46.259 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.259 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.259 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:46.260 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078707+0000", 2024-04-25T22:53:46.260 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.783e-06 2024-04-25T22:53:46.260 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.260 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.260 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:46.260 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078716+0000", 2024-04-25T22:53:46.260 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4800000000000001e-06 2024-04-25T22:53:46.260 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.260 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.260 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:46.260 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078724+0000", 2024-04-25T22:53:46.260 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1519999999999992e-06 2024-04-25T22:53:46.260 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.260 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.261 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:46.261 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078794+0000", 2024-04-25T22:53:46.261 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0500999999999995e-05 2024-04-25T22:53:46.261 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.261 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.261 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:46.261 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078912+0000", 2024-04-25T22:53:46.261 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000117439 2024-04-25T22:53:46.261 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.261 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.261 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:46.261 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079000+0000", 2024-04-25T22:53:46.261 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8092999999999998e-05 2024-04-25T22:53:46.261 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.261 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.262 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:46.262 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.080897+0000", 2024-04-25T22:53:46.262 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0018970899999999999 2024-04-25T22:53:46.262 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.262 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.262 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:46.262 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085517+0000", 2024-04-25T22:53:46.262 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0046198929999999999 2024-04-25T22:53:46.262 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.262 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.262 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:46.262 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085565+0000", 2024-04-25T22:53:46.262 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7777e-05 2024-04-25T22:53:46.262 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.262 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.263 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:46.263 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085599+0000", 2024-04-25T22:53:46.263 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4017999999999999e-05 2024-04-25T22:53:46.263 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:46.263 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:46.263 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:46.263 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.263 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.263 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:2163 4.2a 4:549f79e3:::10000000a43.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T22:53:46.263 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:53:46.263 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 5.0826363480000003, 2024-04-25T22:53:46.263 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069469190000000002, 2024-04-25T22:53:46.263 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:46.263 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:46.264 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:46.264 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:46.264 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.264 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:46.264 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:53:46.264 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:46.264 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.264 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.264 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:46.264 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:53:46.264 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:46.264 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.264 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.264 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:46.264 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:53:46.265 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1399999999999997e-07 2024-04-25T22:53:46.265 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.265 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.265 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:46.265 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078739+0000", 2024-04-25T22:53:46.265 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2960000000000001e-06 2024-04-25T22:53:46.265 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.265 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.265 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:46.265 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078745+0000", 2024-04-25T22:53:46.265 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3439999999999997e-06 2024-04-25T22:53:46.265 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.265 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.265 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:46.265 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078750+0000", 2024-04-25T22:53:46.265 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3179999999999997e-06 2024-04-25T22:53:46.266 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.266 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.266 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:46.266 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079224+0000", 2024-04-25T22:53:46.266 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00047334999999999999 2024-04-25T22:53:46.266 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.266 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.266 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:46.266 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079292+0000", 2024-04-25T22:53:46.266 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8708999999999996e-05 2024-04-25T22:53:46.266 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.266 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.266 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:46.266 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079342+0000", 2024-04-25T22:53:46.267 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9299999999999999e-05 2024-04-25T22:53:46.267 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.267 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.267 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:46.267 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.081611+0000", 2024-04-25T22:53:46.267 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0022695229999999999 2024-04-25T22:53:46.267 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.267 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.267 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:46.267 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085605+0000", 2024-04-25T22:53:46.267 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0039933679999999997 2024-04-25T22:53:46.267 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.267 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.267 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:46.267 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085650+0000", 2024-04-25T22:53:46.268 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5111000000000002e-05 2024-04-25T22:53:46.268 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:46.268 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:46.268 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:46.268 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085683+0000", 2024-04-25T22:53:46.268 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3185999999999997e-05 2024-04-25T22:53:46.268 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:46.268 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:46.268 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:46.268 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:46.268 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:46.268 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:46.270 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:46.268+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:46.271 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:46.271 INFO:tasks.workunit.client.0.smithi052.stdout:checking xfs/handle.h usability... yes 2024-04-25T22:53:46.271 INFO:tasks.workunit.client.0.smithi052.stdout:checking xfs/handle.h presence... yes 2024-04-25T22:53:46.271 INFO:tasks.workunit.client.0.smithi052.stdout:checking for xfs/handle.h... yes 2024-04-25T22:53:46.271 INFO:tasks.workunit.client.0.smithi052.stdout:checking for attr_list_by_handle in -lhandle... yes 2024-04-25T22:53:46.272 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-25T22:53:46.272 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:53:46.272 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:53:46.274 INFO:tasks.workunit.client.0.smithi052.stdout:checking attr/attributes.h usability... yes 2024-04-25T22:53:46.284 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-25T22:53:46.284 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:53:46.287 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:53:46.287 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:53:46.288 INFO:tasks.workunit.client.0.smithi052.stdout:checking attr/attributes.h presence... yes 2024-04-25T22:53:46.288 INFO:tasks.workunit.client.0.smithi052.stdout:checking for attr/attributes.h... yes 2024-04-25T22:53:46.333 INFO:tasks.workunit.client.0.smithi052.stdout:checking sys/attributes.h usability... no 2024-04-25T22:53:46.356 INFO:tasks.workunit.client.0.smithi052.stdout:checking sys/attributes.h presence... no 2024-04-25T22:53:46.356 INFO:tasks.workunit.client.0.smithi052.stdout:checking for sys/attributes.h... no 2024-04-25T22:53:46.370 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:46.369+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:46.375 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:46.375 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:46.384 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:46.406 INFO:tasks.workunit.client.0.smithi052.stdout:checking for attr_list in -lattr... yes 2024-04-25T22:53:46.456 INFO:tasks.workunit.client.0.smithi052.stdout:checking for attr_set in -lattr... yes 2024-04-25T22:53:46.471 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:46.470+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:46.485 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:46.485 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:46.494 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:46.499 INFO:tasks.workunit.client.0.smithi052.stdout:checking sys/acl.h usability... yes 2024-04-25T22:53:46.514 INFO:tasks.workunit.client.0.smithi052.stdout:checking sys/acl.h presence... yes 2024-04-25T22:53:46.514 INFO:tasks.workunit.client.0.smithi052.stdout:checking for sys/acl.h... yes 2024-04-25T22:53:46.548 INFO:tasks.workunit.client.0.smithi052.stdout:checking acl/libacl.h usability... yes 2024-04-25T22:53:46.562 INFO:tasks.workunit.client.0.smithi052.stdout:checking acl/libacl.h presence... yes 2024-04-25T22:53:46.563 INFO:tasks.workunit.client.0.smithi052.stdout:checking for acl/libacl.h... yes 2024-04-25T22:53:46.572 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:46.572+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:46.595 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:46.596 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:46.604 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:46.613 INFO:tasks.workunit.client.0.smithi052.stdout:checking for acl_init in -lacl... yes 2024-04-25T22:53:46.649 INFO:tasks.workunit.client.0.smithi052.stdout:checking gdbm-ndbm.h usability... no 2024-04-25T22:53:46.670 INFO:tasks.workunit.client.0.smithi052.stdout:checking gdbm-ndbm.h presence... no 2024-04-25T22:53:46.671 INFO:tasks.workunit.client.0.smithi052.stdout:checking for gdbm-ndbm.h... no 2024-04-25T22:53:46.673 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:46.672+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:46.704 INFO:tasks.workunit.client.0.smithi052.stdout:checking gdbm/ndbm.h usability... no 2024-04-25T22:53:46.708 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:46.709 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:46.717 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:46.725 INFO:tasks.workunit.client.0.smithi052.stdout:checking gdbm/ndbm.h presence... no 2024-04-25T22:53:46.725 INFO:tasks.workunit.client.0.smithi052.stdout:checking for gdbm/ndbm.h... no 2024-04-25T22:53:46.765 INFO:tasks.workunit.client.0.smithi052.stdout:checking ndbm.h usability... no 2024-04-25T22:53:46.786 INFO:tasks.workunit.client.0.smithi052.stdout:checking ndbm.h presence... no 2024-04-25T22:53:46.787 INFO:tasks.workunit.client.0.smithi052.stdout:checking for ndbm.h... no 2024-04-25T22:53:46.800 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:46.799+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:46.819 INFO:tasks.workunit.client.0.smithi052.stdout:checking libaio.h usability... yes 2024-04-25T22:53:46.835 INFO:tasks.workunit.client.0.smithi052.stdout:checking libaio.h presence... yes 2024-04-25T22:53:46.835 INFO:tasks.workunit.client.0.smithi052.stdout:checking for libaio.h... yes 2024-04-25T22:53:46.860 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:46.861 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:46.870 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:46.876 INFO:tasks.workunit.client.0.smithi052.stdout:checking for dm_make_handle in -ldm... no 2024-04-25T22:53:46.877 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-04-25T22:53:46.877 INFO:tasks.workunit.client.0.smithi052.stdout:WARNING: could not find a valid DMAPI base library. 2024-04-25T22:53:46.877 INFO:tasks.workunit.client.0.smithi052.stdout:If you want DMAPI support please install the data migration 2024-04-25T22:53:46.877 INFO:tasks.workunit.client.0.smithi052.stdout:API (dmapi) library package. Alternatively, run "make install" 2024-04-25T22:53:46.877 INFO:tasks.workunit.client.0.smithi052.stdout:from the dmapi source. 2024-04-25T22:53:46.877 INFO:tasks.workunit.client.0.smithi052.stdout: 2024-04-25T22:53:46.909 INFO:tasks.workunit.client.0.smithi052.stdout:checking linux/fiemap.h usability... yes 2024-04-25T22:53:46.911 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:46.910+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:46.922 INFO:tasks.workunit.client.0.smithi052.stdout:checking linux/fiemap.h presence... yes 2024-04-25T22:53:46.922 INFO:tasks.workunit.client.0.smithi052.stdout:checking for linux/fiemap.h... yes 2024-04-25T22:53:46.972 INFO:tasks.workunit.client.0.smithi052.stdout:checking for fallocate... yes 2024-04-25T22:53:46.976 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:46.975+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:47.012 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:47.012 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:47.020 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:47.033 INFO:tasks.workunit.client.0.smithi052.stdout:checking for open_by_handle_at... yes 2024-04-25T22:53:47.077 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:47.075+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:47.077 INFO:tasks.workunit.client.0.smithi052.stdout:checking sys/prctl.h usability... yes 2024-04-25T22:53:47.091 INFO:tasks.workunit.client.0.smithi052.stdout:checking sys/prctl.h presence... yes 2024-04-25T22:53:47.091 INFO:tasks.workunit.client.0.smithi052.stdout:checking for sys/prctl.h... yes 2024-04-25T22:53:47.125 INFO:tasks.workunit.client.0.smithi052.stdout:checking linux/fs.h usability... yes 2024-04-25T22:53:47.127 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:47.127 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:47.136 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:47.139 INFO:tasks.workunit.client.0.smithi052.stdout:checking linux/fs.h presence... yes 2024-04-25T22:53:47.139 INFO:tasks.workunit.client.0.smithi052.stdout:checking for linux/fs.h... yes 2024-04-25T22:53:47.174 INFO:tasks.workunit.client.0.smithi052.stdout:checking btrfsutil.h usability... no 2024-04-25T22:53:47.182 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:47.179+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:47.196 INFO:tasks.workunit.client.0.smithi052.stdout:checking btrfsutil.h presence... no 2024-04-25T22:53:47.196 INFO:tasks.workunit.client.0.smithi052.stdout:checking for btrfsutil.h... no 2024-04-25T22:53:47.238 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:47.238 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:47.247 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:47.248 INFO:tasks.workunit.client.0.smithi052.stdout:checking for copy_file_range... yes 2024-04-25T22:53:47.289 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:47.288+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:47.301 INFO:tasks.workunit.client.0.smithi052.stdout:checking for renameat2... yes 2024-04-25T22:53:47.320 INFO:tasks.workunit.client.0.smithi052.stdout:configure: creating ./config.status 2024-04-25T22:53:47.367 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-25T22:53:47.379 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:47.379+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:47.389 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:47.389 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:47.397 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:47.481 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:47.480+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:47.499 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:47.499 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:47.508 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:47.582 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:47.581+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:47.609 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:47.610 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:47.618 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:47.654 INFO:tasks.workunit.client.0.smithi052.stdout:config.status: creating include/builddefs 2024-04-25T22:53:47.670 INFO:tasks.workunit.client.0.smithi052.stdout:config.status: creating include/config.h 2024-04-25T22:53:47.682 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:47.681+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:47.683 INFO:tasks.workunit.client.0.smithi052.stdout:config.status: executing libtool commands 2024-04-25T22:53:47.721 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:47.722 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:47.730 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:47.780 INFO:tasks.workunit.client.0.smithi052.stdout:Building lib 2024-04-25T22:53:47.780 INFO:tasks.workunit.client.0.smithi052.stdout:Building include 2024-04-25T22:53:47.780 INFO:tasks.workunit.client.0.smithi052.stdout:Building tests 2024-04-25T22:53:47.783 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:47.783+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:47.792 INFO:tasks.workunit.client.0.smithi052.stdout: [LTDEP] 2024-04-25T22:53:47.833 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:47.833 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:47.841 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:47.845 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~65s 2024-04-25T22:53:47.885 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:47.884+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:47.984 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:47.984+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:47.985 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:47.986 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:47.994 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:48.086 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:48.085+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:48.098 INFO:tasks.workunit.client.0.smithi052.stdout: [CC] dataascii.lo 2024-04-25T22:53:48.098 INFO:tasks.workunit.client.0.smithi052.stdout: [CC] databin.lo 2024-04-25T22:53:48.098 INFO:tasks.workunit.client.0.smithi052.stdout: [CC] datapid.lo 2024-04-25T22:53:48.099 INFO:tasks.workunit.client.0.smithi052.stdout: [CC] file_lock.lo 2024-04-25T22:53:48.141 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:48.141 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:48.149 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:48.193 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:48.192+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:48.254 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:48.254 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:48.263 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:48.266 INFO:tasks.workunit.client.0.smithi052.stdout: [CC] forker.lo 2024-04-25T22:53:48.277 INFO:tasks.workunit.client.0.smithi052.stdout: [CC] pattern.lo 2024-04-25T22:53:48.288 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:53:48.304 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:48.303+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:48.348 INFO:tasks.workunit.client.0.smithi052.stdout: [CC] open_flags.lo 2024-04-25T22:53:48.355 INFO:tasks.workunit.client.0.smithi052.stdout: [CC] random_range.lo 2024-04-25T22:53:48.360 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is unset 2024-04-25T22:53:48.388 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:48.387+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:48.408 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:48.408 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:48.417 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:48.459 INFO:tasks.workunit.client.0.smithi052.stdout: [CC] string_to_tokens.lo 2024-04-25T22:53:48.469 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-25T22:53:48.469 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:53:48.469 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:53:48.491 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-25T22:53:48.491 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:53:48.496 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:53:48.497 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:53:48.498 INFO:tasks.workunit.client.0.smithi052.stdout: [CC] str_to_bytes.lo 2024-04-25T22:53:48.501 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:48.500+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:48.563 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:48.563 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:53:48.563 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:53:48.563 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:53:48.563 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.563 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:53:48.563 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:48.563 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 120.593974999, 2024-04-25T22:53:48.563 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:53:48.563 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:48.564 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:48.564 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:48.564 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:48.564 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.564 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:48.564 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:48.564 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:48.564 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.564 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.564 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:48.564 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:48.565 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:48.565 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.565 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.565 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:48.565 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:53:48.565 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:53:48.565 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.565 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.565 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:48.565 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:53:48.565 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:53:48.565 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.565 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.566 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:48.566 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:53:48.566 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:53:48.566 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.566 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.566 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:48.566 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:53:48.566 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:53:48.566 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.566 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.566 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:48.566 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:53:48.566 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:53:48.567 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.567 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.567 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:48.567 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:53:48.567 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:53:48.567 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.567 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.567 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:48.567 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:53:48.567 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:53:48.567 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.567 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.567 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:48.567 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:53:48.568 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:53:48.568 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:48.568 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:48.568 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:48.568 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.568 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.568 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:48.568 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:48.568 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 115.5494793, 2024-04-25T22:53:48.568 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:53:48.568 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:48.568 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:48.568 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:48.568 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:48.569 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.569 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:48.569 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:48.569 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:48.569 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.569 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.569 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:48.569 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:48.569 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:48.569 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.569 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.569 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:48.569 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:53:48.569 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:53:48.570 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.570 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.570 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:48.570 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:53:48.570 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:53:48.570 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.570 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.570 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:48.570 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:53:48.570 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:53:48.570 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.570 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.570 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:48.571 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:53:48.571 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:53:48.571 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.571 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.571 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:48.571 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:53:48.571 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:53:48.571 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.571 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.571 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:48.571 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:53:48.571 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:53:48.571 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.571 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.572 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:48.572 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:53:48.572 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:53:48.572 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.572 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.572 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:48.572 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:53:48.572 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:53:48.572 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.572 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.572 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:48.572 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:53:48.573 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:53:48.573 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.573 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.573 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:48.573 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:53:48.573 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:53:48.573 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.573 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.573 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:48.573 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:53:48.573 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:53:48.573 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:48.573 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:48.573 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:48.574 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.574 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.574 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:48.574 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:48.574 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 115.548804924, 2024-04-25T22:53:48.574 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:53:48.574 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:48.575 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:48.575 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:48.575 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:48.575 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.575 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:48.575 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:48.575 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:48.575 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.575 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.575 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:48.575 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:48.575 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:48.575 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.575 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.576 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:48.576 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:53:48.576 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:53:48.576 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.576 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.576 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:48.576 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:53:48.576 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:53:48.576 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.576 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.576 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:48.576 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:53:48.576 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:53:48.577 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.577 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.577 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:48.577 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:53:48.577 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:53:48.577 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.577 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.577 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:48.577 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:53:48.577 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:53:48.577 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.577 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.577 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:48.577 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:53:48.578 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:53:48.578 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.578 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.578 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:48.578 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:53:48.578 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:53:48.578 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.579 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.579 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:48.579 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:53:48.579 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:53:48.579 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.579 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.579 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:48.579 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:53:48.579 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:53:48.579 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.579 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.579 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:48.579 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:53:48.579 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:53:48.580 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.580 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.580 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:48.580 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:53:48.580 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:53:48.580 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:48.580 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:48.580 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:48.580 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.580 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.580 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:48.580 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:48.580 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 115.548295712, 2024-04-25T22:53:48.580 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:53:48.581 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:48.581 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:48.581 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:48.581 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:48.581 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.581 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:48.581 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:48.581 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:48.581 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.581 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.581 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:48.581 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:48.581 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:48.581 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.582 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.582 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:48.582 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:53:48.582 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:53:48.582 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.582 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.582 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:48.582 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:53:48.583 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:53:48.583 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.583 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.583 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:48.583 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:53:48.583 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:53:48.583 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.583 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.583 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:48.583 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:53:48.583 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:53:48.583 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.584 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.584 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:48.584 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:53:48.584 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:53:48.584 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.584 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.584 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:48.584 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:53:48.584 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:53:48.584 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.585 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.585 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:48.585 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:53:48.585 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:53:48.585 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.585 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.585 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:48.585 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:53:48.585 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:53:48.585 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.585 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.585 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:48.585 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:53:48.585 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:53:48.586 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.586 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.586 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:48.586 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:53:48.586 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:53:48.586 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.586 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.586 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:48.587 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:53:48.587 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:53:48.587 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:48.587 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:48.587 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:48.587 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.587 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.587 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:48.587 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:48.587 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 115.54788251399999, 2024-04-25T22:53:48.587 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:53:48.588 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:48.588 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:48.588 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:48.588 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:48.589 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.589 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:48.589 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:48.589 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:48.589 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.589 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.589 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:48.589 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:48.589 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:48.589 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.589 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.589 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:48.589 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:48.589 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:53:48.590 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.590 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.590 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:48.590 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:48.590 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:53:48.590 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.590 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.590 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:48.590 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:53:48.590 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:53:48.590 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.590 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.591 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:48.591 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:53:48.591 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:53:48.591 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.591 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.591 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:48.591 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:53:48.591 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:53:48.591 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.591 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.591 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:48.591 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:53:48.591 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:53:48.591 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.592 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.592 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:48.592 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:53:48.592 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:53:48.592 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.592 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.592 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:48.592 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:53:48.592 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:53:48.592 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.592 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.592 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:48.592 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:53:48.592 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:53:48.593 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.593 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.593 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:48.593 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:53:48.593 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:53:48.593 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.593 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.593 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:48.593 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:53:48.593 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:53:48.593 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:48.593 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:48.593 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:48.594 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.594 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.594 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:48.594 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:48.594 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 115.547831844, 2024-04-25T22:53:48.594 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:53:48.594 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:48.594 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:48.594 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:48.594 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:48.594 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.594 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:48.594 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:48.595 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:48.595 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.595 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.595 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:48.595 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:48.595 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:48.595 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.595 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.595 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:48.595 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:53:48.595 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:53:48.595 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.595 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.596 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:48.596 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:53:48.596 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:53:48.596 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.596 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.596 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:48.596 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:53:48.596 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:53:48.596 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.596 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.596 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:48.596 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:53:48.596 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:53:48.596 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.597 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.597 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:48.597 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:53:48.597 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:53:48.597 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.597 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.597 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:48.597 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:53:48.597 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:53:48.597 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.597 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.597 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:48.597 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:53:48.598 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:53:48.598 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.598 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.598 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:48.598 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:53:48.598 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:53:48.598 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.598 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.598 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:48.598 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:53:48.598 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:53:48.598 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.598 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.599 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:48.599 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:53:48.599 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:53:48.599 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.599 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.599 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:48.599 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:53:48.599 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:53:48.599 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.599 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.599 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:48.599 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:53:48.599 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:53:48.600 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.600 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.600 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:48.600 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:53:48.600 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:53:48.600 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:48.600 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:48.600 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:48.600 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.600 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.600 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:48.600 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:48.600 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 115.547794975, 2024-04-25T22:53:48.600 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:53:48.601 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:48.601 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:48.601 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:48.601 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:48.601 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.601 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:48.601 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:48.601 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:48.601 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.601 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.601 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:48.601 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:48.601 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:48.602 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.602 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.602 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:48.602 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:53:48.602 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:53:48.602 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.602 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.602 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:48.602 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:53:48.602 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:53:48.602 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.602 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.602 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:48.603 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:53:48.603 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:53:48.603 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.603 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.603 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:48.603 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:53:48.603 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:53:48.603 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.603 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.603 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:48.603 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:53:48.603 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:53:48.603 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.603 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.604 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:53:48.604 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:53:48.604 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:53:48.604 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.604 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.604 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:48.604 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:53:48.604 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:53:48.604 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.604 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.604 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:48.604 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:53:48.604 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:53:48.604 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.605 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.605 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:48.605 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:53:48.605 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:53:48.605 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.605 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.605 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:48.605 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:53:48.605 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:53:48.605 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.605 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.605 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:48.605 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:53:48.606 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:53:48.606 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.606 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.606 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:48.606 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:53:48.606 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:53:48.606 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.606 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.606 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:48.606 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:53:48.606 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:53:48.606 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:48.606 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:48.606 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:48.607 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.607 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.607 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:48.607 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:48.607 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 115.547770009, 2024-04-25T22:53:48.607 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:53:48.607 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:48.607 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:48.607 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:48.607 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:48.607 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.607 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:48.607 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:48.608 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:48.608 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.608 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.608 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:48.608 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:48.608 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:48.608 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.608 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.608 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:48.608 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:53:48.608 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:53:48.608 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.608 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.609 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:48.609 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:53:48.609 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:53:48.609 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.609 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.609 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:48.609 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:48.609 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:53:48.609 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.609 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.609 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:48.609 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:53:48.610 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:53:48.610 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.610 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.610 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:48.610 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:53:48.610 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:53:48.610 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.610 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.610 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:48.610 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:53:48.610 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:53:48.610 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.610 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.611 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:48.611 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:53:48.611 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:53:48.611 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.611 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.611 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:48.611 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:53:48.611 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:53:48.611 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.611 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.611 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:48.611 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:53:48.611 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:53:48.611 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.612 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.612 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:48.612 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:53:48.612 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:53:48.612 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.612 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.612 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:48.612 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:53:48.612 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:53:48.612 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:48.612 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:48.612 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:48.612 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.613 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.613 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:48.613 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:48.613 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 115.54773364499999, 2024-04-25T22:53:48.613 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:53:48.613 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:48.613 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:48.613 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:48.613 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:48.613 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.613 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:48.613 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:48.613 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:48.613 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.614 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.614 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:48.614 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:48.614 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:48.614 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.614 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.614 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:48.614 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:53:48.614 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:53:48.614 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.614 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.614 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:48.614 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:53:48.615 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:53:48.615 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.615 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.615 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:48.615 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:53:48.615 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:53:48.615 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.615 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.615 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:48.615 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:53:48.615 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:53:48.615 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.615 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.615 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:48.616 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:53:48.616 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:53:48.616 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.616 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.616 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:48.616 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:53:48.616 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:53:48.616 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.616 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.616 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:48.616 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:53:48.616 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:53:48.616 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.616 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.617 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:48.617 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:53:48.617 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:53:48.617 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.617 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.617 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:48.617 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:53:48.617 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:53:48.617 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:48.617 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:48.617 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:48.617 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.617 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.618 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:48.618 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:48.618 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 115.54770256400001, 2024-04-25T22:53:48.618 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:53:48.618 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:48.618 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:48.618 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:48.618 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:48.618 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.618 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:48.618 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:48.618 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:48.618 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.618 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.619 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:48.619 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:48.619 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:48.619 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.619 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.619 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:48.619 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:48.619 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:48.619 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.619 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.619 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:48.619 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:53:48.619 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:53:48.620 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.620 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.620 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:48.620 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:53:48.620 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:53:48.620 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.620 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.620 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:48.620 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:53:48.620 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:53:48.620 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.620 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.620 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:48.620 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:53:48.621 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:53:48.621 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.621 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.621 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:48.621 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:53:48.621 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:53:48.621 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.621 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.621 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:48.621 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:53:48.621 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:53:48.621 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:48.621 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:48.621 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:48.622 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.622 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.622 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:30 4.31 4:8ebfc112:::1000000021d.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-25T22:53:48.622 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:53:48.622 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 17.508016693999998, 2024-04-25T22:53:48.622 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015003005, 2024-04-25T22:53:48.622 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:48.622 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:48.622 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:48.622 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:48.622 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:48.622 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:48.622 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 30 2024-04-25T22:53:48.622 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.623 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:48.623 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.623 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:48.623 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:53:48.623 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:48.623 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.623 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.623 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:48.623 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:53:48.623 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:48.623 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.623 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.623 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:48.624 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053133+0000", 2024-04-25T22:53:48.624 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0370000000000001e-06 2024-04-25T22:53:48.624 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.624 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.624 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:48.624 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060377+0000", 2024-04-25T22:53:48.624 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0072431070000000004 2024-04-25T22:53:48.624 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.624 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.624 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:48.624 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060388+0000", 2024-04-25T22:53:48.624 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1285e-05 2024-04-25T22:53:48.624 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.625 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.625 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:48.625 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060394+0000", 2024-04-25T22:53:48.625 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1040000000000003e-06 2024-04-25T22:53:48.625 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.625 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.625 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:48.625 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060483+0000", 2024-04-25T22:53:48.625 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.9345000000000006e-05 2024-04-25T22:53:48.625 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.625 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.625 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:48.625 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060566+0000", 2024-04-25T22:53:48.625 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2237999999999994e-05 2024-04-25T22:53:48.626 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.626 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.626 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:48.626 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068057+0000", 2024-04-25T22:53:48.626 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074912210000000002 2024-04-25T22:53:48.626 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.626 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.626 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:48.626 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068090+0000", 2024-04-25T22:53:48.626 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3501000000000003e-05 2024-04-25T22:53:48.626 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.626 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.626 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:48.627 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068134+0000", 2024-04-25T22:53:48.627 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4166999999999999e-05 2024-04-25T22:53:48.627 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:48.627 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:48.627 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:48.627 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.627 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.627 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:66 4.27 4:e5671758:::1000000024f.00000000:head [write 0~6641] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:48.627 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:48.627 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 17.247906358000002, 2024-04-25T22:53:48.627 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075166540000000002, 2024-04-25T22:53:48.627 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:48.627 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:48.628 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:48.628 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:48.628 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:48.628 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:48.628 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 66 2024-04-25T22:53:48.628 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.628 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:48.628 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.628 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:48.628 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:48.628 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:48.628 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.628 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.628 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:48.629 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:48.629 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:48.629 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.629 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.629 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:48.629 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:48.629 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4099999999999998e-07 2024-04-25T22:53:48.629 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.629 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.629 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:48.629 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313252+0000", 2024-04-25T22:53:48.629 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5380000000000008e-06 2024-04-25T22:53:48.629 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.630 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.630 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:48.630 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313260+0000", 2024-04-25T22:53:48.630 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2609999999999993e-06 2024-04-25T22:53:48.630 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.630 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.630 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:48.630 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313265+0000", 2024-04-25T22:53:48.630 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4850000000000003e-06 2024-04-25T22:53:48.630 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.630 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.630 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:48.630 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313310+0000", 2024-04-25T22:53:48.630 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5247999999999998e-05 2024-04-25T22:53:48.631 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.631 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.631 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:48.631 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313370+0000", 2024-04-25T22:53:48.631 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0275000000000001e-05 2024-04-25T22:53:48.631 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.631 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.631 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:48.631 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313435+0000", 2024-04-25T22:53:48.631 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4647000000000006e-05 2024-04-25T22:53:48.631 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.631 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.631 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:48.632 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314174+0000", 2024-04-25T22:53:48.632 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00073925 2024-04-25T22:53:48.632 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.632 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.632 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:48.632 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320688+0000", 2024-04-25T22:53:48.632 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.006513418 2024-04-25T22:53:48.632 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.632 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.632 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:48.632 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320736+0000", 2024-04-25T22:53:48.632 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.8114e-05 2024-04-25T22:53:48.632 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.632 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.633 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:48.633 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320758+0000", 2024-04-25T22:53:48.633 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2776999999999999e-05 2024-04-25T22:53:48.633 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:48.633 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:48.633 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:48.633 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.633 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.633 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:68 4.31 4:8fb7f7b7:::10000000251.00000000:head [write 0~2067] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:48.633 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:48.633 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 17.246220579999999, 2024-04-25T22:53:48.633 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0087011669999999992, 2024-04-25T22:53:48.633 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:48.634 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:48.634 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:48.634 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:48.634 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:48.634 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:48.634 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 68 2024-04-25T22:53:48.634 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.634 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:48.634 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.634 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:48.634 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:48.634 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:48.634 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.635 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.635 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:48.635 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:48.635 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:48.635 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.635 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.635 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:48.635 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:48.635 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:53:48.635 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.635 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.635 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:48.635 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314933+0000", 2024-04-25T22:53:48.635 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5430000000000004e-06 2024-04-25T22:53:48.636 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.636 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.636 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:48.636 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314944+0000", 2024-04-25T22:53:48.636 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.076e-05 2024-04-25T22:53:48.636 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.636 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.636 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:48.636 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314949+0000", 2024-04-25T22:53:48.636 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1019999999999996e-06 2024-04-25T22:53:48.636 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.636 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.636 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:48.636 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314996+0000", 2024-04-25T22:53:48.637 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7018999999999998e-05 2024-04-25T22:53:48.637 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.637 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.637 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:48.637 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315064+0000", 2024-04-25T22:53:48.637 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8738000000000005e-05 2024-04-25T22:53:48.637 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.637 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.637 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:48.637 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323531+0000", 2024-04-25T22:53:48.637 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084664739999999999 2024-04-25T22:53:48.637 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.637 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.638 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:48.638 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323574+0000", 2024-04-25T22:53:48.638 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3449999999999999e-05 2024-04-25T22:53:48.638 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.638 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.638 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:48.638 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323629+0000", 2024-04-25T22:53:48.638 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4296999999999999e-05 2024-04-25T22:53:48.638 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:48.638 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:48.638 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:48.638 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.638 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.639 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4734.0:69 4.32 e46/13 4:4e8c6251:::10000000252.00000000:head v 46'1, mlcod=0'0)", 2024-04-25T22:53:48.639 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:48.639 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 17.245189312000001, 2024-04-25T22:53:48.639 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076063240000000002, 2024-04-25T22:53:48.639 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:48.639 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:48.639 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:48.639 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:48.639 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.639 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:48.639 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:48.639 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:48.639 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.639 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.640 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:48.640 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:48.640 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:48.640 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.640 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.640 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:48.640 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:48.640 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3099999999999997e-07 2024-04-25T22:53:48.640 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.640 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.640 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:48.640 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315964+0000", 2024-04-25T22:53:48.640 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3229999999999999e-06 2024-04-25T22:53:48.641 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.641 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.641 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:48.641 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315973+0000", 2024-04-25T22:53:48.641 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7249999999999992e-06 2024-04-25T22:53:48.641 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.641 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.641 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:48.641 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315978+0000", 2024-04-25T22:53:48.641 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4830000000000001e-06 2024-04-25T22:53:48.641 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.641 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.641 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:48.642 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.316043+0000", 2024-04-25T22:53:48.642 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.5036000000000005e-05 2024-04-25T22:53:48.642 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.642 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.642 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:48.642 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.316055+0000", 2024-04-25T22:53:48.642 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1973999999999999e-05 2024-04-25T22:53:48.642 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.642 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.642 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:48.642 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323521+0000", 2024-04-25T22:53:48.642 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074660239999999999 2024-04-25T22:53:48.642 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.643 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.643 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:48.643 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323565+0000", 2024-04-25T22:53:48.643 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4128000000000002e-05 2024-04-25T22:53:48.643 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:48.643 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:48.643 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:48.643 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.643 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.643 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:72 4.36 4:6cdfec98:::10000000255.00000000:head [write 0~4131] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:48.643 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:48.643 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 17.2431454, 2024-04-25T22:53:48.643 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084820680000000006, 2024-04-25T22:53:48.643 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:48.644 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:48.644 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:48.644 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:48.644 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:48.644 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:48.644 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 72 2024-04-25T22:53:48.644 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.644 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:48.644 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.644 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:48.644 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:48.644 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:48.644 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.644 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.645 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:48.645 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:48.645 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:48.645 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.645 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.645 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:48.645 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:48.645 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1800000000000005e-07 2024-04-25T22:53:48.645 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.645 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.645 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:48.645 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318010+0000", 2024-04-25T22:53:48.645 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7399999999999998e-06 2024-04-25T22:53:48.646 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.646 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.646 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:48.646 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318019+0000", 2024-04-25T22:53:48.646 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0170000000000002e-06 2024-04-25T22:53:48.646 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.646 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.646 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:48.646 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318024+0000", 2024-04-25T22:53:48.646 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0150000000000003e-06 2024-04-25T22:53:48.646 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.646 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.646 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:48.646 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318075+0000", 2024-04-25T22:53:48.647 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0537000000000001e-05 2024-04-25T22:53:48.647 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.647 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.647 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:48.647 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318144+0000", 2024-04-25T22:53:48.647 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9432999999999997e-05 2024-04-25T22:53:48.647 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.647 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.647 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:48.647 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326392+0000", 2024-04-25T22:53:48.647 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0082482979999999994 2024-04-25T22:53:48.647 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.647 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.648 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:48.648 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326432+0000", 2024-04-25T22:53:48.648 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9870000000000003e-05 2024-04-25T22:53:48.648 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.648 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.648 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:48.648 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326485+0000", 2024-04-25T22:53:48.648 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2439999999999999e-05 2024-04-25T22:53:48.648 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:48.648 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:48.648 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:48.648 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.648 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.648 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:74 4.10 4:08e6f8ca:::10000000257.00000000:head [write 0~839] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:48.649 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:53:48.649 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 17.241671671999999, 2024-04-25T22:53:48.649 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070370720000000001, 2024-04-25T22:53:48.649 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:48.649 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:48.649 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:48.649 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:48.649 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:48.649 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:48.649 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 74 2024-04-25T22:53:48.649 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.649 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:48.649 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.649 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:48.650 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:53:48.650 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:48.650 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.650 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.650 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:48.650 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:53:48.650 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:48.650 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.650 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.650 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:48.650 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319477+0000", 2024-04-25T22:53:48.650 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1999999999999999e-07 2024-04-25T22:53:48.650 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.651 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.651 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:48.651 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319483+0000", 2024-04-25T22:53:48.651 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4260000000000002e-06 2024-04-25T22:53:48.651 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.651 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.651 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:48.651 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319494+0000", 2024-04-25T22:53:48.651 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.094e-05 2024-04-25T22:53:48.651 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.651 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.651 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:48.651 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319499+0000", 2024-04-25T22:53:48.651 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3789999999999997e-06 2024-04-25T22:53:48.652 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.652 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.652 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:48.652 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319545+0000", 2024-04-25T22:53:48.652 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6149000000000001e-05 2024-04-25T22:53:48.652 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.652 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.652 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:48.652 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319617+0000", 2024-04-25T22:53:48.652 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1792999999999995e-05 2024-04-25T22:53:48.652 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.652 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.652 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:48.653 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326406+0000", 2024-04-25T22:53:48.653 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067895999999999998 2024-04-25T22:53:48.653 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.653 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.653 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:48.653 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326443+0000", 2024-04-25T22:53:48.653 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6828e-05 2024-04-25T22:53:48.653 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.653 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.653 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:48.653 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326514+0000", 2024-04-25T22:53:48.653 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0236999999999999e-05 2024-04-25T22:53:48.653 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:48.653 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:48.654 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:48.654 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.654 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.654 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:128 3.1f 3:f83d65d8:::200.00000004:head [write 876784~3317520 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e48)", 2024-04-25T22:53:48.654 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:36.985410+0000", 2024-04-25T22:53:48.654 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 11.575738054, 2024-04-25T22:53:48.654 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0090177360000000002, 2024-04-25T22:53:48.654 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:48.654 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:48.654 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:48.654 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:48.654 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.654 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:48.655 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.985410+0000", 2024-04-25T22:53:48.655 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:48.655 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.655 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.655 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:48.655 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.985410+0000", 2024-04-25T22:53:48.655 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:48.655 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.655 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.655 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:48.655 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.985411+0000", 2024-04-25T22:53:48.655 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8400000000000003e-07 2024-04-25T22:53:48.655 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.656 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.656 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:48.656 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989116+0000", 2024-04-25T22:53:48.656 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037047389999999999 2024-04-25T22:53:48.656 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.656 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.656 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:48.656 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989128+0000", 2024-04-25T22:53:48.656 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1977999999999999e-05 2024-04-25T22:53:48.656 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.656 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.656 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:48.656 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989135+0000", 2024-04-25T22:53:48.656 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5290000000000003e-06 2024-04-25T22:53:48.657 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.657 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.657 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:48.657 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989181+0000", 2024-04-25T22:53:48.657 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6122999999999999e-05 2024-04-25T22:53:48.657 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.657 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.657 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:48.657 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989250+0000", 2024-04-25T22:53:48.657 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8535999999999996e-05 2024-04-25T22:53:48.657 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.657 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.657 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:48.658 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.994272+0000", 2024-04-25T22:53:48.658 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050224889999999998 2024-04-25T22:53:48.658 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.658 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.658 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:48.658 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.994335+0000", 2024-04-25T22:53:48.658 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2588000000000005e-05 2024-04-25T22:53:48.658 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.658 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.658 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:48.658 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.994428+0000", 2024-04-25T22:53:48.658 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2869999999999997e-05 2024-04-25T22:53:48.658 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:48.659 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:48.659 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:48.659 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.659 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.659 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:2150 4.22 4:47cffac6:::10000000a2b.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T22:53:48.659 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:41.078233+0000", 2024-04-25T22:53:48.659 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 7.4829147440000003, 2024-04-25T22:53:48.659 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069201510000000003, 2024-04-25T22:53:48.659 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:48.659 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:48.659 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:48.659 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:48.659 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.659 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:48.660 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078233+0000", 2024-04-25T22:53:48.660 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:48.660 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.660 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.660 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:48.660 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078233+0000", 2024-04-25T22:53:48.660 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:48.660 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.660 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.660 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:48.660 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078234+0000", 2024-04-25T22:53:48.660 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1699999999999998e-07 2024-04-25T22:53:48.660 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.660 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.661 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:48.661 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078236+0000", 2024-04-25T22:53:48.661 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.875e-06 2024-04-25T22:53:48.661 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.661 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.661 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:48.661 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078242+0000", 2024-04-25T22:53:48.661 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2450000000000003e-06 2024-04-25T22:53:48.661 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.661 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.661 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:48.661 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078247+0000", 2024-04-25T22:53:48.661 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7450000000000003e-06 2024-04-25T22:53:48.661 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.662 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.662 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:48.662 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078641+0000", 2024-04-25T22:53:48.662 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00039420200000000002 2024-04-25T22:53:48.662 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.662 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.662 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:48.662 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078840+0000", 2024-04-25T22:53:48.662 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000199063 2024-04-25T22:53:48.662 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.662 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.662 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:48.662 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078919+0000", 2024-04-25T22:53:48.663 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9182000000000002e-05 2024-04-25T22:53:48.663 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.663 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.663 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:48.663 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.080906+0000", 2024-04-25T22:53:48.663 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0019866390000000001 2024-04-25T22:53:48.663 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.663 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.663 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:48.663 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085074+0000", 2024-04-25T22:53:48.663 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0041683639999999999 2024-04-25T22:53:48.663 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.663 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.663 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:48.664 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085117+0000", 2024-04-25T22:53:48.664 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2849999999999998e-05 2024-04-25T22:53:48.664 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.664 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.664 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:48.664 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085154+0000", 2024-04-25T22:53:48.664 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6468999999999999e-05 2024-04-25T22:53:48.664 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:48.664 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:48.664 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:48.664 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.664 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.664 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:2160 4.2a 4:57f9ed86:::10000000a3d.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T22:53:48.665 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:53:48.665 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 7.4824454539999996, 2024-04-25T22:53:48.665 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0068959959999999997, 2024-04-25T22:53:48.665 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:48.665 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:48.665 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:48.665 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:48.665 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.665 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:48.665 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:53:48.665 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:48.665 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.665 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.665 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:48.666 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:53:48.666 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:48.666 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.666 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.666 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:48.666 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:53:48.666 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7000000000000004e-07 2024-04-25T22:53:48.666 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.666 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.666 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:48.666 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078707+0000", 2024-04-25T22:53:48.666 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.783e-06 2024-04-25T22:53:48.666 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.667 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.667 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:48.667 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078716+0000", 2024-04-25T22:53:48.667 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4800000000000001e-06 2024-04-25T22:53:48.667 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.667 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.667 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:48.667 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078724+0000", 2024-04-25T22:53:48.667 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1519999999999992e-06 2024-04-25T22:53:48.667 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.667 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.667 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:48.667 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078794+0000", 2024-04-25T22:53:48.668 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0500999999999995e-05 2024-04-25T22:53:48.668 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.668 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.668 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:48.668 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078912+0000", 2024-04-25T22:53:48.668 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000117439 2024-04-25T22:53:48.668 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.668 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.668 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:48.668 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079000+0000", 2024-04-25T22:53:48.668 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8092999999999998e-05 2024-04-25T22:53:48.668 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.668 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.669 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:48.669 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.080897+0000", 2024-04-25T22:53:48.669 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0018970899999999999 2024-04-25T22:53:48.669 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.669 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.669 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:48.669 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085517+0000", 2024-04-25T22:53:48.669 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0046198929999999999 2024-04-25T22:53:48.669 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.669 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.669 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:48.669 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085565+0000", 2024-04-25T22:53:48.669 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7777e-05 2024-04-25T22:53:48.669 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.670 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.670 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:48.670 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085599+0000", 2024-04-25T22:53:48.670 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4017999999999999e-05 2024-04-25T22:53:48.670 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:48.670 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:48.670 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:48.670 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.670 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.670 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:2163 4.2a 4:549f79e3:::10000000a43.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T22:53:48.670 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:53:48.670 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 7.4824121009999995, 2024-04-25T22:53:48.670 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069469190000000002, 2024-04-25T22:53:48.671 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:48.671 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:48.671 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:48.671 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:48.671 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.671 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:48.671 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:53:48.671 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:48.671 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.671 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.671 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:48.671 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:53:48.671 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:48.672 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.672 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.672 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:48.672 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:53:48.672 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1399999999999997e-07 2024-04-25T22:53:48.672 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.672 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.672 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:48.672 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078739+0000", 2024-04-25T22:53:48.672 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2960000000000001e-06 2024-04-25T22:53:48.672 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.672 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.672 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:48.672 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078745+0000", 2024-04-25T22:53:48.673 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3439999999999997e-06 2024-04-25T22:53:48.673 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.673 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.673 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:48.673 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078750+0000", 2024-04-25T22:53:48.673 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3179999999999997e-06 2024-04-25T22:53:48.673 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.673 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.673 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:48.673 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079224+0000", 2024-04-25T22:53:48.673 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00047334999999999999 2024-04-25T22:53:48.673 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.673 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.673 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:48.674 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079292+0000", 2024-04-25T22:53:48.674 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8708999999999996e-05 2024-04-25T22:53:48.674 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.674 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.674 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:48.674 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079342+0000", 2024-04-25T22:53:48.674 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9299999999999999e-05 2024-04-25T22:53:48.674 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.674 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.674 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:48.674 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.081611+0000", 2024-04-25T22:53:48.674 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0022695229999999999 2024-04-25T22:53:48.674 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.675 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.675 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:48.675 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085605+0000", 2024-04-25T22:53:48.675 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0039933679999999997 2024-04-25T22:53:48.675 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.675 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.675 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:48.675 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085650+0000", 2024-04-25T22:53:48.675 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5111000000000002e-05 2024-04-25T22:53:48.675 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:48.675 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:48.675 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:48.675 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085683+0000", 2024-04-25T22:53:48.675 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3185999999999997e-05 2024-04-25T22:53:48.676 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:48.676 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:48.676 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:48.676 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:48.676 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:48.676 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:48.677 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:48.676+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:48.677 INFO:tasks.workunit.client.0.smithi052.stdout: [CC] tlibio.lo 2024-04-25T22:53:48.678 INFO:tasks.workunit.client.0.smithi052.stdout: [CC] write_log.lo 2024-04-25T22:53:48.678 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:48.690 INFO:tasks.workunit.client.0.smithi052.stdout: [CC] random.lo 2024-04-25T22:53:48.778 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:48.777+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:48.783 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:48.783 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:48.783 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-04-25T22:53:48.783 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:48.792 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:48.879 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:48.878+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:48.894 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:48.895 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:48.895 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:53:48.895 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:53:48.895 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:48.903 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:48.954 INFO:tasks.workunit.client.0.smithi052.stdout: [LD] 2024-04-25T22:53:48.980 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:48.979+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:49.049 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:49.049 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-04-25T22:53:49.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-04-25T22:53:49.049 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:53:49.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.049 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:49.049 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:49.049 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.081775818, 2024-04-25T22:53:49.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010384338999999999, 2024-04-25T22:53:49.050 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:49.050 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:49.050 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:49.050 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:49.050 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:49.050 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:49.050 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-04-25T22:53:49.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.050 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:49.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:49.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:49.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:49.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:49.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:49.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:49.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:49.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:49.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3600000000000004e-07 2024-04-25T22:53:49.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:49.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965185+0000", 2024-04-25T22:53:49.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.117e-06 2024-04-25T22:53:49.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:49.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965192+0000", 2024-04-25T22:53:49.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3239999999999997e-06 2024-04-25T22:53:49.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:49.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965198+0000", 2024-04-25T22:53:49.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6370000000000004e-06 2024-04-25T22:53:49.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.053 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:49.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970973+0000", 2024-04-25T22:53:49.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057748239999999996 2024-04-25T22:53:49.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.053 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:49.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971049+0000", 2024-04-25T22:53:49.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6029e-05 2024-04-25T22:53:49.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.053 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:49.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971174+0000", 2024-04-25T22:53:49.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012462399999999999 2024-04-25T22:53:49.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:49.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971553+0000", 2024-04-25T22:53:49.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037896499999999999 2024-04-25T22:53:49.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:49.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975482+0000", 2024-04-25T22:53:49.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039297459999999996 2024-04-25T22:53:49.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.055 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:49.055 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975529+0000", 2024-04-25T22:53:49.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6387000000000002e-05 2024-04-25T22:53:49.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.055 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:49.055 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975563+0000", 2024-04-25T22:53:49.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4150000000000003e-05 2024-04-25T22:53:49.055 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:49.055 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:49.055 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:49.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.056 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:49.056 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:49.056 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 116.03472949499999, 2024-04-25T22:53:49.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012637705000000001, 2024-04-25T22:53:49.056 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:49.056 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:49.056 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:49.056 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:49.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:49.056 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:49.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:49.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.057 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:49.057 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:49.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:49.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.057 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:49.057 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012227+0000", 2024-04-25T22:53:49.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.863e-06 2024-04-25T22:53:49.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.057 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:49.057 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012236+0000", 2024-04-25T22:53:49.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1109999999999997e-06 2024-04-25T22:53:49.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:49.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012309+0000", 2024-04-25T22:53:49.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3242000000000001e-05 2024-04-25T22:53:49.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:49.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012324+0000", 2024-04-25T22:53:49.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4837e-05 2024-04-25T22:53:49.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:49.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015060+0000", 2024-04-25T22:53:49.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027363349999999999 2024-04-25T22:53:49.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:49.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015169+0000", 2024-04-25T22:53:49.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108372 2024-04-25T22:53:49.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:49.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015498+0000", 2024-04-25T22:53:49.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032949999999999999 2024-04-25T22:53:49.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:49.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021282+0000", 2024-04-25T22:53:49.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057836429999999998 2024-04-25T22:53:49.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:49.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024709+0000", 2024-04-25T22:53:49.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034271979999999998 2024-04-25T22:53:49.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:49.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024802+0000", 2024-04-25T22:53:49.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2960000000000004e-05 2024-04-25T22:53:49.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:49.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024863+0000", 2024-04-25T22:53:49.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0643999999999997e-05 2024-04-25T22:53:49.061 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:49.061 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:49.061 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:49.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.061 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:49.061 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:49.062 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 116.034605724, 2024-04-25T22:53:49.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012979447999999999, 2024-04-25T22:53:49.062 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:49.062 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:49.062 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:49.062 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:49.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:49.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:49.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:49.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:49.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:49.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:49.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:49.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:49.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:53:49.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:49.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012354+0000", 2024-04-25T22:53:49.064 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7740000000000004e-06 2024-04-25T22:53:49.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.064 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:49.064 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012365+0000", 2024-04-25T22:53:49.064 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.064e-05 2024-04-25T22:53:49.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.064 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:49.064 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012382+0000", 2024-04-25T22:53:49.064 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6999000000000001e-05 2024-04-25T22:53:49.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:49.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015958+0000", 2024-04-25T22:53:49.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035765699999999998 2024-04-25T22:53:49.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:49.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016037+0000", 2024-04-25T22:53:49.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8242000000000001e-05 2024-04-25T22:53:49.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:49.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016404+0000", 2024-04-25T22:53:49.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036784300000000002 2024-04-25T22:53:49.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:49.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021294+0000", 2024-04-25T22:53:49.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048890629999999999 2024-04-25T22:53:49.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.067 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:49.067 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024959+0000", 2024-04-25T22:53:49.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036651570000000001 2024-04-25T22:53:49.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.067 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:49.067 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025097+0000", 2024-04-25T22:53:49.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013788099999999999 2024-04-25T22:53:49.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.067 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:49.067 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025328+0000", 2024-04-25T22:53:49.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231492 2024-04-25T22:53:49.068 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:49.068 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:49.068 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:49.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.068 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:49.068 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:49.068 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 116.034517955, 2024-04-25T22:53:49.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013049827, 2024-04-25T22:53:49.068 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:49.068 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:49.068 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:49.069 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:49.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:49.069 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:49.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:49.069 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:49.069 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:49.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:49.069 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:49.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012437+0000", 2024-04-25T22:53:49.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-04-25T22:53:49.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:49.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012440+0000", 2024-04-25T22:53:49.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7609999999999999e-06 2024-04-25T22:53:49.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:49.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012449+0000", 2024-04-25T22:53:49.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.285e-06 2024-04-25T22:53:49.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:49.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012457+0000", 2024-04-25T22:53:49.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9510000000000006e-06 2024-04-25T22:53:49.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:49.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017106+0000", 2024-04-25T22:53:49.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046494220000000003 2024-04-25T22:53:49.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:49.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017223+0000", 2024-04-25T22:53:49.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116824 2024-04-25T22:53:49.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:49.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017345+0000", 2024-04-25T22:53:49.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122175 2024-04-25T22:53:49.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:49.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021299+0000", 2024-04-25T22:53:49.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039534879999999998 2024-04-25T22:53:49.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:49.073 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025398+0000", 2024-04-25T22:53:49.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040988960000000003 2024-04-25T22:53:49.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:49.073 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025439+0000", 2024-04-25T22:53:49.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0915999999999999e-05 2024-04-25T22:53:49.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:49.074 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025486+0000", 2024-04-25T22:53:49.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7534999999999998e-05 2024-04-25T22:53:49.074 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:49.074 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:49.074 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:49.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.074 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:49.074 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:49.074 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 116.03448780399999, 2024-04-25T22:53:49.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020988041999999998, 2024-04-25T22:53:49.074 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:49.075 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:49.075 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:49.075 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:49.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:49.075 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:49.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:49.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:49.075 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:49.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:49.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.076 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:49.076 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:49.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.99e-07 2024-04-25T22:53:49.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.076 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:49.076 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012470+0000", 2024-04-25T22:53:49.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2789999999999999e-06 2024-04-25T22:53:49.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.076 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:49.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012477+0000", 2024-04-25T22:53:49.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:53:49.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.077 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:49.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012500+0000", 2024-04-25T22:53:49.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2490999999999999e-05 2024-04-25T22:53:49.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.077 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:49.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021911+0000", 2024-04-25T22:53:49.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094114160000000006 2024-04-25T22:53:49.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:49.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022000+0000", 2024-04-25T22:53:49.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8601000000000001e-05 2024-04-25T22:53:49.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:49.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022359+0000", 2024-04-25T22:53:49.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035921999999999999 2024-04-25T22:53:49.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:49.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025541+0000", 2024-04-25T22:53:49.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031820619999999998 2024-04-25T22:53:49.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:49.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033375+0000", 2024-04-25T22:53:49.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078338379999999992 2024-04-25T22:53:49.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:49.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033415+0000", 2024-04-25T22:53:49.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9527000000000003e-05 2024-04-25T22:53:49.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:49.080 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033455+0000", 2024-04-25T22:53:49.080 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9932000000000003e-05 2024-04-25T22:53:49.080 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:49.080 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:49.080 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:49.080 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.080 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.080 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:49.080 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:49.080 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 116.034432611, 2024-04-25T22:53:49.080 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021043857999999999, 2024-04-25T22:53:49.080 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:49.080 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:49.081 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:49.081 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:49.081 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.081 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:49.081 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:49.081 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:49.081 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.081 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.081 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:49.081 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:49.081 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:49.081 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.082 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.082 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:49.082 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012523+0000", 2024-04-25T22:53:49.082 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.361e-06 2024-04-25T22:53:49.082 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.082 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.082 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:49.082 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012530+0000", 2024-04-25T22:53:49.082 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5440000000000004e-06 2024-04-25T22:53:49.082 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.082 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.082 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:49.083 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012541+0000", 2024-04-25T22:53:49.083 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1745e-05 2024-04-25T22:53:49.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.083 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.083 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:49.083 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012551+0000", 2024-04-25T22:53:49.083 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5789999999999993e-06 2024-04-25T22:53:49.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.083 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.083 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:49.083 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022709+0000", 2024-04-25T22:53:49.083 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010157685 2024-04-25T22:53:49.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.084 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:49.084 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022957+0000", 2024-04-25T22:53:49.084 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024824599999999998 2024-04-25T22:53:49.084 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.084 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:49.084 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023443+0000", 2024-04-25T22:53:49.084 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048578599999999999 2024-04-25T22:53:49.084 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.084 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:49.084 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025547+0000", 2024-04-25T22:53:49.085 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021044789999999998 2024-04-25T22:53:49.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.085 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.085 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:49.085 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033509+0000", 2024-04-25T22:53:49.085 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0079622180000000001 2024-04-25T22:53:49.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.085 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.085 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:49.085 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033542+0000", 2024-04-25T22:53:49.085 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3018000000000001e-05 2024-04-25T22:53:49.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.086 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.086 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:49.086 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033566+0000", 2024-04-25T22:53:49.086 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3197000000000002e-05 2024-04-25T22:53:49.086 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:49.086 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:49.086 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:49.086 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.086 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.086 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:49.086 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:49.087 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 116.034392646, 2024-04-25T22:53:49.087 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021122696, 2024-04-25T22:53:49.087 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:49.087 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:49.087 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:49.087 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:49.087 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.087 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:49.087 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:49.087 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:49.087 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.087 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.087 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:49.088 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:49.088 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:49.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.088 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.088 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:49.088 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:49.088 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:53:49.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.088 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.088 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:49.088 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012566+0000", 2024-04-25T22:53:49.088 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-04-25T22:53:49.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.089 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.089 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:49.089 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012619+0000", 2024-04-25T22:53:49.089 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2607e-05 2024-04-25T22:53:49.089 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.089 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.089 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:49.089 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012628+0000", 2024-04-25T22:53:49.089 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6500000000000008e-06 2024-04-25T22:53:49.089 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.089 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.089 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:49.089 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024024+0000", 2024-04-25T22:53:49.089 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011396007999999999 2024-04-25T22:53:49.090 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.090 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.090 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:49.090 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024198+0000", 2024-04-25T22:53:49.090 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000173215 2024-04-25T22:53:49.090 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.090 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.090 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:49.090 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024447+0000", 2024-04-25T22:53:49.090 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024898500000000002 2024-04-25T22:53:49.090 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.090 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.090 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:49.091 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026431+0000", 2024-04-25T22:53:49.091 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001984923 2024-04-25T22:53:49.091 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.091 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.091 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:49.091 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033608+0000", 2024-04-25T22:53:49.091 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071768459999999997 2024-04-25T22:53:49.091 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.091 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.091 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:49.091 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033646+0000", 2024-04-25T22:53:49.091 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299000000000003e-05 2024-04-25T22:53:49.091 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.092 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.092 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:49.092 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033684+0000", 2024-04-25T22:53:49.092 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8773000000000003e-05 2024-04-25T22:53:49.092 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:49.092 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:49.092 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:49.092 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.092 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.092 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:49.092 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:49.092 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 116.03430404700001, 2024-04-25T22:53:49.092 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021175381, 2024-04-25T22:53:49.093 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:49.093 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:49.093 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:49.093 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:49.093 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.093 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:49.093 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:49.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:49.094 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.094 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.094 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:49.094 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:49.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:49.094 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.094 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.094 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:49.094 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012651+0000", 2024-04-25T22:53:49.095 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:53:49.095 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.095 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.095 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:49.095 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012656+0000", 2024-04-25T22:53:49.095 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8899999999999998e-06 2024-04-25T22:53:49.095 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.095 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.095 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:49.096 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012666+0000", 2024-04-25T22:53:49.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0346999999999999e-05 2024-04-25T22:53:49.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.096 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:49.096 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012675+0000", 2024-04-25T22:53:49.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9930000000000001e-06 2024-04-25T22:53:49.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.096 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:49.096 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025661+0000", 2024-04-25T22:53:49.097 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01298531 2024-04-25T22:53:49.097 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.097 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:49.097 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025757+0000", 2024-04-25T22:53:49.097 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5822000000000005e-05 2024-04-25T22:53:49.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.098 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:49.098 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025907+0000", 2024-04-25T22:53:49.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015051499999999999 2024-04-25T22:53:49.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.098 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:49.098 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026435+0000", 2024-04-25T22:53:49.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052762200000000005 2024-04-25T22:53:49.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.099 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:49.099 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033732+0000", 2024-04-25T22:53:49.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072978419999999997 2024-04-25T22:53:49.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.100 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:49.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033787+0000", 2024-04-25T22:53:49.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4703999999999997e-05 2024-04-25T22:53:49.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.100 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:49.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033826+0000", 2024-04-25T22:53:49.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8458999999999999e-05 2024-04-25T22:53:49.100 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:49.100 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:49.100 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:49.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.101 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:49.101 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:49.101 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 116.034248633, 2024-04-25T22:53:49.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021244174000000001, 2024-04-25T22:53:49.101 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:49.102 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:49.102 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:49.102 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:49.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:49.103 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:49.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:49.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.103 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:49.103 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:49.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:49.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.103 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:49.103 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:49.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:49.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.104 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:49.104 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012712+0000", 2024-04-25T22:53:49.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.913e-06 2024-04-25T22:53:49.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.104 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:49.104 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012722+0000", 2024-04-25T22:53:49.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2879999999999998e-06 2024-04-25T22:53:49.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.104 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:49.104 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012727+0000", 2024-04-25T22:53:49.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8429999999999998e-06 2024-04-25T22:53:49.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:49.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026099+0000", 2024-04-25T22:53:49.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013371450999999999 2024-04-25T22:53:49.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:49.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026147+0000", 2024-04-25T22:53:49.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7837999999999998e-05 2024-04-25T22:53:49.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:49.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026254+0000", 2024-04-25T22:53:49.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107314 2024-04-25T22:53:49.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:49.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026686+0000", 2024-04-25T22:53:49.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000432428 2024-04-25T22:53:49.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:49.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033873+0000", 2024-04-25T22:53:49.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071864399999999997 2024-04-25T22:53:49.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:49.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033904+0000", 2024-04-25T22:53:49.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1321e-05 2024-04-25T22:53:49.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:49.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033950+0000", 2024-04-25T22:53:49.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5707999999999997e-05 2024-04-25T22:53:49.108 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:49.108 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:49.108 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:49.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.108 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:49.108 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:49.108 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 116.034218248, 2024-04-25T22:53:49.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01096505, 2024-04-25T22:53:49.108 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:49.108 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:49.108 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:49.108 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:49.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:49.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:49.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:49.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:49.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:49.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:49.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:49.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012737+0000", 2024-04-25T22:53:49.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:49.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.111 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:49.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012739+0000", 2024-04-25T22:53:49.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-04-25T22:53:49.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:49.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012743+0000", 2024-04-25T22:53:49.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3239999999999996e-06 2024-04-25T22:53:49.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:49.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012746+0000", 2024-04-25T22:53:49.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.129e-06 2024-04-25T22:53:49.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.113 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:49.113 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012796+0000", 2024-04-25T22:53:49.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9231999999999999e-05 2024-04-25T22:53:49.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.113 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:49.113 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012915+0000", 2024-04-25T22:53:49.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119021 2024-04-25T22:53:49.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.113 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:49.113 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013069+0000", 2024-04-25T22:53:49.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015463900000000001 2024-04-25T22:53:49.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:49.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019237+0000", 2024-04-25T22:53:49.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061680329999999998 2024-04-25T22:53:49.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:49.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023603+0000", 2024-04-25T22:53:49.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043655860000000003 2024-04-25T22:53:49.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:49.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023659+0000", 2024-04-25T22:53:49.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6484000000000003e-05 2024-04-25T22:53:49.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:49.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023701+0000", 2024-04-25T22:53:49.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1761999999999998e-05 2024-04-25T22:53:49.116 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:49.116 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:49.116 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:49.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.116 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:49.116 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:49.117 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 116.0341933, 2024-04-25T22:53:49.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011234429000000001, 2024-04-25T22:53:49.117 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:49.117 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:49.117 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:49.117 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:49.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.117 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:49.117 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:49.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:49.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.117 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:49.117 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:49.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:49.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:49.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012762+0000", 2024-04-25T22:53:49.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-04-25T22:53:49.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:49.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012765+0000", 2024-04-25T22:53:49.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2569999999999999e-06 2024-04-25T22:53:49.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:49.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012783+0000", 2024-04-25T22:53:49.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8431999999999999e-05 2024-04-25T22:53:49.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:49.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012799+0000", 2024-04-25T22:53:49.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5438999999999999e-05 2024-04-25T22:53:49.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:49.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013826+0000", 2024-04-25T22:53:49.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010275060000000001 2024-04-25T22:53:49.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:49.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013913+0000", 2024-04-25T22:53:49.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.708e-05 2024-04-25T22:53:49.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:49.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014098+0000", 2024-04-25T22:53:49.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018519399999999999 2024-04-25T22:53:49.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:49.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019684+0000", 2024-04-25T22:53:49.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055860079999999999 2024-04-25T22:53:49.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:49.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023876+0000", 2024-04-25T22:53:49.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041918800000000003 2024-04-25T22:53:49.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:49.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023957+0000", 2024-04-25T22:53:49.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1165e-05 2024-04-25T22:53:49.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:49.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023995+0000", 2024-04-25T22:53:49.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:53:49.126 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:49.126 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:49.126 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:49.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.127 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:49.127 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:49.127 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 116.034095521, 2024-04-25T22:53:49.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011131200000000001, 2024-04-25T22:53:49.127 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:49.127 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:49.127 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:49.127 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:49.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:49.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:49.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:49.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:49.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:49.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:49.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:49.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012860+0000", 2024-04-25T22:53:49.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3900000000000004e-07 2024-04-25T22:53:49.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:49.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012865+0000", 2024-04-25T22:53:49.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5609999999999998e-06 2024-04-25T22:53:49.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:49.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012895+0000", 2024-04-25T22:53:49.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9847000000000001e-05 2024-04-25T22:53:49.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:49.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012905+0000", 2024-04-25T22:53:49.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.03e-05 2024-04-25T22:53:49.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:49.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015020+0000", 2024-04-25T22:53:49.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021142940000000001 2024-04-25T22:53:49.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:49.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015182+0000", 2024-04-25T22:53:49.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016248099999999999 2024-04-25T22:53:49.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:49.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015357+0000", 2024-04-25T22:53:49.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017471000000000001 2024-04-25T22:53:49.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:49.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021021+0000", 2024-04-25T22:53:49.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056638340000000004 2024-04-25T22:53:49.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:49.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023712+0000", 2024-04-25T22:53:49.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026910380000000002 2024-04-25T22:53:49.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:49.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023763+0000", 2024-04-25T22:53:49.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1477999999999997e-05 2024-04-25T22:53:49.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:49.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023990+0000", 2024-04-25T22:53:49.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000226818 2024-04-25T22:53:49.133 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:49.133 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:49.133 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:49.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.133 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:49.134 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:49.134 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 116.033972425, 2024-04-25T22:53:49.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011705299000000001, 2024-04-25T22:53:49.134 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:49.134 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:49.134 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:49.134 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:49.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:49.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:49.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:49.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:49.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:49.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:49.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:49.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012983+0000", 2024-04-25T22:53:49.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:53:49.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:49.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012986+0000", 2024-04-25T22:53:49.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5700000000000001e-06 2024-04-25T22:53:49.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:49.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012993+0000", 2024-04-25T22:53:49.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8730000000000001e-06 2024-04-25T22:53:49.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:49.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013000+0000", 2024-04-25T22:53:49.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1890000000000001e-06 2024-04-25T22:53:49.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:49.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:53:49.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002147866 2024-04-25T22:53:49.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:49.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015351+0000", 2024-04-25T22:53:49.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020300799999999999 2024-04-25T22:53:49.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:49.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016260+0000", 2024-04-25T22:53:49.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00090926799999999997 2024-04-25T22:53:49.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:49.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022669+0000", 2024-04-25T22:53:49.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064082849999999997 2024-04-25T22:53:49.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.139 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:49.139 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024584+0000", 2024-04-25T22:53:49.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019151699999999999 2024-04-25T22:53:49.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.139 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:49.139 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024643+0000", 2024-04-25T22:53:49.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8888999999999998e-05 2024-04-25T22:53:49.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.139 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:49.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024687+0000", 2024-04-25T22:53:49.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4444999999999999e-05 2024-04-25T22:53:49.140 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:49.140 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:49.140 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:49.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.140 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:49.140 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:49.140 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 116.033944834, 2024-04-25T22:53:49.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011249699, 2024-04-25T22:53:49.140 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:49.141 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:49.141 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:49.141 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:49.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:49.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:49.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:49.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:49.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:49.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:49.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:49.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013010+0000", 2024-04-25T22:53:49.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2099999999999996e-07 2024-04-25T22:53:49.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:49.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013013+0000", 2024-04-25T22:53:49.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1310000000000002e-06 2024-04-25T22:53:49.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.143 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:49.143 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013020+0000", 2024-04-25T22:53:49.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3330000000000002e-06 2024-04-25T22:53:49.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.143 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:49.143 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013025+0000", 2024-04-25T22:53:49.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6760000000000004e-06 2024-04-25T22:53:49.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.143 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:49.143 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013163+0000", 2024-04-25T22:53:49.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013824599999999999 2024-04-25T22:53:49.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.144 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:49.144 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013504+0000", 2024-04-25T22:53:49.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034080299999999998 2024-04-25T22:53:49.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.144 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:49.144 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013613+0000", 2024-04-25T22:53:49.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108705 2024-04-25T22:53:49.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:49.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015831+0000", 2024-04-25T22:53:49.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002217672 2024-04-25T22:53:49.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:49.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024137+0000", 2024-04-25T22:53:49.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0083060489999999994 2024-04-25T22:53:49.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:49.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024218+0000", 2024-04-25T22:53:49.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1351000000000001e-05 2024-04-25T22:53:49.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:49.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024259+0000", 2024-04-25T22:53:49.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1112000000000002e-05 2024-04-25T22:53:49.146 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:49.146 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:49.146 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:49.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.147 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:49.147 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:49.147 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 116.03385710800001, 2024-04-25T22:53:49.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020379749999999999, 2024-04-25T22:53:49.147 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:49.147 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:49.148 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:49.148 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:49.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.148 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:49.148 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:49.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:49.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:49.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:49.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:49.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:49.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013098+0000", 2024-04-25T22:53:49.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:53:49.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:49.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013105+0000", 2024-04-25T22:53:49.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5969999999999997e-06 2024-04-25T22:53:49.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:49.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013190+0000", 2024-04-25T22:53:49.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5618999999999995e-05 2024-04-25T22:53:49.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:49.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013200+0000", 2024-04-25T22:53:49.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5859999999999994e-06 2024-04-25T22:53:49.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:49.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020265+0000", 2024-04-25T22:53:49.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070653349999999998 2024-04-25T22:53:49.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:49.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020454+0000", 2024-04-25T22:53:49.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189316 2024-04-25T22:53:49.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:49.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020586+0000", 2024-04-25T22:53:49.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013195700000000001 2024-04-25T22:53:49.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:49.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023822+0000", 2024-04-25T22:53:49.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032358529999999999 2024-04-25T22:53:49.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:49.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033409+0000", 2024-04-25T22:53:49.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095870520000000004 2024-04-25T22:53:49.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:49.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033447+0000", 2024-04-25T22:53:49.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7261999999999997e-05 2024-04-25T22:53:49.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:49.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033477+0000", 2024-04-25T22:53:49.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0389e-05 2024-04-25T22:53:49.156 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:49.156 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:49.156 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:49.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.156 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:49.157 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:49.157 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 116.03374060199999, 2024-04-25T22:53:49.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010857383999999999, 2024-04-25T22:53:49.157 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:49.157 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:49.157 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:49.157 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:49.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:49.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:49.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:49.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:49.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:49.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:49.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:49.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:49.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:49.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:49.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013218+0000", 2024-04-25T22:53:49.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8199999999999998e-06 2024-04-25T22:53:49.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:49.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013226+0000", 2024-04-25T22:53:49.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7649999999999993e-06 2024-04-25T22:53:49.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:49.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013259+0000", 2024-04-25T22:53:49.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2727e-05 2024-04-25T22:53:49.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:49.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014809+0000", 2024-04-25T22:53:49.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001550144 2024-04-25T22:53:49.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:49.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014958+0000", 2024-04-25T22:53:49.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014890300000000001 2024-04-25T22:53:49.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:49.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015087+0000", 2024-04-25T22:53:49.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012939200000000001 2024-04-25T22:53:49.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:49.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020212+0000", 2024-04-25T22:53:49.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051248939999999996 2024-04-25T22:53:49.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:49.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023699+0000", 2024-04-25T22:53:49.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034873289999999999 2024-04-25T22:53:49.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:49.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024014+0000", 2024-04-25T22:53:49.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031473999999999999 2024-04-25T22:53:49.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:49.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024071+0000", 2024-04-25T22:53:49.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7040000000000003e-05 2024-04-25T22:53:49.164 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:49.164 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:49.164 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:49.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.165 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:49.165 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:49.165 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 116.033685897, 2024-04-25T22:53:49.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012329677000000001, 2024-04-25T22:53:49.166 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:49.166 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:49.166 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:49.166 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:49.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:49.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:49.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:49.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:49.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:49.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:49.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:49.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013269+0000", 2024-04-25T22:53:49.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5000000000000002e-07 2024-04-25T22:53:49.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:49.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:49.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6909999999999999e-06 2024-04-25T22:53:49.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:49.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013284+0000", 2024-04-25T22:53:49.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0963e-05 2024-04-25T22:53:49.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:49.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013361+0000", 2024-04-25T22:53:49.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7379999999999994e-05 2024-04-25T22:53:49.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:49.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013448+0000", 2024-04-25T22:53:49.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6990000000000006e-05 2024-04-25T22:53:49.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:49.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013632+0000", 2024-04-25T22:53:49.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018396800000000001 2024-04-25T22:53:49.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:49.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013800+0000", 2024-04-25T22:53:49.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167467 2024-04-25T22:53:49.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:49.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.018570+0000", 2024-04-25T22:53:49.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047701460000000003 2024-04-25T22:53:49.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:49.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025507+0000", 2024-04-25T22:53:49.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069372039999999998 2024-04-25T22:53:49.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:49.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025562+0000", 2024-04-25T22:53:49.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4858999999999998e-05 2024-04-25T22:53:49.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:49.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025598+0000", 2024-04-25T22:53:49.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6259e-05 2024-04-25T22:53:49.172 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:49.172 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:49.172 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:49.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.173 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:49.173 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:49.173 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 116.033554024, 2024-04-25T22:53:49.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020176666999999999, 2024-04-25T22:53:49.173 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:49.173 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:49.173 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:53:49.173 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:49.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:49.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:49.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:49.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:49.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:49.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:49.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:49.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:49.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-04-25T22:53:49.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:49.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013405+0000", 2024-04-25T22:53:49.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0559999999999998e-06 2024-04-25T22:53:49.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:49.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013422+0000", 2024-04-25T22:53:49.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6770999999999999e-05 2024-04-25T22:53:49.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:49.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013431+0000", 2024-04-25T22:53:49.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5019999999999998e-06 2024-04-25T22:53:49.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:49.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021720+0000", 2024-04-25T22:53:49.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082884340000000008 2024-04-25T22:53:49.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:49.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022122+0000", 2024-04-25T22:53:49.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000401634 2024-04-25T22:53:49.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:49.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033577+0000", 2024-04-25T22:53:49.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011455435999999999 2024-04-25T22:53:49.177 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:49.177 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:49.177 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:49.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.177 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4734.0:31 4.1b 4:d9872866:::1000000021d.00000002:head [write 0~3618035] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-25T22:53:49.177 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:53:49.177 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 17.993979761999999, 2024-04-25T22:53:49.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011647062, 2024-04-25T22:53:49.178 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:49.178 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:49.178 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:49.178 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:49.178 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4734", 2024-04-25T22:53:49.178 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:49.179 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 31 2024-04-25T22:53:49.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.179 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:49.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:49.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:53:49.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:49.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:49.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:53:49.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:49.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:49.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:53:49.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5700000000000001e-07 2024-04-25T22:53:49.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:49.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059575+0000", 2024-04-25T22:53:49.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0065991380000000001 2024-04-25T22:53:49.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:49.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059586+0000", 2024-04-25T22:53:49.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1438e-05 2024-04-25T22:53:49.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:49.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059592+0000", 2024-04-25T22:53:49.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2899999999999999e-06 2024-04-25T22:53:49.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:49.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059660+0000", 2024-04-25T22:53:49.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7980999999999998e-05 2024-04-25T22:53:49.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:49.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059757+0000", 2024-04-25T22:53:49.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6340000000000003e-05 2024-04-25T22:53:49.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:49.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.064487+0000", 2024-04-25T22:53:49.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004730621 2024-04-25T22:53:49.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:49.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.064538+0000", 2024-04-25T22:53:49.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0801999999999999e-05 2024-04-25T22:53:49.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:49.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.064622+0000", 2024-04-25T22:53:49.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3595000000000002e-05 2024-04-25T22:53:49.187 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:49.187 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:49.187 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:49.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.187 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:97 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-25T22:53:49.188 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:53:33.026298+0000", 2024-04-25T22:53:49.188 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 16.020655948000002, 2024-04-25T22:53:49.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015641848999999999, 2024-04-25T22:53:49.188 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:49.188 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:49.188 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:49.188 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:49.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:49.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026298+0000", 2024-04-25T22:53:49.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:49.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:49.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026298+0000", 2024-04-25T22:53:49.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:49.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:49.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026299+0000", 2024-04-25T22:53:49.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7299999999999996e-07 2024-04-25T22:53:49.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:49.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026464+0000", 2024-04-25T22:53:49.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016477700000000001 2024-04-25T22:53:49.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:49.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026472+0000", 2024-04-25T22:53:49.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1589999999999993e-06 2024-04-25T22:53:49.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:49.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026476+0000", 2024-04-25T22:53:49.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4580000000000003e-06 2024-04-25T22:53:49.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:49.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026550+0000", 2024-04-25T22:53:49.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3836000000000003e-05 2024-04-25T22:53:49.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:49.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026644+0000", 2024-04-25T22:53:49.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4022000000000002e-05 2024-04-25T22:53:49.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:49.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.041838+0000", 2024-04-25T22:53:49.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015193814999999999 2024-04-25T22:53:49.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:49.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.041874+0000", 2024-04-25T22:53:49.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5856999999999999e-05 2024-04-25T22:53:49.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:49.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:49.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:49.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.041940+0000", 2024-04-25T22:53:49.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6352000000000004e-05 2024-04-25T22:53:49.192 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:49.192 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:49.192 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:49.192 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:49.192 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:49.193 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:49.195 INFO:tasks.workunit.client.0.smithi052.stdout:Building ltp 2024-04-25T22:53:49.195 INFO:tasks.workunit.client.0.smithi052.stdout:Building src 2024-04-25T22:53:49.195 INFO:tasks.workunit.client.0.smithi052.stdout:Building m4 2024-04-25T22:53:49.195 INFO:tasks.workunit.client.0.smithi052.stdout:Building common 2024-04-25T22:53:49.195 INFO:tasks.workunit.client.0.smithi052.stdout: [DEP] 2024-04-25T22:53:49.195 INFO:tasks.workunit.client.0.smithi052.stdout: [DEP] 2024-04-25T22:53:49.195 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:49.196 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:49.193+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:49.294 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:49.294+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:49.300 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:49.300 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:49.300 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-25T22:53:49.300 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:49.309 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:49.395 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:49.395+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:49.410 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:49.410 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:49.410 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-25T22:53:49.410 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-25T22:53:49.410 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:49.419 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:49.496 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:49.495+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:49.523 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:49.524 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:53:49.524 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:53:49.524 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:53:49.524 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.524 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:53:49.524 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:49.524 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 121.55419689199999, 2024-04-25T22:53:49.525 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:53:49.525 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:49.525 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:49.525 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:49.525 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:49.525 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.525 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:49.525 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:49.526 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:49.526 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.526 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.526 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:49.526 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:49.526 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:49.527 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.527 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.527 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:49.527 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:53:49.527 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:53:49.527 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.528 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.528 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:49.528 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:53:49.528 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:53:49.528 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.528 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.528 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:49.528 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:53:49.528 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:53:49.528 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.529 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.529 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:49.529 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:53:49.529 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:53:49.529 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.529 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.529 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:49.529 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:53:49.529 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:53:49.529 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.529 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.529 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:49.530 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:53:49.530 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:53:49.530 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.530 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.530 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:49.530 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:53:49.530 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:53:49.530 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.530 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.530 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:49.530 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:53:49.530 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:53:49.530 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:49.531 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:49.531 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:49.531 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.531 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.531 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:49.531 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:49.531 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 116.509701193, 2024-04-25T22:53:49.531 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:53:49.531 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:49.531 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:49.531 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:49.531 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:49.532 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.532 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:49.532 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:49.532 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:49.532 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.532 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.532 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:49.532 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:49.532 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:49.532 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.532 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.532 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:49.532 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:53:49.533 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:53:49.533 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.533 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.533 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:49.533 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:53:49.533 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:53:49.533 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.533 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.533 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:49.533 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:53:49.533 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:53:49.533 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.534 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.534 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:49.534 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:53:49.534 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:53:49.534 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.534 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.534 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:49.534 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:53:49.534 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:53:49.534 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.534 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.534 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:49.535 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:53:49.535 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:53:49.535 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.535 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.535 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:49.535 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:53:49.535 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:53:49.535 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.535 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.535 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:49.535 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:53:49.535 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:53:49.535 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.535 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.536 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:49.536 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:53:49.536 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:53:49.536 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.536 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.536 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:49.536 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:53:49.536 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:53:49.536 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.536 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.536 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:49.536 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:53:49.536 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:53:49.537 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:49.537 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:49.537 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:49.537 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.537 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.537 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:49.537 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:49.537 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 116.50902681700001, 2024-04-25T22:53:49.537 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:53:49.537 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:49.537 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:49.537 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:49.537 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:49.538 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.538 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:49.538 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:49.538 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:49.538 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.538 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.538 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:49.538 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:49.539 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:49.539 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.539 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.539 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:49.539 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:53:49.539 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:53:49.539 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.539 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.539 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:49.539 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:53:49.539 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:53:49.539 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.540 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.540 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:49.540 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:53:49.540 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:53:49.540 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.540 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.540 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:49.540 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:53:49.540 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:53:49.540 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.540 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.540 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:49.540 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:53:49.540 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:53:49.541 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.541 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.541 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:49.541 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:53:49.541 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:53:49.541 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.541 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.541 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:49.541 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:53:49.541 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:53:49.541 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.541 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.542 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:49.542 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:53:49.542 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:53:49.542 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.542 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.542 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:49.542 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:53:49.542 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:53:49.542 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.543 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.543 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:49.543 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:53:49.543 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:53:49.543 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.543 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.544 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:49.544 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:53:49.544 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:53:49.544 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:49.544 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:49.544 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:49.544 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.545 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.545 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:49.545 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:49.545 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 116.50851760499999, 2024-04-25T22:53:49.545 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:53:49.545 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:49.545 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:49.545 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:49.545 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:49.545 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.545 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:49.546 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:49.546 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:49.546 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.546 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.546 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:49.546 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:49.546 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:49.546 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.546 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.546 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:49.546 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:53:49.546 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:53:49.546 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.547 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.547 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:49.547 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:53:49.547 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:53:49.547 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.547 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.547 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:49.547 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:53:49.547 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:53:49.547 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.547 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.547 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:49.547 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:53:49.548 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:53:49.548 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.548 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.548 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:49.548 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:53:49.548 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:53:49.548 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.548 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.548 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:49.548 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:53:49.548 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:53:49.548 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.549 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.549 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:49.549 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:53:49.549 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:53:49.549 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.549 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.549 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:49.549 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:53:49.550 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:53:49.550 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.550 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.550 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:49.550 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:53:49.550 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:53:49.551 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.551 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.551 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:49.551 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:53:49.551 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:53:49.551 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.552 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.552 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:49.552 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:53:49.552 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:53:49.552 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:49.552 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:49.552 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:49.553 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.553 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.553 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:49.553 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:49.553 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 116.508104407, 2024-04-25T22:53:49.553 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:53:49.554 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:49.554 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:49.554 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:49.554 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:49.554 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.554 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:49.555 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:49.555 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:49.555 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.555 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.555 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:49.555 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:49.556 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:49.556 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.556 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.556 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:49.556 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:49.556 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:53:49.557 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.557 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.557 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:49.557 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:49.557 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:53:49.558 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.558 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.558 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:49.558 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:53:49.558 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:53:49.558 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.559 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.559 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:49.559 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:53:49.559 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:53:49.559 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.559 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.559 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:49.560 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:53:49.560 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:53:49.560 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.560 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.560 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:49.560 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:53:49.561 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:53:49.561 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.561 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.561 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:49.561 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:53:49.561 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:53:49.561 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.562 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.562 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:49.562 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:53:49.562 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:53:49.562 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.562 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.563 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:49.563 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:53:49.563 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:53:49.563 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.563 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.563 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:49.564 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:53:49.564 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:53:49.564 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.564 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.564 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:49.564 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:53:49.565 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:53:49.565 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:49.565 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:49.565 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:49.565 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.565 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.566 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:49.566 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:49.566 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 116.508053737, 2024-04-25T22:53:49.566 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:53:49.566 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:49.567 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:49.567 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:49.567 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:49.567 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.567 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:49.567 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:49.568 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:49.568 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.568 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.568 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:49.568 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:49.569 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:49.569 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.569 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.569 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:49.569 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:53:49.569 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:53:49.569 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.570 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.570 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:49.570 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:53:49.570 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:53:49.570 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.570 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.571 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:49.571 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:53:49.571 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:53:49.571 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.571 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.572 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:49.572 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:53:49.572 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:53:49.572 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.572 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.572 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:49.573 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:53:49.573 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:53:49.573 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.573 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.573 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:49.574 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:53:49.574 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:53:49.574 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.574 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.574 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:49.575 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:53:49.575 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:53:49.575 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.575 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.575 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:49.575 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:53:49.576 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:53:49.576 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.576 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.576 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:49.576 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:53:49.577 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:53:49.577 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.577 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.577 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:49.577 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:53:49.577 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:53:49.578 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.578 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.578 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:49.578 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:53:49.578 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:53:49.578 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.579 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.579 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:49.579 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:53:49.579 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:53:49.579 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.579 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.579 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:49.580 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:53:49.580 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:53:49.580 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:49.580 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:49.580 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:49.580 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.581 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.581 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:49.581 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:49.581 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 116.508016868, 2024-04-25T22:53:49.581 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:53:49.581 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:49.581 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:49.581 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:49.582 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:49.582 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.582 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:49.582 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:49.582 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:49.582 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.582 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.583 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:49.583 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:49.583 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:49.583 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.583 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.583 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:49.583 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:53:49.584 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:53:49.584 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.584 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.584 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:49.584 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:53:49.584 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:53:49.585 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.585 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.585 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:49.585 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:53:49.585 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:53:49.585 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.586 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.586 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:49.586 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:53:49.586 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:53:49.586 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.586 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.586 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:49.586 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:53:49.587 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:53:49.587 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.587 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.587 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:53:49.587 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:53:49.587 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:53:49.587 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.587 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.588 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:49.588 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:53:49.588 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:53:49.588 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.588 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.588 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:49.588 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:53:49.588 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:53:49.588 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.589 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.589 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:49.589 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:53:49.589 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:53:49.589 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.589 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.589 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:49.590 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:53:49.590 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:53:49.590 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.590 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.590 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:49.590 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:53:49.591 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:53:49.591 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.591 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.591 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:49.591 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:53:49.591 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:53:49.591 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.592 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.592 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:49.592 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:53:49.592 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:53:49.592 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:49.592 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:49.593 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:49.593 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.593 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.593 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:49.593 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:49.594 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 116.507991902, 2024-04-25T22:53:49.594 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:53:49.594 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:49.594 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:49.594 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:49.594 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:49.595 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.595 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:49.595 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:49.595 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:49.595 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.596 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.596 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:49.596 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:49.596 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:49.596 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.596 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.597 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:49.597 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:53:49.597 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:53:49.597 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.597 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.597 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:49.598 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:53:49.598 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:53:49.598 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.598 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.598 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:49.598 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:49.599 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:53:49.599 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.599 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.599 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:49.599 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:53:49.600 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:53:49.600 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.600 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.600 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:49.600 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:53:49.601 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:53:49.601 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.601 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.601 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:49.601 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:53:49.601 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:53:49.602 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.602 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.602 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:49.602 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:53:49.602 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:53:49.603 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.603 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.603 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:49.603 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:53:49.603 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:53:49.604 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.604 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.604 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:49.604 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:53:49.604 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:53:49.604 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.605 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.605 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:49.605 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:53:49.605 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:53:49.605 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.606 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.606 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:49.606 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:53:49.606 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:53:49.606 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:49.606 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:49.607 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:49.607 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.607 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.607 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:49.607 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:49.607 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 116.507955538, 2024-04-25T22:53:49.608 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:53:49.608 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:49.608 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:49.608 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:49.608 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:49.608 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.608 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:49.608 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:49.608 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:49.609 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.609 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.609 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:49.609 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:49.609 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:49.609 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.609 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.609 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:49.609 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:53:49.609 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:53:49.609 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.609 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.609 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:49.609 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:53:49.610 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:53:49.610 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.610 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.610 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:49.610 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:53:49.610 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:53:49.610 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.610 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.610 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:49.610 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:53:49.610 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:53:49.610 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.611 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.611 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:49.611 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:53:49.611 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:53:49.611 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.611 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.611 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:49.611 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:53:49.611 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:53:49.611 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.611 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.611 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:49.611 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:53:49.611 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:53:49.612 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.612 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.612 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:49.612 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:53:49.612 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:53:49.612 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.612 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.612 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:49.612 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:53:49.612 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:53:49.612 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:49.612 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:49.612 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:49.612 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.613 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.613 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:49.613 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:49.613 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 116.507924457, 2024-04-25T22:53:49.613 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:53:49.613 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:49.613 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:49.613 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:49.613 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:49.613 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.613 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:49.613 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:49.613 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:49.614 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.614 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.614 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:49.614 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:49.614 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:49.614 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.614 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.614 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:49.614 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:49.614 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:49.614 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.614 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.614 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:49.615 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:53:49.615 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:53:49.615 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.615 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.615 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:49.615 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:53:49.615 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:53:49.615 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.615 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.615 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:49.615 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:53:49.615 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:53:49.615 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.615 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.616 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:49.616 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:53:49.616 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:53:49.616 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.616 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.616 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:49.616 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:53:49.616 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:53:49.616 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.616 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.616 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:49.617 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:53:49.617 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:53:49.617 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:49.617 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:49.617 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:49.617 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.617 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.617 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:30 4.31 4:8ebfc112:::1000000021d.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-25T22:53:49.617 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:53:49.617 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 18.468238586999998, 2024-04-25T22:53:49.617 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015003005, 2024-04-25T22:53:49.617 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:49.617 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:49.618 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:49.618 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:49.618 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:49.618 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:49.618 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 30 2024-04-25T22:53:49.618 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.618 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:49.618 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.618 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:49.618 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:53:49.618 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:49.618 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.618 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.619 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:49.619 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:53:49.619 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:49.619 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.619 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.619 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:49.619 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053133+0000", 2024-04-25T22:53:49.619 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0370000000000001e-06 2024-04-25T22:53:49.619 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.619 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.619 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:49.619 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060377+0000", 2024-04-25T22:53:49.619 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0072431070000000004 2024-04-25T22:53:49.620 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.620 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.620 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:49.620 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060388+0000", 2024-04-25T22:53:49.620 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1285e-05 2024-04-25T22:53:49.620 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.620 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.620 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:49.620 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060394+0000", 2024-04-25T22:53:49.620 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1040000000000003e-06 2024-04-25T22:53:49.620 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.620 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.620 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:49.620 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060483+0000", 2024-04-25T22:53:49.621 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.9345000000000006e-05 2024-04-25T22:53:49.621 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.621 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.621 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:49.621 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060566+0000", 2024-04-25T22:53:49.621 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2237999999999994e-05 2024-04-25T22:53:49.621 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.621 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.621 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:49.621 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068057+0000", 2024-04-25T22:53:49.621 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074912210000000002 2024-04-25T22:53:49.621 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.621 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.622 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:49.622 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068090+0000", 2024-04-25T22:53:49.622 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3501000000000003e-05 2024-04-25T22:53:49.622 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.622 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.622 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:49.622 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068134+0000", 2024-04-25T22:53:49.622 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4166999999999999e-05 2024-04-25T22:53:49.622 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:49.622 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:49.622 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:49.622 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.623 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.623 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:66 4.27 4:e5671758:::1000000024f.00000000:head [write 0~6641] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:49.623 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:49.623 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 18.208128251000002, 2024-04-25T22:53:49.623 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075166540000000002, 2024-04-25T22:53:49.623 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:49.623 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:49.623 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:49.623 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:49.623 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:49.623 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:49.623 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 66 2024-04-25T22:53:49.623 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.623 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:49.624 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.624 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:49.624 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:49.624 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:49.624 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.624 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.624 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:49.624 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:49.624 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:49.624 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.624 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.624 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:49.624 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:49.625 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4099999999999998e-07 2024-04-25T22:53:49.625 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.625 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.625 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:49.625 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313252+0000", 2024-04-25T22:53:49.625 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5380000000000008e-06 2024-04-25T22:53:49.625 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.625 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.625 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:49.625 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313260+0000", 2024-04-25T22:53:49.625 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2609999999999993e-06 2024-04-25T22:53:49.625 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.625 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.626 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:49.626 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313265+0000", 2024-04-25T22:53:49.626 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4850000000000003e-06 2024-04-25T22:53:49.626 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.626 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.626 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:49.626 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313310+0000", 2024-04-25T22:53:49.626 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5247999999999998e-05 2024-04-25T22:53:49.626 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.626 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.626 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:49.626 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313370+0000", 2024-04-25T22:53:49.626 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0275000000000001e-05 2024-04-25T22:53:49.627 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.627 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.627 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:49.627 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313435+0000", 2024-04-25T22:53:49.627 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4647000000000006e-05 2024-04-25T22:53:49.627 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.627 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.627 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:49.627 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314174+0000", 2024-04-25T22:53:49.627 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00073925 2024-04-25T22:53:49.627 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.627 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.627 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:49.627 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320688+0000", 2024-04-25T22:53:49.628 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.006513418 2024-04-25T22:53:49.628 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.628 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.628 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:49.628 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320736+0000", 2024-04-25T22:53:49.628 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.8114e-05 2024-04-25T22:53:49.628 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.628 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.628 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:49.628 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320758+0000", 2024-04-25T22:53:49.628 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2776999999999999e-05 2024-04-25T22:53:49.628 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:49.628 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:49.628 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:49.629 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.629 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.629 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:68 4.31 4:8fb7f7b7:::10000000251.00000000:head [write 0~2067] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:49.629 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:49.629 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 18.206442472999999, 2024-04-25T22:53:49.629 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0087011669999999992, 2024-04-25T22:53:49.629 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:49.629 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:49.629 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:49.629 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:49.629 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:49.629 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:49.629 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 68 2024-04-25T22:53:49.629 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.630 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:49.630 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.630 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:49.630 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:49.630 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:49.630 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.630 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.630 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:49.630 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:49.630 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:49.630 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.630 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.631 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:49.631 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:49.631 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:53:49.631 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.631 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.631 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:49.631 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314933+0000", 2024-04-25T22:53:49.631 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5430000000000004e-06 2024-04-25T22:53:49.631 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.631 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.631 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:49.631 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314944+0000", 2024-04-25T22:53:49.631 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.076e-05 2024-04-25T22:53:49.632 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.632 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.632 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:49.632 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314949+0000", 2024-04-25T22:53:49.632 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1019999999999996e-06 2024-04-25T22:53:49.632 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.632 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.632 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:49.632 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314996+0000", 2024-04-25T22:53:49.632 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7018999999999998e-05 2024-04-25T22:53:49.632 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.632 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.632 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:49.632 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315064+0000", 2024-04-25T22:53:49.633 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8738000000000005e-05 2024-04-25T22:53:49.633 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.633 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.633 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:49.633 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323531+0000", 2024-04-25T22:53:49.633 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084664739999999999 2024-04-25T22:53:49.633 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.633 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.633 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:49.633 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323574+0000", 2024-04-25T22:53:49.633 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3449999999999999e-05 2024-04-25T22:53:49.633 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.633 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.634 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:49.634 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323629+0000", 2024-04-25T22:53:49.634 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4296999999999999e-05 2024-04-25T22:53:49.634 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:49.634 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:49.634 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:49.634 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.634 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.634 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4734.0:69 4.32 e46/13 4:4e8c6251:::10000000252.00000000:head v 46'1, mlcod=0'0)", 2024-04-25T22:53:49.634 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:49.634 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 18.205411205000001, 2024-04-25T22:53:49.634 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076063240000000002, 2024-04-25T22:53:49.635 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:49.635 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:49.635 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:49.635 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:49.635 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.635 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:49.635 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:49.635 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:49.635 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.635 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.635 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:49.635 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:49.635 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:49.636 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.636 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.636 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:49.636 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:49.636 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3099999999999997e-07 2024-04-25T22:53:49.636 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.636 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.636 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:49.636 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315964+0000", 2024-04-25T22:53:49.636 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3229999999999999e-06 2024-04-25T22:53:49.636 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.636 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.636 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:49.637 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315973+0000", 2024-04-25T22:53:49.637 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7249999999999992e-06 2024-04-25T22:53:49.637 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.637 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.637 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:49.637 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315978+0000", 2024-04-25T22:53:49.637 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4830000000000001e-06 2024-04-25T22:53:49.637 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.637 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.637 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:49.637 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.316043+0000", 2024-04-25T22:53:49.637 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.5036000000000005e-05 2024-04-25T22:53:49.637 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.637 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.638 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:49.638 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.316055+0000", 2024-04-25T22:53:49.638 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1973999999999999e-05 2024-04-25T22:53:49.638 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.638 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.638 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:49.638 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323521+0000", 2024-04-25T22:53:49.638 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074660239999999999 2024-04-25T22:53:49.638 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.638 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.638 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:49.638 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323565+0000", 2024-04-25T22:53:49.639 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4128000000000002e-05 2024-04-25T22:53:49.639 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:49.639 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:49.639 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:49.639 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.639 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.639 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:72 4.36 4:6cdfec98:::10000000255.00000000:head [write 0~4131] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:49.639 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:49.639 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 18.203367292999999, 2024-04-25T22:53:49.639 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084820680000000006, 2024-04-25T22:53:49.639 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:49.639 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:49.639 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:49.639 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:49.640 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:49.640 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:49.640 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 72 2024-04-25T22:53:49.640 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.640 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:49.640 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.640 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:49.640 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:49.640 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:49.640 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.640 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.640 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:49.640 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:49.640 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:49.641 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.641 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.641 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:49.641 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:49.641 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1800000000000005e-07 2024-04-25T22:53:49.641 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.641 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.641 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:49.641 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318010+0000", 2024-04-25T22:53:49.641 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7399999999999998e-06 2024-04-25T22:53:49.641 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.641 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.641 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:49.642 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318019+0000", 2024-04-25T22:53:49.642 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0170000000000002e-06 2024-04-25T22:53:49.642 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.642 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.642 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:49.642 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318024+0000", 2024-04-25T22:53:49.642 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0150000000000003e-06 2024-04-25T22:53:49.642 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.642 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.642 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:49.642 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318075+0000", 2024-04-25T22:53:49.642 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0537000000000001e-05 2024-04-25T22:53:49.642 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.642 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.643 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:49.643 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318144+0000", 2024-04-25T22:53:49.643 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9432999999999997e-05 2024-04-25T22:53:49.643 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.643 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.643 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:49.643 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326392+0000", 2024-04-25T22:53:49.643 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0082482979999999994 2024-04-25T22:53:49.643 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.643 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.643 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:49.643 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326432+0000", 2024-04-25T22:53:49.643 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9870000000000003e-05 2024-04-25T22:53:49.644 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.644 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.644 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:49.644 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326485+0000", 2024-04-25T22:53:49.644 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2439999999999999e-05 2024-04-25T22:53:49.644 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:49.644 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:49.644 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:49.644 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.644 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.644 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:74 4.10 4:08e6f8ca:::10000000257.00000000:head [write 0~839] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:49.644 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:53:49.644 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 18.201893564999999, 2024-04-25T22:53:49.644 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070370720000000001, 2024-04-25T22:53:49.645 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:49.645 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:49.645 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:49.645 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:49.645 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:49.645 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:49.645 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 74 2024-04-25T22:53:49.645 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.645 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:49.645 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.645 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:49.645 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:53:49.645 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:49.645 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.646 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.646 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:49.646 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:53:49.646 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:49.646 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.646 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.646 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:49.646 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319477+0000", 2024-04-25T22:53:49.646 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1999999999999999e-07 2024-04-25T22:53:49.646 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.646 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.646 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:49.646 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319483+0000", 2024-04-25T22:53:49.647 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4260000000000002e-06 2024-04-25T22:53:49.647 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.647 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.647 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:49.647 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319494+0000", 2024-04-25T22:53:49.647 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.094e-05 2024-04-25T22:53:49.647 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.647 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.647 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:49.647 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319499+0000", 2024-04-25T22:53:49.647 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3789999999999997e-06 2024-04-25T22:53:49.647 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.647 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.648 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:49.648 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319545+0000", 2024-04-25T22:53:49.648 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6149000000000001e-05 2024-04-25T22:53:49.648 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.648 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.648 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:49.648 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319617+0000", 2024-04-25T22:53:49.648 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1792999999999995e-05 2024-04-25T22:53:49.648 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.648 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.648 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:49.648 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326406+0000", 2024-04-25T22:53:49.648 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067895999999999998 2024-04-25T22:53:49.648 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.649 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.649 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:49.649 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326443+0000", 2024-04-25T22:53:49.649 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6828e-05 2024-04-25T22:53:49.649 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.649 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.649 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:49.649 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326514+0000", 2024-04-25T22:53:49.649 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0236999999999999e-05 2024-04-25T22:53:49.649 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:49.649 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:49.649 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:49.649 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.650 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.650 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:128 3.1f 3:f83d65d8:::200.00000004:head [write 876784~3317520 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e48)", 2024-04-25T22:53:49.650 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:36.985410+0000", 2024-04-25T22:53:49.650 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 12.535959947, 2024-04-25T22:53:49.650 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0090177360000000002, 2024-04-25T22:53:49.650 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:49.650 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:49.650 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:49.650 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:49.650 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.650 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:49.650 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.985410+0000", 2024-04-25T22:53:49.650 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:49.651 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.651 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.651 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:49.651 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.985410+0000", 2024-04-25T22:53:49.651 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:49.651 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.651 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.651 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:49.651 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.985411+0000", 2024-04-25T22:53:49.651 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8400000000000003e-07 2024-04-25T22:53:49.651 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.651 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.651 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:49.651 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989116+0000", 2024-04-25T22:53:49.652 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037047389999999999 2024-04-25T22:53:49.652 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.652 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.652 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:49.652 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989128+0000", 2024-04-25T22:53:49.652 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1977999999999999e-05 2024-04-25T22:53:49.652 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.652 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.652 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:49.652 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989135+0000", 2024-04-25T22:53:49.652 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5290000000000003e-06 2024-04-25T22:53:49.652 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.652 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.653 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:49.653 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989181+0000", 2024-04-25T22:53:49.653 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6122999999999999e-05 2024-04-25T22:53:49.653 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.653 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.653 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:49.653 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989250+0000", 2024-04-25T22:53:49.653 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8535999999999996e-05 2024-04-25T22:53:49.653 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.653 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.653 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:49.653 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.994272+0000", 2024-04-25T22:53:49.653 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050224889999999998 2024-04-25T22:53:49.653 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.654 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.654 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:49.654 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.994335+0000", 2024-04-25T22:53:49.654 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2588000000000005e-05 2024-04-25T22:53:49.654 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.654 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.654 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:49.654 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.994428+0000", 2024-04-25T22:53:49.654 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2869999999999997e-05 2024-04-25T22:53:49.654 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:49.654 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:49.654 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:49.654 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.654 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.655 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:2150 4.22 4:47cffac6:::10000000a2b.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T22:53:49.655 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:41.078233+0000", 2024-04-25T22:53:49.655 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 8.4431366370000003, 2024-04-25T22:53:49.655 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069201510000000003, 2024-04-25T22:53:49.655 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:49.655 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:49.655 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:49.655 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:49.655 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.655 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:49.655 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078233+0000", 2024-04-25T22:53:49.655 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:49.655 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.656 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.656 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:49.656 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078233+0000", 2024-04-25T22:53:49.656 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:49.656 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.656 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.656 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:49.656 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078234+0000", 2024-04-25T22:53:49.656 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1699999999999998e-07 2024-04-25T22:53:49.656 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.656 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.656 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:49.656 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078236+0000", 2024-04-25T22:53:49.657 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.875e-06 2024-04-25T22:53:49.657 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.657 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.657 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:49.657 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078242+0000", 2024-04-25T22:53:49.657 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2450000000000003e-06 2024-04-25T22:53:49.657 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.657 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.657 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:49.657 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078247+0000", 2024-04-25T22:53:49.657 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7450000000000003e-06 2024-04-25T22:53:49.657 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.657 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.658 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:49.658 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078641+0000", 2024-04-25T22:53:49.658 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00039420200000000002 2024-04-25T22:53:49.658 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.658 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.658 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:49.658 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078840+0000", 2024-04-25T22:53:49.658 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000199063 2024-04-25T22:53:49.658 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.658 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.658 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:49.658 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078919+0000", 2024-04-25T22:53:49.658 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9182000000000002e-05 2024-04-25T22:53:49.659 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.659 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.659 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:49.659 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.080906+0000", 2024-04-25T22:53:49.659 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0019866390000000001 2024-04-25T22:53:49.659 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.659 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.659 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:49.659 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085074+0000", 2024-04-25T22:53:49.659 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0041683639999999999 2024-04-25T22:53:49.659 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.659 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.659 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:49.660 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085117+0000", 2024-04-25T22:53:49.660 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2849999999999998e-05 2024-04-25T22:53:49.660 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.660 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.660 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:49.660 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085154+0000", 2024-04-25T22:53:49.660 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6468999999999999e-05 2024-04-25T22:53:49.660 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:49.660 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:49.660 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:49.660 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.660 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.660 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:2160 4.2a 4:57f9ed86:::10000000a3d.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T22:53:49.661 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:53:49.661 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 8.4426673470000004, 2024-04-25T22:53:49.661 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0068959959999999997, 2024-04-25T22:53:49.661 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:49.661 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:49.661 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:49.661 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:49.661 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.661 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:49.661 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:53:49.661 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:49.661 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.661 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.662 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:49.662 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:53:49.662 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:49.662 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.662 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.662 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:49.662 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:53:49.662 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7000000000000004e-07 2024-04-25T22:53:49.662 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.662 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.662 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:49.662 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078707+0000", 2024-04-25T22:53:49.663 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.783e-06 2024-04-25T22:53:49.663 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.663 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.663 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:49.664 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078716+0000", 2024-04-25T22:53:49.664 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4800000000000001e-06 2024-04-25T22:53:49.664 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.664 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.664 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:49.664 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078724+0000", 2024-04-25T22:53:49.664 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1519999999999992e-06 2024-04-25T22:53:49.664 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.664 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.664 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:49.664 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078794+0000", 2024-04-25T22:53:49.664 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0500999999999995e-05 2024-04-25T22:53:49.664 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.665 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.665 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:49.665 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078912+0000", 2024-04-25T22:53:49.665 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000117439 2024-04-25T22:53:49.665 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.665 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.665 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:49.665 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079000+0000", 2024-04-25T22:53:49.665 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8092999999999998e-05 2024-04-25T22:53:49.665 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.665 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.665 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:49.665 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.080897+0000", 2024-04-25T22:53:49.666 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0018970899999999999 2024-04-25T22:53:49.666 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.666 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.666 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:49.666 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085517+0000", 2024-04-25T22:53:49.666 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0046198929999999999 2024-04-25T22:53:49.666 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.666 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.666 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:49.666 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085565+0000", 2024-04-25T22:53:49.666 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7777e-05 2024-04-25T22:53:49.666 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.666 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.667 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:49.667 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085599+0000", 2024-04-25T22:53:49.667 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4017999999999999e-05 2024-04-25T22:53:49.667 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:49.667 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:49.667 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:49.667 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.667 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.667 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:2163 4.2a 4:549f79e3:::10000000a43.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T22:53:49.667 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:53:49.667 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 8.4426339939999995, 2024-04-25T22:53:49.667 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069469190000000002, 2024-04-25T22:53:49.667 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:49.667 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:49.668 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:49.668 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:49.668 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.668 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:49.668 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:53:49.668 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:49.668 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.668 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.668 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:49.668 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:53:49.668 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:49.668 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.668 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.669 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:49.669 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:53:49.669 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1399999999999997e-07 2024-04-25T22:53:49.669 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.669 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.669 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:49.669 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078739+0000", 2024-04-25T22:53:49.669 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2960000000000001e-06 2024-04-25T22:53:49.669 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.669 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.669 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:49.669 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078745+0000", 2024-04-25T22:53:49.669 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3439999999999997e-06 2024-04-25T22:53:49.670 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.670 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.670 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:49.670 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078750+0000", 2024-04-25T22:53:49.670 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3179999999999997e-06 2024-04-25T22:53:49.670 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.670 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.670 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:49.670 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079224+0000", 2024-04-25T22:53:49.670 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00047334999999999999 2024-04-25T22:53:49.670 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.670 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.670 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:49.670 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079292+0000", 2024-04-25T22:53:49.671 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8708999999999996e-05 2024-04-25T22:53:49.671 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.671 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.671 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:49.671 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079342+0000", 2024-04-25T22:53:49.671 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9299999999999999e-05 2024-04-25T22:53:49.671 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.671 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.671 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:49.671 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.081611+0000", 2024-04-25T22:53:49.671 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0022695229999999999 2024-04-25T22:53:49.671 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.671 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.672 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:49.672 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085605+0000", 2024-04-25T22:53:49.672 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0039933679999999997 2024-04-25T22:53:49.672 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.672 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.672 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:49.672 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085650+0000", 2024-04-25T22:53:49.672 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5111000000000002e-05 2024-04-25T22:53:49.672 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:49.672 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:49.672 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:49.672 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085683+0000", 2024-04-25T22:53:49.672 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3185999999999997e-05 2024-04-25T22:53:49.672 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:49.673 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:49.673 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:49.673 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:49.673 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:49.673 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:49.674 INFO:tasks.workunit.client.0.smithi052.stdout: [CC] doio 2024-04-25T22:53:49.674 INFO:tasks.workunit.client.0.smithi052.stdout: [CC] fsstress 2024-04-25T22:53:49.674 INFO:tasks.workunit.client.0.smithi052.stdout: [CC] fsx 2024-04-25T22:53:49.675 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:49.676 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:49.673+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:49.775 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:49.774+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:49.780 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:49.780 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:49.780 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-04-25T22:53:49.780 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:49.788 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:49.876 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:49.876+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:49.906 INFO:tasks.workunit.client.0.smithi052.stderr:fsstress.c: In function 'attr_list_path': 2024-04-25T22:53:49.906 INFO:tasks.workunit.client.0.smithi052.stderr:fsstress.c:859:9: warning: 'attr_list' is deprecated: Use listxattr or llistxattr instead [-Wdeprecated-declarations] 2024-04-25T22:53:49.906 INFO:tasks.workunit.client.0.smithi052.stderr: 859 | rval = attr_list(name->path, buffer, buffersize, flags, cursor); 2024-04-25T22:53:49.906 INFO:tasks.workunit.client.0.smithi052.stderr: | ^~~~ 2024-04-25T22:53:49.906 INFO:tasks.workunit.client.0.smithi052.stderr:In file included from ../src/global.h:25, 2024-04-25T22:53:49.906 INFO:tasks.workunit.client.0.smithi052.stderr: from fsstress.c:12: 2024-04-25T22:53:49.906 INFO:tasks.workunit.client.0.smithi052.stderr:/usr/include/attr/attributes.h:165:12: note: declared here 2024-04-25T22:53:49.906 INFO:tasks.workunit.client.0.smithi052.stderr: 165 | extern int attr_list(const char *__path, char *__buffer, const int __buffersize, 2024-04-25T22:53:49.906 INFO:tasks.workunit.client.0.smithi052.stderr: | ^~~~~~~~~ 2024-04-25T22:53:49.907 INFO:tasks.workunit.client.0.smithi052.stderr:fsstress.c: In function 'attr_remove_path': 2024-04-25T22:53:49.907 INFO:tasks.workunit.client.0.smithi052.stderr:fsstress.c:878:9: warning: 'attr_remove' is deprecated: Use removexattr or lremovexattr instead [-Wdeprecated-declarations] 2024-04-25T22:53:49.907 INFO:tasks.workunit.client.0.smithi052.stderr: 878 | rval = attr_remove(name->path, attrname, flags); 2024-04-25T22:53:49.907 INFO:tasks.workunit.client.0.smithi052.stderr: | ^~~~ 2024-04-25T22:53:49.907 INFO:tasks.workunit.client.0.smithi052.stderr:In file included from ../src/global.h:25, 2024-04-25T22:53:49.907 INFO:tasks.workunit.client.0.smithi052.stderr: from fsstress.c:12: 2024-04-25T22:53:49.907 INFO:tasks.workunit.client.0.smithi052.stderr:/usr/include/attr/attributes.h:152:12: note: declared here 2024-04-25T22:53:49.907 INFO:tasks.workunit.client.0.smithi052.stderr: 152 | extern int attr_remove (const char *__path, const char *__attrname, 2024-04-25T22:53:49.907 INFO:tasks.workunit.client.0.smithi052.stderr: | ^~~~~~~~~~~ 2024-04-25T22:53:49.907 INFO:tasks.workunit.client.0.smithi052.stderr:fsstress.c: In function 'attr_set_path': 2024-04-25T22:53:49.907 INFO:tasks.workunit.client.0.smithi052.stderr:fsstress.c:898:9: warning: 'attr_set' is deprecated: Use setxattr or lsetxattr instead [-Wdeprecated-declarations] 2024-04-25T22:53:49.907 INFO:tasks.workunit.client.0.smithi052.stderr: 898 | rval = attr_set(name->path, attrname, attrvalue, valuelength, flags); 2024-04-25T22:53:49.907 INFO:tasks.workunit.client.0.smithi052.stderr: | ^~~~ 2024-04-25T22:53:49.908 INFO:tasks.workunit.client.0.smithi052.stderr:In file included from ../src/global.h:25, 2024-04-25T22:53:49.908 INFO:tasks.workunit.client.0.smithi052.stderr: from fsstress.c:12: 2024-04-25T22:53:49.908 INFO:tasks.workunit.client.0.smithi052.stderr:/usr/include/attr/attributes.h:139:12: note: declared here 2024-04-25T22:53:49.908 INFO:tasks.workunit.client.0.smithi052.stderr: 139 | extern int attr_set (const char *__path, const char *__attrname, 2024-04-25T22:53:49.908 INFO:tasks.workunit.client.0.smithi052.stderr: | ^~~~~~~~ 2024-04-25T22:53:49.918 INFO:tasks.workunit.client.0.smithi052.stderr:fsstress.c: In function 'allocsp_f': 2024-04-25T22:53:49.918 INFO:tasks.workunit.client.0.smithi052.stderr:fsstress.c:2047:32: error: 'XFS_IOC_ALLOCSP64' undeclared (first use in this function); did you mean 'XFS_IOC_RESVSP64'? 2024-04-25T22:53:49.918 INFO:tasks.workunit.client.0.smithi052.stderr: 2047 | e = xfsctl(f.path, fd, XFS_IOC_ALLOCSP64, &fl) < 0 ? errno : 0; 2024-04-25T22:53:49.918 INFO:tasks.workunit.client.0.smithi052.stderr: | ^~~~~~~~~~~~~~~~~ 2024-04-25T22:53:49.918 INFO:tasks.workunit.client.0.smithi052.stderr: | XFS_IOC_RESVSP64 2024-04-25T22:53:49.918 INFO:tasks.workunit.client.0.smithi052.stderr:fsstress.c:2047:32: note: each undeclared identifier is reported only once for each function it appears in 2024-04-25T22:53:49.930 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:49.930 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:49.930 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:53:49.930 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:53:49.930 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:49.937 INFO:tasks.workunit.client.0.smithi052.stderr:fsstress.c: In function 'freesp_f': 2024-04-25T22:53:49.937 INFO:tasks.workunit.client.0.smithi052.stderr:fsstress.c:3640:32: error: 'XFS_IOC_FREESP64' undeclared (first use in this function); did you mean 'XFS_IOC_RESVSP64'? 2024-04-25T22:53:49.937 INFO:tasks.workunit.client.0.smithi052.stderr: 3640 | e = xfsctl(f.path, fd, XFS_IOC_FREESP64, &fl) < 0 ? errno : 0; 2024-04-25T22:53:49.937 INFO:tasks.workunit.client.0.smithi052.stderr: | ^~~~~~~~~~~~~~~~ 2024-04-25T22:53:49.937 INFO:tasks.workunit.client.0.smithi052.stderr: | XFS_IOC_RESVSP64 2024-04-25T22:53:49.940 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:49.974 INFO:tasks.workunit.client.0.smithi052.stderr:gmake[3]: *** [Makefile:46: fsstress] Error 1 2024-04-25T22:53:49.975 INFO:tasks.workunit.client.0.smithi052.stderr:gmake[3]: *** Waiting for unfinished jobs.... 2024-04-25T22:53:49.983 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:49.983+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:50.045 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:50.045 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-04-25T22:53:50.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-04-25T22:53:50.045 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:53:50.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.045 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:50.045 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:50.045 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 122.077748349, 2024-04-25T22:53:50.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010384338999999999, 2024-04-25T22:53:50.045 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:50.045 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:50.045 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:50.046 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:50.046 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:50.046 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:50.046 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-04-25T22:53:50.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.046 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:50.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.046 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:50.046 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:50.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:50.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:50.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:50.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:50.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:50.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:50.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3600000000000004e-07 2024-04-25T22:53:50.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:50.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965185+0000", 2024-04-25T22:53:50.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.117e-06 2024-04-25T22:53:50.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.048 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:50.048 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965192+0000", 2024-04-25T22:53:50.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3239999999999997e-06 2024-04-25T22:53:50.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.048 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:50.048 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965198+0000", 2024-04-25T22:53:50.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6370000000000004e-06 2024-04-25T22:53:50.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.048 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:50.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970973+0000", 2024-04-25T22:53:50.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057748239999999996 2024-04-25T22:53:50.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:50.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971049+0000", 2024-04-25T22:53:50.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6029e-05 2024-04-25T22:53:50.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:50.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971174+0000", 2024-04-25T22:53:50.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012462399999999999 2024-04-25T22:53:50.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:50.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971553+0000", 2024-04-25T22:53:50.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037896499999999999 2024-04-25T22:53:50.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:50.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975482+0000", 2024-04-25T22:53:50.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039297459999999996 2024-04-25T22:53:50.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:50.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975529+0000", 2024-04-25T22:53:50.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6387000000000002e-05 2024-04-25T22:53:50.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:50.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975563+0000", 2024-04-25T22:53:50.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4150000000000003e-05 2024-04-25T22:53:50.051 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:50.051 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:50.051 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:50.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.051 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:50.051 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:50.052 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 117.030702026, 2024-04-25T22:53:50.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012637705000000001, 2024-04-25T22:53:50.052 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:50.052 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:50.052 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:50.052 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:50.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:50.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:50.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:50.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:50.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:50.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:50.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.053 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:50.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012227+0000", 2024-04-25T22:53:50.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.863e-06 2024-04-25T22:53:50.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.053 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:50.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012236+0000", 2024-04-25T22:53:50.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1109999999999997e-06 2024-04-25T22:53:50.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:50.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012309+0000", 2024-04-25T22:53:50.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3242000000000001e-05 2024-04-25T22:53:50.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:50.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012324+0000", 2024-04-25T22:53:50.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4837e-05 2024-04-25T22:53:50.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:50.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015060+0000", 2024-04-25T22:53:50.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027363349999999999 2024-04-25T22:53:50.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.055 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:50.055 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015169+0000", 2024-04-25T22:53:50.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108372 2024-04-25T22:53:50.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.055 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:50.055 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015498+0000", 2024-04-25T22:53:50.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032949999999999999 2024-04-25T22:53:50.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.055 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:50.055 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021282+0000", 2024-04-25T22:53:50.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057836429999999998 2024-04-25T22:53:50.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:50.056 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024709+0000", 2024-04-25T22:53:50.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034271979999999998 2024-04-25T22:53:50.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:50.056 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024802+0000", 2024-04-25T22:53:50.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2960000000000004e-05 2024-04-25T22:53:50.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:50.057 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024863+0000", 2024-04-25T22:53:50.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0643999999999997e-05 2024-04-25T22:53:50.057 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:50.057 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:50.057 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:50.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.057 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:50.057 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:50.057 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 117.03057825499999, 2024-04-25T22:53:50.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012979447999999999, 2024-04-25T22:53:50.057 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:50.057 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:50.058 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:50.058 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:50.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:50.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:50.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:50.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:50.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:50.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:50.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:50.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:50.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:53:50.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:50.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012354+0000", 2024-04-25T22:53:50.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7740000000000004e-06 2024-04-25T22:53:50.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:50.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012365+0000", 2024-04-25T22:53:50.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.064e-05 2024-04-25T22:53:50.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:50.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012382+0000", 2024-04-25T22:53:50.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6999000000000001e-05 2024-04-25T22:53:50.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:50.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015958+0000", 2024-04-25T22:53:50.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035765699999999998 2024-04-25T22:53:50.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:50.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016037+0000", 2024-04-25T22:53:50.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8242000000000001e-05 2024-04-25T22:53:50.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:50.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016404+0000", 2024-04-25T22:53:50.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036784300000000002 2024-04-25T22:53:50.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:50.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021294+0000", 2024-04-25T22:53:50.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048890629999999999 2024-04-25T22:53:50.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:50.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024959+0000", 2024-04-25T22:53:50.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036651570000000001 2024-04-25T22:53:50.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:50.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025097+0000", 2024-04-25T22:53:50.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013788099999999999 2024-04-25T22:53:50.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:50.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025328+0000", 2024-04-25T22:53:50.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231492 2024-04-25T22:53:50.062 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:50.063 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:50.063 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:50.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.063 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:50.063 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:50.063 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 117.03049048600001, 2024-04-25T22:53:50.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013049827, 2024-04-25T22:53:50.063 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:50.063 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:50.063 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:50.063 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:50.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:50.064 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:50.064 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:50.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.064 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:50.064 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:50.064 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:50.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.064 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:50.064 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012437+0000", 2024-04-25T22:53:50.064 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-04-25T22:53:50.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:50.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012440+0000", 2024-04-25T22:53:50.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7609999999999999e-06 2024-04-25T22:53:50.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:50.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012449+0000", 2024-04-25T22:53:50.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.285e-06 2024-04-25T22:53:50.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:50.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012457+0000", 2024-04-25T22:53:50.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9510000000000006e-06 2024-04-25T22:53:50.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:50.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017106+0000", 2024-04-25T22:53:50.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046494220000000003 2024-04-25T22:53:50.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:50.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017223+0000", 2024-04-25T22:53:50.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116824 2024-04-25T22:53:50.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:50.067 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017345+0000", 2024-04-25T22:53:50.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122175 2024-04-25T22:53:50.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.067 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:50.067 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021299+0000", 2024-04-25T22:53:50.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039534879999999998 2024-04-25T22:53:50.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.067 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:50.067 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025398+0000", 2024-04-25T22:53:50.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040988960000000003 2024-04-25T22:53:50.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.068 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:50.068 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025439+0000", 2024-04-25T22:53:50.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0915999999999999e-05 2024-04-25T22:53:50.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.068 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:50.068 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025486+0000", 2024-04-25T22:53:50.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7534999999999998e-05 2024-04-25T22:53:50.068 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:50.068 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:50.068 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:50.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.069 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:50.069 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:50.069 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 117.030460335, 2024-04-25T22:53:50.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020988041999999998, 2024-04-25T22:53:50.069 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:50.069 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:50.069 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:50.069 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:50.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:50.069 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:50.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:50.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:50.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:50.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:50.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:50.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:50.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.99e-07 2024-04-25T22:53:50.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:50.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012470+0000", 2024-04-25T22:53:50.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2789999999999999e-06 2024-04-25T22:53:50.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:50.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012477+0000", 2024-04-25T22:53:50.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:53:50.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:50.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012500+0000", 2024-04-25T22:53:50.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2490999999999999e-05 2024-04-25T22:53:50.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:50.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021911+0000", 2024-04-25T22:53:50.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094114160000000006 2024-04-25T22:53:50.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:50.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022000+0000", 2024-04-25T22:53:50.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8601000000000001e-05 2024-04-25T22:53:50.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:50.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022359+0000", 2024-04-25T22:53:50.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035921999999999999 2024-04-25T22:53:50.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:50.073 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025541+0000", 2024-04-25T22:53:50.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031820619999999998 2024-04-25T22:53:50.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:50.073 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033375+0000", 2024-04-25T22:53:50.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078338379999999992 2024-04-25T22:53:50.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.074 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:50.074 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033415+0000", 2024-04-25T22:53:50.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9527000000000003e-05 2024-04-25T22:53:50.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.074 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:50.074 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033455+0000", 2024-04-25T22:53:50.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9932000000000003e-05 2024-04-25T22:53:50.074 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:50.074 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:50.074 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:50.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.075 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:50.075 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:50.075 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 117.03040514200001, 2024-04-25T22:53:50.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021043857999999999, 2024-04-25T22:53:50.075 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:50.075 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:50.075 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:50.075 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:50.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:50.075 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:50.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:50.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.076 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:50.076 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:50.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:50.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.076 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:50.076 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012523+0000", 2024-04-25T22:53:50.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.361e-06 2024-04-25T22:53:50.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.076 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:50.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012530+0000", 2024-04-25T22:53:50.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5440000000000004e-06 2024-04-25T22:53:50.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.077 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:50.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012541+0000", 2024-04-25T22:53:50.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1745e-05 2024-04-25T22:53:50.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.077 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:50.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012551+0000", 2024-04-25T22:53:50.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5789999999999993e-06 2024-04-25T22:53:50.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:50.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022709+0000", 2024-04-25T22:53:50.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010157685 2024-04-25T22:53:50.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:50.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022957+0000", 2024-04-25T22:53:50.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024824599999999998 2024-04-25T22:53:50.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:50.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023443+0000", 2024-04-25T22:53:50.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048578599999999999 2024-04-25T22:53:50.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:50.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025547+0000", 2024-04-25T22:53:50.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021044789999999998 2024-04-25T22:53:50.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:50.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033509+0000", 2024-04-25T22:53:50.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0079622180000000001 2024-04-25T22:53:50.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:50.080 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033542+0000", 2024-04-25T22:53:50.080 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3018000000000001e-05 2024-04-25T22:53:50.080 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.080 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.080 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:50.080 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033566+0000", 2024-04-25T22:53:50.080 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3197000000000002e-05 2024-04-25T22:53:50.080 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:50.080 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:50.080 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:50.080 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.080 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.080 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:50.081 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:50.081 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 117.03036517699999, 2024-04-25T22:53:50.081 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021122696, 2024-04-25T22:53:50.081 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:50.081 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:50.081 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:50.081 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:50.081 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.081 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:50.081 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:50.081 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:50.081 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.081 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.081 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:50.082 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:50.082 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:50.082 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.082 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.082 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:50.082 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:50.082 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:53:50.082 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.082 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.082 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:50.082 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012566+0000", 2024-04-25T22:53:50.083 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-04-25T22:53:50.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.083 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.083 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:50.083 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012619+0000", 2024-04-25T22:53:50.083 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2607e-05 2024-04-25T22:53:50.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.083 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.083 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:50.083 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012628+0000", 2024-04-25T22:53:50.083 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6500000000000008e-06 2024-04-25T22:53:50.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.083 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.083 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:50.084 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024024+0000", 2024-04-25T22:53:50.084 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011396007999999999 2024-04-25T22:53:50.084 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.084 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:50.084 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024198+0000", 2024-04-25T22:53:50.084 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000173215 2024-04-25T22:53:50.084 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.084 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:50.084 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024447+0000", 2024-04-25T22:53:50.084 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024898500000000002 2024-04-25T22:53:50.084 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.085 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.085 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:50.085 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026431+0000", 2024-04-25T22:53:50.085 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001984923 2024-04-25T22:53:50.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.085 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.085 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:50.085 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033608+0000", 2024-04-25T22:53:50.085 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071768459999999997 2024-04-25T22:53:50.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.085 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.085 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:50.085 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033646+0000", 2024-04-25T22:53:50.085 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299000000000003e-05 2024-04-25T22:53:50.086 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.086 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.086 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:50.086 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033684+0000", 2024-04-25T22:53:50.086 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8773000000000003e-05 2024-04-25T22:53:50.086 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:50.086 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:50.086 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:50.086 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.086 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.086 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:50.086 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:50.086 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 117.030276578, 2024-04-25T22:53:50.087 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021175381, 2024-04-25T22:53:50.087 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:50.087 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:50.087 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:50.087 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:50.087 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.087 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:50.087 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:50.087 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:50.087 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.087 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.087 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:50.087 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:50.088 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:50.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.088 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.088 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:50.088 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012651+0000", 2024-04-25T22:53:50.088 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:53:50.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.088 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.088 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:50.088 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012656+0000", 2024-04-25T22:53:50.088 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8899999999999998e-06 2024-04-25T22:53:50.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.088 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.089 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:50.089 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012666+0000", 2024-04-25T22:53:50.089 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0346999999999999e-05 2024-04-25T22:53:50.089 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.089 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.089 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:50.089 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012675+0000", 2024-04-25T22:53:50.089 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9930000000000001e-06 2024-04-25T22:53:50.089 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.089 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.089 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:50.089 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025661+0000", 2024-04-25T22:53:50.089 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01298531 2024-04-25T22:53:50.089 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.090 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.090 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:50.090 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025757+0000", 2024-04-25T22:53:50.090 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5822000000000005e-05 2024-04-25T22:53:50.090 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.090 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.090 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:50.090 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025907+0000", 2024-04-25T22:53:50.090 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015051499999999999 2024-04-25T22:53:50.090 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.090 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.090 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:50.090 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026435+0000", 2024-04-25T22:53:50.091 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052762200000000005 2024-04-25T22:53:50.091 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.091 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.091 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:50.091 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033732+0000", 2024-04-25T22:53:50.091 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072978419999999997 2024-04-25T22:53:50.091 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.091 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.091 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:50.091 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033787+0000", 2024-04-25T22:53:50.091 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4703999999999997e-05 2024-04-25T22:53:50.091 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.091 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.092 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:50.092 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033826+0000", 2024-04-25T22:53:50.092 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8458999999999999e-05 2024-04-25T22:53:50.092 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:50.092 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:50.092 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:50.092 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.092 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.092 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:50.092 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:50.092 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 117.030221164, 2024-04-25T22:53:50.092 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021244174000000001, 2024-04-25T22:53:50.093 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:50.093 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:50.093 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:50.093 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:50.093 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.093 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:50.093 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:50.093 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:50.093 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.093 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.093 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:50.093 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:50.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:50.094 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.094 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.094 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:50.094 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:50.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:50.094 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.094 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.094 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:50.094 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012712+0000", 2024-04-25T22:53:50.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.913e-06 2024-04-25T22:53:50.094 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.094 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.095 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:50.095 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012722+0000", 2024-04-25T22:53:50.095 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2879999999999998e-06 2024-04-25T22:53:50.095 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.095 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.095 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:50.095 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012727+0000", 2024-04-25T22:53:50.095 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8429999999999998e-06 2024-04-25T22:53:50.095 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.095 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.095 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:50.095 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026099+0000", 2024-04-25T22:53:50.095 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013371450999999999 2024-04-25T22:53:50.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.096 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:50.096 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026147+0000", 2024-04-25T22:53:50.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7837999999999998e-05 2024-04-25T22:53:50.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.096 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:50.096 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026254+0000", 2024-04-25T22:53:50.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107314 2024-04-25T22:53:50.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.096 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:50.097 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026686+0000", 2024-04-25T22:53:50.097 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000432428 2024-04-25T22:53:50.097 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.097 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:50.097 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033873+0000", 2024-04-25T22:53:50.097 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071864399999999997 2024-04-25T22:53:50.097 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.097 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:50.097 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033904+0000", 2024-04-25T22:53:50.097 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1321e-05 2024-04-25T22:53:50.097 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.098 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:50.098 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033950+0000", 2024-04-25T22:53:50.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5707999999999997e-05 2024-04-25T22:53:50.098 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:50.098 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:50.098 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:50.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.098 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:50.098 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:50.098 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 117.03019077899999, 2024-04-25T22:53:50.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01096505, 2024-04-25T22:53:50.099 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:50.099 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:50.099 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:50.099 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:50.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.099 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:50.099 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:50.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:50.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.099 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:50.099 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:50.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:50.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.100 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:50.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012737+0000", 2024-04-25T22:53:50.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:50.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.100 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:50.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012739+0000", 2024-04-25T22:53:50.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-04-25T22:53:50.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:50.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012743+0000", 2024-04-25T22:53:50.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3239999999999996e-06 2024-04-25T22:53:50.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:50.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012746+0000", 2024-04-25T22:53:50.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.129e-06 2024-04-25T22:53:50.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:50.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012796+0000", 2024-04-25T22:53:50.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9231999999999999e-05 2024-04-25T22:53:50.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:50.102 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012915+0000", 2024-04-25T22:53:50.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119021 2024-04-25T22:53:50.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:50.102 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013069+0000", 2024-04-25T22:53:50.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015463900000000001 2024-04-25T22:53:50.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:50.102 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019237+0000", 2024-04-25T22:53:50.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061680329999999998 2024-04-25T22:53:50.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.103 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:50.103 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023603+0000", 2024-04-25T22:53:50.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043655860000000003 2024-04-25T22:53:50.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.103 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:50.103 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023659+0000", 2024-04-25T22:53:50.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6484000000000003e-05 2024-04-25T22:53:50.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.103 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:50.104 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023701+0000", 2024-04-25T22:53:50.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1761999999999998e-05 2024-04-25T22:53:50.104 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:50.104 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:50.104 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:50.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.104 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:50.104 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:50.104 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 117.03016583100001, 2024-04-25T22:53:50.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011234429000000001, 2024-04-25T22:53:50.104 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:50.104 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:50.104 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:50.105 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:50.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:50.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:50.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:50.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:50.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:50.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:50.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:50.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012762+0000", 2024-04-25T22:53:50.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-04-25T22:53:50.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:50.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012765+0000", 2024-04-25T22:53:50.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2569999999999999e-06 2024-04-25T22:53:50.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:50.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012783+0000", 2024-04-25T22:53:50.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8431999999999999e-05 2024-04-25T22:53:50.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:50.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012799+0000", 2024-04-25T22:53:50.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5438999999999999e-05 2024-04-25T22:53:50.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:50.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013826+0000", 2024-04-25T22:53:50.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010275060000000001 2024-04-25T22:53:50.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:50.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013913+0000", 2024-04-25T22:53:50.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.708e-05 2024-04-25T22:53:50.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.108 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:50.108 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014098+0000", 2024-04-25T22:53:50.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018519399999999999 2024-04-25T22:53:50.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.108 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:50.108 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019684+0000", 2024-04-25T22:53:50.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055860079999999999 2024-04-25T22:53:50.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.108 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:50.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023876+0000", 2024-04-25T22:53:50.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041918800000000003 2024-04-25T22:53:50.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:50.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023957+0000", 2024-04-25T22:53:50.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1165e-05 2024-04-25T22:53:50.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:50.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023995+0000", 2024-04-25T22:53:50.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:53:50.109 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:50.109 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:50.110 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:50.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.110 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:50.110 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:50.110 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 117.030068052, 2024-04-25T22:53:50.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011131200000000001, 2024-04-25T22:53:50.110 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:50.110 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:50.110 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:50.110 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:50.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:50.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:50.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:50.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.111 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:50.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:50.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:50.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.111 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:50.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012860+0000", 2024-04-25T22:53:50.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3900000000000004e-07 2024-04-25T22:53:50.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:50.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012865+0000", 2024-04-25T22:53:50.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5609999999999998e-06 2024-04-25T22:53:50.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:50.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012895+0000", 2024-04-25T22:53:50.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9847000000000001e-05 2024-04-25T22:53:50.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:50.113 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012905+0000", 2024-04-25T22:53:50.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.03e-05 2024-04-25T22:53:50.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.113 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:50.113 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015020+0000", 2024-04-25T22:53:50.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021142940000000001 2024-04-25T22:53:50.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.113 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:50.113 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015182+0000", 2024-04-25T22:53:50.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016248099999999999 2024-04-25T22:53:50.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:50.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015357+0000", 2024-04-25T22:53:50.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017471000000000001 2024-04-25T22:53:50.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:50.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021021+0000", 2024-04-25T22:53:50.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056638340000000004 2024-04-25T22:53:50.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:50.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023712+0000", 2024-04-25T22:53:50.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026910380000000002 2024-04-25T22:53:50.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:50.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023763+0000", 2024-04-25T22:53:50.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1477999999999997e-05 2024-04-25T22:53:50.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:50.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023990+0000", 2024-04-25T22:53:50.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000226818 2024-04-25T22:53:50.115 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:50.115 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:50.115 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:50.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.116 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:50.116 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:50.116 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 117.02994495599999, 2024-04-25T22:53:50.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011705299000000001, 2024-04-25T22:53:50.116 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:50.116 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:50.116 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:50.116 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:50.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:50.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:50.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:50.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.117 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:50.117 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:50.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:50.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.117 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:50.117 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012983+0000", 2024-04-25T22:53:50.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:53:50.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:50.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012986+0000", 2024-04-25T22:53:50.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5700000000000001e-06 2024-04-25T22:53:50.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:50.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012993+0000", 2024-04-25T22:53:50.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8730000000000001e-06 2024-04-25T22:53:50.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:50.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013000+0000", 2024-04-25T22:53:50.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1890000000000001e-06 2024-04-25T22:53:50.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:50.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:53:50.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002147866 2024-04-25T22:53:50.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:50.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015351+0000", 2024-04-25T22:53:50.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020300799999999999 2024-04-25T22:53:50.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:50.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016260+0000", 2024-04-25T22:53:50.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00090926799999999997 2024-04-25T22:53:50.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:50.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022669+0000", 2024-04-25T22:53:50.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064082849999999997 2024-04-25T22:53:50.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:50.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024584+0000", 2024-04-25T22:53:50.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019151699999999999 2024-04-25T22:53:50.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:50.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024643+0000", 2024-04-25T22:53:50.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8888999999999998e-05 2024-04-25T22:53:50.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:50.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024687+0000", 2024-04-25T22:53:50.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4444999999999999e-05 2024-04-25T22:53:50.121 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:50.121 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:50.121 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:50.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.122 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:50.122 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:50.122 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 117.029917365, 2024-04-25T22:53:50.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011249699, 2024-04-25T22:53:50.122 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:50.122 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:50.122 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:50.122 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:50.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:50.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:50.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:50.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:50.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:50.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:50.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:50.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013010+0000", 2024-04-25T22:53:50.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2099999999999996e-07 2024-04-25T22:53:50.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:50.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013013+0000", 2024-04-25T22:53:50.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1310000000000002e-06 2024-04-25T22:53:50.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:50.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013020+0000", 2024-04-25T22:53:50.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3330000000000002e-06 2024-04-25T22:53:50.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:50.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013025+0000", 2024-04-25T22:53:50.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6760000000000004e-06 2024-04-25T22:53:50.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:50.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013163+0000", 2024-04-25T22:53:50.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013824599999999999 2024-04-25T22:53:50.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:50.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013504+0000", 2024-04-25T22:53:50.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034080299999999998 2024-04-25T22:53:50.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:50.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013613+0000", 2024-04-25T22:53:50.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108705 2024-04-25T22:53:50.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:50.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015831+0000", 2024-04-25T22:53:50.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002217672 2024-04-25T22:53:50.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:50.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024137+0000", 2024-04-25T22:53:50.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0083060489999999994 2024-04-25T22:53:50.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:50.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024218+0000", 2024-04-25T22:53:50.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1351000000000001e-05 2024-04-25T22:53:50.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:50.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024259+0000", 2024-04-25T22:53:50.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1112000000000002e-05 2024-04-25T22:53:50.127 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:50.127 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:50.127 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:50.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.127 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:50.127 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:50.127 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 117.029829639, 2024-04-25T22:53:50.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020379749999999999, 2024-04-25T22:53:50.127 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:50.127 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:50.128 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:50.128 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:50.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:50.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:50.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:50.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:50.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:50.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:50.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:50.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013098+0000", 2024-04-25T22:53:50.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:53:50.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:50.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013105+0000", 2024-04-25T22:53:50.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5969999999999997e-06 2024-04-25T22:53:50.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:50.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013190+0000", 2024-04-25T22:53:50.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5618999999999995e-05 2024-04-25T22:53:50.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:50.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013200+0000", 2024-04-25T22:53:50.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5859999999999994e-06 2024-04-25T22:53:50.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:50.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020265+0000", 2024-04-25T22:53:50.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070653349999999998 2024-04-25T22:53:50.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:50.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020454+0000", 2024-04-25T22:53:50.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189316 2024-04-25T22:53:50.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:50.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020586+0000", 2024-04-25T22:53:50.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013195700000000001 2024-04-25T22:53:50.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:50.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023822+0000", 2024-04-25T22:53:50.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032358529999999999 2024-04-25T22:53:50.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:50.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033409+0000", 2024-04-25T22:53:50.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095870520000000004 2024-04-25T22:53:50.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:50.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033447+0000", 2024-04-25T22:53:50.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7261999999999997e-05 2024-04-25T22:53:50.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:50.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033477+0000", 2024-04-25T22:53:50.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0389e-05 2024-04-25T22:53:50.132 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:50.132 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:50.132 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:50.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.132 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:50.133 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:50.133 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 117.029713133, 2024-04-25T22:53:50.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010857383999999999, 2024-04-25T22:53:50.133 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:50.133 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:50.133 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:50.133 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:50.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:50.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:50.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:50.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:50.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:50.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:50.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:50.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:50.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:50.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:50.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013218+0000", 2024-04-25T22:53:50.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8199999999999998e-06 2024-04-25T22:53:50.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:50.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013226+0000", 2024-04-25T22:53:50.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7649999999999993e-06 2024-04-25T22:53:50.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:50.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013259+0000", 2024-04-25T22:53:50.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2727e-05 2024-04-25T22:53:50.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:50.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014809+0000", 2024-04-25T22:53:50.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001550144 2024-04-25T22:53:50.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:50.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014958+0000", 2024-04-25T22:53:50.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014890300000000001 2024-04-25T22:53:50.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:50.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015087+0000", 2024-04-25T22:53:50.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012939200000000001 2024-04-25T22:53:50.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:50.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020212+0000", 2024-04-25T22:53:50.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051248939999999996 2024-04-25T22:53:50.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:50.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023699+0000", 2024-04-25T22:53:50.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034873289999999999 2024-04-25T22:53:50.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:50.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024014+0000", 2024-04-25T22:53:50.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031473999999999999 2024-04-25T22:53:50.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:50.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024071+0000", 2024-04-25T22:53:50.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7040000000000003e-05 2024-04-25T22:53:50.138 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:50.138 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:50.138 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:50.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.138 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:50.138 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:50.138 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 117.029658428, 2024-04-25T22:53:50.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012329677000000001, 2024-04-25T22:53:50.139 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:50.139 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:50.139 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:50.139 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:50.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.139 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:50.139 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:50.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:50.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.139 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:50.139 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:50.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:50.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:50.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013269+0000", 2024-04-25T22:53:50.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5000000000000002e-07 2024-04-25T22:53:50.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:50.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:50.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6909999999999999e-06 2024-04-25T22:53:50.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:50.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013284+0000", 2024-04-25T22:53:50.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0963e-05 2024-04-25T22:53:50.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:50.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013361+0000", 2024-04-25T22:53:50.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7379999999999994e-05 2024-04-25T22:53:50.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:50.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013448+0000", 2024-04-25T22:53:50.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6990000000000006e-05 2024-04-25T22:53:50.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:50.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013632+0000", 2024-04-25T22:53:50.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018396800000000001 2024-04-25T22:53:50.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:50.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013800+0000", 2024-04-25T22:53:50.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167467 2024-04-25T22:53:50.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:50.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.018570+0000", 2024-04-25T22:53:50.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047701460000000003 2024-04-25T22:53:50.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.143 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:50.143 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025507+0000", 2024-04-25T22:53:50.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069372039999999998 2024-04-25T22:53:50.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.143 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:50.143 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025562+0000", 2024-04-25T22:53:50.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4858999999999998e-05 2024-04-25T22:53:50.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.143 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:50.144 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025598+0000", 2024-04-25T22:53:50.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6259e-05 2024-04-25T22:53:50.144 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:50.144 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:50.144 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:50.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.144 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:50.144 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:50.144 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 117.029526555, 2024-04-25T22:53:50.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020176666999999999, 2024-04-25T22:53:50.144 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:50.144 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:50.144 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:53:50.145 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:50.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:50.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:50.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:50.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:50.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:50.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:50.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:50.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:50.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-04-25T22:53:50.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:50.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013405+0000", 2024-04-25T22:53:50.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0559999999999998e-06 2024-04-25T22:53:50.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:50.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013422+0000", 2024-04-25T22:53:50.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6770999999999999e-05 2024-04-25T22:53:50.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:50.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013431+0000", 2024-04-25T22:53:50.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5019999999999998e-06 2024-04-25T22:53:50.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:50.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021720+0000", 2024-04-25T22:53:50.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082884340000000008 2024-04-25T22:53:50.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:50.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022122+0000", 2024-04-25T22:53:50.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000401634 2024-04-25T22:53:50.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.148 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:50.148 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033577+0000", 2024-04-25T22:53:50.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011455435999999999 2024-04-25T22:53:50.148 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:50.148 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:50.148 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:50.148 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.148 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4734.0:31 4.1b 4:d9872866:::1000000021d.00000002:head [write 0~3618035] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-25T22:53:50.148 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:53:50.148 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.989952293000002, 2024-04-25T22:53:50.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011647062, 2024-04-25T22:53:50.148 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:50.149 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:50.149 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:50.149 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:50.149 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4734", 2024-04-25T22:53:50.149 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:50.149 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 31 2024-04-25T22:53:50.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.149 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:50.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:50.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:53:50.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:50.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:50.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:53:50.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:50.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:50.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:53:50.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5700000000000001e-07 2024-04-25T22:53:50.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:50.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059575+0000", 2024-04-25T22:53:50.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0065991380000000001 2024-04-25T22:53:50.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:50.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059586+0000", 2024-04-25T22:53:50.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1438e-05 2024-04-25T22:53:50.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:50.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059592+0000", 2024-04-25T22:53:50.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2899999999999999e-06 2024-04-25T22:53:50.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:50.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059660+0000", 2024-04-25T22:53:50.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7980999999999998e-05 2024-04-25T22:53:50.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:50.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059757+0000", 2024-04-25T22:53:50.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6340000000000003e-05 2024-04-25T22:53:50.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:50.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.064487+0000", 2024-04-25T22:53:50.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004730621 2024-04-25T22:53:50.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:50.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.064538+0000", 2024-04-25T22:53:50.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0801999999999999e-05 2024-04-25T22:53:50.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:50.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.064622+0000", 2024-04-25T22:53:50.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3595000000000002e-05 2024-04-25T22:53:50.153 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:50.153 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:50.153 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:50.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.153 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:97 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-25T22:53:50.153 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:53:33.026298+0000", 2024-04-25T22:53:50.153 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 17.016628479000001, 2024-04-25T22:53:50.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015641848999999999, 2024-04-25T22:53:50.154 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:50.154 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:50.154 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:50.154 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:50.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:50.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026298+0000", 2024-04-25T22:53:50.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:50.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:50.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026298+0000", 2024-04-25T22:53:50.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:50.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:50.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026299+0000", 2024-04-25T22:53:50.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7299999999999996e-07 2024-04-25T22:53:50.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:50.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026464+0000", 2024-04-25T22:53:50.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016477700000000001 2024-04-25T22:53:50.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:50.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026472+0000", 2024-04-25T22:53:50.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1589999999999993e-06 2024-04-25T22:53:50.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:50.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026476+0000", 2024-04-25T22:53:50.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4580000000000003e-06 2024-04-25T22:53:50.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:50.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026550+0000", 2024-04-25T22:53:50.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3836000000000003e-05 2024-04-25T22:53:50.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:50.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026644+0000", 2024-04-25T22:53:50.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4022000000000002e-05 2024-04-25T22:53:50.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:50.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.041838+0000", 2024-04-25T22:53:50.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015193814999999999 2024-04-25T22:53:50.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:50.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.041874+0000", 2024-04-25T22:53:50.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5856999999999999e-05 2024-04-25T22:53:50.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:50.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:50.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:50.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.041940+0000", 2024-04-25T22:53:50.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6352000000000004e-05 2024-04-25T22:53:50.158 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:50.158 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:50.158 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:50.158 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:50.158 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:50.158 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:50.160 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:50.161 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:50.159+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:50.261 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:50.260+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:50.265 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:50.265 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:50.265 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-25T22:53:50.265 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:50.274 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:50.362 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:50.361+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:50.368 INFO:tasks.workunit.client.0.smithi052.stderr:doio.c: In function 'parse_cmdline': 2024-04-25T22:53:50.368 INFO:tasks.workunit.client.0.smithi052.stderr:doio.c:3113:33: warning: '%s' directive argument is null [-Wformat-overflow=] 2024-04-25T22:53:50.368 INFO:tasks.workunit.client.0.smithi052.stderr: 3113 | fprintf(stderr, 2024-04-25T22:53:50.368 INFO:tasks.workunit.client.0.smithi052.stderr: | ^~~~~~~~~~~~~~~ 2024-04-25T22:53:50.368 INFO:tasks.workunit.client.0.smithi052.stderr: 3114 | "%s%s: Illegal -C arg (%s). Must be one of: ", 2024-04-25T22:53:50.368 INFO:tasks.workunit.client.0.smithi052.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T22:53:50.368 INFO:tasks.workunit.client.0.smithi052.stderr: 3115 | Prog, TagName, tok); 2024-04-25T22:53:50.368 INFO:tasks.workunit.client.0.smithi052.stderr: | ~~~~~~~~~~~~~~~~~~~ 2024-04-25T22:53:50.375 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:50.376 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:50.376 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-25T22:53:50.376 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-25T22:53:50.376 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:50.379 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-25T22:53:50.384 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:50.395 INFO:tasks.workunit.client.0.smithi052.stderr:fsx.c: In function 'main': 2024-04-25T22:53:50.395 INFO:tasks.workunit.client.0.smithi052.stderr:fsx.c:2662:33: warning: 'strncpy' specified bound 4096 equals destination size [-Wstringop-truncation] 2024-04-25T22:53:50.395 INFO:tasks.workunit.client.0.smithi052.stderr: 2662 | strncpy(opsfile, optarg, sizeof(opsfile)); 2024-04-25T22:53:50.395 INFO:tasks.workunit.client.0.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T22:53:50.396 INFO:tasks.workunit.client.0.smithi052.stderr:fsx.c:2632:25: warning: 'strncpy' specified bound 1024 equals destination size [-Wstringop-truncation] 2024-04-25T22:53:50.396 INFO:tasks.workunit.client.0.smithi052.stderr: 2632 | strncpy(dname, optarg, sizeof(dname)); 2024-04-25T22:53:50.396 INFO:tasks.workunit.client.0.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T22:53:50.463 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:50.462+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:50.489 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:50.489 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:53:50.490 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:53:50.490 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:53:50.490 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.490 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:53:50.490 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:50.490 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 122.520775101, 2024-04-25T22:53:50.490 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:53:50.490 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:50.490 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:50.490 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:50.490 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:50.490 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.491 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:50.491 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:50.491 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:50.491 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.491 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.491 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:50.491 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:50.491 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:50.491 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.491 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.492 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:50.492 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:53:50.492 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:53:50.492 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.492 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.492 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:50.492 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:53:50.492 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:53:50.492 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.492 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.492 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:50.492 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:53:50.492 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:53:50.493 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.493 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.493 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:50.493 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:53:50.493 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:53:50.493 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.493 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.493 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:50.493 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:53:50.493 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:53:50.493 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.493 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.493 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:50.493 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:53:50.494 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:53:50.494 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.494 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.494 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:50.494 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:53:50.494 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:53:50.494 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.494 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.494 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:50.495 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:53:50.495 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:53:50.495 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:50.495 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:50.495 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:50.495 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.495 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.495 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:50.495 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:50.495 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 117.476279402, 2024-04-25T22:53:50.495 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:53:50.495 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:50.495 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:50.495 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:50.496 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:50.496 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.496 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:50.496 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:50.496 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:50.496 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.496 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.496 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:50.496 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:50.496 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:50.496 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.496 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.496 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:50.496 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:53:50.497 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:53:50.497 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.497 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.497 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:50.497 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:53:50.497 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:53:50.497 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.497 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.497 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:50.497 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:53:50.497 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:53:50.497 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.497 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.497 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:50.498 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:53:50.498 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:53:50.498 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.498 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.498 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:50.498 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:53:50.498 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:53:50.498 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.498 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.498 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:50.498 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:53:50.498 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:53:50.499 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.499 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.499 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:50.499 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:53:50.499 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:53:50.499 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.499 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.499 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:50.499 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:53:50.499 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:53:50.499 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.499 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.499 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:50.499 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:53:50.500 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:53:50.500 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.500 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.500 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:50.500 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:53:50.500 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:53:50.500 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.500 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.500 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:50.500 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:53:50.500 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:53:50.500 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:50.500 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:50.501 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:50.501 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.501 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.501 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:50.501 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:50.501 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 117.475605026, 2024-04-25T22:53:50.501 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:53:50.501 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:50.501 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:50.501 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:50.501 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:50.501 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.501 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:50.501 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:50.502 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:50.502 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.502 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.502 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:50.502 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:50.502 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:50.502 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.502 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.502 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:50.502 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:53:50.502 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:53:50.503 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.503 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.503 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:50.503 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:53:50.503 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:53:50.504 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.504 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.504 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:50.504 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:53:50.504 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:53:50.504 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.504 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.504 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:50.504 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:53:50.504 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:53:50.504 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.505 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.505 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:50.505 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:53:50.505 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:53:50.505 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.505 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.505 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:50.505 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:53:50.505 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:53:50.505 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.505 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.505 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:50.505 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:53:50.506 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:53:50.506 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.506 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.506 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:50.506 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:53:50.506 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:53:50.506 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.506 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.506 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:50.506 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:53:50.506 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:53:50.506 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.507 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.507 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:50.507 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:53:50.507 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:53:50.507 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.507 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.507 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:50.507 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:53:50.507 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:53:50.507 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:50.507 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:50.507 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:50.507 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.508 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.508 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:50.508 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:50.508 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 117.475095814, 2024-04-25T22:53:50.508 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:53:50.508 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:50.508 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:50.508 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:50.508 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:50.508 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.508 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:50.508 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:50.508 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:50.509 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.509 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.509 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:50.509 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:50.509 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:50.509 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.509 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.509 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:50.509 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:53:50.509 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:53:50.509 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.509 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.509 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:50.509 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:53:50.510 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:53:50.510 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.510 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.510 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:50.510 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:53:50.510 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:53:50.510 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.510 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.510 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:50.510 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:53:50.510 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:53:50.510 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.511 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.511 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:50.511 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:53:50.511 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:53:50.511 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.511 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.511 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:50.511 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:53:50.511 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:53:50.511 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.511 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.511 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:50.511 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:53:50.512 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:53:50.512 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.512 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.512 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:50.512 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:53:50.512 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:53:50.512 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.512 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.512 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:50.512 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:53:50.512 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:53:50.512 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.512 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.513 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:50.513 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:53:50.513 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:53:50.513 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.513 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.513 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:50.513 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:53:50.513 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:53:50.513 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:50.513 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:50.513 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:50.513 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.513 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.514 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:50.514 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:50.514 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 117.474682616, 2024-04-25T22:53:50.514 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:53:50.514 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:50.514 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:50.514 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:50.514 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:50.514 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.514 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:50.514 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:50.514 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:50.515 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.515 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.515 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:50.515 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:50.515 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:50.515 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.515 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.515 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:50.515 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:50.515 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:53:50.515 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.515 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.515 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:50.515 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:50.516 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:53:50.516 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.516 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.516 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:50.516 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:53:50.516 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:53:50.516 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.516 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.516 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:50.516 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:53:50.516 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:53:50.516 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.516 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.517 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:50.517 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:53:50.517 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:53:50.517 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.517 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.517 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:50.517 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:53:50.517 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:53:50.517 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.517 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.517 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:50.517 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:53:50.517 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:53:50.518 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.518 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.518 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:50.518 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:53:50.518 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:53:50.518 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.518 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.518 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:50.518 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:53:50.518 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:53:50.518 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.518 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.518 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:50.518 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:53:50.519 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:53:50.519 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.519 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.519 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:50.519 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:53:50.519 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:53:50.519 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:50.519 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:50.519 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:50.519 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.519 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.519 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:50.519 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:50.520 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 117.474631946, 2024-04-25T22:53:50.520 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:53:50.520 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:50.520 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:50.520 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:50.520 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:50.520 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.520 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:50.520 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:50.520 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:50.520 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.520 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.521 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:50.521 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:50.521 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:50.521 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.521 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.521 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:50.521 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:53:50.521 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:53:50.521 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.521 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.521 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:50.521 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:53:50.521 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:53:50.522 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.522 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.522 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:50.522 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:53:50.522 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:53:50.522 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.522 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.522 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:50.522 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:53:50.522 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:53:50.522 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.522 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.522 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:50.523 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:53:50.523 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:53:50.523 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.523 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.523 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:50.523 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:53:50.523 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:53:50.523 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.523 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.523 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:50.523 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:53:50.523 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:53:50.523 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.524 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.524 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:50.524 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:53:50.524 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:53:50.524 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.524 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.524 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:50.524 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:53:50.524 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:53:50.524 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.524 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.524 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:50.524 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:53:50.525 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:53:50.525 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.525 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.525 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:50.525 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:53:50.525 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:53:50.525 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.525 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.525 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:50.525 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:53:50.525 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:53:50.525 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.525 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.525 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:50.526 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:53:50.526 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:53:50.526 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:50.526 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:50.526 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:50.526 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.526 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.526 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:50.526 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:50.526 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 117.474595077, 2024-04-25T22:53:50.526 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:53:50.526 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:50.526 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:50.527 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:50.527 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:50.527 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.527 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:50.527 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:50.527 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:50.527 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.527 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.527 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:50.527 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:50.527 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:50.527 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.527 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.528 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:50.528 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:53:50.528 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:53:50.528 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.528 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.528 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:50.528 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:53:50.528 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:53:50.528 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.528 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.528 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:50.528 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:53:50.528 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:53:50.529 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.529 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.529 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:50.529 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:53:50.529 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:53:50.529 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.529 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.529 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:50.529 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:53:50.529 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:53:50.529 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.529 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.529 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:53:50.530 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:53:50.530 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:53:50.530 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.530 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.530 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:50.530 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:53:50.530 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:53:50.530 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.530 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.530 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:50.530 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:53:50.530 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:53:50.530 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.531 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.531 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:50.531 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:53:50.531 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:53:50.531 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.531 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.531 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:50.531 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:53:50.531 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:53:50.531 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.531 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.531 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:50.531 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:53:50.531 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:53:50.532 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.532 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.532 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:50.532 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:53:50.532 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:53:50.532 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.532 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.532 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:50.532 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:53:50.532 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:53:50.532 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:50.532 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:50.532 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:50.533 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.533 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.533 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:50.533 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:50.533 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 117.47457011100001, 2024-04-25T22:53:50.533 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:53:50.533 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:50.533 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:50.533 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:50.533 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:50.533 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.533 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:50.533 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:50.533 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:50.534 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.534 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.534 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:50.534 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:50.534 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:50.534 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.534 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.534 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:50.534 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:53:50.534 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:53:50.534 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.534 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.535 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:50.535 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:53:50.535 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:53:50.535 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.535 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.535 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:50.535 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:50.535 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:53:50.535 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.535 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.535 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:50.535 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:53:50.535 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:53:50.536 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.536 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.536 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:50.536 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:53:50.536 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:53:50.536 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.536 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.536 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:50.536 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:53:50.536 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:53:50.536 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.536 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.536 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:50.537 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:53:50.537 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:53:50.537 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.537 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.537 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:50.537 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:53:50.537 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:53:50.537 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.537 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.537 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:50.537 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:53:50.537 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:53:50.537 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.537 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.538 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:50.538 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:53:50.538 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:53:50.538 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.538 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.538 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:50.538 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:53:50.538 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:53:50.538 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:50.538 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:50.539 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:50.539 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.539 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.539 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:50.539 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:50.539 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 117.474533747, 2024-04-25T22:53:50.539 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:53:50.539 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:50.539 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:50.539 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:50.539 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:50.539 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.539 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:50.539 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:50.540 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:50.540 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.540 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.540 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:50.540 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:50.540 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:50.540 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.540 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.540 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:50.540 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:53:50.540 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:53:50.540 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.540 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.540 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:50.540 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:53:50.541 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:53:50.541 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.541 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.541 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:50.541 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:53:50.541 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:53:50.541 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.541 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.541 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:50.541 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:53:50.541 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:53:50.541 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.541 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.542 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:50.542 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:53:50.542 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:53:50.542 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.542 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.542 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:50.542 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:53:50.542 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:53:50.542 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.542 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.542 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:50.543 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:53:50.543 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:53:50.543 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.543 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.543 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:50.543 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:53:50.543 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:53:50.543 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.543 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.543 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:50.544 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:53:50.544 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:53:50.544 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:50.544 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:50.544 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:50.544 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.544 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.544 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:50.544 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:50.544 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 117.47450266600001, 2024-04-25T22:53:50.544 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:53:50.545 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:50.545 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:50.545 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:50.545 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:50.545 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.545 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:50.545 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:50.545 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:50.545 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.545 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.545 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:50.545 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:50.545 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:50.545 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.545 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.546 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:50.546 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:50.546 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:50.546 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.546 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.546 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:50.546 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:53:50.546 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:53:50.546 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.546 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.546 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:50.546 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:53:50.546 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:53:50.546 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.547 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.547 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:50.547 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:53:50.547 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:53:50.547 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.547 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.547 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:50.547 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:53:50.547 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:53:50.547 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.547 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.547 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:50.547 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:53:50.548 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:53:50.548 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.548 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.548 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:50.548 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:53:50.548 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:53:50.548 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:50.548 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:50.548 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:50.548 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.548 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.548 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:30 4.31 4:8ebfc112:::1000000021d.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-25T22:53:50.548 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:53:50.548 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 19.434816796, 2024-04-25T22:53:50.549 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015003005, 2024-04-25T22:53:50.549 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:50.549 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:50.549 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:50.549 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:50.549 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:50.549 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:50.549 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 30 2024-04-25T22:53:50.549 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.549 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:50.549 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.549 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:50.549 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:53:50.549 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:50.550 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.550 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.550 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:50.550 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:53:50.550 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:50.550 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.550 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.550 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:50.550 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053133+0000", 2024-04-25T22:53:50.550 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0370000000000001e-06 2024-04-25T22:53:50.550 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.550 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.551 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:50.551 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060377+0000", 2024-04-25T22:53:50.551 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0072431070000000004 2024-04-25T22:53:50.551 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.551 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.551 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:50.551 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060388+0000", 2024-04-25T22:53:50.551 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1285e-05 2024-04-25T22:53:50.551 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.551 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.551 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:50.551 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060394+0000", 2024-04-25T22:53:50.551 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1040000000000003e-06 2024-04-25T22:53:50.551 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.551 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.551 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:50.552 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060483+0000", 2024-04-25T22:53:50.552 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.9345000000000006e-05 2024-04-25T22:53:50.552 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.552 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.552 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:50.552 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060566+0000", 2024-04-25T22:53:50.552 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2237999999999994e-05 2024-04-25T22:53:50.552 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.552 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.552 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:50.552 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068057+0000", 2024-04-25T22:53:50.552 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074912210000000002 2024-04-25T22:53:50.552 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.552 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.553 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:50.553 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068090+0000", 2024-04-25T22:53:50.553 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3501000000000003e-05 2024-04-25T22:53:50.553 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.553 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.553 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:50.553 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068134+0000", 2024-04-25T22:53:50.553 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4166999999999999e-05 2024-04-25T22:53:50.553 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:50.553 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:50.553 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:50.553 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.553 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.553 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:66 4.27 4:e5671758:::1000000024f.00000000:head [write 0~6641] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:50.553 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:50.554 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 19.174706459999999, 2024-04-25T22:53:50.554 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075166540000000002, 2024-04-25T22:53:50.554 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:50.554 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:50.554 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:50.554 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:50.554 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:50.554 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:50.554 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 66 2024-04-25T22:53:50.554 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.554 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:50.554 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.554 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:50.555 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:50.555 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:50.555 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.555 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.555 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:50.555 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:50.555 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:50.555 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.555 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.555 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:50.555 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:50.555 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4099999999999998e-07 2024-04-25T22:53:50.555 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.555 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.555 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:50.556 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313252+0000", 2024-04-25T22:53:50.556 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5380000000000008e-06 2024-04-25T22:53:50.556 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.556 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.556 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:50.556 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313260+0000", 2024-04-25T22:53:50.556 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2609999999999993e-06 2024-04-25T22:53:50.556 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.556 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.556 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:50.556 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313265+0000", 2024-04-25T22:53:50.556 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4850000000000003e-06 2024-04-25T22:53:50.556 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.556 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.557 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:50.557 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313310+0000", 2024-04-25T22:53:50.557 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5247999999999998e-05 2024-04-25T22:53:50.557 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.557 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.557 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:50.557 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313370+0000", 2024-04-25T22:53:50.557 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0275000000000001e-05 2024-04-25T22:53:50.557 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.557 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.557 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:50.557 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313435+0000", 2024-04-25T22:53:50.557 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4647000000000006e-05 2024-04-25T22:53:50.557 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.558 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.558 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:50.558 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314174+0000", 2024-04-25T22:53:50.558 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00073925 2024-04-25T22:53:50.558 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.558 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.558 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:50.558 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320688+0000", 2024-04-25T22:53:50.558 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.006513418 2024-04-25T22:53:50.558 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.558 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.558 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:50.558 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320736+0000", 2024-04-25T22:53:50.559 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.8114e-05 2024-04-25T22:53:50.559 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.559 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.559 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:50.559 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320758+0000", 2024-04-25T22:53:50.559 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2776999999999999e-05 2024-04-25T22:53:50.559 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:50.559 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:50.559 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:50.559 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.559 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.559 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:68 4.31 4:8fb7f7b7:::10000000251.00000000:head [write 0~2067] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:50.559 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:50.559 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 19.173020682000001, 2024-04-25T22:53:50.560 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0087011669999999992, 2024-04-25T22:53:50.560 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:50.560 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:50.560 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:50.560 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:50.560 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:50.560 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:50.560 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 68 2024-04-25T22:53:50.560 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.560 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:50.560 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.560 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:50.560 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:50.560 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:50.561 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.561 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.561 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:50.561 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:50.561 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:50.561 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.561 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.561 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:50.561 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:50.561 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:53:50.561 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.561 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.561 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:50.561 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314933+0000", 2024-04-25T22:53:50.562 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5430000000000004e-06 2024-04-25T22:53:50.562 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.562 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.562 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:50.562 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314944+0000", 2024-04-25T22:53:50.562 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.076e-05 2024-04-25T22:53:50.562 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.562 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.562 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:50.562 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314949+0000", 2024-04-25T22:53:50.562 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1019999999999996e-06 2024-04-25T22:53:50.562 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.562 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.563 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:50.563 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314996+0000", 2024-04-25T22:53:50.563 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7018999999999998e-05 2024-04-25T22:53:50.563 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.563 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.563 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:50.563 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315064+0000", 2024-04-25T22:53:50.563 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8738000000000005e-05 2024-04-25T22:53:50.563 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.563 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.563 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:50.563 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323531+0000", 2024-04-25T22:53:50.563 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084664739999999999 2024-04-25T22:53:50.563 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.564 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.564 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:50.564 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323574+0000", 2024-04-25T22:53:50.564 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3449999999999999e-05 2024-04-25T22:53:50.564 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.564 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.564 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:50.564 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323629+0000", 2024-04-25T22:53:50.564 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4296999999999999e-05 2024-04-25T22:53:50.564 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:50.564 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:50.564 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:50.564 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.564 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.564 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4734.0:69 4.32 e46/13 4:4e8c6251:::10000000252.00000000:head v 46'1, mlcod=0'0)", 2024-04-25T22:53:50.565 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:50.565 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 19.171989413999999, 2024-04-25T22:53:50.565 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076063240000000002, 2024-04-25T22:53:50.565 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:50.565 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:50.565 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:50.565 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:50.565 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.565 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:50.565 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:50.565 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:50.565 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.565 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.566 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:50.566 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:50.566 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:50.566 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.566 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.566 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:50.566 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:50.566 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3099999999999997e-07 2024-04-25T22:53:50.566 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.566 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.566 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:50.566 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315964+0000", 2024-04-25T22:53:50.566 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3229999999999999e-06 2024-04-25T22:53:50.567 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.567 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.567 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:50.567 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315973+0000", 2024-04-25T22:53:50.567 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7249999999999992e-06 2024-04-25T22:53:50.567 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.567 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.567 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:50.567 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315978+0000", 2024-04-25T22:53:50.567 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4830000000000001e-06 2024-04-25T22:53:50.567 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.567 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.568 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:50.568 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.316043+0000", 2024-04-25T22:53:50.568 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.5036000000000005e-05 2024-04-25T22:53:50.568 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.568 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.568 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:50.568 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.316055+0000", 2024-04-25T22:53:50.568 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1973999999999999e-05 2024-04-25T22:53:50.568 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.568 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.568 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:50.568 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323521+0000", 2024-04-25T22:53:50.568 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074660239999999999 2024-04-25T22:53:50.568 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.569 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.569 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:50.569 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323565+0000", 2024-04-25T22:53:50.569 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4128000000000002e-05 2024-04-25T22:53:50.569 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:50.569 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:50.569 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:50.569 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.569 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.569 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:72 4.36 4:6cdfec98:::10000000255.00000000:head [write 0~4131] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:50.569 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:50.569 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 19.169945502000001, 2024-04-25T22:53:50.569 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084820680000000006, 2024-04-25T22:53:50.569 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:50.570 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:50.570 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:50.570 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:50.570 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:50.570 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:50.570 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 72 2024-04-25T22:53:50.570 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.570 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:50.570 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.570 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:50.570 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:50.570 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:50.570 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.571 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.571 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:50.571 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:50.571 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:50.571 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.571 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.571 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:50.571 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:50.571 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1800000000000005e-07 2024-04-25T22:53:50.571 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.571 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.571 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:50.571 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318010+0000", 2024-04-25T22:53:50.571 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7399999999999998e-06 2024-04-25T22:53:50.571 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.572 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.572 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:50.572 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318019+0000", 2024-04-25T22:53:50.572 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0170000000000002e-06 2024-04-25T22:53:50.572 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.572 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.572 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:50.572 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318024+0000", 2024-04-25T22:53:50.572 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0150000000000003e-06 2024-04-25T22:53:50.572 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.572 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.572 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:50.573 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318075+0000", 2024-04-25T22:53:50.573 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0537000000000001e-05 2024-04-25T22:53:50.573 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.573 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.573 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:50.573 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318144+0000", 2024-04-25T22:53:50.573 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9432999999999997e-05 2024-04-25T22:53:50.573 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.573 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.573 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:50.573 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326392+0000", 2024-04-25T22:53:50.573 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0082482979999999994 2024-04-25T22:53:50.573 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.574 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.574 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:50.574 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326432+0000", 2024-04-25T22:53:50.574 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9870000000000003e-05 2024-04-25T22:53:50.574 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.574 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.574 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:50.574 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326485+0000", 2024-04-25T22:53:50.574 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2439999999999999e-05 2024-04-25T22:53:50.574 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:50.574 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:50.574 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:50.574 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.574 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.575 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:74 4.10 4:08e6f8ca:::10000000257.00000000:head [write 0~839] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:50.575 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:53:50.575 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 19.168471774, 2024-04-25T22:53:50.575 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070370720000000001, 2024-04-25T22:53:50.575 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:50.575 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:50.575 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:50.575 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:50.575 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:50.575 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:50.575 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 74 2024-04-25T22:53:50.576 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.576 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:50.576 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.576 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:50.576 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:53:50.576 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:50.576 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.576 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.576 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:50.576 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:53:50.576 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:50.576 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.577 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.577 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:50.577 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319477+0000", 2024-04-25T22:53:50.577 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1999999999999999e-07 2024-04-25T22:53:50.577 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.577 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.577 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:50.577 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319483+0000", 2024-04-25T22:53:50.577 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4260000000000002e-06 2024-04-25T22:53:50.577 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.577 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.577 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:50.577 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319494+0000", 2024-04-25T22:53:50.578 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.094e-05 2024-04-25T22:53:50.578 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.578 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.578 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:50.578 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319499+0000", 2024-04-25T22:53:50.578 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3789999999999997e-06 2024-04-25T22:53:50.578 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.578 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.578 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:50.578 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319545+0000", 2024-04-25T22:53:50.578 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6149000000000001e-05 2024-04-25T22:53:50.579 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.579 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.579 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:50.579 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319617+0000", 2024-04-25T22:53:50.579 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1792999999999995e-05 2024-04-25T22:53:50.579 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.579 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.579 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:50.579 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326406+0000", 2024-04-25T22:53:50.579 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067895999999999998 2024-04-25T22:53:50.579 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.579 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.580 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:50.580 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326443+0000", 2024-04-25T22:53:50.580 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6828e-05 2024-04-25T22:53:50.580 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.580 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.580 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:50.580 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326514+0000", 2024-04-25T22:53:50.580 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0236999999999999e-05 2024-04-25T22:53:50.580 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:50.580 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:50.580 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:50.580 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.580 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.580 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:128 3.1f 3:f83d65d8:::200.00000004:head [write 876784~3317520 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e48)", 2024-04-25T22:53:50.581 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:36.985410+0000", 2024-04-25T22:53:50.581 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 13.502538156, 2024-04-25T22:53:50.581 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0090177360000000002, 2024-04-25T22:53:50.581 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:50.581 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:50.581 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:50.581 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:50.581 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.581 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:50.581 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.985410+0000", 2024-04-25T22:53:50.581 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:50.581 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.581 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.581 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:50.582 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.985410+0000", 2024-04-25T22:53:50.582 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:50.582 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.582 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.582 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:50.582 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.985411+0000", 2024-04-25T22:53:50.582 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8400000000000003e-07 2024-04-25T22:53:50.582 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.582 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.582 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:50.582 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989116+0000", 2024-04-25T22:53:50.582 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037047389999999999 2024-04-25T22:53:50.582 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.583 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.583 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:50.583 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989128+0000", 2024-04-25T22:53:50.583 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1977999999999999e-05 2024-04-25T22:53:50.583 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.583 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.583 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:50.583 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989135+0000", 2024-04-25T22:53:50.583 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5290000000000003e-06 2024-04-25T22:53:50.583 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.583 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.583 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:50.583 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989181+0000", 2024-04-25T22:53:50.584 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6122999999999999e-05 2024-04-25T22:53:50.584 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.584 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.584 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:50.584 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989250+0000", 2024-04-25T22:53:50.584 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8535999999999996e-05 2024-04-25T22:53:50.584 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.584 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.584 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:50.584 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.994272+0000", 2024-04-25T22:53:50.584 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050224889999999998 2024-04-25T22:53:50.584 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.584 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.584 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:50.584 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.994335+0000", 2024-04-25T22:53:50.585 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2588000000000005e-05 2024-04-25T22:53:50.585 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.585 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.585 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:50.585 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.994428+0000", 2024-04-25T22:53:50.585 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2869999999999997e-05 2024-04-25T22:53:50.585 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:50.585 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:50.585 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:50.585 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.585 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.585 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:2150 4.22 4:47cffac6:::10000000a2b.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T22:53:50.585 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:41.078233+0000", 2024-04-25T22:53:50.585 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.409714846, 2024-04-25T22:53:50.585 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069201510000000003, 2024-04-25T22:53:50.585 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:50.586 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:50.586 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:50.586 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:50.586 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.586 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:50.586 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078233+0000", 2024-04-25T22:53:50.586 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:50.586 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.586 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.586 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:50.586 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078233+0000", 2024-04-25T22:53:50.586 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:50.586 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.586 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.587 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:50.587 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078234+0000", 2024-04-25T22:53:50.587 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1699999999999998e-07 2024-04-25T22:53:50.587 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.587 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.587 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:50.587 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078236+0000", 2024-04-25T22:53:50.587 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.875e-06 2024-04-25T22:53:50.587 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.587 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.587 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:50.587 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078242+0000", 2024-04-25T22:53:50.587 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2450000000000003e-06 2024-04-25T22:53:50.587 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.587 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.587 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:50.588 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078247+0000", 2024-04-25T22:53:50.588 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7450000000000003e-06 2024-04-25T22:53:50.588 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.588 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.588 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:50.588 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078641+0000", 2024-04-25T22:53:50.588 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00039420200000000002 2024-04-25T22:53:50.588 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.588 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.588 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:50.588 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078840+0000", 2024-04-25T22:53:50.588 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000199063 2024-04-25T22:53:50.588 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.588 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.588 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:50.589 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078919+0000", 2024-04-25T22:53:50.589 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9182000000000002e-05 2024-04-25T22:53:50.589 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.589 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.589 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:50.589 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.080906+0000", 2024-04-25T22:53:50.589 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0019866390000000001 2024-04-25T22:53:50.589 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.589 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.589 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:50.589 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085074+0000", 2024-04-25T22:53:50.589 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0041683639999999999 2024-04-25T22:53:50.589 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.590 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.590 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:50.590 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085117+0000", 2024-04-25T22:53:50.590 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2849999999999998e-05 2024-04-25T22:53:50.590 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.590 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.590 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:50.590 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085154+0000", 2024-04-25T22:53:50.590 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6468999999999999e-05 2024-04-25T22:53:50.590 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:50.590 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:50.590 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:50.590 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.591 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.591 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:2160 4.2a 4:57f9ed86:::10000000a3d.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T22:53:50.591 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:53:50.591 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.4092455560000001, 2024-04-25T22:53:50.591 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0068959959999999997, 2024-04-25T22:53:50.591 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:50.591 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:50.591 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:50.591 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:50.591 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.591 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:50.591 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:53:50.591 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:50.591 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.592 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.592 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:50.592 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:53:50.592 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:50.592 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.592 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.592 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:50.592 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:53:50.592 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7000000000000004e-07 2024-04-25T22:53:50.592 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.592 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.592 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:50.592 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078707+0000", 2024-04-25T22:53:50.592 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.783e-06 2024-04-25T22:53:50.593 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.593 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.593 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:50.593 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078716+0000", 2024-04-25T22:53:50.593 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4800000000000001e-06 2024-04-25T22:53:50.593 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.593 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.593 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:50.593 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078724+0000", 2024-04-25T22:53:50.593 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1519999999999992e-06 2024-04-25T22:53:50.593 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.593 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.593 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:50.593 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078794+0000", 2024-04-25T22:53:50.593 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0500999999999995e-05 2024-04-25T22:53:50.593 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.594 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.594 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:50.594 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078912+0000", 2024-04-25T22:53:50.594 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000117439 2024-04-25T22:53:50.594 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.594 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.594 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:50.594 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079000+0000", 2024-04-25T22:53:50.594 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8092999999999998e-05 2024-04-25T22:53:50.594 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.594 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.594 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:50.594 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.080897+0000", 2024-04-25T22:53:50.594 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0018970899999999999 2024-04-25T22:53:50.595 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.595 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.595 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:50.595 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085517+0000", 2024-04-25T22:53:50.595 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0046198929999999999 2024-04-25T22:53:50.595 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.595 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.595 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:50.595 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085565+0000", 2024-04-25T22:53:50.595 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7777e-05 2024-04-25T22:53:50.595 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.595 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.595 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:50.595 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085599+0000", 2024-04-25T22:53:50.595 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4017999999999999e-05 2024-04-25T22:53:50.596 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:50.596 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:50.596 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:50.596 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.596 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.596 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:2163 4.2a 4:549f79e3:::10000000a43.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T22:53:50.596 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:53:50.596 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 9.4092122029999992, 2024-04-25T22:53:50.596 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069469190000000002, 2024-04-25T22:53:50.596 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:50.596 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:50.596 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:50.596 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:50.596 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.596 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:50.596 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:53:50.597 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:50.597 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.597 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.597 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:50.597 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:53:50.597 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:50.597 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.597 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.597 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:50.597 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:53:50.597 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1399999999999997e-07 2024-04-25T22:53:50.597 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.597 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.597 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:50.597 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078739+0000", 2024-04-25T22:53:50.597 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2960000000000001e-06 2024-04-25T22:53:50.598 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.598 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.598 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:50.598 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078745+0000", 2024-04-25T22:53:50.598 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3439999999999997e-06 2024-04-25T22:53:50.598 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.598 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.598 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:50.598 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078750+0000", 2024-04-25T22:53:50.598 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3179999999999997e-06 2024-04-25T22:53:50.598 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.598 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.598 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:50.598 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079224+0000", 2024-04-25T22:53:50.598 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00047334999999999999 2024-04-25T22:53:50.599 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.599 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.599 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:50.599 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079292+0000", 2024-04-25T22:53:50.599 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8708999999999996e-05 2024-04-25T22:53:50.599 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.599 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.599 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:50.599 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079342+0000", 2024-04-25T22:53:50.599 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9299999999999999e-05 2024-04-25T22:53:50.599 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.599 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.599 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:50.599 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.081611+0000", 2024-04-25T22:53:50.600 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0022695229999999999 2024-04-25T22:53:50.600 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.600 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.600 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:50.600 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085605+0000", 2024-04-25T22:53:50.600 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0039933679999999997 2024-04-25T22:53:50.600 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.600 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.600 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:50.600 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085650+0000", 2024-04-25T22:53:50.600 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5111000000000002e-05 2024-04-25T22:53:50.600 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:50.600 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:50.600 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:50.600 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085683+0000", 2024-04-25T22:53:50.601 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3185999999999997e-05 2024-04-25T22:53:50.601 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:50.601 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:50.601 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:50.601 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:50.601 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:50.601 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:50.601 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:53:50.602 INFO:tasks.workunit.client.0.smithi052.stderr:gmake[2]: *** [include/buildrules:30: ltp] Error 2 2024-04-25T22:53:50.603 INFO:tasks.workunit.client.0.smithi052.stderr:gmake[2]: *** Waiting for unfinished jobs.... 2024-04-25T22:53:50.604 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:50.602+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:50.604 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:50.704 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:50.703+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:50.708 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:50.708 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:50.708 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-04-25T22:53:50.708 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:50.717 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:50.737 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-25T22:53:50.738 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:53:50.738 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:53:50.757 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-25T22:53:50.757 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:53:50.760 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:53:50.761 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:53:50.805 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:50.804+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:50.858 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:50.858 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:50.867 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:50.906 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:50.905+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:50.968 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:50.968 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:50.977 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:51.021 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:51.020+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:51.080 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:51.080 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:51.089 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:51.130 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:51.129+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:51.208 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:51.208+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:51.232 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:51.232 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:51.241 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:51.309 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:51.308+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:51.343 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:51.343 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:51.352 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:51.358 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is set 2024-04-25T22:53:51.410 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:51.409+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:51.457 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:51.457 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:51.465 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:51.550 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:51.549+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:51.608 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:51.608 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:51.612 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:51.611+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:51.616 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:51.713 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:51.712+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:51.758 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:51.759 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:51.767 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:51.814 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:51.814+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:51.870 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:51.871 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:51.879 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:51.916 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:51.915+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:51.981 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:51.982 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:51.990 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:52.035 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:52.034+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:52.093 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:52.093 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:52.102 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:52.148 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:52.147+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:52.205 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:52.205 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:52.214 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:52.218 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:52.217+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:52.320 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:52.319+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:52.355 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:52.355 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:52.364 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:52.448 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:52.447+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:52.506 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:52.507 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:52.515 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:52.560 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:52.559+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:52.619 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:52.619 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:52.622 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:52.621+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:52.628 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:52.723 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:52.722+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:52.736 INFO:tasks.workunit.client.0.smithi052.stdout: [DEP] 2024-04-25T22:53:52.736 INFO:tasks.workunit.client.0.smithi052.stdout: [DEP] 2024-04-25T22:53:52.739 INFO:tasks.workunit.client.0.smithi052.stdout: [DEP] 2024-04-25T22:53:52.762 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:53:52.769 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:52.769 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:52.779 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:52.863 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:52.862+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:52.904 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-25T22:53:52.904 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:53:52.904 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:53:52.923 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-25T22:53:52.924 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:53:52.925 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:52.925 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:53:52.926 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:53:52.926 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:53:52.926 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.926 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:53:52.926 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:52.926 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 124.955785226, 2024-04-25T22:53:52.926 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:53:52.926 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:52.926 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:52.926 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:52.926 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:52.926 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.926 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:52.926 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:52.927 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:52.927 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.927 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.927 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:52.927 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:52.927 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:52.927 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.927 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.927 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:52.927 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:53:52.927 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:53:52.927 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.927 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.928 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:52.928 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:53:52.928 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:53:52.928 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.928 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.928 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:52.928 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:53:52.928 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:53:52.928 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.928 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.928 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:52.928 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:53:52.928 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:53:52.928 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.929 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.929 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:52.929 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:53:52.929 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:53:52.929 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.929 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.929 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:52.929 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:53:52.929 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:53:52.929 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.929 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.929 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:52.929 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:53:52.929 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:53:52.929 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.930 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.930 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:52.930 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:53:52.930 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:53:52.930 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:52.930 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:52.930 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:52.930 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.930 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.930 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:52.930 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:52.930 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 119.91128952699999, 2024-04-25T22:53:52.930 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:53:52.931 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:52.931 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:52.931 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:52.931 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:52.931 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.931 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:52.931 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:52.931 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:52.931 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.931 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.931 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:52.931 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:52.931 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:52.931 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.932 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.932 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:52.932 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:53:52.932 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:53:52.932 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.932 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.932 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:52.932 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:53:52.933 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:53:52.933 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.933 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.933 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:52.934 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:53:52.934 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:53:52.934 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.934 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.934 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:52.934 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:53:52.934 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:53:52.934 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.934 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.935 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:52.935 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:53:52.935 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:53:52.935 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.935 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.935 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:52.935 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:53:52.935 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:53:52.935 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.935 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.935 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:52.935 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:53:52.935 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:53:52.935 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.936 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.936 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:52.936 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:53:52.936 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:53:52.936 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.936 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.936 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:52.936 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:53:52.936 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:53:52.936 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.936 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.936 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:52.936 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:53:52.936 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:53:52.937 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.937 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.937 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:52.937 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:53:52.937 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:53:52.937 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:52.937 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:52.937 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:52.937 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.937 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.937 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:52.937 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:52.937 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 119.910615151, 2024-04-25T22:53:52.937 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:53:52.937 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:52.938 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:52.938 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:52.938 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:52.938 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.938 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:52.938 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:52.938 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:52.938 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.938 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.938 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:52.938 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:52.938 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:52.938 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.938 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.939 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:52.939 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:53:52.939 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:53:52.939 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.939 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.939 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:52.939 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:53:52.939 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:53:52.939 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.939 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.939 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:52.939 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:53:52.939 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:53:52.940 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.940 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.940 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:52.940 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:53:52.940 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:53:52.940 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.940 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.940 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:52.940 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:53:52.940 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:53:52.940 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.940 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.940 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:52.941 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:53:52.941 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:53:52.941 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.941 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.941 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:52.941 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:53:52.941 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:53:52.941 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.941 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.941 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:52.941 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:53:52.941 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:53:52.941 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.942 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.942 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:52.942 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:53:52.942 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:53:52.942 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.942 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.942 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:52.942 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:53:52.942 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:53:52.942 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.942 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.942 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:52.942 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:53:52.943 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:53:52.943 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:52.943 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:52.943 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:52.943 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.943 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.943 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:52.943 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:52.943 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 119.910105939, 2024-04-25T22:53:52.943 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:53:52.943 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:52.943 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:52.943 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:52.944 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:52.944 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.944 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:52.944 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:52.944 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:52.944 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.944 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.944 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:52.944 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:52.944 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:52.944 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.944 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.944 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:52.944 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:53:52.945 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:53:52.945 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.945 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.945 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:52.945 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:53:52.945 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:53:52.945 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.945 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.945 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:52.945 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:53:52.945 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:53:52.945 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.945 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.945 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:52.946 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:53:52.946 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:53:52.946 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.946 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.946 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:52.946 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:53:52.946 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:53:52.946 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.946 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.946 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:52.946 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:53:52.946 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:53:52.946 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.947 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.947 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:52.947 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:53:52.947 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:53:52.947 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.947 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.947 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:52.947 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:53:52.947 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:53:52.947 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.947 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.947 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:52.947 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:53:52.947 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:53:52.948 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.948 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.948 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:52.948 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:53:52.948 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:53:52.948 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.948 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.948 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:52.948 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:53:52.948 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:53:52.948 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:52.948 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:52.948 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:52.949 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.949 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.949 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:52.949 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:52.949 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 119.909692741, 2024-04-25T22:53:52.949 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:53:52.949 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:52.949 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:52.949 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:52.949 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:52.949 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.949 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:52.949 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:52.949 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:52.950 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.950 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.950 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:52.950 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:52.950 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:52.950 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.950 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.950 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:52.950 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:52.950 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:53:52.950 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.950 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.950 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:52.950 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:52.951 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:53:52.951 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.951 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.951 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:52.951 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:53:52.951 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:53:52.951 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.951 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.951 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:52.951 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:53:52.951 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:53:52.951 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.951 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.951 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:52.952 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:53:52.952 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:53:52.952 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.952 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.952 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:52.952 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:53:52.952 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:53:52.952 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.952 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.952 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:52.952 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:53:52.952 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:53:52.952 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.952 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.952 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:52.953 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:53:52.953 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:53:52.953 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.953 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.953 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:52.953 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:53:52.953 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:53:52.953 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.953 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.953 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:52.953 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:53:52.953 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:53:52.953 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.953 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.954 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:52.954 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:53:52.954 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:53:52.954 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:52.954 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:52.954 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:52.954 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.954 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.954 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:52.954 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:52.954 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 119.90964207099999, 2024-04-25T22:53:52.954 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:53:52.954 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:52.955 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:52.955 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:52.955 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:52.955 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.955 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:52.955 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:52.955 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:52.955 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.955 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.955 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:52.955 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:52.955 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:52.955 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.955 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.956 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:52.956 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:53:52.956 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:53:52.956 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.956 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.956 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:52.956 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:53:52.956 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:53:52.956 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.956 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.956 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:52.956 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:53:52.956 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:53:52.956 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.957 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.957 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:52.957 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:53:52.957 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:53:52.957 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.957 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.957 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:52.957 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:53:52.957 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:53:52.957 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.957 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.957 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:52.957 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:53:52.957 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:53:52.958 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.958 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.958 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:52.958 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:53:52.958 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:53:52.958 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.958 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.958 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:52.958 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:53:52.958 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:53:52.958 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.958 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.958 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:52.959 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:53:52.959 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:53:52.959 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.959 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.959 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:52.959 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:53:52.959 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:53:52.959 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.959 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.959 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:52.959 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:53:52.959 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:53:52.959 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.959 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.959 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:52.960 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:53:52.960 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:53:52.960 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.960 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.960 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:52.960 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:53:52.960 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:53:52.960 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:52.960 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:52.960 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:52.960 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.960 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.960 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:52.960 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:52.961 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 119.90960520199999, 2024-04-25T22:53:52.961 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:53:52.961 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:52.961 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:52.961 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:52.961 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:52.961 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.961 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:52.961 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:52.961 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:52.961 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.961 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.961 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:52.961 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:52.962 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:52.962 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.962 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.962 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:52.962 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:53:52.962 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:53:52.962 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.962 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.962 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:52.962 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:53:52.962 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:53:52.962 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.962 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.962 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:52.963 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:53:52.963 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:53:52.963 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.963 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.963 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:52.963 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:53:52.963 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:53:52.963 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.963 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.963 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:52.963 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:53:52.963 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:53:52.963 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.964 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.964 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:53:52.964 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:53:52.964 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:53:52.964 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.964 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.964 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:52.964 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:53:52.964 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:53:52.964 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.964 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.964 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:52.964 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:53:52.964 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:53:52.965 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.965 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.965 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:52.965 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:53:52.965 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:53:52.965 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.965 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.965 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:52.965 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:53:52.965 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:53:52.965 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.965 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.965 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:52.965 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:53:52.966 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:53:52.966 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.966 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.966 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:52.966 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:53:52.966 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:53:52.966 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.966 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.966 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:52.966 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:53:52.966 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:53:52.966 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:52.966 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:52.966 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:52.967 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.967 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.967 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:52.967 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:52.967 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 119.909580236, 2024-04-25T22:53:52.967 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:53:52.967 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:52.967 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:52.967 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:52.967 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:52.967 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.967 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:52.967 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:52.967 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:52.968 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.968 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.968 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:52.968 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:52.968 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:52.968 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.968 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.968 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:52.968 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:53:52.968 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:53:52.968 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.968 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.968 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:52.969 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:53:52.969 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:53:52.969 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.969 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.969 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:52.969 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:52.969 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:53:52.969 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.969 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.969 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:52.969 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:53:52.969 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:53:52.969 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.969 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.970 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:52.970 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:53:52.970 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:53:52.970 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.970 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.970 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:52.970 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:53:52.970 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:53:52.970 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.970 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.970 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:52.970 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:53:52.970 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:53:52.971 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.971 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.971 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:52.971 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:53:52.971 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:53:52.971 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.971 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.971 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:52.971 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:53:52.971 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:53:52.971 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.971 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.971 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:52.971 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:53:52.972 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:53:52.972 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.972 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.972 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:52.972 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:53:52.972 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:53:52.972 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:52.972 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:52.972 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:52.972 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.972 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.972 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:52.972 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:52.972 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 119.909543872, 2024-04-25T22:53:52.973 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:53:52.973 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:52.973 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:52.973 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:52.973 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:52.973 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.973 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:52.973 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:52.973 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:52.973 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.973 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.973 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:52.973 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:52.973 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:52.973 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.974 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.974 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:52.974 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:53:52.974 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:53:52.974 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.974 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.974 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:52.974 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:53:52.974 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:53:52.974 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.974 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.974 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:52.974 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:53:52.975 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:53:52.975 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.975 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.975 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:52.975 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:53:52.975 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:53:52.975 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.975 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.975 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:52.975 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:53:52.975 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:53:52.975 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.975 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.975 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:52.976 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:53:52.976 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:53:52.976 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.976 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.976 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:52.976 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:53:52.976 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:53:52.976 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.976 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.976 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:52.976 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:53:52.976 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:53:52.976 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.976 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.976 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:52.977 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:53:52.977 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:53:52.977 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:52.977 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:52.977 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:52.977 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.977 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.977 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:52.977 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:52.977 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 119.909512791, 2024-04-25T22:53:52.977 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:53:52.977 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:52.977 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:52.977 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:52.978 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:52.978 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.978 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:52.978 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:52.978 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:52.978 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.978 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.978 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:52.978 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:52.978 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:52.978 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.978 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.978 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:52.978 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:52.979 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:52.979 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.979 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.979 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:52.979 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:53:52.979 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:53:52.979 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.979 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.979 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:52.979 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:53:52.979 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:53:52.979 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.979 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.979 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:52.980 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:53:52.980 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:53:52.980 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.980 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.980 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:52.980 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:53:52.980 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:53:52.980 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.980 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.980 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:52.980 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:53:52.980 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:53:52.980 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.980 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.981 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:52.981 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:53:52.981 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:53:52.981 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:52.981 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:52.981 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:52.981 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.981 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.981 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:30 4.31 4:8ebfc112:::1000000021d.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-25T22:53:52.981 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:53:52.981 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 21.869826921000001, 2024-04-25T22:53:52.981 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015003005, 2024-04-25T22:53:52.981 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:52.981 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:52.982 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:52.982 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:52.982 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:52.982 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:52.982 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 30 2024-04-25T22:53:52.982 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.982 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:52.982 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.982 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:52.982 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:53:52.982 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:52.982 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.982 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.983 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:52.983 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:53:52.983 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:52.983 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.983 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.983 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:52.983 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053133+0000", 2024-04-25T22:53:52.983 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0370000000000001e-06 2024-04-25T22:53:52.983 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.983 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.983 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:52.983 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060377+0000", 2024-04-25T22:53:52.983 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0072431070000000004 2024-04-25T22:53:52.983 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.984 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.984 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:52.984 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060388+0000", 2024-04-25T22:53:52.984 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1285e-05 2024-04-25T22:53:52.984 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.984 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.984 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:52.984 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060394+0000", 2024-04-25T22:53:52.984 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1040000000000003e-06 2024-04-25T22:53:52.984 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.984 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.984 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:52.984 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060483+0000", 2024-04-25T22:53:52.984 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.9345000000000006e-05 2024-04-25T22:53:52.984 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.985 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.985 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:52.985 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060566+0000", 2024-04-25T22:53:52.985 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2237999999999994e-05 2024-04-25T22:53:52.985 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.985 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.985 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:52.985 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068057+0000", 2024-04-25T22:53:52.985 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074912210000000002 2024-04-25T22:53:52.985 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.985 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.985 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:52.985 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068090+0000", 2024-04-25T22:53:52.985 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3501000000000003e-05 2024-04-25T22:53:52.986 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.986 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.986 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:52.986 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068134+0000", 2024-04-25T22:53:52.986 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4166999999999999e-05 2024-04-25T22:53:52.986 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:52.986 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:52.986 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:52.986 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.986 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.986 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:66 4.27 4:e5671758:::1000000024f.00000000:head [write 0~6641] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:52.986 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:52.986 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 21.609716585000001, 2024-04-25T22:53:52.986 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075166540000000002, 2024-04-25T22:53:52.987 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:52.987 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:52.987 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:52.987 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:52.987 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:52.987 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:52.987 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 66 2024-04-25T22:53:52.987 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.987 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:52.987 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.987 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:52.987 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:52.987 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:52.987 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.987 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.988 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:52.988 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:52.988 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:52.988 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.988 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.988 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:52.988 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:52.988 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4099999999999998e-07 2024-04-25T22:53:52.988 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.988 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.988 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:52.988 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313252+0000", 2024-04-25T22:53:52.988 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5380000000000008e-06 2024-04-25T22:53:52.988 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.989 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.989 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:52.989 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313260+0000", 2024-04-25T22:53:52.989 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2609999999999993e-06 2024-04-25T22:53:52.989 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.989 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.989 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:52.989 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313265+0000", 2024-04-25T22:53:52.989 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4850000000000003e-06 2024-04-25T22:53:52.989 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.989 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.989 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:52.989 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313310+0000", 2024-04-25T22:53:52.989 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5247999999999998e-05 2024-04-25T22:53:52.989 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.990 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.990 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:52.990 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313370+0000", 2024-04-25T22:53:52.990 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0275000000000001e-05 2024-04-25T22:53:52.990 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.990 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.990 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:52.990 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313435+0000", 2024-04-25T22:53:52.990 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4647000000000006e-05 2024-04-25T22:53:52.990 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.990 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.990 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:52.990 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314174+0000", 2024-04-25T22:53:52.990 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00073925 2024-04-25T22:53:52.990 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.991 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.991 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:52.991 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320688+0000", 2024-04-25T22:53:52.991 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.006513418 2024-04-25T22:53:52.991 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.991 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.991 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:52.991 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320736+0000", 2024-04-25T22:53:52.991 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.8114e-05 2024-04-25T22:53:52.991 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.991 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.991 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:52.991 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320758+0000", 2024-04-25T22:53:52.991 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2776999999999999e-05 2024-04-25T22:53:52.992 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:52.992 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:52.992 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:52.992 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.992 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.992 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:68 4.31 4:8fb7f7b7:::10000000251.00000000:head [write 0~2067] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:52.992 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:52.992 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 21.608030806999999, 2024-04-25T22:53:52.992 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0087011669999999992, 2024-04-25T22:53:52.992 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:52.992 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:52.992 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:52.992 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:52.992 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:52.993 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:52.993 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 68 2024-04-25T22:53:52.993 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.993 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:52.993 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.993 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:52.993 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:52.993 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:52.993 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.993 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.993 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:52.993 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:52.993 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:52.993 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.993 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.994 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:52.994 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:52.994 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:53:52.994 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.994 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.994 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:52.994 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314933+0000", 2024-04-25T22:53:52.994 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5430000000000004e-06 2024-04-25T22:53:52.994 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.994 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.994 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:52.994 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314944+0000", 2024-04-25T22:53:52.994 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.076e-05 2024-04-25T22:53:52.995 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.995 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.995 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:52.995 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314949+0000", 2024-04-25T22:53:52.995 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1019999999999996e-06 2024-04-25T22:53:52.995 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.995 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.995 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:52.995 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314996+0000", 2024-04-25T22:53:52.995 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7018999999999998e-05 2024-04-25T22:53:52.995 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.995 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.995 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:52.995 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315064+0000", 2024-04-25T22:53:52.995 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8738000000000005e-05 2024-04-25T22:53:52.996 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.996 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.996 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:52.996 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323531+0000", 2024-04-25T22:53:52.996 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084664739999999999 2024-04-25T22:53:52.996 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.996 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.996 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:52.996 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323574+0000", 2024-04-25T22:53:52.996 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3449999999999999e-05 2024-04-25T22:53:52.996 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.996 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.996 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:52.997 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323629+0000", 2024-04-25T22:53:52.997 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4296999999999999e-05 2024-04-25T22:53:52.997 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:52.997 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:52.997 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:52.997 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.997 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.997 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4734.0:69 4.32 e46/13 4:4e8c6251:::10000000252.00000000:head v 46'1, mlcod=0'0)", 2024-04-25T22:53:52.997 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:52.997 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 21.606999539, 2024-04-25T22:53:52.997 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076063240000000002, 2024-04-25T22:53:52.997 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:52.998 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:52.998 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:52.998 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:52.998 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.998 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:52.998 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:52.998 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:52.998 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.998 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.998 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:52.998 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:52.998 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:52.998 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.999 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.999 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:52.999 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:52.999 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3099999999999997e-07 2024-04-25T22:53:52.999 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.999 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.999 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:52.999 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315964+0000", 2024-04-25T22:53:52.999 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3229999999999999e-06 2024-04-25T22:53:52.999 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:52.999 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:52.999 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:52.999 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315973+0000", 2024-04-25T22:53:52.999 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7249999999999992e-06 2024-04-25T22:53:53.000 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.000 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.000 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:53.000 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315978+0000", 2024-04-25T22:53:53.000 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4830000000000001e-06 2024-04-25T22:53:53.000 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.000 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.000 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:53.000 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.316043+0000", 2024-04-25T22:53:53.000 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.5036000000000005e-05 2024-04-25T22:53:53.000 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.000 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.000 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:53.000 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.316055+0000", 2024-04-25T22:53:53.001 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1973999999999999e-05 2024-04-25T22:53:53.001 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.001 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.001 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:53.001 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323521+0000", 2024-04-25T22:53:53.001 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074660239999999999 2024-04-25T22:53:53.001 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.001 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.001 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:53.001 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323565+0000", 2024-04-25T22:53:53.001 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4128000000000002e-05 2024-04-25T22:53:53.001 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.001 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:53.001 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.001 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.002 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.002 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:72 4.36 4:6cdfec98:::10000000255.00000000:head [write 0~4131] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:53.002 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:53.002 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 21.604955626999999, 2024-04-25T22:53:53.002 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084820680000000006, 2024-04-25T22:53:53.002 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:53.002 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:53.002 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:53.002 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:53.002 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:53.002 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:53.002 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 72 2024-04-25T22:53:53.002 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.002 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:53.003 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.003 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:53.003 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:53.003 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:53.003 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.003 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.003 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:53.003 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:53.003 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:53.003 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.003 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.003 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:53.003 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:53.003 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1800000000000005e-07 2024-04-25T22:53:53.003 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.003 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.004 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:53.004 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318010+0000", 2024-04-25T22:53:53.004 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7399999999999998e-06 2024-04-25T22:53:53.004 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.004 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.004 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:53.004 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318019+0000", 2024-04-25T22:53:53.004 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0170000000000002e-06 2024-04-25T22:53:53.004 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.004 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.004 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:53.004 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318024+0000", 2024-04-25T22:53:53.004 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0150000000000003e-06 2024-04-25T22:53:53.004 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.004 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.004 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:53.005 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318075+0000", 2024-04-25T22:53:53.005 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0537000000000001e-05 2024-04-25T22:53:53.005 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.005 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.005 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:53.005 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318144+0000", 2024-04-25T22:53:53.005 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9432999999999997e-05 2024-04-25T22:53:53.005 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.005 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.005 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:53.005 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326392+0000", 2024-04-25T22:53:53.005 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0082482979999999994 2024-04-25T22:53:53.005 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.005 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.006 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:53.006 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326432+0000", 2024-04-25T22:53:53.006 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9870000000000003e-05 2024-04-25T22:53:53.006 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.006 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.006 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:53.006 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326485+0000", 2024-04-25T22:53:53.006 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2439999999999999e-05 2024-04-25T22:53:53.006 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.006 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:53.006 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.006 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.006 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.006 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:74 4.10 4:08e6f8ca:::10000000257.00000000:head [write 0~839] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:53.007 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:53:53.007 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 21.603481898999998, 2024-04-25T22:53:53.007 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070370720000000001, 2024-04-25T22:53:53.007 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:53.007 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:53.007 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:53.007 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:53.007 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:53.007 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:53.007 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 74 2024-04-25T22:53:53.007 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.007 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:53.007 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.007 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:53.008 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:53:53.008 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:53.008 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.008 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.008 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:53.008 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:53:53.008 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:53.008 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.008 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.008 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:53.008 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319477+0000", 2024-04-25T22:53:53.008 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1999999999999999e-07 2024-04-25T22:53:53.008 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.009 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.009 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:53.009 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319483+0000", 2024-04-25T22:53:53.009 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4260000000000002e-06 2024-04-25T22:53:53.009 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.009 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.009 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:53.009 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319494+0000", 2024-04-25T22:53:53.009 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.094e-05 2024-04-25T22:53:53.009 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.009 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.009 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:53.009 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319499+0000", 2024-04-25T22:53:53.009 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3789999999999997e-06 2024-04-25T22:53:53.010 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.010 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.010 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:53.010 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319545+0000", 2024-04-25T22:53:53.010 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6149000000000001e-05 2024-04-25T22:53:53.010 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.010 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.010 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:53.010 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319617+0000", 2024-04-25T22:53:53.010 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1792999999999995e-05 2024-04-25T22:53:53.010 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.010 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.010 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:53.011 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326406+0000", 2024-04-25T22:53:53.011 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067895999999999998 2024-04-25T22:53:53.011 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.011 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.011 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:53.011 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326443+0000", 2024-04-25T22:53:53.011 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6828e-05 2024-04-25T22:53:53.011 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.011 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.011 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:53.011 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326514+0000", 2024-04-25T22:53:53.011 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0236999999999999e-05 2024-04-25T22:53:53.011 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.011 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:53.012 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.012 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.012 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.012 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:128 3.1f 3:f83d65d8:::200.00000004:head [write 876784~3317520 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e48)", 2024-04-25T22:53:53.012 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:36.985410+0000", 2024-04-25T22:53:53.012 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 15.937548281, 2024-04-25T22:53:53.012 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0090177360000000002, 2024-04-25T22:53:53.012 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:53.012 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:53.012 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:53.012 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:53.012 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.012 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:53.012 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.985410+0000", 2024-04-25T22:53:53.013 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:53.013 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.013 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.013 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:53.013 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.985410+0000", 2024-04-25T22:53:53.013 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:53.013 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.013 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.013 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:53.013 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.985411+0000", 2024-04-25T22:53:53.013 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8400000000000003e-07 2024-04-25T22:53:53.013 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.013 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.013 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:53.014 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989116+0000", 2024-04-25T22:53:53.014 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037047389999999999 2024-04-25T22:53:53.014 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.014 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.014 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:53.014 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989128+0000", 2024-04-25T22:53:53.014 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1977999999999999e-05 2024-04-25T22:53:53.014 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.014 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.014 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:53.014 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989135+0000", 2024-04-25T22:53:53.014 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5290000000000003e-06 2024-04-25T22:53:53.014 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.014 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.015 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:53.015 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989181+0000", 2024-04-25T22:53:53.015 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6122999999999999e-05 2024-04-25T22:53:53.015 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.015 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.015 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:53.015 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989250+0000", 2024-04-25T22:53:53.015 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8535999999999996e-05 2024-04-25T22:53:53.015 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.015 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.015 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:53.015 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.994272+0000", 2024-04-25T22:53:53.015 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050224889999999998 2024-04-25T22:53:53.015 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.016 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.016 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:53.016 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.994335+0000", 2024-04-25T22:53:53.016 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2588000000000005e-05 2024-04-25T22:53:53.016 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.016 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.016 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:53.016 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.994428+0000", 2024-04-25T22:53:53.016 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2869999999999997e-05 2024-04-25T22:53:53.016 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.016 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:53.016 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.016 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.016 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.017 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:2150 4.22 4:47cffac6:::10000000a2b.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T22:53:53.017 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:41.078233+0000", 2024-04-25T22:53:53.017 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 11.844724971, 2024-04-25T22:53:53.017 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069201510000000003, 2024-04-25T22:53:53.017 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:53.017 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:53.017 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:53.017 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:53.017 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.017 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:53.017 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078233+0000", 2024-04-25T22:53:53.017 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:53.017 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.017 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.017 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:53.018 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078233+0000", 2024-04-25T22:53:53.018 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:53.018 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.018 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.018 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:53.018 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078234+0000", 2024-04-25T22:53:53.018 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1699999999999998e-07 2024-04-25T22:53:53.018 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.018 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.018 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:53.018 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078236+0000", 2024-04-25T22:53:53.018 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.875e-06 2024-04-25T22:53:53.018 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.019 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.019 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:53.019 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078242+0000", 2024-04-25T22:53:53.019 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2450000000000003e-06 2024-04-25T22:53:53.019 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.019 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.019 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:53.019 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078247+0000", 2024-04-25T22:53:53.019 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7450000000000003e-06 2024-04-25T22:53:53.019 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.019 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.019 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:53.019 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078641+0000", 2024-04-25T22:53:53.019 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00039420200000000002 2024-04-25T22:53:53.020 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.020 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.020 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:53.020 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078840+0000", 2024-04-25T22:53:53.020 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000199063 2024-04-25T22:53:53.020 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.020 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.020 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:53.020 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078919+0000", 2024-04-25T22:53:53.020 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9182000000000002e-05 2024-04-25T22:53:53.020 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.020 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.020 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:53.020 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.080906+0000", 2024-04-25T22:53:53.021 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0019866390000000001 2024-04-25T22:53:53.021 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.021 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.021 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:53.021 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085074+0000", 2024-04-25T22:53:53.021 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0041683639999999999 2024-04-25T22:53:53.021 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.021 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.021 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:53.021 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085117+0000", 2024-04-25T22:53:53.021 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2849999999999998e-05 2024-04-25T22:53:53.021 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.021 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.021 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:53.021 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085154+0000", 2024-04-25T22:53:53.022 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6468999999999999e-05 2024-04-25T22:53:53.022 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.022 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:53.022 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.022 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.022 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.022 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:2160 4.2a 4:57f9ed86:::10000000a3d.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T22:53:53.022 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:53:53.022 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 11.844255681, 2024-04-25T22:53:53.022 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0068959959999999997, 2024-04-25T22:53:53.022 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:53.022 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:53.022 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:53.022 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:53.023 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.023 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:53.023 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:53:53.023 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:53.023 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.023 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.023 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:53.023 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:53:53.023 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:53.023 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.023 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.023 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:53.023 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:53:53.023 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7000000000000004e-07 2024-04-25T22:53:53.024 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.024 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.024 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:53.024 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078707+0000", 2024-04-25T22:53:53.024 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.783e-06 2024-04-25T22:53:53.024 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.024 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.024 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:53.024 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078716+0000", 2024-04-25T22:53:53.024 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4800000000000001e-06 2024-04-25T22:53:53.024 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.024 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.024 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:53.024 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078724+0000", 2024-04-25T22:53:53.025 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1519999999999992e-06 2024-04-25T22:53:53.025 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.025 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.025 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:53.025 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078794+0000", 2024-04-25T22:53:53.025 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0500999999999995e-05 2024-04-25T22:53:53.025 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.025 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.025 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:53.025 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078912+0000", 2024-04-25T22:53:53.025 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000117439 2024-04-25T22:53:53.025 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.025 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.025 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:53.026 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079000+0000", 2024-04-25T22:53:53.026 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8092999999999998e-05 2024-04-25T22:53:53.026 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.026 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.026 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:53.026 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.080897+0000", 2024-04-25T22:53:53.026 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0018970899999999999 2024-04-25T22:53:53.026 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.026 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.026 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:53.026 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085517+0000", 2024-04-25T22:53:53.026 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0046198929999999999 2024-04-25T22:53:53.026 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.026 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.027 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:53.027 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085565+0000", 2024-04-25T22:53:53.027 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7777e-05 2024-04-25T22:53:53.027 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.027 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.027 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:53.027 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085599+0000", 2024-04-25T22:53:53.027 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4017999999999999e-05 2024-04-25T22:53:53.027 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.027 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:53.027 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.027 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.027 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.027 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:2163 4.2a 4:549f79e3:::10000000a43.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T22:53:53.028 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:53:53.028 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 11.844222328000001, 2024-04-25T22:53:53.028 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069469190000000002, 2024-04-25T22:53:53.028 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:53.028 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:53.028 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:53.028 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:53.028 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.028 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:53.028 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:53:53.028 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:53.028 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.028 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.028 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:53.029 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:53:53.029 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:53.029 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.029 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.029 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:53.029 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:53:53.029 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1399999999999997e-07 2024-04-25T22:53:53.029 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.029 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.029 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:53.029 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078739+0000", 2024-04-25T22:53:53.029 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2960000000000001e-06 2024-04-25T22:53:53.029 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.029 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.030 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:53.030 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078745+0000", 2024-04-25T22:53:53.030 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3439999999999997e-06 2024-04-25T22:53:53.030 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.030 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.030 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:53.030 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078750+0000", 2024-04-25T22:53:53.030 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3179999999999997e-06 2024-04-25T22:53:53.030 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.030 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.030 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:53.030 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079224+0000", 2024-04-25T22:53:53.030 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00047334999999999999 2024-04-25T22:53:53.030 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.031 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.031 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:53.031 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079292+0000", 2024-04-25T22:53:53.031 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8708999999999996e-05 2024-04-25T22:53:53.031 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.031 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.031 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:53.031 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079342+0000", 2024-04-25T22:53:53.031 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9299999999999999e-05 2024-04-25T22:53:53.031 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.031 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.031 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:53.031 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.081611+0000", 2024-04-25T22:53:53.031 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0022695229999999999 2024-04-25T22:53:53.031 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.032 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.032 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:53.032 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085605+0000", 2024-04-25T22:53:53.032 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0039933679999999997 2024-04-25T22:53:53.032 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.032 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.032 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:53.032 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085650+0000", 2024-04-25T22:53:53.032 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5111000000000002e-05 2024-04-25T22:53:53.032 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.032 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.032 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:53.032 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085683+0000", 2024-04-25T22:53:53.032 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3185999999999997e-05 2024-04-25T22:53:53.032 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.033 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:53.033 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.033 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.033 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:53.033 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:53.035 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:53:53.035 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:52.924+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:53.035 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:53.033+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:53.035 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:53:53.036 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:53.135 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:53.134+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:53.140 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:53.140 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:53.140 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-04-25T22:53:53.140 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:53.148 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:53.236 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:53.235+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:53.250 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:53.250 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:53.250 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:53:53.250 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:53:53.250 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:53.259 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:53.273 INFO:tasks.workunit.client.0.smithi052.stdout: [CC] dirstress 2024-04-25T22:53:53.281 INFO:tasks.workunit.client.0.smithi052.stdout: [CC] fill 2024-04-25T22:53:53.281 INFO:tasks.workunit.client.0.smithi052.stdout: [CC] fill2 2024-04-25T22:53:53.285 INFO:tasks.workunit.client.0.smithi052.stdout: [CC] getpagesize 2024-04-25T22:53:53.337 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:53.336+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:53.364 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:53.364 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-04-25T22:53:53.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-04-25T22:53:53.364 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:53:53.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.365 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:53.365 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:53.365 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.396233896, 2024-04-25T22:53:53.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010384338999999999, 2024-04-25T22:53:53.365 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:53.365 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:53.366 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:53.366 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:53.366 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:53.366 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:53.366 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-04-25T22:53:53.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.367 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:53.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:53.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:53.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:53.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:53.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:53.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:53.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:53.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:53.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3600000000000004e-07 2024-04-25T22:53:53.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:53.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965185+0000", 2024-04-25T22:53:53.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.117e-06 2024-04-25T22:53:53.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:53.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965192+0000", 2024-04-25T22:53:53.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3239999999999997e-06 2024-04-25T22:53:53.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:53.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965198+0000", 2024-04-25T22:53:53.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6370000000000004e-06 2024-04-25T22:53:53.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:53.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970973+0000", 2024-04-25T22:53:53.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057748239999999996 2024-04-25T22:53:53.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:53.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971049+0000", 2024-04-25T22:53:53.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6029e-05 2024-04-25T22:53:53.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:53.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971174+0000", 2024-04-25T22:53:53.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012462399999999999 2024-04-25T22:53:53.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:53.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971553+0000", 2024-04-25T22:53:53.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037896499999999999 2024-04-25T22:53:53.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:53.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975482+0000", 2024-04-25T22:53:53.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039297459999999996 2024-04-25T22:53:53.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:53.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975529+0000", 2024-04-25T22:53:53.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6387000000000002e-05 2024-04-25T22:53:53.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:53.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975563+0000", 2024-04-25T22:53:53.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4150000000000003e-05 2024-04-25T22:53:53.375 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:53.375 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:53.375 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:53.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.375 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:53.375 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:53.375 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 120.34918757299999, 2024-04-25T22:53:53.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012637705000000001, 2024-04-25T22:53:53.375 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:53.376 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:53.376 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:53.376 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:53.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:53.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:53.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:53.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:53.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:53.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:53.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:53.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012227+0000", 2024-04-25T22:53:53.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.863e-06 2024-04-25T22:53:53.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:53.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012236+0000", 2024-04-25T22:53:53.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1109999999999997e-06 2024-04-25T22:53:53.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:53.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012309+0000", 2024-04-25T22:53:53.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3242000000000001e-05 2024-04-25T22:53:53.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:53.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012324+0000", 2024-04-25T22:53:53.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4837e-05 2024-04-25T22:53:53.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:53.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015060+0000", 2024-04-25T22:53:53.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027363349999999999 2024-04-25T22:53:53.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:53.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015169+0000", 2024-04-25T22:53:53.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108372 2024-04-25T22:53:53.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:53.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015498+0000", 2024-04-25T22:53:53.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032949999999999999 2024-04-25T22:53:53.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:53.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021282+0000", 2024-04-25T22:53:53.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057836429999999998 2024-04-25T22:53:53.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:53.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024709+0000", 2024-04-25T22:53:53.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034271979999999998 2024-04-25T22:53:53.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:53.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024802+0000", 2024-04-25T22:53:53.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2960000000000004e-05 2024-04-25T22:53:53.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:53.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024863+0000", 2024-04-25T22:53:53.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0643999999999997e-05 2024-04-25T22:53:53.381 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:53.381 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:53.381 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:53.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.382 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:53.382 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:53.382 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 120.349063802, 2024-04-25T22:53:53.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012979447999999999, 2024-04-25T22:53:53.382 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:53.382 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:53.382 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:53.382 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:53.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:53.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:53.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:53.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:53.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:53.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:53.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:53.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:53.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:53:53.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:53.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012354+0000", 2024-04-25T22:53:53.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7740000000000004e-06 2024-04-25T22:53:53.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:53.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012365+0000", 2024-04-25T22:53:53.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.064e-05 2024-04-25T22:53:53.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:53.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012382+0000", 2024-04-25T22:53:53.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6999000000000001e-05 2024-04-25T22:53:53.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:53.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015958+0000", 2024-04-25T22:53:53.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035765699999999998 2024-04-25T22:53:53.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:53.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016037+0000", 2024-04-25T22:53:53.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8242000000000001e-05 2024-04-25T22:53:53.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:53.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016404+0000", 2024-04-25T22:53:53.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036784300000000002 2024-04-25T22:53:53.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:53.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021294+0000", 2024-04-25T22:53:53.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048890629999999999 2024-04-25T22:53:53.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:53.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024959+0000", 2024-04-25T22:53:53.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036651570000000001 2024-04-25T22:53:53.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:53.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025097+0000", 2024-04-25T22:53:53.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013788099999999999 2024-04-25T22:53:53.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:53.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025328+0000", 2024-04-25T22:53:53.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231492 2024-04-25T22:53:53.387 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:53.387 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:53.387 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:53.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.388 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:53.388 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:53.388 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 120.348976033, 2024-04-25T22:53:53.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013049827, 2024-04-25T22:53:53.388 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:53.388 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:53.388 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:53.388 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:53.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:53.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:53.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:53.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:53.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:53.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:53.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:53.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012437+0000", 2024-04-25T22:53:53.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-04-25T22:53:53.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:53.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012440+0000", 2024-04-25T22:53:53.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7609999999999999e-06 2024-04-25T22:53:53.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:53.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012449+0000", 2024-04-25T22:53:53.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.285e-06 2024-04-25T22:53:53.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:53.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012457+0000", 2024-04-25T22:53:53.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9510000000000006e-06 2024-04-25T22:53:53.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:53.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017106+0000", 2024-04-25T22:53:53.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046494220000000003 2024-04-25T22:53:53.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:53.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017223+0000", 2024-04-25T22:53:53.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116824 2024-04-25T22:53:53.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:53.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017345+0000", 2024-04-25T22:53:53.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122175 2024-04-25T22:53:53.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:53.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021299+0000", 2024-04-25T22:53:53.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039534879999999998 2024-04-25T22:53:53.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:53.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025398+0000", 2024-04-25T22:53:53.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040988960000000003 2024-04-25T22:53:53.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.393 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:53.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025439+0000", 2024-04-25T22:53:53.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0915999999999999e-05 2024-04-25T22:53:53.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.393 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:53.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025486+0000", 2024-04-25T22:53:53.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7534999999999998e-05 2024-04-25T22:53:53.393 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:53.393 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:53.393 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:53.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.394 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:53.394 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:53.394 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 120.348945882, 2024-04-25T22:53:53.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020988041999999998, 2024-04-25T22:53:53.394 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:53.394 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:53.394 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:53.394 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:53.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:53.394 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:53.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:53.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:53.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:53.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:53.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:53.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:53.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.99e-07 2024-04-25T22:53:53.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:53.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012470+0000", 2024-04-25T22:53:53.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2789999999999999e-06 2024-04-25T22:53:53.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:53.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012477+0000", 2024-04-25T22:53:53.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:53:53.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:53.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012500+0000", 2024-04-25T22:53:53.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2490999999999999e-05 2024-04-25T22:53:53.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:53.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021911+0000", 2024-04-25T22:53:53.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094114160000000006 2024-04-25T22:53:53.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:53.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022000+0000", 2024-04-25T22:53:53.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8601000000000001e-05 2024-04-25T22:53:53.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:53.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022359+0000", 2024-04-25T22:53:53.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035921999999999999 2024-04-25T22:53:53.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:53.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025541+0000", 2024-04-25T22:53:53.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031820619999999998 2024-04-25T22:53:53.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:53.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033375+0000", 2024-04-25T22:53:53.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078338379999999992 2024-04-25T22:53:53.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:53.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033415+0000", 2024-04-25T22:53:53.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9527000000000003e-05 2024-04-25T22:53:53.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:53.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033455+0000", 2024-04-25T22:53:53.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9932000000000003e-05 2024-04-25T22:53:53.399 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:53.399 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:53.399 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:53.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.399 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:53.399 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:53.399 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 120.348890689, 2024-04-25T22:53:53.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021043857999999999, 2024-04-25T22:53:53.399 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:53.400 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:53.400 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:53.400 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:53.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:53.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:53.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:53.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:53.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:53.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:53.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:53.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012523+0000", 2024-04-25T22:53:53.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.361e-06 2024-04-25T22:53:53.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:53.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012530+0000", 2024-04-25T22:53:53.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5440000000000004e-06 2024-04-25T22:53:53.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:53.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012541+0000", 2024-04-25T22:53:53.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1745e-05 2024-04-25T22:53:53.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:53.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012551+0000", 2024-04-25T22:53:53.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5789999999999993e-06 2024-04-25T22:53:53.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:53.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022709+0000", 2024-04-25T22:53:53.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010157685 2024-04-25T22:53:53.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:53.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022957+0000", 2024-04-25T22:53:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024824599999999998 2024-04-25T22:53:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023443+0000", 2024-04-25T22:53:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048578599999999999 2024-04-25T22:53:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025547+0000", 2024-04-25T22:53:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021044789999999998 2024-04-25T22:53:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:53.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033509+0000", 2024-04-25T22:53:53.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0079622180000000001 2024-04-25T22:53:53.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:53.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033542+0000", 2024-04-25T22:53:53.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3018000000000001e-05 2024-04-25T22:53:53.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:53.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033566+0000", 2024-04-25T22:53:53.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3197000000000002e-05 2024-04-25T22:53:53.405 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:53.405 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:53.405 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:53.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.405 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:53.405 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:53.405 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 120.348850724, 2024-04-25T22:53:53.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021122696, 2024-04-25T22:53:53.405 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:53.405 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:53.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:53.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:53:53.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:53.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012566+0000", 2024-04-25T22:53:53.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-04-25T22:53:53.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012619+0000", 2024-04-25T22:53:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2607e-05 2024-04-25T22:53:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012628+0000", 2024-04-25T22:53:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6500000000000008e-06 2024-04-25T22:53:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024024+0000", 2024-04-25T22:53:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011396007999999999 2024-04-25T22:53:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024198+0000", 2024-04-25T22:53:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000173215 2024-04-25T22:53:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024447+0000", 2024-04-25T22:53:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024898500000000002 2024-04-25T22:53:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026431+0000", 2024-04-25T22:53:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001984923 2024-04-25T22:53:53.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:53.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033608+0000", 2024-04-25T22:53:53.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071768459999999997 2024-04-25T22:53:53.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:53.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033646+0000", 2024-04-25T22:53:53.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299000000000003e-05 2024-04-25T22:53:53.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033684+0000", 2024-04-25T22:53:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8773000000000003e-05 2024-04-25T22:53:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 120.34876212499999, 2024-04-25T22:53:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021175381, 2024-04-25T22:53:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:53.412 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:53.412 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:53.412 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:53.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:53.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:53.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:53.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:53.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:53.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:53.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:53.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012651+0000", 2024-04-25T22:53:53.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:53:53.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:53.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012656+0000", 2024-04-25T22:53:53.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8899999999999998e-06 2024-04-25T22:53:53.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:53.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012666+0000", 2024-04-25T22:53:53.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0346999999999999e-05 2024-04-25T22:53:53.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:53.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012675+0000", 2024-04-25T22:53:53.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9930000000000001e-06 2024-04-25T22:53:53.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:53.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025661+0000", 2024-04-25T22:53:53.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01298531 2024-04-25T22:53:53.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025757+0000", 2024-04-25T22:53:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5822000000000005e-05 2024-04-25T22:53:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025907+0000", 2024-04-25T22:53:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015051499999999999 2024-04-25T22:53:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026435+0000", 2024-04-25T22:53:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052762200000000005 2024-04-25T22:53:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:53.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033732+0000", 2024-04-25T22:53:53.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072978419999999997 2024-04-25T22:53:53.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:53.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033787+0000", 2024-04-25T22:53:53.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4703999999999997e-05 2024-04-25T22:53:53.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:53.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033826+0000", 2024-04-25T22:53:53.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8458999999999999e-05 2024-04-25T22:53:53.416 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 120.34870671100001, 2024-04-25T22:53:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021244174000000001, 2024-04-25T22:53:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:53.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:53.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:53.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:53.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:53.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:53.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:53.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:53.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:53.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012712+0000", 2024-04-25T22:53:53.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.913e-06 2024-04-25T22:53:53.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:53.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012722+0000", 2024-04-25T22:53:53.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2879999999999998e-06 2024-04-25T22:53:53.420 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.420 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:53.420 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012727+0000", 2024-04-25T22:53:53.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8429999999999998e-06 2024-04-25T22:53:53.420 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.420 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:53.420 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026099+0000", 2024-04-25T22:53:53.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013371450999999999 2024-04-25T22:53:53.420 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:53.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026147+0000", 2024-04-25T22:53:53.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7837999999999998e-05 2024-04-25T22:53:53.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:53.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026254+0000", 2024-04-25T22:53:53.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107314 2024-04-25T22:53:53.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:53.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026686+0000", 2024-04-25T22:53:53.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000432428 2024-04-25T22:53:53.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:53.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033873+0000", 2024-04-25T22:53:53.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071864399999999997 2024-04-25T22:53:53.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:53.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033904+0000", 2024-04-25T22:53:53.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1321e-05 2024-04-25T22:53:53.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:53.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033950+0000", 2024-04-25T22:53:53.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5707999999999997e-05 2024-04-25T22:53:53.423 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:53.423 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:53.423 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:53.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.423 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:53.423 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:53.423 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 120.348676326, 2024-04-25T22:53:53.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01096505, 2024-04-25T22:53:53.423 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:53.423 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:53.424 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:53.424 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:53.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.424 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:53.424 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:53.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:53.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.424 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:53.424 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:53.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:53.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.424 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:53.425 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012737+0000", 2024-04-25T22:53:53.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:53.425 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.425 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.425 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:53.425 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012739+0000", 2024-04-25T22:53:53.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-04-25T22:53:53.425 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.425 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.425 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:53.425 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012743+0000", 2024-04-25T22:53:53.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3239999999999996e-06 2024-04-25T22:53:53.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.426 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:53.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012746+0000", 2024-04-25T22:53:53.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.129e-06 2024-04-25T22:53:53.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.426 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:53.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012796+0000", 2024-04-25T22:53:53.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9231999999999999e-05 2024-04-25T22:53:53.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:53.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012915+0000", 2024-04-25T22:53:53.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119021 2024-04-25T22:53:53.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:53.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013069+0000", 2024-04-25T22:53:53.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015463900000000001 2024-04-25T22:53:53.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:53.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019237+0000", 2024-04-25T22:53:53.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061680329999999998 2024-04-25T22:53:53.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:53.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023603+0000", 2024-04-25T22:53:53.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043655860000000003 2024-04-25T22:53:53.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:53.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023659+0000", 2024-04-25T22:53:53.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6484000000000003e-05 2024-04-25T22:53:53.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.429 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:53.429 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023701+0000", 2024-04-25T22:53:53.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1761999999999998e-05 2024-04-25T22:53:53.429 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:53.429 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:53.429 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:53.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.429 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.429 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:53.429 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:53.429 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 120.348651378, 2024-04-25T22:53:53.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011234429000000001, 2024-04-25T22:53:53.429 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:53.430 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:53.430 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:53.430 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:53.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.430 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:53.430 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:53.430 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:53.430 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.430 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:53.430 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:53.430 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:53.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.431 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:53.431 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012762+0000", 2024-04-25T22:53:53.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-04-25T22:53:53.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.431 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:53.431 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012765+0000", 2024-04-25T22:53:53.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2569999999999999e-06 2024-04-25T22:53:53.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.431 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:53.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012783+0000", 2024-04-25T22:53:53.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8431999999999999e-05 2024-04-25T22:53:53.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:53.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012799+0000", 2024-04-25T22:53:53.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5438999999999999e-05 2024-04-25T22:53:53.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:53.433 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013826+0000", 2024-04-25T22:53:53.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010275060000000001 2024-04-25T22:53:53.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.433 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:53.433 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013913+0000", 2024-04-25T22:53:53.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.708e-05 2024-04-25T22:53:53.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.433 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:53.433 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014098+0000", 2024-04-25T22:53:53.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018519399999999999 2024-04-25T22:53:53.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.434 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.434 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:53.434 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019684+0000", 2024-04-25T22:53:53.434 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055860079999999999 2024-04-25T22:53:53.434 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.434 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.434 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:53.434 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023876+0000", 2024-04-25T22:53:53.434 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041918800000000003 2024-04-25T22:53:53.434 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.434 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.434 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:53.434 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023957+0000", 2024-04-25T22:53:53.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1165e-05 2024-04-25T22:53:53.435 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.435 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:53.435 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023995+0000", 2024-04-25T22:53:53.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:53:53.435 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:53.435 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:53.435 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:53.435 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.435 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:53.435 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:53.435 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 120.348553599, 2024-04-25T22:53:53.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011131200000000001, 2024-04-25T22:53:53.436 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:53.436 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:53.436 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:53.436 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:53.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:53.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:53.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:53.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:53.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:53.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:53.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:53.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012860+0000", 2024-04-25T22:53:53.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3900000000000004e-07 2024-04-25T22:53:53.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:53.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012865+0000", 2024-04-25T22:53:53.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5609999999999998e-06 2024-04-25T22:53:53.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.438 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:53.438 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012895+0000", 2024-04-25T22:53:53.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9847000000000001e-05 2024-04-25T22:53:53.438 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.438 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:53.438 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012905+0000", 2024-04-25T22:53:53.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.03e-05 2024-04-25T22:53:53.438 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.438 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:53.439 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015020+0000", 2024-04-25T22:53:53.439 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021142940000000001 2024-04-25T22:53:53.439 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.439 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.439 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:53.439 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015182+0000", 2024-04-25T22:53:53.439 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016248099999999999 2024-04-25T22:53:53.439 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.439 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.439 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:53.439 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015357+0000", 2024-04-25T22:53:53.439 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017471000000000001 2024-04-25T22:53:53.439 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.440 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.440 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:53.440 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021021+0000", 2024-04-25T22:53:53.440 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056638340000000004 2024-04-25T22:53:53.440 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.440 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.440 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:53.440 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023712+0000", 2024-04-25T22:53:53.440 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026910380000000002 2024-04-25T22:53:53.440 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.440 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.440 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:53.440 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023763+0000", 2024-04-25T22:53:53.441 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1477999999999997e-05 2024-04-25T22:53:53.441 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.441 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.441 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:53.441 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023990+0000", 2024-04-25T22:53:53.441 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000226818 2024-04-25T22:53:53.441 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:53.441 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:53.441 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:53.441 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.441 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.441 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:53.441 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:53.442 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 120.348430503, 2024-04-25T22:53:53.442 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011705299000000001, 2024-04-25T22:53:53.442 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:53.442 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:53.442 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:53.442 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:53.442 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.442 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:53.442 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:53.442 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:53.442 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.442 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.442 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:53.443 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:53.443 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:53.443 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.443 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.443 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:53.443 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012983+0000", 2024-04-25T22:53:53.443 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:53:53.443 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.443 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.443 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:53.443 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012986+0000", 2024-04-25T22:53:53.443 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5700000000000001e-06 2024-04-25T22:53:53.443 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.444 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.444 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:53.444 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012993+0000", 2024-04-25T22:53:53.444 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8730000000000001e-06 2024-04-25T22:53:53.444 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.444 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.444 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:53.444 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013000+0000", 2024-04-25T22:53:53.444 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1890000000000001e-06 2024-04-25T22:53:53.444 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.444 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.444 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:53.444 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:53:53.445 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002147866 2024-04-25T22:53:53.445 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.445 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.445 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:53.445 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015351+0000", 2024-04-25T22:53:53.445 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020300799999999999 2024-04-25T22:53:53.445 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.445 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.445 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:53.445 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016260+0000", 2024-04-25T22:53:53.445 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00090926799999999997 2024-04-25T22:53:53.445 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.445 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.446 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:53.446 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022669+0000", 2024-04-25T22:53:53.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064082849999999997 2024-04-25T22:53:53.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.446 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.446 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:53.446 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024584+0000", 2024-04-25T22:53:53.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019151699999999999 2024-04-25T22:53:53.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.446 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.446 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:53.446 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024643+0000", 2024-04-25T22:53:53.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8888999999999998e-05 2024-04-25T22:53:53.447 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.447 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.447 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:53.447 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024687+0000", 2024-04-25T22:53:53.447 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4444999999999999e-05 2024-04-25T22:53:53.447 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:53.447 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:53.447 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:53.447 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.448 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.448 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:53.448 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:53.448 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 120.348402912, 2024-04-25T22:53:53.448 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011249699, 2024-04-25T22:53:53.448 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:53.448 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:53.448 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:53.448 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:53.448 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.448 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:53.448 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:53.448 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:53.449 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.449 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.449 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:53.449 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:53.449 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:53.449 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.449 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.449 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:53.449 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013010+0000", 2024-04-25T22:53:53.449 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2099999999999996e-07 2024-04-25T22:53:53.449 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.449 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.449 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:53.450 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013013+0000", 2024-04-25T22:53:53.450 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1310000000000002e-06 2024-04-25T22:53:53.450 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.450 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.450 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:53.450 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013020+0000", 2024-04-25T22:53:53.450 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3330000000000002e-06 2024-04-25T22:53:53.450 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.450 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.450 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:53.450 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013025+0000", 2024-04-25T22:53:53.450 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6760000000000004e-06 2024-04-25T22:53:53.450 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.450 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.451 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:53.451 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013163+0000", 2024-04-25T22:53:53.451 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013824599999999999 2024-04-25T22:53:53.451 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.451 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.451 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:53.451 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013504+0000", 2024-04-25T22:53:53.451 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034080299999999998 2024-04-25T22:53:53.451 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.451 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.451 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:53.451 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013613+0000", 2024-04-25T22:53:53.451 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108705 2024-04-25T22:53:53.452 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.452 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.452 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:53.452 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015831+0000", 2024-04-25T22:53:53.452 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002217672 2024-04-25T22:53:53.452 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.452 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.452 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:53.452 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024137+0000", 2024-04-25T22:53:53.452 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0083060489999999994 2024-04-25T22:53:53.452 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.452 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.452 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:53.452 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024218+0000", 2024-04-25T22:53:53.453 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1351000000000001e-05 2024-04-25T22:53:53.453 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.453 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.453 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:53.453 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024259+0000", 2024-04-25T22:53:53.453 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1112000000000002e-05 2024-04-25T22:53:53.453 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:53.453 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:53.453 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:53.453 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.453 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.453 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:53.453 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:53.453 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 120.34831518599999, 2024-04-25T22:53:53.454 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020379749999999999, 2024-04-25T22:53:53.454 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:53.454 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:53.454 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:53.454 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:53.454 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.454 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:53.454 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:53.454 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:53.454 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.454 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.454 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:53.454 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:53.455 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:53.455 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.455 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.455 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:53.455 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013098+0000", 2024-04-25T22:53:53.455 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:53:53.455 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.455 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.455 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:53.455 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013105+0000", 2024-04-25T22:53:53.455 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5969999999999997e-06 2024-04-25T22:53:53.455 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.455 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.456 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:53.456 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013190+0000", 2024-04-25T22:53:53.456 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5618999999999995e-05 2024-04-25T22:53:53.456 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.456 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.456 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:53.456 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013200+0000", 2024-04-25T22:53:53.456 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5859999999999994e-06 2024-04-25T22:53:53.456 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.456 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.456 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:53.456 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020265+0000", 2024-04-25T22:53:53.457 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070653349999999998 2024-04-25T22:53:53.457 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.457 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.457 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:53.457 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020454+0000", 2024-04-25T22:53:53.457 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189316 2024-04-25T22:53:53.457 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.457 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.457 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:53.457 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020586+0000", 2024-04-25T22:53:53.457 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013195700000000001 2024-04-25T22:53:53.457 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.457 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.457 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:53.458 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023822+0000", 2024-04-25T22:53:53.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032358529999999999 2024-04-25T22:53:53.458 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.458 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:53.458 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033409+0000", 2024-04-25T22:53:53.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095870520000000004 2024-04-25T22:53:53.458 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.458 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:53.458 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033447+0000", 2024-04-25T22:53:53.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7261999999999997e-05 2024-04-25T22:53:53.459 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.459 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.459 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:53.459 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033477+0000", 2024-04-25T22:53:53.459 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0389e-05 2024-04-25T22:53:53.459 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:53.459 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:53.459 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:53.459 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.459 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.459 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:53.459 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:53.459 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 120.34819868, 2024-04-25T22:53:53.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010857383999999999, 2024-04-25T22:53:53.460 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:53.460 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:53.460 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:53.460 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:53.460 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.460 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:53.460 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:53.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:53.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.460 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.460 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:53.460 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:53.461 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:53.461 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.461 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:53.461 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:53.461 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:53.461 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.461 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:53.461 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013218+0000", 2024-04-25T22:53:53.461 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8199999999999998e-06 2024-04-25T22:53:53.461 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.461 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:53.462 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013226+0000", 2024-04-25T22:53:53.462 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7649999999999993e-06 2024-04-25T22:53:53.462 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.462 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.462 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:53.462 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013259+0000", 2024-04-25T22:53:53.462 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2727e-05 2024-04-25T22:53:53.462 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.462 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.462 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:53.462 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014809+0000", 2024-04-25T22:53:53.462 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001550144 2024-04-25T22:53:53.462 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.463 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.463 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:53.463 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014958+0000", 2024-04-25T22:53:53.463 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014890300000000001 2024-04-25T22:53:53.463 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.463 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.463 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:53.463 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015087+0000", 2024-04-25T22:53:53.463 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012939200000000001 2024-04-25T22:53:53.463 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.463 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.463 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:53.463 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020212+0000", 2024-04-25T22:53:53.463 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051248939999999996 2024-04-25T22:53:53.464 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.464 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.464 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:53.464 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023699+0000", 2024-04-25T22:53:53.464 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034873289999999999 2024-04-25T22:53:53.464 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.464 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.464 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:53.464 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024014+0000", 2024-04-25T22:53:53.464 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031473999999999999 2024-04-25T22:53:53.464 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.464 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.464 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:53.465 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024071+0000", 2024-04-25T22:53:53.465 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7040000000000003e-05 2024-04-25T22:53:53.465 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:53.465 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:53.465 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:53.465 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.465 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.465 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:53.465 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:53.465 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 120.348143975, 2024-04-25T22:53:53.465 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012329677000000001, 2024-04-25T22:53:53.465 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:53.465 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:53.465 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:53.465 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:53.466 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.466 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:53.466 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:53.466 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:53.466 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.466 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.466 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:53.466 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:53.466 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:53.466 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.466 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.466 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:53.466 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013269+0000", 2024-04-25T22:53:53.467 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5000000000000002e-07 2024-04-25T22:53:53.467 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.467 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.467 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:53.467 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:53.467 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6909999999999999e-06 2024-04-25T22:53:53.467 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.467 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.467 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:53.467 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013284+0000", 2024-04-25T22:53:53.467 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0963e-05 2024-04-25T22:53:53.467 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.467 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.467 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:53.467 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013361+0000", 2024-04-25T22:53:53.468 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7379999999999994e-05 2024-04-25T22:53:53.468 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.468 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.468 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:53.468 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013448+0000", 2024-04-25T22:53:53.468 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6990000000000006e-05 2024-04-25T22:53:53.468 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.468 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.468 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:53.468 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013632+0000", 2024-04-25T22:53:53.468 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018396800000000001 2024-04-25T22:53:53.468 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.468 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.468 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:53.468 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013800+0000", 2024-04-25T22:53:53.469 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167467 2024-04-25T22:53:53.469 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.469 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.469 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:53.469 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.018570+0000", 2024-04-25T22:53:53.469 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047701460000000003 2024-04-25T22:53:53.469 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.469 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.469 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:53.469 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025507+0000", 2024-04-25T22:53:53.469 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069372039999999998 2024-04-25T22:53:53.469 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.469 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.470 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:53.470 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025562+0000", 2024-04-25T22:53:53.470 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4858999999999998e-05 2024-04-25T22:53:53.470 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.470 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.470 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:53.470 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025598+0000", 2024-04-25T22:53:53.470 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6259e-05 2024-04-25T22:53:53.470 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:53.470 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:53.470 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:53.470 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.470 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.471 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:53.471 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:53.471 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 120.348012102, 2024-04-25T22:53:53.471 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020176666999999999, 2024-04-25T22:53:53.471 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:53.471 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:53.471 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:53:53.471 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:53.471 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.471 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:53.471 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:53.471 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:53.471 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.472 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.472 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:53.472 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:53.472 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:53.472 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.472 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.472 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:53.472 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:53.472 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-04-25T22:53:53.472 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.472 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.473 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:53.473 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013405+0000", 2024-04-25T22:53:53.473 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0559999999999998e-06 2024-04-25T22:53:53.473 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.473 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.473 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:53.473 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013422+0000", 2024-04-25T22:53:53.473 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6770999999999999e-05 2024-04-25T22:53:53.473 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.473 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.473 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:53.473 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013431+0000", 2024-04-25T22:53:53.473 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5019999999999998e-06 2024-04-25T22:53:53.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.474 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:53.474 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021720+0000", 2024-04-25T22:53:53.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082884340000000008 2024-04-25T22:53:53.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.474 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:53.474 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022122+0000", 2024-04-25T22:53:53.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000401634 2024-04-25T22:53:53.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.474 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:53.474 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033577+0000", 2024-04-25T22:53:53.475 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011455435999999999 2024-04-25T22:53:53.475 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:53.475 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:53.475 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:53.475 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.475 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.475 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4734.0:31 4.1b 4:d9872866:::1000000021d.00000002:head [write 0~3618035] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-25T22:53:53.475 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:53:53.475 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.30843784, 2024-04-25T22:53:53.475 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011647062, 2024-04-25T22:53:53.475 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:53.475 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:53.475 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:53.476 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:53.476 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4734", 2024-04-25T22:53:53.476 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:53.476 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 31 2024-04-25T22:53:53.476 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.476 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:53.476 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.476 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:53.476 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:53:53.476 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:53.476 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.476 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.476 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:53.476 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:53:53.477 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:53.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.477 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.477 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:53.477 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:53:53.477 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5700000000000001e-07 2024-04-25T22:53:53.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.477 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.477 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:53.477 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059575+0000", 2024-04-25T22:53:53.477 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0065991380000000001 2024-04-25T22:53:53.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.477 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.477 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:53.478 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059586+0000", 2024-04-25T22:53:53.478 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1438e-05 2024-04-25T22:53:53.478 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.478 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.478 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:53.478 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059592+0000", 2024-04-25T22:53:53.478 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2899999999999999e-06 2024-04-25T22:53:53.478 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.478 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.478 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:53.478 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059660+0000", 2024-04-25T22:53:53.479 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7980999999999998e-05 2024-04-25T22:53:53.479 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.479 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.479 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:53.479 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059757+0000", 2024-04-25T22:53:53.479 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6340000000000003e-05 2024-04-25T22:53:53.479 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.479 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.479 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:53.479 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.064487+0000", 2024-04-25T22:53:53.479 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004730621 2024-04-25T22:53:53.479 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.479 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.479 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:53.480 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.064538+0000", 2024-04-25T22:53:53.480 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0801999999999999e-05 2024-04-25T22:53:53.480 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.480 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.480 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:53.480 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.064622+0000", 2024-04-25T22:53:53.480 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3595000000000002e-05 2024-04-25T22:53:53.480 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:53.480 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:53.480 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:53.480 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.480 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.480 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:97 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-25T22:53:53.480 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:53:33.026298+0000", 2024-04-25T22:53:53.481 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 20.335114025999999, 2024-04-25T22:53:53.481 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015641848999999999, 2024-04-25T22:53:53.481 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:53.481 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:53.481 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:53.481 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:53.481 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.481 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:53.481 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026298+0000", 2024-04-25T22:53:53.481 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:53.481 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.481 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.482 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:53.482 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026298+0000", 2024-04-25T22:53:53.482 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:53.482 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.482 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.482 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:53.482 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026299+0000", 2024-04-25T22:53:53.482 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7299999999999996e-07 2024-04-25T22:53:53.482 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.482 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.482 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:53.482 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026464+0000", 2024-04-25T22:53:53.482 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016477700000000001 2024-04-25T22:53:53.483 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.483 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.483 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:53.483 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026472+0000", 2024-04-25T22:53:53.483 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1589999999999993e-06 2024-04-25T22:53:53.483 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.483 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.483 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:53.483 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026476+0000", 2024-04-25T22:53:53.483 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4580000000000003e-06 2024-04-25T22:53:53.483 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.483 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.483 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:53.483 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026550+0000", 2024-04-25T22:53:53.484 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3836000000000003e-05 2024-04-25T22:53:53.484 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.484 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.484 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:53.484 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026644+0000", 2024-04-25T22:53:53.484 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4022000000000002e-05 2024-04-25T22:53:53.484 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.484 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.484 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:53.484 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.041838+0000", 2024-04-25T22:53:53.484 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015193814999999999 2024-04-25T22:53:53.484 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.484 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.484 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:53.485 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.041874+0000", 2024-04-25T22:53:53.485 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5856999999999999e-05 2024-04-25T22:53:53.485 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:53.485 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:53.485 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:53.485 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.041940+0000", 2024-04-25T22:53:53.485 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6352000000000004e-05 2024-04-25T22:53:53.485 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:53.485 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:53.485 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:53.485 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:53.485 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:53.485 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:53.486 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-25T22:53:53.487 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:53.486+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:53.488 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:53.489 INFO:tasks.workunit.client.0.smithi052.stdout: [CC] holes 2024-04-25T22:53:53.510 INFO:tasks.workunit.client.0.smithi052.stdout: [CC] lstat64 2024-04-25T22:53:53.588 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:53.587+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:53.592 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:53.592 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:53.592 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-25T22:53:53.592 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:53.600 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:53.645 INFO:tasks.workunit.client.0.smithi052.stdout: [CC] nametest 2024-04-25T22:53:53.646 INFO:tasks.workunit.client.0.smithi052.stdout: [CC] permname 2024-04-25T22:53:53.689 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:53.688+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:53.704 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:53.704 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:53.704 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-25T22:53:53.704 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-25T22:53:53.704 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:53.713 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:53.789 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~70s 2024-04-25T22:53:53.790 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:53.789+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:53.816 INFO:tasks.workunit.client.0.smithi052.stdout: [CC] randholes 2024-04-25T22:53:53.837 INFO:tasks.workunit.client.0.smithi052.stdout: [CC] runas 2024-04-25T22:53:53.859 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:53.859 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:53:53.859 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:53:53.859 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:53:53.859 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.859 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:53:53.859 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:53.859 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 125.89006523899999, 2024-04-25T22:53:53.859 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:53:53.859 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:53.859 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:53.859 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:53.860 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:53.860 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.860 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:53.860 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:53.860 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:53.860 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.860 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.860 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:53.860 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:53.860 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:53.860 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.860 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.860 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:53.860 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:53:53.861 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:53:53.861 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.861 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.861 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:53.861 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:53:53.861 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:53:53.861 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.861 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.861 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:53.861 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:53:53.861 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:53:53.861 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.861 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.862 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:53.862 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:53:53.862 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:53:53.862 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.862 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.862 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:53.862 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:53:53.862 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:53:53.862 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.862 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.862 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:53.862 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:53:53.863 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:53:53.863 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.863 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.863 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:53.863 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:53:53.863 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:53:53.863 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.863 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.863 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:53.863 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:53:53.863 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:53:53.863 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.863 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:53.863 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.864 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.864 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.864 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:53.864 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:53.864 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 120.84556954, 2024-04-25T22:53:53.864 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:53:53.864 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:53.864 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:53.864 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:53.864 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:53.864 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.864 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:53.864 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:53.865 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:53.865 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.865 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.865 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:53.865 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:53.865 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:53.865 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.865 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.865 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:53.865 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:53:53.865 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:53:53.865 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.865 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.866 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:53.866 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:53:53.866 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:53:53.866 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.866 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.866 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:53.866 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:53:53.866 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:53:53.866 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.866 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.866 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:53.866 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:53:53.866 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:53:53.866 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.867 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.867 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:53.867 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:53:53.867 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:53:53.867 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.867 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.867 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:53.867 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:53:53.867 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:53:53.867 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.867 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.867 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:53.867 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:53:53.867 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:53:53.867 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.868 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.868 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:53.868 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:53:53.868 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:53:53.868 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.868 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.868 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:53.868 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:53:53.868 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:53:53.868 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.868 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.868 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:53.868 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:53:53.868 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:53:53.869 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.869 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.869 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:53.869 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:53:53.869 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:53:53.869 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.869 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:53.869 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.869 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.869 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.869 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:53.869 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:53.869 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 120.84489516399999, 2024-04-25T22:53:53.869 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:53:53.870 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:53.870 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:53.870 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:53.870 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:53.870 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.870 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:53.870 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:53.870 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:53.870 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.870 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.870 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:53.870 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:53.870 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:53.871 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.871 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.871 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:53.871 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:53:53.871 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:53:53.871 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.871 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.871 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:53.871 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:53:53.871 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:53:53.872 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.872 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.872 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:53.872 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:53:53.872 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:53:53.872 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.872 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.872 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:53.872 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:53:53.872 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:53:53.872 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.872 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.872 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:53.873 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:53:53.873 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:53:53.873 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.873 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.873 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:53.873 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:53:53.873 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:53:53.873 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.873 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.873 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:53.873 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:53:53.873 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:53:53.873 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.874 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.874 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:53.874 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:53:53.874 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:53:53.874 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.874 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.874 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:53.874 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:53:53.874 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:53:53.874 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.874 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.874 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:53.874 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:53:53.875 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:53:53.875 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.875 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.875 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:53.875 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:53:53.875 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:53:53.875 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.875 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:53.875 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.875 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.875 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.875 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:53.875 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:53.876 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 120.844385952, 2024-04-25T22:53:53.876 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:53:53.876 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:53.876 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:53.876 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:53.876 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:53.876 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.876 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:53.876 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:53.876 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:53.876 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.876 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.876 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:53.877 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:53.877 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:53.877 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.877 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.877 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:53.877 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:53:53.877 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:53:53.877 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.877 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.877 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:53.877 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:53:53.877 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:53:53.877 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.878 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.878 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:53.878 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:53:53.878 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:53:53.878 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.878 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.878 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:53.878 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:53:53.878 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:53:53.878 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.878 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.878 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:53.878 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:53:53.878 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:53:53.879 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.879 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.879 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:53.879 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:53:53.879 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:53:53.879 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.879 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.879 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:53.879 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:53:53.879 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:53:53.879 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.879 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.879 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:53.880 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:53:53.880 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:53:53.880 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.880 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.880 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:53.880 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:53:53.880 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:53:53.880 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.880 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.880 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:53.880 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:53:53.880 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:53:53.880 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.880 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.881 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:53.881 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:53:53.881 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:53:53.881 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.881 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:53.881 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.881 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.881 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.881 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:53.881 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:53.881 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 120.84397275400001, 2024-04-25T22:53:53.881 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:53:53.881 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:53.881 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:53.881 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:53.882 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:53.882 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.882 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:53.882 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:53.882 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:53.882 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.882 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.882 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:53.882 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:53.882 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:53.882 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.882 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.882 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:53.882 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:53.883 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:53:53.883 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.883 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.883 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:53.883 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:53.883 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:53:53.883 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.883 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.883 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:53.883 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:53:53.883 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:53:53.883 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.884 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.884 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:53.884 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:53:53.884 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:53:53.884 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.884 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.884 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:53.884 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:53:53.884 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:53:53.884 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.884 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.884 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:53.884 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:53:53.884 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:53:53.884 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.885 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.885 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:53.885 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:53:53.885 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:53:53.885 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.885 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.885 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:53.885 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:53:53.885 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:53:53.885 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.885 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.885 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:53.885 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:53:53.885 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:53:53.886 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.886 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.886 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:53.886 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:53:53.886 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:53:53.886 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.886 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.886 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:53.886 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:53:53.886 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:53:53.886 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.886 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:53.886 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.887 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.887 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.887 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:53.887 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:53.887 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 120.843922084, 2024-04-25T22:53:53.887 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:53:53.887 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:53.887 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:53.887 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:53.887 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:53.887 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.887 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:53.887 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:53.888 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:53.888 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.888 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.888 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:53.888 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:53.888 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:53.888 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.888 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.888 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:53.888 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:53:53.888 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:53:53.888 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.888 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.889 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:53.889 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:53:53.889 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:53:53.889 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.889 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.889 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:53.889 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:53:53.889 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:53:53.889 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.889 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.889 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:53.889 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:53:53.889 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:53:53.889 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.890 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.890 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:53.890 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:53:53.890 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:53:53.890 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.890 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.890 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:53.890 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:53:53.890 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:53:53.890 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.890 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.890 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:53.890 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:53:53.891 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:53:53.891 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.891 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.891 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:53.891 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:53:53.891 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:53:53.891 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.891 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.891 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:53.891 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:53:53.891 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:53:53.891 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.892 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.892 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:53.892 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:53:53.892 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:53:53.892 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.892 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.892 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:53.892 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:53:53.892 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:53:53.892 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.892 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.892 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:53.892 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:53:53.892 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:53:53.893 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.893 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.893 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:53.893 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:53:53.893 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:53:53.893 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.893 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:53.893 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.893 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.893 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.893 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:53.893 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:53.893 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 120.843885215, 2024-04-25T22:53:53.893 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:53:53.894 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:53.894 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:53.894 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:53.894 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:53.894 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.894 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:53.894 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:53.894 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:53.894 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.894 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.894 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:53.894 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:53.895 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:53.895 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.895 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.895 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:53.895 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:53:53.895 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:53:53.895 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.895 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.895 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:53.895 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:53:53.895 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:53:53.895 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.895 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.896 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:53.896 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:53:53.896 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:53:53.896 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.896 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.896 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:53.896 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:53:53.896 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:53:53.896 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.896 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.896 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:53.896 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:53:53.896 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:53:53.897 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.897 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.897 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:53:53.897 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:53:53.897 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:53:53.897 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.897 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.897 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:53.897 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:53:53.897 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:53:53.897 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.897 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.897 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:53.897 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:53:53.898 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:53:53.898 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.898 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.898 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:53.898 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:53:53.898 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:53:53.898 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.898 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.898 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:53.898 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:53:53.898 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:53:53.898 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.898 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.899 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:53.899 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:53:53.899 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:53:53.899 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.899 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.899 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:53.899 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:53:53.899 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:53:53.899 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.899 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.899 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:53.899 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:53:53.899 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:53:53.899 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.900 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:53.900 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.900 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.900 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.900 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:53.900 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:53.900 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 120.843860249, 2024-04-25T22:53:53.900 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:53:53.900 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:53.900 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:53.900 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:53.900 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:53.900 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.900 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:53.901 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:53.901 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:53.901 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.901 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.901 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:53.901 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:53.901 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:53.901 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.901 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.901 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:53.901 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:53:53.901 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:53:53.901 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.901 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.902 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:53.902 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:53:53.902 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:53:53.902 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.902 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.902 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:53.902 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:53.902 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:53:53.902 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.902 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.902 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:53.902 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:53:53.902 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:53:53.903 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.903 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.903 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:53.903 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:53:53.903 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:53:53.903 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.903 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.903 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:53.903 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:53:53.903 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:53:53.903 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.903 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.903 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:53.903 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:53:53.904 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:53:53.904 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.904 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.904 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:53.904 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:53:53.904 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:53:53.904 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.904 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.904 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:53.904 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:53:53.904 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:53:53.904 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.904 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.905 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:53.905 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:53:53.905 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:53:53.905 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.905 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.905 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:53.905 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:53:53.905 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:53:53.905 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.905 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:53.905 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.905 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.905 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.905 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:53.906 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:53.906 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 120.84382388500001, 2024-04-25T22:53:53.906 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:53:53.906 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:53.906 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:53.906 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:53.906 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:53.906 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.906 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:53.906 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:53.906 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:53.906 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.906 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.907 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:53.907 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:53.907 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:53.907 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.907 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.907 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:53.907 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:53:53.907 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:53:53.907 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.907 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.907 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:53.907 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:53:53.907 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:53:53.908 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.908 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.908 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:53.908 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:53:53.908 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:53:53.908 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.908 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.908 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:53.908 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:53:53.908 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:53:53.908 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.908 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.908 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:53.908 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:53:53.909 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:53:53.909 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.909 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.909 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:53.909 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:53:53.909 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:53:53.909 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.909 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.909 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:53.909 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:53:53.909 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:53:53.909 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.909 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.909 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:53.910 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:53:53.910 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:53:53.910 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.910 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.910 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:53.910 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:53:53.910 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:53:53.910 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.910 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:53.910 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.910 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.910 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.910 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:53.910 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:53.911 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 120.843792804, 2024-04-25T22:53:53.911 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:53:53.911 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:53.911 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:53.911 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:53.911 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:53.911 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.911 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:53.911 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:53.911 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:53.911 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.911 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.911 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:53.911 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:53.911 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:53.912 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.912 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.912 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:53.912 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:53.912 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:53.912 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.912 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.912 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:53.912 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:53:53.912 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:53:53.912 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.912 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.912 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:53.912 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:53:53.912 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:53:53.912 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.913 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.913 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:53.913 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:53:53.913 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:53:53.913 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.913 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.913 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:53.913 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:53:53.913 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:53:53.913 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.913 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.913 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:53.913 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:53:53.913 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:53:53.914 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.914 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.914 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:53.914 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:53:53.914 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:53:53.914 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.914 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:53.914 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.914 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.914 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.914 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:30 4.31 4:8ebfc112:::1000000021d.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-25T22:53:53.914 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:53:53.914 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 22.804106934, 2024-04-25T22:53:53.914 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015003005, 2024-04-25T22:53:53.915 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:53.915 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:53.915 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:53.915 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:53.915 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:53.915 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:53.915 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 30 2024-04-25T22:53:53.915 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.915 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:53.915 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.915 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:53.915 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:53:53.915 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:53.915 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.916 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.916 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:53.916 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:53:53.916 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:53.916 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.916 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.916 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:53.916 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053133+0000", 2024-04-25T22:53:53.916 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0370000000000001e-06 2024-04-25T22:53:53.916 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.916 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.916 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:53.916 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060377+0000", 2024-04-25T22:53:53.917 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0072431070000000004 2024-04-25T22:53:53.917 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.917 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.917 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:53.917 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060388+0000", 2024-04-25T22:53:53.917 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1285e-05 2024-04-25T22:53:53.917 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.917 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.917 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:53.917 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060394+0000", 2024-04-25T22:53:53.917 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1040000000000003e-06 2024-04-25T22:53:53.918 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.918 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.918 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:53.918 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060483+0000", 2024-04-25T22:53:53.918 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.9345000000000006e-05 2024-04-25T22:53:53.918 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.918 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.918 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:53.918 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060566+0000", 2024-04-25T22:53:53.918 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2237999999999994e-05 2024-04-25T22:53:53.918 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.918 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.918 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:53.918 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068057+0000", 2024-04-25T22:53:53.919 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074912210000000002 2024-04-25T22:53:53.919 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.919 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.919 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:53.919 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068090+0000", 2024-04-25T22:53:53.919 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3501000000000003e-05 2024-04-25T22:53:53.919 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.919 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.919 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:53.919 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068134+0000", 2024-04-25T22:53:53.919 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4166999999999999e-05 2024-04-25T22:53:53.919 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.919 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:53.920 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.920 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.920 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.920 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:66 4.27 4:e5671758:::1000000024f.00000000:head [write 0~6641] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:53.920 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:53.920 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 22.543996598, 2024-04-25T22:53:53.920 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075166540000000002, 2024-04-25T22:53:53.920 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:53.920 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:53.920 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:53.920 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:53.920 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:53.920 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:53.920 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 66 2024-04-25T22:53:53.921 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.921 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:53.921 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.921 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:53.921 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:53.921 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:53.921 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.921 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.921 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:53.921 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:53.921 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:53.921 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.921 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.921 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:53.921 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:53.922 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4099999999999998e-07 2024-04-25T22:53:53.922 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.922 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.922 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:53.922 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313252+0000", 2024-04-25T22:53:53.922 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5380000000000008e-06 2024-04-25T22:53:53.922 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.922 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.922 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:53.922 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313260+0000", 2024-04-25T22:53:53.922 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2609999999999993e-06 2024-04-25T22:53:53.922 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.922 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.923 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:53.923 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313265+0000", 2024-04-25T22:53:53.923 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4850000000000003e-06 2024-04-25T22:53:53.923 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.923 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.923 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:53.923 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313310+0000", 2024-04-25T22:53:53.923 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5247999999999998e-05 2024-04-25T22:53:53.923 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.923 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.923 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:53.923 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313370+0000", 2024-04-25T22:53:53.923 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0275000000000001e-05 2024-04-25T22:53:53.923 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.924 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.924 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:53.924 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313435+0000", 2024-04-25T22:53:53.924 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4647000000000006e-05 2024-04-25T22:53:53.924 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.924 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.924 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:53.924 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314174+0000", 2024-04-25T22:53:53.924 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00073925 2024-04-25T22:53:53.924 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.924 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.924 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:53.924 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320688+0000", 2024-04-25T22:53:53.924 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.006513418 2024-04-25T22:53:53.925 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.925 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.925 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:53.925 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320736+0000", 2024-04-25T22:53:53.925 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.8114e-05 2024-04-25T22:53:53.925 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.925 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.925 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:53.925 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320758+0000", 2024-04-25T22:53:53.925 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2776999999999999e-05 2024-04-25T22:53:53.925 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.925 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:53.925 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.925 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.925 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.925 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:68 4.31 4:8fb7f7b7:::10000000251.00000000:head [write 0~2067] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:53.926 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:53.926 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 22.542310820000001, 2024-04-25T22:53:53.926 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0087011669999999992, 2024-04-25T22:53:53.926 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:53.926 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:53.926 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:53.926 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:53.926 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:53.926 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:53.926 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 68 2024-04-25T22:53:53.926 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.926 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:53.926 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.926 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:53.927 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:53.927 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:53.927 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.927 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.927 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:53.927 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:53.927 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:53.927 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.927 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.927 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:53.927 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:53.927 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:53:53.927 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.927 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.929 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:53.929 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314933+0000", 2024-04-25T22:53:53.929 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5430000000000004e-06 2024-04-25T22:53:53.929 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.929 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.929 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:53.929 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314944+0000", 2024-04-25T22:53:53.930 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.076e-05 2024-04-25T22:53:53.930 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.930 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.930 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:53.930 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314949+0000", 2024-04-25T22:53:53.930 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1019999999999996e-06 2024-04-25T22:53:53.930 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.930 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.930 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:53.930 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314996+0000", 2024-04-25T22:53:53.930 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7018999999999998e-05 2024-04-25T22:53:53.930 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.930 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.931 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:53.931 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315064+0000", 2024-04-25T22:53:53.931 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8738000000000005e-05 2024-04-25T22:53:53.931 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.931 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.931 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:53.931 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323531+0000", 2024-04-25T22:53:53.931 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084664739999999999 2024-04-25T22:53:53.931 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.931 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.931 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:53.931 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323574+0000", 2024-04-25T22:53:53.931 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3449999999999999e-05 2024-04-25T22:53:53.932 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.932 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.932 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:53.932 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323629+0000", 2024-04-25T22:53:53.932 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4296999999999999e-05 2024-04-25T22:53:53.932 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.932 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:53.932 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.932 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.932 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.932 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4734.0:69 4.32 e46/13 4:4e8c6251:::10000000252.00000000:head v 46'1, mlcod=0'0)", 2024-04-25T22:53:53.932 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:53.932 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 22.541279551999999, 2024-04-25T22:53:53.932 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076063240000000002, 2024-04-25T22:53:53.933 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:53.933 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:53.933 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:53.933 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:53.933 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.933 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:53.933 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:53.933 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:53.933 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.933 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.933 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:53.933 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:53.934 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:53.934 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.934 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.934 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:53.934 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:53.934 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3099999999999997e-07 2024-04-25T22:53:53.934 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.934 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.934 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:53.934 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315964+0000", 2024-04-25T22:53:53.935 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3229999999999999e-06 2024-04-25T22:53:53.935 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.935 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.935 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:53.936 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315973+0000", 2024-04-25T22:53:53.936 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7249999999999992e-06 2024-04-25T22:53:53.936 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.936 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.936 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:53.936 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315978+0000", 2024-04-25T22:53:53.936 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4830000000000001e-06 2024-04-25T22:53:53.936 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.936 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.936 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:53.936 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.316043+0000", 2024-04-25T22:53:53.936 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.5036000000000005e-05 2024-04-25T22:53:53.936 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.936 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.937 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:53.937 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.316055+0000", 2024-04-25T22:53:53.937 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1973999999999999e-05 2024-04-25T22:53:53.937 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.937 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.937 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:53.937 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323521+0000", 2024-04-25T22:53:53.937 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074660239999999999 2024-04-25T22:53:53.937 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.937 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.937 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:53.937 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323565+0000", 2024-04-25T22:53:53.937 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4128000000000002e-05 2024-04-25T22:53:53.937 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.937 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:53.938 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.938 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.938 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.938 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:72 4.36 4:6cdfec98:::10000000255.00000000:head [write 0~4131] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:53.938 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:53.938 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 22.539235640000001, 2024-04-25T22:53:53.938 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084820680000000006, 2024-04-25T22:53:53.938 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:53.938 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:53.938 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:53.938 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:53.938 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:53.938 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:53.939 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 72 2024-04-25T22:53:53.939 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.939 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:53.939 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.939 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:53.939 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:53.939 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:53.939 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.939 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.939 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:53.939 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:53.939 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:53.939 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.940 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.940 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:53.940 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:53.940 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1800000000000005e-07 2024-04-25T22:53:53.940 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.940 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.940 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:53.940 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318010+0000", 2024-04-25T22:53:53.940 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7399999999999998e-06 2024-04-25T22:53:53.940 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.940 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.940 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:53.940 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318019+0000", 2024-04-25T22:53:53.940 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0170000000000002e-06 2024-04-25T22:53:53.940 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.941 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.941 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:53.941 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318024+0000", 2024-04-25T22:53:53.941 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0150000000000003e-06 2024-04-25T22:53:53.941 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.941 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.941 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:53.941 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318075+0000", 2024-04-25T22:53:53.941 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0537000000000001e-05 2024-04-25T22:53:53.941 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.941 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.941 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:53.941 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318144+0000", 2024-04-25T22:53:53.941 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9432999999999997e-05 2024-04-25T22:53:53.941 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.942 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.942 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:53.942 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326392+0000", 2024-04-25T22:53:53.942 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0082482979999999994 2024-04-25T22:53:53.942 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.942 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.942 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:53.942 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326432+0000", 2024-04-25T22:53:53.942 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9870000000000003e-05 2024-04-25T22:53:53.942 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.942 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.942 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:53.942 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326485+0000", 2024-04-25T22:53:53.942 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2439999999999999e-05 2024-04-25T22:53:53.943 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.943 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:53.943 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.943 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.943 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.943 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:74 4.10 4:08e6f8ca:::10000000257.00000000:head [write 0~839] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:53.943 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:53:53.943 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 22.537761912000001, 2024-04-25T22:53:53.943 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070370720000000001, 2024-04-25T22:53:53.943 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:53.943 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:53.943 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:53.943 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:53.944 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:53.944 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:53.944 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 74 2024-04-25T22:53:53.944 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.944 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:53.944 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.944 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:53.944 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:53:53.944 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:53.944 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.944 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.944 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:53.944 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:53:53.944 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:53.945 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.945 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.945 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:53.945 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319477+0000", 2024-04-25T22:53:53.945 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1999999999999999e-07 2024-04-25T22:53:53.945 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.945 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.945 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:53.945 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319483+0000", 2024-04-25T22:53:53.945 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4260000000000002e-06 2024-04-25T22:53:53.945 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.945 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.945 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:53.945 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319494+0000", 2024-04-25T22:53:53.945 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.094e-05 2024-04-25T22:53:53.946 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.946 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.946 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:53.946 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319499+0000", 2024-04-25T22:53:53.946 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3789999999999997e-06 2024-04-25T22:53:53.946 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.946 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.946 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:53.946 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319545+0000", 2024-04-25T22:53:53.946 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6149000000000001e-05 2024-04-25T22:53:53.946 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.946 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.946 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:53.947 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319617+0000", 2024-04-25T22:53:53.947 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1792999999999995e-05 2024-04-25T22:53:53.947 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.947 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.947 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:53.947 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326406+0000", 2024-04-25T22:53:53.947 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067895999999999998 2024-04-25T22:53:53.947 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.947 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.947 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:53.947 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326443+0000", 2024-04-25T22:53:53.947 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6828e-05 2024-04-25T22:53:53.947 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.947 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.947 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:53.948 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326514+0000", 2024-04-25T22:53:53.948 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0236999999999999e-05 2024-04-25T22:53:53.948 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.948 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:53.948 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.948 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.948 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.948 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:128 3.1f 3:f83d65d8:::200.00000004:head [write 876784~3317520 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e48)", 2024-04-25T22:53:53.948 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:36.985410+0000", 2024-04-25T22:53:53.948 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 16.871828294, 2024-04-25T22:53:53.948 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0090177360000000002, 2024-04-25T22:53:53.948 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:53.948 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:53.948 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:53.949 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:53.949 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.949 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:53.949 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.985410+0000", 2024-04-25T22:53:53.949 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:53.949 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.949 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.949 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:53.949 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.985410+0000", 2024-04-25T22:53:53.949 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:53.949 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.949 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.949 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:53.949 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.985411+0000", 2024-04-25T22:53:53.950 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8400000000000003e-07 2024-04-25T22:53:53.950 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.950 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.950 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:53.950 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989116+0000", 2024-04-25T22:53:53.950 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037047389999999999 2024-04-25T22:53:53.950 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.950 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.950 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:53.950 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989128+0000", 2024-04-25T22:53:53.950 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1977999999999999e-05 2024-04-25T22:53:53.950 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.950 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.950 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:53.951 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989135+0000", 2024-04-25T22:53:53.951 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5290000000000003e-06 2024-04-25T22:53:53.951 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.951 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.951 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:53.951 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989181+0000", 2024-04-25T22:53:53.951 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6122999999999999e-05 2024-04-25T22:53:53.951 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.951 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.951 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:53.951 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989250+0000", 2024-04-25T22:53:53.951 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8535999999999996e-05 2024-04-25T22:53:53.951 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.951 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.952 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:53.952 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.994272+0000", 2024-04-25T22:53:53.952 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050224889999999998 2024-04-25T22:53:53.952 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.952 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.952 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:53.952 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.994335+0000", 2024-04-25T22:53:53.952 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2588000000000005e-05 2024-04-25T22:53:53.952 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.952 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.952 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:53.952 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.994428+0000", 2024-04-25T22:53:53.952 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2869999999999997e-05 2024-04-25T22:53:53.952 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.952 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:53.953 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.953 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.953 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.953 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:2150 4.22 4:47cffac6:::10000000a2b.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T22:53:53.953 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:41.078233+0000", 2024-04-25T22:53:53.953 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 12.779004984, 2024-04-25T22:53:53.953 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069201510000000003, 2024-04-25T22:53:53.953 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:53.953 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:53.953 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:53.953 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:53.953 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.953 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:53.954 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078233+0000", 2024-04-25T22:53:53.954 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:53.954 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.954 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.954 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:53.954 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078233+0000", 2024-04-25T22:53:53.954 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:53.954 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.954 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.954 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:53.955 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078234+0000", 2024-04-25T22:53:53.955 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1699999999999998e-07 2024-04-25T22:53:53.955 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.955 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.955 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:53.955 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078236+0000", 2024-04-25T22:53:53.955 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.875e-06 2024-04-25T22:53:53.955 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.955 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.955 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:53.955 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078242+0000", 2024-04-25T22:53:53.955 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2450000000000003e-06 2024-04-25T22:53:53.955 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.955 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.956 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:53.956 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078247+0000", 2024-04-25T22:53:53.956 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7450000000000003e-06 2024-04-25T22:53:53.956 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.956 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.956 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:53.956 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078641+0000", 2024-04-25T22:53:53.956 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00039420200000000002 2024-04-25T22:53:53.956 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.956 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.956 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:53.956 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078840+0000", 2024-04-25T22:53:53.956 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000199063 2024-04-25T22:53:53.956 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.957 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.957 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:53.957 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078919+0000", 2024-04-25T22:53:53.957 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9182000000000002e-05 2024-04-25T22:53:53.957 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.957 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.957 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:53.957 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.080906+0000", 2024-04-25T22:53:53.957 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0019866390000000001 2024-04-25T22:53:53.957 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.957 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.957 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:53.957 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085074+0000", 2024-04-25T22:53:53.958 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0041683639999999999 2024-04-25T22:53:53.958 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.958 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.958 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:53.958 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085117+0000", 2024-04-25T22:53:53.958 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2849999999999998e-05 2024-04-25T22:53:53.958 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.958 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.958 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:53.958 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085154+0000", 2024-04-25T22:53:53.958 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6468999999999999e-05 2024-04-25T22:53:53.958 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.958 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:53.959 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.959 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.959 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.959 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:2160 4.2a 4:57f9ed86:::10000000a3d.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T22:53:53.959 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:53:53.959 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 12.778535694, 2024-04-25T22:53:53.959 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0068959959999999997, 2024-04-25T22:53:53.959 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:53.959 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:53.959 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:53.959 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:53.959 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.959 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:53.960 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:53:53.960 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:53.960 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.960 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.960 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:53.960 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:53:53.960 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:53.960 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.960 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.960 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:53.960 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:53:53.960 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7000000000000004e-07 2024-04-25T22:53:53.961 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.961 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.961 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:53.961 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078707+0000", 2024-04-25T22:53:53.961 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.783e-06 2024-04-25T22:53:53.961 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.961 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.961 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:53.961 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078716+0000", 2024-04-25T22:53:53.961 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4800000000000001e-06 2024-04-25T22:53:53.961 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.962 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.962 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:53.962 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078724+0000", 2024-04-25T22:53:53.962 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1519999999999992e-06 2024-04-25T22:53:53.962 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.962 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.962 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:53.962 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078794+0000", 2024-04-25T22:53:53.962 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0500999999999995e-05 2024-04-25T22:53:53.962 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.962 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.962 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:53.962 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078912+0000", 2024-04-25T22:53:53.963 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000117439 2024-04-25T22:53:53.963 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.963 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.963 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:53.963 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079000+0000", 2024-04-25T22:53:53.963 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8092999999999998e-05 2024-04-25T22:53:53.963 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.963 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.963 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:53.963 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.080897+0000", 2024-04-25T22:53:53.963 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0018970899999999999 2024-04-25T22:53:53.963 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.963 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.963 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:53.964 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085517+0000", 2024-04-25T22:53:53.964 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0046198929999999999 2024-04-25T22:53:53.964 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.964 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.964 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:53.964 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085565+0000", 2024-04-25T22:53:53.964 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7777e-05 2024-04-25T22:53:53.964 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.964 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.964 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:53.964 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085599+0000", 2024-04-25T22:53:53.964 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4017999999999999e-05 2024-04-25T22:53:53.964 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.964 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:53.965 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.965 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.965 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.965 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:2163 4.2a 4:549f79e3:::10000000a43.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T22:53:53.965 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:53:53.965 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 12.778502340999999, 2024-04-25T22:53:53.965 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069469190000000002, 2024-04-25T22:53:53.965 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:53.965 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:53.965 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:53.965 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:53.965 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.965 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:53.966 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:53:53.966 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:53.966 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.966 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.966 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:53.966 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:53:53.966 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:53.966 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.966 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.966 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:53.966 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:53:53.966 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1399999999999997e-07 2024-04-25T22:53:53.966 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.967 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.967 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:53.967 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078739+0000", 2024-04-25T22:53:53.967 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2960000000000001e-06 2024-04-25T22:53:53.967 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.967 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.967 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:53.967 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078745+0000", 2024-04-25T22:53:53.967 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3439999999999997e-06 2024-04-25T22:53:53.967 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.967 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.967 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:53.967 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078750+0000", 2024-04-25T22:53:53.967 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3179999999999997e-06 2024-04-25T22:53:53.968 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.968 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.968 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:53.968 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079224+0000", 2024-04-25T22:53:53.968 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00047334999999999999 2024-04-25T22:53:53.968 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.968 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.968 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:53.968 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079292+0000", 2024-04-25T22:53:53.968 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8708999999999996e-05 2024-04-25T22:53:53.968 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.968 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.968 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:53.968 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079342+0000", 2024-04-25T22:53:53.969 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9299999999999999e-05 2024-04-25T22:53:53.969 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.969 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.969 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:53.969 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.081611+0000", 2024-04-25T22:53:53.969 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0022695229999999999 2024-04-25T22:53:53.969 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.969 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.969 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:53.969 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085605+0000", 2024-04-25T22:53:53.969 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0039933679999999997 2024-04-25T22:53:53.969 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.969 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.970 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:53.970 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085650+0000", 2024-04-25T22:53:53.970 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5111000000000002e-05 2024-04-25T22:53:53.970 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:53.970 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:53.970 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:53.970 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085683+0000", 2024-04-25T22:53:53.970 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3185999999999997e-05 2024-04-25T22:53:53.970 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.970 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:53.970 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.970 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:53.970 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:53.971 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:53.972 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:53.971+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:53.972 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:53.985 INFO:tasks.workunit.client.0.smithi052.stdout: [CC] truncfile 2024-04-25T22:53:54.048 INFO:tasks.workunit.client.0.smithi052.stdout: [CC] usemem 2024-04-25T22:53:54.072 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:54.072+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:54.081 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:54.081 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:54.081 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-04-25T22:53:54.081 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:54.090 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:54.117 INFO:tasks.workunit.client.0.smithi052.stdout: [CC] mmapcat 2024-04-25T22:53:54.174 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:54.173+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:54.191 INFO:tasks.workunit.client.0.smithi052.stdout: [CC] append_reader 2024-04-25T22:53:54.193 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:54.193 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:54.193 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:53:54.193 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:53:54.193 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:54.202 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:54.271 INFO:tasks.workunit.client.0.smithi052.stdout: [CC] append_writer 2024-04-25T22:53:54.274 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:54.273+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:54.274 INFO:tasks.workunit.client.0.smithi052.stdout: [CC] dirperf 2024-04-25T22:53:54.306 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:54.306 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-04-25T22:53:54.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-04-25T22:53:54.307 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:53:54.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.307 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:54.307 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:54.307 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 126.339632112, 2024-04-25T22:53:54.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010384338999999999, 2024-04-25T22:53:54.307 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:54.307 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:54.307 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:54.307 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:54.307 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:54.307 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:54.307 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-04-25T22:53:54.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.308 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:54.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:54.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:54.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:54.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:54.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:54.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:54.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:54.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:54.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3600000000000004e-07 2024-04-25T22:53:54.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:54.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965185+0000", 2024-04-25T22:53:54.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.117e-06 2024-04-25T22:53:54.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:54.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965192+0000", 2024-04-25T22:53:54.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3239999999999997e-06 2024-04-25T22:53:54.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:54.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965198+0000", 2024-04-25T22:53:54.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6370000000000004e-06 2024-04-25T22:53:54.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:54.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970973+0000", 2024-04-25T22:53:54.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057748239999999996 2024-04-25T22:53:54.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:54.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971049+0000", 2024-04-25T22:53:54.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6029e-05 2024-04-25T22:53:54.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:54.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971174+0000", 2024-04-25T22:53:54.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012462399999999999 2024-04-25T22:53:54.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:54.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971553+0000", 2024-04-25T22:53:54.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037896499999999999 2024-04-25T22:53:54.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:54.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975482+0000", 2024-04-25T22:53:54.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039297459999999996 2024-04-25T22:53:54.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:54.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975529+0000", 2024-04-25T22:53:54.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6387000000000002e-05 2024-04-25T22:53:54.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:54.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975563+0000", 2024-04-25T22:53:54.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4150000000000003e-05 2024-04-25T22:53:54.312 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:54.312 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:54.312 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:54.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.313 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:54.313 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:54.313 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.292585789, 2024-04-25T22:53:54.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012637705000000001, 2024-04-25T22:53:54.313 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:54.313 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:54.313 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:54.313 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:54.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:54.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:54.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:54.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:54.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:54.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:54.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:54.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012227+0000", 2024-04-25T22:53:54.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.863e-06 2024-04-25T22:53:54.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:54.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012236+0000", 2024-04-25T22:53:54.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1109999999999997e-06 2024-04-25T22:53:54.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:54.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012309+0000", 2024-04-25T22:53:54.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3242000000000001e-05 2024-04-25T22:53:54.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:54.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012324+0000", 2024-04-25T22:53:54.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4837e-05 2024-04-25T22:53:54.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:54.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015060+0000", 2024-04-25T22:53:54.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027363349999999999 2024-04-25T22:53:54.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:54.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015169+0000", 2024-04-25T22:53:54.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108372 2024-04-25T22:53:54.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:54.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015498+0000", 2024-04-25T22:53:54.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032949999999999999 2024-04-25T22:53:54.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:54.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021282+0000", 2024-04-25T22:53:54.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057836429999999998 2024-04-25T22:53:54.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:54.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024709+0000", 2024-04-25T22:53:54.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034271979999999998 2024-04-25T22:53:54.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:54.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024802+0000", 2024-04-25T22:53:54.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2960000000000004e-05 2024-04-25T22:53:54.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:54.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024863+0000", 2024-04-25T22:53:54.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0643999999999997e-05 2024-04-25T22:53:54.319 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:54.319 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:54.319 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:54.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.319 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:54.319 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:54.320 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.29246201799999, 2024-04-25T22:53:54.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012979447999999999, 2024-04-25T22:53:54.320 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:54.320 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:54.320 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:54.320 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:54.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:54.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:54.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:54.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:54.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:54.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:54.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:54.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:54.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:53:54.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:54.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012354+0000", 2024-04-25T22:53:54.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7740000000000004e-06 2024-04-25T22:53:54.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:54.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012365+0000", 2024-04-25T22:53:54.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.064e-05 2024-04-25T22:53:54.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:54.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012382+0000", 2024-04-25T22:53:54.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6999000000000001e-05 2024-04-25T22:53:54.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:54.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015958+0000", 2024-04-25T22:53:54.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035765699999999998 2024-04-25T22:53:54.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:54.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016037+0000", 2024-04-25T22:53:54.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8242000000000001e-05 2024-04-25T22:53:54.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:54.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016404+0000", 2024-04-25T22:53:54.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036784300000000002 2024-04-25T22:53:54.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:54.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021294+0000", 2024-04-25T22:53:54.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048890629999999999 2024-04-25T22:53:54.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:54.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024959+0000", 2024-04-25T22:53:54.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036651570000000001 2024-04-25T22:53:54.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:54.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025097+0000", 2024-04-25T22:53:54.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013788099999999999 2024-04-25T22:53:54.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:54.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025328+0000", 2024-04-25T22:53:54.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231492 2024-04-25T22:53:54.325 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:54.325 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:54.325 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:54.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.325 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:54.325 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:54.325 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.29237424900001, 2024-04-25T22:53:54.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013049827, 2024-04-25T22:53:54.325 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:54.325 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:54.325 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:54.325 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:54.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:54.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:54.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:54.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:54.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:54.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:54.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:54.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012437+0000", 2024-04-25T22:53:54.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-04-25T22:53:54.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:54.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012440+0000", 2024-04-25T22:53:54.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7609999999999999e-06 2024-04-25T22:53:54.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:54.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012449+0000", 2024-04-25T22:53:54.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.285e-06 2024-04-25T22:53:54.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:54.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012457+0000", 2024-04-25T22:53:54.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9510000000000006e-06 2024-04-25T22:53:54.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:54.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017106+0000", 2024-04-25T22:53:54.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046494220000000003 2024-04-25T22:53:54.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:54.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017223+0000", 2024-04-25T22:53:54.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116824 2024-04-25T22:53:54.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:54.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017345+0000", 2024-04-25T22:53:54.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122175 2024-04-25T22:53:54.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:54.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021299+0000", 2024-04-25T22:53:54.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039534879999999998 2024-04-25T22:53:54.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:54.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025398+0000", 2024-04-25T22:53:54.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040988960000000003 2024-04-25T22:53:54.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:54.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025439+0000", 2024-04-25T22:53:54.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0915999999999999e-05 2024-04-25T22:53:54.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:54.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025486+0000", 2024-04-25T22:53:54.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7534999999999998e-05 2024-04-25T22:53:54.331 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:54.331 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:54.331 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:54.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.331 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:54.332 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:54.332 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.292344098, 2024-04-25T22:53:54.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020988041999999998, 2024-04-25T22:53:54.332 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:54.332 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:54.332 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:54.332 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:54.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:54.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:54.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:54.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:54.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:54.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:54.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:54.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:54.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.99e-07 2024-04-25T22:53:54.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:54.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012470+0000", 2024-04-25T22:53:54.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2789999999999999e-06 2024-04-25T22:53:54.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:54.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012477+0000", 2024-04-25T22:53:54.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:53:54.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:54.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012500+0000", 2024-04-25T22:53:54.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2490999999999999e-05 2024-04-25T22:53:54.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:54.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021911+0000", 2024-04-25T22:53:54.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094114160000000006 2024-04-25T22:53:54.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:54.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022000+0000", 2024-04-25T22:53:54.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8601000000000001e-05 2024-04-25T22:53:54.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:54.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022359+0000", 2024-04-25T22:53:54.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035921999999999999 2024-04-25T22:53:54.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:54.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025541+0000", 2024-04-25T22:53:54.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031820619999999998 2024-04-25T22:53:54.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:54.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033375+0000", 2024-04-25T22:53:54.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078338379999999992 2024-04-25T22:53:54.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:54.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033415+0000", 2024-04-25T22:53:54.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9527000000000003e-05 2024-04-25T22:53:54.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:54.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033455+0000", 2024-04-25T22:53:54.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9932000000000003e-05 2024-04-25T22:53:54.337 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:54.337 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:54.337 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:54.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.337 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:54.337 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:54.337 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.29228890500001, 2024-04-25T22:53:54.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021043857999999999, 2024-04-25T22:53:54.337 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:54.337 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:54.337 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:54.338 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:54.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:54.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:54.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:54.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:54.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:54.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:54.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:54.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012523+0000", 2024-04-25T22:53:54.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.361e-06 2024-04-25T22:53:54.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:54.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012530+0000", 2024-04-25T22:53:54.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5440000000000004e-06 2024-04-25T22:53:54.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:54.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012541+0000", 2024-04-25T22:53:54.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1745e-05 2024-04-25T22:53:54.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:54.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012551+0000", 2024-04-25T22:53:54.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5789999999999993e-06 2024-04-25T22:53:54.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:54.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022709+0000", 2024-04-25T22:53:54.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010157685 2024-04-25T22:53:54.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:54.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022957+0000", 2024-04-25T22:53:54.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024824599999999998 2024-04-25T22:53:54.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:54.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023443+0000", 2024-04-25T22:53:54.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048578599999999999 2024-04-25T22:53:54.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:54.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025547+0000", 2024-04-25T22:53:54.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021044789999999998 2024-04-25T22:53:54.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:54.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033509+0000", 2024-04-25T22:53:54.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0079622180000000001 2024-04-25T22:53:54.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:54.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033542+0000", 2024-04-25T22:53:54.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3018000000000001e-05 2024-04-25T22:53:54.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:54.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033566+0000", 2024-04-25T22:53:54.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3197000000000002e-05 2024-04-25T22:53:54.342 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:54.342 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:54.343 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:54.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.343 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:54.343 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:54.343 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.29224893999999, 2024-04-25T22:53:54.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021122696, 2024-04-25T22:53:54.343 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:54.343 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:54.343 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:54.343 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:54.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:54.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:54.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:54.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:54.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:54.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:54.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:54.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:54.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:53:54.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:54.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012566+0000", 2024-04-25T22:53:54.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-04-25T22:53:54.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:54.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012619+0000", 2024-04-25T22:53:54.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2607e-05 2024-04-25T22:53:54.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:54.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012628+0000", 2024-04-25T22:53:54.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6500000000000008e-06 2024-04-25T22:53:54.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:54.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024024+0000", 2024-04-25T22:53:54.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011396007999999999 2024-04-25T22:53:54.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:54.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024198+0000", 2024-04-25T22:53:54.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000173215 2024-04-25T22:53:54.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:54.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024447+0000", 2024-04-25T22:53:54.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024898500000000002 2024-04-25T22:53:54.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:54.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026431+0000", 2024-04-25T22:53:54.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001984923 2024-04-25T22:53:54.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:54.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033608+0000", 2024-04-25T22:53:54.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071768459999999997 2024-04-25T22:53:54.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:54.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033646+0000", 2024-04-25T22:53:54.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299000000000003e-05 2024-04-25T22:53:54.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:54.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033684+0000", 2024-04-25T22:53:54.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8773000000000003e-05 2024-04-25T22:53:54.348 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:54.348 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:54.348 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:54.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.348 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:54.349 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:54.349 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.292160341, 2024-04-25T22:53:54.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021175381, 2024-04-25T22:53:54.349 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:54.349 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:54.349 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:54.349 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:54.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:54.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:54.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:54.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:54.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:54.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:54.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:54.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012651+0000", 2024-04-25T22:53:54.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:53:54.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:54.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012656+0000", 2024-04-25T22:53:54.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8899999999999998e-06 2024-04-25T22:53:54.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:54.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012666+0000", 2024-04-25T22:53:54.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0346999999999999e-05 2024-04-25T22:53:54.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:54.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012675+0000", 2024-04-25T22:53:54.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9930000000000001e-06 2024-04-25T22:53:54.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:54.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025661+0000", 2024-04-25T22:53:54.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01298531 2024-04-25T22:53:54.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:54.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025757+0000", 2024-04-25T22:53:54.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5822000000000005e-05 2024-04-25T22:53:54.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:54.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025907+0000", 2024-04-25T22:53:54.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015051499999999999 2024-04-25T22:53:54.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:54.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026435+0000", 2024-04-25T22:53:54.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052762200000000005 2024-04-25T22:53:54.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:54.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033732+0000", 2024-04-25T22:53:54.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072978419999999997 2024-04-25T22:53:54.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:54.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033787+0000", 2024-04-25T22:53:54.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4703999999999997e-05 2024-04-25T22:53:54.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:54.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033826+0000", 2024-04-25T22:53:54.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8458999999999999e-05 2024-04-25T22:53:54.354 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:54.354 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:54.354 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:54.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.354 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:54.354 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:54.354 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.292104927, 2024-04-25T22:53:54.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021244174000000001, 2024-04-25T22:53:54.354 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:54.354 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:54.355 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:54.355 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:54.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:54.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:54.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:54.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:54.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:54.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:54.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:54.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:54.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:54.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:54.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012712+0000", 2024-04-25T22:53:54.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.913e-06 2024-04-25T22:53:54.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:54.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012722+0000", 2024-04-25T22:53:54.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2879999999999998e-06 2024-04-25T22:53:54.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:54.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012727+0000", 2024-04-25T22:53:54.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8429999999999998e-06 2024-04-25T22:53:54.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:54.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026099+0000", 2024-04-25T22:53:54.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013371450999999999 2024-04-25T22:53:54.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:54.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026147+0000", 2024-04-25T22:53:54.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7837999999999998e-05 2024-04-25T22:53:54.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:54.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026254+0000", 2024-04-25T22:53:54.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107314 2024-04-25T22:53:54.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:54.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026686+0000", 2024-04-25T22:53:54.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000432428 2024-04-25T22:53:54.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:54.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033873+0000", 2024-04-25T22:53:54.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071864399999999997 2024-04-25T22:53:54.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:54.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033904+0000", 2024-04-25T22:53:54.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1321e-05 2024-04-25T22:53:54.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:54.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033950+0000", 2024-04-25T22:53:54.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5707999999999997e-05 2024-04-25T22:53:54.359 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:54.359 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:54.359 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:54.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.360 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:54.360 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:54.360 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.29207454199999, 2024-04-25T22:53:54.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01096505, 2024-04-25T22:53:54.360 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:54.360 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:54.360 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:54.360 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:54.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.360 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:54.360 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:54.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:54.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.361 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:54.361 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:54.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:54.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.361 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:54.361 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012737+0000", 2024-04-25T22:53:54.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:54.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:54.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012739+0000", 2024-04-25T22:53:54.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-04-25T22:53:54.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:54.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012743+0000", 2024-04-25T22:53:54.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3239999999999996e-06 2024-04-25T22:53:54.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:54.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012746+0000", 2024-04-25T22:53:54.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.129e-06 2024-04-25T22:53:54.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:54.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012796+0000", 2024-04-25T22:53:54.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9231999999999999e-05 2024-04-25T22:53:54.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:54.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012915+0000", 2024-04-25T22:53:54.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119021 2024-04-25T22:53:54.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:54.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013069+0000", 2024-04-25T22:53:54.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015463900000000001 2024-04-25T22:53:54.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:54.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019237+0000", 2024-04-25T22:53:54.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061680329999999998 2024-04-25T22:53:54.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:54.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023603+0000", 2024-04-25T22:53:54.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043655860000000003 2024-04-25T22:53:54.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:54.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023659+0000", 2024-04-25T22:53:54.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6484000000000003e-05 2024-04-25T22:53:54.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:54.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023701+0000", 2024-04-25T22:53:54.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1761999999999998e-05 2024-04-25T22:53:54.365 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:54.365 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:54.365 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:54.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.366 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:54.366 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:54.366 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.29204959400001, 2024-04-25T22:53:54.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011234429000000001, 2024-04-25T22:53:54.366 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:54.366 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:54.366 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:54.366 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:54.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:54.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:54.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:54.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:54.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:54.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:54.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:54.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012762+0000", 2024-04-25T22:53:54.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-04-25T22:53:54.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:54.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012765+0000", 2024-04-25T22:53:54.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2569999999999999e-06 2024-04-25T22:53:54.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:54.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012783+0000", 2024-04-25T22:53:54.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8431999999999999e-05 2024-04-25T22:53:54.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:54.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012799+0000", 2024-04-25T22:53:54.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5438999999999999e-05 2024-04-25T22:53:54.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:54.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013826+0000", 2024-04-25T22:53:54.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010275060000000001 2024-04-25T22:53:54.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:54.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013913+0000", 2024-04-25T22:53:54.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.708e-05 2024-04-25T22:53:54.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:54.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014098+0000", 2024-04-25T22:53:54.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018519399999999999 2024-04-25T22:53:54.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:54.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019684+0000", 2024-04-25T22:53:54.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055860079999999999 2024-04-25T22:53:54.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:54.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023876+0000", 2024-04-25T22:53:54.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041918800000000003 2024-04-25T22:53:54.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:54.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023957+0000", 2024-04-25T22:53:54.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1165e-05 2024-04-25T22:53:54.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:54.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023995+0000", 2024-04-25T22:53:54.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:53:54.371 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:54.371 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:54.371 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:54.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.371 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:54.371 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:54.371 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.291951815, 2024-04-25T22:53:54.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011131200000000001, 2024-04-25T22:53:54.371 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:54.371 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:54.372 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:54.372 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:54.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:54.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:54.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:54.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:54.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:54.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:54.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:54.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012860+0000", 2024-04-25T22:53:54.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3900000000000004e-07 2024-04-25T22:53:54.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:54.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012865+0000", 2024-04-25T22:53:54.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5609999999999998e-06 2024-04-25T22:53:54.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:54.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012895+0000", 2024-04-25T22:53:54.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9847000000000001e-05 2024-04-25T22:53:54.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:54.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012905+0000", 2024-04-25T22:53:54.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.03e-05 2024-04-25T22:53:54.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:54.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015020+0000", 2024-04-25T22:53:54.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021142940000000001 2024-04-25T22:53:54.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:54.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015182+0000", 2024-04-25T22:53:54.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016248099999999999 2024-04-25T22:53:54.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:54.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015357+0000", 2024-04-25T22:53:54.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017471000000000001 2024-04-25T22:53:54.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:54.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021021+0000", 2024-04-25T22:53:54.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056638340000000004 2024-04-25T22:53:54.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:54.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023712+0000", 2024-04-25T22:53:54.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026910380000000002 2024-04-25T22:53:54.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:54.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023763+0000", 2024-04-25T22:53:54.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1477999999999997e-05 2024-04-25T22:53:54.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:54.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023990+0000", 2024-04-25T22:53:54.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000226818 2024-04-25T22:53:54.376 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:54.376 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:54.377 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:54.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.377 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:54.377 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:54.377 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.29182871899999, 2024-04-25T22:53:54.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011705299000000001, 2024-04-25T22:53:54.377 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:54.377 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:54.377 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:54.377 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:54.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:54.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:54.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:54.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:54.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:54.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:54.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:54.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012983+0000", 2024-04-25T22:53:54.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:53:54.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:54.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012986+0000", 2024-04-25T22:53:54.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5700000000000001e-06 2024-04-25T22:53:54.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:54.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012993+0000", 2024-04-25T22:53:54.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8730000000000001e-06 2024-04-25T22:53:54.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:54.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013000+0000", 2024-04-25T22:53:54.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1890000000000001e-06 2024-04-25T22:53:54.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:54.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:53:54.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002147866 2024-04-25T22:53:54.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:54.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015351+0000", 2024-04-25T22:53:54.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020300799999999999 2024-04-25T22:53:54.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:54.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016260+0000", 2024-04-25T22:53:54.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00090926799999999997 2024-04-25T22:53:54.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:54.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022669+0000", 2024-04-25T22:53:54.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064082849999999997 2024-04-25T22:53:54.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:54.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024584+0000", 2024-04-25T22:53:54.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019151699999999999 2024-04-25T22:53:54.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:54.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024643+0000", 2024-04-25T22:53:54.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8888999999999998e-05 2024-04-25T22:53:54.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:54.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024687+0000", 2024-04-25T22:53:54.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4444999999999999e-05 2024-04-25T22:53:54.382 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:54.382 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:54.382 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:54.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.383 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:54.383 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:54.383 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.291801128, 2024-04-25T22:53:54.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011249699, 2024-04-25T22:53:54.383 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:54.383 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:54.383 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:54.383 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:54.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:54.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:54.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:54.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:54.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:54.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:54.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:54.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013010+0000", 2024-04-25T22:53:54.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2099999999999996e-07 2024-04-25T22:53:54.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:54.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013013+0000", 2024-04-25T22:53:54.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1310000000000002e-06 2024-04-25T22:53:54.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:54.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013020+0000", 2024-04-25T22:53:54.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3330000000000002e-06 2024-04-25T22:53:54.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:54.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013025+0000", 2024-04-25T22:53:54.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6760000000000004e-06 2024-04-25T22:53:54.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:54.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013163+0000", 2024-04-25T22:53:54.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013824599999999999 2024-04-25T22:53:54.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:54.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013504+0000", 2024-04-25T22:53:54.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034080299999999998 2024-04-25T22:53:54.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:54.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013613+0000", 2024-04-25T22:53:54.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108705 2024-04-25T22:53:54.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:54.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015831+0000", 2024-04-25T22:53:54.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002217672 2024-04-25T22:53:54.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:54.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024137+0000", 2024-04-25T22:53:54.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0083060489999999994 2024-04-25T22:53:54.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:54.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024218+0000", 2024-04-25T22:53:54.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1351000000000001e-05 2024-04-25T22:53:54.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:54.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024259+0000", 2024-04-25T22:53:54.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1112000000000002e-05 2024-04-25T22:53:54.388 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:54.388 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:54.388 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:54.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.388 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:54.388 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:54.388 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.291713402, 2024-04-25T22:53:54.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020379749999999999, 2024-04-25T22:53:54.388 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:54.389 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:54.389 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:54.389 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:54.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:54.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:54.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:54.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:54.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:54.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:54.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:54.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013098+0000", 2024-04-25T22:53:54.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:53:54.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:54.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013105+0000", 2024-04-25T22:53:54.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5969999999999997e-06 2024-04-25T22:53:54.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:54.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013190+0000", 2024-04-25T22:53:54.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5618999999999995e-05 2024-04-25T22:53:54.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:54.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013200+0000", 2024-04-25T22:53:54.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5859999999999994e-06 2024-04-25T22:53:54.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:54.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020265+0000", 2024-04-25T22:53:54.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070653349999999998 2024-04-25T22:53:54.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:54.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020454+0000", 2024-04-25T22:53:54.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189316 2024-04-25T22:53:54.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:54.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020586+0000", 2024-04-25T22:53:54.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013195700000000001 2024-04-25T22:53:54.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:54.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023822+0000", 2024-04-25T22:53:54.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032358529999999999 2024-04-25T22:53:54.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:54.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033409+0000", 2024-04-25T22:53:54.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095870520000000004 2024-04-25T22:53:54.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.393 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:54.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033447+0000", 2024-04-25T22:53:54.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7261999999999997e-05 2024-04-25T22:53:54.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.393 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:54.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033477+0000", 2024-04-25T22:53:54.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0389e-05 2024-04-25T22:53:54.393 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:54.394 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:54.394 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:54.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.394 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:54.394 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:54.394 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.291596896, 2024-04-25T22:53:54.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010857383999999999, 2024-04-25T22:53:54.394 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:54.394 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:54.394 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:54.394 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:54.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:54.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:54.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:54.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:54.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:54.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:54.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:54.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:54.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:54.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:54.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013218+0000", 2024-04-25T22:53:54.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8199999999999998e-06 2024-04-25T22:53:54.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:54.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013226+0000", 2024-04-25T22:53:54.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7649999999999993e-06 2024-04-25T22:53:54.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:54.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013259+0000", 2024-04-25T22:53:54.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2727e-05 2024-04-25T22:53:54.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:54.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014809+0000", 2024-04-25T22:53:54.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001550144 2024-04-25T22:53:54.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:54.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014958+0000", 2024-04-25T22:53:54.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014890300000000001 2024-04-25T22:53:54.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:54.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015087+0000", 2024-04-25T22:53:54.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012939200000000001 2024-04-25T22:53:54.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:54.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020212+0000", 2024-04-25T22:53:54.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051248939999999996 2024-04-25T22:53:54.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:54.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023699+0000", 2024-04-25T22:53:54.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034873289999999999 2024-04-25T22:53:54.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:54.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024014+0000", 2024-04-25T22:53:54.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031473999999999999 2024-04-25T22:53:54.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:54.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024071+0000", 2024-04-25T22:53:54.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7040000000000003e-05 2024-04-25T22:53:54.399 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:54.399 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:54.399 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:54.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.399 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:54.399 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:54.400 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.291542191, 2024-04-25T22:53:54.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012329677000000001, 2024-04-25T22:53:54.400 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:54.400 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:54.400 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:54.400 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:54.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:54.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:54.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:54.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:54.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:54.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:54.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:54.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013269+0000", 2024-04-25T22:53:54.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5000000000000002e-07 2024-04-25T22:53:54.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:54.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:54.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6909999999999999e-06 2024-04-25T22:53:54.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:54.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013284+0000", 2024-04-25T22:53:54.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0963e-05 2024-04-25T22:53:54.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:54.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013361+0000", 2024-04-25T22:53:54.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7379999999999994e-05 2024-04-25T22:53:54.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:54.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013448+0000", 2024-04-25T22:53:54.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6990000000000006e-05 2024-04-25T22:53:54.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:54.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013632+0000", 2024-04-25T22:53:54.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018396800000000001 2024-04-25T22:53:54.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:54.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013800+0000", 2024-04-25T22:53:54.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167467 2024-04-25T22:53:54.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:54.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.018570+0000", 2024-04-25T22:53:54.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047701460000000003 2024-04-25T22:53:54.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:54.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025507+0000", 2024-04-25T22:53:54.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069372039999999998 2024-04-25T22:53:54.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:54.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025562+0000", 2024-04-25T22:53:54.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4858999999999998e-05 2024-04-25T22:53:54.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:54.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025598+0000", 2024-04-25T22:53:54.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6259e-05 2024-04-25T22:53:54.405 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:54.405 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:54.405 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:54.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.405 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:54.405 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:54.405 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.291410318, 2024-04-25T22:53:54.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020176666999999999, 2024-04-25T22:53:54.405 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:54.405 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:54.405 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:53:54.406 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:54.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:54.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:54.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:54.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:54.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:54.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:54.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:54.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:54.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-04-25T22:53:54.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:54.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013405+0000", 2024-04-25T22:53:54.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0559999999999998e-06 2024-04-25T22:53:54.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:54.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013422+0000", 2024-04-25T22:53:54.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6770999999999999e-05 2024-04-25T22:53:54.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:54.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013431+0000", 2024-04-25T22:53:54.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5019999999999998e-06 2024-04-25T22:53:54.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:54.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021720+0000", 2024-04-25T22:53:54.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082884340000000008 2024-04-25T22:53:54.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:54.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022122+0000", 2024-04-25T22:53:54.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000401634 2024-04-25T22:53:54.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:54.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033577+0000", 2024-04-25T22:53:54.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011455435999999999 2024-04-25T22:53:54.409 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:54.409 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:54.409 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:54.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.409 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4734.0:31 4.1b 4:d9872866:::1000000021d.00000002:head [write 0~3618035] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-25T22:53:54.409 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:53:54.409 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 23.251836055999998, 2024-04-25T22:53:54.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011647062, 2024-04-25T22:53:54.410 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:54.410 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:54.410 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:54.410 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:54.410 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4734", 2024-04-25T22:53:54.410 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:54.410 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 31 2024-04-25T22:53:54.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.410 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:54.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:54.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:53:54.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:54.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:54.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:53:54.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:54.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:54.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:53:54.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5700000000000001e-07 2024-04-25T22:53:54.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:54.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059575+0000", 2024-04-25T22:53:54.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0065991380000000001 2024-04-25T22:53:54.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:54.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059586+0000", 2024-04-25T22:53:54.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1438e-05 2024-04-25T22:53:54.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:54.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059592+0000", 2024-04-25T22:53:54.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2899999999999999e-06 2024-04-25T22:53:54.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:54.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059660+0000", 2024-04-25T22:53:54.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7980999999999998e-05 2024-04-25T22:53:54.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:54.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059757+0000", 2024-04-25T22:53:54.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6340000000000003e-05 2024-04-25T22:53:54.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:54.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.064487+0000", 2024-04-25T22:53:54.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004730621 2024-04-25T22:53:54.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:54.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.064538+0000", 2024-04-25T22:53:54.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0801999999999999e-05 2024-04-25T22:53:54.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:54.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.064622+0000", 2024-04-25T22:53:54.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3595000000000002e-05 2024-04-25T22:53:54.414 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:54.414 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:54.414 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:54.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.414 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:97 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-25T22:53:54.415 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:53:33.026298+0000", 2024-04-25T22:53:54.415 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 21.278512242000001, 2024-04-25T22:53:54.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015641848999999999, 2024-04-25T22:53:54.415 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:54.415 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:54.415 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:54.415 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:54.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:54.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026298+0000", 2024-04-25T22:53:54.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:54.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:54.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026298+0000", 2024-04-25T22:53:54.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:54.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:54.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026299+0000", 2024-04-25T22:53:54.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7299999999999996e-07 2024-04-25T22:53:54.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:54.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026464+0000", 2024-04-25T22:53:54.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016477700000000001 2024-04-25T22:53:54.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:54.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026472+0000", 2024-04-25T22:53:54.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1589999999999993e-06 2024-04-25T22:53:54.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:54.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026476+0000", 2024-04-25T22:53:54.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4580000000000003e-06 2024-04-25T22:53:54.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:54.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026550+0000", 2024-04-25T22:53:54.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3836000000000003e-05 2024-04-25T22:53:54.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:54.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026644+0000", 2024-04-25T22:53:54.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4022000000000002e-05 2024-04-25T22:53:54.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:54.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.041838+0000", 2024-04-25T22:53:54.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015193814999999999 2024-04-25T22:53:54.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:54.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.041874+0000", 2024-04-25T22:53:54.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5856999999999999e-05 2024-04-25T22:53:54.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:54.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:54.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:54.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.041940+0000", 2024-04-25T22:53:54.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6352000000000004e-05 2024-04-25T22:53:54.419 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:54.419 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:54.419 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:54.419 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:54.419 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:54.419 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:54.420 INFO:tasks.workunit.client.0.smithi052.stdout: [CC] metaperf 2024-04-25T22:53:54.422 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:54.422 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:54.420+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:54.422 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is set 2024-04-25T22:53:54.435 INFO:tasks.workunit.client.0.smithi052.stdout: [CC] devzero 2024-04-25T22:53:54.512 INFO:tasks.workunit.client.0.smithi052.stdout: [CC] feature 2024-04-25T22:53:54.521 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:54.520+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:54.527 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:54.527 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:54.527 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-25T22:53:54.527 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:54.536 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:54.616 INFO:tasks.workunit.client.0.smithi052.stdout: [CC] alloc 2024-04-25T22:53:54.622 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:54.621+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:54.678 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:54.678 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:54.678 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-25T22:53:54.679 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-25T22:53:54.679 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:54.687 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:54.715 INFO:tasks.workunit.client.0.smithi052.stdout: [CC] fault 2024-04-25T22:53:54.723 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:54.722+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:54.755 INFO:tasks.workunit.client.0.smithi052.stdout: [CC] fstest 2024-04-25T22:53:54.790 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:54.790 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:53:54.790 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:53:54.791 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:53:54.791 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.791 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:53:54.791 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:54.791 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 126.82160324500001, 2024-04-25T22:53:54.791 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:53:54.791 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:54.791 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:54.791 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:54.791 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:54.791 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.791 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:54.791 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:54.792 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:54.792 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.792 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.792 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:54.792 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:54.792 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:54.792 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.792 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.792 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:54.792 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:53:54.792 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:53:54.792 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.792 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.793 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:54.793 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:53:54.793 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:53:54.793 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.793 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.793 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:54.793 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:53:54.793 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:53:54.793 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.793 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.793 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:54.793 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:53:54.793 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:53:54.793 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.794 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.794 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:54.794 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:53:54.794 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:53:54.794 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.794 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.794 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:54.794 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:53:54.794 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:53:54.794 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.794 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.794 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:54.794 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:53:54.795 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:53:54.795 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.795 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.795 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:54.795 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:53:54.795 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:53:54.795 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:54.795 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:54.795 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:54.795 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.795 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.795 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:54.795 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:54.795 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 121.777107546, 2024-04-25T22:53:54.795 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:53:54.796 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:54.796 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:54.796 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:54.796 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:54.796 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.796 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:54.796 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:54.796 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:54.796 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.796 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.796 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:54.796 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:54.796 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:54.796 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.797 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.797 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:54.797 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:53:54.797 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:53:54.797 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.797 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.797 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:54.797 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:53:54.797 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:53:54.797 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.797 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.797 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:54.797 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:53:54.798 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:53:54.798 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.798 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.798 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:54.798 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:53:54.798 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:53:54.798 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.798 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.798 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:54.798 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:53:54.798 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:53:54.798 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.798 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.798 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:54.799 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:53:54.799 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:53:54.799 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.799 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.799 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:54.799 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:53:54.799 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:53:54.799 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.799 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.799 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:54.799 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:53:54.799 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:53:54.799 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.799 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.799 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:54.800 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:53:54.800 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:53:54.800 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.800 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.800 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:54.800 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:53:54.800 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:53:54.800 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.800 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.800 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:54.800 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:53:54.800 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:53:54.800 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:54.801 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:54.801 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:54.801 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.801 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.801 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:54.801 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:54.801 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 121.77643317, 2024-04-25T22:53:54.801 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:53:54.801 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:54.801 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:54.801 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:54.801 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:54.801 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.801 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:54.802 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:54.802 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:54.802 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.802 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.802 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:54.802 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:54.802 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:54.802 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.802 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.802 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:54.802 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:53:54.802 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:53:54.802 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.802 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.803 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:54.803 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:53:54.803 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:53:54.803 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.803 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.803 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:54.803 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:53:54.803 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:53:54.803 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.803 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.803 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:54.803 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:53:54.804 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:53:54.804 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.804 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.804 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:54.804 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:53:54.804 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:53:54.804 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.804 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.804 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:54.804 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:53:54.804 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:53:54.804 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.804 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.804 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:54.805 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:53:54.805 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:53:54.805 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.805 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.805 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:54.805 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:53:54.805 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:53:54.805 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.805 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.805 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:54.805 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:53:54.805 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:53:54.805 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.805 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.806 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:54.806 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:53:54.806 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:53:54.806 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.806 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.806 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:54.806 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:53:54.806 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:53:54.806 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:54.806 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:54.806 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:54.806 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.806 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.806 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:54.807 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:54.807 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 121.77592395800001, 2024-04-25T22:53:54.807 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:53:54.807 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:54.807 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:54.807 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:54.807 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:54.807 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.807 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:54.807 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:54.807 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:54.807 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.807 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.808 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:54.808 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:54.808 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:54.808 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.808 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.808 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:54.808 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:53:54.808 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:53:54.808 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.808 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.808 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:54.808 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:53:54.808 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:53:54.808 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.808 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.809 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:54.809 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:53:54.809 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:53:54.809 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.809 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.809 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:54.809 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:53:54.809 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:53:54.809 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.809 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.809 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:54.809 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:53:54.809 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:53:54.809 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.809 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.810 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:54.810 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:53:54.810 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:53:54.810 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.810 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.810 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:54.810 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:53:54.810 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:53:54.810 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.810 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.810 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:54.810 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:53:54.810 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:53:54.811 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.811 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.811 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:54.811 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:53:54.811 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:53:54.811 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.811 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.811 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:54.811 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:53:54.811 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:53:54.811 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.811 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.811 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:54.811 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:53:54.812 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:53:54.812 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:54.812 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:54.812 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:54.812 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.812 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.812 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:54.812 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:54.812 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 121.77551076, 2024-04-25T22:53:54.812 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:53:54.812 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:54.812 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:54.812 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:54.812 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:54.812 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.813 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:54.813 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:54.813 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:54.813 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.813 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.813 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:54.813 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:54.813 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:54.813 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.813 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.813 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:54.813 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:54.813 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:53:54.813 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.814 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.814 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:54.814 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:54.814 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:53:54.814 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.814 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.814 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:54.814 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:53:54.814 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:53:54.814 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.814 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.814 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:54.814 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:53:54.815 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:53:54.815 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.815 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.815 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:54.815 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:53:54.815 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:53:54.815 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.815 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.815 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:54.815 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:53:54.815 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:53:54.815 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.815 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.816 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:54.816 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:53:54.816 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:53:54.816 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.816 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.816 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:54.816 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:53:54.816 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:53:54.816 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.816 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.816 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:54.816 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:53:54.816 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:53:54.816 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.816 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.817 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:54.817 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:53:54.817 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:53:54.817 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.817 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.817 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:54.817 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:53:54.817 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:53:54.817 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:54.817 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:54.817 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:54.817 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.817 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.818 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:54.818 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:54.818 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 121.77546009, 2024-04-25T22:53:54.818 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:53:54.818 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:54.818 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:54.818 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:54.818 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:54.818 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.818 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:54.818 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:54.819 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:54.819 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.819 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.819 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:54.819 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:54.819 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:54.819 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.819 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.819 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:54.819 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:53:54.819 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:53:54.819 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.819 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.819 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:54.819 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:53:54.820 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:53:54.820 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.820 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.820 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:54.820 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:53:54.820 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:53:54.820 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.820 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.820 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:54.820 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:53:54.820 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:53:54.820 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.820 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.820 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:54.821 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:53:54.821 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:53:54.821 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.821 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.821 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:54.821 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:53:54.821 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:53:54.821 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.821 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.821 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:54.821 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:53:54.821 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:53:54.821 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.822 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.822 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:54.822 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:53:54.822 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:53:54.822 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.822 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.822 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:54.822 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:53:54.822 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:53:54.822 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.822 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.822 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:54.822 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:53:54.823 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:53:54.823 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.823 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.823 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:54.823 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:53:54.823 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:53:54.823 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.823 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.823 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:54.823 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:53:54.823 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:53:54.823 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.823 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.823 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:54.823 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:53:54.824 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:53:54.824 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:54.824 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:54.824 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:54.824 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.824 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.824 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:54.824 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:54.824 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 121.775423221, 2024-04-25T22:53:54.824 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:53:54.824 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:54.824 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:54.824 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:54.824 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:54.825 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.825 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:54.825 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:54.825 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:54.825 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.825 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.825 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:54.825 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:54.825 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:54.825 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.825 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.825 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:54.825 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:53:54.825 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:53:54.825 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.826 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.826 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:54.826 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:53:54.826 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:53:54.826 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.826 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.826 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:54.826 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:53:54.826 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:53:54.826 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.826 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.826 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:54.826 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:53:54.826 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:53:54.827 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.827 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.827 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:54.827 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:53:54.827 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:53:54.827 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.827 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.827 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:53:54.827 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:53:54.827 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:53:54.827 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.827 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.827 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:54.827 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:53:54.828 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:53:54.828 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.828 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.828 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:54.828 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:53:54.828 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:53:54.828 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.828 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.828 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:54.828 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:53:54.828 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:53:54.828 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.828 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.828 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:54.829 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:53:54.829 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:53:54.829 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.829 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.829 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:54.829 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:53:54.829 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:53:54.829 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.829 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.829 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:54.829 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:53:54.829 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:53:54.829 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.829 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.829 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:54.830 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:53:54.830 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:53:54.830 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:54.830 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:54.830 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:54.830 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.830 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.830 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:54.830 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:54.830 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 121.775398255, 2024-04-25T22:53:54.830 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:53:54.830 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:54.830 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:54.830 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:54.831 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:54.831 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.831 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:54.831 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:54.831 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:54.831 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.831 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.831 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:54.831 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:54.831 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:54.831 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.831 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.831 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:54.832 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:53:54.832 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:53:54.832 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.832 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.832 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:54.832 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:53:54.832 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:53:54.832 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.832 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.832 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:54.832 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:54.832 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:53:54.832 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.833 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.833 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:54.833 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:53:54.833 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:53:54.833 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.833 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.833 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:54.833 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:53:54.833 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:53:54.833 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.833 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.833 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:54.833 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:53:54.834 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:53:54.834 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.834 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.834 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:54.834 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:53:54.834 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:53:54.834 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.834 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.834 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:54.834 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:53:54.834 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:53:54.834 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.834 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.834 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:54.835 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:53:54.835 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:53:54.835 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.835 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.835 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:54.835 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:53:54.835 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:53:54.835 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.835 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.835 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:54.835 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:53:54.835 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:53:54.835 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:54.835 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:54.836 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:54.836 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.836 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.836 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:54.836 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:54.836 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 121.775361891, 2024-04-25T22:53:54.836 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:53:54.836 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:54.836 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:54.836 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:54.836 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:54.836 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.836 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:54.836 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:54.837 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:54.837 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.837 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.837 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:54.837 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:54.837 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:54.837 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.837 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.837 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:54.837 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:53:54.837 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:53:54.837 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.837 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.837 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:54.838 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:53:54.838 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:53:54.838 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.838 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.838 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:54.838 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:53:54.838 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:53:54.838 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.838 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.838 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:54.838 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:53:54.838 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:53:54.838 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.838 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.839 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:54.839 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:53:54.839 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:53:54.839 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.839 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.839 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:54.839 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:53:54.839 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:53:54.839 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.839 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.839 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:54.839 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:53:54.839 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:53:54.840 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.840 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.840 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:54.840 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:53:54.840 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:53:54.840 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.840 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.840 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:54.840 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:53:54.840 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:53:54.840 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:54.840 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:54.840 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:54.840 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.841 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.841 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:54.841 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:54.841 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 121.77533081, 2024-04-25T22:53:54.841 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:53:54.841 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:54.841 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:54.841 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:54.841 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:54.841 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.841 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:54.841 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:54.841 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:54.841 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.841 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.842 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:54.842 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:54.842 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:54.842 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.842 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.842 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:54.842 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:54.842 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:54.842 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.842 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.842 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:54.842 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:53:54.842 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:53:54.842 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.843 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.843 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:54.843 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:53:54.843 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:53:54.843 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.843 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.843 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:54.843 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:53:54.843 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:53:54.843 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.843 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.843 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:54.843 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:53:54.843 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:53:54.844 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.844 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.844 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:54.844 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:53:54.844 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:53:54.844 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.844 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.844 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:54.844 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:53:54.844 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:53:54.844 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:54.844 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:54.844 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:54.844 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.844 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.845 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:30 4.31 4:8ebfc112:::1000000021d.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-25T22:53:54.845 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:53:54.845 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 23.73564494, 2024-04-25T22:53:54.845 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015003005, 2024-04-25T22:53:54.845 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:54.845 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:54.845 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:54.845 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:54.845 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:54.845 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:54.845 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 30 2024-04-25T22:53:54.845 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.845 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:54.845 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.846 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:54.846 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:53:54.846 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:54.846 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.846 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.846 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:54.846 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:53:54.846 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:54.846 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.846 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.846 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:54.846 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053133+0000", 2024-04-25T22:53:54.846 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0370000000000001e-06 2024-04-25T22:53:54.847 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.847 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.847 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:54.847 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060377+0000", 2024-04-25T22:53:54.847 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0072431070000000004 2024-04-25T22:53:54.847 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.847 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.847 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:54.847 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060388+0000", 2024-04-25T22:53:54.847 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1285e-05 2024-04-25T22:53:54.847 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.847 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.847 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:54.847 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060394+0000", 2024-04-25T22:53:54.848 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1040000000000003e-06 2024-04-25T22:53:54.848 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.848 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.848 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:54.848 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060483+0000", 2024-04-25T22:53:54.848 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.9345000000000006e-05 2024-04-25T22:53:54.848 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.848 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.848 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:54.848 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060566+0000", 2024-04-25T22:53:54.848 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2237999999999994e-05 2024-04-25T22:53:54.848 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.848 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.849 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:54.849 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068057+0000", 2024-04-25T22:53:54.849 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074912210000000002 2024-04-25T22:53:54.849 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.849 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.849 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:54.849 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068090+0000", 2024-04-25T22:53:54.849 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3501000000000003e-05 2024-04-25T22:53:54.849 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.849 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.849 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:54.849 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068134+0000", 2024-04-25T22:53:54.849 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4166999999999999e-05 2024-04-25T22:53:54.849 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:54.850 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:54.850 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:54.850 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.850 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.850 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:66 4.27 4:e5671758:::1000000024f.00000000:head [write 0~6641] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:54.850 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:54.850 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 23.475534604, 2024-04-25T22:53:54.850 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075166540000000002, 2024-04-25T22:53:54.850 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:54.850 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:54.850 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:54.850 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:54.850 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:54.851 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:54.851 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 66 2024-04-25T22:53:54.851 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.851 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:54.851 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.851 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:54.851 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:54.851 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:54.851 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.851 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.851 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:54.851 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:54.852 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:54.852 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.852 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.852 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:54.852 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:54.852 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4099999999999998e-07 2024-04-25T22:53:54.852 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.852 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.852 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:54.852 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313252+0000", 2024-04-25T22:53:54.852 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5380000000000008e-06 2024-04-25T22:53:54.852 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.852 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.852 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:54.853 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313260+0000", 2024-04-25T22:53:54.853 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2609999999999993e-06 2024-04-25T22:53:54.853 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.853 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.853 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:54.853 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313265+0000", 2024-04-25T22:53:54.853 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4850000000000003e-06 2024-04-25T22:53:54.853 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.853 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.853 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:54.853 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313310+0000", 2024-04-25T22:53:54.853 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5247999999999998e-05 2024-04-25T22:53:54.853 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.853 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.854 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:54.854 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313370+0000", 2024-04-25T22:53:54.854 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0275000000000001e-05 2024-04-25T22:53:54.854 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.854 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.854 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:54.854 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313435+0000", 2024-04-25T22:53:54.854 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4647000000000006e-05 2024-04-25T22:53:54.854 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.854 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.854 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:54.854 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314174+0000", 2024-04-25T22:53:54.854 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00073925 2024-04-25T22:53:54.855 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.855 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.855 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:54.855 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320688+0000", 2024-04-25T22:53:54.855 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.006513418 2024-04-25T22:53:54.855 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.855 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.855 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:54.855 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320736+0000", 2024-04-25T22:53:54.855 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.8114e-05 2024-04-25T22:53:54.855 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.855 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.855 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:54.855 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320758+0000", 2024-04-25T22:53:54.856 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2776999999999999e-05 2024-04-25T22:53:54.856 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:54.856 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:54.856 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:54.856 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.856 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.856 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:68 4.31 4:8fb7f7b7:::10000000251.00000000:head [write 0~2067] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:54.856 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:54.856 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 23.473848826000001, 2024-04-25T22:53:54.856 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0087011669999999992, 2024-04-25T22:53:54.856 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:54.856 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:54.856 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:54.857 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:54.857 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:54.857 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:54.857 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 68 2024-04-25T22:53:54.857 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.857 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:54.857 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.857 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:54.857 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:54.857 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:54.857 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.857 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.857 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:54.857 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:54.858 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:54.858 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.858 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.858 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:54.858 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:54.858 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:53:54.858 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.858 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.858 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:54.858 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314933+0000", 2024-04-25T22:53:54.858 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5430000000000004e-06 2024-04-25T22:53:54.858 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.858 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.859 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:54.859 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314944+0000", 2024-04-25T22:53:54.859 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.076e-05 2024-04-25T22:53:54.859 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.859 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.859 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:54.859 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314949+0000", 2024-04-25T22:53:54.859 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1019999999999996e-06 2024-04-25T22:53:54.859 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.859 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.859 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:54.859 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314996+0000", 2024-04-25T22:53:54.859 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7018999999999998e-05 2024-04-25T22:53:54.860 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.860 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.860 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:54.860 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315064+0000", 2024-04-25T22:53:54.860 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8738000000000005e-05 2024-04-25T22:53:54.860 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.860 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.860 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:54.860 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323531+0000", 2024-04-25T22:53:54.860 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084664739999999999 2024-04-25T22:53:54.860 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.860 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.860 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:54.861 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323574+0000", 2024-04-25T22:53:54.861 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3449999999999999e-05 2024-04-25T22:53:54.861 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.861 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.861 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:54.861 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323629+0000", 2024-04-25T22:53:54.861 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4296999999999999e-05 2024-04-25T22:53:54.861 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:54.861 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:54.861 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:54.861 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.861 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.861 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4734.0:69 4.32 e46/13 4:4e8c6251:::10000000252.00000000:head v 46'1, mlcod=0'0)", 2024-04-25T22:53:54.862 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:54.862 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 23.472817557999999, 2024-04-25T22:53:54.862 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076063240000000002, 2024-04-25T22:53:54.862 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:54.862 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:54.862 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:54.862 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:54.862 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.862 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:54.862 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:54.862 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:54.862 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.863 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.863 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:54.863 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:54.863 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:54.863 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.863 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.863 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:54.863 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:54.863 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3099999999999997e-07 2024-04-25T22:53:54.863 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.863 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.863 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:54.863 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315964+0000", 2024-04-25T22:53:54.863 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3229999999999999e-06 2024-04-25T22:53:54.864 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.864 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.864 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:54.864 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315973+0000", 2024-04-25T22:53:54.864 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7249999999999992e-06 2024-04-25T22:53:54.864 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.864 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.864 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:54.864 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315978+0000", 2024-04-25T22:53:54.864 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4830000000000001e-06 2024-04-25T22:53:54.864 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.864 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.864 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:54.865 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.316043+0000", 2024-04-25T22:53:54.865 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.5036000000000005e-05 2024-04-25T22:53:54.865 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.865 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.865 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:54.865 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.316055+0000", 2024-04-25T22:53:54.865 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1973999999999999e-05 2024-04-25T22:53:54.865 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.865 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.865 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:54.865 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323521+0000", 2024-04-25T22:53:54.865 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074660239999999999 2024-04-25T22:53:54.865 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.865 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.866 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:54.866 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323565+0000", 2024-04-25T22:53:54.866 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4128000000000002e-05 2024-04-25T22:53:54.866 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:54.866 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:54.866 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:54.866 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.866 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.866 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:72 4.36 4:6cdfec98:::10000000255.00000000:head [write 0~4131] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:54.866 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:54.866 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 23.470773646000001, 2024-04-25T22:53:54.866 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084820680000000006, 2024-04-25T22:53:54.866 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:54.867 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:54.867 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:54.867 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:54.867 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:54.867 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:54.867 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 72 2024-04-25T22:53:54.867 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.867 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:54.867 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.867 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:54.867 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:54.867 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:54.867 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.867 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.868 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:54.868 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:54.868 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:54.868 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.868 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.868 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:54.868 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:54.868 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1800000000000005e-07 2024-04-25T22:53:54.868 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.868 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.868 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:54.868 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318010+0000", 2024-04-25T22:53:54.868 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7399999999999998e-06 2024-04-25T22:53:54.868 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.869 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.869 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:54.869 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318019+0000", 2024-04-25T22:53:54.869 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0170000000000002e-06 2024-04-25T22:53:54.869 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.869 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.869 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:54.869 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318024+0000", 2024-04-25T22:53:54.869 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0150000000000003e-06 2024-04-25T22:53:54.869 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.869 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.869 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:54.869 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318075+0000", 2024-04-25T22:53:54.869 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0537000000000001e-05 2024-04-25T22:53:54.870 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.870 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.870 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:54.870 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318144+0000", 2024-04-25T22:53:54.870 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9432999999999997e-05 2024-04-25T22:53:54.870 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.870 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.870 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:54.870 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326392+0000", 2024-04-25T22:53:54.870 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0082482979999999994 2024-04-25T22:53:54.870 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.870 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.870 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:54.871 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326432+0000", 2024-04-25T22:53:54.871 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9870000000000003e-05 2024-04-25T22:53:54.871 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.871 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.871 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:54.871 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326485+0000", 2024-04-25T22:53:54.871 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2439999999999999e-05 2024-04-25T22:53:54.871 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:54.871 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:54.871 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:54.871 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.871 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.871 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:74 4.10 4:08e6f8ca:::10000000257.00000000:head [write 0~839] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:54.872 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:53:54.872 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 23.469299918000001, 2024-04-25T22:53:54.872 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070370720000000001, 2024-04-25T22:53:54.872 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:54.872 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:54.872 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:54.872 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:54.872 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:54.872 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:54.872 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 74 2024-04-25T22:53:54.872 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.872 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:54.872 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.873 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:54.873 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:53:54.873 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:54.873 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.873 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.873 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:54.873 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:53:54.873 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:54.873 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.873 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.873 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:54.873 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319477+0000", 2024-04-25T22:53:54.873 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1999999999999999e-07 2024-04-25T22:53:54.873 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.874 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.874 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:54.874 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319483+0000", 2024-04-25T22:53:54.874 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4260000000000002e-06 2024-04-25T22:53:54.874 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.874 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.874 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:54.874 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319494+0000", 2024-04-25T22:53:54.874 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.094e-05 2024-04-25T22:53:54.874 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.874 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.874 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:54.874 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319499+0000", 2024-04-25T22:53:54.874 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3789999999999997e-06 2024-04-25T22:53:54.875 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.875 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.875 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:54.875 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319545+0000", 2024-04-25T22:53:54.875 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6149000000000001e-05 2024-04-25T22:53:54.875 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.875 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.875 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:54.875 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319617+0000", 2024-04-25T22:53:54.875 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1792999999999995e-05 2024-04-25T22:53:54.875 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.875 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.875 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:54.876 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326406+0000", 2024-04-25T22:53:54.876 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067895999999999998 2024-04-25T22:53:54.876 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.876 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.876 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:54.876 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326443+0000", 2024-04-25T22:53:54.876 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6828e-05 2024-04-25T22:53:54.876 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.876 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.876 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:54.876 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326514+0000", 2024-04-25T22:53:54.876 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0236999999999999e-05 2024-04-25T22:53:54.876 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:54.877 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:54.877 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:54.877 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.877 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.877 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:128 3.1f 3:f83d65d8:::200.00000004:head [write 876784~3317520 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e48)", 2024-04-25T22:53:54.877 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:36.985410+0000", 2024-04-25T22:53:54.877 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 17.8033663, 2024-04-25T22:53:54.877 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0090177360000000002, 2024-04-25T22:53:54.877 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:54.877 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:54.877 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:54.877 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:54.877 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.877 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:54.878 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.985410+0000", 2024-04-25T22:53:54.878 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:54.878 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.878 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.878 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:54.878 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.985410+0000", 2024-04-25T22:53:54.878 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:54.878 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.878 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.878 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:54.878 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.985411+0000", 2024-04-25T22:53:54.878 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8400000000000003e-07 2024-04-25T22:53:54.878 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.879 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.879 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:54.879 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989116+0000", 2024-04-25T22:53:54.879 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037047389999999999 2024-04-25T22:53:54.879 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.879 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.879 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:54.879 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989128+0000", 2024-04-25T22:53:54.879 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1977999999999999e-05 2024-04-25T22:53:54.879 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.879 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.879 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:54.880 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989135+0000", 2024-04-25T22:53:54.880 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5290000000000003e-06 2024-04-25T22:53:54.880 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.880 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.880 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:54.880 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989181+0000", 2024-04-25T22:53:54.880 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6122999999999999e-05 2024-04-25T22:53:54.880 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.880 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.880 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:54.880 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989250+0000", 2024-04-25T22:53:54.880 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8535999999999996e-05 2024-04-25T22:53:54.880 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.880 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.881 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:54.881 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.994272+0000", 2024-04-25T22:53:54.881 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050224889999999998 2024-04-25T22:53:54.881 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.881 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.881 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:54.881 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.994335+0000", 2024-04-25T22:53:54.881 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2588000000000005e-05 2024-04-25T22:53:54.881 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.881 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.881 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:54.882 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.994428+0000", 2024-04-25T22:53:54.882 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2869999999999997e-05 2024-04-25T22:53:54.882 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:54.882 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:54.882 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:54.882 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.882 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.882 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:2150 4.22 4:47cffac6:::10000000a2b.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T22:53:54.882 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:41.078233+0000", 2024-04-25T22:53:54.882 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 13.71054299, 2024-04-25T22:53:54.882 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069201510000000003, 2024-04-25T22:53:54.882 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:54.882 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:54.882 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:54.883 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:54.883 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.883 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:54.883 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078233+0000", 2024-04-25T22:53:54.883 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:54.883 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.883 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.883 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:54.883 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078233+0000", 2024-04-25T22:53:54.883 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:54.883 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.883 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.884 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:54.884 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078234+0000", 2024-04-25T22:53:54.884 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1699999999999998e-07 2024-04-25T22:53:54.884 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.884 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.884 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:54.884 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078236+0000", 2024-04-25T22:53:54.884 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.875e-06 2024-04-25T22:53:54.884 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.884 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.884 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:54.884 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078242+0000", 2024-04-25T22:53:54.884 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2450000000000003e-06 2024-04-25T22:53:54.885 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.885 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.885 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:54.885 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078247+0000", 2024-04-25T22:53:54.885 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7450000000000003e-06 2024-04-25T22:53:54.885 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.885 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.885 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:54.885 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078641+0000", 2024-04-25T22:53:54.885 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00039420200000000002 2024-04-25T22:53:54.885 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.885 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.885 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:54.885 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078840+0000", 2024-04-25T22:53:54.886 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000199063 2024-04-25T22:53:54.886 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.886 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.886 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:54.886 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078919+0000", 2024-04-25T22:53:54.886 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9182000000000002e-05 2024-04-25T22:53:54.886 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.886 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.886 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:54.886 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.080906+0000", 2024-04-25T22:53:54.886 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0019866390000000001 2024-04-25T22:53:54.886 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.886 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.886 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:54.887 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085074+0000", 2024-04-25T22:53:54.887 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0041683639999999999 2024-04-25T22:53:54.887 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.887 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.887 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:54.887 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085117+0000", 2024-04-25T22:53:54.887 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2849999999999998e-05 2024-04-25T22:53:54.887 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.887 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.887 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:54.887 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085154+0000", 2024-04-25T22:53:54.887 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6468999999999999e-05 2024-04-25T22:53:54.887 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:54.887 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:54.888 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:54.888 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.888 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.888 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:2160 4.2a 4:57f9ed86:::10000000a3d.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T22:53:54.888 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:53:54.888 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 13.710073700000001, 2024-04-25T22:53:54.888 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0068959959999999997, 2024-04-25T22:53:54.888 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:54.888 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:54.888 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:54.888 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:54.888 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.888 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:54.888 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:53:54.888 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:54.889 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.889 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.889 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:54.889 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:53:54.889 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:54.889 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.889 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.889 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:54.889 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:53:54.889 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7000000000000004e-07 2024-04-25T22:53:54.889 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.889 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.890 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:54.890 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078707+0000", 2024-04-25T22:53:54.890 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.783e-06 2024-04-25T22:53:54.890 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.890 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.890 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:54.890 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078716+0000", 2024-04-25T22:53:54.890 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4800000000000001e-06 2024-04-25T22:53:54.890 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.890 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.890 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:54.890 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078724+0000", 2024-04-25T22:53:54.890 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1519999999999992e-06 2024-04-25T22:53:54.891 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.891 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.891 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:54.891 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078794+0000", 2024-04-25T22:53:54.891 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0500999999999995e-05 2024-04-25T22:53:54.891 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.891 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.891 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:54.891 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078912+0000", 2024-04-25T22:53:54.891 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000117439 2024-04-25T22:53:54.891 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.891 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.891 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:54.891 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079000+0000", 2024-04-25T22:53:54.891 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8092999999999998e-05 2024-04-25T22:53:54.892 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.892 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.892 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:54.892 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.080897+0000", 2024-04-25T22:53:54.892 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0018970899999999999 2024-04-25T22:53:54.892 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.892 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.892 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:54.892 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085517+0000", 2024-04-25T22:53:54.892 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0046198929999999999 2024-04-25T22:53:54.892 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.892 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.893 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:54.893 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085565+0000", 2024-04-25T22:53:54.893 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7777e-05 2024-04-25T22:53:54.893 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.893 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.893 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:54.893 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085599+0000", 2024-04-25T22:53:54.893 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4017999999999999e-05 2024-04-25T22:53:54.893 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:54.893 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:54.893 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:54.893 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.893 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.893 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:2163 4.2a 4:549f79e3:::10000000a43.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T22:53:54.894 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:53:54.894 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 13.710040347, 2024-04-25T22:53:54.894 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069469190000000002, 2024-04-25T22:53:54.894 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:54.894 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:54.894 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:54.894 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:54.894 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.894 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:54.894 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:53:54.894 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:54.894 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.894 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.895 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:54.895 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:53:54.895 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:54.895 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.895 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.895 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:54.895 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:53:54.895 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1399999999999997e-07 2024-04-25T22:53:54.895 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.895 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.895 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:54.895 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078739+0000", 2024-04-25T22:53:54.895 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2960000000000001e-06 2024-04-25T22:53:54.896 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.896 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.896 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:54.896 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078745+0000", 2024-04-25T22:53:54.896 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3439999999999997e-06 2024-04-25T22:53:54.896 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.896 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.896 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:54.896 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078750+0000", 2024-04-25T22:53:54.896 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3179999999999997e-06 2024-04-25T22:53:54.896 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.896 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.896 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:54.896 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079224+0000", 2024-04-25T22:53:54.897 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00047334999999999999 2024-04-25T22:53:54.897 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.897 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.897 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:54.897 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079292+0000", 2024-04-25T22:53:54.897 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8708999999999996e-05 2024-04-25T22:53:54.897 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.897 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.897 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:54.897 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079342+0000", 2024-04-25T22:53:54.897 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9299999999999999e-05 2024-04-25T22:53:54.897 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.897 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.897 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:54.898 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.081611+0000", 2024-04-25T22:53:54.898 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0022695229999999999 2024-04-25T22:53:54.898 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.898 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.898 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:54.898 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085605+0000", 2024-04-25T22:53:54.898 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0039933679999999997 2024-04-25T22:53:54.898 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.898 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.898 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:54.898 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085650+0000", 2024-04-25T22:53:54.898 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5111000000000002e-05 2024-04-25T22:53:54.898 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:54.898 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:54.899 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:54.899 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085683+0000", 2024-04-25T22:53:54.899 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3185999999999997e-05 2024-04-25T22:53:54.899 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:54.899 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:54.899 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:54.899 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:54.899 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:54.899 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:54.901 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:54.900+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:54.901 INFO:tasks.workunit.client.0.smithi052.stderr:alloc.c: In function 'main': 2024-04-25T22:53:54.901 INFO:tasks.workunit.client.0.smithi052.stderr:alloc.c:154:1: error: 'bozo' undeclared (first use in this function) 2024-04-25T22:53:54.901 INFO:tasks.workunit.client.0.smithi052.stderr: 154 | bozo! 2024-04-25T22:53:54.901 INFO:tasks.workunit.client.0.smithi052.stderr: | ^~~~ 2024-04-25T22:53:54.902 INFO:tasks.workunit.client.0.smithi052.stderr:alloc.c:154:1: note: each undeclared identifier is reported only once for each function it appears in 2024-04-25T22:53:54.902 INFO:tasks.workunit.client.0.smithi052.stderr:alloc.c:154:5: error: expected ';' before '!' token 2024-04-25T22:53:54.902 INFO:tasks.workunit.client.0.smithi052.stderr: 154 | bozo! 2024-04-25T22:53:54.902 INFO:tasks.workunit.client.0.smithi052.stderr: | ^ 2024-04-25T22:53:54.902 INFO:tasks.workunit.client.0.smithi052.stderr: | ; 2024-04-25T22:53:54.902 INFO:tasks.workunit.client.0.smithi052.stderr:alloc.c:184:25: error: 'rflag' undeclared (first use in this function); did you mean 'nflag'? 2024-04-25T22:53:54.902 INFO:tasks.workunit.client.0.smithi052.stderr: 184 | rflag = 1; 2024-04-25T22:53:54.902 INFO:tasks.workunit.client.0.smithi052.stderr: | ^~~~~ 2024-04-25T22:53:54.902 INFO:tasks.workunit.client.0.smithi052.stderr: | nflag 2024-04-25T22:53:54.902 INFO:tasks.workunit.client.0.smithi052.stderr:alloc.c:320:5: error: expected ';' before '!' token 2024-04-25T22:53:54.902 INFO:tasks.workunit.client.0.smithi052.stderr: 320 | bozo! 2024-04-25T22:53:54.902 INFO:tasks.workunit.client.0.smithi052.stderr: | ^ 2024-04-25T22:53:54.902 INFO:tasks.workunit.client.0.smithi052.stderr: | ; 2024-04-25T22:53:54.902 INFO:tasks.workunit.client.0.smithi052.stderr:alloc.c:128:25: warning: variable 'f' set but not used [-Wunused-but-set-variable] 2024-04-25T22:53:54.903 INFO:tasks.workunit.client.0.smithi052.stderr: 128 | struct flock64 f; 2024-04-25T22:53:54.903 INFO:tasks.workunit.client.0.smithi052.stderr: | ^ 2024-04-25T22:53:54.903 INFO:tasks.workunit.client.0.smithi052.stderr:gmake[3]: *** [Makefile:83: alloc] Error 1 2024-04-25T22:53:54.903 INFO:tasks.workunit.client.0.smithi052.stderr:gmake[3]: *** Waiting for unfinished jobs.... 2024-04-25T22:53:54.903 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:54.975 INFO:tasks.workunit.client.0.smithi052.stderr:fstest.c: In function 'run_child': 2024-04-25T22:53:54.975 INFO:tasks.workunit.client.0.smithi052.stderr:fstest.c:95:27: warning: '/file' directive writing 5 bytes into a region of size between 1 and 1024 [-Wformat-overflow=] 2024-04-25T22:53:54.975 INFO:tasks.workunit.client.0.smithi052.stderr: 95 | sprintf(fname, "%s/file%d", dir, fnum); 2024-04-25T22:53:54.975 INFO:tasks.workunit.client.0.smithi052.stderr: | ^~~~~ 2024-04-25T22:53:54.975 INFO:tasks.workunit.client.0.smithi052.stderr:fstest.c:95:24: note: directive argument in the range [0, 2147483647] 2024-04-25T22:53:54.975 INFO:tasks.workunit.client.0.smithi052.stderr: 95 | sprintf(fname, "%s/file%d", dir, fnum); 2024-04-25T22:53:54.975 INFO:tasks.workunit.client.0.smithi052.stderr: | ^~~~~~~~~~~ 2024-04-25T22:53:54.975 INFO:tasks.workunit.client.0.smithi052.stderr:fstest.c:95:9: note: 'sprintf' output between 7 and 1039 bytes into a destination of size 1024 2024-04-25T22:53:54.975 INFO:tasks.workunit.client.0.smithi052.stderr: 95 | sprintf(fname, "%s/file%d", dir, fnum); 2024-04-25T22:53:54.975 INFO:tasks.workunit.client.0.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T22:53:54.975 INFO:tasks.workunit.client.0.smithi052.stderr:fstest.c:166:27: warning: '/file' directive writing 5 bytes into a region of size between 1 and 1024 [-Wformat-overflow=] 2024-04-25T22:53:54.975 INFO:tasks.workunit.client.0.smithi052.stderr: 166 | sprintf(fname, "%s/file%d", dir, fnum); 2024-04-25T22:53:54.976 INFO:tasks.workunit.client.0.smithi052.stderr: | ^~~~~ 2024-04-25T22:53:54.976 INFO:tasks.workunit.client.0.smithi052.stderr:fstest.c:166:24: note: directive argument in the range [0, 2147483647] 2024-04-25T22:53:54.976 INFO:tasks.workunit.client.0.smithi052.stderr: 166 | sprintf(fname, "%s/file%d", dir, fnum); 2024-04-25T22:53:54.976 INFO:tasks.workunit.client.0.smithi052.stderr: | ^~~~~~~~~~~ 2024-04-25T22:53:54.976 INFO:tasks.workunit.client.0.smithi052.stderr:fstest.c:166:9: note: 'sprintf' output between 7 and 1039 bytes into a destination of size 1024 2024-04-25T22:53:54.976 INFO:tasks.workunit.client.0.smithi052.stderr: 166 | sprintf(fname, "%s/file%d", dir, fnum); 2024-04-25T22:53:54.976 INFO:tasks.workunit.client.0.smithi052.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-25T22:53:55.001 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:55.001+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:55.007 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:55.007 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:55.007 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-04-25T22:53:55.007 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:55.015 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:55.036 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:53:55.057 INFO:tasks.workunit.client.0.smithi052.stderr:gmake[2]: *** [include/buildrules:30: src] Error 2 2024-04-25T22:53:55.058 INFO:tasks.workunit.client.0.smithi052.stderr:make[1]: *** [Makefile:53: default] Error 2 2024-04-25T22:53:55.058 INFO:tasks.workunit.client.0.smithi052.stderr:make: *** [Makefile:51: default] Error 2 2024-04-25T22:53:55.059 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-04-25T22:53:55.059 INFO:tasks.workunit:Stopping ['suites/fsx.sh'] on client.0... 2024-04-25T22:53:55.060 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-25T22:53:55.102 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:55.101+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:55.159 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:55.159 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:55.159 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:53:55.159 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:53:55.159 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:55.162 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-25T22:53:55.162 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:53:55.162 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:53:55.167 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:55.181 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-25T22:53:55.181 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:53:55.184 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:53:55.185 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:53:55.203 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:55.202+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:55.305 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:55.304+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:55.309 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:55.310 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:55.318 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:55.377 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_b22e2ebdeb24376882b7bda2a7329c8cccc2276a/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph_b22e2ebdeb24376882b7bda2a7329c8cccc2276a/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_b22e2ebdeb24376882b7bda2a7329c8cccc2276a/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test suites/fsx.sh) on smithi052 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b22e2ebdeb24376882b7bda2a7329c8cccc2276a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh' 2024-04-25T22:53:55.644 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=af7783a6eb09462e98d499be2ec0b381 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_b22e2ebdeb24376882b7bda2a7329c8cccc2276a/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph_b22e2ebdeb24376882b7bda2a7329c8cccc2276a/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_b22e2ebdeb24376882b7bda2a7329c8cccc2276a/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test suites/fsx.sh) on smithi052 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b22e2ebdeb24376882b7bda2a7329c8cccc2276a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh' 2024-04-25T22:53:55.647 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-25T22:53:55.657 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-25T22:53:55.658 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-25T22:53:55.658 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T22:53:55.664 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:55.664 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:55.664 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:55.673 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:55.662+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:55.679 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-25T22:53:55.679 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T22:53:55.737 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:53:55.765 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:55.764+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:55.777 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:55.777 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:55.786 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:55.865 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:55.865+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:55.888 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:55.889 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:55.898 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:55.966 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:55.965+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:56.005 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:56.005 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:56.014 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:56.076 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:53:56.076 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":54,"fsid":"5355b70e-3f7d-4bce-8676-89cee61d2089","created":"2024-04-25T22:51:37.688525+0000","modified":"2024-04-25T22:53:54.364147+0000","last_up_change":"2024-04-25T22:52:42.126339+0000","last_in_change":"2024-04-25T22:51:38.491924+0000","flags":"noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5806080,"flags_set":["nodeep-scrub","noscrub","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:51:45.966439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.87386071681976318,"average_primary_affinity":0.87000000476837158,"average_primary_affinity_weighted":0.87000000476837158}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:51:46.128416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.4900000095367432,"score_stable":1.4900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":0.87386071681976318,"average_primary_affinity":0.87000000476837158,"average_primary_affinity_weighted":0.87000000476837158}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:51:50.648525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":0.67000001668930054,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":0.87386071681976318,"average_primary_affinity":0.87000000476837158,"average_primary_affinity_weighted":0.87000000476837158}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:51:51.351497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.7799999713897705,"score_stable":1.7799999713897705,"optimal_score":0.67000001668930054,"raw_score_acting":1.190000057220459,"raw_score_stable":1.190000057220459,"primary_affinity_weighted":0.87386071681976318,"average_primary_affinity":0.87000000476837158,"average_primary_affinity_weighted":0.87000000476837158}}],"osds":[{"osd":0,"uuid":"b785a86a-6391-4a0d-8aec-c2016380832e","up":1,"in":1,"weight":0.8790740966796875,"primary_affinity":0.62158203125,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6801","nonce":3666753097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6803","nonce":3666753097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6807","nonce":3666753097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6805","nonce":3666753097}]},"public_addr":"172.21.15.110:6801/3666753097","cluster_addr":"172.21.15.110:6803/3666753097","heartbeat_back_addr":"172.21.15.110:6807/3666753097","heartbeat_front_addr":"172.21.15.110:6805/3666753097","state":["exists","up"]},{"osd":1,"uuid":"088b4733-ccbd-41a6-8a31-8d811169c28a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":23,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":479301362},{"type":"v1","addr":"172.21.15.164:6801","nonce":479301362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":479301362},{"type":"v1","addr":"172.21.15.164:6803","nonce":479301362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":479301362},{"type":"v1","addr":"172.21.15.164:6807","nonce":479301362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":479301362},{"type":"v1","addr":"172.21.15.164:6805","nonce":479301362}]},"public_addr":"172.21.15.164:6801/479301362","cluster_addr":"172.21.15.164:6803/479301362","heartbeat_back_addr":"172.21.15.164:6807/479301362","heartbeat_front_addr":"172.21.15.164:6805/479301362","state":["exists"]},{"osd":2,"uuid":"6a6aad8c-22ac-45c0-baf9-928314e7fef9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6801","nonce":349040881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6803","nonce":349040881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6807","nonce":349040881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6805","nonce":349040881}]},"public_addr":"172.21.15.191:6801/349040881","cluster_addr":"172.21.15.191:6803/349040881","heartbeat_back_addr":"172.21.15.191:6807/349040881","heartbeat_front_addr":"172.21.15.191:6805/349040881","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:51:43.531709+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:51:43.589701+0000","dead_epoch":26},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:51:43.566226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:53:56.089 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T22:51:45.966439+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.8738607168197632, 'average_primary_affinity': 0.8700000047683716, 'average_primary_affinity_weighted': 0.8700000047683716}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T22:51:46.128416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.4900000095367432, 'score_stable': 1.4900000095367432, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 0.8738607168197632, 'average_primary_affinity': 0.8700000047683716, 'average_primary_affinity_weighted': 0.8700000047683716}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T22:51:50.648525+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 0.8738607168197632, 'average_primary_affinity': 0.8700000047683716, 'average_primary_affinity_weighted': 0.8700000047683716}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T22:51:51.351497+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.7799999713897705, 'score_stable': 1.7799999713897705, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.190000057220459, 'raw_score_stable': 1.190000057220459, 'primary_affinity_weighted': 0.8738607168197632, 'average_primary_affinity': 0.8700000047683716, 'average_primary_affinity_weighted': 0.8700000047683716}}] 2024-04-25T22:53:56.090 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T22:53:56.097 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:56.097+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:56.156 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:56.157 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:56.165 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:56.206 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:56.205+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:56.270 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:56.268+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:56.307 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:56.307 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:56.316 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:56.371 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:56.369+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:56.384 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2024-04-25T22:53:56.397 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T22:53:56.421 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:56.421 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:56.423 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-25T22:53:56.430 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:56.471 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:56.470+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:56.572 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:56.571+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:56.573 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:56.573 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:56.581 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:56.673 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:56.672+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:56.683 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:56.684 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:56.693 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:56.718 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2024-04-25T22:53:56.732 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T22:53:56.774 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:56.773+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:56.797 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:56.798 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:56.805 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:56.875 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:56.873+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:56.946 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:56.947 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:56.955 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:57.001 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:56.998+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:57.029 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 32 2024-04-25T22:53:57.043 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T22:53:57.057 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:57.058 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:57.067 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:57.109 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:57.108+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:57.171 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:57.172 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:57.178 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:57.177+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:57.180 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:57.185 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:53:57.279 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:57.278+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:57.310 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-25T22:53:57.310 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:53:57.311 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:53:57.323 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:57.324 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:57.330 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-25T22:53:57.330 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:53:57.333 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:57.333 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:53:57.334 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:53:57.343 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2024-04-25T22:53:57.357 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T22:53:57.379 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:57.378+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:57.380 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is unset 2024-04-25T22:53:57.438 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:57.438 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:53:57.438 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:53:57.439 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:53:57.439 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.439 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:53:57.439 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:57.439 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 129.46918494400001, 2024-04-25T22:53:57.440 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:53:57.440 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:57.440 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:57.440 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:57.440 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:57.440 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.440 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:57.440 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:57.441 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:57.441 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.441 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.441 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:57.442 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:57.442 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:57.442 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.442 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.442 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:57.442 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:53:57.442 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:53:57.442 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.443 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.443 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:57.443 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:53:57.443 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:53:57.443 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.443 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.443 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:57.443 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:53:57.444 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:53:57.444 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.444 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.444 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:57.444 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:53:57.444 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:53:57.444 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.444 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.445 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:57.445 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:53:57.445 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:53:57.445 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.445 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.445 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:57.445 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:53:57.445 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:53:57.446 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.446 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.446 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:57.446 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:53:57.446 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:53:57.446 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.447 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.447 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:57.447 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:53:57.447 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:53:57.447 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:57.447 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:57.447 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:57.447 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.448 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.448 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:57.448 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:57.448 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 124.424689245, 2024-04-25T22:53:57.448 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:53:57.448 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:57.448 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:57.448 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:57.449 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:57.449 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.449 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:57.449 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:57.449 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:57.450 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.450 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.450 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:57.450 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:57.450 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:57.450 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.450 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.451 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:57.451 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:53:57.451 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:53:57.451 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.451 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.451 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:57.452 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:53:57.452 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:53:57.452 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.452 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.452 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:57.452 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:53:57.453 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:53:57.453 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.453 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.453 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:57.453 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:53:57.453 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:53:57.453 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.453 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.454 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:57.454 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:53:57.454 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:53:57.454 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.454 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.454 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:57.454 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:53:57.454 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:53:57.455 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.455 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.455 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:57.455 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:53:57.455 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:53:57.455 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.455 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.455 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:57.455 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:53:57.456 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:53:57.456 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.456 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.456 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:57.456 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:53:57.456 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:53:57.456 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.456 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.457 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:57.458 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:53:57.458 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:53:57.458 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.458 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.458 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:57.458 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:53:57.459 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:53:57.459 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:57.459 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:57.459 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:57.460 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.460 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.460 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:57.460 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:57.460 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 124.424014869, 2024-04-25T22:53:57.460 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:53:57.460 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:57.461 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:57.461 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:57.462 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:57.462 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.462 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:57.462 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:57.462 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:57.463 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.463 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.463 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:57.463 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:57.463 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:57.463 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.463 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.464 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:57.464 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:53:57.465 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:53:57.465 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.465 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.465 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:57.465 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:53:57.466 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:53:57.466 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.466 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.466 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:57.466 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:53:57.466 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:53:57.467 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.467 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.467 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:57.467 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:53:57.467 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:53:57.467 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.467 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.467 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:57.468 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:53:57.468 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:53:57.468 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.468 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.468 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:57.468 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:53:57.468 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:53:57.468 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.469 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.469 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:57.469 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:53:57.469 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:53:57.469 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.469 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.469 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:57.469 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:53:57.470 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:53:57.470 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.470 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.470 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:57.470 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:53:57.471 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:53:57.471 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.471 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.471 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:57.471 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:53:57.471 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:53:57.471 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.471 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.472 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:57.472 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:53:57.472 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:53:57.472 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:57.472 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:57.472 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:57.472 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.472 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.473 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:57.473 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:57.473 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 124.42350565700001, 2024-04-25T22:53:57.473 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:53:57.473 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:57.473 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:57.473 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:57.473 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:57.473 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.474 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:57.474 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:57.474 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:57.474 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.474 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.474 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:57.474 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:57.475 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:57.475 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.475 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.475 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:57.475 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:53:57.476 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:53:57.476 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.476 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.476 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:57.476 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:53:57.476 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:53:57.476 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.477 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.477 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:57.477 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:53:57.477 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:53:57.477 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.477 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.478 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:57.478 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:53:57.478 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:53:57.478 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.478 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.478 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:57.478 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:53:57.479 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:53:57.479 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.479 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.480 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:57.480 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:53:57.480 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:53:57.480 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.480 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.480 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:57.480 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:53:57.480 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:53:57.481 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.481 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.481 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:57.481 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:53:57.481 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:53:57.481 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.482 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.482 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:57.482 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:53:57.482 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:53:57.482 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.482 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.482 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:57.482 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:53:57.483 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:53:57.483 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.483 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.483 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:57.484 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:53:57.484 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:53:57.484 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:57.484 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:57.484 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:57.484 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.485 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.485 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:57.485 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:57.485 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 124.423092459, 2024-04-25T22:53:57.485 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:53:57.485 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:57.486 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:57.486 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:57.486 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:57.486 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.486 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:57.486 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:57.487 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:57.487 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.487 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.487 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:57.487 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:57.488 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:57.488 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.488 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.488 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:57.488 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:57.488 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:53:57.489 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.489 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.489 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:57.489 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:57.489 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:53:57.489 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.489 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.490 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:57.490 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:53:57.490 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:53:57.490 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.490 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.490 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:57.490 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:53:57.491 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:53:57.491 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.491 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.491 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:57.491 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:53:57.491 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:53:57.491 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.492 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.492 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:57.492 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:53:57.492 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:53:57.492 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.492 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.492 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:57.493 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:53:57.493 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:53:57.493 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.493 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.493 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:57.493 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:53:57.493 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:53:57.493 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.494 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.494 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:57.494 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:53:57.494 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:53:57.495 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.495 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.495 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:57.495 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:53:57.495 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:53:57.495 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.495 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.495 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:57.496 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:53:57.496 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:53:57.496 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:57.496 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:57.496 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:57.496 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.496 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.496 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:57.497 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:57.497 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 124.423041789, 2024-04-25T22:53:57.497 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:53:57.497 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:57.497 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:57.498 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:57.498 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:57.498 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.498 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:57.499 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:57.499 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:57.499 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.499 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.500 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:57.500 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:57.500 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:57.500 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.500 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.500 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:57.501 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:53:57.501 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:53:57.501 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.501 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.502 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:57.502 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:53:57.502 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:53:57.502 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.503 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.503 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:57.503 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:53:57.503 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:53:57.504 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.504 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.504 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:57.504 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:53:57.504 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:53:57.504 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.505 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.505 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:57.505 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:53:57.505 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:53:57.505 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.506 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.506 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:57.506 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:53:57.506 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:53:57.506 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.506 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.506 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:57.507 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:53:57.507 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:53:57.507 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.507 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.507 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:57.507 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:53:57.507 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:53:57.507 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.507 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.508 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:57.508 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:53:57.508 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:53:57.508 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.508 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.508 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:57.508 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:53:57.508 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:53:57.509 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.509 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.509 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:57.509 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:53:57.509 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:53:57.509 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.509 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.509 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:57.510 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:53:57.510 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:53:57.510 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.510 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.510 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:57.510 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:53:57.511 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:53:57.511 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:57.511 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:57.511 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:57.512 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.512 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.512 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:57.512 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:57.513 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 124.42300492, 2024-04-25T22:53:57.513 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:53:57.513 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:57.513 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:57.514 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:57.514 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:57.514 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.514 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:57.515 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:57.515 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:57.515 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.515 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.515 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:57.516 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:57.516 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:57.516 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.516 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.516 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:57.516 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:53:57.517 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:53:57.517 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.517 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.517 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:57.517 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:53:57.517 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:53:57.518 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.518 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.518 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:57.519 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:53:57.519 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:53:57.519 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.519 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.520 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:57.520 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:53:57.520 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:53:57.520 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.521 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.521 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:57.521 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:53:57.522 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:53:57.522 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.522 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.522 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:53:57.523 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:53:57.523 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:53:57.523 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.524 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.524 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:57.524 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:53:57.524 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:53:57.525 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.525 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.525 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:57.525 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:53:57.526 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:53:57.526 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.526 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.526 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:57.527 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:53:57.527 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:53:57.527 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.527 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.528 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:57.528 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:53:57.528 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:53:57.528 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.529 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.529 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:57.529 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:53:57.529 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:53:57.530 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.530 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.530 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:57.530 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:53:57.531 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:53:57.531 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.531 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.531 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:57.531 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:53:57.532 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:53:57.532 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:57.532 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:57.532 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:57.532 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.533 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.533 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:57.533 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:57.533 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 124.422979954, 2024-04-25T22:53:57.533 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:53:57.534 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:57.534 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:57.534 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:57.534 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:57.535 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.535 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:57.535 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:57.535 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:57.536 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.536 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.536 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:57.536 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:57.537 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:57.537 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.537 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.537 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:57.537 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:53:57.538 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:53:57.538 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.538 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.539 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:57.539 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:53:57.539 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:53:57.539 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.539 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.540 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:57.540 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:57.540 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:53:57.540 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.540 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.540 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:57.540 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:53:57.540 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:53:57.540 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.541 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.541 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:57.541 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:53:57.541 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:53:57.541 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.541 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.541 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:57.541 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:53:57.542 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:53:57.542 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.542 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.542 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:57.542 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:53:57.542 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:53:57.542 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.542 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.543 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:57.543 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:53:57.543 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:53:57.543 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.543 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.543 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:57.543 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:53:57.543 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:53:57.544 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.544 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.544 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:57.544 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:53:57.544 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:53:57.544 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.544 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.544 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:57.545 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:53:57.545 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:53:57.545 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:57.545 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:57.545 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:57.545 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.545 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.545 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:57.546 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:57.546 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 124.42294359, 2024-04-25T22:53:57.546 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:53:57.546 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:57.546 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:57.546 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:57.546 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:57.546 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.547 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:57.547 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:57.547 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:57.547 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.547 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.547 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:57.547 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:57.547 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:57.547 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.548 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.548 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:57.548 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:53:57.548 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:53:57.548 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.548 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.548 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:57.548 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:53:57.549 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:53:57.549 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.549 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.549 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:57.549 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:53:57.549 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:53:57.549 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.549 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.549 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:57.550 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:53:57.550 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:53:57.550 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.550 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.550 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:57.550 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:53:57.550 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:53:57.551 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.551 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.551 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:57.551 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:53:57.551 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:53:57.551 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.551 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.551 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:57.551 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:53:57.552 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:53:57.552 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.552 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.552 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:57.552 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:53:57.552 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:53:57.552 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.552 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.553 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:57.553 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:53:57.553 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:53:57.553 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:57.553 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:57.553 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:57.553 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.553 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.553 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:57.554 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:57.554 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 124.422912509, 2024-04-25T22:53:57.554 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:53:57.554 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:57.554 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:57.554 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:57.554 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:57.554 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.555 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:57.555 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:57.555 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:57.555 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.555 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.555 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:57.555 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:57.555 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:57.556 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.556 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.556 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:57.556 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:57.556 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:57.556 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.556 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.556 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:57.557 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:53:57.557 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:53:57.557 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.557 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.557 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:57.557 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:53:57.557 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:53:57.557 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.557 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.558 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:57.558 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:53:57.558 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:53:57.558 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.558 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.558 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:57.558 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:53:57.558 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:53:57.559 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.559 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.559 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:57.559 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:53:57.559 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:53:57.559 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.559 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.559 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:57.559 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:53:57.560 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:53:57.560 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:57.560 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:57.560 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:57.560 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.560 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.560 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:30 4.31 4:8ebfc112:::1000000021d.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-25T22:53:57.560 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:53:57.561 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 26.383226639, 2024-04-25T22:53:57.561 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015003005, 2024-04-25T22:53:57.561 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:57.561 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:57.561 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:57.561 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:57.561 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:57.561 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:57.561 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 30 2024-04-25T22:53:57.562 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.562 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:57.562 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.562 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:57.562 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:53:57.562 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:57.562 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.562 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.563 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:57.563 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:53:57.563 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:57.563 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.563 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.563 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:57.563 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053133+0000", 2024-04-25T22:53:57.563 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0370000000000001e-06 2024-04-25T22:53:57.564 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.564 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.564 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:57.564 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060377+0000", 2024-04-25T22:53:57.564 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0072431070000000004 2024-04-25T22:53:57.564 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.564 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.564 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:57.565 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060388+0000", 2024-04-25T22:53:57.565 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1285e-05 2024-04-25T22:53:57.565 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.565 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.565 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:57.565 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060394+0000", 2024-04-25T22:53:57.565 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1040000000000003e-06 2024-04-25T22:53:57.565 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.565 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.566 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:57.566 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060483+0000", 2024-04-25T22:53:57.566 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.9345000000000006e-05 2024-04-25T22:53:57.566 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.566 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.566 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:57.566 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060566+0000", 2024-04-25T22:53:57.566 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2237999999999994e-05 2024-04-25T22:53:57.567 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.567 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.567 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:57.567 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068057+0000", 2024-04-25T22:53:57.567 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074912210000000002 2024-04-25T22:53:57.567 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.567 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.567 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:57.568 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068090+0000", 2024-04-25T22:53:57.568 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3501000000000003e-05 2024-04-25T22:53:57.568 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.568 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.568 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:57.568 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068134+0000", 2024-04-25T22:53:57.568 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4166999999999999e-05 2024-04-25T22:53:57.568 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:57.569 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:57.569 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:57.569 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.569 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.569 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:66 4.27 4:e5671758:::1000000024f.00000000:head [write 0~6641] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:57.569 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:57.569 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 26.123116303, 2024-04-25T22:53:57.569 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075166540000000002, 2024-04-25T22:53:57.569 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:57.570 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:57.570 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:57.570 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:57.570 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:57.570 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:57.570 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 66 2024-04-25T22:53:57.570 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.570 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:57.571 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.571 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:57.571 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:57.571 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:57.571 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.571 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.571 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:57.571 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:57.572 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:57.572 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.572 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.572 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:57.572 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:57.572 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4099999999999998e-07 2024-04-25T22:53:57.572 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.572 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.572 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:57.573 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313252+0000", 2024-04-25T22:53:57.573 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5380000000000008e-06 2024-04-25T22:53:57.573 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.573 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.573 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:57.573 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313260+0000", 2024-04-25T22:53:57.573 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2609999999999993e-06 2024-04-25T22:53:57.573 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.574 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.574 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:57.574 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313265+0000", 2024-04-25T22:53:57.574 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4850000000000003e-06 2024-04-25T22:53:57.574 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.574 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.574 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:57.574 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313310+0000", 2024-04-25T22:53:57.575 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5247999999999998e-05 2024-04-25T22:53:57.575 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.575 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.575 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:57.575 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313370+0000", 2024-04-25T22:53:57.575 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0275000000000001e-05 2024-04-25T22:53:57.575 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.575 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.575 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:57.576 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313435+0000", 2024-04-25T22:53:57.576 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4647000000000006e-05 2024-04-25T22:53:57.576 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.576 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.576 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:57.576 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314174+0000", 2024-04-25T22:53:57.576 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00073925 2024-04-25T22:53:57.576 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.577 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.577 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:57.577 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320688+0000", 2024-04-25T22:53:57.577 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.006513418 2024-04-25T22:53:57.577 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.577 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.577 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:57.577 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320736+0000", 2024-04-25T22:53:57.577 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.8114e-05 2024-04-25T22:53:57.578 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.578 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.578 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:57.578 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320758+0000", 2024-04-25T22:53:57.578 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2776999999999999e-05 2024-04-25T22:53:57.578 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:57.578 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:57.578 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:57.579 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.579 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.579 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:68 4.31 4:8fb7f7b7:::10000000251.00000000:head [write 0~2067] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:57.579 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:57.579 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 26.121430525000001, 2024-04-25T22:53:57.579 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0087011669999999992, 2024-04-25T22:53:57.579 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:57.579 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:57.580 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:57.580 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:57.580 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:57.580 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:57.580 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 68 2024-04-25T22:53:57.580 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.580 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:57.580 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.580 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:57.581 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:57.581 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:57.581 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.581 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.581 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:57.581 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:57.581 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:57.581 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.582 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.582 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:57.582 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:57.582 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:53:57.582 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.582 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.582 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:57.582 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314933+0000", 2024-04-25T22:53:57.582 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5430000000000004e-06 2024-04-25T22:53:57.583 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.583 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.583 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:57.583 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314944+0000", 2024-04-25T22:53:57.583 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.076e-05 2024-04-25T22:53:57.583 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.583 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.583 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:57.584 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314949+0000", 2024-04-25T22:53:57.584 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1019999999999996e-06 2024-04-25T22:53:57.584 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.584 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.584 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:57.584 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314996+0000", 2024-04-25T22:53:57.584 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7018999999999998e-05 2024-04-25T22:53:57.584 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.585 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.585 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:57.585 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315064+0000", 2024-04-25T22:53:57.585 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8738000000000005e-05 2024-04-25T22:53:57.585 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.585 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.585 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:57.585 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323531+0000", 2024-04-25T22:53:57.585 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084664739999999999 2024-04-25T22:53:57.586 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.586 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.586 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:57.586 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323574+0000", 2024-04-25T22:53:57.586 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3449999999999999e-05 2024-04-25T22:53:57.586 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.586 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.586 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:57.587 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323629+0000", 2024-04-25T22:53:57.587 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4296999999999999e-05 2024-04-25T22:53:57.587 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:57.587 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:57.587 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:57.587 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.587 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.587 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4734.0:69 4.32 e46/13 4:4e8c6251:::10000000252.00000000:head v 46'1, mlcod=0'0)", 2024-04-25T22:53:57.588 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:57.588 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 26.120399256999999, 2024-04-25T22:53:57.588 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076063240000000002, 2024-04-25T22:53:57.588 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:57.588 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:57.588 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:57.588 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:57.588 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.588 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:57.589 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:57.589 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:57.589 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.589 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.589 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:57.589 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:57.589 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:57.589 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.590 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.590 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:57.590 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:57.590 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3099999999999997e-07 2024-04-25T22:53:57.590 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.590 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.590 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:57.590 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315964+0000", 2024-04-25T22:53:57.591 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3229999999999999e-06 2024-04-25T22:53:57.591 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.591 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.591 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:57.591 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315973+0000", 2024-04-25T22:53:57.591 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7249999999999992e-06 2024-04-25T22:53:57.591 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.591 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.592 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:57.592 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315978+0000", 2024-04-25T22:53:57.592 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4830000000000001e-06 2024-04-25T22:53:57.592 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.592 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.592 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:57.592 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.316043+0000", 2024-04-25T22:53:57.592 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.5036000000000005e-05 2024-04-25T22:53:57.592 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.593 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.593 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:57.593 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.316055+0000", 2024-04-25T22:53:57.593 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1973999999999999e-05 2024-04-25T22:53:57.593 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.593 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.593 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:57.593 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323521+0000", 2024-04-25T22:53:57.594 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074660239999999999 2024-04-25T22:53:57.594 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.594 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.594 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:57.594 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323565+0000", 2024-04-25T22:53:57.594 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4128000000000002e-05 2024-04-25T22:53:57.594 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:57.594 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:57.595 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:57.595 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.595 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.595 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:72 4.36 4:6cdfec98:::10000000255.00000000:head [write 0~4131] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:57.595 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:57.595 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 26.118355345000001, 2024-04-25T22:53:57.595 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084820680000000006, 2024-04-25T22:53:57.595 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:57.595 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:57.596 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:57.596 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:57.596 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:57.596 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:57.596 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 72 2024-04-25T22:53:57.596 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.596 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:57.596 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.596 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:57.597 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:57.597 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:57.597 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.597 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.597 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:57.597 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:57.597 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:57.597 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.598 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.598 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:57.598 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:57.598 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1800000000000005e-07 2024-04-25T22:53:57.598 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.598 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.598 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:57.598 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318010+0000", 2024-04-25T22:53:57.599 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7399999999999998e-06 2024-04-25T22:53:57.599 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.599 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.599 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:57.599 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318019+0000", 2024-04-25T22:53:57.599 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0170000000000002e-06 2024-04-25T22:53:57.599 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.599 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.599 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:57.600 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318024+0000", 2024-04-25T22:53:57.600 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0150000000000003e-06 2024-04-25T22:53:57.600 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.600 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.600 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:57.600 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318075+0000", 2024-04-25T22:53:57.600 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0537000000000001e-05 2024-04-25T22:53:57.600 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.601 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.601 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:57.601 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318144+0000", 2024-04-25T22:53:57.601 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9432999999999997e-05 2024-04-25T22:53:57.601 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.601 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.601 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:57.601 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326392+0000", 2024-04-25T22:53:57.601 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0082482979999999994 2024-04-25T22:53:57.602 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.602 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.602 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:57.602 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326432+0000", 2024-04-25T22:53:57.602 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9870000000000003e-05 2024-04-25T22:53:57.602 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.602 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.602 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:57.603 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326485+0000", 2024-04-25T22:53:57.603 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2439999999999999e-05 2024-04-25T22:53:57.603 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:57.603 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:57.603 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:57.603 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.603 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.603 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:74 4.10 4:08e6f8ca:::10000000257.00000000:head [write 0~839] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:57.604 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:53:57.604 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 26.116881617000001, 2024-04-25T22:53:57.604 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070370720000000001, 2024-04-25T22:53:57.604 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:57.604 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:57.604 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:57.604 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:57.604 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:57.604 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:57.605 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 74 2024-04-25T22:53:57.605 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.605 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:57.605 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.605 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:57.605 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:53:57.605 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:57.605 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.606 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.606 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:57.606 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:53:57.606 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:57.606 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.606 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.606 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:57.606 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319477+0000", 2024-04-25T22:53:57.607 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1999999999999999e-07 2024-04-25T22:53:57.607 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.607 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.607 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:57.607 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319483+0000", 2024-04-25T22:53:57.607 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4260000000000002e-06 2024-04-25T22:53:57.607 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.607 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.607 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:57.608 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319494+0000", 2024-04-25T22:53:57.608 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.094e-05 2024-04-25T22:53:57.608 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.608 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.608 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:57.608 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319499+0000", 2024-04-25T22:53:57.608 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3789999999999997e-06 2024-04-25T22:53:57.608 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.608 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.609 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:57.609 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319545+0000", 2024-04-25T22:53:57.609 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6149000000000001e-05 2024-04-25T22:53:57.609 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.609 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.609 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:57.609 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319617+0000", 2024-04-25T22:53:57.609 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1792999999999995e-05 2024-04-25T22:53:57.610 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.610 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.610 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:57.610 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326406+0000", 2024-04-25T22:53:57.610 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067895999999999998 2024-04-25T22:53:57.610 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.610 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.610 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:57.611 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326443+0000", 2024-04-25T22:53:57.611 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6828e-05 2024-04-25T22:53:57.611 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.611 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.611 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:57.611 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326514+0000", 2024-04-25T22:53:57.611 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0236999999999999e-05 2024-04-25T22:53:57.611 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:57.612 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:57.612 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:57.612 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.612 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.612 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:128 3.1f 3:f83d65d8:::200.00000004:head [write 876784~3317520 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e48)", 2024-04-25T22:53:57.612 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:36.985410+0000", 2024-04-25T22:53:57.612 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 20.450947999, 2024-04-25T22:53:57.614 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0090177360000000002, 2024-04-25T22:53:57.614 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:57.614 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:57.614 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:57.615 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:57.615 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.615 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:57.615 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.985410+0000", 2024-04-25T22:53:57.615 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:57.615 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.615 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.615 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:57.615 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.985410+0000", 2024-04-25T22:53:57.616 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:57.616 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.616 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.616 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:57.616 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.985411+0000", 2024-04-25T22:53:57.616 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8400000000000003e-07 2024-04-25T22:53:57.616 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.616 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.617 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:57.617 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989116+0000", 2024-04-25T22:53:57.617 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037047389999999999 2024-04-25T22:53:57.617 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.617 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.617 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:57.617 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989128+0000", 2024-04-25T22:53:57.617 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1977999999999999e-05 2024-04-25T22:53:57.617 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.618 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.618 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:57.618 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989135+0000", 2024-04-25T22:53:57.618 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5290000000000003e-06 2024-04-25T22:53:57.618 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.618 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.618 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:57.618 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989181+0000", 2024-04-25T22:53:57.619 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6122999999999999e-05 2024-04-25T22:53:57.619 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.619 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.619 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:57.619 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989250+0000", 2024-04-25T22:53:57.619 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8535999999999996e-05 2024-04-25T22:53:57.619 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.619 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.620 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:57.620 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.994272+0000", 2024-04-25T22:53:57.620 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050224889999999998 2024-04-25T22:53:57.620 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.620 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.620 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:57.620 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.994335+0000", 2024-04-25T22:53:57.620 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2588000000000005e-05 2024-04-25T22:53:57.620 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.621 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.621 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:57.621 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.994428+0000", 2024-04-25T22:53:57.621 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2869999999999997e-05 2024-04-25T22:53:57.621 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:57.621 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:57.621 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:57.621 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.621 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.622 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:2150 4.22 4:47cffac6:::10000000a2b.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T22:53:57.622 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:41.078233+0000", 2024-04-25T22:53:57.622 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 16.358124689, 2024-04-25T22:53:57.622 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069201510000000003, 2024-04-25T22:53:57.622 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:57.622 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:57.622 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:57.622 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:57.623 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.623 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:57.623 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078233+0000", 2024-04-25T22:53:57.623 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:57.623 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.623 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.623 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:57.623 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078233+0000", 2024-04-25T22:53:57.624 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:57.624 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.624 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.624 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:57.624 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078234+0000", 2024-04-25T22:53:57.624 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1699999999999998e-07 2024-04-25T22:53:57.624 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.624 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.624 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:57.625 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078236+0000", 2024-04-25T22:53:57.625 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.875e-06 2024-04-25T22:53:57.625 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.625 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.625 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:57.625 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078242+0000", 2024-04-25T22:53:57.625 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2450000000000003e-06 2024-04-25T22:53:57.625 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.625 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.626 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:57.626 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078247+0000", 2024-04-25T22:53:57.626 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7450000000000003e-06 2024-04-25T22:53:57.626 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.626 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.626 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:57.626 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078641+0000", 2024-04-25T22:53:57.626 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00039420200000000002 2024-04-25T22:53:57.627 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.627 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.627 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:57.627 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078840+0000", 2024-04-25T22:53:57.627 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000199063 2024-04-25T22:53:57.627 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.627 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.627 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:57.627 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078919+0000", 2024-04-25T22:53:57.628 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9182000000000002e-05 2024-04-25T22:53:57.628 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.628 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.628 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:57.628 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.080906+0000", 2024-04-25T22:53:57.628 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0019866390000000001 2024-04-25T22:53:57.628 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.628 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.629 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:57.629 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085074+0000", 2024-04-25T22:53:57.629 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0041683639999999999 2024-04-25T22:53:57.629 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.629 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.629 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:57.629 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085117+0000", 2024-04-25T22:53:57.629 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2849999999999998e-05 2024-04-25T22:53:57.630 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.630 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.630 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:57.630 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085154+0000", 2024-04-25T22:53:57.630 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6468999999999999e-05 2024-04-25T22:53:57.630 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:57.630 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:57.630 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:57.631 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.631 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.631 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:2160 4.2a 4:57f9ed86:::10000000a3d.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T22:53:57.631 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:53:57.631 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 16.357655398999999, 2024-04-25T22:53:57.631 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0068959959999999997, 2024-04-25T22:53:57.631 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:57.631 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:57.631 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:57.632 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:57.632 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.632 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:57.632 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:53:57.632 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:57.632 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.632 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.632 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:57.633 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:53:57.633 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:57.633 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.633 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.633 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:57.633 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:53:57.633 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7000000000000004e-07 2024-04-25T22:53:57.633 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.633 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.634 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:57.634 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078707+0000", 2024-04-25T22:53:57.634 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.783e-06 2024-04-25T22:53:57.634 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.634 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.634 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:57.634 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078716+0000", 2024-04-25T22:53:57.634 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4800000000000001e-06 2024-04-25T22:53:57.635 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.635 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.635 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:57.635 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078724+0000", 2024-04-25T22:53:57.635 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1519999999999992e-06 2024-04-25T22:53:57.635 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.635 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.635 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:57.635 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078794+0000", 2024-04-25T22:53:57.636 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0500999999999995e-05 2024-04-25T22:53:57.636 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.636 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.636 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:57.636 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078912+0000", 2024-04-25T22:53:57.636 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000117439 2024-04-25T22:53:57.636 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.636 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.637 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:57.637 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079000+0000", 2024-04-25T22:53:57.637 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8092999999999998e-05 2024-04-25T22:53:57.637 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.637 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.637 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:57.637 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.080897+0000", 2024-04-25T22:53:57.637 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0018970899999999999 2024-04-25T22:53:57.637 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.638 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.638 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:57.638 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085517+0000", 2024-04-25T22:53:57.638 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0046198929999999999 2024-04-25T22:53:57.638 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.638 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.638 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:57.638 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085565+0000", 2024-04-25T22:53:57.639 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7777e-05 2024-04-25T22:53:57.639 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.639 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.639 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:57.639 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085599+0000", 2024-04-25T22:53:57.639 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4017999999999999e-05 2024-04-25T22:53:57.639 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:57.639 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:57.639 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:57.640 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.640 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.640 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:2163 4.2a 4:549f79e3:::10000000a43.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T22:53:57.640 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:53:57.640 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 16.357622045999999, 2024-04-25T22:53:57.640 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069469190000000002, 2024-04-25T22:53:57.640 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:57.640 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:57.641 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:57.641 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:57.641 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.641 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:57.641 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:53:57.641 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:57.641 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.641 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.641 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:57.642 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:53:57.642 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:57.642 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.642 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.642 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:57.642 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:53:57.642 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1399999999999997e-07 2024-04-25T22:53:57.642 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.643 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.643 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:57.643 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078739+0000", 2024-04-25T22:53:57.643 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2960000000000001e-06 2024-04-25T22:53:57.643 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.643 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.643 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:57.643 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078745+0000", 2024-04-25T22:53:57.643 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3439999999999997e-06 2024-04-25T22:53:57.644 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.644 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.644 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:57.644 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078750+0000", 2024-04-25T22:53:57.644 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3179999999999997e-06 2024-04-25T22:53:57.644 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.644 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.644 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:57.645 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079224+0000", 2024-04-25T22:53:57.645 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00047334999999999999 2024-04-25T22:53:57.645 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.645 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.645 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:57.645 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079292+0000", 2024-04-25T22:53:57.645 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8708999999999996e-05 2024-04-25T22:53:57.645 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.646 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.646 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:57.646 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079342+0000", 2024-04-25T22:53:57.646 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9299999999999999e-05 2024-04-25T22:53:57.646 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.646 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.646 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:57.646 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.081611+0000", 2024-04-25T22:53:57.646 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0022695229999999999 2024-04-25T22:53:57.647 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.647 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.647 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:57.647 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085605+0000", 2024-04-25T22:53:57.647 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0039933679999999997 2024-04-25T22:53:57.647 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.647 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.647 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:57.648 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085650+0000", 2024-04-25T22:53:57.648 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5111000000000002e-05 2024-04-25T22:53:57.648 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:57.648 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:57.648 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:57.648 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085683+0000", 2024-04-25T22:53:57.648 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3185999999999997e-05 2024-04-25T22:53:57.648 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:57.648 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:57.649 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:57.649 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:57.649 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:57.649 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:57.650 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:57.650+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:57.651 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:57.689 INFO:teuthology.orchestra.run.smithi052.stderr:listed 0 entries 2024-04-25T22:53:57.702 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-25T22:53:57.702 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T22:53:57.717 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:53:57.751 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:57.751+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:57.757 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:57.757 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:57.757 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-04-25T22:53:57.757 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:57.766 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:57.852 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:57.851+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:57.869 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:57.869 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:57.869 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:53:57.870 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:53:57.870 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:57.878 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:57.953 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:57.952+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:58.023 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:58.024 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-04-25T22:53:58.024 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-04-25T22:53:58.024 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:53:58.024 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.024 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:58.024 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:58.024 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 130.05656269599999, 2024-04-25T22:53:58.025 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010384338999999999, 2024-04-25T22:53:58.025 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:58.025 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:58.025 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:58.025 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:58.025 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:58.025 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:58.026 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-04-25T22:53:58.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.026 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:58.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:58.026 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:58.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:58.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.027 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.027 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:58.031 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:58.031 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:58.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.031 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.032 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:58.032 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:58.032 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3600000000000004e-07 2024-04-25T22:53:58.032 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.033 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:58.033 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965185+0000", 2024-04-25T22:53:58.033 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.117e-06 2024-04-25T22:53:58.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.034 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:58.034 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965192+0000", 2024-04-25T22:53:58.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3239999999999997e-06 2024-04-25T22:53:58.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.035 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.035 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:58.036 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965198+0000", 2024-04-25T22:53:58.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6370000000000004e-06 2024-04-25T22:53:58.036 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.036 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:58.036 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970973+0000", 2024-04-25T22:53:58.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057748239999999996 2024-04-25T22:53:58.036 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.037 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:58.037 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971049+0000", 2024-04-25T22:53:58.037 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6029e-05 2024-04-25T22:53:58.037 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.037 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.037 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:58.037 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971174+0000", 2024-04-25T22:53:58.037 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012462399999999999 2024-04-25T22:53:58.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:58.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971553+0000", 2024-04-25T22:53:58.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037896499999999999 2024-04-25T22:53:58.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:58.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975482+0000", 2024-04-25T22:53:58.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039297459999999996 2024-04-25T22:53:58.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:58.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975529+0000", 2024-04-25T22:53:58.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6387000000000002e-05 2024-04-25T22:53:58.041 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.041 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.042 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:58.042 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975563+0000", 2024-04-25T22:53:58.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4150000000000003e-05 2024-04-25T22:53:58.043 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:58.043 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:58.043 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:58.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.043 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:58.043 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:58.043 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.009516373, 2024-04-25T22:53:58.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012637705000000001, 2024-04-25T22:53:58.044 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:58.044 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:58.044 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:58.044 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:58.044 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.044 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:58.044 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:58.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:58.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:58.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:58.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:58.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:58.046 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012227+0000", 2024-04-25T22:53:58.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.863e-06 2024-04-25T22:53:58.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.046 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:58.046 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012236+0000", 2024-04-25T22:53:58.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1109999999999997e-06 2024-04-25T22:53:58.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:58.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012309+0000", 2024-04-25T22:53:58.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3242000000000001e-05 2024-04-25T22:53:58.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:58.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012324+0000", 2024-04-25T22:53:58.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4837e-05 2024-04-25T22:53:58.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.048 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:58.048 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015060+0000", 2024-04-25T22:53:58.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027363349999999999 2024-04-25T22:53:58.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:58.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015169+0000", 2024-04-25T22:53:58.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108372 2024-04-25T22:53:58.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:58.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015498+0000", 2024-04-25T22:53:58.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032949999999999999 2024-04-25T22:53:58.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:58.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021282+0000", 2024-04-25T22:53:58.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057836429999999998 2024-04-25T22:53:58.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:58.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024709+0000", 2024-04-25T22:53:58.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034271979999999998 2024-04-25T22:53:58.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:58.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024802+0000", 2024-04-25T22:53:58.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2960000000000004e-05 2024-04-25T22:53:58.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:58.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024863+0000", 2024-04-25T22:53:58.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0643999999999997e-05 2024-04-25T22:53:58.053 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:58.053 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:58.053 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:58.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.053 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:58.053 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:58.053 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.00939260200001, 2024-04-25T22:53:58.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012979447999999999, 2024-04-25T22:53:58.054 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:58.054 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:58.054 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:58.054 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:58.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.055 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:58.055 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:58.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:58.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:58.056 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:58.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:58.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.057 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:58.057 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:58.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:53:58.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.057 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:58.057 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012354+0000", 2024-04-25T22:53:58.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7740000000000004e-06 2024-04-25T22:53:58.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:58.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012365+0000", 2024-04-25T22:53:58.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.064e-05 2024-04-25T22:53:58.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:58.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012382+0000", 2024-04-25T22:53:58.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6999000000000001e-05 2024-04-25T22:53:58.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:58.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015958+0000", 2024-04-25T22:53:58.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035765699999999998 2024-04-25T22:53:58.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:58.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016037+0000", 2024-04-25T22:53:58.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8242000000000001e-05 2024-04-25T22:53:58.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:58.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016404+0000", 2024-04-25T22:53:58.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036784300000000002 2024-04-25T22:53:58.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:58.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021294+0000", 2024-04-25T22:53:58.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048890629999999999 2024-04-25T22:53:58.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:58.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024959+0000", 2024-04-25T22:53:58.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036651570000000001 2024-04-25T22:53:58.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:58.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025097+0000", 2024-04-25T22:53:58.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013788099999999999 2024-04-25T22:53:58.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:58.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025328+0000", 2024-04-25T22:53:58.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231492 2024-04-25T22:53:58.064 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:58.064 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:58.064 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:58.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.064 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:58.064 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:58.064 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.009304833, 2024-04-25T22:53:58.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013049827, 2024-04-25T22:53:58.065 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:58.065 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:58.065 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:58.065 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:58.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:58.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:58.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:58.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:58.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:58.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:58.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.067 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:58.067 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012437+0000", 2024-04-25T22:53:58.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-04-25T22:53:58.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.067 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:58.067 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012440+0000", 2024-04-25T22:53:58.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7609999999999999e-06 2024-04-25T22:53:58.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.068 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:58.068 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012449+0000", 2024-04-25T22:53:58.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.285e-06 2024-04-25T22:53:58.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:58.069 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012457+0000", 2024-04-25T22:53:58.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9510000000000006e-06 2024-04-25T22:53:58.069 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:58.069 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017106+0000", 2024-04-25T22:53:58.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046494220000000003 2024-04-25T22:53:58.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:58.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017223+0000", 2024-04-25T22:53:58.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116824 2024-04-25T22:53:58.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:58.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017345+0000", 2024-04-25T22:53:58.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122175 2024-04-25T22:53:58.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:58.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021299+0000", 2024-04-25T22:53:58.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039534879999999998 2024-04-25T22:53:58.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:58.073 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025398+0000", 2024-04-25T22:53:58.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040988960000000003 2024-04-25T22:53:58.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:58.073 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025439+0000", 2024-04-25T22:53:58.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0915999999999999e-05 2024-04-25T22:53:58.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.074 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:58.074 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025486+0000", 2024-04-25T22:53:58.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7534999999999998e-05 2024-04-25T22:53:58.074 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:58.074 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:58.074 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:58.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.075 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:58.075 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:58.075 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.009274682, 2024-04-25T22:53:58.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020988041999999998, 2024-04-25T22:53:58.075 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:58.075 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:58.075 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:58.075 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:58.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.076 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:58.076 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:58.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:58.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.076 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:58.076 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:58.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:58.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.077 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:58.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:58.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.99e-07 2024-04-25T22:53:58.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.077 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:58.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012470+0000", 2024-04-25T22:53:58.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2789999999999999e-06 2024-04-25T22:53:58.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:58.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012477+0000", 2024-04-25T22:53:58.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:53:58.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:58.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012500+0000", 2024-04-25T22:53:58.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2490999999999999e-05 2024-04-25T22:53:58.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:58.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021911+0000", 2024-04-25T22:53:58.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094114160000000006 2024-04-25T22:53:58.080 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.080 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.080 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:58.080 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022000+0000", 2024-04-25T22:53:58.080 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8601000000000001e-05 2024-04-25T22:53:58.080 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.080 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.080 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:58.080 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022359+0000", 2024-04-25T22:53:58.081 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035921999999999999 2024-04-25T22:53:58.081 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.081 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.081 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:58.081 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025541+0000", 2024-04-25T22:53:58.081 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031820619999999998 2024-04-25T22:53:58.081 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.081 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.082 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:58.082 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033375+0000", 2024-04-25T22:53:58.082 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078338379999999992 2024-04-25T22:53:58.082 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.082 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.082 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:58.082 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033415+0000", 2024-04-25T22:53:58.082 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9527000000000003e-05 2024-04-25T22:53:58.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.083 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.083 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:58.083 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033455+0000", 2024-04-25T22:53:58.083 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9932000000000003e-05 2024-04-25T22:53:58.083 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:58.083 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:58.083 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:58.084 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.084 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:58.084 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:58.084 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.009219489, 2024-04-25T22:53:58.084 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021043857999999999, 2024-04-25T22:53:58.084 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:58.084 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:58.084 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:58.085 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:58.085 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.085 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:58.085 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:58.085 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:58.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.085 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.085 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:58.086 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:58.086 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:58.086 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.086 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.086 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:58.086 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012523+0000", 2024-04-25T22:53:58.086 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.361e-06 2024-04-25T22:53:58.086 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.087 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.087 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:58.087 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012530+0000", 2024-04-25T22:53:58.087 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5440000000000004e-06 2024-04-25T22:53:58.087 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.087 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.087 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:58.087 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012541+0000", 2024-04-25T22:53:58.088 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1745e-05 2024-04-25T22:53:58.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.088 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.088 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:58.088 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012551+0000", 2024-04-25T22:53:58.088 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5789999999999993e-06 2024-04-25T22:53:58.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.088 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.088 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:58.089 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022709+0000", 2024-04-25T22:53:58.089 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010157685 2024-04-25T22:53:58.089 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.089 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.089 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:58.089 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022957+0000", 2024-04-25T22:53:58.089 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024824599999999998 2024-04-25T22:53:58.089 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.090 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.090 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:58.090 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023443+0000", 2024-04-25T22:53:58.090 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048578599999999999 2024-04-25T22:53:58.090 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.090 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.090 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:58.090 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025547+0000", 2024-04-25T22:53:58.091 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021044789999999998 2024-04-25T22:53:58.091 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.091 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.091 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:58.091 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033509+0000", 2024-04-25T22:53:58.091 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0079622180000000001 2024-04-25T22:53:58.091 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.091 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.091 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:58.092 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033542+0000", 2024-04-25T22:53:58.092 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3018000000000001e-05 2024-04-25T22:53:58.092 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.092 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.092 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:58.092 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033566+0000", 2024-04-25T22:53:58.092 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3197000000000002e-05 2024-04-25T22:53:58.092 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:58.093 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:58.093 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:58.093 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.093 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.093 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:58.093 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:58.093 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.009179524, 2024-04-25T22:53:58.093 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021122696, 2024-04-25T22:53:58.093 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:58.094 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:58.094 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:58.094 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:58.094 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.094 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:58.094 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:58.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:58.095 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.095 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.095 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:58.095 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:58.095 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:58.095 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.095 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.095 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:58.095 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:58.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:53:58.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.096 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:58.096 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012566+0000", 2024-04-25T22:53:58.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-04-25T22:53:58.097 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.097 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:58.097 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012619+0000", 2024-04-25T22:53:58.097 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2607e-05 2024-04-25T22:53:58.097 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.098 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:58.098 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012628+0000", 2024-04-25T22:53:58.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6500000000000008e-06 2024-04-25T22:53:58.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.098 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:58.098 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024024+0000", 2024-04-25T22:53:58.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011396007999999999 2024-04-25T22:53:58.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.099 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:58.099 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024198+0000", 2024-04-25T22:53:58.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000173215 2024-04-25T22:53:58.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.099 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:58.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024447+0000", 2024-04-25T22:53:58.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024898500000000002 2024-04-25T22:53:58.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.100 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:58.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026431+0000", 2024-04-25T22:53:58.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001984923 2024-04-25T22:53:58.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:58.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033608+0000", 2024-04-25T22:53:58.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071768459999999997 2024-04-25T22:53:58.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:58.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033646+0000", 2024-04-25T22:53:58.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299000000000003e-05 2024-04-25T22:53:58.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:58.102 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033684+0000", 2024-04-25T22:53:58.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8773000000000003e-05 2024-04-25T22:53:58.102 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:58.102 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:58.103 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:58.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.103 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:58.103 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:58.103 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.009090925, 2024-04-25T22:53:58.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021175381, 2024-04-25T22:53:58.103 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:58.103 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:58.104 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:58.104 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:58.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.104 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:58.104 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:58.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:58.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:58.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:58.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:58.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:58.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012651+0000", 2024-04-25T22:53:58.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:53:58.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:58.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012656+0000", 2024-04-25T22:53:58.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8899999999999998e-06 2024-04-25T22:53:58.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:58.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012666+0000", 2024-04-25T22:53:58.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0346999999999999e-05 2024-04-25T22:53:58.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:58.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012675+0000", 2024-04-25T22:53:58.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9930000000000001e-06 2024-04-25T22:53:58.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.108 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:58.108 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025661+0000", 2024-04-25T22:53:58.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01298531 2024-04-25T22:53:58.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.108 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:58.108 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025757+0000", 2024-04-25T22:53:58.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5822000000000005e-05 2024-04-25T22:53:58.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:58.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025907+0000", 2024-04-25T22:53:58.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015051499999999999 2024-04-25T22:53:58.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:58.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026435+0000", 2024-04-25T22:53:58.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052762200000000005 2024-04-25T22:53:58.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:58.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033732+0000", 2024-04-25T22:53:58.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072978419999999997 2024-04-25T22:53:58.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.111 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:58.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033787+0000", 2024-04-25T22:53:58.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4703999999999997e-05 2024-04-25T22:53:58.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:58.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033826+0000", 2024-04-25T22:53:58.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8458999999999999e-05 2024-04-25T22:53:58.112 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:58.112 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:58.114 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:58.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.114 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:58.115 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:58.115 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.00903551099999, 2024-04-25T22:53:58.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021244174000000001, 2024-04-25T22:53:58.115 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:58.115 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:58.115 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:58.116 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:58.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:58.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:58.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:58.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.117 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:58.117 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:58.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:58.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:58.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:58.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:58.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:58.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012712+0000", 2024-04-25T22:53:58.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.913e-06 2024-04-25T22:53:58.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:58.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012722+0000", 2024-04-25T22:53:58.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2879999999999998e-06 2024-04-25T22:53:58.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:58.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012727+0000", 2024-04-25T22:53:58.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8429999999999998e-06 2024-04-25T22:53:58.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:58.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026099+0000", 2024-04-25T22:53:58.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013371450999999999 2024-04-25T22:53:58.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:58.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026147+0000", 2024-04-25T22:53:58.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7837999999999998e-05 2024-04-25T22:53:58.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:58.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026254+0000", 2024-04-25T22:53:58.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107314 2024-04-25T22:53:58.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:58.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026686+0000", 2024-04-25T22:53:58.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000432428 2024-04-25T22:53:58.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:58.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033873+0000", 2024-04-25T22:53:58.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071864399999999997 2024-04-25T22:53:58.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:58.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033904+0000", 2024-04-25T22:53:58.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1321e-05 2024-04-25T22:53:58.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:58.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033950+0000", 2024-04-25T22:53:58.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5707999999999997e-05 2024-04-25T22:53:58.128 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:58.128 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:58.128 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:58.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.128 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:58.128 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:58.129 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.00900512600001, 2024-04-25T22:53:58.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01096505, 2024-04-25T22:53:58.129 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:58.129 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:58.129 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:58.129 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:58.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:58.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:58.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:58.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:58.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:58.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:58.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:58.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012737+0000", 2024-04-25T22:53:58.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:58.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:58.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012739+0000", 2024-04-25T22:53:58.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-04-25T22:53:58.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:58.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012743+0000", 2024-04-25T22:53:58.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3239999999999996e-06 2024-04-25T22:53:58.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:58.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012746+0000", 2024-04-25T22:53:58.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.129e-06 2024-04-25T22:53:58.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:58.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012796+0000", 2024-04-25T22:53:58.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9231999999999999e-05 2024-04-25T22:53:58.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:58.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012915+0000", 2024-04-25T22:53:58.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119021 2024-04-25T22:53:58.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:58.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013069+0000", 2024-04-25T22:53:58.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015463900000000001 2024-04-25T22:53:58.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:58.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019237+0000", 2024-04-25T22:53:58.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061680329999999998 2024-04-25T22:53:58.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:58.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023603+0000", 2024-04-25T22:53:58.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043655860000000003 2024-04-25T22:53:58.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:58.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023659+0000", 2024-04-25T22:53:58.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6484000000000003e-05 2024-04-25T22:53:58.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:58.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023701+0000", 2024-04-25T22:53:58.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1761999999999998e-05 2024-04-25T22:53:58.137 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:58.137 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:58.137 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:58.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.138 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:58.138 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:58.138 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.008980178, 2024-04-25T22:53:58.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011234429000000001, 2024-04-25T22:53:58.138 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:58.138 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:58.139 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:58.139 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:58.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.139 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:58.139 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:58.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:58.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.139 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:58.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:58.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:58.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:58.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012762+0000", 2024-04-25T22:53:58.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-04-25T22:53:58.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:58.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012765+0000", 2024-04-25T22:53:58.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2569999999999999e-06 2024-04-25T22:53:58.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:58.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012783+0000", 2024-04-25T22:53:58.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8431999999999999e-05 2024-04-25T22:53:58.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.143 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:58.143 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012799+0000", 2024-04-25T22:53:58.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5438999999999999e-05 2024-04-25T22:53:58.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.143 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:58.143 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013826+0000", 2024-04-25T22:53:58.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010275060000000001 2024-04-25T22:53:58.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.144 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:58.144 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013913+0000", 2024-04-25T22:53:58.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.708e-05 2024-04-25T22:53:58.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.144 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:58.144 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014098+0000", 2024-04-25T22:53:58.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018519399999999999 2024-04-25T22:53:58.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:58.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019684+0000", 2024-04-25T22:53:58.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055860079999999999 2024-04-25T22:53:58.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:58.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023876+0000", 2024-04-25T22:53:58.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041918800000000003 2024-04-25T22:53:58.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:58.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023957+0000", 2024-04-25T22:53:58.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1165e-05 2024-04-25T22:53:58.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:58.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023995+0000", 2024-04-25T22:53:58.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:53:58.147 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:58.147 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:58.147 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:58.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.147 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:58.148 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:58.148 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.008882399, 2024-04-25T22:53:58.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011131200000000001, 2024-04-25T22:53:58.148 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:58.148 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:58.148 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:58.148 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:58.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.148 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:58.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:58.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:58.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:58.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:58.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:58.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:58.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012860+0000", 2024-04-25T22:53:58.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3900000000000004e-07 2024-04-25T22:53:58.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:58.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012865+0000", 2024-04-25T22:53:58.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5609999999999998e-06 2024-04-25T22:53:58.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:58.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012895+0000", 2024-04-25T22:53:58.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9847000000000001e-05 2024-04-25T22:53:58.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:58.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012905+0000", 2024-04-25T22:53:58.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.03e-05 2024-04-25T22:53:58.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:58.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015020+0000", 2024-04-25T22:53:58.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021142940000000001 2024-04-25T22:53:58.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:58.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015182+0000", 2024-04-25T22:53:58.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016248099999999999 2024-04-25T22:53:58.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:58.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015357+0000", 2024-04-25T22:53:58.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017471000000000001 2024-04-25T22:53:58.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:58.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021021+0000", 2024-04-25T22:53:58.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056638340000000004 2024-04-25T22:53:58.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:58.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023712+0000", 2024-04-25T22:53:58.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026910380000000002 2024-04-25T22:53:58.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:58.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023763+0000", 2024-04-25T22:53:58.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1477999999999997e-05 2024-04-25T22:53:58.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:58.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023990+0000", 2024-04-25T22:53:58.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000226818 2024-04-25T22:53:58.156 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:58.156 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:58.156 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:58.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.157 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:58.157 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:58.157 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.00875930300001, 2024-04-25T22:53:58.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011705299000000001, 2024-04-25T22:53:58.157 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:58.158 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:58.158 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:58.158 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:58.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:58.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:58.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:58.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:58.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:58.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:58.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:58.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012983+0000", 2024-04-25T22:53:58.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:53:58.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:58.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012986+0000", 2024-04-25T22:53:58.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5700000000000001e-06 2024-04-25T22:53:58.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:58.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012993+0000", 2024-04-25T22:53:58.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8730000000000001e-06 2024-04-25T22:53:58.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:58.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013000+0000", 2024-04-25T22:53:58.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1890000000000001e-06 2024-04-25T22:53:58.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:58.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:53:58.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002147866 2024-04-25T22:53:58.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:58.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015351+0000", 2024-04-25T22:53:58.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020300799999999999 2024-04-25T22:53:58.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:58.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016260+0000", 2024-04-25T22:53:58.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00090926799999999997 2024-04-25T22:53:58.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:58.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022669+0000", 2024-04-25T22:53:58.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064082849999999997 2024-04-25T22:53:58.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:58.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024584+0000", 2024-04-25T22:53:58.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019151699999999999 2024-04-25T22:53:58.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:58.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024643+0000", 2024-04-25T22:53:58.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8888999999999998e-05 2024-04-25T22:53:58.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:58.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024687+0000", 2024-04-25T22:53:58.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4444999999999999e-05 2024-04-25T22:53:58.166 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:58.166 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:58.166 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:58.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.166 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:58.166 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:58.167 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.008731712, 2024-04-25T22:53:58.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011249699, 2024-04-25T22:53:58.167 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:58.167 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:58.167 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:58.167 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:58.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:58.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:58.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:58.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:58.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:58.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:58.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:58.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013010+0000", 2024-04-25T22:53:58.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2099999999999996e-07 2024-04-25T22:53:58.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:58.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013013+0000", 2024-04-25T22:53:58.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1310000000000002e-06 2024-04-25T22:53:58.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:58.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013020+0000", 2024-04-25T22:53:58.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3330000000000002e-06 2024-04-25T22:53:58.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:58.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013025+0000", 2024-04-25T22:53:58.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6760000000000004e-06 2024-04-25T22:53:58.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:58.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013163+0000", 2024-04-25T22:53:58.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013824599999999999 2024-04-25T22:53:58.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:58.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013504+0000", 2024-04-25T22:53:58.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034080299999999998 2024-04-25T22:53:58.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:58.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013613+0000", 2024-04-25T22:53:58.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108705 2024-04-25T22:53:58.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:58.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015831+0000", 2024-04-25T22:53:58.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002217672 2024-04-25T22:53:58.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:58.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024137+0000", 2024-04-25T22:53:58.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0083060489999999994 2024-04-25T22:53:58.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:58.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024218+0000", 2024-04-25T22:53:58.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1351000000000001e-05 2024-04-25T22:53:58.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:58.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024259+0000", 2024-04-25T22:53:58.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1112000000000002e-05 2024-04-25T22:53:58.176 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:58.176 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:58.176 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:58.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.177 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:58.177 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:58.177 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.008643986, 2024-04-25T22:53:58.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020379749999999999, 2024-04-25T22:53:58.177 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:58.177 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:58.177 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:58.177 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:58.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:58.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:58.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:58.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:58.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:58.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:58.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:58.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013098+0000", 2024-04-25T22:53:58.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:53:58.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:58.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013105+0000", 2024-04-25T22:53:58.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5969999999999997e-06 2024-04-25T22:53:58.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:58.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013190+0000", 2024-04-25T22:53:58.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5618999999999995e-05 2024-04-25T22:53:58.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:58.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013200+0000", 2024-04-25T22:53:58.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5859999999999994e-06 2024-04-25T22:53:58.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:58.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020265+0000", 2024-04-25T22:53:58.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070653349999999998 2024-04-25T22:53:58.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:58.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020454+0000", 2024-04-25T22:53:58.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189316 2024-04-25T22:53:58.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:58.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020586+0000", 2024-04-25T22:53:58.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013195700000000001 2024-04-25T22:53:58.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:58.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023822+0000", 2024-04-25T22:53:58.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032358529999999999 2024-04-25T22:53:58.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:58.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033409+0000", 2024-04-25T22:53:58.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095870520000000004 2024-04-25T22:53:58.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:58.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033447+0000", 2024-04-25T22:53:58.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7261999999999997e-05 2024-04-25T22:53:58.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:58.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033477+0000", 2024-04-25T22:53:58.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0389e-05 2024-04-25T22:53:58.186 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:58.186 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:58.186 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:58.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.187 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:58.187 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:58.187 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.00852748, 2024-04-25T22:53:58.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010857383999999999, 2024-04-25T22:53:58.187 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:58.187 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:58.187 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:58.187 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:58.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:58.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:58.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:58.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:58.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:58.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:58.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:58.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:58.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:58.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:58.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013218+0000", 2024-04-25T22:53:58.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8199999999999998e-06 2024-04-25T22:53:58.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:58.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013226+0000", 2024-04-25T22:53:58.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7649999999999993e-06 2024-04-25T22:53:58.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.193 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:58.193 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013259+0000", 2024-04-25T22:53:58.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2727e-05 2024-04-25T22:53:58.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.194 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:58.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014809+0000", 2024-04-25T22:53:58.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001550144 2024-04-25T22:53:58.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:58.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014958+0000", 2024-04-25T22:53:58.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014890300000000001 2024-04-25T22:53:58.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:58.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015087+0000", 2024-04-25T22:53:58.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012939200000000001 2024-04-25T22:53:58.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.198 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:58.198 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020212+0000", 2024-04-25T22:53:58.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051248939999999996 2024-04-25T22:53:58.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:58.199 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023699+0000", 2024-04-25T22:53:58.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034873289999999999 2024-04-25T22:53:58.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.200 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.200 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:58.200 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024014+0000", 2024-04-25T22:53:58.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031473999999999999 2024-04-25T22:53:58.200 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:58.201 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024071+0000", 2024-04-25T22:53:58.201 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7040000000000003e-05 2024-04-25T22:53:58.201 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:58.202 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:58.202 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:58.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.202 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.202 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:58.203 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:58.203 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.008472775, 2024-04-25T22:53:58.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012329677000000001, 2024-04-25T22:53:58.203 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:58.203 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:58.204 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:58.204 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:58.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:58.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:58.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:58.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:58.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:58.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:58.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:58.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013269+0000", 2024-04-25T22:53:58.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5000000000000002e-07 2024-04-25T22:53:58.207 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.207 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:58.207 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:58.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6909999999999999e-06 2024-04-25T22:53:58.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:58.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013284+0000", 2024-04-25T22:53:58.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0963e-05 2024-04-25T22:53:58.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:58.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013361+0000", 2024-04-25T22:53:58.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7379999999999994e-05 2024-04-25T22:53:58.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:58.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013448+0000", 2024-04-25T22:53:58.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6990000000000006e-05 2024-04-25T22:53:58.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:58.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013632+0000", 2024-04-25T22:53:58.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018396800000000001 2024-04-25T22:53:58.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:58.212 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013800+0000", 2024-04-25T22:53:58.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167467 2024-04-25T22:53:58.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.213 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:58.213 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.018570+0000", 2024-04-25T22:53:58.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047701460000000003 2024-04-25T22:53:58.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:58.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025507+0000", 2024-04-25T22:53:58.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069372039999999998 2024-04-25T22:53:58.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:58.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025562+0000", 2024-04-25T22:53:58.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4858999999999998e-05 2024-04-25T22:53:58.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:58.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025598+0000", 2024-04-25T22:53:58.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6259e-05 2024-04-25T22:53:58.215 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:58.215 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:58.215 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:58.216 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.216 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:58.216 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:58.216 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.008340902, 2024-04-25T22:53:58.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020176666999999999, 2024-04-25T22:53:58.216 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:58.216 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:58.216 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:53:58.217 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:58.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:58.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:58.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:58.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:58.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:58.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:58.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:58.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:58.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-04-25T22:53:58.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:58.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013405+0000", 2024-04-25T22:53:58.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0559999999999998e-06 2024-04-25T22:53:58.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:58.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013422+0000", 2024-04-25T22:53:58.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6770999999999999e-05 2024-04-25T22:53:58.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:58.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013431+0000", 2024-04-25T22:53:58.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5019999999999998e-06 2024-04-25T22:53:58.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:58.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021720+0000", 2024-04-25T22:53:58.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082884340000000008 2024-04-25T22:53:58.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:58.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022122+0000", 2024-04-25T22:53:58.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000401634 2024-04-25T22:53:58.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:58.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033577+0000", 2024-04-25T22:53:58.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011455435999999999 2024-04-25T22:53:58.222 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:58.222 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:58.222 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:58.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.222 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4734.0:31 4.1b 4:d9872866:::1000000021d.00000002:head [write 0~3618035] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-25T22:53:58.223 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:53:58.223 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.968766639999998, 2024-04-25T22:53:58.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011647062, 2024-04-25T22:53:58.223 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:58.223 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:58.223 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:58.223 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:58.223 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4734", 2024-04-25T22:53:58.223 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:58.224 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 31 2024-04-25T22:53:58.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.224 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:58.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:58.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:53:58.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:58.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:58.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:53:58.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:58.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:58.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:53:58.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5700000000000001e-07 2024-04-25T22:53:58.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:58.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059575+0000", 2024-04-25T22:53:58.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0065991380000000001 2024-04-25T22:53:58.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:58.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059586+0000", 2024-04-25T22:53:58.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1438e-05 2024-04-25T22:53:58.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:58.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059592+0000", 2024-04-25T22:53:58.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2899999999999999e-06 2024-04-25T22:53:58.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:58.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059660+0000", 2024-04-25T22:53:58.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7980999999999998e-05 2024-04-25T22:53:58.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.228 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:58.228 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059757+0000", 2024-04-25T22:53:58.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6340000000000003e-05 2024-04-25T22:53:58.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.228 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:58.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.064487+0000", 2024-04-25T22:53:58.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004730621 2024-04-25T22:53:58.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:58.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.064538+0000", 2024-04-25T22:53:58.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0801999999999999e-05 2024-04-25T22:53:58.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:58.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.064622+0000", 2024-04-25T22:53:58.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3595000000000002e-05 2024-04-25T22:53:58.230 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:58.230 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:58.230 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:58.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.231 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:97 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-25T22:53:58.234 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:53:33.026298+0000", 2024-04-25T22:53:58.234 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.995442826000001, 2024-04-25T22:53:58.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015641848999999999, 2024-04-25T22:53:58.235 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:58.235 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:58.235 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:58.235 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:58.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:58.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026298+0000", 2024-04-25T22:53:58.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:58.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:58.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026298+0000", 2024-04-25T22:53:58.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:58.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:58.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026299+0000", 2024-04-25T22:53:58.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7299999999999996e-07 2024-04-25T22:53:58.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:58.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026464+0000", 2024-04-25T22:53:58.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016477700000000001 2024-04-25T22:53:58.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:58.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026472+0000", 2024-04-25T22:53:58.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1589999999999993e-06 2024-04-25T22:53:58.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:58.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026476+0000", 2024-04-25T22:53:58.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4580000000000003e-06 2024-04-25T22:53:58.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:58.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026550+0000", 2024-04-25T22:53:58.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3836000000000003e-05 2024-04-25T22:53:58.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:58.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026644+0000", 2024-04-25T22:53:58.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4022000000000002e-05 2024-04-25T22:53:58.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:58.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.041838+0000", 2024-04-25T22:53:58.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015193814999999999 2024-04-25T22:53:58.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:58.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.041874+0000", 2024-04-25T22:53:58.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5856999999999999e-05 2024-04-25T22:53:58.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:58.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:58.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:58.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.041940+0000", 2024-04-25T22:53:58.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6352000000000004e-05 2024-04-25T22:53:58.241 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:58.241 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:58.241 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:58.241 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:58.242 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:58.242 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:58.244 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:53:58.244 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":55,"fsid":"5355b70e-3f7d-4bce-8676-89cee61d2089","created":"2024-04-25T22:51:37.688525+0000","modified":"2024-04-25T22:53:57.373661+0000","last_up_change":"2024-04-25T22:52:42.126339+0000","last_in_change":"2024-04-25T22:51:38.491924+0000","flags":"nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5804032,"flags_set":["nodeep-scrub","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:51:45.966439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.87386071681976318,"average_primary_affinity":0.87000000476837158,"average_primary_affinity_weighted":0.87000000476837158}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:51:46.128416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.4900000095367432,"score_stable":1.4900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":0.87386071681976318,"average_primary_affinity":0.87000000476837158,"average_primary_affinity_weighted":0.87000000476837158}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:51:50.648525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":0.67000001668930054,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":0.87386071681976318,"average_primary_affinity":0.87000000476837158,"average_primary_affinity_weighted":0.87000000476837158}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:51:51.351497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.7799999713897705,"score_stable":1.7799999713897705,"optimal_score":0.67000001668930054,"raw_score_acting":1.190000057220459,"raw_score_stable":1.190000057220459,"primary_affinity_weighted":0.87386071681976318,"average_primary_affinity":0.87000000476837158,"average_primary_affinity_weighted":0.87000000476837158}}],"osds":[{"osd":0,"uuid":"b785a86a-6391-4a0d-8aec-c2016380832e","up":1,"in":1,"weight":0.8790740966796875,"primary_affinity":0.62158203125,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6801","nonce":3666753097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6803","nonce":3666753097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6807","nonce":3666753097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6805","nonce":3666753097}]},"public_addr":"172.21.15.110:6801/3666753097","cluster_addr":"172.21.15.110:6803/3666753097","heartbeat_back_addr":"172.21.15.110:6807/3666753097","heartbeat_front_addr":"172.21.15.110:6805/3666753097","state":["exists","up"]},{"osd":1,"uuid":"088b4733-ccbd-41a6-8a31-8d811169c28a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":23,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":479301362},{"type":"v1","addr":"172.21.15.164:6801","nonce":479301362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":479301362},{"type":"v1","addr":"172.21.15.164:6803","nonce":479301362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":479301362},{"type":"v1","addr":"172.21.15.164:6807","nonce":479301362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":479301362},{"type":"v1","addr":"172.21.15.164:6805","nonce":479301362}]},"public_addr":"172.21.15.164:6801/479301362","cluster_addr":"172.21.15.164:6803/479301362","heartbeat_back_addr":"172.21.15.164:6807/479301362","heartbeat_front_addr":"172.21.15.164:6805/479301362","state":["exists"]},{"osd":2,"uuid":"6a6aad8c-22ac-45c0-baf9-928314e7fef9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6801","nonce":349040881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6803","nonce":349040881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6807","nonce":349040881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6805","nonce":349040881}]},"public_addr":"172.21.15.191:6801/349040881","cluster_addr":"172.21.15.191:6803/349040881","heartbeat_back_addr":"172.21.15.191:6807/349040881","heartbeat_front_addr":"172.21.15.191:6805/349040881","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:51:43.531709+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:51:43.589701+0000","dead_epoch":26},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:51:43.566226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:53:58.244 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:58.245 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:58.242+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:58.245 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T22:51:45.966439+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.8738607168197632, 'average_primary_affinity': 0.8700000047683716, 'average_primary_affinity_weighted': 0.8700000047683716}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T22:51:46.128416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.4900000095367432, 'score_stable': 1.4900000095367432, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 0.8738607168197632, 'average_primary_affinity': 0.8700000047683716, 'average_primary_affinity_weighted': 0.8700000047683716}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T22:51:50.648525+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 0.8738607168197632, 'average_primary_affinity': 0.8700000047683716, 'average_primary_affinity_weighted': 0.8700000047683716}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T22:51:51.351497+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.7799999713897705, 'score_stable': 1.7799999713897705, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.190000057220459, 'raw_score_stable': 1.190000057220459, 'primary_affinity_weighted': 0.8738607168197632, 'average_primary_affinity': 0.8700000047683716, 'average_primary_affinity_weighted': 0.8700000047683716}}] 2024-04-25T22:53:58.246 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T22:53:58.344 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:58.343+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:58.357 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:58.358 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:58.358 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-25T22:53:58.358 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:58.367 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:58.445 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:58.444+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:58.469 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:58.469 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:58.470 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-25T22:53:58.470 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-25T22:53:58.470 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:58.478 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:58.544 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2024-04-25T22:53:58.546 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:58.545+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:58.558 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T22:53:58.622 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:58.623 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:53:58.623 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:53:58.623 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:53:58.623 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.623 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:53:58.623 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:58.623 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 130.653797895, 2024-04-25T22:53:58.623 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:53:58.624 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:58.624 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:58.624 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:58.624 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:58.624 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.624 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:58.624 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:58.624 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:58.625 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.625 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.625 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:58.625 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:53:58.625 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:58.625 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.625 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.625 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:58.626 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:53:58.626 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:53:58.626 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.626 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.626 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:58.626 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:53:58.627 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:53:58.627 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.627 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.627 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:58.627 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:53:58.628 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:53:58.628 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.628 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.628 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:58.628 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:53:58.628 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:53:58.628 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.628 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.629 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:58.629 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:53:58.629 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:53:58.629 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.629 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.629 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:58.629 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:53:58.629 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:53:58.629 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.630 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.630 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:58.630 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:53:58.630 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:53:58.630 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.630 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.630 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:58.630 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:53:58.631 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:53:58.631 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:58.631 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:58.631 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:58.631 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.631 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.631 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:58.632 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:58.632 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 125.609302196, 2024-04-25T22:53:58.632 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:53:58.632 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:58.632 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:58.632 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:58.632 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:58.632 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.632 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:58.633 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:58.634 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:58.634 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.634 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.634 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:58.634 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:53:58.634 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:58.634 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.635 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.635 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:58.635 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:53:58.635 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:53:58.635 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.635 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.635 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:58.635 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:53:58.635 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:53:58.636 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.636 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.636 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:58.636 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:53:58.636 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:53:58.636 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.636 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.636 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:58.637 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:53:58.637 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:53:58.637 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.637 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.637 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:58.637 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:53:58.637 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:53:58.637 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.638 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.638 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:58.638 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:53:58.638 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:53:58.638 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.638 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.639 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:58.639 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:53:58.639 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:53:58.639 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.639 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.639 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:58.639 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:53:58.640 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:53:58.640 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.640 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.640 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:58.640 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:53:58.640 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:53:58.640 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.640 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.641 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:58.641 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:53:58.641 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:53:58.641 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.641 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.641 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:58.641 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:53:58.641 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:53:58.641 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:58.642 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:58.642 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:58.642 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.642 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.642 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:58.642 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:58.642 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 125.60862782, 2024-04-25T22:53:58.642 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:53:58.643 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:58.643 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:58.643 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:58.643 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:58.643 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.643 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:58.643 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:58.643 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:58.644 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.644 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.645 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:58.645 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:53:58.645 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:58.645 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.645 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.645 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:58.645 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:53:58.645 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:53:58.646 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.646 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.646 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:58.646 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:53:58.646 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:53:58.646 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.646 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.646 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:58.647 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:53:58.647 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:53:58.647 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.647 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.647 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:58.647 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:53:58.647 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:53:58.647 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.648 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.648 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:58.648 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:53:58.648 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:53:58.648 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.648 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.648 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:58.648 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:53:58.648 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:53:58.649 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.649 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.649 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:58.649 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:53:58.649 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:53:58.649 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.649 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.649 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:58.650 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:53:58.650 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:53:58.650 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.650 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.650 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:58.650 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:53:58.650 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:53:58.650 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.651 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.651 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:58.651 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:53:58.651 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:53:58.651 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.651 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.651 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:58.651 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:53:58.651 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:53:58.652 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:58.652 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:58.652 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:58.652 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.652 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.652 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:58.652 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:58.652 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 125.608118608, 2024-04-25T22:53:58.653 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:53:58.653 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:58.653 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:58.653 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:58.653 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:58.653 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.653 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:58.653 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:58.653 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:58.654 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.654 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.654 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:58.654 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:53:58.654 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:58.654 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.654 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.654 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:58.655 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:53:58.655 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:53:58.655 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.655 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.655 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:58.655 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:53:58.655 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:53:58.655 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.656 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.656 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:58.656 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:53:58.656 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:53:58.656 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.656 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.656 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:58.656 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:53:58.656 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:53:58.657 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.657 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.657 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:58.657 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:53:58.657 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:53:58.657 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.657 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.657 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:58.658 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:53:58.658 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:53:58.658 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.658 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.658 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:58.658 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:53:58.659 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:53:58.659 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.659 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.659 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:58.659 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:53:58.659 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:53:58.659 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.659 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.659 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:58.660 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:53:58.660 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:53:58.660 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.660 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.660 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:58.660 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:53:58.660 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:53:58.660 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.661 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.661 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:58.661 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:53:58.661 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:53:58.661 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:58.661 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:58.661 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:58.661 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.661 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.662 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:58.662 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:58.662 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 125.60770540999999, 2024-04-25T22:53:58.662 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:53:58.662 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:58.662 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:58.662 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:58.663 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:58.663 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.663 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:58.663 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:58.663 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:58.663 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.663 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.663 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:58.663 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:58.664 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:58.664 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.664 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.664 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:58.664 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:53:58.664 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:53:58.664 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.664 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.665 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:58.665 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:58.665 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:53:58.665 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.665 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.665 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:58.665 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:53:58.665 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:53:58.665 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.666 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.666 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:58.666 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:53:58.666 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:53:58.666 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.666 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.666 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:58.666 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:53:58.667 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:53:58.667 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.667 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.667 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:58.667 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:53:58.667 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:53:58.667 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.667 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.668 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:58.668 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:53:58.668 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:53:58.668 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.668 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.668 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:58.668 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:53:58.668 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:53:58.668 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.669 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.669 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:58.669 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:53:58.669 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:53:58.669 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.669 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.669 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:58.669 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:53:58.670 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:53:58.670 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.670 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.670 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:58.670 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:53:58.670 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:53:58.670 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:58.670 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:58.670 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:58.671 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.671 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.671 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:58.671 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:58.671 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 125.60765474, 2024-04-25T22:53:58.671 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:53:58.671 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:58.671 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:58.672 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:58.672 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:58.672 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.672 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:58.672 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:58.672 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:58.672 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.672 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.673 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:58.673 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:53:58.673 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:58.673 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.673 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.673 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:58.673 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:53:58.673 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:53:58.674 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.674 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.674 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:58.674 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:53:58.674 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:53:58.674 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.674 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.674 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:58.674 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:53:58.675 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:53:58.675 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.675 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.675 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:58.675 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:53:58.675 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:53:58.675 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.675 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.676 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:58.676 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:53:58.676 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:53:58.676 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.676 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.676 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:58.676 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:53:58.676 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:53:58.676 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.677 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.677 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:58.677 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:53:58.677 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:53:58.677 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.677 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.677 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:58.677 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:53:58.678 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:53:58.678 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.678 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.678 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:58.678 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:53:58.678 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:53:58.678 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.678 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.679 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:58.679 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:53:58.679 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:53:58.679 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.679 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.679 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:58.679 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:53:58.679 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:53:58.679 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.680 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.680 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:58.680 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:53:58.680 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:53:58.680 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.680 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.680 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:58.680 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:53:58.681 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:53:58.681 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:58.681 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:58.681 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:58.681 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.681 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.681 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:58.681 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:58.681 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 125.607617871, 2024-04-25T22:53:58.682 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:53:58.682 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:58.682 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:58.682 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:58.682 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:58.682 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.682 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:58.682 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:58.683 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:58.683 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.683 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.683 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:58.683 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:53:58.683 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:58.683 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.683 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.684 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:58.684 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:53:58.684 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:53:58.684 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.684 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.684 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:58.684 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:53:58.684 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:53:58.684 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.685 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.685 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:58.685 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:53:58.685 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:53:58.685 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.685 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.685 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:58.685 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:53:58.686 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:53:58.686 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.686 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.686 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:58.686 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:53:58.686 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:53:58.686 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.686 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.687 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:53:58.687 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:53:58.687 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:53:58.687 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.687 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.687 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:58.687 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:53:58.687 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:53:58.688 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.688 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.688 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:58.688 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:53:58.688 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:53:58.688 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.688 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.688 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:58.688 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:53:58.689 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:53:58.689 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.689 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.689 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:58.689 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:53:58.689 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:53:58.689 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.689 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.689 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:58.690 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:53:58.690 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:53:58.690 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.690 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.690 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:58.690 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:53:58.690 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:53:58.690 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.691 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.691 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:58.691 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:53:58.691 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:53:58.691 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:58.691 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:58.691 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:58.691 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.692 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.692 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:58.692 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:58.692 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 125.607592905, 2024-04-25T22:53:58.692 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:53:58.692 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:58.692 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:58.692 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:58.692 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:58.693 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.693 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:58.693 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:58.693 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:58.693 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.693 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.693 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:58.693 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:53:58.694 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:58.694 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.694 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.694 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:58.694 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:53:58.694 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:53:58.694 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.694 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.695 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:58.695 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:53:58.695 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:53:58.695 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.695 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.695 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:58.695 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:58.695 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:53:58.695 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.696 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.696 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:58.696 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:53:58.696 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:53:58.696 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.696 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.696 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:58.696 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:53:58.696 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:53:58.697 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.697 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.697 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:58.697 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:53:58.697 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:53:58.697 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.697 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.697 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:58.698 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:53:58.698 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:53:58.698 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.698 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.698 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:58.698 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:53:58.698 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:53:58.698 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.699 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.699 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:58.699 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:53:58.699 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:53:58.699 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.699 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.699 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:58.699 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:53:58.699 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:53:58.700 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.700 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.700 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:58.700 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:53:58.700 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:53:58.700 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:58.700 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:58.700 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:58.701 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.701 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.701 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:58.702 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:58.702 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 125.60755654099999, 2024-04-25T22:53:58.703 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:53:58.703 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:58.703 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:58.703 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:58.703 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:58.703 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.703 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:58.703 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:58.704 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:58.704 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.704 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.704 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:58.704 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:53:58.704 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:58.704 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.704 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.705 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:58.705 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:53:58.705 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:53:58.705 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.705 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.705 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:58.705 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:53:58.705 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:53:58.705 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.706 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.706 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:58.706 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:53:58.706 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:53:58.706 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.706 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.706 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:58.706 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:53:58.707 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:53:58.707 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.707 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.707 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:58.707 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:53:58.707 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:53:58.707 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.707 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.708 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:53:58.708 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:53:58.708 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:53:58.708 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.708 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.708 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:58.708 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:53:58.708 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:53:58.708 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.709 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.709 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:58.709 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:53:58.709 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:53:58.709 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.709 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.709 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:58.709 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:53:58.709 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:53:58.710 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:58.710 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:58.710 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:58.710 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.710 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.710 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:58.710 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:58.710 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 125.60752546000001, 2024-04-25T22:53:58.711 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:53:58.711 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:58.711 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:58.711 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:53:58.711 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:58.711 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.711 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:58.711 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:58.711 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:58.712 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.712 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.712 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:58.712 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:58.712 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:58.712 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.712 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.712 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:58.713 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:53:58.713 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:58.713 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.713 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.713 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:58.713 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:53:58.713 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:53:58.713 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.713 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.714 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:58.714 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:53:58.714 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:53:58.714 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.714 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.714 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:58.714 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:53:58.714 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:53:58.715 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.715 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.715 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:58.715 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:53:58.715 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:53:58.715 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.715 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.715 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:58.715 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:53:58.716 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:53:58.716 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.716 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.716 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:58.716 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:53:58.716 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:53:58.716 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:58.716 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:58.716 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:58.717 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.717 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.717 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:30 4.31 4:8ebfc112:::1000000021d.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-25T22:53:58.717 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:53:58.717 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 27.567839589999998, 2024-04-25T22:53:58.717 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015003005, 2024-04-25T22:53:58.717 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:58.717 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:58.718 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:58.718 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:58.718 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:58.718 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:58.718 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 30 2024-04-25T22:53:58.718 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.718 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:58.718 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.718 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:58.719 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:53:58.719 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:58.719 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.719 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.719 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:58.719 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:53:58.719 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:58.719 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.720 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.720 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:58.720 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053133+0000", 2024-04-25T22:53:58.720 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0370000000000001e-06 2024-04-25T22:53:58.720 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.720 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.720 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:58.720 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060377+0000", 2024-04-25T22:53:58.721 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0072431070000000004 2024-04-25T22:53:58.721 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.721 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.721 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:58.721 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060388+0000", 2024-04-25T22:53:58.721 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1285e-05 2024-04-25T22:53:58.721 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.722 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.722 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:58.722 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060394+0000", 2024-04-25T22:53:58.722 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1040000000000003e-06 2024-04-25T22:53:58.722 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.722 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.722 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:58.722 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060483+0000", 2024-04-25T22:53:58.723 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.9345000000000006e-05 2024-04-25T22:53:58.723 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.723 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.723 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:58.723 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060566+0000", 2024-04-25T22:53:58.723 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2237999999999994e-05 2024-04-25T22:53:58.723 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.723 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.724 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:58.724 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068057+0000", 2024-04-25T22:53:58.724 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074912210000000002 2024-04-25T22:53:58.724 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.724 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.724 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:58.724 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068090+0000", 2024-04-25T22:53:58.724 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3501000000000003e-05 2024-04-25T22:53:58.724 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.725 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.725 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:58.725 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068134+0000", 2024-04-25T22:53:58.725 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4166999999999999e-05 2024-04-25T22:53:58.725 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:58.725 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:58.725 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:58.725 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.726 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.726 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:66 4.27 4:e5671758:::1000000024f.00000000:head [write 0~6641] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:58.726 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:58.726 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 27.307729254000002, 2024-04-25T22:53:58.726 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075166540000000002, 2024-04-25T22:53:58.726 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:58.726 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:58.726 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:58.727 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:58.727 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:58.727 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:58.727 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 66 2024-04-25T22:53:58.727 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.727 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:58.727 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.727 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:58.727 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:58.728 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:58.728 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.728 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.728 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:58.728 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:58.728 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:58.728 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.728 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.729 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:58.729 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:53:58.729 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4099999999999998e-07 2024-04-25T22:53:58.729 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.729 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.729 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:58.729 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313252+0000", 2024-04-25T22:53:58.729 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5380000000000008e-06 2024-04-25T22:53:58.729 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.730 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.730 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:58.730 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313260+0000", 2024-04-25T22:53:58.730 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2609999999999993e-06 2024-04-25T22:53:58.730 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.730 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.730 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:58.730 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313265+0000", 2024-04-25T22:53:58.731 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4850000000000003e-06 2024-04-25T22:53:58.731 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.731 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.731 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:58.731 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313310+0000", 2024-04-25T22:53:58.731 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5247999999999998e-05 2024-04-25T22:53:58.731 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.731 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.732 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:58.732 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313370+0000", 2024-04-25T22:53:58.732 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0275000000000001e-05 2024-04-25T22:53:58.732 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.732 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.732 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:58.732 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313435+0000", 2024-04-25T22:53:58.732 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4647000000000006e-05 2024-04-25T22:53:58.732 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.733 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.733 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:58.733 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314174+0000", 2024-04-25T22:53:58.733 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00073925 2024-04-25T22:53:58.733 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.733 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.733 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:58.733 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320688+0000", 2024-04-25T22:53:58.734 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.006513418 2024-04-25T22:53:58.734 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.734 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.734 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:58.734 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320736+0000", 2024-04-25T22:53:58.734 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.8114e-05 2024-04-25T22:53:58.734 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.734 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.734 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:58.735 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320758+0000", 2024-04-25T22:53:58.735 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2776999999999999e-05 2024-04-25T22:53:58.735 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:58.735 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:58.735 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:58.735 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.735 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.735 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:68 4.31 4:8fb7f7b7:::10000000251.00000000:head [write 0~2067] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:58.736 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:58.736 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 27.306043475999999, 2024-04-25T22:53:58.736 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0087011669999999992, 2024-04-25T22:53:58.736 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:58.736 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:58.736 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:58.737 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:58.737 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:58.737 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:58.737 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 68 2024-04-25T22:53:58.737 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.737 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:58.738 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.738 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:58.738 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:58.738 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:58.738 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.738 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.738 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:58.739 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:58.739 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:58.739 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.739 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.739 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:58.739 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:53:58.739 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:53:58.740 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.740 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.740 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:58.740 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314933+0000", 2024-04-25T22:53:58.740 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5430000000000004e-06 2024-04-25T22:53:58.740 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.741 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.741 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:58.741 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314944+0000", 2024-04-25T22:53:58.741 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.076e-05 2024-04-25T22:53:58.741 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.741 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.741 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:58.741 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314949+0000", 2024-04-25T22:53:58.742 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1019999999999996e-06 2024-04-25T22:53:58.742 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.742 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.742 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:58.742 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314996+0000", 2024-04-25T22:53:58.742 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7018999999999998e-05 2024-04-25T22:53:58.742 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.743 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.743 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:58.743 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315064+0000", 2024-04-25T22:53:58.743 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8738000000000005e-05 2024-04-25T22:53:58.743 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.743 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.743 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:58.744 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323531+0000", 2024-04-25T22:53:58.744 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084664739999999999 2024-04-25T22:53:58.744 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.744 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.744 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:58.744 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323574+0000", 2024-04-25T22:53:58.744 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3449999999999999e-05 2024-04-25T22:53:58.745 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.745 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.745 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:58.745 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323629+0000", 2024-04-25T22:53:58.745 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4296999999999999e-05 2024-04-25T22:53:58.745 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:58.745 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:58.746 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:58.746 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.746 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.746 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4734.0:69 4.32 e46/13 4:4e8c6251:::10000000252.00000000:head v 46'1, mlcod=0'0)", 2024-04-25T22:53:58.746 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:58.746 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 27.305012208000001, 2024-04-25T22:53:58.746 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076063240000000002, 2024-04-25T22:53:58.746 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:58.747 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:58.747 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:58.747 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:58.747 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.747 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:58.747 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:58.747 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:58.748 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.748 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.748 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:58.748 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:58.748 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:58.748 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.748 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.749 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:58.749 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:53:58.749 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3099999999999997e-07 2024-04-25T22:53:58.749 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.749 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.749 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:58.749 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315964+0000", 2024-04-25T22:53:58.749 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3229999999999999e-06 2024-04-25T22:53:58.750 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.750 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.750 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:58.750 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315973+0000", 2024-04-25T22:53:58.750 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7249999999999992e-06 2024-04-25T22:53:58.750 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.750 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.751 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:58.751 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315978+0000", 2024-04-25T22:53:58.751 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4830000000000001e-06 2024-04-25T22:53:58.751 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.751 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.751 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:58.751 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.316043+0000", 2024-04-25T22:53:58.751 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.5036000000000005e-05 2024-04-25T22:53:58.752 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.752 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.752 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:58.752 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.316055+0000", 2024-04-25T22:53:58.752 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1973999999999999e-05 2024-04-25T22:53:58.752 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.753 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.753 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:58.753 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323521+0000", 2024-04-25T22:53:58.753 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074660239999999999 2024-04-25T22:53:58.753 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.753 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.753 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:58.753 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323565+0000", 2024-04-25T22:53:58.754 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4128000000000002e-05 2024-04-25T22:53:58.754 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:58.754 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:58.754 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:58.754 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.754 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.754 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:72 4.36 4:6cdfec98:::10000000255.00000000:head [write 0~4131] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:58.755 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:58.755 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 27.302968296, 2024-04-25T22:53:58.755 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084820680000000006, 2024-04-25T22:53:58.755 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:58.755 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:58.755 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:58.755 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:58.757 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:58.757 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:58.757 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 72 2024-04-25T22:53:58.758 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.758 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:58.758 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.758 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:58.758 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:58.758 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:58.758 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.758 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.759 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:58.759 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:58.759 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:58.759 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.759 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.759 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:58.759 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:53:58.759 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1800000000000005e-07 2024-04-25T22:53:58.760 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.760 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.760 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:58.760 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318010+0000", 2024-04-25T22:53:58.760 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7399999999999998e-06 2024-04-25T22:53:58.760 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.761 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.761 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:58.761 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318019+0000", 2024-04-25T22:53:58.761 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0170000000000002e-06 2024-04-25T22:53:58.761 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.761 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.761 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:58.761 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318024+0000", 2024-04-25T22:53:58.762 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0150000000000003e-06 2024-04-25T22:53:58.762 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.762 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.762 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:58.762 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318075+0000", 2024-04-25T22:53:58.762 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0537000000000001e-05 2024-04-25T22:53:58.762 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.762 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.762 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:58.763 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318144+0000", 2024-04-25T22:53:58.763 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9432999999999997e-05 2024-04-25T22:53:58.763 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.763 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.763 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:58.763 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326392+0000", 2024-04-25T22:53:58.763 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0082482979999999994 2024-04-25T22:53:58.763 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.764 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.764 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:58.764 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326432+0000", 2024-04-25T22:53:58.764 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9870000000000003e-05 2024-04-25T22:53:58.764 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.764 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.764 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:58.764 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326485+0000", 2024-04-25T22:53:58.765 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2439999999999999e-05 2024-04-25T22:53:58.765 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:58.765 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:58.765 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:58.765 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.765 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.765 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:74 4.10 4:08e6f8ca:::10000000257.00000000:head [write 0~839] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:53:58.765 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:53:58.765 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 27.301494567999999, 2024-04-25T22:53:58.766 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070370720000000001, 2024-04-25T22:53:58.766 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:58.766 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:58.766 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:58.766 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:53:58.766 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:53:58.767 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:58.767 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 74 2024-04-25T22:53:58.767 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.768 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:58.768 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.768 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:58.768 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:53:58.768 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:58.768 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.768 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.768 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:58.768 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:53:58.769 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:58.769 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.769 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.769 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:58.769 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319477+0000", 2024-04-25T22:53:58.769 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1999999999999999e-07 2024-04-25T22:53:58.769 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.769 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.770 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:58.770 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319483+0000", 2024-04-25T22:53:58.770 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4260000000000002e-06 2024-04-25T22:53:58.770 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.770 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.770 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:58.770 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319494+0000", 2024-04-25T22:53:58.770 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.094e-05 2024-04-25T22:53:58.770 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.771 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.771 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:58.771 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319499+0000", 2024-04-25T22:53:58.771 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3789999999999997e-06 2024-04-25T22:53:58.771 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.771 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.771 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:58.772 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319545+0000", 2024-04-25T22:53:58.772 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6149000000000001e-05 2024-04-25T22:53:58.772 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.772 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.772 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:58.772 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319617+0000", 2024-04-25T22:53:58.772 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1792999999999995e-05 2024-04-25T22:53:58.772 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.773 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.773 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:58.773 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326406+0000", 2024-04-25T22:53:58.773 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067895999999999998 2024-04-25T22:53:58.773 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.773 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.773 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:58.773 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326443+0000", 2024-04-25T22:53:58.774 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6828e-05 2024-04-25T22:53:58.774 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.774 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.774 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:58.774 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326514+0000", 2024-04-25T22:53:58.774 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0236999999999999e-05 2024-04-25T22:53:58.774 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:58.774 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:58.774 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:58.775 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.775 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.775 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:128 3.1f 3:f83d65d8:::200.00000004:head [write 876784~3317520 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e48)", 2024-04-25T22:53:58.775 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:36.985410+0000", 2024-04-25T22:53:58.775 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 21.635560949999999, 2024-04-25T22:53:58.775 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0090177360000000002, 2024-04-25T22:53:58.775 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:58.775 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:58.776 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:58.776 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:58.776 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.776 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:58.776 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.985410+0000", 2024-04-25T22:53:58.776 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:58.776 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.776 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.776 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:58.777 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.985410+0000", 2024-04-25T22:53:58.777 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:58.777 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.777 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.777 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:58.778 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.985411+0000", 2024-04-25T22:53:58.778 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8400000000000003e-07 2024-04-25T22:53:58.778 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.778 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.778 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:58.779 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989116+0000", 2024-04-25T22:53:58.779 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037047389999999999 2024-04-25T22:53:58.779 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.779 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.779 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:58.779 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989128+0000", 2024-04-25T22:53:58.779 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1977999999999999e-05 2024-04-25T22:53:58.779 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.780 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.780 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:58.780 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989135+0000", 2024-04-25T22:53:58.780 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5290000000000003e-06 2024-04-25T22:53:58.780 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.780 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.780 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:58.780 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989181+0000", 2024-04-25T22:53:58.780 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6122999999999999e-05 2024-04-25T22:53:58.781 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.781 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.781 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:58.781 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989250+0000", 2024-04-25T22:53:58.781 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8535999999999996e-05 2024-04-25T22:53:58.781 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.781 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.781 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:58.781 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.994272+0000", 2024-04-25T22:53:58.782 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050224889999999998 2024-04-25T22:53:58.782 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.782 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.782 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:58.782 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.994335+0000", 2024-04-25T22:53:58.782 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2588000000000005e-05 2024-04-25T22:53:58.782 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.782 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.783 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:58.783 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.994428+0000", 2024-04-25T22:53:58.783 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2869999999999997e-05 2024-04-25T22:53:58.783 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:58.783 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:58.783 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:58.783 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.783 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.783 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:2150 4.22 4:47cffac6:::10000000a2b.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T22:53:58.784 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:41.078233+0000", 2024-04-25T22:53:58.784 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 17.542737639999999, 2024-04-25T22:53:58.784 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069201510000000003, 2024-04-25T22:53:58.784 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:58.784 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:58.784 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:58.784 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:58.784 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.784 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:58.785 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078233+0000", 2024-04-25T22:53:58.785 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:58.785 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.785 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.785 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:58.785 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078233+0000", 2024-04-25T22:53:58.785 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:58.785 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.786 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.786 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:58.786 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078234+0000", 2024-04-25T22:53:58.786 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1699999999999998e-07 2024-04-25T22:53:58.786 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.786 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.787 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:58.787 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078236+0000", 2024-04-25T22:53:58.787 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.875e-06 2024-04-25T22:53:58.787 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.787 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.787 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:58.788 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078242+0000", 2024-04-25T22:53:58.788 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2450000000000003e-06 2024-04-25T22:53:58.788 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.788 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.789 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:58.789 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078247+0000", 2024-04-25T22:53:58.789 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7450000000000003e-06 2024-04-25T22:53:58.789 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.789 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.789 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:58.790 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078641+0000", 2024-04-25T22:53:58.790 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00039420200000000002 2024-04-25T22:53:58.790 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.790 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.790 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:58.790 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078840+0000", 2024-04-25T22:53:58.790 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000199063 2024-04-25T22:53:58.790 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.791 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.791 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:58.791 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078919+0000", 2024-04-25T22:53:58.791 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9182000000000002e-05 2024-04-25T22:53:58.791 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.791 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.791 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:58.791 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.080906+0000", 2024-04-25T22:53:58.791 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0019866390000000001 2024-04-25T22:53:58.792 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.792 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.792 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:58.792 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085074+0000", 2024-04-25T22:53:58.792 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0041683639999999999 2024-04-25T22:53:58.792 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.792 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.792 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:58.792 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085117+0000", 2024-04-25T22:53:58.793 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2849999999999998e-05 2024-04-25T22:53:58.793 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.793 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.793 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:58.793 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085154+0000", 2024-04-25T22:53:58.793 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6468999999999999e-05 2024-04-25T22:53:58.793 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:58.793 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:58.793 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:58.794 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.794 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.794 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:2160 4.2a 4:57f9ed86:::10000000a3d.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T22:53:58.794 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:53:58.794 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 17.542268350000001, 2024-04-25T22:53:58.794 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0068959959999999997, 2024-04-25T22:53:58.794 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:58.794 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:58.795 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:58.795 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:58.795 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.795 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:58.795 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:53:58.795 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:58.795 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.795 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.795 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:58.796 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:53:58.796 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:58.796 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.796 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.796 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:58.796 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:53:58.796 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7000000000000004e-07 2024-04-25T22:53:58.796 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.797 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.797 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:58.797 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078707+0000", 2024-04-25T22:53:58.797 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.783e-06 2024-04-25T22:53:58.797 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.797 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.797 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:58.797 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078716+0000", 2024-04-25T22:53:58.797 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4800000000000001e-06 2024-04-25T22:53:58.798 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.798 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.798 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:58.798 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078724+0000", 2024-04-25T22:53:58.798 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1519999999999992e-06 2024-04-25T22:53:58.798 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.799 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.799 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:58.799 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078794+0000", 2024-04-25T22:53:58.799 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0500999999999995e-05 2024-04-25T22:53:58.799 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.800 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.800 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:58.800 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078912+0000", 2024-04-25T22:53:58.800 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000117439 2024-04-25T22:53:58.800 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.800 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.801 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:58.801 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079000+0000", 2024-04-25T22:53:58.801 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8092999999999998e-05 2024-04-25T22:53:58.801 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.801 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.801 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:58.801 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.080897+0000", 2024-04-25T22:53:58.802 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0018970899999999999 2024-04-25T22:53:58.802 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.802 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.802 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:58.802 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085517+0000", 2024-04-25T22:53:58.802 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0046198929999999999 2024-04-25T22:53:58.802 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.803 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.803 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:58.803 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085565+0000", 2024-04-25T22:53:58.803 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7777e-05 2024-04-25T22:53:58.803 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.803 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.803 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:58.803 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085599+0000", 2024-04-25T22:53:58.803 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4017999999999999e-05 2024-04-25T22:53:58.804 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:58.804 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:58.804 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:58.804 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.804 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.804 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:2163 4.2a 4:549f79e3:::10000000a43.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T22:53:58.804 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:53:58.804 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 17.542234997000001, 2024-04-25T22:53:58.805 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069469190000000002, 2024-04-25T22:53:58.805 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:53:58.805 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:53:58.805 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:58.805 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:53:58.805 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.805 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:53:58.805 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:53:58.805 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:58.806 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.806 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.806 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:53:58.806 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:53:58.806 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:53:58.806 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.806 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.806 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:53:58.807 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:53:58.807 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1399999999999997e-07 2024-04-25T22:53:58.807 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.807 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.807 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:53:58.807 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078739+0000", 2024-04-25T22:53:58.807 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2960000000000001e-06 2024-04-25T22:53:58.807 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.807 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.808 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:53:58.808 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078745+0000", 2024-04-25T22:53:58.808 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3439999999999997e-06 2024-04-25T22:53:58.808 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.808 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.808 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:53:58.808 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078750+0000", 2024-04-25T22:53:58.808 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3179999999999997e-06 2024-04-25T22:53:58.809 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.809 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.809 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:53:58.809 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079224+0000", 2024-04-25T22:53:58.809 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00047334999999999999 2024-04-25T22:53:58.809 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.810 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.810 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:53:58.810 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079292+0000", 2024-04-25T22:53:58.810 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8708999999999996e-05 2024-04-25T22:53:58.811 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.811 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.811 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:53:58.811 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079342+0000", 2024-04-25T22:53:58.811 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9299999999999999e-05 2024-04-25T22:53:58.811 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.811 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.811 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:58.812 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.081611+0000", 2024-04-25T22:53:58.812 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0022695229999999999 2024-04-25T22:53:58.812 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.812 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.812 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:53:58.812 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085605+0000", 2024-04-25T22:53:58.812 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0039933679999999997 2024-04-25T22:53:58.812 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.812 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.813 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:53:58.813 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085650+0000", 2024-04-25T22:53:58.813 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5111000000000002e-05 2024-04-25T22:53:58.813 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:53:58.813 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:53:58.813 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:53:58.814 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085683+0000", 2024-04-25T22:53:58.814 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3185999999999997e-05 2024-04-25T22:53:58.814 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:58.814 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:58.814 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:58.814 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:53:58.815 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:53:58.815 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:58.817 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:58.817 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:58.816+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:58.859 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2024-04-25T22:53:58.872 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T22:53:58.917 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:58.917+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:58.927 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:58.927 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:58.927 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-04-25T22:53:58.927 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:58.936 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:59.018 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:59.017+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:59.039 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:59.039 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:53:59.039 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:53:59.039 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:53:59.040 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:59.047 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:53:59.119 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:59.118+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:59.152 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:53:59.152 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-04-25T22:53:59.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-04-25T22:53:59.153 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:53:59.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.153 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:53:59.154 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:59.154 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 131.18452156500001, 2024-04-25T22:53:59.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010384338999999999, 2024-04-25T22:53:59.154 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:59.155 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:59.155 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:59.155 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:59.155 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:53:59.156 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:53:59.156 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-04-25T22:53:59.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.156 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:59.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:59.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:59.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:59.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:59.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:59.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:59.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:59.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:53:59.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3600000000000004e-07 2024-04-25T22:53:59.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:59.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965185+0000", 2024-04-25T22:53:59.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.117e-06 2024-04-25T22:53:59.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:59.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965192+0000", 2024-04-25T22:53:59.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3239999999999997e-06 2024-04-25T22:53:59.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:59.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965198+0000", 2024-04-25T22:53:59.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6370000000000004e-06 2024-04-25T22:53:59.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:59.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970973+0000", 2024-04-25T22:53:59.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057748239999999996 2024-04-25T22:53:59.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:59.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971049+0000", 2024-04-25T22:53:59.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6029e-05 2024-04-25T22:53:59.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:59.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971174+0000", 2024-04-25T22:53:59.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012462399999999999 2024-04-25T22:53:59.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:59.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971553+0000", 2024-04-25T22:53:59.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037896499999999999 2024-04-25T22:53:59.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:59.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975482+0000", 2024-04-25T22:53:59.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039297459999999996 2024-04-25T22:53:59.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:59.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975529+0000", 2024-04-25T22:53:59.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6387000000000002e-05 2024-04-25T22:53:59.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:59.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975563+0000", 2024-04-25T22:53:59.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4150000000000003e-05 2024-04-25T22:53:59.165 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:59.165 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:59.166 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:59.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.166 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:59.166 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:59.166 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 126.13747524199999, 2024-04-25T22:53:59.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012637705000000001, 2024-04-25T22:53:59.166 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:59.167 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:59.167 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:59.167 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:59.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:59.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:59.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:59.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:59.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:53:59.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:59.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:59.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012227+0000", 2024-04-25T22:53:59.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.863e-06 2024-04-25T22:53:59.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:59.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012236+0000", 2024-04-25T22:53:59.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1109999999999997e-06 2024-04-25T22:53:59.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:59.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012309+0000", 2024-04-25T22:53:59.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3242000000000001e-05 2024-04-25T22:53:59.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:59.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012324+0000", 2024-04-25T22:53:59.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4837e-05 2024-04-25T22:53:59.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:59.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015060+0000", 2024-04-25T22:53:59.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027363349999999999 2024-04-25T22:53:59.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:59.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015169+0000", 2024-04-25T22:53:59.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108372 2024-04-25T22:53:59.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:59.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015498+0000", 2024-04-25T22:53:59.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032949999999999999 2024-04-25T22:53:59.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:59.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021282+0000", 2024-04-25T22:53:59.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057836429999999998 2024-04-25T22:53:59.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:59.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024709+0000", 2024-04-25T22:53:59.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034271979999999998 2024-04-25T22:53:59.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:59.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024802+0000", 2024-04-25T22:53:59.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2960000000000004e-05 2024-04-25T22:53:59.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:59.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024863+0000", 2024-04-25T22:53:59.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0643999999999997e-05 2024-04-25T22:53:59.175 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:59.175 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:59.175 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:59.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.175 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:59.175 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:59.176 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 126.137351471, 2024-04-25T22:53:59.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012979447999999999, 2024-04-25T22:53:59.176 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:59.176 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:59.176 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:59.176 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:59.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:59.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:59.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:59.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:59.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:59.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:59.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:59.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:53:59.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:53:59.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:59.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012354+0000", 2024-04-25T22:53:59.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7740000000000004e-06 2024-04-25T22:53:59.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:59.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012365+0000", 2024-04-25T22:53:59.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.064e-05 2024-04-25T22:53:59.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:59.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012382+0000", 2024-04-25T22:53:59.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6999000000000001e-05 2024-04-25T22:53:59.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:59.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015958+0000", 2024-04-25T22:53:59.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035765699999999998 2024-04-25T22:53:59.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:59.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016037+0000", 2024-04-25T22:53:59.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8242000000000001e-05 2024-04-25T22:53:59.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:59.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016404+0000", 2024-04-25T22:53:59.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036784300000000002 2024-04-25T22:53:59.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:59.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021294+0000", 2024-04-25T22:53:59.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048890629999999999 2024-04-25T22:53:59.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:59.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024959+0000", 2024-04-25T22:53:59.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036651570000000001 2024-04-25T22:53:59.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:59.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025097+0000", 2024-04-25T22:53:59.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013788099999999999 2024-04-25T22:53:59.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:59.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025328+0000", 2024-04-25T22:53:59.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231492 2024-04-25T22:53:59.184 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:59.184 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:59.184 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:59.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.184 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:59.184 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:59.185 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 126.137263702, 2024-04-25T22:53:59.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013049827, 2024-04-25T22:53:59.185 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:59.185 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:59.185 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:59.185 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:59.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:59.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:59.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:59.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:59.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:53:59.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:59.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:59.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012437+0000", 2024-04-25T22:53:59.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-04-25T22:53:59.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:59.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012440+0000", 2024-04-25T22:53:59.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7609999999999999e-06 2024-04-25T22:53:59.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:59.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012449+0000", 2024-04-25T22:53:59.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.285e-06 2024-04-25T22:53:59.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:59.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012457+0000", 2024-04-25T22:53:59.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9510000000000006e-06 2024-04-25T22:53:59.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:59.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017106+0000", 2024-04-25T22:53:59.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046494220000000003 2024-04-25T22:53:59.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:59.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017223+0000", 2024-04-25T22:53:59.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116824 2024-04-25T22:53:59.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:59.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017345+0000", 2024-04-25T22:53:59.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122175 2024-04-25T22:53:59.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:59.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021299+0000", 2024-04-25T22:53:59.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039534879999999998 2024-04-25T22:53:59.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:59.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025398+0000", 2024-04-25T22:53:59.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040988960000000003 2024-04-25T22:53:59.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:59.193 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025439+0000", 2024-04-25T22:53:59.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0915999999999999e-05 2024-04-25T22:53:59.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.193 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:59.193 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025486+0000", 2024-04-25T22:53:59.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7534999999999998e-05 2024-04-25T22:53:59.193 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:59.193 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:59.194 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:59.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.194 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:59.194 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:59.194 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 126.13723355099999, 2024-04-25T22:53:59.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020988041999999998, 2024-04-25T22:53:59.194 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:59.194 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:59.195 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:59.195 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:59.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:59.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:59.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:59.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:59.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:59.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:59.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:59.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:53:59.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.99e-07 2024-04-25T22:53:59.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:59.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012470+0000", 2024-04-25T22:53:59.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2789999999999999e-06 2024-04-25T22:53:59.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:59.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012477+0000", 2024-04-25T22:53:59.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:53:59.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.198 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:59.198 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012500+0000", 2024-04-25T22:53:59.198 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2490999999999999e-05 2024-04-25T22:53:59.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.198 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:59.198 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021911+0000", 2024-04-25T22:53:59.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094114160000000006 2024-04-25T22:53:59.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:59.199 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022000+0000", 2024-04-25T22:53:59.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8601000000000001e-05 2024-04-25T22:53:59.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:59.200 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022359+0000", 2024-04-25T22:53:59.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035921999999999999 2024-04-25T22:53:59.200 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.200 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.200 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:59.200 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025541+0000", 2024-04-25T22:53:59.201 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031820619999999998 2024-04-25T22:53:59.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:59.202 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033375+0000", 2024-04-25T22:53:59.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078338379999999992 2024-04-25T22:53:59.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.202 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.202 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:59.202 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033415+0000", 2024-04-25T22:53:59.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9527000000000003e-05 2024-04-25T22:53:59.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:59.203 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033455+0000", 2024-04-25T22:53:59.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9932000000000003e-05 2024-04-25T22:53:59.203 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:59.203 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:59.203 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:59.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.204 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:59.204 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:59.204 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 126.137178358, 2024-04-25T22:53:59.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021043857999999999, 2024-04-25T22:53:59.204 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:59.204 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:59.204 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:59.205 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:59.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:59.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:59.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:59.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:59.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:53:59.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:59.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:59.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012523+0000", 2024-04-25T22:53:59.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.361e-06 2024-04-25T22:53:59.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.207 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:59.207 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012530+0000", 2024-04-25T22:53:59.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5440000000000004e-06 2024-04-25T22:53:59.207 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.207 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:59.207 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012541+0000", 2024-04-25T22:53:59.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1745e-05 2024-04-25T22:53:59.207 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:59.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012551+0000", 2024-04-25T22:53:59.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5789999999999993e-06 2024-04-25T22:53:59.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:59.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022709+0000", 2024-04-25T22:53:59.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010157685 2024-04-25T22:53:59.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:59.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022957+0000", 2024-04-25T22:53:59.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024824599999999998 2024-04-25T22:53:59.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:59.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023443+0000", 2024-04-25T22:53:59.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048578599999999999 2024-04-25T22:53:59.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:59.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025547+0000", 2024-04-25T22:53:59.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021044789999999998 2024-04-25T22:53:59.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:59.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033509+0000", 2024-04-25T22:53:59.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0079622180000000001 2024-04-25T22:53:59.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:59.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033542+0000", 2024-04-25T22:53:59.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3018000000000001e-05 2024-04-25T22:53:59.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:59.212 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033566+0000", 2024-04-25T22:53:59.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3197000000000002e-05 2024-04-25T22:53:59.212 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:59.212 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:59.212 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:59.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.213 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:59.213 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:59.213 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 126.137138393, 2024-04-25T22:53:59.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021122696, 2024-04-25T22:53:59.213 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:59.213 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:59.213 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:59.213 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:59.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:59.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:59.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:59.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:59.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:59.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:59.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:59.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:53:59.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:53:59.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:59.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012566+0000", 2024-04-25T22:53:59.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-04-25T22:53:59.216 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.216 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:59.216 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012619+0000", 2024-04-25T22:53:59.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2607e-05 2024-04-25T22:53:59.216 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.216 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:59.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012628+0000", 2024-04-25T22:53:59.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6500000000000008e-06 2024-04-25T22:53:59.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:59.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024024+0000", 2024-04-25T22:53:59.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011396007999999999 2024-04-25T22:53:59.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:59.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024198+0000", 2024-04-25T22:53:59.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000173215 2024-04-25T22:53:59.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:59.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024447+0000", 2024-04-25T22:53:59.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024898500000000002 2024-04-25T22:53:59.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:59.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026431+0000", 2024-04-25T22:53:59.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001984923 2024-04-25T22:53:59.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:59.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033608+0000", 2024-04-25T22:53:59.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071768459999999997 2024-04-25T22:53:59.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:59.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033646+0000", 2024-04-25T22:53:59.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299000000000003e-05 2024-04-25T22:53:59.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:59.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033684+0000", 2024-04-25T22:53:59.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8773000000000003e-05 2024-04-25T22:53:59.221 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:59.221 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:59.221 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:59.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.222 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:59.222 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:59.222 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 126.13704979400001, 2024-04-25T22:53:59.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021175381, 2024-04-25T22:53:59.222 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:59.222 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:59.222 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:59.223 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:59.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:59.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:59.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:59.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:59.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:53:59.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:59.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:59.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012651+0000", 2024-04-25T22:53:59.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:53:59.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:59.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012656+0000", 2024-04-25T22:53:59.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8899999999999998e-06 2024-04-25T22:53:59.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:59.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012666+0000", 2024-04-25T22:53:59.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0346999999999999e-05 2024-04-25T22:53:59.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:59.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012675+0000", 2024-04-25T22:53:59.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9930000000000001e-06 2024-04-25T22:53:59.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:59.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025661+0000", 2024-04-25T22:53:59.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01298531 2024-04-25T22:53:59.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:59.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025757+0000", 2024-04-25T22:53:59.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5822000000000005e-05 2024-04-25T22:53:59.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:59.228 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025907+0000", 2024-04-25T22:53:59.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015051499999999999 2024-04-25T22:53:59.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.228 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:59.228 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026435+0000", 2024-04-25T22:53:59.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052762200000000005 2024-04-25T22:53:59.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:59.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033732+0000", 2024-04-25T22:53:59.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072978419999999997 2024-04-25T22:53:59.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:59.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033787+0000", 2024-04-25T22:53:59.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4703999999999997e-05 2024-04-25T22:53:59.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:59.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033826+0000", 2024-04-25T22:53:59.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8458999999999999e-05 2024-04-25T22:53:59.230 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:59.231 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:59.231 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:59.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.231 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:59.231 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:59.231 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 126.13699438, 2024-04-25T22:53:59.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021244174000000001, 2024-04-25T22:53:59.232 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:59.232 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:59.232 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:59.232 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:59.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:59.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:59.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:59.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:59.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:59.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:59.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:59.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:53:59.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:59.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:59.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012712+0000", 2024-04-25T22:53:59.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.913e-06 2024-04-25T22:53:59.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:59.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012722+0000", 2024-04-25T22:53:59.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2879999999999998e-06 2024-04-25T22:53:59.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:59.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012727+0000", 2024-04-25T22:53:59.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8429999999999998e-06 2024-04-25T22:53:59.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:59.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026099+0000", 2024-04-25T22:53:59.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013371450999999999 2024-04-25T22:53:59.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:59.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026147+0000", 2024-04-25T22:53:59.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7837999999999998e-05 2024-04-25T22:53:59.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:59.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026254+0000", 2024-04-25T22:53:59.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107314 2024-04-25T22:53:59.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:59.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026686+0000", 2024-04-25T22:53:59.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000432428 2024-04-25T22:53:59.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:59.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033873+0000", 2024-04-25T22:53:59.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071864399999999997 2024-04-25T22:53:59.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:59.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033904+0000", 2024-04-25T22:53:59.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1321e-05 2024-04-25T22:53:59.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:59.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033950+0000", 2024-04-25T22:53:59.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5707999999999997e-05 2024-04-25T22:53:59.240 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:59.240 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:59.240 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:59.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.241 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:59.241 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:59.241 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 126.136963995, 2024-04-25T22:53:59.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01096505, 2024-04-25T22:53:59.241 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:59.241 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:59.242 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:59.242 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:59.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:59.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:59.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:59.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:59.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:53:59.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:59.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:59.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012737+0000", 2024-04-25T22:53:59.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:53:59.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:59.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012739+0000", 2024-04-25T22:53:59.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-04-25T22:53:59.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:59.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012743+0000", 2024-04-25T22:53:59.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3239999999999996e-06 2024-04-25T22:53:59.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:59.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012746+0000", 2024-04-25T22:53:59.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.129e-06 2024-04-25T22:53:59.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:59.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012796+0000", 2024-04-25T22:53:59.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9231999999999999e-05 2024-04-25T22:53:59.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:59.247 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012915+0000", 2024-04-25T22:53:59.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119021 2024-04-25T22:53:59.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.247 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:59.247 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013069+0000", 2024-04-25T22:53:59.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015463900000000001 2024-04-25T22:53:59.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.248 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:59.248 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019237+0000", 2024-04-25T22:53:59.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061680329999999998 2024-04-25T22:53:59.248 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.248 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:59.248 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023603+0000", 2024-04-25T22:53:59.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043655860000000003 2024-04-25T22:53:59.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:59.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023659+0000", 2024-04-25T22:53:59.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6484000000000003e-05 2024-04-25T22:53:59.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:59.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023701+0000", 2024-04-25T22:53:59.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1761999999999998e-05 2024-04-25T22:53:59.250 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:59.250 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:59.250 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:59.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.251 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:59.251 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:59.251 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 126.136939047, 2024-04-25T22:53:59.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011234429000000001, 2024-04-25T22:53:59.251 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:59.251 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:59.251 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:59.251 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:59.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.252 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:59.252 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:59.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:59.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.252 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:59.252 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:53:59.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:59.253 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.253 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.253 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:59.253 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012762+0000", 2024-04-25T22:53:59.253 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-04-25T22:53:59.253 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.253 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.253 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:59.253 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012765+0000", 2024-04-25T22:53:59.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2569999999999999e-06 2024-04-25T22:53:59.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:59.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012783+0000", 2024-04-25T22:53:59.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8431999999999999e-05 2024-04-25T22:53:59.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:59.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012799+0000", 2024-04-25T22:53:59.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5438999999999999e-05 2024-04-25T22:53:59.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:59.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013826+0000", 2024-04-25T22:53:59.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010275060000000001 2024-04-25T22:53:59.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.256 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:59.256 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013913+0000", 2024-04-25T22:53:59.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.708e-05 2024-04-25T22:53:59.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.256 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:59.256 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014098+0000", 2024-04-25T22:53:59.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018519399999999999 2024-04-25T22:53:59.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.257 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:59.257 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019684+0000", 2024-04-25T22:53:59.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055860079999999999 2024-04-25T22:53:59.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.257 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:59.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023876+0000", 2024-04-25T22:53:59.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041918800000000003 2024-04-25T22:53:59.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:59.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023957+0000", 2024-04-25T22:53:59.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1165e-05 2024-04-25T22:53:59.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.259 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:59.259 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023995+0000", 2024-04-25T22:53:59.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:53:59.259 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:59.259 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:59.259 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:59.260 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.260 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.260 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:59.260 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:59.260 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 126.136841268, 2024-04-25T22:53:59.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011131200000000001, 2024-04-25T22:53:59.260 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:59.260 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:59.260 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:59.261 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:59.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.261 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:59.261 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:59.261 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:59.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.261 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:59.261 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:53:59.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:59.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:59.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012860+0000", 2024-04-25T22:53:59.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3900000000000004e-07 2024-04-25T22:53:59.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:59.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012865+0000", 2024-04-25T22:53:59.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5609999999999998e-06 2024-04-25T22:53:59.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:59.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012895+0000", 2024-04-25T22:53:59.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9847000000000001e-05 2024-04-25T22:53:59.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:59.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012905+0000", 2024-04-25T22:53:59.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.03e-05 2024-04-25T22:53:59.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:59.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015020+0000", 2024-04-25T22:53:59.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021142940000000001 2024-04-25T22:53:59.265 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.265 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.265 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:59.265 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015182+0000", 2024-04-25T22:53:59.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016248099999999999 2024-04-25T22:53:59.265 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.265 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.265 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:59.266 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015357+0000", 2024-04-25T22:53:59.266 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017471000000000001 2024-04-25T22:53:59.266 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.266 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.266 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:59.266 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021021+0000", 2024-04-25T22:53:59.266 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056638340000000004 2024-04-25T22:53:59.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.267 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:59.267 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023712+0000", 2024-04-25T22:53:59.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026910380000000002 2024-04-25T22:53:59.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.268 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:59.268 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023763+0000", 2024-04-25T22:53:59.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1477999999999997e-05 2024-04-25T22:53:59.268 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.268 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.268 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:59.268 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023990+0000", 2024-04-25T22:53:59.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000226818 2024-04-25T22:53:59.269 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:59.269 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:59.269 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:59.269 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.269 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.269 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:59.269 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:59.269 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 126.136718172, 2024-04-25T22:53:59.269 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011705299000000001, 2024-04-25T22:53:59.270 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:59.270 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:59.270 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:59.270 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:59.270 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.270 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:59.270 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:59.270 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:59.271 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.271 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.271 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:59.271 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:53:59.271 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:59.271 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.271 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.271 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:59.271 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012983+0000", 2024-04-25T22:53:59.272 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:53:59.272 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.272 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.272 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:59.272 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012986+0000", 2024-04-25T22:53:59.272 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5700000000000001e-06 2024-04-25T22:53:59.272 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.272 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.273 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:59.273 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012993+0000", 2024-04-25T22:53:59.273 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8730000000000001e-06 2024-04-25T22:53:59.273 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.273 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.273 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:59.273 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013000+0000", 2024-04-25T22:53:59.273 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1890000000000001e-06 2024-04-25T22:53:59.273 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.274 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.274 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:59.274 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:53:59.274 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002147866 2024-04-25T22:53:59.274 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.274 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.274 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:59.274 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015351+0000", 2024-04-25T22:53:59.275 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020300799999999999 2024-04-25T22:53:59.275 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.275 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.275 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:59.275 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016260+0000", 2024-04-25T22:53:59.275 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00090926799999999997 2024-04-25T22:53:59.275 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.275 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.275 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:59.276 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022669+0000", 2024-04-25T22:53:59.276 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064082849999999997 2024-04-25T22:53:59.276 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.276 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.276 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:59.276 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024584+0000", 2024-04-25T22:53:59.276 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019151699999999999 2024-04-25T22:53:59.276 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.277 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.277 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:59.277 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024643+0000", 2024-04-25T22:53:59.277 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8888999999999998e-05 2024-04-25T22:53:59.277 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.277 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.277 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:59.277 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024687+0000", 2024-04-25T22:53:59.278 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4444999999999999e-05 2024-04-25T22:53:59.278 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:59.278 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:59.278 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:59.278 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.278 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.278 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:59.278 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:59.278 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 126.136690581, 2024-04-25T22:53:59.279 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011249699, 2024-04-25T22:53:59.279 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:59.279 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:59.279 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:59.279 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:59.279 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.279 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:59.279 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:59.279 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:59.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:59.280 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:53:59.280 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:59.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:59.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013010+0000", 2024-04-25T22:53:59.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2099999999999996e-07 2024-04-25T22:53:59.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.281 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:59.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013013+0000", 2024-04-25T22:53:59.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1310000000000002e-06 2024-04-25T22:53:59.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:59.282 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013020+0000", 2024-04-25T22:53:59.282 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3330000000000002e-06 2024-04-25T22:53:59.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:59.282 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013025+0000", 2024-04-25T22:53:59.282 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6760000000000004e-06 2024-04-25T22:53:59.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.283 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:59.283 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013163+0000", 2024-04-25T22:53:59.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013824599999999999 2024-04-25T22:53:59.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.283 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:59.284 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013504+0000", 2024-04-25T22:53:59.284 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034080299999999998 2024-04-25T22:53:59.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.284 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.284 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:59.284 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013613+0000", 2024-04-25T22:53:59.284 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108705 2024-04-25T22:53:59.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.284 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.285 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:59.285 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015831+0000", 2024-04-25T22:53:59.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002217672 2024-04-25T22:53:59.285 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.285 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.285 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:59.285 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024137+0000", 2024-04-25T22:53:59.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0083060489999999994 2024-04-25T22:53:59.285 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.286 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:59.286 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024218+0000", 2024-04-25T22:53:59.286 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1351000000000001e-05 2024-04-25T22:53:59.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.286 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:59.286 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024259+0000", 2024-04-25T22:53:59.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1112000000000002e-05 2024-04-25T22:53:59.287 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:59.287 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:59.287 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:59.287 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.287 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.287 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:59.287 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:59.287 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 126.13660285500001, 2024-04-25T22:53:59.288 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020379749999999999, 2024-04-25T22:53:59.288 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:59.288 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:59.288 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:59.288 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:59.288 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.288 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:59.288 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:59.288 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:59.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.289 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:59.289 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:53:59.289 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:59.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.289 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:59.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013098+0000", 2024-04-25T22:53:59.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:53:59.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:59.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013105+0000", 2024-04-25T22:53:59.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5969999999999997e-06 2024-04-25T22:53:59.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.291 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:59.291 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013190+0000", 2024-04-25T22:53:59.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5618999999999995e-05 2024-04-25T22:53:59.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.291 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.291 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:59.291 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013200+0000", 2024-04-25T22:53:59.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5859999999999994e-06 2024-04-25T22:53:59.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.292 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.292 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:59.292 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020265+0000", 2024-04-25T22:53:59.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070653349999999998 2024-04-25T22:53:59.292 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.292 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.292 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:59.292 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020454+0000", 2024-04-25T22:53:59.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189316 2024-04-25T22:53:59.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:59.293 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020586+0000", 2024-04-25T22:53:59.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013195700000000001 2024-04-25T22:53:59.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:59.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023822+0000", 2024-04-25T22:53:59.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032358529999999999 2024-04-25T22:53:59.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:59.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033409+0000", 2024-04-25T22:53:59.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095870520000000004 2024-04-25T22:53:59.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:59.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033447+0000", 2024-04-25T22:53:59.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7261999999999997e-05 2024-04-25T22:53:59.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:59.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033477+0000", 2024-04-25T22:53:59.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0389e-05 2024-04-25T22:53:59.296 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:59.296 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:59.296 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:59.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.296 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:59.296 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:59.296 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 126.13648634899999, 2024-04-25T22:53:59.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010857383999999999, 2024-04-25T22:53:59.297 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:59.297 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:59.297 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:59.297 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:59.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.297 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:59.297 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:59.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:59.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:59.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:59.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:59.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:59.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:53:59.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:53:59.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:59.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013218+0000", 2024-04-25T22:53:59.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8199999999999998e-06 2024-04-25T22:53:59.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:59.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013226+0000", 2024-04-25T22:53:59.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7649999999999993e-06 2024-04-25T22:53:59.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:59.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013259+0000", 2024-04-25T22:53:59.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2727e-05 2024-04-25T22:53:59.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:59.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014809+0000", 2024-04-25T22:53:59.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001550144 2024-04-25T22:53:59.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:59.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014958+0000", 2024-04-25T22:53:59.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014890300000000001 2024-04-25T22:53:59.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:53:59.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015087+0000", 2024-04-25T22:53:59.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012939200000000001 2024-04-25T22:53:59.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:59.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020212+0000", 2024-04-25T22:53:59.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051248939999999996 2024-04-25T22:53:59.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.303 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:59.303 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023699+0000", 2024-04-25T22:53:59.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034873289999999999 2024-04-25T22:53:59.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.303 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:59.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024014+0000", 2024-04-25T22:53:59.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031473999999999999 2024-04-25T22:53:59.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:59.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024071+0000", 2024-04-25T22:53:59.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7040000000000003e-05 2024-04-25T22:53:59.304 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:59.305 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:59.305 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:59.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.305 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:59.305 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:59.305 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 126.136431644, 2024-04-25T22:53:59.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012329677000000001, 2024-04-25T22:53:59.305 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:59.306 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:59.306 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:59.306 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:59.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:59.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:59.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:59.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:59.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:53:59.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:59.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:59.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013269+0000", 2024-04-25T22:53:59.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5000000000000002e-07 2024-04-25T22:53:59.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:59.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:53:59.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6909999999999999e-06 2024-04-25T22:53:59.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:59.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013284+0000", 2024-04-25T22:53:59.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0963e-05 2024-04-25T22:53:59.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:59.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013361+0000", 2024-04-25T22:53:59.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7379999999999994e-05 2024-04-25T22:53:59.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:59.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013448+0000", 2024-04-25T22:53:59.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6990000000000006e-05 2024-04-25T22:53:59.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:59.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013632+0000", 2024-04-25T22:53:59.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018396800000000001 2024-04-25T22:53:59.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:53:59.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013800+0000", 2024-04-25T22:53:59.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167467 2024-04-25T22:53:59.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:59.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.018570+0000", 2024-04-25T22:53:59.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047701460000000003 2024-04-25T22:53:59.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:53:59.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025507+0000", 2024-04-25T22:53:59.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069372039999999998 2024-04-25T22:53:59.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:59.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025562+0000", 2024-04-25T22:53:59.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4858999999999998e-05 2024-04-25T22:53:59.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:59.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025598+0000", 2024-04-25T22:53:59.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6259e-05 2024-04-25T22:53:59.314 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:59.314 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:59.314 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:59.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.314 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:53:59.314 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:59.314 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 126.136299771, 2024-04-25T22:53:59.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020176666999999999, 2024-04-25T22:53:59.315 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:59.315 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:59.315 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:53:59.315 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:59.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:59.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:59.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:59.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:59.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:53:59.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:59.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:59.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:53:59.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-04-25T22:53:59.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:59.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013405+0000", 2024-04-25T22:53:59.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0559999999999998e-06 2024-04-25T22:53:59.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:59.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013422+0000", 2024-04-25T22:53:59.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6770999999999999e-05 2024-04-25T22:53:59.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:59.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013431+0000", 2024-04-25T22:53:59.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5019999999999998e-06 2024-04-25T22:53:59.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:59.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021720+0000", 2024-04-25T22:53:59.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082884340000000008 2024-04-25T22:53:59.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:59.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022122+0000", 2024-04-25T22:53:59.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000401634 2024-04-25T22:53:59.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:59.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033577+0000", 2024-04-25T22:53:59.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011455435999999999 2024-04-25T22:53:59.320 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:59.320 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:59.320 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:59.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.321 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4734.0:31 4.1b 4:d9872866:::1000000021d.00000002:head [write 0~3618035] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-25T22:53:59.321 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:53:59.321 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.096725508999999, 2024-04-25T22:53:59.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011647062, 2024-04-25T22:53:59.321 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:59.321 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:59.322 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:59.322 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:53:59.322 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4734", 2024-04-25T22:53:59.322 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:53:59.322 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 31 2024-04-25T22:53:59.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.322 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:59.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:59.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:53:59.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:59.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:59.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:53:59.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:59.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:59.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:53:59.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5700000000000001e-07 2024-04-25T22:53:59.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:59.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059575+0000", 2024-04-25T22:53:59.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0065991380000000001 2024-04-25T22:53:59.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:59.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059586+0000", 2024-04-25T22:53:59.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1438e-05 2024-04-25T22:53:59.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:59.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059592+0000", 2024-04-25T22:53:59.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2899999999999999e-06 2024-04-25T22:53:59.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:59.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059660+0000", 2024-04-25T22:53:59.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7980999999999998e-05 2024-04-25T22:53:59.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:59.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059757+0000", 2024-04-25T22:53:59.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6340000000000003e-05 2024-04-25T22:53:59.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:59.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.064487+0000", 2024-04-25T22:53:59.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004730621 2024-04-25T22:53:59.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:59.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.064538+0000", 2024-04-25T22:53:59.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0801999999999999e-05 2024-04-25T22:53:59.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:59.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.064622+0000", 2024-04-25T22:53:59.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3595000000000002e-05 2024-04-25T22:53:59.329 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:59.329 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:59.329 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:59.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.329 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:97 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-25T22:53:59.329 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:53:33.026298+0000", 2024-04-25T22:53:59.329 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.123401694999998, 2024-04-25T22:53:59.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015641848999999999, 2024-04-25T22:53:59.330 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:53:59.330 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:53:59.330 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:53:59.330 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:53:59.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:53:59.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026298+0000", 2024-04-25T22:53:59.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:59.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:53:59.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026298+0000", 2024-04-25T22:53:59.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:53:59.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:53:59.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026299+0000", 2024-04-25T22:53:59.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7299999999999996e-07 2024-04-25T22:53:59.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:53:59.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026464+0000", 2024-04-25T22:53:59.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016477700000000001 2024-04-25T22:53:59.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:53:59.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026472+0000", 2024-04-25T22:53:59.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1589999999999993e-06 2024-04-25T22:53:59.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:53:59.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026476+0000", 2024-04-25T22:53:59.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4580000000000003e-06 2024-04-25T22:53:59.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:53:59.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026550+0000", 2024-04-25T22:53:59.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3836000000000003e-05 2024-04-25T22:53:59.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:53:59.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026644+0000", 2024-04-25T22:53:59.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4022000000000002e-05 2024-04-25T22:53:59.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:53:59.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.041838+0000", 2024-04-25T22:53:59.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015193814999999999 2024-04-25T22:53:59.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:53:59.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.041874+0000", 2024-04-25T22:53:59.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5856999999999999e-05 2024-04-25T22:53:59.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:53:59.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:53:59.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:53:59.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.041940+0000", 2024-04-25T22:53:59.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6352000000000004e-05 2024-04-25T22:53:59.336 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:59.337 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:59.337 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:59.337 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:53:59.337 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:53:59.337 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:53:59.338 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:53:59.339 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:59.338+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:59.340 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 32 2024-04-25T22:53:59.341 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:53:59.341 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T22:53:59.395 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-25T22:53:59.439 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:59.438+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:59.446 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:53:59.447 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:53:59.447 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-25T22:53:59.447 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:53:59.456 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:53:59.515 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-25T22:53:59.516 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:53:59.516 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:53:59.536 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-25T22:53:59.536 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:53:59.540 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:59.539+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:59.541 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:53:59.541 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:53:59.598 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:59.598 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:59.606 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:53:59.650 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:59.649+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:59.692 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2024-04-25T22:53:59.709 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:59.709 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:59.711 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T22:53:59.717 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:53:59.741 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~76s 2024-04-25T22:53:59.762 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:59.761+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:59.825 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:59.825 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:59.834 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:53:59.877 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:53:59.874+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:53:59.943 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:53:59.943+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:53:59.977 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:53:59.977 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:53:59.986 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:54:00.019 INFO:teuthology.orchestra.run.smithi052.stderr:listed 0 entries 2024-04-25T22:54:00.033 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi052.front.sepia.ceph.com... 2024-04-25T22:54:00.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:54:00.033 DEBUG:teuthology.orchestra.run.smithi052:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-25T22:54:00.044 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:54:00.043+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:54:00.056 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi052.stderr:ceph-fuse[31785]: fuse finished with error 0 and tester_r 0 2024-04-25T22:54:00.065 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T22:54:00.096 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:54:00.097 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:54:00.109 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:54:00.154 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:54:00.153+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:54:00.213 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:54:00.214 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:54:00.224 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:54:00.247 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:54:00.246+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:54:00.347 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:54:00.346+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:54:00.364 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:54:00.364 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:54:00.373 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:54:00.379 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is unset 2024-04-25T22:54:00.457 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:54:00.456+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:54:00.516 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:54:00.516 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:54:00.524 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:54:00.568 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:54:00.567+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:54:00.628 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:54:00.628 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:54:00.638 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:54:00.679 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:54:00.678+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:54:00.750 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:54:00.749+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:54:00.780 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:54:00.780 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:54:00.788 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:54:00.873 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:54:00.872+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:54:00.930 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:54:00.931 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:54:00.939 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:54:00.981 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:54:00.980+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:54:01.044 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:54:01.044 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:54:01.053 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:54:01.053 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:54:01.052+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:54:01.154 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:54:01.153+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:54:01.195 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:54:01.195 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:54:01.204 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:54:01.288 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:54:01.287+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:54:01.348 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:54:01.348 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:54:01.355 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:54:01.354+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:54:01.356 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:54:01.456 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:54:01.455+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:54:01.461 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:54:01.461 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:54:01.469 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:54:01.542 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:54:01.557 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:54:01.557+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:54:01.611 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:54:01.611 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:54:01.621 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:54:01.658 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:54:01.657+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:54:01.679 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-25T22:54:01.680 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:54:01.680 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:54:01.698 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-25T22:54:01.699 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:54:01.702 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:54:01.702 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:54:01.725 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:54:01.725 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-04-25T22:54:01.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-04-25T22:54:01.726 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:54:01.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.726 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:54:01.726 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:54:01.726 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 133.75830513400001, 2024-04-25T22:54:01.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010384338999999999, 2024-04-25T22:54:01.726 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:01.727 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:01.727 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:01.727 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:54:01.727 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:54:01.727 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:54:01.727 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-04-25T22:54:01.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.728 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:01.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:01.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:54:01.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:01.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:01.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:54:01.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:01.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:01.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:54:01.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3600000000000004e-07 2024-04-25T22:54:01.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:01.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965185+0000", 2024-04-25T22:54:01.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.117e-06 2024-04-25T22:54:01.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:01.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965192+0000", 2024-04-25T22:54:01.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3239999999999997e-06 2024-04-25T22:54:01.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:01.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965198+0000", 2024-04-25T22:54:01.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6370000000000004e-06 2024-04-25T22:54:01.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:01.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970973+0000", 2024-04-25T22:54:01.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057748239999999996 2024-04-25T22:54:01.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:01.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971049+0000", 2024-04-25T22:54:01.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6029e-05 2024-04-25T22:54:01.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:54:01.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971174+0000", 2024-04-25T22:54:01.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012462399999999999 2024-04-25T22:54:01.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:01.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971553+0000", 2024-04-25T22:54:01.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037896499999999999 2024-04-25T22:54:01.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:01.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975482+0000", 2024-04-25T22:54:01.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039297459999999996 2024-04-25T22:54:01.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:01.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975529+0000", 2024-04-25T22:54:01.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6387000000000002e-05 2024-04-25T22:54:01.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:01.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975563+0000", 2024-04-25T22:54:01.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4150000000000003e-05 2024-04-25T22:54:01.735 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:01.735 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:01.736 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:01.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.736 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:01.736 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:54:01.736 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 128.71125881099999, 2024-04-25T22:54:01.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012637705000000001, 2024-04-25T22:54:01.736 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:01.736 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:01.737 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:01.737 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:01.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:01.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:54:01.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:01.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:01.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:54:01.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:01.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:01.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012227+0000", 2024-04-25T22:54:01.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.863e-06 2024-04-25T22:54:01.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:01.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012236+0000", 2024-04-25T22:54:01.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1109999999999997e-06 2024-04-25T22:54:01.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:01.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012309+0000", 2024-04-25T22:54:01.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3242000000000001e-05 2024-04-25T22:54:01.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:01.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012324+0000", 2024-04-25T22:54:01.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4837e-05 2024-04-25T22:54:01.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:01.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015060+0000", 2024-04-25T22:54:01.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027363349999999999 2024-04-25T22:54:01.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:01.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015169+0000", 2024-04-25T22:54:01.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108372 2024-04-25T22:54:01.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:54:01.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015498+0000", 2024-04-25T22:54:01.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032949999999999999 2024-04-25T22:54:01.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:01.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021282+0000", 2024-04-25T22:54:01.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057836429999999998 2024-04-25T22:54:01.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:01.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024709+0000", 2024-04-25T22:54:01.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034271979999999998 2024-04-25T22:54:01.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:01.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024802+0000", 2024-04-25T22:54:01.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2960000000000004e-05 2024-04-25T22:54:01.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:01.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024863+0000", 2024-04-25T22:54:01.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0643999999999997e-05 2024-04-25T22:54:01.744 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:01.745 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:01.745 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:01.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.745 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:01.745 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:54:01.745 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 128.71113503999999, 2024-04-25T22:54:01.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012979447999999999, 2024-04-25T22:54:01.745 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:01.746 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:01.746 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:01.746 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:01.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:01.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:54:01.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:01.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:01.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:54:01.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:01.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:01.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:54:01.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:54:01.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:01.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012354+0000", 2024-04-25T22:54:01.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7740000000000004e-06 2024-04-25T22:54:01.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:01.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012365+0000", 2024-04-25T22:54:01.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.064e-05 2024-04-25T22:54:01.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:01.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012382+0000", 2024-04-25T22:54:01.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6999000000000001e-05 2024-04-25T22:54:01.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:01.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015958+0000", 2024-04-25T22:54:01.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035765699999999998 2024-04-25T22:54:01.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:01.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016037+0000", 2024-04-25T22:54:01.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8242000000000001e-05 2024-04-25T22:54:01.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:54:01.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016404+0000", 2024-04-25T22:54:01.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036784300000000002 2024-04-25T22:54:01.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:01.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021294+0000", 2024-04-25T22:54:01.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048890629999999999 2024-04-25T22:54:01.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:01.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024959+0000", 2024-04-25T22:54:01.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036651570000000001 2024-04-25T22:54:01.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:01.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025097+0000", 2024-04-25T22:54:01.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013788099999999999 2024-04-25T22:54:01.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:01.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025328+0000", 2024-04-25T22:54:01.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231492 2024-04-25T22:54:01.754 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:01.754 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:01.754 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:01.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.755 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:01.755 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:54:01.755 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 128.71104727100001, 2024-04-25T22:54:01.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013049827, 2024-04-25T22:54:01.755 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:01.755 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:01.756 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:01.756 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:01.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:01.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:54:01.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:01.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:01.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:54:01.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:01.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:01.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012437+0000", 2024-04-25T22:54:01.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-04-25T22:54:01.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:01.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012440+0000", 2024-04-25T22:54:01.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7609999999999999e-06 2024-04-25T22:54:01.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:01.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012449+0000", 2024-04-25T22:54:01.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.285e-06 2024-04-25T22:54:01.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:01.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012457+0000", 2024-04-25T22:54:01.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9510000000000006e-06 2024-04-25T22:54:01.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:01.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017106+0000", 2024-04-25T22:54:01.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046494220000000003 2024-04-25T22:54:01.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:01.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017223+0000", 2024-04-25T22:54:01.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116824 2024-04-25T22:54:01.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:54:01.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017345+0000", 2024-04-25T22:54:01.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122175 2024-04-25T22:54:01.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:01.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021299+0000", 2024-04-25T22:54:01.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039534879999999998 2024-04-25T22:54:01.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:01.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025398+0000", 2024-04-25T22:54:01.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040988960000000003 2024-04-25T22:54:01.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:01.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025439+0000", 2024-04-25T22:54:01.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0915999999999999e-05 2024-04-25T22:54:01.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:01.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025486+0000", 2024-04-25T22:54:01.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7534999999999998e-05 2024-04-25T22:54:01.763 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:01.763 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:01.764 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:01.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.764 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:01.764 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:54:01.764 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 128.71101712000001, 2024-04-25T22:54:01.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020988041999999998, 2024-04-25T22:54:01.764 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:01.764 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:01.765 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:01.765 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:01.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:01.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:54:01.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:01.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:01.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:54:01.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:01.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:01.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:54:01.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.99e-07 2024-04-25T22:54:01.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:01.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012470+0000", 2024-04-25T22:54:01.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2789999999999999e-06 2024-04-25T22:54:01.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:01.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012477+0000", 2024-04-25T22:54:01.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:54:01.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:01.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012500+0000", 2024-04-25T22:54:01.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2490999999999999e-05 2024-04-25T22:54:01.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:01.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021911+0000", 2024-04-25T22:54:01.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094114160000000006 2024-04-25T22:54:01.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:01.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022000+0000", 2024-04-25T22:54:01.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8601000000000001e-05 2024-04-25T22:54:01.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:54:01.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022359+0000", 2024-04-25T22:54:01.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035921999999999999 2024-04-25T22:54:01.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:01.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025541+0000", 2024-04-25T22:54:01.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031820619999999998 2024-04-25T22:54:01.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:01.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033375+0000", 2024-04-25T22:54:01.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078338379999999992 2024-04-25T22:54:01.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:01.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033415+0000", 2024-04-25T22:54:01.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9527000000000003e-05 2024-04-25T22:54:01.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:01.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033455+0000", 2024-04-25T22:54:01.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9932000000000003e-05 2024-04-25T22:54:01.773 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:01.773 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:01.773 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:01.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.773 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:01.774 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:54:01.774 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 128.710961927, 2024-04-25T22:54:01.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021043857999999999, 2024-04-25T22:54:01.774 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:01.774 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:01.774 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:01.774 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:01.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:01.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:54:01.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:01.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:01.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:54:01.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:01.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:01.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012523+0000", 2024-04-25T22:54:01.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.361e-06 2024-04-25T22:54:01.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:01.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012530+0000", 2024-04-25T22:54:01.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5440000000000004e-06 2024-04-25T22:54:01.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:01.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012541+0000", 2024-04-25T22:54:01.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1745e-05 2024-04-25T22:54:01.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:01.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012551+0000", 2024-04-25T22:54:01.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5789999999999993e-06 2024-04-25T22:54:01.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:01.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022709+0000", 2024-04-25T22:54:01.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010157685 2024-04-25T22:54:01.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:01.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022957+0000", 2024-04-25T22:54:01.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024824599999999998 2024-04-25T22:54:01.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:54:01.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023443+0000", 2024-04-25T22:54:01.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048578599999999999 2024-04-25T22:54:01.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:01.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025547+0000", 2024-04-25T22:54:01.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021044789999999998 2024-04-25T22:54:01.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:01.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033509+0000", 2024-04-25T22:54:01.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0079622180000000001 2024-04-25T22:54:01.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:01.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033542+0000", 2024-04-25T22:54:01.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3018000000000001e-05 2024-04-25T22:54:01.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:01.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033566+0000", 2024-04-25T22:54:01.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3197000000000002e-05 2024-04-25T22:54:01.782 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:01.782 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:01.782 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:01.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.782 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:01.782 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:54:01.783 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 128.71092196199999, 2024-04-25T22:54:01.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021122696, 2024-04-25T22:54:01.783 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:01.783 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:01.783 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:01.783 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:01.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:01.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:54:01.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:01.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:01.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:54:01.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:01.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:01.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:54:01.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:54:01.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:01.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012566+0000", 2024-04-25T22:54:01.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-04-25T22:54:01.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:01.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012619+0000", 2024-04-25T22:54:01.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2607e-05 2024-04-25T22:54:01.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:01.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012628+0000", 2024-04-25T22:54:01.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6500000000000008e-06 2024-04-25T22:54:01.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:01.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024024+0000", 2024-04-25T22:54:01.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011396007999999999 2024-04-25T22:54:01.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:01.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024198+0000", 2024-04-25T22:54:01.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000173215 2024-04-25T22:54:01.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:54:01.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024447+0000", 2024-04-25T22:54:01.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024898500000000002 2024-04-25T22:54:01.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:01.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026431+0000", 2024-04-25T22:54:01.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001984923 2024-04-25T22:54:01.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:01.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033608+0000", 2024-04-25T22:54:01.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071768459999999997 2024-04-25T22:54:01.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:01.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033646+0000", 2024-04-25T22:54:01.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299000000000003e-05 2024-04-25T22:54:01.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:01.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033684+0000", 2024-04-25T22:54:01.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8773000000000003e-05 2024-04-25T22:54:01.791 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:01.791 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:01.791 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:01.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.791 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:01.791 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:54:01.792 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 128.71083336300001, 2024-04-25T22:54:01.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021175381, 2024-04-25T22:54:01.792 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:01.792 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:01.792 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:01.792 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:01.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:01.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:54:01.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:01.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:01.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:54:01.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:01.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:01.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012651+0000", 2024-04-25T22:54:01.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:54:01.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:01.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012656+0000", 2024-04-25T22:54:01.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8899999999999998e-06 2024-04-25T22:54:01.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:01.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012666+0000", 2024-04-25T22:54:01.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0346999999999999e-05 2024-04-25T22:54:01.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:01.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012675+0000", 2024-04-25T22:54:01.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9930000000000001e-06 2024-04-25T22:54:01.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:01.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025661+0000", 2024-04-25T22:54:01.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01298531 2024-04-25T22:54:01.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:01.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025757+0000", 2024-04-25T22:54:01.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5822000000000005e-05 2024-04-25T22:54:01.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:54:01.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025907+0000", 2024-04-25T22:54:01.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015051499999999999 2024-04-25T22:54:01.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:01.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026435+0000", 2024-04-25T22:54:01.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052762200000000005 2024-04-25T22:54:01.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:01.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033732+0000", 2024-04-25T22:54:01.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072978419999999997 2024-04-25T22:54:01.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:01.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033787+0000", 2024-04-25T22:54:01.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4703999999999997e-05 2024-04-25T22:54:01.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:01.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033826+0000", 2024-04-25T22:54:01.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8458999999999999e-05 2024-04-25T22:54:01.800 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:01.800 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:01.800 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:01.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.800 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:01.800 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:54:01.800 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 128.710777949, 2024-04-25T22:54:01.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021244174000000001, 2024-04-25T22:54:01.801 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:01.801 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:01.801 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:01.801 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:01.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:01.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:54:01.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:01.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:01.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:54:01.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:01.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:01.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:54:01.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:54:01.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:01.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012712+0000", 2024-04-25T22:54:01.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.913e-06 2024-04-25T22:54:01.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:01.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012722+0000", 2024-04-25T22:54:01.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2879999999999998e-06 2024-04-25T22:54:01.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:01.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012727+0000", 2024-04-25T22:54:01.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8429999999999998e-06 2024-04-25T22:54:01.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:01.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026099+0000", 2024-04-25T22:54:01.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013371450999999999 2024-04-25T22:54:01.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:01.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026147+0000", 2024-04-25T22:54:01.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7837999999999998e-05 2024-04-25T22:54:01.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:54:01.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026254+0000", 2024-04-25T22:54:01.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107314 2024-04-25T22:54:01.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:01.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026686+0000", 2024-04-25T22:54:01.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000432428 2024-04-25T22:54:01.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:01.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033873+0000", 2024-04-25T22:54:01.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071864399999999997 2024-04-25T22:54:01.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:01.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033904+0000", 2024-04-25T22:54:01.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1321e-05 2024-04-25T22:54:01.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:01.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033950+0000", 2024-04-25T22:54:01.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5707999999999997e-05 2024-04-25T22:54:01.809 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:01.809 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:01.809 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:01.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.809 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:01.809 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:54:01.809 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 128.710747564, 2024-04-25T22:54:01.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01096505, 2024-04-25T22:54:01.810 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:01.810 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:01.810 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:01.810 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:01.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:01.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:54:01.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:01.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:01.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:54:01.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:01.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:01.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012737+0000", 2024-04-25T22:54:01.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:54:01.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:01.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012739+0000", 2024-04-25T22:54:01.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-04-25T22:54:01.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:01.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012743+0000", 2024-04-25T22:54:01.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3239999999999996e-06 2024-04-25T22:54:01.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:01.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012746+0000", 2024-04-25T22:54:01.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.129e-06 2024-04-25T22:54:01.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:01.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012796+0000", 2024-04-25T22:54:01.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9231999999999999e-05 2024-04-25T22:54:01.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:01.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012915+0000", 2024-04-25T22:54:01.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119021 2024-04-25T22:54:01.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:54:01.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013069+0000", 2024-04-25T22:54:01.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015463900000000001 2024-04-25T22:54:01.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:01.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019237+0000", 2024-04-25T22:54:01.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061680329999999998 2024-04-25T22:54:01.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:01.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023603+0000", 2024-04-25T22:54:01.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043655860000000003 2024-04-25T22:54:01.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:01.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023659+0000", 2024-04-25T22:54:01.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6484000000000003e-05 2024-04-25T22:54:01.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:01.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023701+0000", 2024-04-25T22:54:01.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1761999999999998e-05 2024-04-25T22:54:01.818 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:01.818 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:01.818 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:01.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.818 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:01.818 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:54:01.818 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 128.710722616, 2024-04-25T22:54:01.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011234429000000001, 2024-04-25T22:54:01.819 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:01.819 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:01.819 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:01.819 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:01.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:01.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:54:01.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:01.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:01.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:54:01.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:01.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:01.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012762+0000", 2024-04-25T22:54:01.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-04-25T22:54:01.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:01.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012765+0000", 2024-04-25T22:54:01.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2569999999999999e-06 2024-04-25T22:54:01.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.822 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:01.822 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012783+0000", 2024-04-25T22:54:01.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8431999999999999e-05 2024-04-25T22:54:01.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.822 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:01.822 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012799+0000", 2024-04-25T22:54:01.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5438999999999999e-05 2024-04-25T22:54:01.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:01.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013826+0000", 2024-04-25T22:54:01.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010275060000000001 2024-04-25T22:54:01.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:01.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013913+0000", 2024-04-25T22:54:01.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.708e-05 2024-04-25T22:54:01.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:54:01.824 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014098+0000", 2024-04-25T22:54:01.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018519399999999999 2024-04-25T22:54:01.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:01.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019684+0000", 2024-04-25T22:54:01.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055860079999999999 2024-04-25T22:54:01.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:01.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023876+0000", 2024-04-25T22:54:01.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041918800000000003 2024-04-25T22:54:01.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.826 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:01.826 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023957+0000", 2024-04-25T22:54:01.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1165e-05 2024-04-25T22:54:01.826 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.826 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.826 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:01.826 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023995+0000", 2024-04-25T22:54:01.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:54:01.827 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:01.827 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:01.827 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:01.827 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.827 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:01.827 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:54:01.827 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 128.71062483700001, 2024-04-25T22:54:01.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011131200000000001, 2024-04-25T22:54:01.828 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:01.828 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:01.828 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:01.828 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:01.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.828 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:01.828 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:54:01.828 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:01.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.829 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:01.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:54:01.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:01.829 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.829 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:01.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012860+0000", 2024-04-25T22:54:01.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3900000000000004e-07 2024-04-25T22:54:01.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.830 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:01.830 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012865+0000", 2024-04-25T22:54:01.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5609999999999998e-06 2024-04-25T22:54:01.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.830 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:01.831 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012895+0000", 2024-04-25T22:54:01.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9847000000000001e-05 2024-04-25T22:54:01.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.831 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.831 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:01.831 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012905+0000", 2024-04-25T22:54:01.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.03e-05 2024-04-25T22:54:01.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.832 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:01.832 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015020+0000", 2024-04-25T22:54:01.832 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021142940000000001 2024-04-25T22:54:01.832 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.832 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:01.832 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015182+0000", 2024-04-25T22:54:01.832 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016248099999999999 2024-04-25T22:54:01.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.833 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:54:01.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015357+0000", 2024-04-25T22:54:01.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017471000000000001 2024-04-25T22:54:01.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.833 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:01.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021021+0000", 2024-04-25T22:54:01.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056638340000000004 2024-04-25T22:54:01.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:01.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023712+0000", 2024-04-25T22:54:01.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026910380000000002 2024-04-25T22:54:01.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:01.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023763+0000", 2024-04-25T22:54:01.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1477999999999997e-05 2024-04-25T22:54:01.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:01.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023990+0000", 2024-04-25T22:54:01.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000226818 2024-04-25T22:54:01.835 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:01.836 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:01.836 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:01.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.836 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:01.836 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:54:01.836 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 128.710501741, 2024-04-25T22:54:01.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011705299000000001, 2024-04-25T22:54:01.836 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:01.837 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:01.837 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:01.837 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:01.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:01.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:54:01.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:01.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:01.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:54:01.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:01.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:01.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012983+0000", 2024-04-25T22:54:01.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:54:01.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:01.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012986+0000", 2024-04-25T22:54:01.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5700000000000001e-06 2024-04-25T22:54:01.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:01.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012993+0000", 2024-04-25T22:54:01.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8730000000000001e-06 2024-04-25T22:54:01.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:01.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013000+0000", 2024-04-25T22:54:01.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1890000000000001e-06 2024-04-25T22:54:01.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:01.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:54:01.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002147866 2024-04-25T22:54:01.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:01.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015351+0000", 2024-04-25T22:54:01.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020300799999999999 2024-04-25T22:54:01.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:54:01.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016260+0000", 2024-04-25T22:54:01.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00090926799999999997 2024-04-25T22:54:01.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:01.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022669+0000", 2024-04-25T22:54:01.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064082849999999997 2024-04-25T22:54:01.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:01.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024584+0000", 2024-04-25T22:54:01.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019151699999999999 2024-04-25T22:54:01.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.844 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:01.844 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024643+0000", 2024-04-25T22:54:01.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8888999999999998e-05 2024-04-25T22:54:01.844 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.844 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:01.844 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024687+0000", 2024-04-25T22:54:01.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4444999999999999e-05 2024-04-25T22:54:01.845 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:01.845 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:01.845 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:01.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.845 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:01.845 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:54:01.845 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 128.71047415000001, 2024-04-25T22:54:01.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011249699, 2024-04-25T22:54:01.846 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:01.846 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:01.846 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:01.846 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:01.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:01.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:54:01.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:01.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:01.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:54:01.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:01.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:01.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013010+0000", 2024-04-25T22:54:01.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2099999999999996e-07 2024-04-25T22:54:01.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:01.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013013+0000", 2024-04-25T22:54:01.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1310000000000002e-06 2024-04-25T22:54:01.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:01.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013020+0000", 2024-04-25T22:54:01.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3330000000000002e-06 2024-04-25T22:54:01.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.849 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:01.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013025+0000", 2024-04-25T22:54:01.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6760000000000004e-06 2024-04-25T22:54:01.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.850 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:01.850 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013163+0000", 2024-04-25T22:54:01.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013824599999999999 2024-04-25T22:54:01.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.850 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:01.850 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013504+0000", 2024-04-25T22:54:01.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034080299999999998 2024-04-25T22:54:01.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:54:01.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013613+0000", 2024-04-25T22:54:01.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108705 2024-04-25T22:54:01.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:01.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015831+0000", 2024-04-25T22:54:01.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002217672 2024-04-25T22:54:01.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:01.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024137+0000", 2024-04-25T22:54:01.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0083060489999999994 2024-04-25T22:54:01.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.853 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:01.853 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024218+0000", 2024-04-25T22:54:01.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1351000000000001e-05 2024-04-25T22:54:01.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.853 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:01.853 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024259+0000", 2024-04-25T22:54:01.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1112000000000002e-05 2024-04-25T22:54:01.854 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:01.854 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:01.854 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:01.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.854 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:01.854 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:54:01.854 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 128.71038642400001, 2024-04-25T22:54:01.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020379749999999999, 2024-04-25T22:54:01.855 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:01.855 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:01.855 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:01.855 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:01.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:01.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:54:01.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:01.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:01.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:54:01.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:01.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:01.857 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013098+0000", 2024-04-25T22:54:01.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:54:01.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.857 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:01.857 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013105+0000", 2024-04-25T22:54:01.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5969999999999997e-06 2024-04-25T22:54:01.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.858 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:01.858 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013190+0000", 2024-04-25T22:54:01.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5618999999999995e-05 2024-04-25T22:54:01.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.858 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:01.858 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013200+0000", 2024-04-25T22:54:01.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5859999999999994e-06 2024-04-25T22:54:01.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:01.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020265+0000", 2024-04-25T22:54:01.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070653349999999998 2024-04-25T22:54:01.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:01.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020454+0000", 2024-04-25T22:54:01.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189316 2024-04-25T22:54:01.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:54:01.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020586+0000", 2024-04-25T22:54:01.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013195700000000001 2024-04-25T22:54:01.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:01.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023822+0000", 2024-04-25T22:54:01.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032358529999999999 2024-04-25T22:54:01.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:01.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033409+0000", 2024-04-25T22:54:01.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095870520000000004 2024-04-25T22:54:01.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:01.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033447+0000", 2024-04-25T22:54:01.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7261999999999997e-05 2024-04-25T22:54:01.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:01.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033477+0000", 2024-04-25T22:54:01.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0389e-05 2024-04-25T22:54:01.863 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:01.863 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:01.863 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:01.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.863 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:01.863 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:54:01.863 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 128.71026991799999, 2024-04-25T22:54:01.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010857383999999999, 2024-04-25T22:54:01.864 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:01.864 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:01.864 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:01.864 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:01.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.864 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:01.864 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:54:01.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:01.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:01.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:54:01.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:01.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:01.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:54:01.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:54:01.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.866 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:01.866 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013218+0000", 2024-04-25T22:54:01.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8199999999999998e-06 2024-04-25T22:54:01.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.867 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:01.867 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013226+0000", 2024-04-25T22:54:01.867 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7649999999999993e-06 2024-04-25T22:54:01.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.867 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:01.867 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013259+0000", 2024-04-25T22:54:01.867 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2727e-05 2024-04-25T22:54:01.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.868 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.868 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:01.868 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014809+0000", 2024-04-25T22:54:01.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001550144 2024-04-25T22:54:01.868 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.868 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.868 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:01.868 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014958+0000", 2024-04-25T22:54:01.869 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014890300000000001 2024-04-25T22:54:01.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.869 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.869 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:54:01.869 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015087+0000", 2024-04-25T22:54:01.869 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012939200000000001 2024-04-25T22:54:01.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.869 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.870 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:01.870 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020212+0000", 2024-04-25T22:54:01.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051248939999999996 2024-04-25T22:54:01.870 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.870 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.870 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:01.870 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023699+0000", 2024-04-25T22:54:01.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034873289999999999 2024-04-25T22:54:01.871 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.871 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.871 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:01.871 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024014+0000", 2024-04-25T22:54:01.871 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031473999999999999 2024-04-25T22:54:01.871 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.871 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.871 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:01.872 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024071+0000", 2024-04-25T22:54:01.872 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7040000000000003e-05 2024-04-25T22:54:01.872 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:01.872 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:01.872 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:01.872 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.872 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.872 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:01.872 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:54:01.873 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 128.710215213, 2024-04-25T22:54:01.873 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012329677000000001, 2024-04-25T22:54:01.873 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:01.873 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:01.873 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:01.873 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:01.873 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.873 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:01.874 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:54:01.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:01.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.874 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:01.874 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:54:01.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:01.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.875 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:01.875 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013269+0000", 2024-04-25T22:54:01.875 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5000000000000002e-07 2024-04-25T22:54:01.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.875 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:01.875 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:54:01.875 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6909999999999999e-06 2024-04-25T22:54:01.876 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.876 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.876 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:01.876 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013284+0000", 2024-04-25T22:54:01.876 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0963e-05 2024-04-25T22:54:01.876 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.876 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.876 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:01.876 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013361+0000", 2024-04-25T22:54:01.877 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7379999999999994e-05 2024-04-25T22:54:01.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.877 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:01.877 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013448+0000", 2024-04-25T22:54:01.877 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6990000000000006e-05 2024-04-25T22:54:01.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.877 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:01.878 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013632+0000", 2024-04-25T22:54:01.878 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018396800000000001 2024-04-25T22:54:01.878 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.878 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.878 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:54:01.878 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013800+0000", 2024-04-25T22:54:01.878 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167467 2024-04-25T22:54:01.878 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:01.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.018570+0000", 2024-04-25T22:54:01.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047701460000000003 2024-04-25T22:54:01.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:01.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025507+0000", 2024-04-25T22:54:01.880 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069372039999999998 2024-04-25T22:54:01.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.880 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.880 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:01.880 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025562+0000", 2024-04-25T22:54:01.880 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4858999999999998e-05 2024-04-25T22:54:01.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.880 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.880 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:01.881 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025598+0000", 2024-04-25T22:54:01.881 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6259e-05 2024-04-25T22:54:01.881 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:01.881 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:01.881 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:01.881 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.881 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.881 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:01.881 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:54:01.882 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 128.71008334000001, 2024-04-25T22:54:01.882 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020176666999999999, 2024-04-25T22:54:01.882 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:01.882 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:01.882 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:54:01.882 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:01.882 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.882 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:01.883 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:54:01.883 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:01.883 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.883 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:01.883 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:54:01.883 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:01.883 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.884 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:01.884 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:54:01.884 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-04-25T22:54:01.884 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.884 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.884 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:01.884 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013405+0000", 2024-04-25T22:54:01.884 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0559999999999998e-06 2024-04-25T22:54:01.884 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.885 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.885 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:01.885 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013422+0000", 2024-04-25T22:54:01.885 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6770999999999999e-05 2024-04-25T22:54:01.885 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.885 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.885 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:01.885 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013431+0000", 2024-04-25T22:54:01.885 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5019999999999998e-06 2024-04-25T22:54:01.886 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.886 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.886 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:01.886 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021720+0000", 2024-04-25T22:54:01.886 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082884340000000008 2024-04-25T22:54:01.886 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.886 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.886 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:01.886 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022122+0000", 2024-04-25T22:54:01.887 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000401634 2024-04-25T22:54:01.887 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.887 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.887 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:01.887 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033577+0000", 2024-04-25T22:54:01.887 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011455435999999999 2024-04-25T22:54:01.887 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:01.887 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:01.887 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:01.888 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.888 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.888 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4734.0:31 4.1b 4:d9872866:::1000000021d.00000002:head [write 0~3618035] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-25T22:54:01.888 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:54:01.888 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 30.670509077999998, 2024-04-25T22:54:01.888 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011647062, 2024-04-25T22:54:01.888 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:01.888 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:01.889 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:01.889 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:54:01.889 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4734", 2024-04-25T22:54:01.889 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:54:01.889 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 31 2024-04-25T22:54:01.889 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.889 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:01.889 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.889 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:01.889 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:54:01.890 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:01.890 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.890 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.890 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:01.890 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:54:01.890 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:01.890 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.890 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.891 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:01.891 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:54:01.891 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5700000000000001e-07 2024-04-25T22:54:01.891 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.891 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.891 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:01.891 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059575+0000", 2024-04-25T22:54:01.891 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0065991380000000001 2024-04-25T22:54:01.892 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.892 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.892 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:01.892 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059586+0000", 2024-04-25T22:54:01.892 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1438e-05 2024-04-25T22:54:01.892 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.892 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.892 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:01.892 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059592+0000", 2024-04-25T22:54:01.893 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2899999999999999e-06 2024-04-25T22:54:01.893 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.893 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.893 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:01.893 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059660+0000", 2024-04-25T22:54:01.893 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7980999999999998e-05 2024-04-25T22:54:01.893 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.893 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.893 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:01.894 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059757+0000", 2024-04-25T22:54:01.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6340000000000003e-05 2024-04-25T22:54:01.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.894 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:01.894 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.064487+0000", 2024-04-25T22:54:01.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004730621 2024-04-25T22:54:01.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.895 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:01.895 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.064538+0000", 2024-04-25T22:54:01.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0801999999999999e-05 2024-04-25T22:54:01.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.895 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:01.895 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.064622+0000", 2024-04-25T22:54:01.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3595000000000002e-05 2024-04-25T22:54:01.896 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:01.896 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:01.896 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:01.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.896 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.896 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:97 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-25T22:54:01.896 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:53:33.026298+0000", 2024-04-25T22:54:01.896 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.697185264000002, 2024-04-25T22:54:01.896 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015641848999999999, 2024-04-25T22:54:01.896 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:01.897 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:01.897 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:01.897 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:01.897 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.897 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:01.897 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026298+0000", 2024-04-25T22:54:01.897 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:01.897 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.898 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:01.898 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026298+0000", 2024-04-25T22:54:01.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:01.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.898 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:01.898 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026299+0000", 2024-04-25T22:54:01.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7299999999999996e-07 2024-04-25T22:54:01.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.899 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:01.899 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026464+0000", 2024-04-25T22:54:01.899 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016477700000000001 2024-04-25T22:54:01.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.899 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:01.899 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026472+0000", 2024-04-25T22:54:01.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1589999999999993e-06 2024-04-25T22:54:01.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.900 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:01.900 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026476+0000", 2024-04-25T22:54:01.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4580000000000003e-06 2024-04-25T22:54:01.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.901 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:01.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026550+0000", 2024-04-25T22:54:01.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3836000000000003e-05 2024-04-25T22:54:01.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.901 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:01.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026644+0000", 2024-04-25T22:54:01.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4022000000000002e-05 2024-04-25T22:54:01.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.902 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:01.902 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.041838+0000", 2024-04-25T22:54:01.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015193814999999999 2024-04-25T22:54:01.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.902 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:01.902 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.041874+0000", 2024-04-25T22:54:01.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5856999999999999e-05 2024-04-25T22:54:01.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:01.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:01.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:01.903 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.041940+0000", 2024-04-25T22:54:01.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6352000000000004e-05 2024-04-25T22:54:01.903 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:01.903 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:01.903 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:01.904 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:01.904 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:01.904 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:54:01.905 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:54:01.906 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:54:01.904+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:54:02.006 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:54:02.005+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:54:02.010 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:54:02.011 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:54:02.011 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-25T22:54:02.011 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:54:02.019 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:54:02.107 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:54:02.106+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:54:02.163 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:54:02.163 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:54:02.163 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-25T22:54:02.163 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-25T22:54:02.163 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:54:02.172 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:54:02.216 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:54:02.215+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:54:02.277 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:54:02.277 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:54:02.277 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:54:02.277 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:54:02.278 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.278 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:54:02.278 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:54:02.278 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 134.30808165299999, 2024-04-25T22:54:02.278 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:54:02.278 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:02.278 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:02.279 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:02.279 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:02.279 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.279 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:02.279 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:54:02.279 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:02.279 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.279 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.280 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:02.280 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:54:02.280 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:02.280 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.280 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.280 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:02.280 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:54:02.280 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:54:02.281 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.281 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.281 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:02.281 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:54:02.281 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:54:02.281 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.281 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.281 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:02.282 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:54:02.282 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:54:02.282 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.282 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.282 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:02.282 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:54:02.282 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:54:02.283 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.283 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.283 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:02.283 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:54:02.283 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:54:02.283 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.283 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.283 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:02.283 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:54:02.284 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:54:02.284 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.284 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.284 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:54:02.284 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:54:02.284 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:54:02.284 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.284 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.285 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:02.285 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:54:02.285 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:54:02.285 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:02.285 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:02.285 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:02.285 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.285 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.286 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:02.286 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:54:02.286 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 129.26358595400001, 2024-04-25T22:54:02.286 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:54:02.286 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:02.286 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:02.286 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:02.286 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:02.287 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.287 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:02.287 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:54:02.287 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:02.287 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.287 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.287 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:02.287 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:54:02.288 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:02.288 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.288 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.288 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:02.288 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:54:02.288 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:54:02.288 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.288 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.288 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:02.289 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:54:02.289 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:54:02.289 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.289 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.289 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:02.289 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:54:02.289 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:54:02.289 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.289 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.290 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:02.290 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:54:02.290 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:54:02.290 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.290 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.290 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:02.290 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:54:02.290 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:54:02.290 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.291 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.291 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:02.291 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:54:02.291 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:54:02.291 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.291 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.291 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:54:02.291 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:54:02.291 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:54:02.292 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.292 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.292 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:54:02.292 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:54:02.292 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:54:02.292 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.292 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.292 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:02.292 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:54:02.293 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:54:02.293 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.293 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.293 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:54:02.293 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:54:02.293 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:54:02.293 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.293 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.293 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:02.294 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:54:02.294 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:54:02.294 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:02.294 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:02.294 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:02.294 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.294 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.294 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:02.294 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:54:02.295 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 129.262911578, 2024-04-25T22:54:02.295 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:54:02.295 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:02.295 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:02.295 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:02.295 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:02.295 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.295 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:02.295 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:54:02.296 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:02.296 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.296 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.296 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:02.296 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:54:02.296 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:02.296 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.296 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.296 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:02.297 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:54:02.297 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:54:02.297 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.297 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.297 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:02.297 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:54:02.297 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:54:02.297 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.297 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.298 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:02.298 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:54:02.298 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:54:02.298 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.298 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.298 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:02.298 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:54:02.298 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:54:02.299 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.299 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.299 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:02.299 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:54:02.299 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:54:02.299 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.299 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.299 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:02.299 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:54:02.300 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:54:02.300 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.300 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.300 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:54:02.300 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:54:02.300 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:54:02.300 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.301 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.301 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:54:02.301 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:54:02.301 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:54:02.301 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.301 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.301 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:02.301 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:54:02.301 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:54:02.302 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.302 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.302 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:54:02.302 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:54:02.302 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:54:02.302 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.302 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.302 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:02.303 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:54:02.303 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:54:02.303 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:02.303 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:02.303 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:02.303 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.303 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.303 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:02.303 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:54:02.304 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 129.262402366, 2024-04-25T22:54:02.304 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:54:02.304 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:02.304 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:02.304 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:02.304 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:02.304 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.304 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:02.305 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:54:02.305 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:02.305 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.305 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.305 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:02.305 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:54:02.305 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:02.305 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.305 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.305 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:02.306 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:54:02.306 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:54:02.306 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.306 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.306 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:02.306 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:54:02.306 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:54:02.306 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.307 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.307 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:02.307 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:54:02.307 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:54:02.307 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.307 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.307 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:02.307 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:54:02.307 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:54:02.308 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.308 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.308 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:02.308 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:54:02.308 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:54:02.308 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.308 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.308 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:02.309 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:54:02.309 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:54:02.309 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.309 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.309 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:54:02.309 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:54:02.309 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:54:02.309 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.309 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.310 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:54:02.310 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:54:02.310 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:54:02.310 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.310 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.310 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:02.310 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:54:02.311 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:54:02.311 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.311 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.311 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:54:02.311 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:54:02.311 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:54:02.311 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.311 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.312 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:02.312 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:54:02.312 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:54:02.312 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:02.312 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:02.312 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:02.312 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.313 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.313 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:02.313 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:54:02.313 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 129.26198916800001, 2024-04-25T22:54:02.313 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:54:02.313 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:02.313 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:02.313 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:02.313 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:02.314 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.314 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:02.314 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:54:02.314 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:02.314 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.314 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.314 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:02.315 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:54:02.315 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:02.315 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.315 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.315 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:02.315 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:54:02.315 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:54:02.315 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.315 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.316 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:02.316 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:54:02.316 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:54:02.316 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.316 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.316 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:02.316 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:54:02.316 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:54:02.317 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.317 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.317 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:02.317 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:54:02.317 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:54:02.317 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.317 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.318 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:02.318 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:54:02.318 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:54:02.318 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.318 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.318 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:02.318 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:54:02.318 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:54:02.319 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.319 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.319 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:54:02.319 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:54:02.319 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:54:02.319 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.319 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.319 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:54:02.319 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:54:02.320 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:54:02.320 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.320 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.320 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:02.320 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:54:02.320 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:54:02.320 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.320 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.321 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:54:02.321 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:54:02.321 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:54:02.321 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.321 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.321 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:02.321 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:54:02.321 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:54:02.322 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:02.322 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:02.322 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:02.322 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.322 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.322 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:02.322 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:54:02.323 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 129.26193849800001, 2024-04-25T22:54:02.323 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:54:02.323 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:02.323 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:02.323 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:02.323 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:02.323 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.323 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:02.323 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:54:02.324 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:02.324 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.324 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.324 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:02.324 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:54:02.324 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:02.324 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.325 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.325 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:02.325 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:54:02.325 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:54:02.325 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.325 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.325 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:02.325 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:54:02.325 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:54:02.326 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.326 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.326 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:02.326 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:54:02.326 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:54:02.326 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.326 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.326 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:02.326 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:54:02.327 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:54:02.327 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.327 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.327 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:02.327 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:54:02.327 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:54:02.327 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.327 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.327 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:54:02.328 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:54:02.328 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:54:02.328 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.328 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.328 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:02.328 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:54:02.328 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:54:02.328 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.328 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.329 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:02.329 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:54:02.329 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:54:02.329 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.329 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.329 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:54:02.329 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:54:02.329 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:54:02.329 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.330 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.330 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:54:02.330 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:54:02.330 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:54:02.330 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.330 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.330 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:02.330 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:54:02.331 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:54:02.331 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.331 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.331 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:54:02.331 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:54:02.331 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:54:02.331 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.331 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.332 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:02.332 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:54:02.332 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:54:02.332 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:02.332 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:02.332 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:02.332 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.332 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.332 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:02.333 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:54:02.333 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 129.26190162899999, 2024-04-25T22:54:02.333 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:54:02.333 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:02.333 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:02.333 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:02.333 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:02.333 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.334 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:02.334 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:54:02.334 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:02.334 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.334 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.334 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:02.334 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:54:02.334 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:02.335 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.335 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.335 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:02.335 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:54:02.335 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:54:02.335 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.335 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.335 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:02.335 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:54:02.336 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:54:02.336 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.336 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.336 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:02.336 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:54:02.336 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:54:02.336 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.336 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.337 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:02.337 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:54:02.337 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:54:02.337 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.337 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.337 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:02.337 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:54:02.338 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:54:02.338 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.338 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.338 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:54:02.338 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:54:02.338 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:54:02.338 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.338 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.339 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:02.339 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:54:02.339 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:54:02.339 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.341 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.341 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:02.341 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:54:02.342 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:54:02.342 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.342 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.342 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:54:02.342 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:54:02.342 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:54:02.342 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.342 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.343 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:54:02.343 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:54:02.343 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:54:02.343 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.343 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.343 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:02.343 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:54:02.343 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:54:02.343 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.344 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.344 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:54:02.344 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:54:02.344 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:54:02.344 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.344 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.344 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:02.344 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:54:02.345 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:54:02.345 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:02.345 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:02.345 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:02.345 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.345 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.345 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:02.345 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:54:02.346 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 129.26187666300001, 2024-04-25T22:54:02.346 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:54:02.346 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:02.346 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:02.346 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:02.346 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:02.346 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.347 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:02.347 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:54:02.347 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:02.347 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.347 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.347 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:02.347 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:54:02.347 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:02.347 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.348 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.348 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:02.348 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:54:02.348 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:54:02.348 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.348 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.348 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:02.348 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:54:02.349 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:54:02.349 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.349 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.349 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:02.349 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:54:02.349 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:54:02.350 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.350 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.350 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:02.350 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:54:02.350 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:54:02.350 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.351 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.351 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:02.351 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:54:02.351 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:54:02.351 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.351 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.351 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:02.351 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:54:02.351 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:54:02.352 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.352 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.352 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:54:02.352 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:54:02.352 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:54:02.352 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.352 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.352 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:54:02.353 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:54:02.353 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:54:02.353 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.353 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.353 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:02.353 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:54:02.353 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:54:02.353 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.353 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.354 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:54:02.354 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:54:02.354 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:54:02.354 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.354 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.354 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:02.354 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:54:02.354 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:54:02.355 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:02.355 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:02.355 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:02.355 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.355 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.355 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:02.355 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:54:02.355 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 129.261840299, 2024-04-25T22:54:02.355 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:54:02.356 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:02.356 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:02.356 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:54:02.356 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:02.356 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.356 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:02.356 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:54:02.356 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:02.356 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.357 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.357 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:02.357 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:54:02.357 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:02.357 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.357 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.357 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:02.357 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:54:02.357 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:54:02.358 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.358 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.358 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:02.358 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:54:02.358 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:54:02.358 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.358 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.358 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:02.359 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:54:02.359 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:54:02.359 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.359 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.359 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:02.359 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:54:02.359 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:54:02.359 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.360 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.360 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:02.360 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:54:02.360 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:54:02.360 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.360 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.360 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:54:02.360 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:54:02.361 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:54:02.361 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.361 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.361 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:02.361 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:54:02.361 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:54:02.361 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.361 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.361 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:02.362 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:54:02.362 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:54:02.362 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.362 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.362 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:02.362 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:54:02.362 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:54:02.362 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:02.363 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:02.363 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:02.363 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.363 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.363 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:02.363 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:54:02.363 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 129.261809218, 2024-04-25T22:54:02.363 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:54:02.364 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:02.364 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:02.364 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:54:02.364 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:02.364 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.364 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:02.364 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:54:02.364 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:02.365 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.365 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.365 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:02.365 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:54:02.365 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:02.365 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.365 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.365 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:02.365 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:54:02.366 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:54:02.366 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.366 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.366 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:02.366 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:54:02.366 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:54:02.366 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.366 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.367 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:02.367 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:54:02.367 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:54:02.367 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.367 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.367 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:02.367 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:54:02.368 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:54:02.368 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.368 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.368 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:02.368 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:54:02.368 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:54:02.368 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.368 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.369 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:02.369 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:54:02.369 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:54:02.369 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.369 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.369 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:02.369 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:54:02.369 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:54:02.370 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:02.370 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:02.370 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:02.370 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.370 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.370 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:30 4.31 4:8ebfc112:::1000000021d.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-25T22:54:02.370 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:54:02.370 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 31.222123348, 2024-04-25T22:54:02.370 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015003005, 2024-04-25T22:54:02.371 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:02.371 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:02.371 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:02.371 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:54:02.371 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:54:02.371 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:54:02.371 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 30 2024-04-25T22:54:02.371 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.372 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:02.372 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.372 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:02.372 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:54:02.372 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:02.372 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.372 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.372 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:02.373 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:54:02.373 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:02.373 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.373 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.373 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:02.373 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053133+0000", 2024-04-25T22:54:02.373 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0370000000000001e-06 2024-04-25T22:54:02.374 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.374 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.374 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:02.374 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060377+0000", 2024-04-25T22:54:02.374 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0072431070000000004 2024-04-25T22:54:02.374 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.374 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.375 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:02.375 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060388+0000", 2024-04-25T22:54:02.375 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1285e-05 2024-04-25T22:54:02.375 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.375 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.375 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:02.375 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060394+0000", 2024-04-25T22:54:02.375 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1040000000000003e-06 2024-04-25T22:54:02.375 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.376 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.376 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:02.376 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060483+0000", 2024-04-25T22:54:02.376 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.9345000000000006e-05 2024-04-25T22:54:02.376 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.376 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.376 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:02.376 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060566+0000", 2024-04-25T22:54:02.377 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2237999999999994e-05 2024-04-25T22:54:02.377 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.377 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.377 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:54:02.377 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068057+0000", 2024-04-25T22:54:02.377 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074912210000000002 2024-04-25T22:54:02.377 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.377 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.377 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:54:02.378 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068090+0000", 2024-04-25T22:54:02.378 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3501000000000003e-05 2024-04-25T22:54:02.378 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.378 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.378 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:02.378 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068134+0000", 2024-04-25T22:54:02.378 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4166999999999999e-05 2024-04-25T22:54:02.378 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:02.379 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:02.379 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:02.379 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.379 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.379 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:66 4.27 4:e5671758:::1000000024f.00000000:head [write 0~6641] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:54:02.379 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:54:02.379 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 30.962013012, 2024-04-25T22:54:02.379 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075166540000000002, 2024-04-25T22:54:02.380 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:02.380 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:02.380 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:02.380 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:54:02.380 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:54:02.380 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:54:02.380 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 66 2024-04-25T22:54:02.380 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.381 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:02.381 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.381 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:02.381 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:54:02.381 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:02.381 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.381 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.381 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:02.381 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:54:02.382 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:02.382 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.382 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.382 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:02.382 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:54:02.382 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4099999999999998e-07 2024-04-25T22:54:02.382 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.382 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.383 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:02.383 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313252+0000", 2024-04-25T22:54:02.383 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5380000000000008e-06 2024-04-25T22:54:02.383 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.383 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.383 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:02.383 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313260+0000", 2024-04-25T22:54:02.383 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2609999999999993e-06 2024-04-25T22:54:02.383 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.384 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.384 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:02.384 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313265+0000", 2024-04-25T22:54:02.384 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4850000000000003e-06 2024-04-25T22:54:02.384 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.384 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.384 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:02.384 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313310+0000", 2024-04-25T22:54:02.384 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5247999999999998e-05 2024-04-25T22:54:02.385 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.385 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.385 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:02.385 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313370+0000", 2024-04-25T22:54:02.385 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0275000000000001e-05 2024-04-25T22:54:02.385 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.385 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.385 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:54:02.386 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313435+0000", 2024-04-25T22:54:02.386 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4647000000000006e-05 2024-04-25T22:54:02.386 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.386 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.386 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:02.386 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314174+0000", 2024-04-25T22:54:02.386 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00073925 2024-04-25T22:54:02.386 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.386 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.387 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:54:02.387 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320688+0000", 2024-04-25T22:54:02.387 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.006513418 2024-04-25T22:54:02.387 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.387 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.387 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:54:02.387 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320736+0000", 2024-04-25T22:54:02.387 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.8114e-05 2024-04-25T22:54:02.388 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.388 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.388 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:02.388 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320758+0000", 2024-04-25T22:54:02.388 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2776999999999999e-05 2024-04-25T22:54:02.388 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:02.388 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:02.388 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:02.388 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.389 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.389 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:68 4.31 4:8fb7f7b7:::10000000251.00000000:head [write 0~2067] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:54:02.389 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:54:02.389 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 30.960327234000001, 2024-04-25T22:54:02.389 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0087011669999999992, 2024-04-25T22:54:02.389 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:02.389 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:02.389 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:02.390 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:54:02.390 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:54:02.390 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:54:02.390 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 68 2024-04-25T22:54:02.390 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.390 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:02.390 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.390 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:02.391 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:54:02.391 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:02.391 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.391 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.391 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:02.391 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:54:02.391 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:02.391 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.391 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.392 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:02.392 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:54:02.392 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:54:02.392 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.392 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.392 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:02.392 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314933+0000", 2024-04-25T22:54:02.392 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5430000000000004e-06 2024-04-25T22:54:02.392 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.393 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.393 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:02.393 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314944+0000", 2024-04-25T22:54:02.393 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.076e-05 2024-04-25T22:54:02.393 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.393 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.393 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:02.393 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314949+0000", 2024-04-25T22:54:02.394 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1019999999999996e-06 2024-04-25T22:54:02.394 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.394 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.394 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:02.394 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314996+0000", 2024-04-25T22:54:02.394 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7018999999999998e-05 2024-04-25T22:54:02.394 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.394 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.395 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:02.395 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315064+0000", 2024-04-25T22:54:02.395 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8738000000000005e-05 2024-04-25T22:54:02.395 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.395 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.395 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:54:02.395 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323531+0000", 2024-04-25T22:54:02.395 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084664739999999999 2024-04-25T22:54:02.395 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.396 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.396 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:54:02.396 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323574+0000", 2024-04-25T22:54:02.396 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3449999999999999e-05 2024-04-25T22:54:02.396 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.396 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.396 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:02.396 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323629+0000", 2024-04-25T22:54:02.397 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4296999999999999e-05 2024-04-25T22:54:02.397 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:02.397 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:02.397 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:02.397 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.397 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.397 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4734.0:69 4.32 e46/13 4:4e8c6251:::10000000252.00000000:head v 46'1, mlcod=0'0)", 2024-04-25T22:54:02.397 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:54:02.397 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 30.959295965999999, 2024-04-25T22:54:02.398 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076063240000000002, 2024-04-25T22:54:02.398 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:02.398 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:02.398 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:02.398 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:02.398 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.398 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:02.398 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:54:02.399 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:02.399 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.399 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.399 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:02.399 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:54:02.399 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:02.399 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.399 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.399 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:02.400 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:54:02.400 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3099999999999997e-07 2024-04-25T22:54:02.400 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.400 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.400 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:02.400 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315964+0000", 2024-04-25T22:54:02.400 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3229999999999999e-06 2024-04-25T22:54:02.400 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.400 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.401 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:02.401 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315973+0000", 2024-04-25T22:54:02.401 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7249999999999992e-06 2024-04-25T22:54:02.401 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.401 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.401 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:02.401 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315978+0000", 2024-04-25T22:54:02.401 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4830000000000001e-06 2024-04-25T22:54:02.401 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.402 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.402 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:02.402 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.316043+0000", 2024-04-25T22:54:02.402 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.5036000000000005e-05 2024-04-25T22:54:02.402 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.402 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.402 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:02.403 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.316055+0000", 2024-04-25T22:54:02.403 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1973999999999999e-05 2024-04-25T22:54:02.403 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.403 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.403 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:54:02.403 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323521+0000", 2024-04-25T22:54:02.403 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074660239999999999 2024-04-25T22:54:02.403 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.403 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.404 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:02.404 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323565+0000", 2024-04-25T22:54:02.404 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4128000000000002e-05 2024-04-25T22:54:02.404 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:02.404 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:02.404 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:02.404 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.404 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.405 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:72 4.36 4:6cdfec98:::10000000255.00000000:head [write 0~4131] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:54:02.405 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:54:02.405 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 30.957252054000001, 2024-04-25T22:54:02.405 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084820680000000006, 2024-04-25T22:54:02.405 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:02.405 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:02.405 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:02.405 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:54:02.405 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:54:02.406 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:54:02.406 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 72 2024-04-25T22:54:02.406 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.406 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:02.406 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.406 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:02.406 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:54:02.407 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:02.407 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.407 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.407 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:02.407 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:54:02.407 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:02.407 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.407 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.407 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:02.408 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:54:02.408 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1800000000000005e-07 2024-04-25T22:54:02.408 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.408 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.408 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:02.408 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318010+0000", 2024-04-25T22:54:02.408 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7399999999999998e-06 2024-04-25T22:54:02.408 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.409 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.409 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:02.409 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318019+0000", 2024-04-25T22:54:02.409 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0170000000000002e-06 2024-04-25T22:54:02.409 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.409 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.409 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:02.409 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318024+0000", 2024-04-25T22:54:02.410 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0150000000000003e-06 2024-04-25T22:54:02.410 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.410 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.410 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:02.410 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318075+0000", 2024-04-25T22:54:02.410 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0537000000000001e-05 2024-04-25T22:54:02.410 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.410 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.411 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:02.411 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318144+0000", 2024-04-25T22:54:02.411 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9432999999999997e-05 2024-04-25T22:54:02.411 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.411 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.411 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:54:02.411 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326392+0000", 2024-04-25T22:54:02.411 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0082482979999999994 2024-04-25T22:54:02.411 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.412 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.412 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:54:02.412 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326432+0000", 2024-04-25T22:54:02.412 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9870000000000003e-05 2024-04-25T22:54:02.412 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.412 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.412 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:02.412 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326485+0000", 2024-04-25T22:54:02.413 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2439999999999999e-05 2024-04-25T22:54:02.413 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:02.413 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:02.413 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:02.413 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.413 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.413 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:74 4.10 4:08e6f8ca:::10000000257.00000000:head [write 0~839] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:54:02.413 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:54:02.414 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 30.955778326000001, 2024-04-25T22:54:02.414 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070370720000000001, 2024-04-25T22:54:02.414 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:02.414 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:02.414 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:02.414 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:54:02.414 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:54:02.414 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:54:02.414 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 74 2024-04-25T22:54:02.415 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.415 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:02.415 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.415 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:02.415 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:54:02.415 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:02.415 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.415 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.416 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:02.416 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:54:02.416 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:02.416 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.416 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.416 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:02.416 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319477+0000", 2024-04-25T22:54:02.416 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1999999999999999e-07 2024-04-25T22:54:02.417 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.417 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.417 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:02.417 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319483+0000", 2024-04-25T22:54:02.417 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4260000000000002e-06 2024-04-25T22:54:02.417 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.417 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.417 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:02.417 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319494+0000", 2024-04-25T22:54:02.418 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.094e-05 2024-04-25T22:54:02.418 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.418 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.418 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:02.418 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319499+0000", 2024-04-25T22:54:02.418 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3789999999999997e-06 2024-04-25T22:54:02.418 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.418 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.419 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:02.419 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319545+0000", 2024-04-25T22:54:02.419 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6149000000000001e-05 2024-04-25T22:54:02.419 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.419 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.419 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:02.419 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319617+0000", 2024-04-25T22:54:02.419 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1792999999999995e-05 2024-04-25T22:54:02.420 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.420 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.420 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:54:02.420 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326406+0000", 2024-04-25T22:54:02.420 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067895999999999998 2024-04-25T22:54:02.420 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.420 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.420 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:54:02.420 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326443+0000", 2024-04-25T22:54:02.421 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6828e-05 2024-04-25T22:54:02.421 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.421 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.421 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:02.421 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326514+0000", 2024-04-25T22:54:02.421 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0236999999999999e-05 2024-04-25T22:54:02.421 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:02.421 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:02.421 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:02.422 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.422 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.422 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:128 3.1f 3:f83d65d8:::200.00000004:head [write 876784~3317520 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e48)", 2024-04-25T22:54:02.422 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:36.985410+0000", 2024-04-25T22:54:02.422 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 25.289844708, 2024-04-25T22:54:02.422 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0090177360000000002, 2024-04-25T22:54:02.422 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:02.422 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:02.423 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:02.423 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:02.423 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.423 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:02.423 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.985410+0000", 2024-04-25T22:54:02.423 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:02.423 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.423 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.424 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:02.424 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.985410+0000", 2024-04-25T22:54:02.424 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:02.424 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.424 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.424 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:02.424 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.985411+0000", 2024-04-25T22:54:02.424 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8400000000000003e-07 2024-04-25T22:54:02.424 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.425 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.425 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:02.425 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989116+0000", 2024-04-25T22:54:02.425 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037047389999999999 2024-04-25T22:54:02.425 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.425 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.425 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:02.425 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989128+0000", 2024-04-25T22:54:02.425 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1977999999999999e-05 2024-04-25T22:54:02.426 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.426 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.426 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:02.426 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989135+0000", 2024-04-25T22:54:02.426 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5290000000000003e-06 2024-04-25T22:54:02.426 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.426 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.426 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:02.427 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989181+0000", 2024-04-25T22:54:02.427 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6122999999999999e-05 2024-04-25T22:54:02.427 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.427 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.427 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:02.427 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989250+0000", 2024-04-25T22:54:02.427 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8535999999999996e-05 2024-04-25T22:54:02.427 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.427 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.428 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:54:02.428 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.994272+0000", 2024-04-25T22:54:02.428 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050224889999999998 2024-04-25T22:54:02.428 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.428 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.428 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:54:02.428 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.994335+0000", 2024-04-25T22:54:02.428 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2588000000000005e-05 2024-04-25T22:54:02.429 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.429 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.429 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:02.429 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.994428+0000", 2024-04-25T22:54:02.429 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2869999999999997e-05 2024-04-25T22:54:02.429 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:02.429 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:02.429 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:02.429 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.430 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.430 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:2150 4.22 4:47cffac6:::10000000a2b.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T22:54:02.430 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:41.078233+0000", 2024-04-25T22:54:02.430 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 21.197021398, 2024-04-25T22:54:02.430 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069201510000000003, 2024-04-25T22:54:02.430 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:02.430 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:02.430 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:02.431 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:02.431 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.431 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:02.431 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078233+0000", 2024-04-25T22:54:02.431 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:02.431 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.431 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.431 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:02.431 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078233+0000", 2024-04-25T22:54:02.432 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:02.432 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.432 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.432 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:02.432 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078234+0000", 2024-04-25T22:54:02.432 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1699999999999998e-07 2024-04-25T22:54:02.432 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.432 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.433 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:02.433 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078236+0000", 2024-04-25T22:54:02.433 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.875e-06 2024-04-25T22:54:02.433 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.433 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.433 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:02.433 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078242+0000", 2024-04-25T22:54:02.433 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2450000000000003e-06 2024-04-25T22:54:02.434 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.434 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.434 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:02.434 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078247+0000", 2024-04-25T22:54:02.434 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7450000000000003e-06 2024-04-25T22:54:02.434 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.434 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.434 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:02.435 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078641+0000", 2024-04-25T22:54:02.435 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00039420200000000002 2024-04-25T22:54:02.435 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.435 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.435 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:02.435 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078840+0000", 2024-04-25T22:54:02.435 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000199063 2024-04-25T22:54:02.435 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.435 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.436 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:54:02.436 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078919+0000", 2024-04-25T22:54:02.436 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9182000000000002e-05 2024-04-25T22:54:02.436 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.436 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.436 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:02.436 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.080906+0000", 2024-04-25T22:54:02.436 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0019866390000000001 2024-04-25T22:54:02.437 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.437 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.437 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:54:02.437 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085074+0000", 2024-04-25T22:54:02.437 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0041683639999999999 2024-04-25T22:54:02.437 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.437 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.437 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:54:02.437 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085117+0000", 2024-04-25T22:54:02.438 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2849999999999998e-05 2024-04-25T22:54:02.438 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.438 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.438 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:02.438 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085154+0000", 2024-04-25T22:54:02.438 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6468999999999999e-05 2024-04-25T22:54:02.438 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:02.438 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:02.439 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:02.439 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.439 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.439 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:2160 4.2a 4:57f9ed86:::10000000a3d.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T22:54:02.439 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:54:02.439 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 21.196552107999999, 2024-04-25T22:54:02.439 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0068959959999999997, 2024-04-25T22:54:02.439 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:02.439 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:02.440 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:02.440 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:02.440 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.440 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:02.440 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:54:02.440 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:02.440 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.440 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.441 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:02.441 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:54:02.441 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:02.441 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.441 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.441 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:02.441 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:54:02.441 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7000000000000004e-07 2024-04-25T22:54:02.441 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.442 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.442 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:02.442 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078707+0000", 2024-04-25T22:54:02.442 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.783e-06 2024-04-25T22:54:02.442 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.442 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.442 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:02.442 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078716+0000", 2024-04-25T22:54:02.443 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4800000000000001e-06 2024-04-25T22:54:02.443 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.443 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.443 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:02.443 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078724+0000", 2024-04-25T22:54:02.443 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1519999999999992e-06 2024-04-25T22:54:02.443 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.443 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.444 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:02.444 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078794+0000", 2024-04-25T22:54:02.444 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0500999999999995e-05 2024-04-25T22:54:02.444 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.444 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.444 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:02.444 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078912+0000", 2024-04-25T22:54:02.444 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000117439 2024-04-25T22:54:02.445 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.445 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.445 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:54:02.445 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079000+0000", 2024-04-25T22:54:02.445 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8092999999999998e-05 2024-04-25T22:54:02.445 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.445 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.445 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:02.446 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.080897+0000", 2024-04-25T22:54:02.446 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0018970899999999999 2024-04-25T22:54:02.446 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.446 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.446 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:54:02.446 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085517+0000", 2024-04-25T22:54:02.446 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0046198929999999999 2024-04-25T22:54:02.446 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.447 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.447 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:54:02.447 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085565+0000", 2024-04-25T22:54:02.447 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7777e-05 2024-04-25T22:54:02.447 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.447 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.447 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:02.447 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085599+0000", 2024-04-25T22:54:02.448 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4017999999999999e-05 2024-04-25T22:54:02.448 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:02.448 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:02.448 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:02.448 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.448 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.448 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:2163 4.2a 4:549f79e3:::10000000a43.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T22:54:02.448 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:54:02.448 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 21.196518755, 2024-04-25T22:54:02.449 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069469190000000002, 2024-04-25T22:54:02.449 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:02.449 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:02.449 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:02.449 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:02.449 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.450 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:02.450 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:54:02.450 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:02.450 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.450 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.450 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:02.450 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:54:02.450 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:02.450 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.451 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.451 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:02.451 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:54:02.451 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1399999999999997e-07 2024-04-25T22:54:02.451 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.451 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.451 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:02.451 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078739+0000", 2024-04-25T22:54:02.452 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2960000000000001e-06 2024-04-25T22:54:02.452 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.452 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.452 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:02.452 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078745+0000", 2024-04-25T22:54:02.452 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3439999999999997e-06 2024-04-25T22:54:02.452 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.453 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.453 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:02.453 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078750+0000", 2024-04-25T22:54:02.453 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3179999999999997e-06 2024-04-25T22:54:02.453 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.453 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.453 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:02.453 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079224+0000", 2024-04-25T22:54:02.453 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00047334999999999999 2024-04-25T22:54:02.454 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.454 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.454 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:02.454 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079292+0000", 2024-04-25T22:54:02.454 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8708999999999996e-05 2024-04-25T22:54:02.454 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.454 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.454 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:54:02.455 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079342+0000", 2024-04-25T22:54:02.455 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9299999999999999e-05 2024-04-25T22:54:02.455 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.455 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.455 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:02.455 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.081611+0000", 2024-04-25T22:54:02.455 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0022695229999999999 2024-04-25T22:54:02.455 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.455 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.456 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:54:02.456 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085605+0000", 2024-04-25T22:54:02.456 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0039933679999999997 2024-04-25T22:54:02.456 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.456 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.456 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:54:02.456 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085650+0000", 2024-04-25T22:54:02.456 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5111000000000002e-05 2024-04-25T22:54:02.457 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:02.457 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:02.457 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:02.457 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085683+0000", 2024-04-25T22:54:02.457 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3185999999999997e-05 2024-04-25T22:54:02.457 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:02.457 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:02.457 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:02.457 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:02.458 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:02.458 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:54:02.458 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-25T22:54:02.460 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:54:02.459+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:54:02.460 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:54:02.560 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:54:02.559+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:54:02.571 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:54:02.571 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:54:02.571 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-04-25T22:54:02.572 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:54:02.580 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:54:02.661 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:54:02.661+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:54:02.680 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:54:02.680 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:54:02.681 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:54:02.681 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:54:02.681 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:54:02.689 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:54:02.762 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:54:02.762+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:54:02.792 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:54:02.793 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-04-25T22:54:02.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-04-25T22:54:02.793 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:54:02.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.793 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:54:02.793 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:54:02.793 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 134.82565721500001, 2024-04-25T22:54:02.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010384338999999999, 2024-04-25T22:54:02.794 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:02.794 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:02.794 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:02.794 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:54:02.794 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:54:02.794 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:54:02.794 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-04-25T22:54:02.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.795 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:02.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:02.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:54:02.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:02.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:02.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:54:02.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:02.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:02.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:54:02.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3600000000000004e-07 2024-04-25T22:54:02.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:02.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965185+0000", 2024-04-25T22:54:02.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.117e-06 2024-04-25T22:54:02.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:02.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965192+0000", 2024-04-25T22:54:02.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3239999999999997e-06 2024-04-25T22:54:02.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:02.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965198+0000", 2024-04-25T22:54:02.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6370000000000004e-06 2024-04-25T22:54:02.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:02.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970973+0000", 2024-04-25T22:54:02.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057748239999999996 2024-04-25T22:54:02.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:02.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971049+0000", 2024-04-25T22:54:02.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6029e-05 2024-04-25T22:54:02.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:54:02.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971174+0000", 2024-04-25T22:54:02.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012462399999999999 2024-04-25T22:54:02.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:02.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971553+0000", 2024-04-25T22:54:02.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037896499999999999 2024-04-25T22:54:02.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:02.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975482+0000", 2024-04-25T22:54:02.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039297459999999996 2024-04-25T22:54:02.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:02.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975529+0000", 2024-04-25T22:54:02.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6387000000000002e-05 2024-04-25T22:54:02.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:02.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975563+0000", 2024-04-25T22:54:02.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4150000000000003e-05 2024-04-25T22:54:02.802 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:02.803 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:02.803 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:02.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.803 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:02.803 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:54:02.803 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 129.77861089199999, 2024-04-25T22:54:02.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012637705000000001, 2024-04-25T22:54:02.803 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:02.804 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:02.804 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:02.804 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:02.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:02.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:54:02.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:02.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:02.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:54:02.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:02.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:02.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012227+0000", 2024-04-25T22:54:02.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.863e-06 2024-04-25T22:54:02.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:02.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012236+0000", 2024-04-25T22:54:02.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1109999999999997e-06 2024-04-25T22:54:02.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:02.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012309+0000", 2024-04-25T22:54:02.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3242000000000001e-05 2024-04-25T22:54:02.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:02.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012324+0000", 2024-04-25T22:54:02.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4837e-05 2024-04-25T22:54:02.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:02.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015060+0000", 2024-04-25T22:54:02.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027363349999999999 2024-04-25T22:54:02.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:02.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015169+0000", 2024-04-25T22:54:02.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108372 2024-04-25T22:54:02.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:54:02.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015498+0000", 2024-04-25T22:54:02.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032949999999999999 2024-04-25T22:54:02.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:02.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021282+0000", 2024-04-25T22:54:02.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057836429999999998 2024-04-25T22:54:02.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:02.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024709+0000", 2024-04-25T22:54:02.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034271979999999998 2024-04-25T22:54:02.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:02.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024802+0000", 2024-04-25T22:54:02.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2960000000000004e-05 2024-04-25T22:54:02.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:02.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024863+0000", 2024-04-25T22:54:02.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0643999999999997e-05 2024-04-25T22:54:02.812 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:02.812 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:02.812 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:02.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.812 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:02.812 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:54:02.813 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 129.77848712100001, 2024-04-25T22:54:02.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012979447999999999, 2024-04-25T22:54:02.813 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:02.813 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:02.813 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:02.813 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:02.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:02.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:54:02.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:02.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:02.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:54:02.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:02.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:02.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:54:02.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:54:02.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:02.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012354+0000", 2024-04-25T22:54:02.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7740000000000004e-06 2024-04-25T22:54:02.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:02.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012365+0000", 2024-04-25T22:54:02.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.064e-05 2024-04-25T22:54:02.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:02.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012382+0000", 2024-04-25T22:54:02.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6999000000000001e-05 2024-04-25T22:54:02.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:02.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015958+0000", 2024-04-25T22:54:02.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035765699999999998 2024-04-25T22:54:02.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:02.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016037+0000", 2024-04-25T22:54:02.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8242000000000001e-05 2024-04-25T22:54:02.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:54:02.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016404+0000", 2024-04-25T22:54:02.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036784300000000002 2024-04-25T22:54:02.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:02.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021294+0000", 2024-04-25T22:54:02.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048890629999999999 2024-04-25T22:54:02.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:02.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024959+0000", 2024-04-25T22:54:02.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036651570000000001 2024-04-25T22:54:02.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:02.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025097+0000", 2024-04-25T22:54:02.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013788099999999999 2024-04-25T22:54:02.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:02.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025328+0000", 2024-04-25T22:54:02.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231492 2024-04-25T22:54:02.821 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:02.821 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:02.821 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:02.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.822 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:02.822 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:54:02.822 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 129.77839935200001, 2024-04-25T22:54:02.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013049827, 2024-04-25T22:54:02.822 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:02.822 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:02.822 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:02.822 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:02.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:02.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:54:02.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:02.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:02.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:54:02.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:02.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:02.824 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012437+0000", 2024-04-25T22:54:02.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-04-25T22:54:02.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:02.824 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012440+0000", 2024-04-25T22:54:02.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7609999999999999e-06 2024-04-25T22:54:02.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:02.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012449+0000", 2024-04-25T22:54:02.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.285e-06 2024-04-25T22:54:02.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:02.826 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012457+0000", 2024-04-25T22:54:02.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9510000000000006e-06 2024-04-25T22:54:02.826 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.826 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.826 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:02.826 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017106+0000", 2024-04-25T22:54:02.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046494220000000003 2024-04-25T22:54:02.826 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.827 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:02.827 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017223+0000", 2024-04-25T22:54:02.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116824 2024-04-25T22:54:02.827 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.827 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:54:02.827 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017345+0000", 2024-04-25T22:54:02.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122175 2024-04-25T22:54:02.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.828 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:02.828 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021299+0000", 2024-04-25T22:54:02.828 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039534879999999998 2024-04-25T22:54:02.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.828 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:02.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025398+0000", 2024-04-25T22:54:02.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040988960000000003 2024-04-25T22:54:02.829 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.829 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:02.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025439+0000", 2024-04-25T22:54:02.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0915999999999999e-05 2024-04-25T22:54:02.829 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.830 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:02.830 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025486+0000", 2024-04-25T22:54:02.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7534999999999998e-05 2024-04-25T22:54:02.830 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:02.830 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:02.830 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:02.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.831 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:02.831 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:54:02.831 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 129.778369201, 2024-04-25T22:54:02.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020988041999999998, 2024-04-25T22:54:02.831 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:02.831 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:02.831 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:02.831 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:02.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.832 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:02.832 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:54:02.832 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:02.832 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.832 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:02.832 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:54:02.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:02.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.833 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:02.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:54:02.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.99e-07 2024-04-25T22:54:02.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:02.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012470+0000", 2024-04-25T22:54:02.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2789999999999999e-06 2024-04-25T22:54:02.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:02.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012477+0000", 2024-04-25T22:54:02.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:54:02.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:02.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012500+0000", 2024-04-25T22:54:02.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2490999999999999e-05 2024-04-25T22:54:02.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:02.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021911+0000", 2024-04-25T22:54:02.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094114160000000006 2024-04-25T22:54:02.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.836 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:02.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022000+0000", 2024-04-25T22:54:02.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8601000000000001e-05 2024-04-25T22:54:02.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:54:02.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022359+0000", 2024-04-25T22:54:02.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035921999999999999 2024-04-25T22:54:02.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:02.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025541+0000", 2024-04-25T22:54:02.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031820619999999998 2024-04-25T22:54:02.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:02.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033375+0000", 2024-04-25T22:54:02.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078338379999999992 2024-04-25T22:54:02.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:02.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033415+0000", 2024-04-25T22:54:02.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9527000000000003e-05 2024-04-25T22:54:02.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:02.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033455+0000", 2024-04-25T22:54:02.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9932000000000003e-05 2024-04-25T22:54:02.839 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:02.840 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:02.840 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:02.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.840 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:02.840 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:54:02.840 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 129.778314008, 2024-04-25T22:54:02.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021043857999999999, 2024-04-25T22:54:02.841 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:02.841 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:02.841 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:02.841 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:02.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:02.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:54:02.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:02.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:02.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:54:02.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:02.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:02.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012523+0000", 2024-04-25T22:54:02.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.361e-06 2024-04-25T22:54:02.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:02.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012530+0000", 2024-04-25T22:54:02.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5440000000000004e-06 2024-04-25T22:54:02.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:02.844 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012541+0000", 2024-04-25T22:54:02.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1745e-05 2024-04-25T22:54:02.844 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.844 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:02.844 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012551+0000", 2024-04-25T22:54:02.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5789999999999993e-06 2024-04-25T22:54:02.844 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:02.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022709+0000", 2024-04-25T22:54:02.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010157685 2024-04-25T22:54:02.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:02.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022957+0000", 2024-04-25T22:54:02.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024824599999999998 2024-04-25T22:54:02.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:54:02.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023443+0000", 2024-04-25T22:54:02.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048578599999999999 2024-04-25T22:54:02.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:02.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025547+0000", 2024-04-25T22:54:02.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021044789999999998 2024-04-25T22:54:02.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:02.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033509+0000", 2024-04-25T22:54:02.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0079622180000000001 2024-04-25T22:54:02.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:02.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033542+0000", 2024-04-25T22:54:02.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3018000000000001e-05 2024-04-25T22:54:02.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:02.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033566+0000", 2024-04-25T22:54:02.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3197000000000002e-05 2024-04-25T22:54:02.848 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:02.848 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:02.849 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:02.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.849 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:02.849 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:54:02.849 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 129.77827404300001, 2024-04-25T22:54:02.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021122696, 2024-04-25T22:54:02.849 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:02.850 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:02.850 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:02.850 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:02.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.850 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:02.850 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:54:02.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:02.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:02.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:54:02.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:02.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:02.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:54:02.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:54:02.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:02.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012566+0000", 2024-04-25T22:54:02.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-04-25T22:54:02.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.853 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:02.853 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012619+0000", 2024-04-25T22:54:02.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2607e-05 2024-04-25T22:54:02.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.853 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:02.853 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012628+0000", 2024-04-25T22:54:02.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6500000000000008e-06 2024-04-25T22:54:02.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.854 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:02.854 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024024+0000", 2024-04-25T22:54:02.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011396007999999999 2024-04-25T22:54:02.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:02.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024198+0000", 2024-04-25T22:54:02.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000173215 2024-04-25T22:54:02.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:54:02.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024447+0000", 2024-04-25T22:54:02.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024898500000000002 2024-04-25T22:54:02.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:02.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026431+0000", 2024-04-25T22:54:02.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001984923 2024-04-25T22:54:02.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:02.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033608+0000", 2024-04-25T22:54:02.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071768459999999997 2024-04-25T22:54:02.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.857 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:02.857 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033646+0000", 2024-04-25T22:54:02.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299000000000003e-05 2024-04-25T22:54:02.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.857 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:02.858 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033684+0000", 2024-04-25T22:54:02.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8773000000000003e-05 2024-04-25T22:54:02.858 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:02.858 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:02.858 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:02.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.858 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:02.858 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:54:02.859 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 129.778185444, 2024-04-25T22:54:02.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021175381, 2024-04-25T22:54:02.859 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:02.859 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:02.859 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:02.859 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:02.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:02.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:54:02.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:02.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:02.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:54:02.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:02.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:02.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012651+0000", 2024-04-25T22:54:02.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:54:02.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:02.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012656+0000", 2024-04-25T22:54:02.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8899999999999998e-06 2024-04-25T22:54:02.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:02.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012666+0000", 2024-04-25T22:54:02.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0346999999999999e-05 2024-04-25T22:54:02.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:02.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012675+0000", 2024-04-25T22:54:02.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9930000000000001e-06 2024-04-25T22:54:02.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:02.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025661+0000", 2024-04-25T22:54:02.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01298531 2024-04-25T22:54:02.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.864 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:02.864 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025757+0000", 2024-04-25T22:54:02.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5822000000000005e-05 2024-04-25T22:54:02.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.864 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:54:02.864 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025907+0000", 2024-04-25T22:54:02.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015051499999999999 2024-04-25T22:54:02.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:02.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026435+0000", 2024-04-25T22:54:02.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052762200000000005 2024-04-25T22:54:02.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:02.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033732+0000", 2024-04-25T22:54:02.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072978419999999997 2024-04-25T22:54:02.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.866 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:02.866 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033787+0000", 2024-04-25T22:54:02.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4703999999999997e-05 2024-04-25T22:54:02.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.866 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:02.867 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033826+0000", 2024-04-25T22:54:02.867 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8458999999999999e-05 2024-04-25T22:54:02.867 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:02.867 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:02.867 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:02.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.867 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:02.867 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:54:02.868 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 129.77813003, 2024-04-25T22:54:02.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021244174000000001, 2024-04-25T22:54:02.868 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:02.868 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:02.868 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:02.868 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:02.868 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.868 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:02.869 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:54:02.869 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:02.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.869 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.869 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:02.869 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:54:02.869 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:02.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.869 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.870 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:02.870 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:54:02.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:54:02.870 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.870 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.870 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:02.870 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012712+0000", 2024-04-25T22:54:02.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.913e-06 2024-04-25T22:54:02.871 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.871 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.871 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:02.871 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012722+0000", 2024-04-25T22:54:02.871 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2879999999999998e-06 2024-04-25T22:54:02.871 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.871 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.871 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:02.872 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012727+0000", 2024-04-25T22:54:02.872 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8429999999999998e-06 2024-04-25T22:54:02.872 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.872 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.872 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:02.872 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026099+0000", 2024-04-25T22:54:02.872 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013371450999999999 2024-04-25T22:54:02.872 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.872 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.873 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:02.873 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026147+0000", 2024-04-25T22:54:02.873 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7837999999999998e-05 2024-04-25T22:54:02.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.873 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.873 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:54:02.873 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026254+0000", 2024-04-25T22:54:02.873 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107314 2024-04-25T22:54:02.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.874 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:02.874 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026686+0000", 2024-04-25T22:54:02.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000432428 2024-04-25T22:54:02.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.874 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:02.875 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033873+0000", 2024-04-25T22:54:02.875 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071864399999999997 2024-04-25T22:54:02.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.875 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:02.875 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033904+0000", 2024-04-25T22:54:02.875 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1321e-05 2024-04-25T22:54:02.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.876 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:02.876 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033950+0000", 2024-04-25T22:54:02.876 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5707999999999997e-05 2024-04-25T22:54:02.876 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:02.876 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:02.876 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:02.876 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.876 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.876 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:02.877 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:54:02.877 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 129.778099645, 2024-04-25T22:54:02.877 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01096505, 2024-04-25T22:54:02.877 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:02.877 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:02.877 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:02.877 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:02.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.878 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:02.878 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:54:02.878 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:02.878 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.878 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.878 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:02.878 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:54:02.878 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:02.878 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:02.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012737+0000", 2024-04-25T22:54:02.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:54:02.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:02.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012739+0000", 2024-04-25T22:54:02.880 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-04-25T22:54:02.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.880 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.880 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:02.880 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012743+0000", 2024-04-25T22:54:02.880 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3239999999999996e-06 2024-04-25T22:54:02.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.881 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.881 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:02.882 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012746+0000", 2024-04-25T22:54:02.882 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.129e-06 2024-04-25T22:54:02.882 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.882 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.882 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:02.882 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012796+0000", 2024-04-25T22:54:02.882 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9231999999999999e-05 2024-04-25T22:54:02.882 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.883 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:02.883 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012915+0000", 2024-04-25T22:54:02.883 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119021 2024-04-25T22:54:02.883 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.883 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:54:02.883 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013069+0000", 2024-04-25T22:54:02.884 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015463900000000001 2024-04-25T22:54:02.884 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.884 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.884 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:02.884 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019237+0000", 2024-04-25T22:54:02.884 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061680329999999998 2024-04-25T22:54:02.884 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.884 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.885 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:02.885 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023603+0000", 2024-04-25T22:54:02.885 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043655860000000003 2024-04-25T22:54:02.885 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.885 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.885 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:02.885 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023659+0000", 2024-04-25T22:54:02.885 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6484000000000003e-05 2024-04-25T22:54:02.886 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.886 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.886 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:02.886 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023701+0000", 2024-04-25T22:54:02.886 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1761999999999998e-05 2024-04-25T22:54:02.886 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:02.886 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:02.886 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:02.887 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.887 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.887 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:02.887 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:54:02.887 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 129.77807469699999, 2024-04-25T22:54:02.887 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011234429000000001, 2024-04-25T22:54:02.887 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:02.887 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:02.888 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:02.888 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:02.888 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.888 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:02.888 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:54:02.888 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:02.888 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.888 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.888 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:02.889 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:54:02.889 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:02.889 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.889 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.889 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:02.889 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012762+0000", 2024-04-25T22:54:02.889 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-04-25T22:54:02.889 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.890 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.890 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:02.890 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012765+0000", 2024-04-25T22:54:02.890 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2569999999999999e-06 2024-04-25T22:54:02.890 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.890 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.890 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:02.890 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012783+0000", 2024-04-25T22:54:02.890 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8431999999999999e-05 2024-04-25T22:54:02.891 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.891 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.891 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:02.891 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012799+0000", 2024-04-25T22:54:02.891 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5438999999999999e-05 2024-04-25T22:54:02.891 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.891 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.891 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:02.892 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013826+0000", 2024-04-25T22:54:02.892 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010275060000000001 2024-04-25T22:54:02.892 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.892 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.892 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:02.892 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013913+0000", 2024-04-25T22:54:02.892 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.708e-05 2024-04-25T22:54:02.892 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.893 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.893 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:54:02.893 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014098+0000", 2024-04-25T22:54:02.893 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018519399999999999 2024-04-25T22:54:02.893 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.893 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.893 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:02.893 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019684+0000", 2024-04-25T22:54:02.893 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055860079999999999 2024-04-25T22:54:02.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.894 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:02.894 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023876+0000", 2024-04-25T22:54:02.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041918800000000003 2024-04-25T22:54:02.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.894 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:02.894 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023957+0000", 2024-04-25T22:54:02.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1165e-05 2024-04-25T22:54:02.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.895 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:02.895 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023995+0000", 2024-04-25T22:54:02.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:54:02.895 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:02.895 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:02.896 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:02.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.896 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.896 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:02.896 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:54:02.896 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 129.77797691800001, 2024-04-25T22:54:02.896 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011131200000000001, 2024-04-25T22:54:02.896 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:02.897 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:02.897 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:02.897 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:02.897 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.897 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:02.897 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:54:02.897 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:02.897 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.897 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.898 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:02.898 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:54:02.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:02.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.898 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:02.898 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012860+0000", 2024-04-25T22:54:02.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3900000000000004e-07 2024-04-25T22:54:02.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.899 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:02.899 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012865+0000", 2024-04-25T22:54:02.899 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5609999999999998e-06 2024-04-25T22:54:02.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.899 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:02.899 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012895+0000", 2024-04-25T22:54:02.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9847000000000001e-05 2024-04-25T22:54:02.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.900 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:02.900 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012905+0000", 2024-04-25T22:54:02.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.03e-05 2024-04-25T22:54:02.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.900 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:02.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015020+0000", 2024-04-25T22:54:02.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021142940000000001 2024-04-25T22:54:02.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.901 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:02.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015182+0000", 2024-04-25T22:54:02.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016248099999999999 2024-04-25T22:54:02.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.902 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:54:02.902 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015357+0000", 2024-04-25T22:54:02.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017471000000000001 2024-04-25T22:54:02.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.902 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:02.902 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021021+0000", 2024-04-25T22:54:02.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056638340000000004 2024-04-25T22:54:02.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:02.903 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023712+0000", 2024-04-25T22:54:02.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026910380000000002 2024-04-25T22:54:02.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:02.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023763+0000", 2024-04-25T22:54:02.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1477999999999997e-05 2024-04-25T22:54:02.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.904 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:02.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023990+0000", 2024-04-25T22:54:02.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000226818 2024-04-25T22:54:02.904 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:02.904 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:02.905 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:02.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.905 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:02.905 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:54:02.905 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 129.777853822, 2024-04-25T22:54:02.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011705299000000001, 2024-04-25T22:54:02.905 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:02.906 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:02.906 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:02.906 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:02.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.906 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:02.906 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:54:02.906 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:02.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.907 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:02.907 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:54:02.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:02.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.907 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:02.907 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012983+0000", 2024-04-25T22:54:02.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:54:02.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.908 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.908 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:02.908 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012986+0000", 2024-04-25T22:54:02.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5700000000000001e-06 2024-04-25T22:54:02.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.908 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.908 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:02.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012993+0000", 2024-04-25T22:54:02.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8730000000000001e-06 2024-04-25T22:54:02.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:02.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013000+0000", 2024-04-25T22:54:02.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1890000000000001e-06 2024-04-25T22:54:02.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:02.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:54:02.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002147866 2024-04-25T22:54:02.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:02.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015351+0000", 2024-04-25T22:54:02.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020300799999999999 2024-04-25T22:54:02.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:54:02.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016260+0000", 2024-04-25T22:54:02.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00090926799999999997 2024-04-25T22:54:02.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:02.912 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022669+0000", 2024-04-25T22:54:02.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064082849999999997 2024-04-25T22:54:02.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.912 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:02.912 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024584+0000", 2024-04-25T22:54:02.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019151699999999999 2024-04-25T22:54:02.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.913 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.913 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:02.913 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024643+0000", 2024-04-25T22:54:02.913 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8888999999999998e-05 2024-04-25T22:54:02.913 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.913 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.913 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:02.913 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024687+0000", 2024-04-25T22:54:02.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4444999999999999e-05 2024-04-25T22:54:02.914 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:02.914 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:02.914 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:02.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.914 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:02.914 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:54:02.915 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 129.77782623100001, 2024-04-25T22:54:02.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011249699, 2024-04-25T22:54:02.915 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:02.915 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:02.915 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:02.915 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:02.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.915 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:02.916 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:54:02.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:02.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.916 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:02.916 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:54:02.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:02.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.917 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:02.917 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013010+0000", 2024-04-25T22:54:02.917 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2099999999999996e-07 2024-04-25T22:54:02.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.917 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.917 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:02.917 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013013+0000", 2024-04-25T22:54:02.917 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1310000000000002e-06 2024-04-25T22:54:02.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:02.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013020+0000", 2024-04-25T22:54:02.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3330000000000002e-06 2024-04-25T22:54:02.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:02.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013025+0000", 2024-04-25T22:54:02.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6760000000000004e-06 2024-04-25T22:54:02.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.919 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:02.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013163+0000", 2024-04-25T22:54:02.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013824599999999999 2024-04-25T22:54:02.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:02.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013504+0000", 2024-04-25T22:54:02.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034080299999999998 2024-04-25T22:54:02.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:54:02.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013613+0000", 2024-04-25T22:54:02.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108705 2024-04-25T22:54:02.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.921 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:02.921 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015831+0000", 2024-04-25T22:54:02.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002217672 2024-04-25T22:54:02.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.921 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:02.922 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024137+0000", 2024-04-25T22:54:02.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0083060489999999994 2024-04-25T22:54:02.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.922 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:02.922 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024218+0000", 2024-04-25T22:54:02.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1351000000000001e-05 2024-04-25T22:54:02.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.923 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:02.923 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024259+0000", 2024-04-25T22:54:02.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1112000000000002e-05 2024-04-25T22:54:02.923 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:02.923 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:02.923 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:02.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.923 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.923 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:02.924 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:54:02.924 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 129.777738505, 2024-04-25T22:54:02.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020379749999999999, 2024-04-25T22:54:02.924 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:02.924 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:02.924 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:02.924 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:02.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:02.925 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:54:02.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:02.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.925 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:02.925 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:54:02.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:02.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:02.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013098+0000", 2024-04-25T22:54:02.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:54:02.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:02.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013105+0000", 2024-04-25T22:54:02.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5969999999999997e-06 2024-04-25T22:54:02.927 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.927 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.927 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:02.927 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013190+0000", 2024-04-25T22:54:02.927 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5618999999999995e-05 2024-04-25T22:54:02.927 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.927 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.927 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:02.927 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013200+0000", 2024-04-25T22:54:02.928 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5859999999999994e-06 2024-04-25T22:54:02.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.928 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.928 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:02.928 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020265+0000", 2024-04-25T22:54:02.928 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070653349999999998 2024-04-25T22:54:02.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.928 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.929 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:02.929 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020454+0000", 2024-04-25T22:54:02.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189316 2024-04-25T22:54:02.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.929 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:54:02.929 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020586+0000", 2024-04-25T22:54:02.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013195700000000001 2024-04-25T22:54:02.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.930 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:02.930 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023822+0000", 2024-04-25T22:54:02.930 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032358529999999999 2024-04-25T22:54:02.930 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.930 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:02.931 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033409+0000", 2024-04-25T22:54:02.931 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095870520000000004 2024-04-25T22:54:02.931 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.931 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.931 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:02.931 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033447+0000", 2024-04-25T22:54:02.931 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7261999999999997e-05 2024-04-25T22:54:02.931 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.931 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.932 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:02.932 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033477+0000", 2024-04-25T22:54:02.932 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0389e-05 2024-04-25T22:54:02.932 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:02.932 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:02.932 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:02.932 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.932 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.932 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:02.933 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:54:02.933 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 129.77762199899999, 2024-04-25T22:54:02.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010857383999999999, 2024-04-25T22:54:02.933 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:02.933 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:02.933 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:02.933 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:02.933 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.934 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:02.934 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:54:02.934 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:02.934 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.934 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.934 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:02.934 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:54:02.934 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:02.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.935 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.935 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:02.935 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:54:02.935 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:54:02.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.935 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.935 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:02.935 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013218+0000", 2024-04-25T22:54:02.936 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8199999999999998e-06 2024-04-25T22:54:02.936 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.936 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.936 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:02.936 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013226+0000", 2024-04-25T22:54:02.936 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7649999999999993e-06 2024-04-25T22:54:02.936 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.936 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.937 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:02.937 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013259+0000", 2024-04-25T22:54:02.937 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2727e-05 2024-04-25T22:54:02.937 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.937 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.937 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:02.937 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014809+0000", 2024-04-25T22:54:02.937 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001550144 2024-04-25T22:54:02.937 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.938 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.938 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:02.938 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014958+0000", 2024-04-25T22:54:02.938 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014890300000000001 2024-04-25T22:54:02.938 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.938 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.938 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:54:02.938 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015087+0000", 2024-04-25T22:54:02.939 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012939200000000001 2024-04-25T22:54:02.939 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.939 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.939 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:02.939 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020212+0000", 2024-04-25T22:54:02.939 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051248939999999996 2024-04-25T22:54:02.939 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.939 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.939 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:02.940 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023699+0000", 2024-04-25T22:54:02.940 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034873289999999999 2024-04-25T22:54:02.940 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.940 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.940 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:02.940 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024014+0000", 2024-04-25T22:54:02.940 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031473999999999999 2024-04-25T22:54:02.940 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.940 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.941 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:02.941 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024071+0000", 2024-04-25T22:54:02.941 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7040000000000003e-05 2024-04-25T22:54:02.941 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:02.941 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:02.941 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:02.941 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.941 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.942 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:02.942 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:54:02.942 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 129.77756729399999, 2024-04-25T22:54:02.942 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012329677000000001, 2024-04-25T22:54:02.942 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:02.942 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:02.942 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:02.943 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:02.943 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.943 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:02.943 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:54:02.943 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:02.943 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.943 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.943 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:02.943 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:54:02.944 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:02.944 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.944 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.944 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:02.944 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013269+0000", 2024-04-25T22:54:02.944 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5000000000000002e-07 2024-04-25T22:54:02.944 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.944 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.945 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:02.945 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:54:02.945 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6909999999999999e-06 2024-04-25T22:54:02.945 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.945 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.945 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:02.945 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013284+0000", 2024-04-25T22:54:02.945 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0963e-05 2024-04-25T22:54:02.946 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.946 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.946 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:02.946 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013361+0000", 2024-04-25T22:54:02.946 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7379999999999994e-05 2024-04-25T22:54:02.946 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.946 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.946 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:02.946 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013448+0000", 2024-04-25T22:54:02.947 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6990000000000006e-05 2024-04-25T22:54:02.947 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.947 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.947 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:02.947 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013632+0000", 2024-04-25T22:54:02.947 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018396800000000001 2024-04-25T22:54:02.947 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.947 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.948 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:54:02.948 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013800+0000", 2024-04-25T22:54:02.948 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167467 2024-04-25T22:54:02.948 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.948 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.948 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:02.948 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.018570+0000", 2024-04-25T22:54:02.948 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047701460000000003 2024-04-25T22:54:02.948 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.949 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.949 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:02.949 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025507+0000", 2024-04-25T22:54:02.949 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069372039999999998 2024-04-25T22:54:02.949 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.949 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.949 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:02.949 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025562+0000", 2024-04-25T22:54:02.949 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4858999999999998e-05 2024-04-25T22:54:02.950 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.950 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.950 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:02.950 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025598+0000", 2024-04-25T22:54:02.950 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6259e-05 2024-04-25T22:54:02.950 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:02.950 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:02.950 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:02.951 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.951 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.951 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:02.951 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:54:02.951 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 129.77743542100001, 2024-04-25T22:54:02.951 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020176666999999999, 2024-04-25T22:54:02.951 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:02.951 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:02.952 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:54:02.952 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:02.952 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.952 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:02.952 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:54:02.952 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:02.952 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.952 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.952 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:02.953 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:54:02.953 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:02.953 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.953 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.953 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:02.953 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:54:02.953 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-04-25T22:54:02.953 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.954 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.954 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:02.954 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013405+0000", 2024-04-25T22:54:02.954 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0559999999999998e-06 2024-04-25T22:54:02.954 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.954 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.954 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:02.954 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013422+0000", 2024-04-25T22:54:02.954 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6770999999999999e-05 2024-04-25T22:54:02.955 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.955 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.955 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:02.955 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013431+0000", 2024-04-25T22:54:02.957 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5019999999999998e-06 2024-04-25T22:54:02.957 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.957 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.958 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:02.958 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021720+0000", 2024-04-25T22:54:02.958 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082884340000000008 2024-04-25T22:54:02.958 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.958 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.958 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:02.958 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022122+0000", 2024-04-25T22:54:02.958 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000401634 2024-04-25T22:54:02.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.959 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.959 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:02.959 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033577+0000", 2024-04-25T22:54:02.959 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011455435999999999 2024-04-25T22:54:02.959 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:02.959 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:02.959 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:02.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.960 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.960 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4734.0:31 4.1b 4:d9872866:::1000000021d.00000002:head [write 0~3618035] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-25T22:54:02.960 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:54:02.960 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 31.737861159000001, 2024-04-25T22:54:02.960 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011647062, 2024-04-25T22:54:02.960 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:02.960 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:02.961 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:02.961 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:54:02.961 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4734", 2024-04-25T22:54:02.961 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:54:02.961 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 31 2024-04-25T22:54:02.961 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.961 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:02.961 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.961 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:02.962 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:54:02.962 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:02.962 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.962 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.962 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:02.962 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:54:02.962 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:02.962 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.963 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.963 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:02.963 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:54:02.963 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5700000000000001e-07 2024-04-25T22:54:02.963 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.963 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.963 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:02.963 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059575+0000", 2024-04-25T22:54:02.964 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0065991380000000001 2024-04-25T22:54:02.964 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.964 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.964 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:02.964 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059586+0000", 2024-04-25T22:54:02.964 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1438e-05 2024-04-25T22:54:02.964 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.964 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.964 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:02.965 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059592+0000", 2024-04-25T22:54:02.965 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2899999999999999e-06 2024-04-25T22:54:02.965 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.965 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.965 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:02.965 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059660+0000", 2024-04-25T22:54:02.965 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7980999999999998e-05 2024-04-25T22:54:02.965 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.965 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.966 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:02.966 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059757+0000", 2024-04-25T22:54:02.966 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6340000000000003e-05 2024-04-25T22:54:02.966 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.966 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.966 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:02.966 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.064487+0000", 2024-04-25T22:54:02.966 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004730621 2024-04-25T22:54:02.967 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.967 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.967 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:02.967 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.064538+0000", 2024-04-25T22:54:02.967 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0801999999999999e-05 2024-04-25T22:54:02.967 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.967 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.967 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:02.967 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.064622+0000", 2024-04-25T22:54:02.968 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3595000000000002e-05 2024-04-25T22:54:02.968 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:02.968 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:02.968 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:02.968 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.968 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.968 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:97 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-25T22:54:02.968 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:53:33.026298+0000", 2024-04-25T22:54:02.969 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.764537345000001, 2024-04-25T22:54:02.969 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015641848999999999, 2024-04-25T22:54:02.969 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:02.969 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:02.969 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:02.969 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:02.969 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.969 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:02.970 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026298+0000", 2024-04-25T22:54:02.970 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:02.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.970 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.970 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:02.970 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026298+0000", 2024-04-25T22:54:02.970 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:02.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.971 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.971 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:02.971 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026299+0000", 2024-04-25T22:54:02.971 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7299999999999996e-07 2024-04-25T22:54:02.971 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.971 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.971 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:02.971 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026464+0000", 2024-04-25T22:54:02.972 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016477700000000001 2024-04-25T22:54:02.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.972 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.972 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:02.972 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026472+0000", 2024-04-25T22:54:02.972 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1589999999999993e-06 2024-04-25T22:54:02.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.972 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.972 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:02.973 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026476+0000", 2024-04-25T22:54:02.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4580000000000003e-06 2024-04-25T22:54:02.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.973 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.973 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:02.973 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026550+0000", 2024-04-25T22:54:02.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3836000000000003e-05 2024-04-25T22:54:02.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.974 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:02.974 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026644+0000", 2024-04-25T22:54:02.974 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4022000000000002e-05 2024-04-25T22:54:02.974 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.974 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:02.974 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.041838+0000", 2024-04-25T22:54:02.974 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015193814999999999 2024-04-25T22:54:02.975 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.975 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.975 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:02.975 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.041874+0000", 2024-04-25T22:54:02.975 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5856999999999999e-05 2024-04-25T22:54:02.975 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:02.975 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:02.975 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:02.976 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.041940+0000", 2024-04-25T22:54:02.976 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6352000000000004e-05 2024-04-25T22:54:02.976 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:02.976 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:02.976 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:02.976 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:02.976 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:02.976 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:54:02.978 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:54:02.979 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:54:02.977+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:54:03.078 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:54:03.077+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:54:03.083 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:54:03.083 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:54:03.084 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-25T22:54:03.084 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:54:03.092 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:54:03.179 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:54:03.178+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:54:03.233 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:54:03.233 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:54:03.233 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-25T22:54:03.234 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-25T22:54:03.234 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:54:03.241 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:54:03.285 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:54:03.284+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:54:03.344 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:54:03.345 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:54:03.345 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:54:03.345 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:54:03.345 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.345 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:54:03.345 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:54:03.345 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 135.375597451, 2024-04-25T22:54:03.345 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:54:03.346 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:03.346 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:03.346 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:03.346 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:03.346 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.346 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:03.346 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:54:03.347 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:03.347 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.347 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.347 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:03.347 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:54:03.347 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:03.347 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.347 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.348 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:03.348 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:54:03.348 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:54:03.348 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.348 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.348 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:03.348 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:54:03.348 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:54:03.349 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.349 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.349 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:03.349 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:54:03.349 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:54:03.349 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.349 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.349 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:03.350 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:54:03.350 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:54:03.350 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.350 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.350 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:03.350 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:54:03.350 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:54:03.350 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.351 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.351 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:03.351 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:54:03.351 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:54:03.351 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.351 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.351 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:54:03.351 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:54:03.352 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:54:03.352 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.352 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.352 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:03.352 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:54:03.352 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:54:03.352 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:03.352 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:03.353 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:03.353 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.353 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.353 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:03.353 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:54:03.353 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 130.331101752, 2024-04-25T22:54:03.353 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:54:03.353 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:03.354 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:03.354 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:03.354 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:03.354 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.354 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:03.354 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:54:03.354 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:03.354 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.355 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.355 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:03.355 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:54:03.355 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:03.355 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.355 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.355 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:03.355 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:54:03.356 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:54:03.356 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.356 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.356 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:03.356 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:54:03.356 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:54:03.356 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.356 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.357 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:03.357 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:54:03.357 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:54:03.357 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.357 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.357 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:03.357 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:54:03.357 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:54:03.358 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.358 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.358 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:03.358 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:54:03.358 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:54:03.358 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.358 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.359 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:03.359 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:54:03.359 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:54:03.359 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.359 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.360 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:54:03.360 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:54:03.360 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:54:03.360 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.360 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.360 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:54:03.360 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:54:03.361 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:54:03.361 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.361 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.361 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:03.361 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:54:03.361 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:54:03.361 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.361 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.362 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:54:03.362 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:54:03.362 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:54:03.362 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.362 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.362 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:03.362 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:54:03.362 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:54:03.363 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:03.363 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:03.363 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:03.363 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.363 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.363 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:03.364 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:54:03.364 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 130.33042737599999, 2024-04-25T22:54:03.364 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:54:03.364 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:03.364 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:03.364 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:03.364 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:03.364 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.365 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:03.365 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:54:03.365 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:03.365 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.365 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.365 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:03.365 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:54:03.365 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:03.366 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.366 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.366 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:03.366 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:54:03.366 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:54:03.369 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.369 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.370 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:03.370 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:54:03.370 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:54:03.370 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.370 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.370 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:03.370 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:54:03.371 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:54:03.371 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.371 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.371 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:03.371 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:54:03.371 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:54:03.371 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.371 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.371 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:03.372 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:54:03.372 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:54:03.372 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.372 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.372 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:03.372 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:54:03.372 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:54:03.372 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.373 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.373 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:54:03.373 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:54:03.373 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:54:03.373 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.373 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.373 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:54:03.373 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:54:03.374 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:54:03.374 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.374 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.374 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:03.374 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:54:03.374 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:54:03.374 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.375 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.375 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:54:03.375 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:54:03.375 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:54:03.375 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.375 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.375 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:03.375 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:54:03.375 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:54:03.376 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:03.376 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:03.376 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:03.376 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.376 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.376 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:03.376 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:54:03.376 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 130.32991816399999, 2024-04-25T22:54:03.377 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:54:03.377 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:03.377 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:03.377 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:03.377 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:03.377 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.377 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:03.377 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:54:03.377 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:03.378 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.378 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.378 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:03.378 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:54:03.378 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:03.378 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.378 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.378 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:03.379 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:54:03.379 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:54:03.379 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.379 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.379 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:03.379 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:54:03.379 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:54:03.379 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.380 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.380 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:03.380 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:54:03.380 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:54:03.380 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.380 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.380 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:03.381 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:54:03.381 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:54:03.381 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.381 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.381 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:03.381 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:54:03.381 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:54:03.381 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.381 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.382 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:03.382 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:54:03.382 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:54:03.382 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.382 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.382 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:54:03.382 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:54:03.382 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:54:03.383 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.383 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.383 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:54:03.383 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:54:03.383 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:54:03.383 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.383 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.383 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:03.383 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:54:03.384 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:54:03.384 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.384 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.384 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:54:03.384 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:54:03.384 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:54:03.384 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.384 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.384 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:03.385 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:54:03.385 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:54:03.385 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:03.385 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:03.385 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:03.385 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.385 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.385 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:03.386 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:54:03.386 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 130.329504966, 2024-04-25T22:54:03.386 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:54:03.386 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:03.386 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:03.386 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:03.386 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:03.386 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.386 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:03.387 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:54:03.387 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:03.387 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.387 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.387 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:03.387 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:54:03.387 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:03.387 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.388 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.388 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:03.388 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:54:03.388 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:54:03.388 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.388 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.388 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:03.388 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:54:03.389 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:54:03.389 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.389 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.389 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:03.389 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:54:03.389 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:54:03.389 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.389 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.389 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:03.390 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:54:03.390 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:54:03.390 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.390 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.390 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:03.390 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:54:03.390 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:54:03.391 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.391 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.391 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:03.391 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:54:03.391 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:54:03.391 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.391 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.391 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:54:03.391 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:54:03.392 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:54:03.392 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.392 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.392 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:54:03.392 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:54:03.392 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:54:03.392 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.392 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.392 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:03.393 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:54:03.393 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:54:03.393 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.393 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.393 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:54:03.393 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:54:03.393 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:54:03.393 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.394 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.394 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:03.394 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:54:03.394 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:54:03.394 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:03.394 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:03.394 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:03.394 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.395 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.395 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:03.395 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:54:03.395 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 130.32945429599999, 2024-04-25T22:54:03.395 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:54:03.395 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:03.395 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:03.395 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:03.395 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:03.396 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.396 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:03.396 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:54:03.396 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:03.396 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.396 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.396 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:03.396 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:54:03.397 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:03.397 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.397 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.397 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:03.397 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:54:03.397 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:54:03.397 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.397 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.397 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:03.398 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:54:03.398 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:54:03.398 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.398 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.398 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:03.398 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:54:03.398 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:54:03.398 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.399 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.399 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:03.399 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:54:03.399 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:54:03.399 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.399 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.399 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:03.399 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:54:03.399 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:54:03.400 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.400 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.400 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:54:03.400 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:54:03.400 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:54:03.400 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.400 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.400 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:03.401 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:54:03.401 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:54:03.401 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.401 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.401 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:03.401 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:54:03.401 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:54:03.401 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.401 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.402 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:54:03.402 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:54:03.402 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:54:03.402 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.402 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.402 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:54:03.402 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:54:03.402 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:54:03.403 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.403 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.403 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:03.403 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:54:03.403 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:54:03.403 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.403 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.403 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:54:03.404 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:54:03.404 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:54:03.404 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.404 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.404 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:03.404 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:54:03.404 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:54:03.404 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:03.404 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:03.405 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:03.405 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.405 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.405 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:03.405 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:54:03.405 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 130.32941742700001, 2024-04-25T22:54:03.405 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:54:03.405 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:03.406 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:03.406 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:03.406 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:03.406 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.406 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:03.406 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:54:03.406 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:03.406 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.406 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.407 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:03.407 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:54:03.407 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:03.407 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.407 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.407 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:03.407 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:54:03.407 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:54:03.408 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.408 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.408 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:03.408 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:54:03.408 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:54:03.408 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.408 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.408 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:03.408 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:54:03.409 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:54:03.409 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.409 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.409 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:03.409 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:54:03.409 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:54:03.409 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.409 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.410 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:03.410 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:54:03.410 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:54:03.410 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.410 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.410 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:54:03.410 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:54:03.410 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:54:03.410 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.411 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.411 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:03.411 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:54:03.411 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:54:03.411 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.411 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.411 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:03.411 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:54:03.412 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:54:03.412 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.412 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.412 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:54:03.412 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:54:03.412 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:54:03.412 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.412 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.412 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:54:03.413 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:54:03.413 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:54:03.413 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.413 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.413 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:03.413 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:54:03.413 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:54:03.413 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.414 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.414 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:54:03.414 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:54:03.414 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:54:03.414 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.414 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.414 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:03.414 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:54:03.414 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:54:03.415 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:03.415 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:03.415 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:03.415 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.415 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.415 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:03.415 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:54:03.415 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 130.329392461, 2024-04-25T22:54:03.416 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:54:03.416 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:03.416 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:03.416 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:03.416 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:03.416 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.416 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:03.416 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:54:03.416 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:03.417 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.417 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.417 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:03.417 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:54:03.417 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:03.417 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.417 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.417 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:03.418 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:54:03.418 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:54:03.418 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.418 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.418 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:03.418 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:54:03.418 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:54:03.418 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.419 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.419 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:03.419 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:54:03.419 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:54:03.419 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.419 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.419 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:03.419 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:54:03.420 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:54:03.420 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.420 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.420 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:03.420 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:54:03.420 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:54:03.420 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.420 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.420 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:03.421 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:54:03.421 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:54:03.421 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.421 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.421 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:54:03.421 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:54:03.421 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:54:03.421 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.422 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.422 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:54:03.422 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:54:03.422 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:54:03.422 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.422 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.422 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:03.422 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:54:03.422 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:54:03.423 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.423 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.423 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:54:03.423 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:54:03.423 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:54:03.423 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.423 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.423 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:03.424 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:54:03.424 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:54:03.424 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:03.424 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:03.424 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:03.424 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.424 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.424 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:03.424 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:54:03.425 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 130.32935609699999, 2024-04-25T22:54:03.425 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:54:03.425 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:03.425 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:03.425 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:54:03.425 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:03.425 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.425 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:03.426 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:54:03.426 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:03.426 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.426 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.426 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:03.426 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:54:03.426 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:03.426 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.427 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.427 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:03.427 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:54:03.427 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:54:03.427 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.427 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.427 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:03.427 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:54:03.428 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:54:03.428 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.428 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.428 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:03.428 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:54:03.428 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:54:03.428 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.428 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.429 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:03.429 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:54:03.429 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:54:03.429 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.429 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.429 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:03.429 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:54:03.429 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:54:03.430 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.430 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.430 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:54:03.430 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:54:03.430 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:54:03.430 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.430 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.431 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:03.431 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:54:03.431 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:54:03.431 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.431 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.431 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:03.431 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:54:03.431 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:54:03.431 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.432 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.432 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:03.432 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:54:03.432 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:54:03.432 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:03.432 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:03.432 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:03.433 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.433 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.433 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:03.433 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:54:03.433 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 130.32932501600001, 2024-04-25T22:54:03.433 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:54:03.433 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:03.433 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:03.433 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:54:03.434 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:03.434 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.434 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:03.434 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:54:03.434 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:03.434 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.434 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.434 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:03.435 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:54:03.435 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:03.435 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.435 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.435 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:03.435 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:54:03.435 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:54:03.435 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.435 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.436 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:03.436 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:54:03.436 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:54:03.436 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.436 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.436 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:03.436 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:54:03.436 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:54:03.437 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.437 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.437 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:03.437 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:54:03.437 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:54:03.437 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.437 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.437 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:03.438 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:54:03.438 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:54:03.438 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.438 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.438 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:03.438 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:54:03.438 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:54:03.438 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.438 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.439 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:03.439 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:54:03.439 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:54:03.439 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:03.439 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:03.439 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:03.439 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.439 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.440 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:30 4.31 4:8ebfc112:::1000000021d.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-25T22:54:03.440 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:54:03.440 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 32.289639145999999, 2024-04-25T22:54:03.440 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015003005, 2024-04-25T22:54:03.440 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:03.440 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:03.440 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:03.440 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:54:03.440 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:54:03.441 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:54:03.441 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 30 2024-04-25T22:54:03.441 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.441 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:03.441 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.441 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:03.441 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:54:03.441 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:03.442 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.442 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.442 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:03.442 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:54:03.442 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:03.442 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.442 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.442 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:03.443 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053133+0000", 2024-04-25T22:54:03.443 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0370000000000001e-06 2024-04-25T22:54:03.443 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.443 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.443 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:03.443 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060377+0000", 2024-04-25T22:54:03.443 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0072431070000000004 2024-04-25T22:54:03.443 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.444 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.444 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:03.444 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060388+0000", 2024-04-25T22:54:03.444 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1285e-05 2024-04-25T22:54:03.444 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.444 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.444 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:03.444 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060394+0000", 2024-04-25T22:54:03.445 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1040000000000003e-06 2024-04-25T22:54:03.445 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.445 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.445 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:03.445 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060483+0000", 2024-04-25T22:54:03.445 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.9345000000000006e-05 2024-04-25T22:54:03.445 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.445 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.446 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:03.446 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060566+0000", 2024-04-25T22:54:03.446 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2237999999999994e-05 2024-04-25T22:54:03.446 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.446 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.446 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:54:03.446 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068057+0000", 2024-04-25T22:54:03.446 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074912210000000002 2024-04-25T22:54:03.447 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.447 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.447 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:54:03.447 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068090+0000", 2024-04-25T22:54:03.447 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3501000000000003e-05 2024-04-25T22:54:03.447 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.447 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.447 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:03.447 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068134+0000", 2024-04-25T22:54:03.448 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4166999999999999e-05 2024-04-25T22:54:03.448 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:03.448 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:03.448 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:03.448 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.448 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.448 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:66 4.27 4:e5671758:::1000000024f.00000000:head [write 0~6641] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:54:03.448 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:54:03.449 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 32.029528810000002, 2024-04-25T22:54:03.449 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075166540000000002, 2024-04-25T22:54:03.449 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:03.449 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:03.449 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:03.449 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:54:03.449 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:54:03.449 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:54:03.449 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 66 2024-04-25T22:54:03.450 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.450 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:03.450 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.450 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:03.450 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:54:03.450 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:03.450 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.450 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.451 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:03.451 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:54:03.451 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:03.451 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.451 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.451 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:03.451 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:54:03.451 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4099999999999998e-07 2024-04-25T22:54:03.452 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.452 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.452 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:03.452 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313252+0000", 2024-04-25T22:54:03.452 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5380000000000008e-06 2024-04-25T22:54:03.452 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.452 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.452 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:03.452 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313260+0000", 2024-04-25T22:54:03.453 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2609999999999993e-06 2024-04-25T22:54:03.453 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.453 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.453 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:03.453 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313265+0000", 2024-04-25T22:54:03.453 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4850000000000003e-06 2024-04-25T22:54:03.453 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.453 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.454 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:03.454 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313310+0000", 2024-04-25T22:54:03.454 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5247999999999998e-05 2024-04-25T22:54:03.454 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.454 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.454 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:03.454 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313370+0000", 2024-04-25T22:54:03.454 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0275000000000001e-05 2024-04-25T22:54:03.455 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.455 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.455 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:54:03.455 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313435+0000", 2024-04-25T22:54:03.455 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4647000000000006e-05 2024-04-25T22:54:03.455 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.455 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.455 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:03.456 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314174+0000", 2024-04-25T22:54:03.456 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00073925 2024-04-25T22:54:03.456 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.456 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.456 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:54:03.456 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320688+0000", 2024-04-25T22:54:03.456 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.006513418 2024-04-25T22:54:03.456 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.456 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.457 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:54:03.457 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320736+0000", 2024-04-25T22:54:03.457 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.8114e-05 2024-04-25T22:54:03.457 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.457 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.457 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:03.457 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320758+0000", 2024-04-25T22:54:03.458 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2776999999999999e-05 2024-04-25T22:54:03.458 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:03.458 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:03.458 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:03.458 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.458 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.458 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:68 4.31 4:8fb7f7b7:::10000000251.00000000:head [write 0~2067] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:54:03.458 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:54:03.459 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 32.027843032, 2024-04-25T22:54:03.459 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0087011669999999992, 2024-04-25T22:54:03.459 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:03.459 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:03.459 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:03.459 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:54:03.460 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:54:03.460 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:54:03.460 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 68 2024-04-25T22:54:03.460 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.460 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:03.460 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.460 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:03.460 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:54:03.461 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:03.461 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.461 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.461 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:03.461 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:54:03.461 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:03.461 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.461 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.462 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:03.462 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:54:03.462 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:54:03.462 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.462 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.462 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:03.462 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314933+0000", 2024-04-25T22:54:03.463 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5430000000000004e-06 2024-04-25T22:54:03.463 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.463 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.463 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:03.463 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314944+0000", 2024-04-25T22:54:03.463 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.076e-05 2024-04-25T22:54:03.463 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.463 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.463 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:03.464 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314949+0000", 2024-04-25T22:54:03.464 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1019999999999996e-06 2024-04-25T22:54:03.464 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.464 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.464 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:03.464 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314996+0000", 2024-04-25T22:54:03.464 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7018999999999998e-05 2024-04-25T22:54:03.464 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.465 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.465 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:03.465 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315064+0000", 2024-04-25T22:54:03.465 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8738000000000005e-05 2024-04-25T22:54:03.465 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.465 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.465 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:54:03.465 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323531+0000", 2024-04-25T22:54:03.466 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084664739999999999 2024-04-25T22:54:03.466 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.466 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.466 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:54:03.466 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323574+0000", 2024-04-25T22:54:03.466 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3449999999999999e-05 2024-04-25T22:54:03.466 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.466 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.467 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:03.467 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323629+0000", 2024-04-25T22:54:03.467 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4296999999999999e-05 2024-04-25T22:54:03.467 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:03.467 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:03.467 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:03.467 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.467 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.467 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4734.0:69 4.32 e46/13 4:4e8c6251:::10000000252.00000000:head v 46'1, mlcod=0'0)", 2024-04-25T22:54:03.468 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:54:03.468 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 32.026811764000001, 2024-04-25T22:54:03.468 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076063240000000002, 2024-04-25T22:54:03.468 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:03.468 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:03.468 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:03.468 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:03.469 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.469 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:03.469 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:54:03.469 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:03.469 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.469 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.469 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:03.469 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:54:03.470 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:03.470 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.470 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.470 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:03.470 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:54:03.470 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3099999999999997e-07 2024-04-25T22:54:03.470 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.471 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.471 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:03.471 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315964+0000", 2024-04-25T22:54:03.471 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3229999999999999e-06 2024-04-25T22:54:03.471 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.471 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.471 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:03.471 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315973+0000", 2024-04-25T22:54:03.472 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7249999999999992e-06 2024-04-25T22:54:03.472 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.472 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.472 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:03.472 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315978+0000", 2024-04-25T22:54:03.472 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4830000000000001e-06 2024-04-25T22:54:03.472 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.472 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.473 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:03.473 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.316043+0000", 2024-04-25T22:54:03.473 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.5036000000000005e-05 2024-04-25T22:54:03.473 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.473 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.473 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:03.473 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.316055+0000", 2024-04-25T22:54:03.473 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1973999999999999e-05 2024-04-25T22:54:03.474 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.474 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.474 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:54:03.474 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323521+0000", 2024-04-25T22:54:03.474 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074660239999999999 2024-04-25T22:54:03.474 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.474 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.474 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:03.475 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323565+0000", 2024-04-25T22:54:03.475 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4128000000000002e-05 2024-04-25T22:54:03.475 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:03.475 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:03.475 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:03.475 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.475 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.475 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:72 4.36 4:6cdfec98:::10000000255.00000000:head [write 0~4131] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:54:03.475 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:54:03.476 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 32.024767851999997, 2024-04-25T22:54:03.476 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084820680000000006, 2024-04-25T22:54:03.476 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:03.476 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:03.476 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:03.476 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:54:03.476 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:54:03.476 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:54:03.477 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 72 2024-04-25T22:54:03.477 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.477 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:03.477 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.477 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:03.477 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:54:03.477 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:03.477 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.477 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.478 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:03.478 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:54:03.478 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:03.478 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.478 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.478 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:03.478 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:54:03.478 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1800000000000005e-07 2024-04-25T22:54:03.479 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.479 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.479 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:03.479 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318010+0000", 2024-04-25T22:54:03.479 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7399999999999998e-06 2024-04-25T22:54:03.479 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.479 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.479 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:03.480 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318019+0000", 2024-04-25T22:54:03.480 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0170000000000002e-06 2024-04-25T22:54:03.480 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.480 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.480 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:03.480 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318024+0000", 2024-04-25T22:54:03.480 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0150000000000003e-06 2024-04-25T22:54:03.480 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.481 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.481 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:03.481 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318075+0000", 2024-04-25T22:54:03.481 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0537000000000001e-05 2024-04-25T22:54:03.481 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.481 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.481 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:03.481 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318144+0000", 2024-04-25T22:54:03.482 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9432999999999997e-05 2024-04-25T22:54:03.482 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.482 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.482 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:54:03.482 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326392+0000", 2024-04-25T22:54:03.482 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0082482979999999994 2024-04-25T22:54:03.482 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.482 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.483 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:54:03.483 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326432+0000", 2024-04-25T22:54:03.483 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9870000000000003e-05 2024-04-25T22:54:03.483 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.483 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.483 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:03.483 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326485+0000", 2024-04-25T22:54:03.483 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2439999999999999e-05 2024-04-25T22:54:03.483 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:03.484 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:03.484 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:03.484 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.484 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.484 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:74 4.10 4:08e6f8ca:::10000000257.00000000:head [write 0~839] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:54:03.484 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:54:03.484 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 32.023294124000003, 2024-04-25T22:54:03.485 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070370720000000001, 2024-04-25T22:54:03.485 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:03.485 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:03.485 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:03.485 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:54:03.485 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:54:03.485 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:54:03.485 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 74 2024-04-25T22:54:03.486 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.486 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:03.486 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.486 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:03.486 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:54:03.486 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:03.486 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.486 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.487 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:03.487 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:54:03.487 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:03.487 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.487 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.487 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:03.487 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319477+0000", 2024-04-25T22:54:03.487 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1999999999999999e-07 2024-04-25T22:54:03.487 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.488 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.488 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:03.488 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319483+0000", 2024-04-25T22:54:03.488 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4260000000000002e-06 2024-04-25T22:54:03.488 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.488 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.488 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:03.488 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319494+0000", 2024-04-25T22:54:03.489 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.094e-05 2024-04-25T22:54:03.489 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.489 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.489 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:03.489 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319499+0000", 2024-04-25T22:54:03.489 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3789999999999997e-06 2024-04-25T22:54:03.489 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.489 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.490 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:03.490 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319545+0000", 2024-04-25T22:54:03.490 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6149000000000001e-05 2024-04-25T22:54:03.490 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.490 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.490 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:03.490 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319617+0000", 2024-04-25T22:54:03.490 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1792999999999995e-05 2024-04-25T22:54:03.491 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.491 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.491 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:54:03.491 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326406+0000", 2024-04-25T22:54:03.491 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067895999999999998 2024-04-25T22:54:03.491 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.491 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.491 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:54:03.491 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326443+0000", 2024-04-25T22:54:03.492 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6828e-05 2024-04-25T22:54:03.492 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.492 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.492 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:03.492 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326514+0000", 2024-04-25T22:54:03.492 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0236999999999999e-05 2024-04-25T22:54:03.492 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:03.492 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:03.493 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:03.493 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.493 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.493 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:128 3.1f 3:f83d65d8:::200.00000004:head [write 876784~3317520 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e48)", 2024-04-25T22:54:03.493 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:36.985410+0000", 2024-04-25T22:54:03.493 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 26.357360505999999, 2024-04-25T22:54:03.493 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0090177360000000002, 2024-04-25T22:54:03.493 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:03.494 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:03.494 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:03.494 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:03.494 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.494 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:03.494 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.985410+0000", 2024-04-25T22:54:03.494 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:03.494 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.494 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.495 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:03.495 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.985410+0000", 2024-04-25T22:54:03.495 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:03.495 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.495 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.495 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:03.495 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.985411+0000", 2024-04-25T22:54:03.495 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8400000000000003e-07 2024-04-25T22:54:03.496 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.496 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.496 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:03.496 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989116+0000", 2024-04-25T22:54:03.496 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037047389999999999 2024-04-25T22:54:03.496 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.496 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.496 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:03.497 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989128+0000", 2024-04-25T22:54:03.497 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1977999999999999e-05 2024-04-25T22:54:03.497 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.497 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.497 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:03.497 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989135+0000", 2024-04-25T22:54:03.497 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5290000000000003e-06 2024-04-25T22:54:03.497 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.497 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.498 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:03.498 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989181+0000", 2024-04-25T22:54:03.498 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6122999999999999e-05 2024-04-25T22:54:03.498 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.498 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.498 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:03.498 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989250+0000", 2024-04-25T22:54:03.498 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8535999999999996e-05 2024-04-25T22:54:03.499 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.499 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.499 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:54:03.499 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.994272+0000", 2024-04-25T22:54:03.499 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050224889999999998 2024-04-25T22:54:03.499 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.499 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.499 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:54:03.500 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.994335+0000", 2024-04-25T22:54:03.500 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2588000000000005e-05 2024-04-25T22:54:03.500 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.500 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.500 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:03.500 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.994428+0000", 2024-04-25T22:54:03.500 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2869999999999997e-05 2024-04-25T22:54:03.500 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:03.500 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:03.501 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:03.501 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.501 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.501 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:2150 4.22 4:47cffac6:::10000000a2b.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T22:54:03.501 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:41.078233+0000", 2024-04-25T22:54:03.501 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 22.264537195999999, 2024-04-25T22:54:03.501 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069201510000000003, 2024-04-25T22:54:03.501 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:03.502 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:03.502 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:03.502 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:03.502 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.502 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:03.502 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078233+0000", 2024-04-25T22:54:03.502 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:03.502 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.503 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.503 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:03.503 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078233+0000", 2024-04-25T22:54:03.503 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:03.503 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.503 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.503 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:03.503 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078234+0000", 2024-04-25T22:54:03.503 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1699999999999998e-07 2024-04-25T22:54:03.504 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.504 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.504 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:03.504 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078236+0000", 2024-04-25T22:54:03.504 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.875e-06 2024-04-25T22:54:03.504 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.504 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.504 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:03.505 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078242+0000", 2024-04-25T22:54:03.505 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2450000000000003e-06 2024-04-25T22:54:03.505 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.505 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.505 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:03.505 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078247+0000", 2024-04-25T22:54:03.505 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7450000000000003e-06 2024-04-25T22:54:03.505 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.506 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.506 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:03.506 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078641+0000", 2024-04-25T22:54:03.506 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00039420200000000002 2024-04-25T22:54:03.506 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.506 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.506 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:03.507 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078840+0000", 2024-04-25T22:54:03.507 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000199063 2024-04-25T22:54:03.507 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.507 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.507 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:54:03.507 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078919+0000", 2024-04-25T22:54:03.507 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9182000000000002e-05 2024-04-25T22:54:03.507 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.508 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.508 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:03.508 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.080906+0000", 2024-04-25T22:54:03.508 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0019866390000000001 2024-04-25T22:54:03.508 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.508 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.508 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:54:03.508 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085074+0000", 2024-04-25T22:54:03.509 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0041683639999999999 2024-04-25T22:54:03.509 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.509 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.509 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:54:03.509 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085117+0000", 2024-04-25T22:54:03.509 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2849999999999998e-05 2024-04-25T22:54:03.509 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.509 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.510 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:03.510 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085154+0000", 2024-04-25T22:54:03.510 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6468999999999999e-05 2024-04-25T22:54:03.510 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:03.510 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:03.510 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:03.510 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.511 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.511 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:2160 4.2a 4:57f9ed86:::10000000a3d.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T22:54:03.511 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:54:03.511 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 22.264067906000001, 2024-04-25T22:54:03.511 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0068959959999999997, 2024-04-25T22:54:03.511 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:03.511 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:03.511 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:03.512 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:03.512 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.512 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:03.512 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:54:03.512 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:03.512 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.512 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.512 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:03.512 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:54:03.513 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:03.513 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.513 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.513 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:03.513 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:54:03.513 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7000000000000004e-07 2024-04-25T22:54:03.513 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.513 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.514 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:03.514 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078707+0000", 2024-04-25T22:54:03.514 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.783e-06 2024-04-25T22:54:03.514 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.514 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.514 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:03.514 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078716+0000", 2024-04-25T22:54:03.515 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4800000000000001e-06 2024-04-25T22:54:03.515 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.515 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.515 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:03.515 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078724+0000", 2024-04-25T22:54:03.515 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1519999999999992e-06 2024-04-25T22:54:03.515 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.515 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.516 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:03.516 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078794+0000", 2024-04-25T22:54:03.516 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0500999999999995e-05 2024-04-25T22:54:03.516 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.516 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.516 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:03.516 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078912+0000", 2024-04-25T22:54:03.516 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000117439 2024-04-25T22:54:03.517 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.517 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.517 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:54:03.517 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079000+0000", 2024-04-25T22:54:03.517 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8092999999999998e-05 2024-04-25T22:54:03.517 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.517 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.517 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:03.518 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.080897+0000", 2024-04-25T22:54:03.518 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0018970899999999999 2024-04-25T22:54:03.518 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.518 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.518 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:54:03.518 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085517+0000", 2024-04-25T22:54:03.518 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0046198929999999999 2024-04-25T22:54:03.518 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.519 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.519 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:54:03.519 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085565+0000", 2024-04-25T22:54:03.519 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7777e-05 2024-04-25T22:54:03.519 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.519 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.519 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:03.520 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085599+0000", 2024-04-25T22:54:03.520 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4017999999999999e-05 2024-04-25T22:54:03.520 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:03.520 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:03.520 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:03.520 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.520 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.520 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:2163 4.2a 4:549f79e3:::10000000a43.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T22:54:03.521 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:54:03.521 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 22.264034552999998, 2024-04-25T22:54:03.521 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069469190000000002, 2024-04-25T22:54:03.521 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:03.521 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:03.521 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:03.521 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:03.521 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.522 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:03.522 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:54:03.522 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:03.522 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.522 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.522 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:03.522 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:54:03.522 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:03.523 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.523 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.523 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:03.523 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:54:03.523 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1399999999999997e-07 2024-04-25T22:54:03.523 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.523 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.523 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:03.524 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078739+0000", 2024-04-25T22:54:03.524 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2960000000000001e-06 2024-04-25T22:54:03.524 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.524 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.524 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:03.524 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078745+0000", 2024-04-25T22:54:03.524 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3439999999999997e-06 2024-04-25T22:54:03.525 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.525 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.525 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:03.525 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078750+0000", 2024-04-25T22:54:03.525 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3179999999999997e-06 2024-04-25T22:54:03.525 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.525 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.525 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:03.525 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079224+0000", 2024-04-25T22:54:03.526 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00047334999999999999 2024-04-25T22:54:03.526 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.526 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.526 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:03.526 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079292+0000", 2024-04-25T22:54:03.526 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8708999999999996e-05 2024-04-25T22:54:03.526 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.527 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.527 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:54:03.527 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079342+0000", 2024-04-25T22:54:03.527 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9299999999999999e-05 2024-04-25T22:54:03.527 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.527 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.527 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:03.527 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.081611+0000", 2024-04-25T22:54:03.528 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0022695229999999999 2024-04-25T22:54:03.528 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.528 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.528 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:54:03.528 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085605+0000", 2024-04-25T22:54:03.528 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0039933679999999997 2024-04-25T22:54:03.528 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.528 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.529 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:54:03.529 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085650+0000", 2024-04-25T22:54:03.529 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5111000000000002e-05 2024-04-25T22:54:03.529 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:03.529 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:03.529 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:03.529 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085683+0000", 2024-04-25T22:54:03.529 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3185999999999997e-05 2024-04-25T22:54:03.530 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:03.530 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:03.530 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:03.530 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:03.530 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:03.530 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:54:03.532 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is set 2024-04-25T22:54:03.533 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:54:03.534 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:54:03.531+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:54:03.633 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:54:03.633+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:54:03.644 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:54:03.644 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:54:03.645 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-04-25T22:54:03.645 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:54:03.653 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:54:03.703 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T22:54:03.734 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:54:03.734+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:54:03.755 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:54:03.756 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:54:03.756 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:54:03.756 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:54:03.756 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:54:03.765 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:54:03.835 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:54:03.834+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:54:03.839 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-25T22:54:03.839 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:54:03.840 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:54:03.858 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-25T22:54:03.859 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:54:03.861 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:54:03.862 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:54:03.867 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:54:03.867 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:54:03.876 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:54:03.936 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:54:03.935+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:54:03.982 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:54:03.982 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:54:03.991 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:54:04.036 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:54:04.035+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:54:04.092 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:54:04.092 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:54:04.100 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:54:04.141 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:54:04.140+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:54:04.239 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:54:04.238+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:54:04.242 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:54:04.242 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:54:04.250 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:54:04.340 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:54:04.339+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:54:04.357 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:54:04.357 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:54:04.366 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:54:04.441 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:54:04.440+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:54:04.508 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:54:04.508 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:54:04.516 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:54:04.560 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:54:04.559+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:54:04.618 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:54:04.618 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:54:04.626 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:54:04.667 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:54:04.666+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:54:04.728 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:54:04.728 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:54:04.736 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:54:04.780 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:54:04.779+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:54:04.837 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:54:04.838 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:54:04.846 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:54:04.887 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:54:04.886+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:54:04.949 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:54:04.948+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:54:04.989 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:54:04.989 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:54:04.998 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:54:05.050 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:54:05.049+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:54:05.101 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:54:05.101 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:54:05.110 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:54:05.151 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:54:05.150+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:54:05.252 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:54:05.252 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:54:05.252 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:54:05.251+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:54:05.261 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:54:05.353 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:54:05.352+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:54:05.403 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:54:05.403 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:54:05.412 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:54:05.454 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:54:05.453+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:54:05.516 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:54:05.516 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:54:05.525 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:54:05.533 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-25T22:54:05.547 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~82s 2024-04-25T22:54:05.568 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:54:05.567+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:54:05.626 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:54:05.626 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:54:05.634 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:54:05.656 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:54:05.655+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:54:05.757 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:54:05.756+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:54:05.776 INFO:teuthology.orchestra.run.smithi191.stdout:ERROR: (22) Invalid argument 2024-04-25T22:54:05.776 INFO:teuthology.orchestra.run.smithi191.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:54:05.784 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-25T22:54:05.858 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:54:05.857+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:54:05.862 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T22:54:05.886 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-04-25T22:54:05.887 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-25T22:54:05.895 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-25T22:54:05.981 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:54:05.980+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:54:05.987 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-25T22:54:05.987 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-25T22:54:05.987 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-25T22:54:06.006 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-25T22:54:06.006 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-25T22:54:06.009 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-25T22:54:06.009 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-25T22:54:06.039 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:54:06.039 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-04-25T22:54:06.039 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-04-25T22:54:06.039 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-04-25T22:54:06.040 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:54:06.048 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-25T22:54:06.059 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:54:06.059+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:54:06.160 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:54:06.160+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:54:06.168 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi052.front.sepia.ceph.com 2024-04-25T22:54:06.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:54:06.169 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T22:54:06.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:54:06.185 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2024-04-25T22:54:06.192 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-25T22:54:06.192 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-04-25T22:54:06.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-04-25T22:54:06.193 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-04-25T22:54:06.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.193 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4170.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-25T22:54:06.193 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:54:06.193 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 138.22547782300001, 2024-04-25T22:54:06.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010384338999999999, 2024-04-25T22:54:06.193 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:06.193 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:06.194 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:06.194 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:54:06.194 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4170", 2024-04-25T22:54:06.194 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.52:0/1775818619", 2024-04-25T22:54:06.194 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-04-25T22:54:06.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.194 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:06.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:06.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:54:06.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:06.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:06.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:54:06.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:06.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:06.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965179+0000", 2024-04-25T22:54:06.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3600000000000004e-07 2024-04-25T22:54:06.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:06.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965185+0000", 2024-04-25T22:54:06.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.117e-06 2024-04-25T22:54:06.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:06.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965192+0000", 2024-04-25T22:54:06.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3239999999999997e-06 2024-04-25T22:54:06.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.198 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:06.198 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.965198+0000", 2024-04-25T22:54:06.198 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6370000000000004e-06 2024-04-25T22:54:06.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.198 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:06.198 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.970973+0000", 2024-04-25T22:54:06.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057748239999999996 2024-04-25T22:54:06.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:06.199 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971049+0000", 2024-04-25T22:54:06.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6029e-05 2024-04-25T22:54:06.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:54:06.200 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971174+0000", 2024-04-25T22:54:06.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012462399999999999 2024-04-25T22:54:06.200 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.200 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.200 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:06.200 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.971553+0000", 2024-04-25T22:54:06.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037896499999999999 2024-04-25T22:54:06.200 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:06.201 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975482+0000", 2024-04-25T22:54:06.201 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039297459999999996 2024-04-25T22:54:06.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:06.201 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975529+0000", 2024-04-25T22:54:06.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6387000000000002e-05 2024-04-25T22:54:06.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.202 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.202 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:06.202 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:47.975563+0000", 2024-04-25T22:54:06.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4150000000000003e-05 2024-04-25T22:54:06.202 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:06.202 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:06.203 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:06.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.203 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:06.203 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:54:06.203 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 133.17843149999999, 2024-04-25T22:54:06.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012637705000000001, 2024-04-25T22:54:06.203 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:06.203 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:06.204 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:06.204 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:06.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:06.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:54:06.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:06.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:06.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012225+0000", 2024-04-25T22:54:06.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:06.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:06.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012227+0000", 2024-04-25T22:54:06.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.863e-06 2024-04-25T22:54:06.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:06.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012236+0000", 2024-04-25T22:54:06.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1109999999999997e-06 2024-04-25T22:54:06.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:06.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012309+0000", 2024-04-25T22:54:06.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3242000000000001e-05 2024-04-25T22:54:06.207 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.207 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:06.207 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012324+0000", 2024-04-25T22:54:06.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4837e-05 2024-04-25T22:54:06.207 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:06.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015060+0000", 2024-04-25T22:54:06.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027363349999999999 2024-04-25T22:54:06.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:06.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015169+0000", 2024-04-25T22:54:06.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108372 2024-04-25T22:54:06.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:54:06.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015498+0000", 2024-04-25T22:54:06.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032949999999999999 2024-04-25T22:54:06.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:06.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021282+0000", 2024-04-25T22:54:06.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057836429999999998 2024-04-25T22:54:06.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:06.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024709+0000", 2024-04-25T22:54:06.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034271979999999998 2024-04-25T22:54:06.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:06.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024802+0000", 2024-04-25T22:54:06.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2960000000000004e-05 2024-04-25T22:54:06.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:06.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024863+0000", 2024-04-25T22:54:06.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0643999999999997e-05 2024-04-25T22:54:06.211 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:06.212 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:06.212 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:06.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.212 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:06.212 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:54:06.212 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 133.17830772900001, 2024-04-25T22:54:06.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012979447999999999, 2024-04-25T22:54:06.213 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:06.213 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:06.213 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:06.213 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:06.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:06.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:54:06.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:06.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:06.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:54:06.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:06.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:06.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012349+0000", 2024-04-25T22:54:06.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-04-25T22:54:06.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:06.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012354+0000", 2024-04-25T22:54:06.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7740000000000004e-06 2024-04-25T22:54:06.216 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.216 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:06.216 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012365+0000", 2024-04-25T22:54:06.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.064e-05 2024-04-25T22:54:06.216 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.216 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:06.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012382+0000", 2024-04-25T22:54:06.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6999000000000001e-05 2024-04-25T22:54:06.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:06.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015958+0000", 2024-04-25T22:54:06.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035765699999999998 2024-04-25T22:54:06.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:06.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016037+0000", 2024-04-25T22:54:06.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8242000000000001e-05 2024-04-25T22:54:06.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:54:06.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016404+0000", 2024-04-25T22:54:06.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036784300000000002 2024-04-25T22:54:06.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:06.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021294+0000", 2024-04-25T22:54:06.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048890629999999999 2024-04-25T22:54:06.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:06.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024959+0000", 2024-04-25T22:54:06.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036651570000000001 2024-04-25T22:54:06.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:06.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025097+0000", 2024-04-25T22:54:06.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013788099999999999 2024-04-25T22:54:06.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:06.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025328+0000", 2024-04-25T22:54:06.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000231492 2024-04-25T22:54:06.221 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:06.221 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:06.221 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:06.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.222 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:06.222 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:54:06.222 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 133.17821996000001, 2024-04-25T22:54:06.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013049827, 2024-04-25T22:54:06.222 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:06.222 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:06.222 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:06.223 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:06.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:06.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:54:06.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:06.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:06.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012436+0000", 2024-04-25T22:54:06.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:06.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:06.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012437+0000", 2024-04-25T22:54:06.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000003e-07 2024-04-25T22:54:06.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:06.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012440+0000", 2024-04-25T22:54:06.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7609999999999999e-06 2024-04-25T22:54:06.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:06.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012449+0000", 2024-04-25T22:54:06.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.285e-06 2024-04-25T22:54:06.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:06.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012457+0000", 2024-04-25T22:54:06.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9510000000000006e-06 2024-04-25T22:54:06.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:06.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017106+0000", 2024-04-25T22:54:06.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046494220000000003 2024-04-25T22:54:06.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:06.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017223+0000", 2024-04-25T22:54:06.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116824 2024-04-25T22:54:06.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.228 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:54:06.228 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.017345+0000", 2024-04-25T22:54:06.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122175 2024-04-25T22:54:06.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.228 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:06.228 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021299+0000", 2024-04-25T22:54:06.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039534879999999998 2024-04-25T22:54:06.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:06.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025398+0000", 2024-04-25T22:54:06.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040988960000000003 2024-04-25T22:54:06.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:06.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025439+0000", 2024-04-25T22:54:06.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0915999999999999e-05 2024-04-25T22:54:06.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:06.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025486+0000", 2024-04-25T22:54:06.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7534999999999998e-05 2024-04-25T22:54:06.230 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:06.230 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:06.231 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:06.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.231 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:06.231 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:54:06.231 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 133.178189809, 2024-04-25T22:54:06.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020988041999999998, 2024-04-25T22:54:06.231 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:06.232 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:06.232 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:06.232 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:06.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:06.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:54:06.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:06.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:06.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:54:06.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:06.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:06.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012467+0000", 2024-04-25T22:54:06.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.99e-07 2024-04-25T22:54:06.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:06.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012470+0000", 2024-04-25T22:54:06.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2789999999999999e-06 2024-04-25T22:54:06.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:06.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012477+0000", 2024-04-25T22:54:06.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0770000000000002e-06 2024-04-25T22:54:06.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:06.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012500+0000", 2024-04-25T22:54:06.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2490999999999999e-05 2024-04-25T22:54:06.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:06.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021911+0000", 2024-04-25T22:54:06.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094114160000000006 2024-04-25T22:54:06.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:06.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022000+0000", 2024-04-25T22:54:06.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8601000000000001e-05 2024-04-25T22:54:06.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:54:06.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022359+0000", 2024-04-25T22:54:06.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035921999999999999 2024-04-25T22:54:06.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:06.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025541+0000", 2024-04-25T22:54:06.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031820619999999998 2024-04-25T22:54:06.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:06.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033375+0000", 2024-04-25T22:54:06.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078338379999999992 2024-04-25T22:54:06.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:06.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033415+0000", 2024-04-25T22:54:06.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9527000000000003e-05 2024-04-25T22:54:06.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:06.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033455+0000", 2024-04-25T22:54:06.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9932000000000003e-05 2024-04-25T22:54:06.240 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:06.240 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:06.240 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:06.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.240 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:06.240 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:54:06.241 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 133.17813461599999, 2024-04-25T22:54:06.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021043857999999999, 2024-04-25T22:54:06.241 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:06.241 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:06.241 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:06.241 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:06.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:06.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:54:06.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:06.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:06.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012522+0000", 2024-04-25T22:54:06.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:06.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:06.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012523+0000", 2024-04-25T22:54:06.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.361e-06 2024-04-25T22:54:06.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:06.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012530+0000", 2024-04-25T22:54:06.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5440000000000004e-06 2024-04-25T22:54:06.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:06.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012541+0000", 2024-04-25T22:54:06.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1745e-05 2024-04-25T22:54:06.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:06.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012551+0000", 2024-04-25T22:54:06.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5789999999999993e-06 2024-04-25T22:54:06.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:06.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022709+0000", 2024-04-25T22:54:06.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010157685 2024-04-25T22:54:06.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:06.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022957+0000", 2024-04-25T22:54:06.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024824599999999998 2024-04-25T22:54:06.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:54:06.247 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023443+0000", 2024-04-25T22:54:06.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048578599999999999 2024-04-25T22:54:06.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.247 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:06.247 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025547+0000", 2024-04-25T22:54:06.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021044789999999998 2024-04-25T22:54:06.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.248 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:06.248 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033509+0000", 2024-04-25T22:54:06.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0079622180000000001 2024-04-25T22:54:06.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:06.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033542+0000", 2024-04-25T22:54:06.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3018000000000001e-05 2024-04-25T22:54:06.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:06.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033566+0000", 2024-04-25T22:54:06.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3197000000000002e-05 2024-04-25T22:54:06.251 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:06.251 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:06.251 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:06.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.251 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:06.252 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:54:06.252 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 133.17809465100001, 2024-04-25T22:54:06.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021122696, 2024-04-25T22:54:06.252 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:06.252 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:06.252 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:06.252 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:06.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.252 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:06.253 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:54:06.253 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:06.253 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.253 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.253 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:06.253 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:54:06.253 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:06.253 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:06.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012562+0000", 2024-04-25T22:54:06.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6000000000000003e-07 2024-04-25T22:54:06.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:06.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012566+0000", 2024-04-25T22:54:06.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299999999999999e-06 2024-04-25T22:54:06.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:06.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012619+0000", 2024-04-25T22:54:06.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2607e-05 2024-04-25T22:54:06.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:06.256 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012628+0000", 2024-04-25T22:54:06.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6500000000000008e-06 2024-04-25T22:54:06.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.256 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:06.256 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024024+0000", 2024-04-25T22:54:06.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011396007999999999 2024-04-25T22:54:06.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.257 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:06.257 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024198+0000", 2024-04-25T22:54:06.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000173215 2024-04-25T22:54:06.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.257 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:54:06.257 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024447+0000", 2024-04-25T22:54:06.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024898500000000002 2024-04-25T22:54:06.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:06.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026431+0000", 2024-04-25T22:54:06.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001984923 2024-04-25T22:54:06.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:06.259 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033608+0000", 2024-04-25T22:54:06.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071768459999999997 2024-04-25T22:54:06.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.259 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:06.259 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033646+0000", 2024-04-25T22:54:06.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7299000000000003e-05 2024-04-25T22:54:06.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.260 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:06.260 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033684+0000", 2024-04-25T22:54:06.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8773000000000003e-05 2024-04-25T22:54:06.260 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:06.260 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:06.260 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:06.260 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.260 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.261 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:06.261 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:54:06.261 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 133.178006052, 2024-04-25T22:54:06.261 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021175381, 2024-04-25T22:54:06.261 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:06.261 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:06.261 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:06.261 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:06.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:06.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:54:06.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:06.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:06.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012650+0000", 2024-04-25T22:54:06.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:06.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:06.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012651+0000", 2024-04-25T22:54:06.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7700000000000003e-07 2024-04-25T22:54:06.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:06.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012656+0000", 2024-04-25T22:54:06.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8899999999999998e-06 2024-04-25T22:54:06.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:06.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012666+0000", 2024-04-25T22:54:06.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0346999999999999e-05 2024-04-25T22:54:06.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.265 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.265 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:06.265 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012675+0000", 2024-04-25T22:54:06.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9930000000000001e-06 2024-04-25T22:54:06.265 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.265 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.265 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:06.265 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025661+0000", 2024-04-25T22:54:06.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01298531 2024-04-25T22:54:06.266 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.266 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.266 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:06.266 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025757+0000", 2024-04-25T22:54:06.266 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5822000000000005e-05 2024-04-25T22:54:06.266 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.266 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.266 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:54:06.267 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025907+0000", 2024-04-25T22:54:06.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015051499999999999 2024-04-25T22:54:06.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.267 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:06.267 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026435+0000", 2024-04-25T22:54:06.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052762200000000005 2024-04-25T22:54:06.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.268 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:06.268 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033732+0000", 2024-04-25T22:54:06.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072978419999999997 2024-04-25T22:54:06.268 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.268 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.268 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:06.268 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033787+0000", 2024-04-25T22:54:06.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4703999999999997e-05 2024-04-25T22:54:06.269 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.269 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.269 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:06.269 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033826+0000", 2024-04-25T22:54:06.269 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8458999999999999e-05 2024-04-25T22:54:06.269 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:06.269 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:06.269 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:06.270 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.270 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.270 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:06.270 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:54:06.270 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 133.177950638, 2024-04-25T22:54:06.270 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021244174000000001, 2024-04-25T22:54:06.270 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:06.270 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:06.271 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:06.271 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:06.271 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.271 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:06.271 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:54:06.271 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:06.271 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.271 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.271 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:06.272 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:54:06.272 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:06.272 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.272 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.272 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:06.272 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012706+0000", 2024-04-25T22:54:06.272 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:54:06.272 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.272 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.273 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:06.273 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012712+0000", 2024-04-25T22:54:06.273 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.913e-06 2024-04-25T22:54:06.273 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.273 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.273 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:06.273 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012722+0000", 2024-04-25T22:54:06.273 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2879999999999998e-06 2024-04-25T22:54:06.274 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.274 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.274 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:06.274 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012727+0000", 2024-04-25T22:54:06.274 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8429999999999998e-06 2024-04-25T22:54:06.274 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.274 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.274 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:06.275 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026099+0000", 2024-04-25T22:54:06.275 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013371450999999999 2024-04-25T22:54:06.275 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.275 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.275 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:06.275 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026147+0000", 2024-04-25T22:54:06.275 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7837999999999998e-05 2024-04-25T22:54:06.275 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.275 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.276 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:54:06.276 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026254+0000", 2024-04-25T22:54:06.276 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107314 2024-04-25T22:54:06.276 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.276 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.276 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:06.276 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.026686+0000", 2024-04-25T22:54:06.276 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000432428 2024-04-25T22:54:06.276 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.276 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.277 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:06.277 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033873+0000", 2024-04-25T22:54:06.277 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071864399999999997 2024-04-25T22:54:06.277 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.277 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.277 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:06.277 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033904+0000", 2024-04-25T22:54:06.277 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1321e-05 2024-04-25T22:54:06.277 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.278 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.278 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:06.278 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033950+0000", 2024-04-25T22:54:06.278 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5707999999999997e-05 2024-04-25T22:54:06.278 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:06.278 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:06.278 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:06.279 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.279 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.279 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:06.279 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:54:06.279 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 133.177920253, 2024-04-25T22:54:06.279 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01096505, 2024-04-25T22:54:06.279 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:06.279 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:06.279 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:06.280 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:06.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:06.280 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:54:06.280 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:06.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:06.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012736+0000", 2024-04-25T22:54:06.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:06.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.281 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:06.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012737+0000", 2024-04-25T22:54:06.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:54:06.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:06.282 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012739+0000", 2024-04-25T22:54:06.282 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.385e-06 2024-04-25T22:54:06.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:06.282 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012743+0000", 2024-04-25T22:54:06.282 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3239999999999996e-06 2024-04-25T22:54:06.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.283 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:06.283 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012746+0000", 2024-04-25T22:54:06.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.129e-06 2024-04-25T22:54:06.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.283 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:06.284 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012796+0000", 2024-04-25T22:54:06.284 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9231999999999999e-05 2024-04-25T22:54:06.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.284 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.284 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:06.284 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012915+0000", 2024-04-25T22:54:06.284 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119021 2024-04-25T22:54:06.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.285 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.285 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:54:06.285 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013069+0000", 2024-04-25T22:54:06.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015463900000000001 2024-04-25T22:54:06.285 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.285 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.285 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:06.285 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019237+0000", 2024-04-25T22:54:06.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061680329999999998 2024-04-25T22:54:06.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.286 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:06.286 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023603+0000", 2024-04-25T22:54:06.286 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043655860000000003 2024-04-25T22:54:06.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.286 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:06.287 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023659+0000", 2024-04-25T22:54:06.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6484000000000003e-05 2024-04-25T22:54:06.287 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.287 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.287 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:06.287 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023701+0000", 2024-04-25T22:54:06.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1761999999999998e-05 2024-04-25T22:54:06.287 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:06.288 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:06.288 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:06.288 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.288 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.288 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:06.288 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:54:06.288 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 133.17789530499999, 2024-04-25T22:54:06.288 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011234429000000001, 2024-04-25T22:54:06.289 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:06.289 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:06.289 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:06.289 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:06.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.289 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:06.289 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:54:06.289 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:06.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:06.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012761+0000", 2024-04-25T22:54:06.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:06.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:06.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012762+0000", 2024-04-25T22:54:06.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9900000000000001e-07 2024-04-25T22:54:06.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.291 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.291 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:06.291 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012765+0000", 2024-04-25T22:54:06.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2569999999999999e-06 2024-04-25T22:54:06.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.291 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.292 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:06.292 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012783+0000", 2024-04-25T22:54:06.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8431999999999999e-05 2024-04-25T22:54:06.292 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.292 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.292 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:06.292 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012799+0000", 2024-04-25T22:54:06.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5438999999999999e-05 2024-04-25T22:54:06.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:06.293 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013826+0000", 2024-04-25T22:54:06.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010275060000000001 2024-04-25T22:54:06.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:06.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013913+0000", 2024-04-25T22:54:06.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.708e-05 2024-04-25T22:54:06.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:54:06.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014098+0000", 2024-04-25T22:54:06.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018519399999999999 2024-04-25T22:54:06.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:06.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.019684+0000", 2024-04-25T22:54:06.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055860079999999999 2024-04-25T22:54:06.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:06.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023876+0000", 2024-04-25T22:54:06.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041918800000000003 2024-04-25T22:54:06.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.296 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:06.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023957+0000", 2024-04-25T22:54:06.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1165e-05 2024-04-25T22:54:06.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.296 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:06.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023995+0000", 2024-04-25T22:54:06.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7969000000000002e-05 2024-04-25T22:54:06.297 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:06.297 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:06.297 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:06.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.297 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:06.297 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:54:06.297 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 133.17779752600001, 2024-04-25T22:54:06.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011131200000000001, 2024-04-25T22:54:06.298 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:06.298 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:06.298 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:06.298 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:06.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:06.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:54:06.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:06.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:06.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012859+0000", 2024-04-25T22:54:06.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:06.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:06.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012860+0000", 2024-04-25T22:54:06.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3900000000000004e-07 2024-04-25T22:54:06.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:06.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012865+0000", 2024-04-25T22:54:06.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5609999999999998e-06 2024-04-25T22:54:06.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:06.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012895+0000", 2024-04-25T22:54:06.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9847000000000001e-05 2024-04-25T22:54:06.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:06.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012905+0000", 2024-04-25T22:54:06.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.03e-05 2024-04-25T22:54:06.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:06.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015020+0000", 2024-04-25T22:54:06.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021142940000000001 2024-04-25T22:54:06.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.303 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:06.303 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015182+0000", 2024-04-25T22:54:06.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016248099999999999 2024-04-25T22:54:06.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.303 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:54:06.303 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015357+0000", 2024-04-25T22:54:06.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017471000000000001 2024-04-25T22:54:06.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:06.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021021+0000", 2024-04-25T22:54:06.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056638340000000004 2024-04-25T22:54:06.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:06.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023712+0000", 2024-04-25T22:54:06.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026910380000000002 2024-04-25T22:54:06.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:06.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023763+0000", 2024-04-25T22:54:06.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1477999999999997e-05 2024-04-25T22:54:06.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:06.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023990+0000", 2024-04-25T22:54:06.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000226818 2024-04-25T22:54:06.306 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:06.306 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:06.306 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:06.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.307 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:06.307 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:54:06.307 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 133.17767443, 2024-04-25T22:54:06.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011705299000000001, 2024-04-25T22:54:06.307 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:06.307 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:06.308 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:06.308 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:06.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:06.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:54:06.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:06.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:06.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012982+0000", 2024-04-25T22:54:06.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:06.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:06.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012983+0000", 2024-04-25T22:54:06.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3600000000000003e-07 2024-04-25T22:54:06.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:06.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012986+0000", 2024-04-25T22:54:06.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5700000000000001e-06 2024-04-25T22:54:06.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:06.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.012993+0000", 2024-04-25T22:54:06.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8730000000000001e-06 2024-04-25T22:54:06.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:06.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013000+0000", 2024-04-25T22:54:06.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1890000000000001e-06 2024-04-25T22:54:06.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:06.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015148+0000", 2024-04-25T22:54:06.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002147866 2024-04-25T22:54:06.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:06.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015351+0000", 2024-04-25T22:54:06.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020300799999999999 2024-04-25T22:54:06.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:54:06.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.016260+0000", 2024-04-25T22:54:06.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00090926799999999997 2024-04-25T22:54:06.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:06.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022669+0000", 2024-04-25T22:54:06.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064082849999999997 2024-04-25T22:54:06.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:06.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024584+0000", 2024-04-25T22:54:06.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019151699999999999 2024-04-25T22:54:06.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:06.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024643+0000", 2024-04-25T22:54:06.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8888999999999998e-05 2024-04-25T22:54:06.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:06.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024687+0000", 2024-04-25T22:54:06.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4444999999999999e-05 2024-04-25T22:54:06.316 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:06.316 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:06.316 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:06.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.317 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:06.317 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:54:06.317 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 133.177646839, 2024-04-25T22:54:06.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011249699, 2024-04-25T22:54:06.317 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:06.317 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:06.317 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:06.318 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:06.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:06.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:54:06.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:06.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:06.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013009+0000", 2024-04-25T22:54:06.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:06.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:06.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013010+0000", 2024-04-25T22:54:06.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2099999999999996e-07 2024-04-25T22:54:06.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:06.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013013+0000", 2024-04-25T22:54:06.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1310000000000002e-06 2024-04-25T22:54:06.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:06.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013020+0000", 2024-04-25T22:54:06.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3330000000000002e-06 2024-04-25T22:54:06.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:06.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013025+0000", 2024-04-25T22:54:06.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6760000000000004e-06 2024-04-25T22:54:06.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:06.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013163+0000", 2024-04-25T22:54:06.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013824599999999999 2024-04-25T22:54:06.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:06.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013504+0000", 2024-04-25T22:54:06.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034080299999999998 2024-04-25T22:54:06.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:54:06.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013613+0000", 2024-04-25T22:54:06.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108705 2024-04-25T22:54:06.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:06.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015831+0000", 2024-04-25T22:54:06.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002217672 2024-04-25T22:54:06.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:06.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024137+0000", 2024-04-25T22:54:06.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0083060489999999994 2024-04-25T22:54:06.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:06.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024218+0000", 2024-04-25T22:54:06.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1351000000000001e-05 2024-04-25T22:54:06.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:06.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024259+0000", 2024-04-25T22:54:06.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1112000000000002e-05 2024-04-25T22:54:06.326 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:06.326 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:06.326 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:06.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.326 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:06.327 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:54:06.327 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 133.177559113, 2024-04-25T22:54:06.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020379749999999999, 2024-04-25T22:54:06.327 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:06.327 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:06.327 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:06.327 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:06.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:06.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:54:06.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:06.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:06.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013097+0000", 2024-04-25T22:54:06.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:06.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:06.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013098+0000", 2024-04-25T22:54:06.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:54:06.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:06.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013105+0000", 2024-04-25T22:54:06.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5969999999999997e-06 2024-04-25T22:54:06.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:06.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013190+0000", 2024-04-25T22:54:06.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5618999999999995e-05 2024-04-25T22:54:06.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:06.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013200+0000", 2024-04-25T22:54:06.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5859999999999994e-06 2024-04-25T22:54:06.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:06.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020265+0000", 2024-04-25T22:54:06.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070653349999999998 2024-04-25T22:54:06.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:06.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020454+0000", 2024-04-25T22:54:06.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189316 2024-04-25T22:54:06.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:54:06.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020586+0000", 2024-04-25T22:54:06.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013195700000000001 2024-04-25T22:54:06.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:06.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023822+0000", 2024-04-25T22:54:06.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0032358529999999999 2024-04-25T22:54:06.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:06.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033409+0000", 2024-04-25T22:54:06.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0095870520000000004 2024-04-25T22:54:06.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:06.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033447+0000", 2024-04-25T22:54:06.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7261999999999997e-05 2024-04-25T22:54:06.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:06.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033477+0000", 2024-04-25T22:54:06.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0389e-05 2024-04-25T22:54:06.335 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:06.335 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:06.335 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:06.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.336 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:06.336 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:54:06.336 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 133.17744260699999, 2024-04-25T22:54:06.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010857383999999999, 2024-04-25T22:54:06.336 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:06.336 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:06.336 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:06.337 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:06.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:06.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:54:06.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:06.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:06.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:54:06.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:06.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:06.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013214+0000", 2024-04-25T22:54:06.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3e-07 2024-04-25T22:54:06.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:06.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013218+0000", 2024-04-25T22:54:06.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8199999999999998e-06 2024-04-25T22:54:06.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:06.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013226+0000", 2024-04-25T22:54:06.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7649999999999993e-06 2024-04-25T22:54:06.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:06.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013259+0000", 2024-04-25T22:54:06.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2727e-05 2024-04-25T22:54:06.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:06.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014809+0000", 2024-04-25T22:54:06.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001550144 2024-04-25T22:54:06.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:06.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.014958+0000", 2024-04-25T22:54:06.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014890300000000001 2024-04-25T22:54:06.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-04-25T22:54:06.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.015087+0000", 2024-04-25T22:54:06.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012939200000000001 2024-04-25T22:54:06.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:06.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.020212+0000", 2024-04-25T22:54:06.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051248939999999996 2024-04-25T22:54:06.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:06.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.023699+0000", 2024-04-25T22:54:06.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034873289999999999 2024-04-25T22:54:06.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:06.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024014+0000", 2024-04-25T22:54:06.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031473999999999999 2024-04-25T22:54:06.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:06.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.024071+0000", 2024-04-25T22:54:06.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7040000000000003e-05 2024-04-25T22:54:06.344 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:06.344 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:06.344 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:06.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.345 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:06.345 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:54:06.345 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 133.17738790199999, 2024-04-25T22:54:06.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012329677000000001, 2024-04-25T22:54:06.345 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:06.345 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:06.345 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:06.346 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:06.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:06.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:54:06.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:06.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:06.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013268+0000", 2024-04-25T22:54:06.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:06.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:06.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013269+0000", 2024-04-25T22:54:06.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5000000000000002e-07 2024-04-25T22:54:06.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:06.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:54:06.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6909999999999999e-06 2024-04-25T22:54:06.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:06.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013284+0000", 2024-04-25T22:54:06.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0963e-05 2024-04-25T22:54:06.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:06.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013361+0000", 2024-04-25T22:54:06.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7379999999999994e-05 2024-04-25T22:54:06.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:06.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013448+0000", 2024-04-25T22:54:06.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6990000000000006e-05 2024-04-25T22:54:06.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:06.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013632+0000", 2024-04-25T22:54:06.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018396800000000001 2024-04-25T22:54:06.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-04-25T22:54:06.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013800+0000", 2024-04-25T22:54:06.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000167467 2024-04-25T22:54:06.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:06.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.018570+0000", 2024-04-25T22:54:06.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047701460000000003 2024-04-25T22:54:06.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:06.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025507+0000", 2024-04-25T22:54:06.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069372039999999998 2024-04-25T22:54:06.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:06.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025562+0000", 2024-04-25T22:54:06.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4858999999999998e-05 2024-04-25T22:54:06.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:06.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.025598+0000", 2024-04-25T22:54:06.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6259e-05 2024-04-25T22:54:06.354 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:06.354 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:06.354 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:06.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.354 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:06.354 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:54:06.354 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 133.17725602900001, 2024-04-25T22:54:06.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020176666999999999, 2024-04-25T22:54:06.355 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:06.355 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:06.355 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-04-25T22:54:06.355 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:06.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:06.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:54:06.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:06.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:06.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013400+0000", 2024-04-25T22:54:06.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:06.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:06.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:54:06.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3399999999999998e-07 2024-04-25T22:54:06.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:06.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013405+0000", 2024-04-25T22:54:06.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0559999999999998e-06 2024-04-25T22:54:06.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:06.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013422+0000", 2024-04-25T22:54:06.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6770999999999999e-05 2024-04-25T22:54:06.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:06.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.013431+0000", 2024-04-25T22:54:06.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5019999999999998e-06 2024-04-25T22:54:06.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:06.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.021720+0000", 2024-04-25T22:54:06.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082884340000000008 2024-04-25T22:54:06.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.360 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:06.360 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.022122+0000", 2024-04-25T22:54:06.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000401634 2024-04-25T22:54:06.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.360 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:06.360 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:51:53.033577+0000", 2024-04-25T22:54:06.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011455435999999999 2024-04-25T22:54:06.361 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:06.361 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:06.361 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:06.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.361 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4734.0:31 4.1b 4:d9872866:::1000000021d.00000002:head [write 0~3618035] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-25T22:54:06.361 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:54:06.361 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 35.137681766999997, 2024-04-25T22:54:06.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011647062, 2024-04-25T22:54:06.362 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:06.362 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:06.362 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:06.362 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-04-25T22:54:06.362 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4734", 2024-04-25T22:54:06.362 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:54:06.362 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 31 2024-04-25T22:54:06.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.363 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:06.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:06.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:54:06.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:06.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:06.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:54:06.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:06.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:06.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.052975+0000", 2024-04-25T22:54:06.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5700000000000001e-07 2024-04-25T22:54:06.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:06.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059575+0000", 2024-04-25T22:54:06.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0065991380000000001 2024-04-25T22:54:06.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:06.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059586+0000", 2024-04-25T22:54:06.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1438e-05 2024-04-25T22:54:06.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:06.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059592+0000", 2024-04-25T22:54:06.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2899999999999999e-06 2024-04-25T22:54:06.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:06.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059660+0000", 2024-04-25T22:54:06.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7980999999999998e-05 2024-04-25T22:54:06.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:06.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.059757+0000", 2024-04-25T22:54:06.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6340000000000003e-05 2024-04-25T22:54:06.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:06.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.064487+0000", 2024-04-25T22:54:06.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004730621 2024-04-25T22:54:06.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:06.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.064538+0000", 2024-04-25T22:54:06.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0801999999999999e-05 2024-04-25T22:54:06.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:06.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:31.064622+0000", 2024-04-25T22:54:06.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3595000000000002e-05 2024-04-25T22:54:06.369 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:06.369 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:06.370 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:06.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.370 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(mds.0.3:97 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-25T22:54:06.370 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-04-25T22:53:33.026298+0000", 2024-04-25T22:54:06.370 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 33.164357953, 2024-04-25T22:54:06.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015641848999999999, 2024-04-25T22:54:06.370 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-04-25T22:54:06.370 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-04-25T22:54:06.371 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:06.371 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-04-25T22:54:06.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-04-25T22:54:06.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026298+0000", 2024-04-25T22:54:06.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:06.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-04-25T22:54:06.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026298+0000", 2024-04-25T22:54:06.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-04-25T22:54:06.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-04-25T22:54:06.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026299+0000", 2024-04-25T22:54:06.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7299999999999996e-07 2024-04-25T22:54:06.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-04-25T22:54:06.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026464+0000", 2024-04-25T22:54:06.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016477700000000001 2024-04-25T22:54:06.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-04-25T22:54:06.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026472+0000", 2024-04-25T22:54:06.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1589999999999993e-06 2024-04-25T22:54:06.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-04-25T22:54:06.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026476+0000", 2024-04-25T22:54:06.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4580000000000003e-06 2024-04-25T22:54:06.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-04-25T22:54:06.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026550+0000", 2024-04-25T22:54:06.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3836000000000003e-05 2024-04-25T22:54:06.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-04-25T22:54:06.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.026644+0000", 2024-04-25T22:54:06.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4022000000000002e-05 2024-04-25T22:54:06.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-04-25T22:54:06.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.041838+0000", 2024-04-25T22:54:06.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015193814999999999 2024-04-25T22:54:06.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-04-25T22:54:06.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.041874+0000", 2024-04-25T22:54:06.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5856999999999999e-05 2024-04-25T22:54:06.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-25T22:54:06.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-25T22:54:06.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-04-25T22:54:06.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-04-25T22:53:33.041940+0000", 2024-04-25T22:54:06.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6352000000000004e-05 2024-04-25T22:54:06.377 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:06.377 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:06.377 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:06.378 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-25T22:54:06.378 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-25T22:54:06.378 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-25T22:54:06.380 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-25T22:54:06.380 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-04-25T22:54:06.378+0000 7fabe92e3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28660) UID: 0 2024-04-25T22:54:06.393 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T22:54:06.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:54:06.394 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T22:54:06.403 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is set 2024-04-25T22:54:06.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T22:54:06.428 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link delete ceph-brx 2024-04-25T22:54:06.480 INFO:tasks.ceph.osd.2.smithi191.stderr:2024-04-25T22:54:06.479+0000 7f553d320640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28736) UID: 0 2024-04-25T22:54:06.488 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:54:06.488 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:54:06.488 INFO:teuthology.orchestra.run.smithi191.stdout: "num_ops": 0 2024-04-25T22:54:06.488 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:54:06.497 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-25T22:54:06.519 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-04-25T22:54:06.530 INFO:tasks.thrashosds:joining thrashosds 2024-04-25T22:54:06.638 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:54:06.638 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [], 2024-04-25T22:54:06.639 INFO:teuthology.orchestra.run.smithi191.stdout: "complaint_time": 30, 2024-04-25T22:54:06.639 INFO:teuthology.orchestra.run.smithi191.stdout: "num_blocked_ops": 0 2024-04-25T22:54:06.639 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:54:06.646 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-25T22:54:06.750 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-04-25T22:54:06.750 INFO:teuthology.orchestra.run.smithi191.stdout: "size": 20, 2024-04-25T22:54:06.750 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 600, 2024-04-25T22:54:06.750 INFO:teuthology.orchestra.run.smithi191.stdout: "ops": [ 2024-04-25T22:54:06.750 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.751 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4170.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'67)", 2024-04-25T22:54:06.751 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:54:06.751 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 138.78085919599999, 2024-04-25T22:54:06.751 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007142603, 2024-04-25T22:54:06.751 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:06.751 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:06.751 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:06.751 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:06.752 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.752 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:06.752 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:54:06.752 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:06.752 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.752 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.752 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:06.752 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967173+0000", 2024-04-25T22:54:06.753 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:06.753 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.753 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.753 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:06.753 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967174+0000", 2024-04-25T22:54:06.753 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.51e-07 2024-04-25T22:54:06.753 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.753 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.754 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:06.754 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967245+0000", 2024-04-25T22:54:06.754 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1594000000000006e-05 2024-04-25T22:54:06.754 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.754 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.754 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:06.754 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967252+0000", 2024-04-25T22:54:06.754 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9249999999999998e-06 2024-04-25T22:54:06.755 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.755 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.755 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:06.755 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967256+0000", 2024-04-25T22:54:06.755 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0729999999999998e-06 2024-04-25T22:54:06.755 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.755 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.756 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:06.756 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967320+0000", 2024-04-25T22:54:06.756 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3774000000000003e-05 2024-04-25T22:54:06.756 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.756 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.756 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:06.756 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.967337+0000", 2024-04-25T22:54:06.756 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7322000000000001e-05 2024-04-25T22:54:06.757 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.757 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.757 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:54:06.757 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974260+0000", 2024-04-25T22:54:06.757 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069228290000000001 2024-04-25T22:54:06.757 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.758 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.758 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:06.758 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:47.974316+0000", 2024-04-25T22:54:06.758 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.5535000000000003e-05 2024-04-25T22:54:06.758 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:06.758 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:06.758 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:06.758 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.759 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.759 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:06.759 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:54:06.759 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 133.73636349700001, 2024-04-25T22:54:06.759 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.017070647000000001, 2024-04-25T22:54:06.759 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:06.759 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:06.760 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:06.760 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:06.760 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.760 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:06.760 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:54:06.760 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:06.760 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.760 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.761 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:06.761 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011669+0000", 2024-04-25T22:54:06.761 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:06.761 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.761 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.761 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:06.761 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011672+0000", 2024-04-25T22:54:06.761 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3689999999999998e-06 2024-04-25T22:54:06.761 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.762 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.762 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:06.762 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011681+0000", 2024-04-25T22:54:06.762 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4200000000000007e-06 2024-04-25T22:54:06.762 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.762 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.762 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:06.763 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011694+0000", 2024-04-25T22:54:06.763 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.3162e-05 2024-04-25T22:54:06.763 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.763 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.764 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:06.764 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.011706+0000", 2024-04-25T22:54:06.764 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.2111e-05 2024-04-25T22:54:06.764 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.764 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.764 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:06.764 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019128+0000", 2024-04-25T22:54:06.765 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074220370000000003 2024-04-25T22:54:06.765 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.765 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.765 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:06.765 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019459+0000", 2024-04-25T22:54:06.765 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000331377 2024-04-25T22:54:06.765 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.765 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.766 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:54:06.766 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019561+0000", 2024-04-25T22:54:06.766 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101229 2024-04-25T22:54:06.766 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.766 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.766 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:54:06.766 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021341+0000", 2024-04-25T22:54:06.766 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0017800050000000001 2024-04-25T22:54:06.767 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.767 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.767 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:06.767 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028666+0000", 2024-04-25T22:54:06.767 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073257399999999999 2024-04-25T22:54:06.767 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.767 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.767 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:54:06.767 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028699+0000", 2024-04-25T22:54:06.768 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3111999999999997e-05 2024-04-25T22:54:06.768 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.768 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.768 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:06.768 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028739+0000", 2024-04-25T22:54:06.768 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.0085e-05 2024-04-25T22:54:06.768 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:06.768 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:06.769 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:06.769 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.769 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.769 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:06.769 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:54:06.769 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 133.73568912100001, 2024-04-25T22:54:06.769 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016816666000000001, 2024-04-25T22:54:06.770 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:06.770 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:06.770 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:06.770 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:06.770 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.770 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:06.770 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:54:06.770 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:06.771 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.771 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.771 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:06.771 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012343+0000", 2024-04-25T22:54:06.771 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:06.771 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.771 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.772 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:06.772 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012344+0000", 2024-04-25T22:54:06.772 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8100000000000001e-07 2024-04-25T22:54:06.772 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.772 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.772 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:06.772 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012358+0000", 2024-04-25T22:54:06.773 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.4304999999999999e-05 2024-04-25T22:54:06.773 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.773 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.773 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:06.773 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012369+0000", 2024-04-25T22:54:06.773 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.0281e-05 2024-04-25T22:54:06.773 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.773 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.774 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:06.774 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012390+0000", 2024-04-25T22:54:06.774 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.1149e-05 2024-04-25T22:54:06.774 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.774 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.774 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:06.774 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020025+0000", 2024-04-25T22:54:06.774 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076351730000000003 2024-04-25T22:54:06.775 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.775 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.775 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:06.775 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020123+0000", 2024-04-25T22:54:06.775 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7979000000000005e-05 2024-04-25T22:54:06.775 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.775 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.775 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:54:06.776 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020325+0000", 2024-04-25T22:54:06.776 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00020251899999999999 2024-04-25T22:54:06.776 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.776 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.776 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:54:06.776 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021361+0000", 2024-04-25T22:54:06.776 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0010357509999999999 2024-04-25T22:54:06.776 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.776 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.777 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:06.777 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028945+0000", 2024-04-25T22:54:06.777 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075834609999999997 2024-04-25T22:54:06.777 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.777 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.777 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:54:06.777 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029058+0000", 2024-04-25T22:54:06.777 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113482 2024-04-25T22:54:06.778 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.778 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.778 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:06.778 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029160+0000", 2024-04-25T22:54:06.778 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000101685 2024-04-25T22:54:06.778 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:06.778 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:06.778 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:06.779 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.779 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.779 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:06.779 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:54:06.779 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 133.73517990900001, 2024-04-25T22:54:06.779 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.016078867, 2024-04-25T22:54:06.779 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:06.779 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:06.780 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:06.780 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:06.780 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.780 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:06.780 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:54:06.780 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:06.780 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.781 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.781 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:06.781 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012852+0000", 2024-04-25T22:54:06.781 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:06.781 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.781 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.781 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:06.781 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012853+0000", 2024-04-25T22:54:06.782 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2699999999999998e-07 2024-04-25T22:54:06.782 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.782 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.782 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:06.782 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012869+0000", 2024-04-25T22:54:06.782 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.5576000000000001e-05 2024-04-25T22:54:06.782 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.783 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.783 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:06.783 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012887+0000", 2024-04-25T22:54:06.783 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.7708000000000001e-05 2024-04-25T22:54:06.783 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.784 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.784 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:06.784 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.012898+0000", 2024-04-25T22:54:06.784 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1748e-05 2024-04-25T22:54:06.784 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.784 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.784 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:06.784 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020005+0000", 2024-04-25T22:54:06.785 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071065240000000003 2024-04-25T22:54:06.785 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.785 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.785 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:06.785 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020110+0000", 2024-04-25T22:54:06.785 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00010483499999999999 2024-04-25T22:54:06.785 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.785 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.785 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:54:06.786 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020181+0000", 2024-04-25T22:54:06.786 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1679000000000003e-05 2024-04-25T22:54:06.786 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.786 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.786 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:54:06.786 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021348+0000", 2024-04-25T22:54:06.786 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001166109 2024-04-25T22:54:06.787 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.787 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.787 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:06.787 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028785+0000", 2024-04-25T22:54:06.787 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.007437964 2024-04-25T22:54:06.787 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.787 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.787 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:54:06.787 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028870+0000", 2024-04-25T22:54:06.788 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4438999999999996e-05 2024-04-25T22:54:06.788 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.788 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.788 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:06.788 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028931+0000", 2024-04-25T22:54:06.788 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1358000000000004e-05 2024-04-25T22:54:06.788 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:06.788 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:06.789 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:06.789 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.789 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.789 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:06.789 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:54:06.789 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 133.73476671099999, 2024-04-25T22:54:06.789 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015923036000000002, 2024-04-25T22:54:06.790 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:06.790 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:06.790 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:06.790 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:06.790 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.790 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:06.790 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:54:06.790 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:06.791 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.791 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.791 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:06.791 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:54:06.791 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:06.791 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.791 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.791 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:06.791 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013266+0000", 2024-04-25T22:54:06.792 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.0699999999999996e-07 2024-04-25T22:54:06.792 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.792 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.792 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:06.792 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013273+0000", 2024-04-25T22:54:06.792 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3350000000000003e-06 2024-04-25T22:54:06.792 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.792 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.793 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:06.793 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013292+0000", 2024-04-25T22:54:06.793 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.9675000000000001e-05 2024-04-25T22:54:06.793 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.793 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.793 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:06.793 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013301+0000", 2024-04-25T22:54:06.793 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0049999999999993e-06 2024-04-25T22:54:06.793 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.794 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.794 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:06.794 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020425+0000", 2024-04-25T22:54:06.794 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0071234849999999997 2024-04-25T22:54:06.794 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.794 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.794 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:06.795 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020470+0000", 2024-04-25T22:54:06.795 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5395000000000002e-05 2024-04-25T22:54:06.795 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.795 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.795 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:54:06.795 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020556+0000", 2024-04-25T22:54:06.795 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6132999999999997e-05 2024-04-25T22:54:06.795 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.796 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.796 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:54:06.796 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022199+0000", 2024-04-25T22:54:06.796 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001642613 2024-04-25T22:54:06.796 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.796 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.796 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:06.797 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028994+0000", 2024-04-25T22:54:06.797 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067950149999999997 2024-04-25T22:54:06.797 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.797 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.797 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:54:06.797 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029150+0000", 2024-04-25T22:54:06.797 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00015621100000000001 2024-04-25T22:54:06.797 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.798 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.798 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:06.798 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029189+0000", 2024-04-25T22:54:06.798 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.8362000000000003e-05 2024-04-25T22:54:06.798 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:06.798 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:06.798 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:06.798 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.799 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.799 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:06.799 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:54:06.799 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 133.73471604100001, 2024-04-25T22:54:06.799 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015324397, 2024-04-25T22:54:06.799 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:06.799 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:06.799 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:06.800 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:06.800 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.800 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:06.800 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:54:06.800 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:06.800 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.801 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.801 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:06.801 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013316+0000", 2024-04-25T22:54:06.801 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:06.801 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.801 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.801 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:06.801 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013317+0000", 2024-04-25T22:54:06.802 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.7199999999999999e-07 2024-04-25T22:54:06.802 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.802 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.802 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:06.802 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013321+0000", 2024-04-25T22:54:06.802 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.839e-06 2024-04-25T22:54:06.802 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.802 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.803 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:06.803 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013327+0000", 2024-04-25T22:54:06.803 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.686e-06 2024-04-25T22:54:06.803 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.803 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.803 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:06.803 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013336+0000", 2024-04-25T22:54:06.803 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.6179999999999995e-06 2024-04-25T22:54:06.804 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.804 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.804 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:06.804 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013418+0000", 2024-04-25T22:54:06.804 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2143000000000003e-05 2024-04-25T22:54:06.804 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.804 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.805 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:54:06.805 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013425+0000", 2024-04-25T22:54:06.805 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6089999999999997e-06 2024-04-25T22:54:06.805 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.805 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.805 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:06.805 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.018737+0000", 2024-04-25T22:54:06.805 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0053124829999999998 2024-04-25T22:54:06.806 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.806 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.806 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:06.806 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019088+0000", 2024-04-25T22:54:06.806 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00035084299999999999 2024-04-25T22:54:06.806 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.806 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.807 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:54:06.807 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019257+0000", 2024-04-25T22:54:06.807 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00016861099999999999 2024-04-25T22:54:06.807 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.807 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.807 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:54:06.807 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020619+0000", 2024-04-25T22:54:06.807 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001361985 2024-04-25T22:54:06.808 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.808 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.808 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:06.808 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028531+0000", 2024-04-25T22:54:06.808 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0079123460000000007 2024-04-25T22:54:06.808 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.808 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.808 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:54:06.809 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028591+0000", 2024-04-25T22:54:06.809 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.9759000000000002e-05 2024-04-25T22:54:06.809 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.809 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.809 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:06.809 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028641+0000", 2024-04-25T22:54:06.809 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9903e-05 2024-04-25T22:54:06.809 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:06.810 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:06.810 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:06.810 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.810 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.810 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:06.810 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:54:06.810 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 133.734679172, 2024-04-25T22:54:06.811 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015437763, 2024-04-25T22:54:06.811 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:06.811 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:06.811 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:06.811 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:06.811 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.811 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:06.812 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:54:06.812 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:06.812 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.812 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.812 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:06.812 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013353+0000", 2024-04-25T22:54:06.812 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:06.813 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.813 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.813 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:06.813 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013354+0000", 2024-04-25T22:54:06.813 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7899999999999999e-07 2024-04-25T22:54:06.813 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.813 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.814 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:06.814 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013357+0000", 2024-04-25T22:54:06.814 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.2100000000000002e-06 2024-04-25T22:54:06.814 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.814 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.814 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:06.815 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013364+0000", 2024-04-25T22:54:06.815 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8970000000000002e-06 2024-04-25T22:54:06.815 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.815 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.815 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:06.815 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013370+0000", 2024-04-25T22:54:06.815 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.6619999999999999e-06 2024-04-25T22:54:06.816 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.816 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.816 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:06.816 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013487+0000", 2024-04-25T22:54:06.816 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00011657100000000001 2024-04-25T22:54:06.816 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.816 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.816 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting_for_map not empty", 2024-04-25T22:54:06.817 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013524+0000", 2024-04-25T22:54:06.817 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6758000000000003e-05 2024-04-25T22:54:06.817 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.817 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.817 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:06.817 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019759+0000", 2024-04-25T22:54:06.817 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0062352780000000003 2024-04-25T22:54:06.817 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.818 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.818 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:06.818 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.019850+0000", 2024-04-25T22:54:06.818 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.1459999999999995e-05 2024-04-25T22:54:06.818 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.818 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.819 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:54:06.819 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020023+0000", 2024-04-25T22:54:06.819 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00017216099999999999 2024-04-25T22:54:06.819 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.819 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.819 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:54:06.819 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.021325+0000", 2024-04-25T22:54:06.819 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0013025230000000001 2024-04-25T22:54:06.820 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.820 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.820 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:06.820 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028692+0000", 2024-04-25T22:54:06.820 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073665550000000003 2024-04-25T22:54:06.820 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.820 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.820 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:54:06.820 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028748+0000", 2024-04-25T22:54:06.821 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6808000000000002e-05 2024-04-25T22:54:06.821 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.821 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.821 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:06.821 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.028791+0000", 2024-04-25T22:54:06.821 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2401000000000003e-05 2024-04-25T22:54:06.821 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:06.821 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:06.822 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:06.822 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.822 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.822 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:06.822 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:54:06.822 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 133.73465420599999, 2024-04-25T22:54:06.822 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015926276999999999, 2024-04-25T22:54:06.822 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:06.822 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:06.823 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:06.823 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:06.823 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.823 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:06.823 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:54:06.823 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:06.823 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.823 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.824 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:06.824 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013378+0000", 2024-04-25T22:54:06.824 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:06.824 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.824 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.824 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:06.824 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013379+0000", 2024-04-25T22:54:06.824 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.13e-07 2024-04-25T22:54:06.824 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.825 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.825 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:06.825 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013393+0000", 2024-04-25T22:54:06.825 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.431e-05 2024-04-25T22:54:06.825 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.825 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.825 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:06.825 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013401+0000", 2024-04-25T22:54:06.826 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.5189999999999992e-06 2024-04-25T22:54:06.826 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.826 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.826 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:06.826 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013407+0000", 2024-04-25T22:54:06.826 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4689999999999996e-06 2024-04-25T22:54:06.826 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.826 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.827 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:06.827 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020709+0000", 2024-04-25T22:54:06.827 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0073018509999999998 2024-04-25T22:54:06.827 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.827 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.827 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:06.827 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020814+0000", 2024-04-25T22:54:06.827 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000105572 2024-04-25T22:54:06.828 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.828 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.828 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:54:06.828 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.020928+0000", 2024-04-25T22:54:06.828 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000113922 2024-04-25T22:54:06.828 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.828 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.828 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:54:06.829 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.022205+0000", 2024-04-25T22:54:06.829 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.001276353 2024-04-25T22:54:06.829 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.829 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.829 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:06.829 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029206+0000", 2024-04-25T22:54:06.829 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070012190000000004 2024-04-25T22:54:06.830 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.830 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.830 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:54:06.830 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029257+0000", 2024-04-25T22:54:06.830 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1445e-05 2024-04-25T22:54:06.830 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.830 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.830 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:06.831 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.029304+0000", 2024-04-25T22:54:06.831 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7104000000000002e-05 2024-04-25T22:54:06.831 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:06.831 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:06.831 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:06.831 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.831 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.831 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:06.831 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:54:06.832 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 133.73461784200001, 2024-04-25T22:54:06.832 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.013330402999999999, 2024-04-25T22:54:06.832 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:06.832 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:06.832 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:54:06.832 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:06.832 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.833 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:06.833 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:54:06.833 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:06.833 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.833 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.833 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:06.833 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013414+0000", 2024-04-25T22:54:06.833 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:06.834 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.834 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.834 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:06.834 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013415+0000", 2024-04-25T22:54:06.834 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.75e-07 2024-04-25T22:54:06.834 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.834 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.834 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:06.835 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013417+0000", 2024-04-25T22:54:06.835 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.3240000000000001e-06 2024-04-25T22:54:06.835 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.835 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.835 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:06.835 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013424+0000", 2024-04-25T22:54:06.835 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9179999999999997e-06 2024-04-25T22:54:06.835 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.835 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.836 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:06.836 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013430+0000", 2024-04-25T22:54:06.836 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6400000000000002e-06 2024-04-25T22:54:06.836 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.836 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.836 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:06.836 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013505+0000", 2024-04-25T22:54:06.836 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.4758999999999994e-05 2024-04-25T22:54:06.837 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.837 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.837 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op must wait for map", 2024-04-25T22:54:06.837 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013510+0000", 2024-04-25T22:54:06.837 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.6840000000000001e-06 2024-04-25T22:54:06.837 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.837 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.837 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:06.837 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016623+0000", 2024-04-25T22:54:06.838 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0031128869999999999 2024-04-25T22:54:06.838 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.838 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.838 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:06.838 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016793+0000", 2024-04-25T22:54:06.838 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000169455 2024-04-25T22:54:06.838 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.838 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.839 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:06.839 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.026745+0000", 2024-04-25T22:54:06.839 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0099521609999999993 2024-04-25T22:54:06.839 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:06.839 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:06.839 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:06.839 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.839 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.840 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-25T22:54:06.840 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:54:06.840 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 133.734586761, 2024-04-25T22:54:06.840 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.012008094, 2024-04-25T22:54:06.840 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:06.840 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:06.840 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "started", 2024-04-25T22:54:06.840 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:06.840 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.841 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:06.841 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:54:06.841 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:06.841 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.841 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.841 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:06.841 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:54:06.842 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:06.842 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.842 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.842 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:06.842 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013446+0000", 2024-04-25T22:54:06.842 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5499999999999998e-07 2024-04-25T22:54:06.842 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.842 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.843 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:06.843 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013449+0000", 2024-04-25T22:54:06.843 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.5399999999999998e-06 2024-04-25T22:54:06.843 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.843 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.843 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:06.843 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013531+0000", 2024-04-25T22:54:06.843 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1979999999999998e-05 2024-04-25T22:54:06.844 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.844 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.844 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:06.844 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.013537+0000", 2024-04-25T22:54:06.844 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8920000000000003e-06 2024-04-25T22:54:06.844 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.844 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.845 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:06.845 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016411+0000", 2024-04-25T22:54:06.845 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0028734239999999999 2024-04-25T22:54:06.845 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.845 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.845 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:06.845 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.016829+0000", 2024-04-25T22:54:06.845 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00041864799999999998 2024-04-25T22:54:06.846 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.846 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.846 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:06.846 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:51:53.025454+0000", 2024-04-25T22:54:06.846 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0086241549999999997 2024-04-25T22:54:06.846 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:06.846 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:06.846 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:06.847 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.847 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.847 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:30 4.31 4:8ebfc112:::1000000021d.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-25T22:54:06.847 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:54:06.847 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 35.694900891000003, 2024-04-25T22:54:06.847 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.015003005, 2024-04-25T22:54:06.847 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:06.848 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:06.848 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:06.848 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:54:06.848 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:54:06.848 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:54:06.848 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 30 2024-04-25T22:54:06.848 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.849 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:06.849 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.849 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:06.849 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:54:06.849 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:06.849 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.849 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.850 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:06.850 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053131+0000", 2024-04-25T22:54:06.850 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:06.850 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.850 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.850 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:06.850 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.053133+0000", 2024-04-25T22:54:06.851 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.0370000000000001e-06 2024-04-25T22:54:06.851 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.851 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.851 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:06.851 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060377+0000", 2024-04-25T22:54:06.851 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0072431070000000004 2024-04-25T22:54:06.851 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.852 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.852 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:06.852 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060388+0000", 2024-04-25T22:54:06.852 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1285e-05 2024-04-25T22:54:06.852 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.852 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.852 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:06.852 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060394+0000", 2024-04-25T22:54:06.853 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.1040000000000003e-06 2024-04-25T22:54:06.853 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.853 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.853 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:06.853 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060483+0000", 2024-04-25T22:54:06.853 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.9345000000000006e-05 2024-04-25T22:54:06.853 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.853 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.854 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:06.854 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.060566+0000", 2024-04-25T22:54:06.854 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2237999999999994e-05 2024-04-25T22:54:06.854 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.854 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.854 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:54:06.854 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068057+0000", 2024-04-25T22:54:06.854 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074912210000000002 2024-04-25T22:54:06.855 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.855 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.855 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:54:06.855 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068090+0000", 2024-04-25T22:54:06.855 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3501000000000003e-05 2024-04-25T22:54:06.855 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.855 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.856 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:06.856 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.068134+0000", 2024-04-25T22:54:06.856 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4166999999999999e-05 2024-04-25T22:54:06.856 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:06.856 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:06.856 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:06.856 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.856 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.857 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:66 4.27 4:e5671758:::1000000024f.00000000:head [write 0~6641] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:54:06.857 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:54:06.857 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 35.434790554999999, 2024-04-25T22:54:06.857 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0075166540000000002, 2024-04-25T22:54:06.857 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:06.857 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:06.857 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:06.857 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:54:06.858 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:54:06.858 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:54:06.858 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 66 2024-04-25T22:54:06.858 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.858 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:06.858 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.858 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:06.858 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:54:06.859 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:06.859 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.859 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.859 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:06.859 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:54:06.859 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:06.859 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.859 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.860 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:06.860 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313242+0000", 2024-04-25T22:54:06.860 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4099999999999998e-07 2024-04-25T22:54:06.860 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.860 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.860 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:06.860 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313252+0000", 2024-04-25T22:54:06.860 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.5380000000000008e-06 2024-04-25T22:54:06.860 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.861 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.861 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:06.861 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313260+0000", 2024-04-25T22:54:06.861 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.2609999999999993e-06 2024-04-25T22:54:06.861 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.861 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.861 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:06.861 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313265+0000", 2024-04-25T22:54:06.862 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4850000000000003e-06 2024-04-25T22:54:06.862 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.862 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.862 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:06.862 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313310+0000", 2024-04-25T22:54:06.862 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5247999999999998e-05 2024-04-25T22:54:06.862 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.862 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.867 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:06.867 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313370+0000", 2024-04-25T22:54:06.867 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.0275000000000001e-05 2024-04-25T22:54:06.867 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.867 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.867 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:54:06.867 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.313435+0000", 2024-04-25T22:54:06.868 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.4647000000000006e-05 2024-04-25T22:54:06.868 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.868 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.868 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:06.868 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314174+0000", 2024-04-25T22:54:06.868 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00073925 2024-04-25T22:54:06.868 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.869 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.869 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:54:06.869 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320688+0000", 2024-04-25T22:54:06.869 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.006513418 2024-04-25T22:54:06.869 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.869 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.869 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:54:06.869 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320736+0000", 2024-04-25T22:54:06.870 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.8114e-05 2024-04-25T22:54:06.870 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.870 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.870 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:06.870 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.320758+0000", 2024-04-25T22:54:06.870 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2776999999999999e-05 2024-04-25T22:54:06.870 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:06.870 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:06.871 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:06.871 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.871 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.871 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:68 4.31 4:8fb7f7b7:::10000000251.00000000:head [write 0~2067] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:54:06.871 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:54:06.871 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 35.433104776999997, 2024-04-25T22:54:06.871 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0087011669999999992, 2024-04-25T22:54:06.871 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:06.872 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:06.872 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:06.872 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:54:06.872 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:54:06.872 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:54:06.872 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 68 2024-04-25T22:54:06.872 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.872 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:06.872 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.873 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:06.873 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:54:06.873 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:06.873 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.873 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.873 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:06.873 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:54:06.873 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:06.874 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.874 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.874 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:06.874 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314928+0000", 2024-04-25T22:54:06.874 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.8400000000000003e-07 2024-04-25T22:54:06.874 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.874 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.874 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:06.875 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314933+0000", 2024-04-25T22:54:06.875 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5430000000000004e-06 2024-04-25T22:54:06.875 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.875 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.875 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:06.875 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314944+0000", 2024-04-25T22:54:06.875 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.076e-05 2024-04-25T22:54:06.875 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.876 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.876 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:06.876 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314949+0000", 2024-04-25T22:54:06.876 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1019999999999996e-06 2024-04-25T22:54:06.876 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.876 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.876 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:06.877 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.314996+0000", 2024-04-25T22:54:06.877 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7018999999999998e-05 2024-04-25T22:54:06.877 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.877 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.877 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:06.877 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315064+0000", 2024-04-25T22:54:06.877 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8738000000000005e-05 2024-04-25T22:54:06.878 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.878 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.878 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:54:06.878 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323531+0000", 2024-04-25T22:54:06.878 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084664739999999999 2024-04-25T22:54:06.878 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.878 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.879 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:54:06.879 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323574+0000", 2024-04-25T22:54:06.879 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3449999999999999e-05 2024-04-25T22:54:06.879 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.879 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.879 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:06.879 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323629+0000", 2024-04-25T22:54:06.879 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4296999999999999e-05 2024-04-25T22:54:06.880 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:06.880 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:06.880 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:06.880 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.880 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.880 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_repop(client.4734.0:69 4.32 e46/13 4:4e8c6251:::10000000252.00000000:head v 46'1, mlcod=0'0)", 2024-04-25T22:54:06.880 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:54:06.881 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 35.432073508999999, 2024-04-25T22:54:06.881 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0076063240000000002, 2024-04-25T22:54:06.881 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:06.881 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:06.881 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:06.881 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:06.881 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.881 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:06.882 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:54:06.882 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:06.882 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.882 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.882 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:06.882 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:54:06.882 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:06.882 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.883 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.883 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:06.883 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315959+0000", 2024-04-25T22:54:06.883 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3099999999999997e-07 2024-04-25T22:54:06.883 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.883 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.883 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:06.883 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315964+0000", 2024-04-25T22:54:06.883 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.3229999999999999e-06 2024-04-25T22:54:06.884 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.884 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.884 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:06.884 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315973+0000", 2024-04-25T22:54:06.884 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.7249999999999992e-06 2024-04-25T22:54:06.884 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.884 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.884 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:06.885 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.315978+0000", 2024-04-25T22:54:06.885 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4830000000000001e-06 2024-04-25T22:54:06.885 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.885 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.885 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:06.885 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.316043+0000", 2024-04-25T22:54:06.885 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.5036000000000005e-05 2024-04-25T22:54:06.885 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.885 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.886 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:06.886 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.316055+0000", 2024-04-25T22:54:06.886 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1973999999999999e-05 2024-04-25T22:54:06.886 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.886 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.886 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:54:06.886 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323521+0000", 2024-04-25T22:54:06.886 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0074660239999999999 2024-04-25T22:54:06.887 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.887 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.887 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:06.887 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.323565+0000", 2024-04-25T22:54:06.887 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.4128000000000002e-05 2024-04-25T22:54:06.887 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:06.887 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:06.887 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:06.887 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.888 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.888 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:72 4.36 4:6cdfec98:::10000000255.00000000:head [write 0~4131] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:54:06.888 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:54:06.888 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 35.430029597000001, 2024-04-25T22:54:06.888 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0084820680000000006, 2024-04-25T22:54:06.888 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:06.888 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:06.888 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:06.889 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:54:06.889 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:54:06.889 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:54:06.889 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 72 2024-04-25T22:54:06.889 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.889 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:06.889 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.889 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:06.890 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:54:06.890 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:06.890 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.890 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.890 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:06.890 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:54:06.890 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:06.891 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.891 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.891 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:06.891 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318003+0000", 2024-04-25T22:54:06.891 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1800000000000005e-07 2024-04-25T22:54:06.891 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.891 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.891 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:06.892 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318010+0000", 2024-04-25T22:54:06.892 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.7399999999999998e-06 2024-04-25T22:54:06.892 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.892 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.892 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:06.892 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318019+0000", 2024-04-25T22:54:06.892 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.0170000000000002e-06 2024-04-25T22:54:06.892 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.893 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.893 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:06.893 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318024+0000", 2024-04-25T22:54:06.893 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0150000000000003e-06 2024-04-25T22:54:06.893 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.893 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.893 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:06.894 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318075+0000", 2024-04-25T22:54:06.894 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.0537000000000001e-05 2024-04-25T22:54:06.894 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.894 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.894 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:06.894 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.318144+0000", 2024-04-25T22:54:06.894 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.9432999999999997e-05 2024-04-25T22:54:06.894 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.894 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.895 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:54:06.895 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326392+0000", 2024-04-25T22:54:06.895 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0082482979999999994 2024-04-25T22:54:06.895 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.895 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.895 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:54:06.895 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326432+0000", 2024-04-25T22:54:06.895 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.9870000000000003e-05 2024-04-25T22:54:06.896 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.896 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.896 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:06.896 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326485+0000", 2024-04-25T22:54:06.896 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.2439999999999999e-05 2024-04-25T22:54:06.896 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:06.896 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:06.896 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:06.897 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.897 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.897 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(client.4734.0:74 4.10 4:08e6f8ca:::10000000257.00000000:head [write 0~839] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-25T22:54:06.897 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:54:06.897 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 35.428555869, 2024-04-25T22:54:06.897 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0070370720000000001, 2024-04-25T22:54:06.897 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:06.897 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:06.897 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:06.898 INFO:teuthology.orchestra.run.smithi191.stdout: "client_info": { 2024-04-25T22:54:06.898 INFO:teuthology.orchestra.run.smithi191.stdout: "client": "client.4734", 2024-04-25T22:54:06.898 INFO:teuthology.orchestra.run.smithi191.stdout: "client_addr": "192.168.0.1:0/1876499807", 2024-04-25T22:54:06.898 INFO:teuthology.orchestra.run.smithi191.stdout: "tid": 74 2024-04-25T22:54:06.898 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.898 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:06.898 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.898 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:06.899 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:54:06.899 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:06.899 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.899 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.899 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:06.899 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319476+0000", 2024-04-25T22:54:06.899 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:06.900 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.900 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.900 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:06.900 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319477+0000", 2024-04-25T22:54:06.900 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1999999999999999e-07 2024-04-25T22:54:06.900 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.900 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.900 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:06.901 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319483+0000", 2024-04-25T22:54:06.901 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.4260000000000002e-06 2024-04-25T22:54:06.901 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.901 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.901 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:06.901 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319494+0000", 2024-04-25T22:54:06.901 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.094e-05 2024-04-25T22:54:06.901 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.901 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.902 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:06.902 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319499+0000", 2024-04-25T22:54:06.902 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3789999999999997e-06 2024-04-25T22:54:06.902 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.902 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.902 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:06.902 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319545+0000", 2024-04-25T22:54:06.903 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6149000000000001e-05 2024-04-25T22:54:06.903 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.903 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.903 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:06.903 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.319617+0000", 2024-04-25T22:54:06.903 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.1792999999999995e-05 2024-04-25T22:54:06.903 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.903 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.904 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:54:06.904 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326406+0000", 2024-04-25T22:54:06.904 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0067895999999999998 2024-04-25T22:54:06.904 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.904 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.904 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:54:06.904 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326443+0000", 2024-04-25T22:54:06.904 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6828e-05 2024-04-25T22:54:06.905 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.905 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.905 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:06.905 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:31.326514+0000", 2024-04-25T22:54:06.905 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0236999999999999e-05 2024-04-25T22:54:06.905 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:06.905 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:06.905 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:06.905 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.906 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.906 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:128 3.1f 3:f83d65d8:::200.00000004:head [write 876784~3317520 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e48)", 2024-04-25T22:54:06.906 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:36.985410+0000", 2024-04-25T22:54:06.906 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 29.762622251, 2024-04-25T22:54:06.906 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0090177360000000002, 2024-04-25T22:54:06.906 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:06.906 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:06.907 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:06.907 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:06.907 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.907 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:06.907 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.985410+0000", 2024-04-25T22:54:06.907 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:06.907 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.907 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.907 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:06.908 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.985410+0000", 2024-04-25T22:54:06.908 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:06.908 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.908 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.908 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:06.908 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.985411+0000", 2024-04-25T22:54:06.908 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8400000000000003e-07 2024-04-25T22:54:06.908 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.909 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.909 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:06.909 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989116+0000", 2024-04-25T22:54:06.909 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0037047389999999999 2024-04-25T22:54:06.909 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.909 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.909 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:06.910 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989128+0000", 2024-04-25T22:54:06.910 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.1977999999999999e-05 2024-04-25T22:54:06.910 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.910 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.910 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:06.910 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989135+0000", 2024-04-25T22:54:06.910 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.5290000000000003e-06 2024-04-25T22:54:06.910 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.911 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.911 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:06.911 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989181+0000", 2024-04-25T22:54:06.911 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.6122999999999999e-05 2024-04-25T22:54:06.911 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.911 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.911 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:06.911 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.989250+0000", 2024-04-25T22:54:06.912 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8535999999999996e-05 2024-04-25T22:54:06.912 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.912 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.912 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:54:06.912 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.994272+0000", 2024-04-25T22:54:06.912 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0050224889999999998 2024-04-25T22:54:06.912 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.913 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.913 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:54:06.913 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.994335+0000", 2024-04-25T22:54:06.913 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2588000000000005e-05 2024-04-25T22:54:06.913 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.913 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.913 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:06.913 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:36.994428+0000", 2024-04-25T22:54:06.914 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 9.2869999999999997e-05 2024-04-25T22:54:06.914 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:06.914 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:06.914 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:06.914 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.914 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.914 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:2150 4.22 4:47cffac6:::10000000a2b.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T22:54:06.915 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:41.078233+0000", 2024-04-25T22:54:06.915 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 25.669798941, 2024-04-25T22:54:06.915 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069201510000000003, 2024-04-25T22:54:06.915 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:06.915 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:06.915 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:06.915 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:06.915 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.916 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:06.916 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078233+0000", 2024-04-25T22:54:06.916 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:06.916 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.916 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.916 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:06.916 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078233+0000", 2024-04-25T22:54:06.916 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:06.917 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.917 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.917 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:06.917 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078234+0000", 2024-04-25T22:54:06.917 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.1699999999999998e-07 2024-04-25T22:54:06.917 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.917 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.917 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:06.918 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078236+0000", 2024-04-25T22:54:06.918 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 1.875e-06 2024-04-25T22:54:06.918 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.918 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.918 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:06.918 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078242+0000", 2024-04-25T22:54:06.918 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.2450000000000003e-06 2024-04-25T22:54:06.918 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.919 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.919 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:06.919 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078247+0000", 2024-04-25T22:54:06.919 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7450000000000003e-06 2024-04-25T22:54:06.919 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.919 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.919 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:06.920 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078641+0000", 2024-04-25T22:54:06.920 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00039420200000000002 2024-04-25T22:54:06.920 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.920 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.920 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:06.920 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078840+0000", 2024-04-25T22:54:06.920 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000199063 2024-04-25T22:54:06.920 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.921 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.921 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:54:06.921 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078919+0000", 2024-04-25T22:54:06.921 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.9182000000000002e-05 2024-04-25T22:54:06.921 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.921 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.921 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:06.921 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.080906+0000", 2024-04-25T22:54:06.922 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0019866390000000001 2024-04-25T22:54:06.922 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.922 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.922 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:54:06.922 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085074+0000", 2024-04-25T22:54:06.922 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0041683639999999999 2024-04-25T22:54:06.922 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.923 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.923 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:54:06.923 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085117+0000", 2024-04-25T22:54:06.923 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.2849999999999998e-05 2024-04-25T22:54:06.923 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.923 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.923 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:06.923 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085154+0000", 2024-04-25T22:54:06.924 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.6468999999999999e-05 2024-04-25T22:54:06.924 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:06.924 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:06.924 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:06.924 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.924 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.924 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:2160 4.2a 4:57f9ed86:::10000000a3d.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T22:54:06.925 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:54:06.925 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 25.669329650999998, 2024-04-25T22:54:06.925 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0068959959999999997, 2024-04-25T22:54:06.925 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:06.925 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:06.925 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:06.925 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:06.926 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.926 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:06.926 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:54:06.926 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:06.926 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.926 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.926 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:06.926 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:54:06.927 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:06.927 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.927 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.927 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:06.927 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078703+0000", 2024-04-25T22:54:06.927 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.7000000000000004e-07 2024-04-25T22:54:06.927 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.928 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.928 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:06.928 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078707+0000", 2024-04-25T22:54:06.928 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.783e-06 2024-04-25T22:54:06.928 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.928 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.928 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:06.929 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078716+0000", 2024-04-25T22:54:06.929 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.4800000000000001e-06 2024-04-25T22:54:06.929 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.929 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.929 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:06.929 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078724+0000", 2024-04-25T22:54:06.929 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.1519999999999992e-06 2024-04-25T22:54:06.930 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.930 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.930 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:06.930 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078794+0000", 2024-04-25T22:54:06.930 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 7.0500999999999995e-05 2024-04-25T22:54:06.930 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.930 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.930 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:06.931 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078912+0000", 2024-04-25T22:54:06.931 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.000117439 2024-04-25T22:54:06.931 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.931 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.931 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:54:06.931 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079000+0000", 2024-04-25T22:54:06.931 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 8.8092999999999998e-05 2024-04-25T22:54:06.931 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.932 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.932 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:06.932 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.080897+0000", 2024-04-25T22:54:06.932 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0018970899999999999 2024-04-25T22:54:06.932 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.932 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.932 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:54:06.932 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085517+0000", 2024-04-25T22:54:06.933 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0046198929999999999 2024-04-25T22:54:06.933 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.933 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.933 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:54:06.933 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085565+0000", 2024-04-25T22:54:06.933 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.7777e-05 2024-04-25T22:54:06.933 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.933 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.934 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:06.934 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085599+0000", 2024-04-25T22:54:06.934 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.4017999999999999e-05 2024-04-25T22:54:06.934 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:06.934 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:06.934 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:06.934 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.935 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.935 INFO:teuthology.orchestra.run.smithi191.stdout: "description": "osd_op(mds.0.3:2163 4.2a 4:549f79e3:::10000000a43.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-25T22:54:06.935 INFO:teuthology.orchestra.run.smithi191.stdout: "initiated_at": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:54:06.935 INFO:teuthology.orchestra.run.smithi191.stdout: "age": 25.669296297999999, 2024-04-25T22:54:06.935 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0069469190000000002, 2024-04-25T22:54:06.935 INFO:teuthology.orchestra.run.smithi191.stdout: "continuous": false, 2024-04-25T22:54:06.935 INFO:teuthology.orchestra.run.smithi191.stdout: "type_data": { 2024-04-25T22:54:06.935 INFO:teuthology.orchestra.run.smithi191.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-25T22:54:06.936 INFO:teuthology.orchestra.run.smithi191.stdout: "events": [ 2024-04-25T22:54:06.936 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.936 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "initiated", 2024-04-25T22:54:06.936 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:54:06.936 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:06.936 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.936 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.936 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "header_read", 2024-04-25T22:54:06.936 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:54:06.937 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0 2024-04-25T22:54:06.937 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.937 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.937 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "throttled", 2024-04-25T22:54:06.937 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078736+0000", 2024-04-25T22:54:06.937 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.1399999999999997e-07 2024-04-25T22:54:06.937 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.938 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.938 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "all_read", 2024-04-25T22:54:06.938 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078739+0000", 2024-04-25T22:54:06.938 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 2.2960000000000001e-06 2024-04-25T22:54:06.938 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.938 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.938 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "dispatched", 2024-04-25T22:54:06.938 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078745+0000", 2024-04-25T22:54:06.939 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.3439999999999997e-06 2024-04-25T22:54:06.939 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.939 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.939 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "queued_for_pg", 2024-04-25T22:54:06.939 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.078750+0000", 2024-04-25T22:54:06.939 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 5.3179999999999997e-06 2024-04-25T22:54:06.939 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.939 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.940 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "reached_pg", 2024-04-25T22:54:06.940 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079224+0000", 2024-04-25T22:54:06.940 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.00047334999999999999 2024-04-25T22:54:06.940 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.940 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.940 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "started", 2024-04-25T22:54:06.940 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079292+0000", 2024-04-25T22:54:06.941 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 6.8708999999999996e-05 2024-04-25T22:54:06.941 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.941 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.941 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "waiting for subops from 0", 2024-04-25T22:54:06.941 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.079342+0000", 2024-04-25T22:54:06.941 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.9299999999999999e-05 2024-04-25T22:54:06.941 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.941 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.941 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "sub_op_commit_rec", 2024-04-25T22:54:06.942 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.081611+0000", 2024-04-25T22:54:06.942 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0022695229999999999 2024-04-25T22:54:06.942 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.942 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.942 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "op_commit", 2024-04-25T22:54:06.942 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085605+0000", 2024-04-25T22:54:06.942 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 0.0039933679999999997 2024-04-25T22:54:06.943 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.943 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.943 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "commit_sent", 2024-04-25T22:54:06.943 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085650+0000", 2024-04-25T22:54:06.943 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 4.5111000000000002e-05 2024-04-25T22:54:06.943 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-04-25T22:54:06.943 INFO:teuthology.orchestra.run.smithi191.stdout: { 2024-04-25T22:54:06.943 INFO:teuthology.orchestra.run.smithi191.stdout: "event": "done", 2024-04-25T22:54:06.943 INFO:teuthology.orchestra.run.smithi191.stdout: "time": "2024-04-25T22:53:41.085683+0000", 2024-04-25T22:54:06.944 INFO:teuthology.orchestra.run.smithi191.stdout: "duration": 3.3185999999999997e-05 2024-04-25T22:54:06.944 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:06.944 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:06.944 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:06.944 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-04-25T22:54:06.944 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-04-25T22:54:06.944 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-04-25T22:54:08.418 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-25T22:54:09.404 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is unset 2024-04-25T22:54:09.423 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-25T22:54:10.417 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is unset 2024-04-25T22:54:11.355 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~88s 2024-04-25T22:54:17.162 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~94s 2024-04-25T22:54:22.969 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~100s 2024-04-25T22:54:28.777 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~106s 2024-04-25T22:54:34.584 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~111s 2024-04-25T22:54:40.390 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~117s 2024-04-25T22:54:46.200 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~123s 2024-04-25T22:54:52.006 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~129s 2024-04-25T22:54:57.812 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~135s 2024-04-25T22:55:03.621 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~140s 2024-04-25T22:55:09.428 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~146s 2024-04-25T22:55:15.234 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~152s 2024-04-25T22:55:17.661 DEBUG:teuthology.orchestra.console.smithi164:expect before: [Enter `^Ec?' for help] \x80 \x80 \x80  el(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Initializing Intel(R) Boot Agent XE v2.1.60 Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.72 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 88 73 F3 GUID: 00000000 0000 0000 0000 0CC47AD934F4 DHCP.|                    DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| CLIENT IP: 172.21.15.164 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 95D3:0070, entry point at 95D3:0106  UNDI code segment 95D3:3E70, data segment 8E94:73F0 (570-615kB)  UNDI device is PCI 03:00.1, type DIX+802.3  570kB free base memory after PXE unload iPXE initialising devices... iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:88:73:f3)... Configuring (net0 0c:c4:7a:88:73:f3).... Configuring (net0 0c:c4:7a:88:73:f3)..... Configuring (net0 0c:c4:7a:88:73:f3)...... ok .   [?25lUse the ^ and v keys to change the selection. Press 'e' to edit the selected item, or 'c' for a command prompt.   CentOS Stream (5.14.0-437.el9.x86_64) 9  CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-7fc8828e06d0482694bcf4a447d13cb6) 9                The selected entry will be started automatically in 5s.             Use the * and * keys to change the selection.  Press 'e' to edit the selected item, or 'c' for a command prompt.  The selected entry will be started automatically in 5s.   CentOS Stream (5.14.0-437.el9.x86_64) 9   CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-7fc8828e06d0482694bcf4a447d13cb6) 9  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 0s. [?25h      [ 0.000000] Linux version 5.14.0-437.el9.x86_64 (mockbuild@x86-05.stream.rdu2.redhat.com) (gcc (GCC) 11.4.1 20231218 (Red Hat 11.4.1-3), GNU ld version 2.35.2-43.el9) #1 SMP PREEMPT_DYNAMIC Tue Apr 9 12:57:02 UTC 2024 [ 0.000000] The list of certified hardware and cloud instances for Red Hat Enterprise Linux 9 can be viewed at the Red Hat Ecosystem Catalog, https://catalog.redhat.com. [ 0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-437.el9.x86_64 root=UUID=a494b625-6d2c-4093-809e-dd42758f0c27 ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008abff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ec5fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f78000-0x00000000798a7fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798a8000-0x0000000079d44fff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d45000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] APIC: Static calls initialized [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0a 08/02/2016 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.983 MHz processor [ 0.000409] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000412] MTRR map: 5 entries (3 fixed + 2 variable; max 23), built from 10 variable MTRRs [ 0.000414] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000743] last_pfn = 0x78ec6 max_arch_pfn = 0x400000000 [ 0.006422] found SMP MP-table at [mem 0x000fcd40-0x000fcd4f] [ 0.006430] Using GB pages for direct mapping [ 0.006542] RAMDISK: [mem 0x33f38000-0x35f93fff] [ 0.006545] ACPI: Early table checksum verification disabled [ 0.006548] ACPI: RSDP 0x00000000000F05B0 000024 (v02 SUPERM) [ 0.006551] ACPI: XSDT 0x00000000798A80A0 0000BC (v01 01072009 AMI 00010013) [ 0.006555] ACPI: FACP 0x00000000798DB838 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006559] ACPI: DSDT 0x00000000798A81F0 033641 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.006562] ACPI: FACS 0x0000000079D43F80 000040 [ 0.006564] ACPI: APIC 0x00000000798DB948 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006566] ACPI: FPDT 0x00000000798DBA10 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006569] ACPI: FIDT 0x00000000798DBA58 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006571] ACPI: SPMI 0x00000000798DBAF8 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.006573] ACPI: MCFG 0x00000000798DBB38 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.006576] ACPI: UEFI 0x00000000798DBB78 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.006578] ACPI: HPET 0x00000000798DBBC0 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006580] ACPI: WDDT 0x00000000798DBBF8 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.006582] ACPI: SSDT 0x00000000798DBC38 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.006585] ACPI: NITR 0x00000000798F2DB8 000071 (v02 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006587] ACPI: SSDT 0x00000000798F2E30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.006589] ACPI: SSDT 0x00000000798F5480 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.006592] ACPI: PRAD 0x00000000798F54E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.006594] ACPI: DMAR 0x00000000798F55F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006596] ACPI: HEST 0x00000000798F56B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006599] ACPI: BERT 0x00000000798F5930 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006601] ACPI: ERST 0x00000000798F5960 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006603] ACPI: EINJ 0x00000000798F5B90 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006605] ACPI: Reserving FACP table memory at [mem 0x798db838-0x798db943] [ 0.006606] ACPI: Reserving DSDT table memory at [mem 0x798a81f0-0x798db830] [ 0.006607] ACPI: Reserving FACS table memory at [mem 0x79d43f80-0x79d43fbf] [ 0.006607] ACPI: Reserving APIC table memory at [mem 0x798db948-0x798dba0f] [ 0.006608] ACPI: Reserving FPDT table memory at [mem 0x798dba10-0x798dba53] [ 0.006609] ACPI: Reserving FIDT table memory at [mem 0x798dba58-0x798dbaf3] [ 0.006609] ACPI: Reserving SPMI table memory at [mem 0x798dbaf8-0x798dbb37] [ 0.006610] ACPI: Reserving MCFG table memory at [mem 0x798dbb38-0x798dbb73] [ 0.006610] ACPI: Reserving UEFI table memory at [mem 0x798dbb78-0x798dbbb9] [ 0.006611] ACPI: Reserving HPET table memory at [mem 0x798dbbc0-0x798dbbf7] [ 0.006612] ACPI: Reserving WDDT table memory at [mem 0x798dbbf8-0x798dbc37] [ 0.006612] ACPI: Reserving SSDT table memory at [mem 0x798dbc38-0x798f2db6] [ 0.006613] ACPI: Reserving NITR table memory at [mem 0x798f2db8-0x798f2e28] [ 0.006613] ACPI: Reserving SSDT table memory at [mem 0x798f2e30-0x798f547b] [ 0.006614] ACPI: Reserving SSDT table memory at [mem 0x798f5480-0x798f54e3] [ 0.006615] ACPI: Reserving PRAD table memory at [mem 0x798f54e8-0x798f55e9] [ 0.006615] ACPI: Reserving DMAR table memory at [mem 0x798f55f0-0x798f56ab] [ 0.006616] ACPI: Reserving HEST table memory at [mem 0x798f56b0-0x798f592b] [ 0.006616] ACPI: Reserving BERT table memory at [mem 0x798f5930-0x798f595f] [ 0.006617] ACPI: Reserving ERST table memory at [mem 0x798f5960-0x798f5b8f] [ 0.006618] ACPI: Reserving EINJ table memory at [mem 0x798f5b90-0x798f5cbf] [ 0.006663] No NUMA configuration found [ 0.006664] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.006672] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.006870] Reserving 256MB of memory at 1664MB for crashkernel (System RAM: 32654MB) [ 0.006906] Zone ranges: [ 0.006906] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.006908] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.006909] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.006910] Device empty [ 0.006911] Movable zone start for each node [ 0.006913] Early memory node ranges [ 0.006913] node 0: [mem 0x0000000000001000-0x0000000000089fff] [ 0.006914] node 0: [mem 0x0000000000100000-0x0000000078ec5fff] [ 0.006915] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.006919] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.006924] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.006961] On node 0, zone DMA: 118 pages in unavailable ranges [ 0.011998] On node 0, zone Normal: 28986 pages in unavailable ranges [ 0.012108] ACPI: PM-Timer IO Port: 0x408 [ 0.012117] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.012118] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.012118] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.012119] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.012119] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.012120] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.012121] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.012121] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.012130] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.012134] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.012136] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.012138] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.012141] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.012142] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.012146] [Firmware Bug]: TSC_DEADLINE disabled due to Errata; please update microcode to version: 0xb000020 (or later) [ 0.012147] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.012157] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.012158] PM: hibernation: Registered nosave memory: [mem 0x0008a000-0x000dffff] [ 0.012159] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.012160] PM: hibernation: Registered nosave memory: [mem 0x78ec6000-0x78f77fff] [ 0.012161] PM: hibernation: Registered nosave memory: [mem 0x78f78000-0x798a7fff] [ 0.012161] PM: hibernation: Registered nosave memory: [mem 0x798a8000-0x79d44fff] [ 0.012162] PM: hibernation: Registered nosave memory: [mem 0x79d45000-0x8fffffff] [ 0.012162] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.012163] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.012163] PM: hibernation: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.012164] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.012165] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.012166] Booting paravirtualized kernel on bare hardware [ 0.012168] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.016494] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.016716] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u262144 [ 0.016741] Fallback order for Node 0: 0 [ 0.016743] Built 1 zonelists, mobility grouping on. Total pages: 8228746 [ 0.016744] Policy zone: Normal [ 0.016745] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-437.el9.x86_64 root=UUID=a494b625-6d2c-4093-809e-dd42758f0c27 ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.016802] Unknown kernel command line parameters "BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-437.el9.x86_64", will be passed to user space. [ 0.016818] random: crng init done [ 0.018991] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.020125] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.020372] mem auto-init: stack:off, heap alloc:off, heap free:off [ 0.020380] software IO TLB: area num 8. [ 0.048291] Memory: 1750180K/33438012K available (16384K kernel code, 5628K rwdata, 11788K rodata, 3928K init, 5908K bss, 989180K reserved, 0K cma-reserved) [ 0.048391] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.048399] Kernel/User page tables isolation: enabled [ 0.048422] ftrace: allocating 46993 entries in 184 pages [ 0.066742] ftrace: allocated 184 pages with 4 groups [ 0.067255] Dynamic Preempt: voluntary [ 0.067284] rcu: Preemptible hierarchical RCU implementation. [ 0.067285] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.067286] Trampoline variant of Tasks RCU enabled. [ 0.067286] Rude variant of Tasks RCU enabled. [ 0.067287] Tracing variant of Tasks RCU enabled. [ 0.067287] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.067288] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.070518] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.070680] rcu: srcu_init: Setting srcu_struct sizes based on contention. [ 0.070787] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) [ 0.076003] Console: colour VGA+ 80x25 [ 1.112996] printk: console [ttyS1] enabled [ 1.117187] ACPI: Core revision 20230331 [ 1.121281] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.130409] APIC: Switch to symmetric I/O mode setup [ 1.135378] DMAR: Host address width 46 [ 1.139223] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.144539] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.152542] DMAR: RMRR base: 0x0000007ba6e000 end: 0x0000007ba7dfff [ 1.158808] DMAR: ATSR flags: 0x0 [ 1.162128] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.168394] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.174746] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.181100] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.186500] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.186500] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.201514] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.206816] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.213044] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.223408] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x327340b30a0, max_idle_ns: 440795302655 ns [ 1.233921] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.96 BogoMIPS (lpj=3499983) [ 1.234940] CPU0: Thermal monitoring enabled (TM1) [ 1.235974] process: using mwait in idle threads [ 1.236922] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.237920] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.238922] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.239921] Spectre V2 : Mitigation: Retpolines [ 1.240920] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.241920] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.242921] Speculative Store Bypass: Vulnerable [ 1.243926] MDS: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.244920] TAA: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.245920] MMIO Stale Data: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.246923] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.247920] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.248920] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.249921] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.250920] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.263438] Freeing SMP alternatives memory: 36K [ 1.263921] pid_max: default: 32768 minimum: 301 [ 1.264939] LSM: initializing lsm=lockdown,capability,yama,integrity,selinux,bpf [ 1.265925] Yama: becoming mindful. [ 1.266924] SELinux: Initializing. [ 1.267936] LSM support for eBPF active [ 1.269972] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.270958] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.374872] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.376018] cblist_init_generic: Setting adjustable number of callback queues. [ 1.376920] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.377932] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.378930] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.379929] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.380921] ... version: 3 [ 1.381920] ... bit width: 48 [ 1.382920] ... generic registers: 4 [ 1.383920] ... value mask: 0000ffffffffffff [ 1.384920] ... max period: 00007fffffffffff [ 1.385920] ... fixed-purpose events: 3 [ 1.386921] ... event mask: 000000070000000f [ 1.388004] signal: max sigframe size: 1776 [ 1.388931] Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.389946] rcu: Hierarchical SRCU implementation. [ 1.389947] rcu: Max phase no-delay instances is 400. [ 1.389955] printk: console [ttyS1] printing thread started [ 1.394527] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.394593] smp: Bringing up secondary CPUs ... [ 1.394661] smpboot: x86: Booting SMP configuration: [ 1.394662] .... node #0, CPUs: #1 #2 #3 #4 #5 #6 #7 [ 1.400180] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.400180] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.400180] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.400180] smp: Brought up 1 node, 8 CPUs [ 1.400180] smpboot: Max logical packages: 1 [ 1.400180] smpboot: Total of 8 processors activated (55999.72 BogoMIPS) [ 1.449941] node 0 deferred pages initialised in 42ms [ 1.451920] devtmpfs: initialized [ 1.451960] x86/mm: Memory block size: 128MB [ 1.453703] ACPI: PM: Registering ACPI NVS region [mem 0x798a8000-0x79d44fff] (4837376 bytes) [ 1.453703] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 1.453703] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.453703] pinctrl core: initialized pinctrl subsystem [ 1.470811] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.470900] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 1.470911] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.470919] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.470928] audit: initializing netlink subsys (disabled) [ 1.471922] audit: type=2000 audit(1714085689.258:1): state=initialized audit_enabled=0 res=1 [ 1.471922] thermal_sys: Registered thermal governor 'fair_share' [ 1.471922] thermal_sys: Registered thermal governor 'step_wise' [ 1.471922] thermal_sys: Registered thermal governor 'user_space' [ 1.480922] cpuidle: using governor menu [ 1.487948] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.487949] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.488001] PCI: ECAM [mem 0x80000000-0x8fffffff] (base 0x80000000) for domain 0000 [bus 00-ff] [ 1.488004] PCI: ECAM [mem 0x80000000-0x8fffffff] reserved as E820 entry [ 1.488012] PCI: Using configuration type 1 for base access [ 1.498948] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.498952] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages [ 1.498952] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page [ 1.498952] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages [ 1.498952] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page [ 1.505946] cryptd: max_cpu_qlen set to 1000 [ 1.513713] ACPI: Added _OSI(Module Device) [ 1.513714] ACPI: Added _OSI(Processor Device) [ 1.513715] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.513715] ACPI: Added _OSI(Processor Aggregator Device) [ 1.513716] ACPI: Added _OSI(Linux-Dell-Video) [ 1.513716] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.513717] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.545750] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.547946] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.550011] ACPI: Dynamic OEM Table Load: [ 1.570175] ACPI: _OSC evaluated successfully for all CPUs [ 1.570440] ACPI: Interpreter enabled [ 1.570449] ACPI: PM: (supports S0 S4 S5) [ 1.570450] ACPI: Using IOAPIC for interrupt routing [ 1.571964] HEST: Enabling Firmware First mode for corrected errors. [ 1.608939] HEST: Table parsing has been initialized. [ 1.609059] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.609061] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.609062] PCI: Using E820 reservations for host bridge windows [ 1.609505] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.637209] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.637215] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.638825] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.639613] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.639614] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.639647] PCI host bridge to bus 0000:ff [ 1.639649] pci_bus 0000:ff: root bus resource [bus ff] [ 1.639662] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 conventional PCI endpoint [ 1.639716] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 conventional PCI endpoint [ 1.639756] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 conventional PCI endpoint [ 1.639793] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 conventional PCI endpoint [ 1.639830] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 conventional PCI endpoint [ 1.639867] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 conventional PCI endpoint [ 1.639903] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 conventional PCI endpoint [ 1.639942] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 conventional PCI endpoint [ 1.639978] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 conventional PCI endpoint [ 1.640012] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 conventional PCI endpoint [ 1.640049] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 conventional PCI endpoint [ 1.640083] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 conventional PCI endpoint [ 1.640119] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 conventional PCI endpoint [ 1.640155] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 conventional PCI endpoint [ 1.640190] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 conventional PCI endpoint [ 1.640227] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 conventional PCI endpoint [ 1.640261] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 conventional PCI endpoint [ 1.640296] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 conventional PCI endpoint [ 1.640331] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 conventional PCI endpoint [ 1.640357] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 conventional PCI endpoint [ 1.640401] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.640463] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.640518] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.640568] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.640617] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.640665] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.640714] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 conventional PCI endpoint [ 1.640751] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 conventional PCI endpoint [ 1.640789] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.640839] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.640889] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.640941] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.640989] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 conventional PCI endpoint [ 1.641026] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 conventional PCI endpoint [ 1.641065] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 conventional PCI endpoint [ 1.641102] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x00 conventional PCI endpoint [ 1.641143] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.641193] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.641243] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.641294] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.641346] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 conventional PCI endpoint [ 1.641387] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 conventional PCI endpoint [ 1.641429] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 conventional PCI endpoint [ 1.641468] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 conventional PCI endpoint [ 1.641509] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 conventional PCI endpoint [ 1.641548] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 conventional PCI endpoint [ 1.641582] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 conventional PCI endpoint [ 1.641613] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 conventional PCI endpoint [ 1.641646] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 conventional PCI endpoint [ 1.641675] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 contional PCI endpoint [ 1.641705] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 conventional PCI endpoint [ 1.641734] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 conventional PCI endpoint [ 1.641755] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 conventional PCI endpoint [ 1.641786] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 conventional PCI endpoint [ 1.641818] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 conventional PCI endpoint [ 1.644044] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 1.644047] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.644182] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.644422] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.644423] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.644828] PCI host bridge to bus 0000:00 [ 1.644829] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 1.644830] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 1.644831] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 1.644832] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 1.644833] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 1.644834] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 1.644835] pci_bus 0000:00: root bus resource [bus 00-fe] [ 1.644853] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 PCIe Root Port [ 1.644957] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 PCIe Root Port [ 1.644969] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.645004] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 1.645095] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 PCIe Root Port [ 1.645107] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.645110] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.645143] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 1.645230] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 PCIe Root Port [ 1.645242] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.645244] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.645245] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.645249] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.645279] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 1.645360] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.645368] pci 0000:00:04.0: BAR 0 [mem 0xfb42c000-0xfb42ffff 64bit] [ 1.645442] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.645449] pci 0000:00:04.1: BAR 0 [mem 0xfb428000-0xfb42bfff 64bit] [ 1.645522] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.645529] pci 0000:00:04.2: BAR 0 [mem 0xfb424000-0xfb427fff 64bit] [ 1.645603] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.645610] pci 0000:00:04.3: BAR 0 [mem 0xfb420000-0xfb423fff 64bit] [ 1.645682] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.645689] pci 0000:00:04.4: BAR 0 [mem 0xfb41c000-0xfb41ffff 64bit] [ 1.645761] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.645768] pci 0000:00:04.5: BAR 0 [mem 0xfb418000-0xfb41bfff 64bit] [ 1.645840] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.645847] pci 0000:00:04.6: BAR 0 [mem 0xfb414000-0xfb417fff 64bit] .7: [8086:6f27] omplex Integrated Endpoint [ 1.645932] pci 0000:00:04.7: BAR 0 [mem 0xfb410000-0xfb413fff 64bit] [ 1.646005] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.646065] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.646147] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.646203] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 PCIe Root Complex Integrated Endpoint [ 1.646208] pci 0000:00:05.4: BAR 0 [mem 0xfb439000-0xfb439fff] [ 1.646289] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 PCIe Root Complex Integrated Endpoint [ 1.646526] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 conventional PCI endpoint [ 1.646547] pci 0000:00:11.4: BAR 0 [io 0xf110-0xf117] [ 1.646558] pci 0000:00:1103] [ 1.646 [io 0xf0f0-0xf1.4: BAR 3 [io 0xf0e0-0xf0e3] [ 1.646592] pci 0000:00:11.4: BAR 4 [io 0xf020-0xf03f] [ 1.646603] pci 0000:00:11.4: BAR 5 [mem 0xfb438000-0xfb4387ff] [ 1.646661] pci 0000:00:11.4: PME# supported from D3hot [ 1.646738] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 conventional PCI endpoint [ 1.646761] pci 0000:00:14.0: BAR 0 [mem 0xfb400000-0xfb40ffff 64bit] [ 1.646847] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 1.646933] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 conventional PCI endpoint [ 1.646957] pci 0000:00:16.0: BAR 0 [mem 0xfb437000-0xfb43700f 64bit] [ 1.647044] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 1.647111] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 conventional PCI endpoint [ 1.647136] pci 0000:00:16.1: BAR 0 [mem 0xfb436000-0xfb43600f 64bit] [ 1.647222] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 1.647303] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 conventional Ppci 0000:00:1a.0: BAR 0 [mem 0xfb434000-0xfb4343ff] [ 1.647438] pci 0000:00:E# supported from D0 D3hot D3cold [ 1.647517] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 PCIe Root Port [ 1.647554] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.647644] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 1.647746] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 PCIe Root Port [ 1.647783] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.647787] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.647790] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.647878] pci 0000:00:1c.2: PME# supported from Dt D3cold [ 1.647976] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 PCIe Root Port [ 1.648016] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.648021] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.648025] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.648114] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 1.648217] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 conventional PCI endpoint [ 1.648238] pci 0000:00:1d.0: BAR 0 [mem 0xfb433000-0xfb4333ff] [ 1.648355] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 1.648434] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 conventional PCI endpoint [ 1.648639] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 conventional PCI endpoint [ 1.648657] pci 0000:00:1f.2: BAR 0 [io 0xf070-0xf077] [ 1.648667] pci 0000:00:1f.2: BAR 1 [io 0xf060-0xf063] [ 1.648678] pci 0000:00:1f.2: BAR 2 [io 0xf050-0xf057] [ 1.648688] pci 0000:00:1f.2: BAR 3 [io 0xf040-0xf043] [ 1.648699] pci 0000:00:1f.2: BAR 4 [io 0xf000-0xf01f] [ 1.648709] pci 0000:00:1f.2: BAR 5 [mem 0xfb432000-0xfb4327ff] [ 1.648761] pci 0000:00:1f.2: PME# supported from D3hot [ 1.648823] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 conventional PCI endpoint [ 1.648845] pci 0000:00:1f.3: BAR 0 [mem 0xfb431000-0xfb4310ff 64bit] [ 1.648875] pci 0000:00:1f.3: BAR 4 [io 0x0580-0x059f] [ 1.649036] acpiphp: Slot [1] registered [ 1.649047] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.649153] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 PCIe Endpoint [ 1.649162] pci 0000:02:00.0: BAR 0 [mem 0xfb310000-0xfb313fff 64bit] [ 1.649178] pci 0000:02:00.0: ROM [mem 0xfb300000-0xfb30ffff pref] [ 1.649182] pci 0000:02:00.0: enabling Extended Tags [ 1.649283] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.649388] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.649398] pci 0000:03:00.0: BAR 0 [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 1.649403] pci 0000:03:00.0: BAR 2 [io 0xe020-0xe03f] [ 1.649413] pci 0000:03:00.0: BAR 4 [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 1.649417] pci 0000:03:00.0: ROM [mem 0xfb280000-0xfb2fffff pref] [ 1.649452] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 1.649469] pci 0000:03:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.649470] pci 0000:03:00.0: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.649479] pci 0000:03:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.649480] pci 0000:03:00.0: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.649630] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.649640] pci 0000:03:00.1: BAR 0 [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 1.649645] pci 0000:03:00.1: BAR 2 [io 0xe000-0xe01f] [ 1.649655] pci 0000:03:00.1: BAR 4 [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 1.649659] pci 0000:03:00.1: ROM [mem 0xfb200000-0xfb27ffff pref] [ 1.649695] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 1.649708] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.649709] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.649718] pci 0000:03:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.649718] pci 0000:03:00.1: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.649856] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.649901] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.649995] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 PCIe to PCI/PCI-X bridge [ 1.650068] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.650081] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.650086] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.650139] pci 0000:05:00.0: enabling Extended Tags [ 1.650270] pci 0000:05:00.0: supports D1 D2 [ 1.650271] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.650447] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.650534] pci_bus 0000:06: extended config space not accessible [ 1.650567] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 conventional PCI endpoint [ 1.650603] pci 0000:06:00.0: BAR 0 [mem 0xfa000000-0xfaffffff] [ 1.650623] pci 0000:06:00.0: BAR 1 [mem 0xfb000000-0xfb01ffff] [ 1.650643] pci 0000:06:00.0: BAR 2 [io 0xd000-0xd07f] [ 1.650741] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 1.650811] pci 0000:06:00.0: supports D1 D2 [ 1.650812] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.650962] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.651106] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 PCIe Endpoint [ 1.651138] pci 0000:07:00.0: BAR 0 [mem 0xfb120000-0xfb13ffff] [ 1.651175] pci 0000:07:00.0: BAR 2 [io 0xc020-0xc03f] [ 1.651193] pci 0000:07:00.0: BAR 3 [mem 0xfb144000-0xfb147fff] [ 1.651417] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 1.651477] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.651478] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.651511] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.651512] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.651837] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 PCIe Endpoint [ 1.651869] pci 0000:07:00.1: BAR 0 [mem 0xfb100000-0xfb11ffff] [ 1.651905] pci 0000:07:00.1: BAR 2 [io 0xc000-0xc01f] [ 1.651924] pci 0000:07:00.1: BAR 3 [mem 0xfb140000-0xfb143fff] [ 1.652135] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 1.652196] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.652197] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.652230] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.652230] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.652523] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.652536] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 1.653205] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 1.653236] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 1.653265] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 1.653295] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 1.653325] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 1.653326] ACPI: PCI: Interrupt link LNKE disabled [ 1.653355] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 1.653355] ACPI: PCI: Interrupt link LNKF disabled [ 1.653385] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 1.653385] ACPI: PCI: Interrupt link LNKG disabled [ 1.653415] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 1.653415] ACPI: PCI: Interrupt link LNKH disabled [ 1.653931] iommu: Default domain type: Translated [ 1.653931] iommu: DMA domain TLB invalidation policy: lazy mode [ 1.654000] SCSI subsystem initialized [ 1.654015] ACPI: bus type USB registered [ 1.654025] usbcore: registered new interface driver usbfs [ 1.654030] usbcore: registered new interface driver hub [ 1.654035] usbcore: registered new device driver usb [ 1.654054] pps_core: LinuxPPS API ver. 1 registered [ 1.654055] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 1.654056] PTP clock support registered [ 1.654070] EDAC MC: Ver: 3.0.0 [ 1.654086] NetLabel: Initializing [ 1.654087] NetLabel: domain hash size = 128 [ 1.654087] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 1.654100] NetLabel: unlabeled traffic allowed by default [ 1.654101] PCI: Using ACPI for IRQ routing [ 1.664943] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 1.664944] pci 0000:06:00.0: vgaarb: bridge control possible [ 1.664945] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 1.664946] vgaarb: loaded [ 1.664953] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 1.664956] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 1.672964] clocksource: Switched to clocksource tsc-early [ 1.683937] VFS: Disk quotas dquot_6.6.0 [ 1.683949] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 1.684012] pnp: PnP ACPI init [ 1.684337] system 00:01: [io 0x0500-0x057f] has been reserved [ 1.684339] system 00:01: [io 0x0400-0x047f] has been reserved [ 1.684340] system 00:01: [io 0x0580-0x059f] has been reserved [ 1.684341] system 00:01: [io 0x0600-0x061f] has been reserved [ 1.684342] system 00:01: [io 0x0880-0x0883] has been reserved [ 1.684343] system 00:01: [io 0x0800-0x081f] has been reserved [ 1.684344] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 1.684345] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 1.684346] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 1.684347] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 1.684348] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 1.684349] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 1.684351] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 1.684500] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 1.684501] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 1.684502] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 1.684502] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 1.684503] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 1.685186] pnp: PnP ACPI: found 5 devices [ 1.690653] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 1.690693] NET: Registered PF_INET protocol family [ 1.690862] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.693148] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 1.693179] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 1.693190] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.693426] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 1.693533] TCP: Hash tables configured (established 262144 bind 65536) [ 1.693654] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear) [ 1.693739] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 1.693796] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 1.693875] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 1.693880] NET: Registered PF_XDP protocol family [ 1.693902] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 1.693912] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref]: assigned [ 1.693914] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.693925] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.693927] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.693933] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.693934] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.693935] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.693936] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.693938] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.693938] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.693940] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.693940] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.693942] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.693943] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.693944] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.693945] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.693946] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.693947] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.693948] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.693949] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.693950] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.693951] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.693953] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.693954] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.693958] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.693971] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.693973] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.693981] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.693997] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.693999] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.694005] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.694014] pci 0000:07:00.0: VF BAR 0 [mem 0x90000000-0x9001ffff 64bit pref]: assigned [ 1.694020] pci 0000:07:00.0: VF BAR 3 [mem 0x90020000-0x9003ffff 64bit pref]: assigned [ 1.694026] pci 0000:07:00.1: VF BAR 0 [mem 0x90040000-0x9005ffff 64bit pref]: assigned [ 1.694032] pci 0000:07:00.1: VF BAR 3 [mem 0x90060000-0x9007ffff 64bit pref]: assigned [ 1.694038] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.694040] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.694045] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.694048] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 1.694054] pci_bus 0000:00: Some PCI device resources are unassigned, try booting with pci=realloc [ 1.694055] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 1.694056] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 1.694057] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 1.694058] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 1.694059] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 1.694060] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 1.694061] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 1.694062] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 1.694062] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 1.694063] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.694064] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 1.694065] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.694066] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 1.694067] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.694068] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 1.694068] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 1.694069] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 1.694229] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 1.709966] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x140 took 15201 usecs [ 1.728523] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x140 took 18106 usecs [ 1.728538] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 1.728584] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 1.728585] software IO TLB: mapped [mem 0x0000000064000000-0x0000000068000000] (64MB) [ 1.728588] Trying to unpack rootfs image as initramfs... [ 1.728592] ACPI: bus type thunderbolt registered [ 1.791862] Initialise system trusted keyrings [ 1.791872] Key type blacklist registered [ 1.791914] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 1.793545] zbud: loaded [ 1.862896] integrity: Platform Keyring initialized [ 1.862901] integrity: Machine keyring initialized [ 1.870955] NET: Registered PF_ALG protocol family [ 1.870957] xor: automatically using best checksumming function avx [ 1.870958] Key type asymmetric registered [ 1.870959] Asymmetric key parser 'x509' registered [ 1.870960] Running certificate verification selftests [ 1.872376] Loaded X.509 cert 'Certificate verification self-testing key: f58703bb33ce1b73ee02eccdee5b8817518fe3db' [ 1.873930] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 246) [ 1.873952] io scheduler mq-deadline registered [ 1.873953] io scheduler kyber registered [ 1.873981] io scheduler bfq registered [ 1.912421] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 1.912755] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 1.912906] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 1.913055] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 1.913189] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 1.913343] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 1.913485] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 1.913644] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 1.913719] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 1.921122] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 1.921142] ACPI: button: Power Button [PWRB] [ 1.921164] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 1.921195] ACPI: button: Power Button [PWRF] [ 1.929848] ERST: Error Record Serialization Table (ERST) support is initialized. [ 1.929850] pstore: Registered erst as persistent store backend [ 1.929955] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 1.930042] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 1.937203] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 1.945777] Non-volatile memory driver v1.3 [ 1.954111] rdac: device handler registered [ 1.954138] hp_sw: device handler registered [ 1.954138] emc: device handler registered [ 1.954157] alua: device handler registered [ 1.954436] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 1.954499] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 1 [ 1.954512] ehci-pci 0000:00:1d.0: debug port 2 [ 1.958447] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 1.966953] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 1.966997] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 1.966999] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.967000] usb usb1: Product: EHCI Host Controller [ 1.967001] usb usb1: Manufacturer: Linux 5.14.0-437.el9.x86_64 ehci_hcd [ 1.967002] usb usb1: SerialNumber: 0000:00:1d.0 [ 1.967090] hub 1-0:1.0: USB hub found [ 1.967093] hub 1-0:1.0: 2 ports detected [ 1.967225] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 1.967252] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2 [ 1.968346] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 1.968556] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 1.968556] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 1.968604] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 4 [ 1.968606] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 1.968607] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 1.968625] ehci-pci 0000:00:1a.0: debug port 2 [ 1.968637] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 1.968639] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.968640] usb usb2: Product: xHCI Host Controller [ 1.968641] usb usb2: Manufacturer: Linux 5.14.0-437.el9.x86_64 xhci-hcd [ 1.968642] usb usb2: SerialNumber: 0000:00:14.0 [ 1.968729] hub 2-0:1.0: USB hub found [ 1.968759] hub 2-0:1.0: 15 ports detected [ 1.970495] usb usb3: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.14 [ 1.970497] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.970498] usb usb3: Product: xHCI Host Controller [ 1.970499] usb usb3: Manufacturer: Linux 5.14.0-437.el9.x86_64 xhci-hcd [ 1.970499] usb usb3: SerialNumber: 0000:00:14.0 [ 1.970585] hub 3-0:1.0: USB hub found [ 1.970601] hub 3-0:1.0: 6 ports detected [ 1.971525] usbcore: registered new interface driver usbserial_generic [ 1.971529] usbserial: USB Serial support registered for generic [ 1.971552] i8042: PNP: No PS/2 controller found. [ 1.971580] mousedev: PS/2 mouse device common for all mice [ 1.971640] rtc_cmos 00:00: RTC can wake from S4 [ 1.971958] rtc_cmos 00:00: registered as rtc0 [ 1.972010] rtc_cmos 00:00: setting system clock to 2024-04-25T22:54:51 UTC (1714085691) [ 1.972039] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 1.972537] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 1.980809] intel_pstate: Intel P-state driver initializing [ 1.980931] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 1.980960] usb usb4: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 1.980962] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.980963] usb usb4: Product: EHCI Host Controller [ 1.980964] usb usb4: Manufacturer: Linux 5.14.0-437.el9.x86_64 ehci_hcd [ 1.980965] usb usb4: SerialNumber: 0000:00:1a.0 [ 1.981043] hub 4-0:1.0: USB hub found [ 1.981047] hub 4-0:1.0: 2 ports detected [ 2.034905] hid: raw HID events driver (C) Jiri Kosina [ 2.034949] usbcore: registered new interface driver usbhid [ 2.034949] usbhid: USB HID core driver [ 2.034995] drop_monitor: Initializing network drop monitor service [ 2.043949] Initializing XFRM netlink socket [ 2.044039] NET: Registered PF_INET6 protocol family [ 2.056564] Freeing initrd memory: 33136K [ 2.060891] Segment Routing with IPv6 [ 2.060915] NET: Registered PF_PACKET protocol family [ 2.060943] mpls_gso: MPLS GSO support [ 2.071778] microcode: Current revision: 0x0b00001b [ 2.088337] resctrl: L3 allocation detected [ 2.088338] resctrl: L3 monitoring detected [ 2.088351] IPI shorthand broadcast: enabled [ 2.088355] AVX2 version of gcm_enc/dec engaged. [ 2.141998] AES CTR mode by8 optimization enabled [ 2.142034] sched_clock: Marking stable (998708433, 1143212095)->(2546097593, -404177065) [ 2.150356] registered taskstats version 1 [ 2.166987] Loading compiled-in X.509 certificates [ 2.167469] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: ac928bd9444a4e48f0eddf90defda693df54cc67' [ 2.167749] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 2.168027] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 2.168169] Loaded X.509 cert 'RH-IMA-CA: Red Hat IMA CA: fb31825dd0e073685b264e3038963673f753959a' [ 2.168178] Loaded X.509 cert 'Nvidia GPU OOT signing 001: 55e1cef88193e60419f0b0ec379c49f77545acf0' [ 2.168364] zswap: loaded using pool lzo/zbud [ 2.175101] page_owner is disabled [ 2.175280] pstore: Using crash dump compression: deflate [ 2.175292] Key type big_key registered [ 2.206955] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 2.217925] usb 2-12: new high-speed USB device number 2 using xhci_hcd [ 2.224701] usb 4-1: new high-speed USB device number 2 using ehci-pci [ 2.307647] Key type encrypted registered [ 2.307655] ima: No TPM chip found, activating TPM-bypass! [ 2.307659] Loading compiled-in module X.509 certificates [ 2.307948] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: ac928bd9444a4e48f0eddf90defda693df54cc67' [ 2.307951] ima: Allocated hash algorithm: sha256 [ 2.307960] ima: No architecture policies found [ 2.307968] evm: Initialising EVM extended attributes: [ 2.307968] evm: security.selinux [ 2.307969] evm: security.SMACK64 (disabled) [ 2.307969] evm: security.SMACK64EXEC (disabled) [ 2.307970] evm: security.SMACK64TRANSMUTE (disabled) [ 2.307970] evm: security.SMACK64MMAP (disabled) [ 2.307970] evm: security.apparmor (disabled) [ 2.307971] evm: security.ima [ 2.307971] evm: security.capability [ 2.307972] evm: HMAC attrs: 0x1 [ 2.335239] usb 1-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 2.335241] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.335405] hub 1-1:1.0: USB hub found [ 2.335491] hub 1-1:1.0: 8 ports detected [ 2.344130] usb 2-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 2.344133] usb 2-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.344635] hub 2-12:1.0: USB hub found [ 2.344714] hub 2-12:1.0: 4 ports detected [ 2.373242] usb 4-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 2.373244] usb 4-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.373400] hub 4-1:1.0: USB hub found [ 2.373495] hub 4-1:1.0: 6 ports detected [ 2.640926] usb 2-12.1: new low-speed USB device number 3 using xhci_hcd [ 2.744199] usb 2-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 2.744201] usb 2-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.749143] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.0/0003:0557:2419.0001/input/input2 [ 2.780942] tsc: Refined TSC clocksource calibration: 3499.996 MHz [ 2.780946] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734d20948, max_idle_ns: 440795306379 ns [ 2.784875] clocksource: Switched to clocksource tsc [ 2.801036] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 2.803659] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.1/0003:0557:2419.0002/input/input3 [ 2.803712] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 5.294160] Freeing unused decrypted memory: 2028K [ 5.294653] Freeing unused kernel image (initmem) memory: 3928K [ 5.305966] Write protecting the kernel read-only data: 28672k [ 5.306166] Freeing unused kernel image (rodata/data gap) memory: 500K [ 5.354811] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.354812] x86/mm: Checking user space page tables [ 5.391529] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.391541] Run /init as init process Welcome to [0[ 5.404658] systemd[1]: systemd 252-32.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 5.404755] systemd[1]: Detected architecture x86-64. [ 5.404756] systemd[1]: Running in initrd. ;31mCentOS Stream 9 dracut-057-53.git20240104.el9 (Initramfs)! [ 5.456040] systemd[1]: Hostname set to . [ OK [[ 5.515401] systemd[1]: Queued start job for default target Initrd Default Target. [ 5.515512] systemd[1]: Reached target Initrd /usr File System. 0m] Reached target Initrd /usr File System. [ OK [[ 5.537030] systemd[1]: Reached target Local File Systems. 0m] Reached target Local File Systems. [ OK [[ 5.551072] systemd[1]: Reached target Slice Units. 0m] Reached target Slice Units. [ OK [[ 5.562990] systemd[1]: Reached target Swaps. 0m] Reached target Swaps. [ OK [[ 5.573989] systemd[1]: Reached target Timer Units. 0m] Reached target Timer Units. [ OK [[ 5.586126] systemd[1]: Listening on D-Bus System Message Bus Socket. 0m] Listening on D-Bus System Message Bus Socket. [ OK [[ 5.601059] systemd[1]: Listening on Journal Socket (/dev/log). 0m] Listening on Journal Socket (/dev/log). [ OK [[ 5.615191] systemd[1]: Listening on Journal Socket. 0m] Listening on Journal Socket. [ OK [[ 5.627061] systemd[1]: Listening on udev Control Socket. 0m] Listening on udev Control Socket. [ OK [[ 5.641066] systemd[1]: Listening on udev Kernel Socket. 0m] Listening on udev Kernel Socket. [ OK [[ 5.654013] systemd[1]: Reached target Socket Units. 0m] Reached target Socket Units. Startin[ 5.672618] systemd[1]: Starting Create List of Static Device Nodes... g Create List of Static Device Nodes... Startin[ 5.688012] systemd[1]: Starting Journal Service... g Journal Service... Startin[ 5.700085] systemd[1]: Load Kernel Modules was skipped because no trigger condition checks were met. [ 5.700636] systemd[1]: Starting Apply Kernel Variables... g Apply Kernel Variables... Startin[ 5.722513] systemd[1]: Starting Create System Users... g Create System Users... Startin[ 5.735771] systemd[1]: Starting Setup Virtual Console... g Setup Virtual Console... [ OK [[ 5.748857] systemd[1]: Started Journal Service. 0m] Started Journal Service. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... Starting Create Volatile Files and Directories... [ OK ] Finished Setup Virtual Console. [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Finished Create Volatile Files and Directories. Starting dracut cmdline hook... [ OK ] Finished dracut cmdline hook. Starting dracut pre-udev hook... [ OK ] Finished dracut pre-udev hook. Starting Rule-based Manage…for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. Starting Coldplug All udev Devices... [ OK ] Finished Coldplug All udev Devices. [ OK ] Reached target System Initialization. [ OK ] Reached target Network. Starting dracut initqueue hook... Starting Show [ 6.164910] dca service started, version 1.12.1 Plymouth Boot Screen... [ OK ] Started Show Plymouth Boot Screen. [ [ 6.207152] igb: Intel(R) Gigabit Ethernet Network Driver OK ] Starte[ 6.207155] igb: Copyright (c) 2007-2014 Intel Corporation. d Forwa[ 6.207550] nvme nvme0: pci function 0000:02:00.0 rd Password R…[ 6.223657] nvme nvme0: 8/0/0 default/read/poll queues s to Plymouth Directory Watch. [ OK ] Reached target Path Units. [ OK ] Reached target Basic System. [ 6.255255] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [ 6.255256] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 6.255308] ACPI: bus type drm_connector registered [ 6.255354] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 6.255358] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 6.262067] igb 0000:07:00.0: added PHC on eth0 [ 6.262093] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 6.262094] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:34:f4 [ 6.262174] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 6.262175] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.265176] scsi host0: ahci [ 6.265305] scsi host1: ahci [ 6.265406] scsi host2: ahci [ 6.265488] scsi host3: ahci [ 6.265521] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 53 lpm-pol 0 [ 6.265523] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 53 lpm-pol 0 [ 6.265526] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 53 lpm-pol 0 [ 6.265528] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 53 lpm-pol 0 [ 6.265753] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 6.265756] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 6.280342] scsi host4: ahci [ 6.280443] scsi host5: ahci [ 6.280639] scsi host6: ahci [ 6.280735] scsi host7: ahci [ 6.280890] scsi host8: ahci [ 6.281634] scsi host9: ahci [ 6.281680] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 63 lpm-pol 0 [ 6.281682] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 63 lpm-pol 0 [ 6.281686] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 63 lpm-pol 0 [ 6.281688] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 63 lpm-pol 0 [ 6.281692] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 63 lpm-pol 0 [ 6.281695] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 63 lpm-pol 0 [ 6.315437] igb 0000:07:00.1: added PHC on eth1 [ 6.315468] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Netwo0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:34:f5 [ 6.315555] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 6.315556] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.316832] igb 0000:07:00.1 eno2: renamed from eth1 [ 6.317247] ast 0000:06:00.0: vgaarb: deactivate vga console [ 6.326167] Console: switching to colour dummy device 80x25 [ 6.326303] ast 0000:06:00.0: [drm] Using P2A bridge for configuration [ 6.326304] ast 0000:06:00.0: [drm] AST 2400 detected [ 6.326314] ast 0000:06:00.0: [drm] Using analog VGA [ 6.326320] ast 0000:06:00.0: [drm] dram MCLK=408 Mhz type=1 bus_width=16 [ 6.326502] [drm] Initialized ast 0.1.0 20120228 for 0000:06:00.0 on minor 0 [ 6.333832] fbcon: astdrmfb (fb0) is primary device [ 6.333916] igb 0000:07:00.0 eno1: renamed from eth0 [ 6.358551] Console: switching to colour frame buffer device 128x48 [ 6.378110] ast 0000:06:00.0: [drm] fb0: astdrmfb frame buffer device [ 6.570085] ata4: SATA link down (SStatus 0 SControl 300) [ 6.570512] ata1: SATA link down (SStatus 0 SControl 300) [ 6.572326] ata3: SATA link down (SStatus 0 SControl 300) [ 6.583046] ata2: SATA link down (SStatus 0 SControl 300) [ 6.586034] ata10: SATA link down (SStatus 0 SCont6.586336] ata9: s 0 SControl 300 ata7: SATA link down (SStatus 0 SControl 300) [ 6.586437] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 6.587177] ata8: SATA link down (SStatus 0 SControl 300) [ 6.587889] ata6: SATA link down (SStatus 0 SControl 300) [ 6.635499] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 6.636023] ata5.00: NCQ Send/Recv Log not supported [ 6.636024] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 6.637513] ata5.00: NCQ Send/Recv Log not supported [ 6.637517] ata5.00: configured for UDMA/133 [ 6.637633] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 6.716039] scsi 4:0:0:0: Attached scsi generic sg0 type 0 [ 6.751095] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 6.751108] sd 4:0:0:0: [sda] Write Protect is off [ 6.751130] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 6.751151] sd 4:0:0:0: [sda] Preferred minimum I/O size 512 bytes [ 6.771472] sda: sda1 [ 6.771527] sd 4:0:0:0: [sda] Attached SCSI disk [ OK ] Found device ST1000NM0033-9ZM173 1. [ OK ] Reached target Initrd Root Device. [ 7.410278] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.410567] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.410649] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 7.410650] ixgbe 0000:03:00.0: 0c:c4:7a:88:73:f2 [ 7.413913] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 7.571240] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.571528] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.571610] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 7.571611] ixgbe 0000:03:00.1: 0c:c4:7a:88:73:f3 [ 7.574849] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 7.583148] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ 7.615782] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ OK ] Finished dracut initqueue hook. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting File System Check…6d2c-4093-809e-dd42758f0c27... [ OK ] Finished File System Check…5-6d2c-4093-809e-dd42758f0c27. Mounting /sysroot... [ 7.861476] EXT4-fs (sda1): mounted filesystem a494b625-6d2c-4093-809e-dd42758f0c27 ro with ordered data mode. Quota mode: none. [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Mountpoints Configured in the Real Root... [ OK ] Finished Mountpoints Configured in the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Finished dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped target Network. [ OK ] Stopped target Timer Units. [ OK ] Closed D-Bus System Message Bus Socket. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Basic System. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Initrd /usr File System. [ OK ] Stopped target Path Units. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Preparation for Remote File Systems. [ OK ] Stopped target Slice Units. [ OK ] Stopped target Socket Units. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Swaps. [ OK ] Stopped dracut initqueue hook. Starting Plymouth switch root service... [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped Coldplug All udev Devices. Stopping Rule-based Manage…for Device Events and Files... [ OK ] Finished Cleaning Up and Shutting Down Daemons. [ OK ] Stopped Rule-based Manager for Device Events and Files. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. Starting Cleanup udev Database... [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create List of Static Device Nodes. [ OK ] Stopped Create System Users. [ OK ] Finished Cleanup udev Database. [ OK ] Reached target Switch Root. [ OK ] Finished Plymouth switch root service. Starting Switch Root... [ 8.198171] systemd-journald[282]: Received SIGTERM from PID 1 (systemd). [ 8.705980] SELinux: policy capability network_peer_controls=1 [ 8.705983] SELinux: policy capability open_perms=1 [ 8.705984] SELinux: policy capability extended_socket_class=1 [ 8.705984] SELinux: policy capability always_check_network=0 [ 8.705985] SELinux: policy capability cgroup_seclabel=1 [ 8.705985] SELinux: policy capability nnp_nosuid_transition=1 [ 8.705986] SELinux: policy capability genfs_seclabel_symlinks=1 [ 8.749973] audit: type=1403 audit(1714085698.277:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 [ 8.753703] systemd[1]: Successfully loaded SELinux policy in 116.043ms. [ 8.824953] systemd[1]: Relabelled /dev, /dev/shm, /run, /sys/fs/cgroup in 25.464ms. [ 8.833719] systemd[1]: systemd 252-32.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 8.833824] systemd[1]: Detected architecture x86-64. [ 8.869078] systemd[1]: Hostname set to . Welcome to CentOS Stream 9! [ 9.851813] systemd[1]: initrd-switch-root.service: Deactivated successfully. [ OK [[ 9.851912] systemd[1]: Stopped Switch Root. [ 9.859353] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 9.859678] systemd[1]: Created slice Slice /system/getty. [ 9.860035] systemd[1]: Created slice Slice /system/modprobe. [ 9.865300] systemd[1]: Created slice Slice /system/serial-getty. [ 9.874158] systemd[1]: Created slice Slice /system/sshd-keygen. [ 9.879658] systemd[1]: Created slice User and Session Slice. 0m] Stopped [0;[ 9.885003] systemd[1]: Dispatch Password Requests to Console Directory Watch was skipped because of an unmet condition check (ConditionPathExists=!/run/plymouth/pid). [ 9.885139] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ 9.891527] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. [ 9.897117] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ 9.902838] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. 1;39mSwitch Root[ 9.956862] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. [ 9.956893] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ 9.956913] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ 9.956950] systemd[1]: Reached target ceph target allowing to start/stop all ceph-rbd-mirror@.service instances at once. . [[ 10.000464] systemd[1]: Reached target Local Encrypted Volumes. [ 10.000500] systemd[1]: Stopped target Switch Root. [ 10.000519] systemd[1]: Stopped target Initrd File Systems. [ 10.000532] systemd[1]: Stopped target Initrd Root File System. [ 10.000561] systemd[1]: Reached target Local Integrity Protected Volumes. [ 10.000597] systemd[1]: Reached target Path Units. [ 10.000626] systemd[1]: Reached target Slice Units. [ 10.000649] systemd[1]: Reached target Swaps. [ 10.000668] systemd[1]: Reached target Local Verity Protected Volumes. [ 10.001070] systemd[1]: Listening on Device-mapper event daemon FIFOs. OK ] Created slice Slice /system/getty. [ OK [ 10.063474] systemd[1]: Listening on LVM2 poll daemon socket. ] Created slice Slice /system/modprobe. [ OK ] Created slice Slice /system/[ 10.078175] systemd[1]: Listening on RPCbind Server Activation Socket. [ 10.078217] systemd[1]: Reached target RPC Port Mapper. [ 10.079493] systemd[1]: Listening on Process Core Dump Socket. serial-getty[ 10.098106] systemd[1]: Listening on initctl Compatibility Named Pipe. [ 10.098537] systemd[1]: Listening on udev Control Socket. [ 10.098781] systemd[1]: Listening on udev Kernel Socket. [ 10.099596] systemd[1]: Mounting Huge Pages File System... . [ OK[ 10.122847] systemd[1]: Mounting POSIX Message Queue File System... [ 10.123658] systemd[1]: Mounting Kernel Debug File System... ] Created slice S[ 10.136217] systemd[1]: Mounting Kernel Trace File System... [ 10.136350] systemd[1]: Kernel Module supporting RPCSEC_GSS was skipped because of an unmet condition check (ConditionPathExists=/etc/krb5.keytab). lice /system/sshd-keygen. [ OK ] Created slice User and Session Slice. [ OK ] Started Forward Password R…uests to Wall Directory Watch. [ OK ] Set up automount Arbitrary\xe2[ 10.178125] systemd[1]: Starting Create List of Static Device Nodes... [ 10.178955] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... \x80\xa6s File System [ 10.196767] systemd[1]: Starting Load Kernel Module configfs... [ 10.197545] systemd[1]: Starting Load Kernel Module drm... Automount Point[ 10.209556] systemd[1]: Starting Load Kernel Module fuse... [ 10.211186] systemd[1]: Starting Read and set NIS domainname from /etc/sysconfig/network... [0m. [ [ 10.215828] systemd[1]: plymouth-switch-root.service: Deactivated successfully. [ 10.215874] systemd[1]: Stopped Plymouth switch root service. [ 10.224304] systemd[1]: Stopped Journal Service. OK ] Reach[ 10.243727] systemd[1]: Starting Journal Service... [ 10.246065] systemd[1]: Starting Load Kernel Modules... ed target ceph target\xe2\x80[ 10.255418] systemd[1]: Starting Generate network units from Kernel command line... [ 10.255463] systemd[1]: TPM2 PCR Machine ID Measurement was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/StubPcrKernelImage-4a67b082-0a4c-41cf-b6c7-440b29bb8c4f). [ 10.256272] systemd[1]: Starting Remount Root and Kernel File Systems... [ 10.283653] systemd[1]: Repartition Root Disk was skipped because no trigger condition checks were met. \xa6on@.service ins[ 10.284838] systemd[1]: Starting Coldplug All udev Devices... [ 10.300742] systemd[1]: Started Journal Service. tances at once. [ OK ] Reached target ceph target…ds@.service instances at once. [ OK ] Reached target ceph target…gr@.service insta[ 10.326488] EXT4-fs (sda1): re-mounted a494b625-6d2c-4093-809e-dd42758f0c27 r/w. Quota mode: none. nces at once. [ OK ] Reached target ceph target…sd@.service instances at once. [ OK ] Reached target ceph target…gw@.service instances at once. [ OK ] Reached target ceph target…or@.service instances at once. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd File Systems. [ OK ] Stopped target Initrd Root File System. [ OK ] Reached target Local Integrity Protected Volumes. [ OK ] Reached target Pa[ 10.397884] systemd-journald[575]: Received client request to flush runtime journal. th Units. [ OK ] Reached target Slice Units. [ OK ] Reached target Swaps. [ OK ] Reached target Local Verity Protected Volumes. [ OK ] Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on LVM2 poll daemon socket. [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. [ OK ] Listening on Process Core Dump Socket. [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Listening on udev Control Socket. [ OK ] Listening on udev Kernel Socket. Mounting Huge Pages File System... Mounting POSIX Message Queue File System... Mounting Kernel Debug File System... Mounting Kernel Trace File System... Starting Create List of Static Device Nodes... Starting Monitoring of LVM…meventd or progress polling... Starting Load Kernel Module configfs... Starting Load Kernel Module drm... Starting Load Kernel Module fuse... Starting Read and set NIS …from /etc/sysconfig/network... [ OK ] Stopped Plymouth switch root service. [ OK ] Stopped Journal Service.[ 10.546386] fuse: init (API version 7.36) Starting Journal Service... Starting Load Kernel Modules... Starting Generate network …ts from Kernel command line... Star[ 10.568217] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. [ 10.568236] device-mapper: uevent: version 1.0.3 [ 10.568296] device-mapper: ioctl: 4.48.0-ioctl (2023-03-01) initialised: dm-devel@redhat.com ting Remount Root and Kernel File Systems... Starting Coldplug All udev Devices... [ OK ] Started Journal Service. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Kernel Trace File System. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Read and set NIS …e from /etc/sysconfig/network. [ OK ] Finished Generate network units from Kernel command line. [ OK ] Reached target Preparation for Network. [ OK ] Finished Remount Root and Kernel File Systems. Starting Flush Journal to Persistent Storage... Starting Load/Save OS Random Seed... Starting Create Static Device Nodes in /dev... [ OK ] Finished Flush Journal to Persistent Storage. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Module configfs. Mounting Kernel Configuration File System... [ OK ] Finished Coldplug All udev Devices. [ OK ] Mounted Kernel Configuration File System. [ OK ] Finished Load/Save OS Random Seed. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Load Kernel Modules. Mounting FUSE Control File System... Starting Apply Kernel Variables... [ OK ] Mounted FUSE Control File System. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Monitoring of LVM… dmeventd or progress polling. [ OK ] Finished Create Static Device Nodes in /dev. Starting Rule-based Manage…for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. [ OK ] Reached target Preparation for Local File Systems. [ OK ] Reached target Local File Systems. Starting Tell Plymouth To Write Out Runtime Data... Starting Automatic Boot Loader Update... Starting Create Volatile Files and Directories... Starting Load Kernel Module configfs... [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Tell Plymouth To Write Out Runtime Data. [ OK ] Finished Automatic Boot Loader Update. [ 10.928139] ioatdma: Intel(R) QuickData Technology Driver 5.00 [ 10.942516] igb 0000:07:00.0: DCA enabled [ 10.942543] igb 0000:07:00.1: DCA enabled [ 10.991075] mei_me 0000:00:16.0: Device doesn't have valid ME Interface [ 11.016108] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer [ 11.016111] RAPL PMU: hw unit of domain package 2^-14 Joules [ 11.016112] RAPL PMU: hw unit of domain dram 2^-16 Joules [ 11.045382] input: PC Speaker as /devices/platform/pcspkr/input/input4 [ OK ] Started /usr/sbin/lvm vgch…-autoactivation event vg_nvme. [ 11.064665] iTCO_vendor_support: vendor-support=0 [ 11.064690] IPMI message handler: version 39.2 [ 11.076033] iTCO_wdt iTCO_wdt.1.auto: Found a Wellsburg TCO device (Version=2, TCOBASE=0x0460) [ 11.076444] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) [ 11.077179] power_meter ACPI000D:00: Found ACPI power meter. [ 11.077208] power_meter ACPI000D:00: Ignoring unsafe software power cap! [ 11.077215] power_meter ACPI000D:00: hwmon_device_register() is deprecated. Please convert the driver to use hwmon_device_register_with_info(). [ 11.093377] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 11.094417] i2c i2c-3: 2/8 memory slots populated (from DMI) [ 11.094420] i2c i2c-3: Systems with more than 4 memory slots not supported yet, not instantiating SPD [ 11.098882] ipmi device interface [ OK ] Found device /dev/vg_nvme/lv_5. [ 11.241753] ipmi_si: IPMI System Interface driver [ 11.241771] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS [ 11.241772] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 [ 11.241774] ipmi_si: Adding SMBIOS-specified kcs state machine [ 11.241830] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI [ 11.241916] ipmi_si IPI0001:00: ipmi_platform: [io 0x0ca2] regsize 1 spacing 1 irq 0 [ 11.242895] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI [ 11.242897] ipmi_si: Adding ACPI-specified kcs state machine [ 11.242975] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 [ OK ] Finished Create Volatile Files and Directories. Starting Security Auditing Service... Starting RPC Bind... Mounting /var/lib/ceph... Mounting RPC Pipe File System... [ 11.356927] ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. [ 11.369866] EDAC MC0: Giving out device to module sb_edac controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT) [ 11.369868] EDAC sbridge: Ver: 1.1.2 [ 11.386597] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x0833, dev_id: 0x20) [ 11.427876] ipmi_si IPI0001:00: IPMI kcs interface initialized [ 11.438520] ipmi_ssif: IPMI SSIF Interface driver [ 11.440130] RPC: Registered named UNIX socket transport module. [ 11.440131] RPC: Registered udp transport module. [ OK [[ 11.440131] RPC: Registered tcp transport module. 0m] Mounted [0;[ 11.440132] RPC: Registered tcp-with-tls transport module. 1;39mRPC Pipe Fi[ 11.440132] RPC: Registered tcp NFSv4.1 backchannel transport module. le System. [ 11.467928] intel_rapl_common: Found RAPL domain package [ 11.467934] intel_rapl_common: Found RAPL domain dram [ OK ] Reached target rpc_pipefs.target. [ OK ] Started RPC Bind. [ 11.661489] SGI XFS with ACLs, security attributes, scrub, quota, no debug enabled [ 11.670231] XFS (dm-4): Deprecated V4 format (crc=0) will not be supported after September 2030. [ OK [[ 11.670328] XFS (dm-4): Mounting V4 Filesystem 82bb6fc0-59b1-432f-bcef-30577bea3db2 [ 11.674543] XFS (dm-4): Ending clean mount [ 11.674582] xfs filesystem being mounted at /var/lib/ceph supports timestamps until 2038 (0x7fffffff) 0m] Mounted /var/lib/ceph. [ OK ] Started Security Auditing Service. Starting Record System Boot/Shutdown in UTMP... [ OK ] Finished Record System Boot/Shutdown in UTMP. [ OK ] Reached target System Initialization. [ OK ] Started Daily rotation of log files. [ OK ] Started Updates mlocate database every day. [ OK ] Started Run system activit…ounting tool every 10 minutes. [ OK ] Started Generate summary o…esterday's process accounting. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Reached target Timer Units. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Listening on SSSD Kerberos…ache Manager responder socket. [ OK ] Reached target Socket Units. Starting D-Bus System Message Bus... [ OK ] Started D-Bus System Message Bus. [ OK ] Reached target Basic System. Starting Network Manager... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target…h*@.service instances at once. Starting NTP client/server... Starting Restore /run/initramfs on shutdown... [ OK ] Started irqbalance daemon. [ OK ] Started libstoragemgmt plug-in server daemon. [ OK ] Started Machine Check Exception Logging Daemon. Starting Self Monitoring a…g Technology (SMART) Daemon... [ OK ] Reached target sshd-keygen.target. [ OK ] Reached target User and Group Name Lookups. Starting Resets System Activity Logs... Starting User Login Management... [ OK ] Finished Restore /run/initramfs on shutdown. [ OK ] Started User Login Management. [ OK ] Finished Resets System Activity Logs. [ OK ] Started NTP client/server. [ OK ] Started Self Monitoring an…ing Technology (SMART) Daemon. Starting Hostname Service... [ OK ] Started Hostname Service. [ OK ] Listening on Load/Save RF …itch Status /dev/rfkill Watch. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ 13.463984] ixgbe 0000:03:00.0: registered PHC device on enp3s0f0 [ 13.623488] ixgbe 0000:03:00.1: registered PHC device on enp3s0f1 [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting Network Manager Wait Online... Starting GSSAPI Proxy Daemon... Starting OpenSSH server daemon... [ 13.849005] ixgbe 0000:03:00.1 enp3s0f1: detected SFP+: 4 [ OK ] Started OpenSSH server daemon. [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Finished Permit User Sessions. [ OK ] Started Deferred execution scheduler. [ OK ] S[ 14.038023] ixgbe 0000:03:00.1 enp3s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX [ 14.038150] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f1: link becomes ready tarted Command Scheduler. [* ] A start job is running for Network Manager Wait Online (6s / no limit) M [** ] A start job is running for Network Manager Wait Online (7s / no limit) M [*** ] A start job is running for Network Manager Wait Online (7s / no limit) M [ *** ] A start job is running for Network Manager Wait Online (8s / no limit) M [ *** ] A start job is running for Network Manager Wait Online (8s / no limit) M [ ***] A start job is running for Network Manager Wait Online (9s / no limit) M [ **] A start job is running for Network Manager Wait Online (9s / no limit) M [ OK ] Finished Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Crash recovery kernel arming... [ OK ] Started Nagios Remote Plugin Executor. Starting /etc/rc.d/rc.local Compatibility... Starting Notify NFS peers of a restart... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' Starting System Logging Service... [ OK ] Started Notify NFS peers of a restart. + myips=172.21.15.164 + attempts=1 + sleep 1 [ OK ] Started System Logging Service. Starting SETroubleshoot da…ing new SELinux denial logs... [ 21.541478] block sda: the capability attribute has been deprecated. + '[' 172.21.15.164 '!=' '' ']' + set -e + '[' -n 172.21.15.164 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.164 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.164 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' + newhostname=smithi164.front.sepia.ceph.com + '[' -n smithi164.front.sepia.ceph.com ']' + hostname smithi164.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi164 + echo smithi164 + grep -q front.sepia.ceph.com /etc/hosts + sed -i '1i172.21.15.164 smithi164.front.sepia.ceph.com smithi164\' /etc/hosts + break + command -v zypper + command -v apt-get + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.d/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... CentOS Stream 9 Kernel 5.14.0-437.el9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2024-04-25T22:55:17.662 DEBUG:teuthology.orchestra.console.smithi164:expect after: smithi164 login: 2024-04-25T22:55:17.716 DEBUG:teuthology.orchestra.console.smithi164:console disconnect output: [Enter `^Ec?' for help] \x80 \x80 \x80  el(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Initializing Intel(R) Boot Agent XE v2.1.60 Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.72 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 88 73 F3 GUID: 00000000 0000 0000 0000 0CC47AD934F4 DHCP.|                    DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| CLIENT IP: 172.21.15.164 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 95D3:0070, entry point at 95D3:0106  UNDI code segment 95D3:3E70, data segment 8E94:73F0 (570-615kB)  UNDI device is PCI 03:00.1, type DIX+802.3  570kB free base memory after PXE unload iPXE initialising devices... iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:88:73:f3)... Configuring (net0 0c:c4:7a:88:73:f3).... Configuring (net0 0c:c4:7a:88:73:f3)..... Configuring (net0 0c:c4:7a:88:73:f3)...... ok .   [?25lUse the ^ and v keys to change the selection. Press 'e' to edit the selected item, or 'c' for a command prompt.   CentOS Stream (5.14.0-437.el9.x86_64) 9  CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-7fc8828e06d0482694bcf4a447d13cb6) 9                The selected entry will be started automatically in 5s.             Use the * and * keys to change the selection.  Press 'e' to edit the selected item, or 'c' for a command prompt.  The selected entry will be started automatically in 5s.   CentOS Stream (5.14.0-437.el9.x86_64) 9   CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-7fc8828e06d0482694bcf4a447d13cb6) 9  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 0s. [?25h      [ 0.000000] Linux version 5.14.0-437.el9.x86_64 (mockbuild@x86-05.stream.rdu2.redhat.com) (gcc (GCC) 11.4.1 20231218 (Red Hat 11.4.1-3), GNU ld version 2.35.2-43.el9) #1 SMP PREEMPT_DYNAMIC Tue Apr 9 12:57:02 UTC 2024 [ 0.000000] The list of certified hardware and cloud instances for Red Hat Enterprise Linux 9 can be viewed at the Red Hat Ecosystem Catalog, https://catalog.redhat.com. [ 0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-437.el9.x86_64 root=UUID=a494b625-6d2c-4093-809e-dd42758f0c27 ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008abff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ec5fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f78000-0x00000000798a7fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798a8000-0x0000000079d44fff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d45000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] APIC: Static calls initialized [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0a 08/02/2016 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.983 MHz processor [ 0.000409] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000412] MTRR map: 5 entries (3 fixed + 2 variable; max 23), built from 10 variable MTRRs [ 0.000414] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000743] last_pfn = 0x78ec6 max_arch_pfn = 0x400000000 [ 0.006422] found SMP MP-table at [mem 0x000fcd40-0x000fcd4f] [ 0.006430] Using GB pages for direct mapping [ 0.006542] RAMDISK: [mem 0x33f38000-0x35f93fff] [ 0.006545] ACPI: Early table checksum verification disabled [ 0.006548] ACPI: RSDP 0x00000000000F05B0 000024 (v02 SUPERM) [ 0.006551] ACPI: XSDT 0x00000000798A80A0 0000BC (v01 01072009 AMI 00010013) [ 0.006555] ACPI: FACP 0x00000000798DB838 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006559] ACPI: DSDT 0x00000000798A81F0 033641 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.006562] ACPI: FACS 0x0000000079D43F80 000040 [ 0.006564] ACPI: APIC 0x00000000798DB948 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006566] ACPI: FPDT 0x00000000798DBA10 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006569] ACPI: FIDT 0x00000000798DBA58 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006571] ACPI: SPMI 0x00000000798DBAF8 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.006573] ACPI: MCFG 0x00000000798DBB38 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.006576] ACPI: UEFI 0x00000000798DBB78 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.006578] ACPI: HPET 0x00000000798DBBC0 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006580] ACPI: WDDT 0x00000000798DBBF8 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.006582] ACPI: SSDT 0x00000000798DBC38 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.006585] ACPI: NITR 0x00000000798F2DB8 000071 (v02 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006587] ACPI: SSDT 0x00000000798F2E30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.006589] ACPI: SSDT 0x00000000798F5480 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.006592] ACPI: PRAD 0x00000000798F54E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.006594] ACPI: DMAR 0x00000000798F55F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006596] ACPI: HEST 0x00000000798F56B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006599] ACPI: BERT 0x00000000798F5930 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006601] ACPI: ERST 0x00000000798F5960 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006603] ACPI: EINJ 0x00000000798F5B90 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006605] ACPI: Reserving FACP table memory at [mem 0x798db838-0x798db943] [ 0.006606] ACPI: Reserving DSDT table memory at [mem 0x798a81f0-0x798db830] [ 0.006607] ACPI: Reserving FACS table memory at [mem 0x79d43f80-0x79d43fbf] [ 0.006607] ACPI: Reserving APIC table memory at [mem 0x798db948-0x798dba0f] [ 0.006608] ACPI: Reserving FPDT table memory at [mem 0x798dba10-0x798dba53] [ 0.006609] ACPI: Reserving FIDT table memory at [mem 0x798dba58-0x798dbaf3] [ 0.006609] ACPI: Reserving SPMI table memory at [mem 0x798dbaf8-0x798dbb37] [ 0.006610] ACPI: Reserving MCFG table memory at [mem 0x798dbb38-0x798dbb73] [ 0.006610] ACPI: Reserving UEFI table memory at [mem 0x798dbb78-0x798dbbb9] [ 0.006611] ACPI: Reserving HPET table memory at [mem 0x798dbbc0-0x798dbbf7] [ 0.006612] ACPI: Reserving WDDT table memory at [mem 0x798dbbf8-0x798dbc37] [ 0.006612] ACPI: Reserving SSDT table memory at [mem 0x798dbc38-0x798f2db6] [ 0.006613] ACPI: Reserving NITR table memory at [mem 0x798f2db8-0x798f2e28] [ 0.006613] ACPI: Reserving SSDT table memory at [mem 0x798f2e30-0x798f547b] [ 0.006614] ACPI: Reserving SSDT table memory at [mem 0x798f5480-0x798f54e3] [ 0.006615] ACPI: Reserving PRAD table memory at [mem 0x798f54e8-0x798f55e9] [ 0.006615] ACPI: Reserving DMAR table memory at [mem 0x798f55f0-0x798f56ab] [ 0.006616] ACPI: Reserving HEST table memory at [mem 0x798f56b0-0x798f592b] [ 0.006616] ACPI: Reserving BERT table memory at [mem 0x798f5930-0x798f595f] [ 0.006617] ACPI: Reserving ERST table memory at [mem 0x798f5960-0x798f5b8f] [ 0.006618] ACPI: Reserving EINJ table memory at [mem 0x798f5b90-0x798f5cbf] [ 0.006663] No NUMA configuration found [ 0.006664] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.006672] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.006870] Reserving 256MB of memory at 1664MB for crashkernel (System RAM: 32654MB) [ 0.006906] Zone ranges: [ 0.006906] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.006908] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.006909] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.006910] Device empty [ 0.006911] Movable zone start for each node [ 0.006913] Early memory node ranges [ 0.006913] node 0: [mem 0x0000000000001000-0x0000000000089fff] [ 0.006914] node 0: [mem 0x0000000000100000-0x0000000078ec5fff] [ 0.006915] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.006919] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.006924] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.006961] On node 0, zone DMA: 118 pages in unavailable ranges [ 0.011998] On node 0, zone Normal: 28986 pages in unavailable ranges [ 0.012108] ACPI: PM-Timer IO Port: 0x408 [ 0.012117] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.012118] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.012118] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.012119] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.012119] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.012120] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.012121] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.012121] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.012130] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.012134] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.012136] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.012138] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.012141] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.012142] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.012146] [Firmware Bug]: TSC_DEADLINE disabled due to Errata; please update microcode to version: 0xb000020 (or later) [ 0.012147] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.012157] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.012158] PM: hibernation: Registered nosave memory: [mem 0x0008a000-0x000dffff] [ 0.012159] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.012160] PM: hibernation: Registered nosave memory: [mem 0x78ec6000-0x78f77fff] [ 0.012161] PM: hibernation: Registered nosave memory: [mem 0x78f78000-0x798a7fff] [ 0.012161] PM: hibernation: Registered nosave memory: [mem 0x798a8000-0x79d44fff] [ 0.012162] PM: hibernation: Registered nosave memory: [mem 0x79d45000-0x8fffffff] [ 0.012162] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.012163] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.012163] PM: hibernation: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.012164] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.012165] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.012166] Booting paravirtualized kernel on bare hardware [ 0.012168] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.016494] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.016716] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u262144 [ 0.016741] Fallback order for Node 0: 0 [ 0.016743] Built 1 zonelists, mobility grouping on. Total pages: 8228746 [ 0.016744] Policy zone: Normal [ 0.016745] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-437.el9.x86_64 root=UUID=a494b625-6d2c-4093-809e-dd42758f0c27 ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.016802] Unknown kernel command line parameters "BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-437.el9.x86_64", will be passed to user space. [ 0.016818] random: crng init done [ 0.018991] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.020125] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.020372] mem auto-init: stack:off, heap alloc:off, heap free:off [ 0.020380] software IO TLB: area num 8. [ 0.048291] Memory: 1750180K/33438012K available (16384K kernel code, 5628K rwdata, 11788K rodata, 3928K init, 5908K bss, 989180K reserved, 0K cma-reserved) [ 0.048391] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.048399] Kernel/User page tables isolation: enabled [ 0.048422] ftrace: allocating 46993 entries in 184 pages [ 0.066742] ftrace: allocated 184 pages with 4 groups [ 0.067255] Dynamic Preempt: voluntary [ 0.067284] rcu: Preemptible hierarchical RCU implementation. [ 0.067285] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.067286] Trampoline variant of Tasks RCU enabled. [ 0.067286] Rude variant of Tasks RCU enabled. [ 0.067287] Tracing variant of Tasks RCU enabled. [ 0.067287] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.067288] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.070518] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.070680] rcu: srcu_init: Setting srcu_struct sizes based on contention. [ 0.070787] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) [ 0.076003] Console: colour VGA+ 80x25 [ 1.112996] printk: console [ttyS1] enabled [ 1.117187] ACPI: Core revision 20230331 [ 1.121281] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.130409] APIC: Switch to symmetric I/O mode setup [ 1.135378] DMAR: Host address width 46 [ 1.139223] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.144539] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.152542] DMAR: RMRR base: 0x0000007ba6e000 end: 0x0000007ba7dfff [ 1.158808] DMAR: ATSR flags: 0x0 [ 1.162128] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.168394] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.174746] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.181100] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.186500] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.186500] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.201514] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.206816] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.213044] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.223408] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x327340b30a0, max_idle_ns: 440795302655 ns [ 1.233921] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.96 BogoMIPS (lpj=3499983) [ 1.234940] CPU0: Thermal monitoring enabled (TM1) [ 1.235974] process: using mwait in idle threads [ 1.236922] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.237920] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.238922] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.239921] Spectre V2 : Mitigation: Retpolines [ 1.240920] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.241920] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.242921] Speculative Store Bypass: Vulnerable [ 1.243926] MDS: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.244920] TAA: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.245920] MMIO Stale Data: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.246923] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.247920] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.248920] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.249921] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.250920] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.263438] Freeing SMP alternatives memory: 36K [ 1.263921] pid_max: default: 32768 minimum: 301 [ 1.264939] LSM: initializing lsm=lockdown,capability,yama,integrity,selinux,bpf [ 1.265925] Yama: becoming mindful. [ 1.266924] SELinux: Initializing. [ 1.267936] LSM support for eBPF active [ 1.269972] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.270958] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.374872] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.376018] cblist_init_generic: Setting adjustable number of callback queues. [ 1.376920] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.377932] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.378930] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.379929] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.380921] ... version: 3 [ 1.381920] ... bit width: 48 [ 1.382920] ... generic registers: 4 [ 1.383920] ... value mask: 0000ffffffffffff [ 1.384920] ... max period: 00007fffffffffff [ 1.385920] ... fixed-purpose events: 3 [ 1.386921] ... event mask: 000000070000000f [ 1.388004] signal: max sigframe size: 1776 [ 1.388931] Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.389946] rcu: Hierarchical SRCU implementation. [ 1.389947] rcu: Max phase no-delay instances is 400. [ 1.389955] printk: console [ttyS1] printing thread started [ 1.394527] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.394593] smp: Bringing up secondary CPUs ... [ 1.394661] smpboot: x86: Booting SMP configuration: [ 1.394662] .... node #0, CPUs: #1 #2 #3 #4 #5 #6 #7 [ 1.400180] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.400180] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.400180] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.400180] smp: Brought up 1 node, 8 CPUs [ 1.400180] smpboot: Max logical packages: 1 [ 1.400180] smpboot: Total of 8 processors activated (55999.72 BogoMIPS) [ 1.449941] node 0 deferred pages initialised in 42ms [ 1.451920] devtmpfs: initialized [ 1.451960] x86/mm: Memory block size: 128MB [ 1.453703] ACPI: PM: Registering ACPI NVS region [mem 0x798a8000-0x79d44fff] (4837376 bytes) [ 1.453703] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 1.453703] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.453703] pinctrl core: initialized pinctrl subsystem [ 1.470811] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.470900] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 1.470911] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.470919] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.470928] audit: initializing netlink subsys (disabled) [ 1.471922] audit: type=2000 audit(1714085689.258:1): state=initialized audit_enabled=0 res=1 [ 1.471922] thermal_sys: Registered thermal governor 'fair_share' [ 1.471922] thermal_sys: Registered thermal governor 'step_wise' [ 1.471922] thermal_sys: Registered thermal governor 'user_space' [ 1.480922] cpuidle: using governor menu [ 1.487948] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.487949] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.488001] PCI: ECAM [mem 0x80000000-0x8fffffff] (base 0x80000000) for domain 0000 [bus 00-ff] [ 1.488004] PCI: ECAM [mem 0x80000000-0x8fffffff] reserved as E820 entry [ 1.488012] PCI: Using configuration type 1 for base access [ 1.498948] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.498952] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages [ 1.498952] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page [ 1.498952] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages [ 1.498952] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page [ 1.505946] cryptd: max_cpu_qlen set to 1000 [ 1.513713] ACPI: Added _OSI(Module Device) [ 1.513714] ACPI: Added _OSI(Processor Device) [ 1.513715] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.513715] ACPI: Added _OSI(Processor Aggregator Device) [ 1.513716] ACPI: Added _OSI(Linux-Dell-Video) [ 1.513716] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.513717] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.545750] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.547946] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.550011] ACPI: Dynamic OEM Table Load: [ 1.570175] ACPI: _OSC evaluated successfully for all CPUs [ 1.570440] ACPI: Interpreter enabled [ 1.570449] ACPI: PM: (supports S0 S4 S5) [ 1.570450] ACPI: Using IOAPIC for interrupt routing [ 1.571964] HEST: Enabling Firmware First mode for corrected errors. [ 1.608939] HEST: Table parsing has been initialized. [ 1.609059] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.609061] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.609062] PCI: Using E820 reservations for host bridge windows [ 1.609505] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.637209] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.637215] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.638825] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.639613] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.639614] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.639647] PCI host bridge to bus 0000:ff [ 1.639649] pci_bus 0000:ff: root bus resource [bus ff] [ 1.639662] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 conventional PCI endpoint [ 1.639716] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 conventional PCI endpoint [ 1.639756] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 conventional PCI endpoint [ 1.639793] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 conventional PCI endpoint [ 1.639830] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 conventional PCI endpoint [ 1.639867] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 conventional PCI endpoint [ 1.639903] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 conventional PCI endpoint [ 1.639942] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 conventional PCI endpoint [ 1.639978] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 conventional PCI endpoint [ 1.640012] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 conventional PCI endpoint [ 1.640049] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 conventional PCI endpoint [ 1.640083] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 conventional PCI endpoint [ 1.640119] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 conventional PCI endpoint [ 1.640155] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 conventional PCI endpoint [ 1.640190] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 conventional PCI endpoint [ 1.640227] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 conventional PCI endpoint [ 1.640261] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 conventional PCI endpoint [ 1.640296] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 conventional PCI endpoint [ 1.640331] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 conventional PCI endpoint [ 1.640357] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 conventional PCI endpoint [ 1.640401] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.640463] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.640518] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.640568] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.640617] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.640665] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.640714] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 conventional PCI endpoint [ 1.640751] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 conventional PCI endpoint [ 1.640789] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.640839] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.640889] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.640941] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.640989] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 conventional PCI endpoint [ 1.641026] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 conventional PCI endpoint [ 1.641065] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 conventional PCI endpoint [ 1.641102] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x00 conventional PCI endpoint [ 1.641143] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.641193] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.641243] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.641294] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.641346] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 conventional PCI endpoint [ 1.641387] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 conventional PCI endpoint [ 1.641429] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 conventional PCI endpoint [ 1.641468] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 conventional PCI endpoint [ 1.641509] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 conventional PCI endpoint [ 1.641548] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 conventional PCI endpoint [ 1.641582] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 conventional PCI endpoint [ 1.641613] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 conventional PCI endpoint [ 1.641646] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 conventional PCI endpoint [ 1.641675] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 contional PCI endpoint [ 1.641705] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 conventional PCI endpoint [ 1.641734] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 conventional PCI endpoint [ 1.641755] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 conventional PCI endpoint [ 1.641786] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 conventional PCI endpoint [ 1.641818] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 conventional PCI endpoint [ 1.644044] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 1.644047] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.644182] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.644422] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.644423] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.644828] PCI host bridge to bus 0000:00 [ 1.644829] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 1.644830] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 1.644831] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 1.644832] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 1.644833] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 1.644834] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 1.644835] pci_bus 0000:00: root bus resource [bus 00-fe] [ 1.644853] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 PCIe Root Port [ 1.644957] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 PCIe Root Port [ 1.644969] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.645004] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 1.645095] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 PCIe Root Port [ 1.645107] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.645110] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.645143] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 1.645230] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 PCIe Root Port [ 1.645242] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.645244] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.645245] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.645249] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.645279] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 1.645360] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.645368] pci 0000:00:04.0: BAR 0 [mem 0xfb42c000-0xfb42ffff 64bit] [ 1.645442] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.645449] pci 0000:00:04.1: BAR 0 [mem 0xfb428000-0xfb42bfff 64bit] [ 1.645522] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.645529] pci 0000:00:04.2: BAR 0 [mem 0xfb424000-0xfb427fff 64bit] [ 1.645603] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.645610] pci 0000:00:04.3: BAR 0 [mem 0xfb420000-0xfb423fff 64bit] [ 1.645682] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.645689] pci 0000:00:04.4: BAR 0 [mem 0xfb41c000-0xfb41ffff 64bit] [ 1.645761] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.645768] pci 0000:00:04.5: BAR 0 [mem 0xfb418000-0xfb41bfff 64bit] [ 1.645840] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.645847] pci 0000:00:04.6: BAR 0 [mem 0xfb414000-0xfb417fff 64bit] .7: [8086:6f27] omplex Integrated Endpoint [ 1.645932] pci 0000:00:04.7: BAR 0 [mem 0xfb410000-0xfb413fff 64bit] [ 1.646005] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.646065] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.646147] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.646203] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 PCIe Root Complex Integrated Endpoint [ 1.646208] pci 0000:00:05.4: BAR 0 [mem 0xfb439000-0xfb439fff] [ 1.646289] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 PCIe Root Complex Integrated Endpoint [ 1.646526] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 conventional PCI endpoint [ 1.646547] pci 0000:00:11.4: BAR 0 [io 0xf110-0xf117] [ 1.646558] pci 0000:00:1103] [ 1.646 [io 0xf0f0-0xf1.4: BAR 3 [io 0xf0e0-0xf0e3] [ 1.646592] pci 0000:00:11.4: BAR 4 [io 0xf020-0xf03f] [ 1.646603] pci 0000:00:11.4: BAR 5 [mem 0xfb438000-0xfb4387ff] [ 1.646661] pci 0000:00:11.4: PME# supported from D3hot [ 1.646738] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 conventional PCI endpoint [ 1.646761] pci 0000:00:14.0: BAR 0 [mem 0xfb400000-0xfb40ffff 64bit] [ 1.646847] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 1.646933] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 conventional PCI endpoint [ 1.646957] pci 0000:00:16.0: BAR 0 [mem 0xfb437000-0xfb43700f 64bit] [ 1.647044] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 1.647111] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 conventional PCI endpoint [ 1.647136] pci 0000:00:16.1: BAR 0 [mem 0xfb436000-0xfb43600f 64bit] [ 1.647222] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 1.647303] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 conventional Ppci 0000:00:1a.0: BAR 0 [mem 0xfb434000-0xfb4343ff] [ 1.647438] pci 0000:00:E# supported from D0 D3hot D3cold [ 1.647517] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 PCIe Root Port [ 1.647554] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.647644] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 1.647746] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 PCIe Root Port [ 1.647783] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.647787] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.647790] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.647878] pci 0000:00:1c.2: PME# supported from Dt D3cold [ 1.647976] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 PCIe Root Port [ 1.648016] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.648021] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.648025] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.648114] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 1.648217] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 conventional PCI endpoint [ 1.648238] pci 0000:00:1d.0: BAR 0 [mem 0xfb433000-0xfb4333ff] [ 1.648355] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 1.648434] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 conventional PCI endpoint [ 1.648639] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 conventional PCI endpoint [ 1.648657] pci 0000:00:1f.2: BAR 0 [io 0xf070-0xf077] [ 1.648667] pci 0000:00:1f.2: BAR 1 [io 0xf060-0xf063] [ 1.648678] pci 0000:00:1f.2: BAR 2 [io 0xf050-0xf057] [ 1.648688] pci 0000:00:1f.2: BAR 3 [io 0xf040-0xf043] [ 1.648699] pci 0000:00:1f.2: BAR 4 [io 0xf000-0xf01f] [ 1.648709] pci 0000:00:1f.2: BAR 5 [mem 0xfb432000-0xfb4327ff] [ 1.648761] pci 0000:00:1f.2: PME# supported from D3hot [ 1.648823] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 conventional PCI endpoint [ 1.648845] pci 0000:00:1f.3: BAR 0 [mem 0xfb431000-0xfb4310ff 64bit] [ 1.648875] pci 0000:00:1f.3: BAR 4 [io 0x0580-0x059f] [ 1.649036] acpiphp: Slot [1] registered [ 1.649047] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.649153] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 PCIe Endpoint [ 1.649162] pci 0000:02:00.0: BAR 0 [mem 0xfb310000-0xfb313fff 64bit] [ 1.649178] pci 0000:02:00.0: ROM [mem 0xfb300000-0xfb30ffff pref] [ 1.649182] pci 0000:02:00.0: enabling Extended Tags [ 1.649283] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.649388] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.649398] pci 0000:03:00.0: BAR 0 [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 1.649403] pci 0000:03:00.0: BAR 2 [io 0xe020-0xe03f] [ 1.649413] pci 0000:03:00.0: BAR 4 [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 1.649417] pci 0000:03:00.0: ROM [mem 0xfb280000-0xfb2fffff pref] [ 1.649452] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 1.649469] pci 0000:03:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.649470] pci 0000:03:00.0: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.649479] pci 0000:03:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.649480] pci 0000:03:00.0: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.649630] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.649640] pci 0000:03:00.1: BAR 0 [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 1.649645] pci 0000:03:00.1: BAR 2 [io 0xe000-0xe01f] [ 1.649655] pci 0000:03:00.1: BAR 4 [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 1.649659] pci 0000:03:00.1: ROM [mem 0xfb200000-0xfb27ffff pref] [ 1.649695] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 1.649708] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.649709] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.649718] pci 0000:03:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.649718] pci 0000:03:00.1: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.649856] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.649901] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.649995] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 PCIe to PCI/PCI-X bridge [ 1.650068] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.650081] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.650086] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.650139] pci 0000:05:00.0: enabling Extended Tags [ 1.650270] pci 0000:05:00.0: supports D1 D2 [ 1.650271] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.650447] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.650534] pci_bus 0000:06: extended config space not accessible [ 1.650567] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 conventional PCI endpoint [ 1.650603] pci 0000:06:00.0: BAR 0 [mem 0xfa000000-0xfaffffff] [ 1.650623] pci 0000:06:00.0: BAR 1 [mem 0xfb000000-0xfb01ffff] [ 1.650643] pci 0000:06:00.0: BAR 2 [io 0xd000-0xd07f] [ 1.650741] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 1.650811] pci 0000:06:00.0: supports D1 D2 [ 1.650812] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.650962] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.651106] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 PCIe Endpoint [ 1.651138] pci 0000:07:00.0: BAR 0 [mem 0xfb120000-0xfb13ffff] [ 1.651175] pci 0000:07:00.0: BAR 2 [io 0xc020-0xc03f] [ 1.651193] pci 0000:07:00.0: BAR 3 [mem 0xfb144000-0xfb147fff] [ 1.651417] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 1.651477] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.651478] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.651511] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.651512] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.651837] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 PCIe Endpoint [ 1.651869] pci 0000:07:00.1: BAR 0 [mem 0xfb100000-0xfb11ffff] [ 1.651905] pci 0000:07:00.1: BAR 2 [io 0xc000-0xc01f] [ 1.651924] pci 0000:07:00.1: BAR 3 [mem 0xfb140000-0xfb143fff] [ 1.652135] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 1.652196] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.652197] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.652230] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.652230] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.652523] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.652536] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 1.653205] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 1.653236] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 1.653265] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 1.653295] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 1.653325] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 1.653326] ACPI: PCI: Interrupt link LNKE disabled [ 1.653355] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 1.653355] ACPI: PCI: Interrupt link LNKF disabled [ 1.653385] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 1.653385] ACPI: PCI: Interrupt link LNKG disabled [ 1.653415] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 1.653415] ACPI: PCI: Interrupt link LNKH disabled [ 1.653931] iommu: Default domain type: Translated [ 1.653931] iommu: DMA domain TLB invalidation policy: lazy mode [ 1.654000] SCSI subsystem initialized [ 1.654015] ACPI: bus type USB registered [ 1.654025] usbcore: registered new interface driver usbfs [ 1.654030] usbcore: registered new interface driver hub [ 1.654035] usbcore: registered new device driver usb [ 1.654054] pps_core: LinuxPPS API ver. 1 registered [ 1.654055] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 1.654056] PTP clock support registered [ 1.654070] EDAC MC: Ver: 3.0.0 [ 1.654086] NetLabel: Initializing [ 1.654087] NetLabel: domain hash size = 128 [ 1.654087] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 1.654100] NetLabel: unlabeled traffic allowed by default [ 1.654101] PCI: Using ACPI for IRQ routing [ 1.664943] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 1.664944] pci 0000:06:00.0: vgaarb: bridge control possible [ 1.664945] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 1.664946] vgaarb: loaded [ 1.664953] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 1.664956] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 1.672964] clocksource: Switched to clocksource tsc-early [ 1.683937] VFS: Disk quotas dquot_6.6.0 [ 1.683949] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 1.684012] pnp: PnP ACPI init [ 1.684337] system 00:01: [io 0x0500-0x057f] has been reserved [ 1.684339] system 00:01: [io 0x0400-0x047f] has been reserved [ 1.684340] system 00:01: [io 0x0580-0x059f] has been reserved [ 1.684341] system 00:01: [io 0x0600-0x061f] has been reserved [ 1.684342] system 00:01: [io 0x0880-0x0883] has been reserved [ 1.684343] system 00:01: [io 0x0800-0x081f] has been reserved [ 1.684344] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 1.684345] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 1.684346] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 1.684347] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 1.684348] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 1.684349] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 1.684351] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 1.684500] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 1.684501] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 1.684502] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 1.684502] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 1.684503] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 1.685186] pnp: PnP ACPI: found 5 devices [ 1.690653] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 1.690693] NET: Registered PF_INET protocol family [ 1.690862] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.693148] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 1.693179] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 1.693190] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.693426] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 1.693533] TCP: Hash tables configured (established 262144 bind 65536) [ 1.693654] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear) [ 1.693739] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 1.693796] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 1.693875] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 1.693880] NET: Registered PF_XDP protocol family [ 1.693902] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 1.693912] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref]: assigned [ 1.693914] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.693925] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.693927] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.693933] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.693934] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.693935] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.693936] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.693938] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.693938] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.693940] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.693940] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.693942] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.693943] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.693944] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.693945] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.693946] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.693947] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.693948] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.693949] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.693950] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.693951] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.693953] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.693954] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.693958] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.693971] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.693973] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.693981] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.693997] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.693999] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.694005] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.694014] pci 0000:07:00.0: VF BAR 0 [mem 0x90000000-0x9001ffff 64bit pref]: assigned [ 1.694020] pci 0000:07:00.0: VF BAR 3 [mem 0x90020000-0x9003ffff 64bit pref]: assigned [ 1.694026] pci 0000:07:00.1: VF BAR 0 [mem 0x90040000-0x9005ffff 64bit pref]: assigned [ 1.694032] pci 0000:07:00.1: VF BAR 3 [mem 0x90060000-0x9007ffff 64bit pref]: assigned [ 1.694038] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.694040] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.694045] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.694048] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 1.694054] pci_bus 0000:00: Some PCI device resources are unassigned, try booting with pci=realloc [ 1.694055] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 1.694056] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 1.694057] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 1.694058] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 1.694059] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 1.694060] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 1.694061] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 1.694062] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 1.694062] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 1.694063] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.694064] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 1.694065] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.694066] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 1.694067] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.694068] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 1.694068] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 1.694069] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 1.694229] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 1.709966] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x140 took 15201 usecs [ 1.728523] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x140 took 18106 usecs [ 1.728538] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 1.728584] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 1.728585] software IO TLB: mapped [mem 0x0000000064000000-0x0000000068000000] (64MB) [ 1.728588] Trying to unpack rootfs image as initramfs... [ 1.728592] ACPI: bus type thunderbolt registered [ 1.791862] Initialise system trusted keyrings [ 1.791872] Key type blacklist registered [ 1.791914] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 1.793545] zbud: loaded [ 1.862896] integrity: Platform Keyring initialized [ 1.862901] integrity: Machine keyring initialized [ 1.870955] NET: Registered PF_ALG protocol family [ 1.870957] xor: automatically using best checksumming function avx [ 1.870958] Key type asymmetric registered [ 1.870959] Asymmetric key parser 'x509' registered [ 1.870960] Running certificate verification selftests [ 1.872376] Loaded X.509 cert 'Certificate verification self-testing key: f58703bb33ce1b73ee02eccdee5b8817518fe3db' [ 1.873930] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 246) [ 1.873952] io scheduler mq-deadline registered [ 1.873953] io scheduler kyber registered [ 1.873981] io scheduler bfq registered [ 1.912421] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 1.912755] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 1.912906] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 1.913055] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 1.913189] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 1.913343] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 1.913485] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 1.913644] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 1.913719] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 1.921122] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 1.921142] ACPI: button: Power Button [PWRB] [ 1.921164] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 1.921195] ACPI: button: Power Button [PWRF] [ 1.929848] ERST: Error Record Serialization Table (ERST) support is initialized. [ 1.929850] pstore: Registered erst as persistent store backend [ 1.929955] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 1.930042] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 1.937203] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 1.945777] Non-volatile memory driver v1.3 [ 1.954111] rdac: device handler registered [ 1.954138] hp_sw: device handler registered [ 1.954138] emc: device handler registered [ 1.954157] alua: device handler registered [ 1.954436] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 1.954499] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 1 [ 1.954512] ehci-pci 0000:00:1d.0: debug port 2 [ 1.958447] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 1.966953] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 1.966997] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 1.966999] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.967000] usb usb1: Product: EHCI Host Controller [ 1.967001] usb usb1: Manufacturer: Linux 5.14.0-437.el9.x86_64 ehci_hcd [ 1.967002] usb usb1: SerialNumber: 0000:00:1d.0 [ 1.967090] hub 1-0:1.0: USB hub found [ 1.967093] hub 1-0:1.0: 2 ports detected [ 1.967225] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 1.967252] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2 [ 1.968346] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 1.968556] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 1.968556] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 1.968604] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 4 [ 1.968606] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 1.968607] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 1.968625] ehci-pci 0000:00:1a.0: debug port 2 [ 1.968637] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 1.968639] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.968640] usb usb2: Product: xHCI Host Controller [ 1.968641] usb usb2: Manufacturer: Linux 5.14.0-437.el9.x86_64 xhci-hcd [ 1.968642] usb usb2: SerialNumber: 0000:00:14.0 [ 1.968729] hub 2-0:1.0: USB hub found [ 1.968759] hub 2-0:1.0: 15 ports detected [ 1.970495] usb usb3: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.14 [ 1.970497] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.970498] usb usb3: Product: xHCI Host Controller [ 1.970499] usb usb3: Manufacturer: Linux 5.14.0-437.el9.x86_64 xhci-hcd [ 1.970499] usb usb3: SerialNumber: 0000:00:14.0 [ 1.970585] hub 3-0:1.0: USB hub found [ 1.970601] hub 3-0:1.0: 6 ports detected [ 1.971525] usbcore: registered new interface driver usbserial_generic [ 1.971529] usbserial: USB Serial support registered for generic [ 1.971552] i8042: PNP: No PS/2 controller found. [ 1.971580] mousedev: PS/2 mouse device common for all mice [ 1.971640] rtc_cmos 00:00: RTC can wake from S4 [ 1.971958] rtc_cmos 00:00: registered as rtc0 [ 1.972010] rtc_cmos 00:00: setting system clock to 2024-04-25T22:54:51 UTC (1714085691) [ 1.972039] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 1.972537] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 1.980809] intel_pstate: Intel P-state driver initializing [ 1.980931] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 1.980960] usb usb4: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 1.980962] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.980963] usb usb4: Product: EHCI Host Controller [ 1.980964] usb usb4: Manufacturer: Linux 5.14.0-437.el9.x86_64 ehci_hcd [ 1.980965] usb usb4: SerialNumber: 0000:00:1a.0 [ 1.981043] hub 4-0:1.0: USB hub found [ 1.981047] hub 4-0:1.0: 2 ports detected [ 2.034905] hid: raw HID events driver (C) Jiri Kosina [ 2.034949] usbcore: registered new interface driver usbhid [ 2.034949] usbhid: USB HID core driver [ 2.034995] drop_monitor: Initializing network drop monitor service [ 2.043949] Initializing XFRM netlink socket [ 2.044039] NET: Registered PF_INET6 protocol family [ 2.056564] Freeing initrd memory: 33136K [ 2.060891] Segment Routing with IPv6 [ 2.060915] NET: Registered PF_PACKET protocol family [ 2.060943] mpls_gso: MPLS GSO support [ 2.071778] microcode: Current revision: 0x0b00001b [ 2.088337] resctrl: L3 allocation detected [ 2.088338] resctrl: L3 monitoring detected [ 2.088351] IPI shorthand broadcast: enabled [ 2.088355] AVX2 version of gcm_enc/dec engaged. [ 2.141998] AES CTR mode by8 optimization enabled [ 2.142034] sched_clock: Marking stable (998708433, 1143212095)->(2546097593, -404177065) [ 2.150356] registered taskstats version 1 [ 2.166987] Loading compiled-in X.509 certificates [ 2.167469] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: ac928bd9444a4e48f0eddf90defda693df54cc67' [ 2.167749] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 2.168027] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 2.168169] Loaded X.509 cert 'RH-IMA-CA: Red Hat IMA CA: fb31825dd0e073685b264e3038963673f753959a' [ 2.168178] Loaded X.509 cert 'Nvidia GPU OOT signing 001: 55e1cef88193e60419f0b0ec379c49f77545acf0' [ 2.168364] zswap: loaded using pool lzo/zbud [ 2.175101] page_owner is disabled [ 2.175280] pstore: Using crash dump compression: deflate [ 2.175292] Key type big_key registered [ 2.206955] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 2.217925] usb 2-12: new high-speed USB device number 2 using xhci_hcd [ 2.224701] usb 4-1: new high-speed USB device number 2 using ehci-pci [ 2.307647] Key type encrypted registered [ 2.307655] ima: No TPM chip found, activating TPM-bypass! [ 2.307659] Loading compiled-in module X.509 certificates [ 2.307948] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: ac928bd9444a4e48f0eddf90defda693df54cc67' [ 2.307951] ima: Allocated hash algorithm: sha256 [ 2.307960] ima: No architecture policies found [ 2.307968] evm: Initialising EVM extended attributes: [ 2.307968] evm: security.selinux [ 2.307969] evm: security.SMACK64 (disabled) [ 2.307969] evm: security.SMACK64EXEC (disabled) [ 2.307970] evm: security.SMACK64TRANSMUTE (disabled) [ 2.307970] evm: security.SMACK64MMAP (disabled) [ 2.307970] evm: security.apparmor (disabled) [ 2.307971] evm: security.ima [ 2.307971] evm: security.capability [ 2.307972] evm: HMAC attrs: 0x1 [ 2.335239] usb 1-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 2.335241] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.335405] hub 1-1:1.0: USB hub found [ 2.335491] hub 1-1:1.0: 8 ports detected [ 2.344130] usb 2-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 2.344133] usb 2-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.344635] hub 2-12:1.0: USB hub found [ 2.344714] hub 2-12:1.0: 4 ports detected [ 2.373242] usb 4-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 2.373244] usb 4-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.373400] hub 4-1:1.0: USB hub found [ 2.373495] hub 4-1:1.0: 6 ports detected [ 2.640926] usb 2-12.1: new low-speed USB device number 3 using xhci_hcd [ 2.744199] usb 2-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 2.744201] usb 2-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.749143] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.0/0003:0557:2419.0001/input/input2 [ 2.780942] tsc: Refined TSC clocksource calibration: 3499.996 MHz [ 2.780946] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734d20948, max_idle_ns: 440795306379 ns [ 2.784875] clocksource: Switched to clocksource tsc [ 2.801036] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 2.803659] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.1/0003:0557:2419.0002/input/input3 [ 2.803712] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 5.294160] Freeing unused decrypted memory: 2028K [ 5.294653] Freeing unused kernel image (initmem) memory: 3928K [ 5.305966] Write protecting the kernel read-only data: 28672k [ 5.306166] Freeing unused kernel image (rodata/data gap) memory: 500K [ 5.354811] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.354812] x86/mm: Checking user space page tables [ 5.391529] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.391541] Run /init as init process Welcome to [0[ 5.404658] systemd[1]: systemd 252-32.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 5.404755] systemd[1]: Detected architecture x86-64. [ 5.404756] systemd[1]: Running in initrd. ;31mCentOS Stream 9 dracut-057-53.git20240104.el9 (Initramfs)! [ 5.456040] systemd[1]: Hostname set to . [ OK [[ 5.515401] systemd[1]: Queued start job for default target Initrd Default Target. [ 5.515512] systemd[1]: Reached target Initrd /usr File System. 0m] Reached target Initrd /usr File System. [ OK [[ 5.537030] systemd[1]: Reached target Local File Systems. 0m] Reached target Local File Systems. [ OK [[ 5.551072] systemd[1]: Reached target Slice Units. 0m] Reached target Slice Units. [ OK [[ 5.562990] systemd[1]: Reached target Swaps. 0m] Reached target Swaps. [ OK [[ 5.573989] systemd[1]: Reached target Timer Units. 0m] Reached target Timer Units. [ OK [[ 5.586126] systemd[1]: Listening on D-Bus System Message Bus Socket. 0m] Listening on D-Bus System Message Bus Socket. [ OK [[ 5.601059] systemd[1]: Listening on Journal Socket (/dev/log). 0m] Listening on Journal Socket (/dev/log). [ OK [[ 5.615191] systemd[1]: Listening on Journal Socket. 0m] Listening on Journal Socket. [ OK [[ 5.627061] systemd[1]: Listening on udev Control Socket. 0m] Listening on udev Control Socket. [ OK [[ 5.641066] systemd[1]: Listening on udev Kernel Socket. 0m] Listening on udev Kernel Socket. [ OK [[ 5.654013] systemd[1]: Reached target Socket Units. 0m] Reached target Socket Units. Startin[ 5.672618] systemd[1]: Starting Create List of Static Device Nodes... g Create List of Static Device Nodes... Startin[ 5.688012] systemd[1]: Starting Journal Service... g Journal Service... Startin[ 5.700085] systemd[1]: Load Kernel Modules was skipped because no trigger condition checks were met. [ 5.700636] systemd[1]: Starting Apply Kernel Variables... g Apply Kernel Variables... Startin[ 5.722513] systemd[1]: Starting Create System Users... g Create System Users... Startin[ 5.735771] systemd[1]: Starting Setup Virtual Console... g Setup Virtual Console... [ OK [[ 5.748857] systemd[1]: Started Journal Service. 0m] Started Journal Service. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... Starting Create Volatile Files and Directories... [ OK ] Finished Setup Virtual Console. [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Finished Create Volatile Files and Directories. Starting dracut cmdline hook... [ OK ] Finished dracut cmdline hook. Starting dracut pre-udev hook... [ OK ] Finished dracut pre-udev hook. Starting Rule-based Manage…for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. Starting Coldplug All udev Devices... [ OK ] Finished Coldplug All udev Devices. [ OK ] Reached target System Initialization. [ OK ] Reached target Network. Starting dracut initqueue hook... Starting Show [ 6.164910] dca service started, version 1.12.1 Plymouth Boot Screen... [ OK ] Started Show Plymouth Boot Screen. [ [ 6.207152] igb: Intel(R) Gigabit Ethernet Network Driver OK ] Starte[ 6.207155] igb: Copyright (c) 2007-2014 Intel Corporation. d Forwa[ 6.207550] nvme nvme0: pci function 0000:02:00.0 rd Password R…[ 6.223657] nvme nvme0: 8/0/0 default/read/poll queues s to Plymouth Directory Watch. [ OK ] Reached target Path Units. [ OK ] Reached target Basic System. [ 6.255255] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [ 6.255256] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 6.255308] ACPI: bus type drm_connector registered [ 6.255354] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 6.255358] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 6.262067] igb 0000:07:00.0: added PHC on eth0 [ 6.262093] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 6.262094] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:34:f4 [ 6.262174] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 6.262175] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.265176] scsi host0: ahci [ 6.265305] scsi host1: ahci [ 6.265406] scsi host2: ahci [ 6.265488] scsi host3: ahci [ 6.265521] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 53 lpm-pol 0 [ 6.265523] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 53 lpm-pol 0 [ 6.265526] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 53 lpm-pol 0 [ 6.265528] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 53 lpm-pol 0 [ 6.265753] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 6.265756] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 6.280342] scsi host4: ahci [ 6.280443] scsi host5: ahci [ 6.280639] scsi host6: ahci [ 6.280735] scsi host7: ahci [ 6.280890] scsi host8: ahci [ 6.281634] scsi host9: ahci [ 6.281680] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 63 lpm-pol 0 [ 6.281682] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 63 lpm-pol 0 [ 6.281686] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 63 lpm-pol 0 [ 6.281688] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 63 lpm-pol 0 [ 6.281692] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 63 lpm-pol 0 [ 6.281695] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 63 lpm-pol 0 [ 6.315437] igb 0000:07:00.1: added PHC on eth1 [ 6.315468] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Netwo0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:34:f5 [ 6.315555] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 6.315556] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.316832] igb 0000:07:00.1 eno2: renamed from eth1 [ 6.317247] ast 0000:06:00.0: vgaarb: deactivate vga console [ 6.326167] Console: switching to colour dummy device 80x25 [ 6.326303] ast 0000:06:00.0: [drm] Using P2A bridge for configuration [ 6.326304] ast 0000:06:00.0: [drm] AST 2400 detected [ 6.326314] ast 0000:06:00.0: [drm] Using analog VGA [ 6.326320] ast 0000:06:00.0: [drm] dram MCLK=408 Mhz type=1 bus_width=16 [ 6.326502] [drm] Initialized ast 0.1.0 20120228 for 0000:06:00.0 on minor 0 [ 6.333832] fbcon: astdrmfb (fb0) is primary device [ 6.333916] igb 0000:07:00.0 eno1: renamed from eth0 [ 6.358551] Console: switching to colour frame buffer device 128x48 [ 6.378110] ast 0000:06:00.0: [drm] fb0: astdrmfb frame buffer device [ 6.570085] ata4: SATA link down (SStatus 0 SControl 300) [ 6.570512] ata1: SATA link down (SStatus 0 SControl 300) [ 6.572326] ata3: SATA link down (SStatus 0 SControl 300) [ 6.583046] ata2: SATA link down (SStatus 0 SControl 300) [ 6.586034] ata10: SATA link down (SStatus 0 SCont6.586336] ata9: s 0 SControl 300 ata7: SATA link down (SStatus 0 SControl 300) [ 6.586437] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 6.587177] ata8: SATA link down (SStatus 0 SControl 300) [ 6.587889] ata6: SATA link down (SStatus 0 SControl 300) [ 6.635499] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 6.636023] ata5.00: NCQ Send/Recv Log not supported [ 6.636024] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 6.637513] ata5.00: NCQ Send/Recv Log not supported [ 6.637517] ata5.00: configured for UDMA/133 [ 6.637633] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 6.716039] scsi 4:0:0:0: Attached scsi generic sg0 type 0 [ 6.751095] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 6.751108] sd 4:0:0:0: [sda] Write Protect is off [ 6.751130] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 6.751151] sd 4:0:0:0: [sda] Preferred minimum I/O size 512 bytes [ 6.771472] sda: sda1 [ 6.771527] sd 4:0:0:0: [sda] Attached SCSI disk [ OK ] Found device ST1000NM0033-9ZM173 1. [ OK ] Reached target Initrd Root Device. [ 7.410278] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.410567] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.410649] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 7.410650] ixgbe 0000:03:00.0: 0c:c4:7a:88:73:f2 [ 7.413913] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 7.571240] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.571528] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.571610] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 7.571611] ixgbe 0000:03:00.1: 0c:c4:7a:88:73:f3 [ 7.574849] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 7.583148] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ 7.615782] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ OK ] Finished dracut initqueue hook. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting File System Check…6d2c-4093-809e-dd42758f0c27... [ OK ] Finished File System Check…5-6d2c-4093-809e-dd42758f0c27. Mounting /sysroot... [ 7.861476] EXT4-fs (sda1): mounted filesystem a494b625-6d2c-4093-809e-dd42758f0c27 ro with ordered data mode. Quota mode: none. [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Mountpoints Configured in the Real Root... [ OK ] Finished Mountpoints Configured in the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Finished dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped target Network. [ OK ] Stopped target Timer Units. [ OK ] Closed D-Bus System Message Bus Socket. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Basic System. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Initrd /usr File System. [ OK ] Stopped target Path Units. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Preparation for Remote File Systems. [ OK ] Stopped target Slice Units. [ OK ] Stopped target Socket Units. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Swaps. [ OK ] Stopped dracut initqueue hook. Starting Plymouth switch root service... [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped Coldplug All udev Devices. Stopping Rule-based Manage…for Device Events and Files... [ OK ] Finished Cleaning Up and Shutting Down Daemons. [ OK ] Stopped Rule-based Manager for Device Events and Files. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. Starting Cleanup udev Database... [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create List of Static Device Nodes. [ OK ] Stopped Create System Users. [ OK ] Finished Cleanup udev Database. [ OK ] Reached target Switch Root. [ OK ] Finished Plymouth switch root service. Starting Switch Root... [ 8.198171] systemd-journald[282]: Received SIGTERM from PID 1 (systemd). [ 8.705980] SELinux: policy capability network_peer_controls=1 [ 8.705983] SELinux: policy capability open_perms=1 [ 8.705984] SELinux: policy capability extended_socket_class=1 [ 8.705984] SELinux: policy capability always_check_network=0 [ 8.705985] SELinux: policy capability cgroup_seclabel=1 [ 8.705985] SELinux: policy capability nnp_nosuid_transition=1 [ 8.705986] SELinux: policy capability genfs_seclabel_symlinks=1 [ 8.749973] audit: type=1403 audit(1714085698.277:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 [ 8.753703] systemd[1]: Successfully loaded SELinux policy in 116.043ms. [ 8.824953] systemd[1]: Relabelled /dev, /dev/shm, /run, /sys/fs/cgroup in 25.464ms. [ 8.833719] systemd[1]: systemd 252-32.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 8.833824] systemd[1]: Detected architecture x86-64. [ 8.869078] systemd[1]: Hostname set to . Welcome to CentOS Stream 9! [ 9.851813] systemd[1]: initrd-switch-root.service: Deactivated successfully. [ OK [[ 9.851912] systemd[1]: Stopped Switch Root. [ 9.859353] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 9.859678] systemd[1]: Created slice Slice /system/getty. [ 9.860035] systemd[1]: Created slice Slice /system/modprobe. [ 9.865300] systemd[1]: Created slice Slice /system/serial-getty. [ 9.874158] systemd[1]: Created slice Slice /system/sshd-keygen. [ 9.879658] systemd[1]: Created slice User and Session Slice. 0m] Stopped [0;[ 9.885003] systemd[1]: Dispatch Password Requests to Console Directory Watch was skipped because of an unmet condition check (ConditionPathExists=!/run/plymouth/pid). [ 9.885139] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ 9.891527] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. [ 9.897117] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ 9.902838] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. 1;39mSwitch Root[ 9.956862] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. [ 9.956893] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ 9.956913] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ 9.956950] systemd[1]: Reached target ceph target allowing to start/stop all ceph-rbd-mirror@.service instances at once. . [[ 10.000464] systemd[1]: Reached target Local Encrypted Volumes. [ 10.000500] systemd[1]: Stopped target Switch Root. [ 10.000519] systemd[1]: Stopped target Initrd File Systems. [ 10.000532] systemd[1]: Stopped target Initrd Root File System. [ 10.000561] systemd[1]: Reached target Local Integrity Protected Volumes. [ 10.000597] systemd[1]: Reached target Path Units. [ 10.000626] systemd[1]: Reached target Slice Units. [ 10.000649] systemd[1]: Reached target Swaps. [ 10.000668] systemd[1]: Reached target Local Verity Protected Volumes. [ 10.001070] systemd[1]: Listening on Device-mapper event daemon FIFOs. OK ] Created slice Slice /system/getty. [ OK [ 10.063474] systemd[1]: Listening on LVM2 poll daemon socket. ] Created slice Slice /system/modprobe. [ OK ] Created slice Slice /system/[ 10.078175] systemd[1]: Listening on RPCbind Server Activation Socket. [ 10.078217] systemd[1]: Reached target RPC Port Mapper. [ 10.079493] systemd[1]: Listening on Process Core Dump Socket. serial-getty[ 10.098106] systemd[1]: Listening on initctl Compatibility Named Pipe. [ 10.098537] systemd[1]: Listening on udev Control Socket. [ 10.098781] systemd[1]: Listening on udev Kernel Socket. [ 10.099596] systemd[1]: Mounting Huge Pages File System... . [ OK[ 10.122847] systemd[1]: Mounting POSIX Message Queue File System... [ 10.123658] systemd[1]: Mounting Kernel Debug File System... ] Created slice S[ 10.136217] systemd[1]: Mounting Kernel Trace File System... [ 10.136350] systemd[1]: Kernel Module supporting RPCSEC_GSS was skipped because of an unmet condition check (ConditionPathExists=/etc/krb5.keytab). lice /system/sshd-keygen. [ OK ] Created slice User and Session Slice. [ OK ] Started Forward Password R…uests to Wall Directory Watch. [ OK ] Set up automount Arbitrary\xe2[ 10.178125] systemd[1]: Starting Create List of Static Device Nodes... [ 10.178955] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... \x80\xa6s File System [ 10.196767] systemd[1]: Starting Load Kernel Module configfs... [ 10.197545] systemd[1]: Starting Load Kernel Module drm... Automount Point[ 10.209556] systemd[1]: Starting Load Kernel Module fuse... [ 10.211186] systemd[1]: Starting Read and set NIS domainname from /etc/sysconfig/network... [0m. [ [ 10.215828] systemd[1]: plymouth-switch-root.service: Deactivated successfully. [ 10.215874] systemd[1]: Stopped Plymouth switch root service. [ 10.224304] systemd[1]: Stopped Journal Service. OK ] Reach[ 10.243727] systemd[1]: Starting Journal Service... [ 10.246065] systemd[1]: Starting Load Kernel Modules... ed target ceph target\xe2\x80[ 10.255418] systemd[1]: Starting Generate network units from Kernel command line... [ 10.255463] systemd[1]: TPM2 PCR Machine ID Measurement was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/StubPcrKernelImage-4a67b082-0a4c-41cf-b6c7-440b29bb8c4f). [ 10.256272] systemd[1]: Starting Remount Root and Kernel File Systems... [ 10.283653] systemd[1]: Repartition Root Disk was skipped because no trigger condition checks were met. \xa6on@.service ins[ 10.284838] systemd[1]: Starting Coldplug All udev Devices... [ 10.300742] systemd[1]: Started Journal Service. tances at once. [ OK ] Reached target ceph target…ds@.service instances at once. [ OK ] Reached target ceph target…gr@.service insta[ 10.326488] EXT4-fs (sda1): re-mounted a494b625-6d2c-4093-809e-dd42758f0c27 r/w. Quota mode: none. nces at once. [ OK ] Reached target ceph target…sd@.service instances at once. [ OK ] Reached target ceph target…gw@.service instances at once. [ OK ] Reached target ceph target…or@.service instances at once. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd File Systems. [ OK ] Stopped target Initrd Root File System. [ OK ] Reached target Local Integrity Protected Volumes. [ OK ] Reached target Pa[ 10.397884] systemd-journald[575]: Received client request to flush runtime journal. th Units. [ OK ] Reached target Slice Units. [ OK ] Reached target Swaps. [ OK ] Reached target Local Verity Protected Volumes. [ OK ] Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on LVM2 poll daemon socket. [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. [ OK ] Listening on Process Core Dump Socket. [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Listening on udev Control Socket. [ OK ] Listening on udev Kernel Socket. Mounting Huge Pages File System... Mounting POSIX Message Queue File System... Mounting Kernel Debug File System... Mounting Kernel Trace File System... Starting Create List of Static Device Nodes... Starting Monitoring of LVM…meventd or progress polling... Starting Load Kernel Module configfs... Starting Load Kernel Module drm... Starting Load Kernel Module fuse... Starting Read and set NIS …from /etc/sysconfig/network... [ OK ] Stopped Plymouth switch root service. [ OK ] Stopped Journal Service.[ 10.546386] fuse: init (API version 7.36) Starting Journal Service... Starting Load Kernel Modules... Starting Generate network …ts from Kernel command line... Star[ 10.568217] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. [ 10.568236] device-mapper: uevent: version 1.0.3 [ 10.568296] device-mapper: ioctl: 4.48.0-ioctl (2023-03-01) initialised: dm-devel@redhat.com ting Remount Root and Kernel File Systems... Starting Coldplug All udev Devices... [ OK ] Started Journal Service. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Kernel Trace File System. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Read and set NIS …e from /etc/sysconfig/network. [ OK ] Finished Generate network units from Kernel command line. [ OK ] Reached target Preparation for Network. [ OK ] Finished Remount Root and Kernel File Systems. Starting Flush Journal to Persistent Storage... Starting Load/Save OS Random Seed... Starting Create Static Device Nodes in /dev... [ OK ] Finished Flush Journal to Persistent Storage. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Module configfs. Mounting Kernel Configuration File System... [ OK ] Finished Coldplug All udev Devices. [ OK ] Mounted Kernel Configuration File System. [ OK ] Finished Load/Save OS Random Seed. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Load Kernel Modules. Mounting FUSE Control File System... Starting Apply Kernel Variables... [ OK ] Mounted FUSE Control File System. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Monitoring of LVM… dmeventd or progress polling. [ OK ] Finished Create Static Device Nodes in /dev. Starting Rule-based Manage…for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. [ OK ] Reached target Preparation for Local File Systems. [ OK ] Reached target Local File Systems. Starting Tell Plymouth To Write Out Runtime Data... Starting Automatic Boot Loader Update... Starting Create Volatile Files and Directories... Starting Load Kernel Module configfs... [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Tell Plymouth To Write Out Runtime Data. [ OK ] Finished Automatic Boot Loader Update. [ 10.928139] ioatdma: Intel(R) QuickData Technology Driver 5.00 [ 10.942516] igb 0000:07:00.0: DCA enabled [ 10.942543] igb 0000:07:00.1: DCA enabled [ 10.991075] mei_me 0000:00:16.0: Device doesn't have valid ME Interface [ 11.016108] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer [ 11.016111] RAPL PMU: hw unit of domain package 2^-14 Joules [ 11.016112] RAPL PMU: hw unit of domain dram 2^-16 Joules [ 11.045382] input: PC Speaker as /devices/platform/pcspkr/input/input4 [ OK ] Started /usr/sbin/lvm vgch…-autoactivation event vg_nvme. [ 11.064665] iTCO_vendor_support: vendor-support=0 [ 11.064690] IPMI message handler: version 39.2 [ 11.076033] iTCO_wdt iTCO_wdt.1.auto: Found a Wellsburg TCO device (Version=2, TCOBASE=0x0460) [ 11.076444] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) [ 11.077179] power_meter ACPI000D:00: Found ACPI power meter. [ 11.077208] power_meter ACPI000D:00: Ignoring unsafe software power cap! [ 11.077215] power_meter ACPI000D:00: hwmon_device_register() is deprecated. Please convert the driver to use hwmon_device_register_with_info(). [ 11.093377] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 11.094417] i2c i2c-3: 2/8 memory slots populated (from DMI) [ 11.094420] i2c i2c-3: Systems with more than 4 memory slots not supported yet, not instantiating SPD [ 11.098882] ipmi device interface [ OK ] Found device /dev/vg_nvme/lv_5. [ 11.241753] ipmi_si: IPMI System Interface driver [ 11.241771] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS [ 11.241772] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 [ 11.241774] ipmi_si: Adding SMBIOS-specified kcs state machine [ 11.241830] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI [ 11.241916] ipmi_si IPI0001:00: ipmi_platform: [io 0x0ca2] regsize 1 spacing 1 irq 0 [ 11.242895] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI [ 11.242897] ipmi_si: Adding ACPI-specified kcs state machine [ 11.242975] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 [ OK ] Finished Create Volatile Files and Directories. Starting Security Auditing Service... Starting RPC Bind... Mounting /var/lib/ceph... Mounting RPC Pipe File System... [ 11.356927] ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. [ 11.369866] EDAC MC0: Giving out device to module sb_edac controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT) [ 11.369868] EDAC sbridge: Ver: 1.1.2 [ 11.386597] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x0833, dev_id: 0x20) [ 11.427876] ipmi_si IPI0001:00: IPMI kcs interface initialized [ 11.438520] ipmi_ssif: IPMI SSIF Interface driver [ 11.440130] RPC: Registered named UNIX socket transport module. [ 11.440131] RPC: Registered udp transport module. [ OK [[ 11.440131] RPC: Registered tcp transport module. 0m] Mounted [0;[ 11.440132] RPC: Registered tcp-with-tls transport module. 1;39mRPC Pipe Fi[ 11.440132] RPC: Registered tcp NFSv4.1 backchannel transport module. le System. [ 11.467928] intel_rapl_common: Found RAPL domain package [ 11.467934] intel_rapl_common: Found RAPL domain dram [ OK ] Reached target rpc_pipefs.target. [ OK ] Started RPC Bind. [ 11.661489] SGI XFS with ACLs, security attributes, scrub, quota, no debug enabled [ 11.670231] XFS (dm-4): Deprecated V4 format (crc=0) will not be supported after September 2030. [ OK [[ 11.670328] XFS (dm-4): Mounting V4 Filesystem 82bb6fc0-59b1-432f-bcef-30577bea3db2 [ 11.674543] XFS (dm-4): Ending clean mount [ 11.674582] xfs filesystem being mounted at /var/lib/ceph supports timestamps until 2038 (0x7fffffff) 0m] Mounted /var/lib/ceph. [ OK ] Started Security Auditing Service. Starting Record System Boot/Shutdown in UTMP... [ OK ] Finished Record System Boot/Shutdown in UTMP. [ OK ] Reached target System Initialization. [ OK ] Started Daily rotation of log files. [ OK ] Started Updates mlocate database every day. [ OK ] Started Run system activit…ounting tool every 10 minutes. [ OK ] Started Generate summary o…esterday's process accounting. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Reached target Timer Units. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Listening on SSSD Kerberos…ache Manager responder socket. [ OK ] Reached target Socket Units. Starting D-Bus System Message Bus... [ OK ] Started D-Bus System Message Bus. [ OK ] Reached target Basic System. Starting Network Manager... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target…h*@.service instances at once. Starting NTP client/server... Starting Restore /run/initramfs on shutdown... [ OK ] Started irqbalance daemon. [ OK ] Started libstoragemgmt plug-in server daemon. [ OK ] Started Machine Check Exception Logging Daemon. Starting Self Monitoring a…g Technology (SMART) Daemon... [ OK ] Reached target sshd-keygen.target. [ OK ] Reached target User and Group Name Lookups. Starting Resets System Activity Logs... Starting User Login Management... [ OK ] Finished Restore /run/initramfs on shutdown. [ OK ] Started User Login Management. [ OK ] Finished Resets System Activity Logs. [ OK ] Started NTP client/server. [ OK ] Started Self Monitoring an…ing Technology (SMART) Daemon. Starting Hostname Service... [ OK ] Started Hostname Service. [ OK ] Listening on Load/Save RF …itch Status /dev/rfkill Watch. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ 13.463984] ixgbe 0000:03:00.0: registered PHC device on enp3s0f0 [ 13.623488] ixgbe 0000:03:00.1: registered PHC device on enp3s0f1 [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting Network Manager Wait Online... Starting GSSAPI Proxy Daemon... Starting OpenSSH server daemon... [ 13.849005] ixgbe 0000:03:00.1 enp3s0f1: detected SFP+: 4 [ OK ] Started OpenSSH server daemon. [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Finished Permit User Sessions. [ OK ] Started Deferred execution scheduler. [ OK ] S[ 14.038023] ixgbe 0000:03:00.1 enp3s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX [ 14.038150] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f1: link becomes ready tarted Command Scheduler. [* ] A start job is running for Network Manager Wait Online (6s / no limit) M [** ] A start job is running for Network Manager Wait Online (7s / no limit) M [*** ] A start job is running for Network Manager Wait Online (7s / no limit) M [ *** ] A start job is running for Network Manager Wait Online (8s / no limit) M [ *** ] A start job is running for Network Manager Wait Online (8s / no limit) M [ ***] A start job is running for Network Manager Wait Online (9s / no limit) M [ **] A start job is running for Network Manager Wait Online (9s / no limit) M [ OK ] Finished Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Crash recovery kernel arming... [ OK ] Started Nagios Remote Plugin Executor. Starting /etc/rc.d/rc.local Compatibility... Starting Notify NFS peers of a restart... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' Starting System Logging Service... [ OK ] Started Notify NFS peers of a restart. + myips=172.21.15.164 + attempts=1 + sleep 1 [ OK ] Started System Logging Service. Starting SETroubleshoot da…ing new SELinux denial logs... [ 21.541478] block sda: the capability attribute has been deprecated. + '[' 172.21.15.164 '!=' '' ']' + set -e + '[' -n 172.21.15.164 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.164 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.164 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' + newhostname=smithi164.front.sepia.ceph.com + '[' -n smithi164.front.sepia.ceph.com ']' + hostname smithi164.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi164 + echo smithi164 + grep -q front.sepia.ceph.com /etc/hosts + sed -i '1i172.21.15.164 smithi164.front.sepia.ceph.com smithi164\' /etc/hosts + break + command -v zypper + command -v apt-get + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.d/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... CentOS Stream 9 Kernel 5.14.0-437.el9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi164 login: [disconnect] 2024-04-25T22:55:17.818 INFO:teuthology.misc:Re-opening connections... 2024-04-25T22:55:17.818 INFO:teuthology.misc:trying to connect to ubuntu@smithi164.front.sepia.ceph.com 2024-04-25T22:55:17.819 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-04-25T22:55:17.820 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T22:55:18.287 DEBUG:teuthology.orchestra.run.smithi164:> true 2024-04-25T22:55:18.849 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-04-25T22:55:18.850 DEBUG:teuthology.misc:waited 1.0313045978546143 2024-04-25T22:55:19.850 DEBUG:tasks.ceph_manager:Mounting data for osd.1 on ubuntu@smithi164.front.sepia.ceph.com 2024-04-25T22:55:19.850 INFO:tasks.ceph_manager:Mounting osd.1: dev: ubuntu@smithi164.front.sepia.ceph.com, cluster: cephmountpoint: /var/lib/ceph/osd/ceph-1, type: xfs, options: ['noatime'] 2024-04-25T22:55:19.851 DEBUG:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-04-25T22:55:19.955 DEBUG:teuthology.orchestra.run.smithi164:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T22:55:20.081 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-25T22:55:20.081 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-25T22:55:20.083 INFO:tasks.ceph.osd.1:Started 2024-04-25T22:55:20.084 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:55:20.191 INFO:teuthology.orchestra.run.smithi164.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2024-04-25T22:55:20.193 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T22:55:20.194 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2024-04-25T22:55:21.041 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:55:21.040+0000 7f50e55a7640 -1 Falling back to public interface 2024-04-25T22:55:21.142 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-04-25T22:55:24.687 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:55:24.686+0000 7f50e55a7640 -1 osd.1 26 log_to_monitors true 2024-04-25T22:55:25.195 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:55:25.297 INFO:teuthology.orchestra.run.smithi164.stderr:no valid command found; 10 closest matches: 2024-04-25T22:55:25.297 INFO:teuthology.orchestra.run.smithi164.stderr:0 2024-04-25T22:55:25.298 INFO:teuthology.orchestra.run.smithi164.stderr:1 2024-04-25T22:55:25.298 INFO:teuthology.orchestra.run.smithi164.stderr:2 2024-04-25T22:55:25.298 INFO:teuthology.orchestra.run.smithi164.stderr:abort 2024-04-25T22:55:25.298 INFO:teuthology.orchestra.run.smithi164.stderr:assert 2024-04-25T22:55:25.298 INFO:teuthology.orchestra.run.smithi164.stderr:bluefs debug_inject_read_zeros 2024-04-25T22:55:25.298 INFO:teuthology.orchestra.run.smithi164.stderr:bluefs files list 2024-04-25T22:55:25.298 INFO:teuthology.orchestra.run.smithi164.stderr:bluefs stats 2024-04-25T22:55:25.298 INFO:teuthology.orchestra.run.smithi164.stderr:bluestore allocator dump block 2024-04-25T22:55:25.298 INFO:teuthology.orchestra.run.smithi164.stderr:bluestore allocator fragmentation block 2024-04-25T22:55:25.299 INFO:teuthology.orchestra.run.smithi164.stderr:admin_socket: invalid command 2024-04-25T22:55:25.300 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T22:55:25.300 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2024-04-25T22:55:25.543 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-04-25T22:55:25.542+0000 7f50d934c640 -1 osd.1 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T22:55:30.301 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-25T22:55:30.412 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-25T22:55:30.412 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-25T22:55:30.412 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-25T22:55:30.413 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-25T22:55:35.422 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-04-25T22:55:35.552 INFO:teuthology.orchestra.run.smithi052.stdout:mon.a: {} 2024-04-25T22:55:35.552 INFO:teuthology.orchestra.run.smithi052.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-25T22:55:35.561 INFO:teuthology.orchestra.run.smithi052.stdout:mon.b: {} 2024-04-25T22:55:35.561 INFO:teuthology.orchestra.run.smithi052.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-25T22:55:35.570 INFO:teuthology.orchestra.run.smithi052.stdout:mon.c: {} 2024-04-25T22:55:35.570 INFO:teuthology.orchestra.run.smithi052.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-25T22:55:35.581 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-25T22:55:36.516 INFO:teuthology.orchestra.run.smithi052.stderr:reweighted osd.0 to 1 (10000) 2024-04-25T22:55:36.534 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-04-25T22:55:37.508 INFO:teuthology.orchestra.run.smithi052.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-04-25T22:55:37.526 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-25T22:55:38.510 INFO:teuthology.orchestra.run.smithi052.stderr:reweighted osd.2 to 1 (10000) 2024-04-25T22:55:38.528 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-04-25T22:55:39.527 INFO:teuthology.orchestra.run.smithi052.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-04-25T22:55:39.544 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-25T22:55:40.535 INFO:teuthology.orchestra.run.smithi052.stderr:reweighted osd.1 to 1 (10000) 2024-04-25T22:55:40.551 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-04-25T22:55:41.533 INFO:teuthology.orchestra.run.smithi052.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-04-25T22:55:41.552 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-04-25T22:55:41.552 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-04-25T22:55:41.552 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-04-25T22:55:41.552 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-04-25T22:55:41.552 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-25T22:55:41.553 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:55:41.858 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:55:41.859 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":77,"fsid":"5355b70e-3f7d-4bce-8676-89cee61d2089","created":"2024-04-25T22:51:37.688525+0000","modified":"2024-04-25T22:55:41.532205+0000","last_up_change":"2024-04-25T22:55:26.505414+0000","last_in_change":"2024-04-25T22:51:38.491924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:51:45.966439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:51:46.128416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:51:50.648525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:51:51.351497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b785a86a-6391-4a0d-8aec-c2016380832e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6801","nonce":3666753097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6803","nonce":3666753097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6807","nonce":3666753097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6805","nonce":3666753097}]},"public_addr":"172.21.15.110:6801/3666753097","cluster_addr":"172.21.15.110:6803/3666753097","heartbeat_back_addr":"172.21.15.110:6807/3666753097","heartbeat_front_addr":"172.21.15.110:6805/3666753097","state":["exists","up"]},{"osd":1,"uuid":"088b4733-ccbd-41a6-8a31-8d811169c28a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":26,"up_from":62,"up_thru":75,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2239032021},{"type":"v1","addr":"172.21.15.164:6801","nonce":2239032021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2239032021},{"type":"v1","addr":"172.21.15.164:6803","nonce":2239032021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2239032021},{"type":"v1","addr":"172.21.15.164:6807","nonce":2239032021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2239032021},{"type":"v1","addr":"172.21.15.164:6805","nonce":2239032021}]},"public_addr":"172.21.15.164:6801/2239032021","cluster_addr":"172.21.15.164:6803/2239032021","heartbeat_back_addr":"172.21.15.164:6807/2239032021","heartbeat_front_addr":"172.21.15.164:6805/2239032021","state":["exists","up"]},{"osd":2,"uuid":"6a6aad8c-22ac-45c0-baf9-928314e7fef9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6801","nonce":349040881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6803","nonce":349040881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6807","nonce":349040881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6805","nonce":349040881}]},"public_addr":"172.21.15.191:6801/349040881","cluster_addr":"172.21.15.191:6803/349040881","heartbeat_back_addr":"172.21.15.191:6807/349040881","heartbeat_front_addr":"172.21.15.191:6805/349040881","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:51:43.531709+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:51:43.589701+0000","dead_epoch":26},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:51:43.566226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:55:41.872 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-25T22:55:41.872 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:55:42.171 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:55:42.171 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":77,"fsid":"5355b70e-3f7d-4bce-8676-89cee61d2089","created":"2024-04-25T22:51:37.688525+0000","modified":"2024-04-25T22:55:41.532205+0000","last_up_change":"2024-04-25T22:55:26.505414+0000","last_in_change":"2024-04-25T22:51:38.491924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:51:45.966439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:51:46.128416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:51:50.648525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:51:51.351497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b785a86a-6391-4a0d-8aec-c2016380832e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6801","nonce":3666753097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6803","nonce":3666753097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6807","nonce":3666753097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6805","nonce":3666753097}]},"public_addr":"172.21.15.110:6801/3666753097","cluster_addr":"172.21.15.110:6803/3666753097","heartbeat_back_addr":"172.21.15.110:6807/3666753097","heartbeat_front_addr":"172.21.15.110:6805/3666753097","state":["exists","up"]},{"osd":1,"uuid":"088b4733-ccbd-41a6-8a31-8d811169c28a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":26,"up_from":62,"up_thru":75,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2239032021},{"type":"v1","addr":"172.21.15.164:6801","nonce":2239032021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2239032021},{"type":"v1","addr":"172.21.15.164:6803","nonce":2239032021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2239032021},{"type":"v1","addr":"172.21.15.164:6807","nonce":2239032021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2239032021},{"type":"v1","addr":"172.21.15.164:6805","nonce":2239032021}]},"public_addr":"172.21.15.164:6801/2239032021","cluster_addr":"172.21.15.164:6803/2239032021","heartbeat_back_addr":"172.21.15.164:6807/2239032021","heartbeat_front_addr":"172.21.15.164:6805/2239032021","state":["exists","up"]},{"osd":2,"uuid":"6a6aad8c-22ac-45c0-baf9-928314e7fef9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6801","nonce":349040881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6803","nonce":349040881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6807","nonce":349040881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6805","nonce":349040881}]},"public_addr":"172.21.15.191:6801/349040881","cluster_addr":"172.21.15.191:6803/349040881","heartbeat_back_addr":"172.21.15.191:6807/349040881","heartbeat_front_addr":"172.21.15.191:6805/349040881","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:51:43.531709+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:51:43.589701+0000","dead_epoch":26},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:51:43.566226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:55:42.184 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-25T22:55:42.185 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-25T22:55:42.185 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-25T22:55:42.332 INFO:teuthology.orchestra.run.smithi052.stdout:34359738419 2024-04-25T22:55:42.332 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T22:55:42.342 INFO:teuthology.orchestra.run.smithi052.stdout:266287972357 2024-04-25T22:55:42.342 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T22:55:42.349 INFO:teuthology.orchestra.run.smithi052.stdout:34359738419 2024-04-25T22:55:42.349 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T22:55:42.641 INFO:teuthology.orchestra.run.smithi052.stdout:34359738418 2024-04-25T22:55:42.655 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738419 got 34359738418 for osd.2 2024-04-25T22:55:42.695 INFO:teuthology.orchestra.run.smithi052.stdout:34359738418 2024-04-25T22:55:42.696 INFO:teuthology.orchestra.run.smithi052.stdout:266287972356 2024-04-25T22:55:42.709 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738419 got 34359738418 for osd.0 2024-04-25T22:55:42.711 INFO:tasks.ceph.ceph_manager.ceph:need seq 266287972357 got 266287972356 for osd.1 2024-04-25T22:55:43.656 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T22:55:43.711 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T22:55:43.711 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T22:55:43.993 INFO:teuthology.orchestra.run.smithi052.stdout:34359738418 2024-04-25T22:55:44.008 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738419 got 34359738418 for osd.2 2024-04-25T22:55:44.027 INFO:teuthology.orchestra.run.smithi052.stdout:34359738418 2024-04-25T22:55:44.036 INFO:teuthology.orchestra.run.smithi052.stdout:266287972356 2024-04-25T22:55:44.041 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738419 got 34359738418 for osd.0 2024-04-25T22:55:44.050 INFO:tasks.ceph.ceph_manager.ceph:need seq 266287972357 got 266287972356 for osd.1 2024-04-25T22:55:45.009 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T22:55:45.041 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T22:55:45.051 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T22:55:45.334 INFO:teuthology.orchestra.run.smithi052.stdout:34359738419 2024-04-25T22:55:45.349 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738419 got 34359738419 for osd.2 2024-04-25T22:55:45.349 DEBUG:teuthology.parallel:result is None 2024-04-25T22:55:45.367 INFO:teuthology.orchestra.run.smithi052.stdout:266287972357 2024-04-25T22:55:45.368 INFO:teuthology.orchestra.run.smithi052.stdout:34359738419 2024-04-25T22:55:45.381 INFO:tasks.ceph.ceph_manager.ceph:need seq 266287972357 got 266287972357 for osd.1 2024-04-25T22:55:45.381 DEBUG:teuthology.parallel:result is None 2024-04-25T22:55:45.382 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738419 got 34359738419 for osd.0 2024-04-25T22:55:45.382 DEBUG:teuthology.parallel:result is None 2024-04-25T22:55:45.383 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-25T22:55:45.383 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:55:45.723 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:55:45.725 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-25T22:55:45.734 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":194,"stamp":"2024-04-25T22:55:43.986965+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":67784878,"num_objects":3482,"num_object_clones":0,"num_object_copies":6964,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3482,"num_whiteouts":0,"num_read":170,"num_read_kb":461,"num_write":11256,"num_write_kb":82675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4966,"num_bytes_recovered":56287056,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11006,"ondisk_log_size":11006,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":212,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":272644,"kb_used_data":153620,"kb_used_omap":9,"kb_used_meta":118966,"kb_avail":282842876,"statfs":{"total":289910292480,"available":289631105024,"internally_reserved":0,"allocated":157306880,"data_stored":136206144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10136,"internal_metadata":121821288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":209,"num_bytes_recovered":9238667,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.479154"},"pg_stats":[{"pgid":"4.3f","version":"55'160","reported_seq":516,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859594+0000","last_change":"2024-04-25T22:55:34.515388+0000","last_active":"2024-04-25T22:55:41.859594+0000","last_peered":"2024-04-25T22:55:41.859594+0000","last_clean":"2024-04-25T22:55:41.859594+0000","last_became_active":"2024-04-25T22:55:34.514302+0000","last_became_peered":"2024-04-25T22:55:34.514302+0000","last_unstale":"2024-04-25T22:55:41.859594+0000","last_undegraded":"2024-04-25T22:55:41.859594+0000","last_fullsized":"2024-04-25T22:55:41.859594+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:08:19.339484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168293,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":168293,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"55'153","reported_seq":495,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859178+0000","last_change":"2024-04-25T22:55:35.519132+0000","last_active":"2024-04-25T22:55:41.859178+0000","last_peered":"2024-04-25T22:55:41.859178+0000","last_clean":"2024-04-25T22:55:41.859178+0000","last_became_active":"2024-04-25T22:55:35.517561+0000","last_became_peered":"2024-04-25T22:55:35.517561+0000","last_unstale":"2024-04-25T22:55:41.859178+0000","last_undegraded":"2024-04-25T22:55:41.859178+0000","last_fullsized":"2024-04-25T22:55:41.859178+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:02:40.268992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286387,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":286387,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"55'164","reported_seq":238,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536366+0000","last_change":"2024-04-25T22:55:38.519244+0000","last_active":"2024-04-25T22:55:41.536366+0000","last_peered":"2024-04-25T22:55:41.536366+0000","last_clean":"2024-04-25T22:55:41.536366+0000","last_became_active":"2024-04-25T22:55:38.517874+0000","last_became_peered":"2024-04-25T22:55:38.517874+0000","last_unstale":"2024-04-25T22:55:41.536366+0000","last_undegraded":"2024-04-25T22:55:41.536366+0000","last_fullsized":"2024-04-25T22:55:41.536366+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:45:27.635067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130188,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"55'126","reported_seq":423,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536210+0000","last_change":"2024-04-25T22:55:38.516209+0000","last_active":"2024-04-25T22:55:41.536210+0000","last_peered":"2024-04-25T22:55:41.536210+0000","last_clean":"2024-04-25T22:55:41.536210+0000","last_became_active":"2024-04-25T22:55:38.513558+0000","last_became_peered":"2024-04-25T22:55:38.513558+0000","last_unstale":"2024-04-25T22:55:41.536210+0000","last_undegraded":"2024-04-25T22:55:41.536210+0000","last_fullsized":"2024-04-25T22:55:41.536210+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:50.123900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142819,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":135761,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"55'173","reported_seq":559,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859149+0000","last_change":"2024-04-25T22:55:35.517931+0000","last_active":"2024-04-25T22:55:41.859149+0000","last_peered":"2024-04-25T22:55:41.859149+0000","last_clean":"2024-04-25T22:55:41.859149+0000","last_became_active":"2024-04-25T22:55:35.517044+0000","last_became_peered":"2024-04-25T22:55:35.517044+0000","last_unstale":"2024-04-25T22:55:41.859149+0000","last_undegraded":"2024-04-25T22:55:41.859149+0000","last_fullsized":"2024-04-25T22:55:41.859149+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:42.118131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":709662,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":119,"num_bytes_recovered":709653,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"55'173","reported_seq":516,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535750+0000","last_change":"2024-04-25T22:55:38.515187+0000","last_active":"2024-04-25T22:55:41.535750+0000","last_peered":"2024-04-25T22:55:41.535750+0000","last_clean":"2024-04-25T22:55:41.535750+0000","last_became_active":"2024-04-25T22:55:38.513456+0000","last_became_peered":"2024-04-25T22:55:38.513456+0000","last_unstale":"2024-04-25T22:55:41.535750+0000","last_undegraded":"2024-04-25T22:55:41.535750+0000","last_fullsized":"2024-04-25T22:55:41.535750+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:08:19.339484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569466,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":569466,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"55'173","reported_seq":541,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535869+0000","last_change":"2024-04-25T22:55:33.512839+0000","last_active":"2024-04-25T22:55:41.535869+0000","last_peered":"2024-04-25T22:55:41.535869+0000","last_clean":"2024-04-25T22:55:41.535869+0000","last_became_active":"2024-04-25T22:55:33.511961+0000","last_became_peered":"2024-04-25T22:55:33.511961+0000","last_unstale":"2024-04-25T22:55:41.535869+0000","last_undegraded":"2024-04-25T22:55:41.535869+0000","last_fullsized":"2024-04-25T22:55:41.535869+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:54:45.619674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75460,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":111,"num_bytes_recovered":75460,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"55'140","reported_seq":456,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535457+0000","last_change":"2024-04-25T22:55:32.510322+0000","last_active":"2024-04-25T22:55:41.535457+0000","last_peered":"2024-04-25T22:55:41.535457+0000","last_clean":"2024-04-25T22:55:41.535457+0000","last_became_active":"2024-04-25T22:55:32.509908+0000","last_became_peered":"2024-04-25T22:55:32.509908+0000","last_unstale":"2024-04-25T22:55:41.535457+0000","last_undegraded":"2024-04-25T22:55:41.535457+0000","last_fullsized":"2024-04-25T22:55:41.535457+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:16:15.948780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":214453,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":214404,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"55'169","reported_seq":274,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536936+0000","last_change":"2024-04-25T22:55:32.513084+0000","last_active":"2024-04-25T22:55:41.536936+0000","last_peered":"2024-04-25T22:55:41.536936+0000","last_clean":"2024-04-25T22:55:41.536936+0000","last_became_active":"2024-04-25T22:55:32.512447+0000","last_became_peered":"2024-04-25T22:55:32.512447+0000","last_unstale":"2024-04-25T22:55:41.536936+0000","last_undegraded":"2024-04-25T22:55:41.536936+0000","last_fullsized":"2024-04-25T22:55:41.536936+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:16:27.593679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":538374,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":538374,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"55'153","reported_seq":483,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859293+0000","last_change":"2024-04-25T22:55:35.518293+0000","last_active":"2024-04-25T22:55:41.859293+0000","last_peered":"2024-04-25T22:55:41.859293+0000","last_clean":"2024-04-25T22:55:41.859293+0000","last_became_active":"2024-04-25T22:55:35.517506+0000","last_became_peered":"2024-04-25T22:55:35.517506+0000","last_unstale":"2024-04-25T22:55:41.859293+0000","last_undegraded":"2024-04-25T22:55:41.859293+0000","last_fullsized":"2024-04-25T22:55:41.859293+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:42:09.860717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130447,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":123390,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"55'154","reported_seq":258,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536002+0000","last_change":"2024-04-25T22:55:40.538872+0000","last_active":"2024-04-25T22:55:41.536002+0000","last_peered":"2024-04-25T22:55:41.536002+0000","last_clean":"2024-04-25T22:55:41.536002+0000","last_became_active":"2024-04-25T22:55:40.538052+0000","last_became_peered":"2024-04-25T22:55:40.538052+0000","last_unstale":"2024-04-25T22:55:41.536002+0000","last_undegraded":"2024-04-25T22:55:41.536002+0000","last_fullsized":"2024-04-25T22:55:41.536002+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:06.239983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":343806,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":208,"num_bytes_recovered":687612,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"55'141","reported_seq":278,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858898+0000","last_change":"2024-04-25T22:51:53.028006+0000","last_active":"2024-04-25T22:55:41.858898+0000","last_peered":"2024-04-25T22:55:41.858898+0000","last_clean":"2024-04-25T22:55:41.858898+0000","last_became_active":"2024-04-25T22:51:53.027363+0000","last_became_peered":"2024-04-25T22:51:53.027363+0000","last_unstale":"2024-04-25T22:55:41.858898+0000","last_undegraded":"2024-04-25T22:55:41.858898+0000","last_fullsized":"2024-04-25T22:55:41.858898+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:32.923620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125409,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"55'135","reported_seq":459,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858862+0000","last_change":"2024-04-25T22:55:33.512249+0000","last_active":"2024-04-25T22:55:41.858862+0000","last_peered":"2024-04-25T22:55:41.858862+0000","last_clean":"2024-04-25T22:55:41.858862+0000","last_became_active":"2024-04-25T22:55:33.511546+0000","last_became_peered":"2024-04-25T22:55:33.511546+0000","last_unstale":"2024-04-25T22:55:41.858862+0000","last_undegraded":"2024-04-25T22:55:41.858862+0000","last_fullsized":"2024-04-25T22:55:41.858862+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:52:41.758279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":183835,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":183835,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"55'179","reported_seq":314,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535808+0000","last_change":"2024-04-25T22:51:53.022367+0000","last_active":"2024-04-25T22:55:41.535808+0000","last_peered":"2024-04-25T22:55:41.535808+0000","last_clean":"2024-04-25T22:55:41.535808+0000","last_became_active":"2024-04-25T22:51:53.021902+0000","last_became_peered":"2024-04-25T22:51:53.021902+0000","last_unstale":"2024-04-25T22:55:41.535808+0000","last_undegraded":"2024-04-25T22:55:41.535808+0000","last_fullsized":"2024-04-25T22:55:41.535808+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:44:59.401139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153371,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":181,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"55'161","reported_seq":273,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535564+0000","last_change":"2024-04-25T22:55:40.539371+0000","last_active":"2024-04-25T22:55:41.535564+0000","last_peered":"2024-04-25T22:55:41.535564+0000","last_clean":"2024-04-25T22:55:41.535564+0000","last_became_active":"2024-04-25T22:55:40.538095+0000","last_became_peered":"2024-04-25T22:55:40.538095+0000","last_unstale":"2024-04-25T22:55:41.535564+0000","last_undegraded":"2024-04-25T22:55:41.535564+0000","last_fullsized":"2024-04-25T22:55:41.535564+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:57.514231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4276239,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":4418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":4276214,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"55'179","reported_seq":551,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535530+0000","last_change":"2024-04-25T22:55:31.526766+0000","last_active":"2024-04-25T22:55:41.535530+0000","last_peered":"2024-04-25T22:55:41.535530+0000","last_clean":"2024-04-25T22:55:41.535530+0000","last_became_active":"2024-04-25T22:55:31.526271+0000","last_became_peered":"2024-04-25T22:55:31.526271+0000","last_unstale":"2024-04-25T22:55:41.535530+0000","last_undegraded":"2024-04-25T22:55:41.535530+0000","last_fullsized":"2024-04-25T22:55:41.535530+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:48:39.183880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4371943,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":4513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":4363238,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"55'163","reported_seq":268,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536806+0000","last_change":"2024-04-25T22:55:32.513240+0000","last_active":"2024-04-25T22:55:41.536806+0000","last_peered":"2024-04-25T22:55:41.536806+0000","last_clean":"2024-04-25T22:55:41.536806+0000","last_became_active":"2024-04-25T22:55:32.512371+0000","last_became_peered":"2024-04-25T22:55:32.512371+0000","last_unstale":"2024-04-25T22:55:41.536806+0000","last_undegraded":"2024-04-25T22:55:41.536806+0000","last_fullsized":"2024-04-25T22:55:41.536806+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:23.735382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96221,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":87110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"55'147","reported_seq":487,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859496+0000","last_change":"2024-04-25T22:55:35.519379+0000","last_active":"2024-04-25T22:55:41.859496+0000","last_peered":"2024-04-25T22:55:41.859496+0000","last_clean":"2024-04-25T22:55:41.859496+0000","last_became_active":"2024-04-25T22:55:35.518584+0000","last_became_peered":"2024-04-25T22:55:35.518584+0000","last_unstale":"2024-04-25T22:55:41.859496+0000","last_undegraded":"2024-04-25T22:55:41.859496+0000","last_fullsized":"2024-04-25T22:55:41.859496+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:33:50.992444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1432264,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":1532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":1432241,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"55'146","reported_seq":255,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536568+0000","last_change":"2024-04-25T22:55:30.527560+0000","last_active":"2024-04-25T22:55:41.536568+0000","last_peered":"2024-04-25T22:55:41.536568+0000","last_clean":"2024-04-25T22:55:41.536568+0000","last_became_active":"2024-04-25T22:55:30.526745+0000","last_became_peered":"2024-04-25T22:55:30.526745+0000","last_unstale":"2024-04-25T22:55:41.536568+0000","last_undegraded":"2024-04-25T22:55:41.536568+0000","last_fullsized":"2024-04-25T22:55:41.536568+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:40:08.494734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112933,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":112933,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"55'178","reported_seq":548,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536195+0000","last_change":"2024-04-25T22:55:34.512671+0000","last_active":"2024-04-25T22:55:41.536195+0000","last_peered":"2024-04-25T22:55:41.536195+0000","last_clean":"2024-04-25T22:55:41.536195+0000","last_became_active":"2024-04-25T22:55:34.511872+0000","last_became_peered":"2024-04-25T22:55:34.511872+0000","last_unstale":"2024-04-25T22:55:41.536195+0000","last_undegraded":"2024-04-25T22:55:41.536195+0000","last_fullsized":"2024-04-25T22:55:41.536195+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:43:12.293070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124334,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":124334,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"55'158","reported_seq":500,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535980+0000","last_change":"2024-04-25T22:55:34.512430+0000","last_active":"2024-04-25T22:55:41.535980+0000","last_peered":"2024-04-25T22:55:41.535980+0000","last_clean":"2024-04-25T22:55:41.535980+0000","last_became_active":"2024-04-25T22:55:34.511833+0000","last_became_peered":"2024-04-25T22:55:34.511833+0000","last_unstale":"2024-04-25T22:55:41.535980+0000","last_undegraded":"2024-04-25T22:55:41.535980+0000","last_fullsized":"2024-04-25T22:55:41.535980+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:52:03.534174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145029,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":145029,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"55'171","reported_seq":308,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858838+0000","last_change":"2024-04-25T22:51:53.026746+0000","last_active":"2024-04-25T22:55:41.858838+0000","last_peered":"2024-04-25T22:55:41.858838+0000","last_clean":"2024-04-25T22:55:41.858838+0000","last_became_active":"2024-04-25T22:51:53.025938+0000","last_became_peered":"2024-04-25T22:51:53.025938+0000","last_unstale":"2024-04-25T22:55:41.858838+0000","last_undegraded":"2024-04-25T22:55:41.858838+0000","last_fullsized":"2024-04-25T22:55:41.858838+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:38:03.428258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115019,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"55'161","reported_seq":262,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535818+0000","last_change":"2024-04-25T22:55:33.513307+0000","last_active":"2024-04-25T22:55:41.535818+0000","last_peered":"2024-04-25T22:55:41.535818+0000","last_clean":"2024-04-25T22:55:41.535818+0000","last_became_active":"2024-04-25T22:55:33.512160+0000","last_became_peered":"2024-04-25T22:55:33.512160+0000","last_unstale":"2024-04-25T22:55:41.535818+0000","last_undegraded":"2024-04-25T22:55:41.535818+0000","last_fullsized":"2024-04-25T22:55:41.535818+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:57:16.042728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":641227,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":641227,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"55'169","reported_seq":525,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858515+0000","last_change":"2024-04-25T22:55:33.512249+0000","last_active":"2024-04-25T22:55:41.858515+0000","last_peered":"2024-04-25T22:55:41.858515+0000","last_clean":"2024-04-25T22:55:41.858515+0000","last_became_active":"2024-04-25T22:55:33.511463+0000","last_became_peered":"2024-04-25T22:55:33.511463+0000","last_unstale":"2024-04-25T22:55:41.858515+0000","last_undegraded":"2024-04-25T22:55:41.858515+0000","last_fullsized":"2024-04-25T22:55:41.858515+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:54:45.619674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103634,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":189,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":98869,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"55'159","reported_seq":296,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859682+0000","last_change":"2024-04-25T22:51:53.028155+0000","last_active":"2024-04-25T22:55:41.859682+0000","last_peered":"2024-04-25T22:55:41.859682+0000","last_clean":"2024-04-25T22:55:41.859682+0000","last_became_active":"2024-04-25T22:51:53.027867+0000","last_became_peered":"2024-04-25T22:51:53.027867+0000","last_unstale":"2024-04-25T22:55:41.859682+0000","last_undegraded":"2024-04-25T22:55:41.859682+0000","last_fullsized":"2024-04-25T22:55:41.859682+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:43:47.453569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272252,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"55'190","reported_seq":289,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536880+0000","last_change":"2024-04-25T22:55:34.513270+0000","last_active":"2024-04-25T22:55:41.536880+0000","last_peered":"2024-04-25T22:55:41.536880+0000","last_clean":"2024-04-25T22:55:41.536880+0000","last_became_active":"2024-04-25T22:55:34.512320+0000","last_became_peered":"2024-04-25T22:55:34.512320+0000","last_unstale":"2024-04-25T22:55:41.536880+0000","last_undegraded":"2024-04-25T22:55:41.536880+0000","last_fullsized":"2024-04-25T22:55:41.536880+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:37.486013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126403,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":117,"num_bytes_recovered":126342,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"55'151","reported_seq":286,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536427+0000","last_change":"2024-04-25T22:51:53.022893+0000","last_active":"2024-04-25T22:55:41.536427+0000","last_peered":"2024-04-25T22:55:41.536427+0000","last_clean":"2024-04-25T22:55:41.536427+0000","last_became_active":"2024-04-25T22:51:53.022407+0000","last_became_peered":"2024-04-25T22:51:53.022407+0000","last_unstale":"2024-04-25T22:55:41.536427+0000","last_undegraded":"2024-04-25T22:55:41.536427+0000","last_fullsized":"2024-04-25T22:55:41.536427+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:08:44.404718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69245,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"55'147","reported_seq":284,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859212+0000","last_change":"2024-04-25T22:51:53.028447+0000","last_active":"2024-04-25T22:55:41.859212+0000","last_peered":"2024-04-25T22:55:41.859212+0000","last_clean":"2024-04-25T22:55:41.859212+0000","last_became_active":"2024-04-25T22:51:53.027852+0000","last_became_peered":"2024-04-25T22:51:53.027852+0000","last_unstale":"2024-04-25T22:55:41.859212+0000","last_undegraded":"2024-04-25T22:55:41.859212+0000","last_fullsized":"2024-04-25T22:55:41.859212+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:16.187194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192848,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"55'166","reported_seq":267,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535904+0000","last_change":"2024-04-25T22:55:34.514981+0000","last_active":"2024-04-25T22:55:41.535904+0000","last_peered":"2024-04-25T22:55:41.535904+0000","last_clean":"2024-04-25T22:55:41.535904+0000","last_became_active":"2024-04-25T22:55:34.514067+0000","last_became_peered":"2024-04-25T22:55:34.514067+0000","last_unstale":"2024-04-25T22:55:41.535904+0000","last_undegraded":"2024-04-25T22:55:41.535904+0000","last_fullsized":"2024-04-25T22:55:41.535904+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:05:49.273497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239074,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":239074,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"55'191","reported_seq":328,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859081+0000","last_change":"2024-04-25T22:51:53.026997+0000","last_active":"2024-04-25T22:55:41.859081+0000","last_peered":"2024-04-25T22:55:41.859081+0000","last_clean":"2024-04-25T22:55:41.859081+0000","last_became_active":"2024-04-25T22:51:53.026379+0000","last_became_peered":"2024-04-25T22:51:53.026379+0000","last_unstale":"2024-04-25T22:55:41.859081+0000","last_undegraded":"2024-04-25T22:55:41.859081+0000","last_fullsized":"2024-04-25T22:55:41.859081+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:33:24.700106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99668,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"55'193","reported_seq":298,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536272+0000","last_change":"2024-04-25T22:55:32.511886+0000","last_active":"2024-04-25T22:55:41.536272+0000","last_peered":"2024-04-25T22:55:41.536272+0000","last_clean":"2024-04-25T22:55:41.536272+0000","last_became_active":"2024-04-25T22:55:32.509978+0000","last_became_peered":"2024-04-25T22:55:32.509978+0000","last_unstale":"2024-04-25T22:55:41.536272+0000","last_undegraded":"2024-04-25T22:55:41.536272+0000","last_fullsized":"2024-04-25T22:55:41.536272+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:56:47.747527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128069,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":128069,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"55'182","reported_seq":537,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535588+0000","last_change":"2024-04-25T22:55:38.519451+0000","last_active":"2024-04-25T22:55:41.535588+0000","last_peered":"2024-04-25T22:55:41.535588+0000","last_clean":"2024-04-25T22:55:41.535588+0000","last_became_active":"2024-04-25T22:55:38.518412+0000","last_became_peered":"2024-04-25T22:55:38.518412+0000","last_unstale":"2024-04-25T22:55:41.535588+0000","last_undegraded":"2024-04-25T22:55:41.535588+0000","last_fullsized":"2024-04-25T22:55:41.535588+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:27.179735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":586629,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":580754,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"55'156","reported_seq":494,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859060+0000","last_change":"2024-04-25T22:55:33.512918+0000","last_active":"2024-04-25T22:55:41.859060+0000","last_peered":"2024-04-25T22:55:41.859060+0000","last_clean":"2024-04-25T22:55:41.859060+0000","last_became_active":"2024-04-25T22:55:33.512114+0000","last_became_peered":"2024-04-25T22:55:33.512114+0000","last_unstale":"2024-04-25T22:55:41.859060+0000","last_undegraded":"2024-04-25T22:55:41.859060+0000","last_fullsized":"2024-04-25T22:55:41.859060+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:52:03.534174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118861,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":118861,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"60'105","reported_seq":256,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536115+0000","last_change":"2024-04-25T22:55:30.526027+0000","last_active":"2024-04-25T22:55:41.536115+0000","last_peered":"2024-04-25T22:55:41.536115+0000","last_clean":"2024-04-25T22:55:41.536115+0000","last_became_active":"2024-04-25T22:55:30.525469+0000","last_became_peered":"2024-04-25T22:55:30.525469+0000","last_unstale":"2024-04-25T22:55:41.536115+0000","last_undegraded":"2024-04-25T22:55:41.536115+0000","last_fullsized":"2024-04-25T22:55:41.536115+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:18:16.878967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2425045,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":2428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":2425011,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"55'146","reported_seq":472,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859394+0000","last_change":"2024-04-25T22:55:30.525674+0000","last_active":"2024-04-25T22:55:41.859394+0000","last_peered":"2024-04-25T22:55:41.859394+0000","last_clean":"2024-04-25T22:55:41.859394+0000","last_became_active":"2024-04-25T22:55:30.524718+0000","last_became_peered":"2024-04-25T22:55:30.524718+0000","last_unstale":"2024-04-25T22:55:41.859394+0000","last_undegraded":"2024-04-25T22:55:41.859394+0000","last_fullsized":"2024-04-25T22:55:41.859394+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:48:39.183880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67079,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":89,"num_bytes_recovered":67079,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":48,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535977+0000","last_change":"2024-04-25T22:55:27.517626+0000","last_active":"2024-04-25T22:55:41.535977+0000","last_peered":"2024-04-25T22:55:41.535977+0000","last_clean":"2024-04-25T22:55:41.535977+0000","last_became_active":"2024-04-25T22:55:27.517208+0000","last_became_peered":"2024-04-25T22:55:27.517208+0000","last_unstale":"2024-04-25T22:55:41.535977+0000","last_undegraded":"2024-04-25T22:55:41.535977+0000","last_fullsized":"2024-04-25T22:55:41.535977+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:09.249311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"55'186","reported_seq":287,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536662+0000","last_change":"2024-04-25T22:55:33.513626+0000","last_active":"2024-04-25T22:55:41.536662+0000","last_peered":"2024-04-25T22:55:41.536662+0000","last_clean":"2024-04-25T22:55:41.536662+0000","last_became_active":"2024-04-25T22:55:33.512389+0000","last_became_peered":"2024-04-25T22:55:33.512389+0000","last_unstale":"2024-04-25T22:55:41.536662+0000","last_undegraded":"2024-04-25T22:55:41.536662+0000","last_fullsized":"2024-04-25T22:55:41.536662+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:02:53.672517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139986,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":137763,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":139,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859045+0000","last_change":"2024-04-25T22:51:52.018646+0000","last_active":"2024-04-25T22:55:41.859045+0000","last_peered":"2024-04-25T22:55:41.859045+0000","last_clean":"2024-04-25T22:55:41.859045+0000","last_became_active":"2024-04-25T22:51:52.018313+0000","last_became_peered":"2024-04-25T22:51:52.018313+0000","last_unstale":"2024-04-25T22:55:41.859045+0000","last_undegraded":"2024-04-25T22:55:41.859045+0000","last_fullsized":"2024-04-25T22:55:41.859045+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:00:21.688745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"55'167","reported_seq":274,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536676+0000","last_change":"2024-04-25T22:55:30.527435+0000","last_active":"2024-04-25T22:55:41.536676+0000","last_peered":"2024-04-25T22:55:41.536676+0000","last_clean":"2024-04-25T22:55:41.536676+0000","last_became_active":"2024-04-25T22:55:30.526276+0000","last_became_peered":"2024-04-25T22:55:30.526276+0000","last_unstale":"2024-04-25T22:55:41.536676+0000","last_undegraded":"2024-04-25T22:55:41.536676+0000","last_fullsized":"2024-04-25T22:55:41.536676+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:03:39.273168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87849,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":87849,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":145,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535666+0000","last_change":"2024-04-25T22:51:52.021510+0000","last_active":"2024-04-25T22:55:41.535666+0000","last_peered":"2024-04-25T22:55:41.535666+0000","last_clean":"2024-04-25T22:55:41.535666+0000","last_became_active":"2024-04-25T22:51:52.021145+0000","last_became_peered":"2024-04-25T22:51:52.021145+0000","last_unstale":"2024-04-25T22:55:41.535666+0000","last_undegraded":"2024-04-25T22:55:41.535666+0000","last_fullsized":"2024-04-25T22:55:41.535666+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:05.110747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"52'2","reported_seq":139,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536823+0000","last_change":"2024-04-25T22:51:52.021355+0000","last_active":"2024-04-25T22:55:41.536823+0000","last_peered":"2024-04-25T22:55:41.536823+0000","last_clean":"2024-04-25T22:55:41.536823+0000","last_became_active":"2024-04-25T22:51:52.020860+0000","last_became_peered":"2024-04-25T22:51:52.020860+0000","last_unstale":"2024-04-25T22:55:41.536823+0000","last_undegraded":"2024-04-25T22:55:41.536823+0000","last_fullsized":"2024-04-25T22:55:41.536823+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:55.235787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"55'157","reported_seq":294,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858543+0000","last_change":"2024-04-25T22:51:53.029390+0000","last_active":"2024-04-25T22:55:41.858543+0000","last_peered":"2024-04-25T22:55:41.858543+0000","last_clean":"2024-04-25T22:55:41.858543+0000","last_became_active":"2024-04-25T22:51:53.029157+0000","last_became_peered":"2024-04-25T22:51:53.029157+0000","last_unstale":"2024-04-25T22:55:41.858543+0000","last_undegraded":"2024-04-25T22:55:41.858543+0000","last_fullsized":"2024-04-25T22:55:41.858543+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:51:43.808994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190158,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"48'3","reported_seq":142,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859570+0000","last_change":"2024-04-25T22:51:52.018856+0000","last_active":"2024-04-25T22:55:41.859570+0000","last_peered":"2024-04-25T22:55:41.859570+0000","last_clean":"2024-04-25T22:55:41.859570+0000","last_became_active":"2024-04-25T22:51:52.018390+0000","last_became_peered":"2024-04-25T22:51:52.018390+0000","last_unstale":"2024-04-25T22:55:41.859570+0000","last_undegraded":"2024-04-25T22:55:41.859570+0000","last_fullsized":"2024-04-25T22:55:41.859570+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:42:54.430484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"55'171","reported_seq":539,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858599+0000","last_change":"2024-04-25T22:55:31.527677+0000","last_active":"2024-04-25T22:55:41.858599+0000","last_peered":"2024-04-25T22:55:41.858599+0000","last_clean":"2024-04-25T22:55:41.858599+0000","last_became_active":"2024-04-25T22:55:31.527049+0000","last_became_peered":"2024-04-25T22:55:31.527049+0000","last_unstale":"2024-04-25T22:55:41.858599+0000","last_undegraded":"2024-04-25T22:55:41.858599+0000","last_fullsized":"2024-04-25T22:55:41.858599+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:16:15.948780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":315325,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":191,"num_write_kb":549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":110,"num_bytes_recovered":301306,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":45,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536688+0000","last_change":"2024-04-25T22:55:38.519011+0000","last_active":"2024-04-25T22:55:41.536688+0000","last_peered":"2024-04-25T22:55:41.536688+0000","last_clean":"2024-04-25T22:55:41.536688+0000","last_became_active":"2024-04-25T22:55:38.517362+0000","last_became_peered":"2024-04-25T22:55:38.517362+0000","last_unstale":"2024-04-25T22:55:41.536688+0000","last_undegraded":"2024-04-25T22:55:41.536688+0000","last_fullsized":"2024-04-25T22:55:41.536688+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:30:15.580001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"55'153","reported_seq":486,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536056+0000","last_change":"2024-04-25T22:55:38.515892+0000","last_active":"2024-04-25T22:55:41.536056+0000","last_peered":"2024-04-25T22:55:41.536056+0000","last_clean":"2024-04-25T22:55:41.536056+0000","last_became_active":"2024-04-25T22:55:38.514319+0000","last_became_peered":"2024-04-25T22:55:38.514319+0000","last_unstale":"2024-04-25T22:55:41.536056+0000","last_undegraded":"2024-04-25T22:55:41.536056+0000","last_fullsized":"2024-04-25T22:55:41.536056+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:42.118131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97209,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":97196,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"51'1","reported_seq":115,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536541+0000","last_change":"2024-04-25T22:55:38.518279+0000","last_active":"2024-04-25T22:55:41.536541+0000","last_peered":"2024-04-25T22:55:41.536541+0000","last_clean":"2024-04-25T22:55:41.536541+0000","last_became_active":"2024-04-25T22:55:38.516782+0000","last_became_peered":"2024-04-25T22:55:38.516782+0000","last_unstale":"2024-04-25T22:55:41.536541+0000","last_undegraded":"2024-04-25T22:55:41.536541+0000","last_fullsized":"2024-04-25T22:55:41.536541+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:27:46.635381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"55'153","reported_seq":256,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536313+0000","last_change":"2024-04-25T22:55:32.511660+0000","last_active":"2024-04-25T22:55:41.536313+0000","last_peered":"2024-04-25T22:55:41.536313+0000","last_clean":"2024-04-25T22:55:41.536313+0000","last_became_active":"2024-04-25T22:55:32.510402+0000","last_became_peered":"2024-04-25T22:55:32.510402+0000","last_unstale":"2024-04-25T22:55:41.536313+0000","last_undegraded":"2024-04-25T22:55:41.536313+0000","last_fullsized":"2024-04-25T22:55:41.536313+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:13:03.774101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131384,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":131332,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"47'7","reported_seq":56,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536115+0000","last_change":"2024-04-25T22:55:27.566798+0000","last_active":"2024-04-25T22:55:41.536115+0000","last_peered":"2024-04-25T22:55:41.536115+0000","last_clean":"2024-04-25T22:55:41.536115+0000","last_became_active":"2024-04-25T22:55:27.518709+0000","last_became_peered":"2024-04-25T22:55:27.518709+0000","last_unstale":"2024-04-25T22:55:41.536115+0000","last_undegraded":"2024-04-25T22:55:41.536115+0000","last_fullsized":"2024-04-25T22:55:41.536115+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:07:47.758073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"55'174","reported_seq":521,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536332+0000","last_change":"2024-04-25T22:55:38.517785+0000","last_active":"2024-04-25T22:55:41.536332+0000","last_peered":"2024-04-25T22:55:41.536332+0000","last_clean":"2024-04-25T22:55:41.536332+0000","last_became_active":"2024-04-25T22:55:38.514695+0000","last_became_peered":"2024-04-25T22:55:38.514695+0000","last_unstale":"2024-04-25T22:55:41.536332+0000","last_undegraded":"2024-04-25T22:55:41.536332+0000","last_fullsized":"2024-04-25T22:55:41.536332+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:33:50.992444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187245,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":111,"num_bytes_recovered":187245,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":144,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536245+0000","last_change":"2024-04-25T22:55:27.517686+0000","last_active":"2024-04-25T22:55:41.536245+0000","last_peered":"2024-04-25T22:55:41.536245+0000","last_clean":"2024-04-25T22:55:41.536245+0000","last_became_active":"2024-04-25T22:55:27.517404+0000","last_became_peered":"2024-04-25T22:55:27.517404+0000","last_unstale":"2024-04-25T22:55:41.536245+0000","last_undegraded":"2024-04-25T22:55:41.536245+0000","last_fullsized":"2024-04-25T22:55:41.536245+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:11.671572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"55'163","reported_seq":298,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536548+0000","last_change":"2024-04-25T22:51:53.023929+0000","last_active":"2024-04-25T22:55:41.536548+0000","last_peered":"2024-04-25T22:55:41.536548+0000","last_clean":"2024-04-25T22:55:41.536548+0000","last_became_active":"2024-04-25T22:51:53.023405+0000","last_became_peered":"2024-04-25T22:51:53.023405+0000","last_unstale":"2024-04-25T22:55:41.536548+0000","last_undegraded":"2024-04-25T22:55:41.536548+0000","last_fullsized":"2024-04-25T22:55:41.536548+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:35:35.419823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130867,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":156,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859401+0000","last_change":"2024-04-25T22:55:37.516071+0000","last_active":"2024-04-25T22:55:41.859401+0000","last_peered":"2024-04-25T22:55:41.859401+0000","last_clean":"2024-04-25T22:55:41.859401+0000","last_became_active":"2024-04-25T22:55:37.515798+0000","last_became_peered":"2024-04-25T22:55:37.515798+0000","last_unstale":"2024-04-25T22:55:41.859401+0000","last_undegraded":"2024-04-25T22:55:41.859401+0000","last_fullsized":"2024-04-25T22:55:41.859401+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:27:46.635381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"55'139","reported_seq":274,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536510+0000","last_change":"2024-04-25T22:51:53.020574+0000","last_active":"2024-04-25T22:55:41.536510+0000","last_peered":"2024-04-25T22:55:41.536510+0000","last_clean":"2024-04-25T22:55:41.536510+0000","last_became_active":"2024-04-25T22:51:53.019978+0000","last_became_peered":"2024-04-25T22:51:53.019978+0000","last_unstale":"2024-04-25T22:55:41.536510+0000","last_undegraded":"2024-04-25T22:55:41.536510+0000","last_fullsized":"2024-04-25T22:55:41.536510+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:41.205051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197405,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"51'1","reported_seq":147,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858624+0000","last_change":"2024-04-25T22:55:27.517695+0000","last_active":"2024-04-25T22:55:41.858624+0000","last_peered":"2024-04-25T22:55:41.858624+0000","last_clean":"2024-04-25T22:55:41.858624+0000","last_became_active":"2024-04-25T22:55:27.517330+0000","last_became_peered":"2024-04-25T22:55:27.517330+0000","last_unstale":"2024-04-25T22:55:41.858624+0000","last_undegraded":"2024-04-25T22:55:41.858624+0000","last_fullsized":"2024-04-25T22:55:41.858624+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:15:30.181042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"55'145","reported_seq":252,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.537124+0000","last_change":"2024-04-25T22:55:31.528962+0000","last_active":"2024-04-25T22:55:41.537124+0000","last_peered":"2024-04-25T22:55:41.537124+0000","last_clean":"2024-04-25T22:55:41.537124+0000","last_became_active":"2024-04-25T22:55:31.528360+0000","last_became_peered":"2024-04-25T22:55:31.528360+0000","last_unstale":"2024-04-25T22:55:41.537124+0000","last_undegraded":"2024-04-25T22:55:41.537124+0000","last_fullsized":"2024-04-25T22:55:41.537124+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:27:45.223109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165168,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":165116,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":339,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536012+0000","last_change":"2024-04-25T22:51:47.764624+0000","last_active":"2024-04-25T22:55:41.536012+0000","last_peered":"2024-04-25T22:55:41.536012+0000","last_clean":"2024-04-25T22:55:41.536012+0000","last_became_active":"2024-04-25T22:51:47.764176+0000","last_became_peered":"2024-04-25T22:51:47.764176+0000","last_unstale":"2024-04-25T22:55:41.536012+0000","last_undegraded":"2024-04-25T22:55:41.536012+0000","last_fullsized":"2024-04-25T22:55:41.536012+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:59:39.005489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":150,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536222+0000","last_change":"2024-04-25T22:55:27.521219+0000","last_active":"2024-04-25T22:55:41.536222+0000","last_peered":"2024-04-25T22:55:41.536222+0000","last_clean":"2024-04-25T22:55:41.536222+0000","last_became_active":"2024-04-25T22:55:27.520951+0000","last_became_peered":"2024-04-25T22:55:27.520951+0000","last_unstale":"2024-04-25T22:55:41.536222+0000","last_undegraded":"2024-04-25T22:55:41.536222+0000","last_fullsized":"2024-04-25T22:55:41.536222+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:48:53.391950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"51'2","reported_seq":48,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536134+0000","last_change":"2024-04-25T22:55:27.520902+0000","last_active":"2024-04-25T22:55:41.536134+0000","last_peered":"2024-04-25T22:55:41.536134+0000","last_clean":"2024-04-25T22:55:41.536134+0000","last_became_active":"2024-04-25T22:55:27.520466+0000","last_became_peered":"2024-04-25T22:55:27.520466+0000","last_unstale":"2024-04-25T22:55:41.536134+0000","last_undegraded":"2024-04-25T22:55:41.536134+0000","last_fullsized":"2024-04-25T22:55:41.536134+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:18:17.518924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"55'150","reported_seq":285,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536563+0000","last_change":"2024-04-25T22:51:53.024106+0000","last_active":"2024-04-25T22:55:41.536563+0000","last_peered":"2024-04-25T22:55:41.536563+0000","last_clean":"2024-04-25T22:55:41.536563+0000","last_became_active":"2024-04-25T22:51:53.023497+0000","last_became_peered":"2024-04-25T22:51:53.023497+0000","last_unstale":"2024-04-25T22:55:41.536563+0000","last_undegraded":"2024-04-25T22:55:41.536563+0000","last_fullsized":"2024-04-25T22:55:41.536563+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:52:16.918935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":331484,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":143,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536139+0000","last_change":"2024-04-25T22:51:47.764591+0000","last_active":"2024-04-25T22:55:41.536139+0000","last_peered":"2024-04-25T22:55:41.536139+0000","last_clean":"2024-04-25T22:55:41.536139+0000","last_became_active":"2024-04-25T22:51:47.764229+0000","last_became_peered":"2024-04-25T22:51:47.764229+0000","last_unstale":"2024-04-25T22:55:41.536139+0000","last_undegraded":"2024-04-25T22:55:41.536139+0000","last_fullsized":"2024-04-25T22:55:41.536139+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:32.854624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"53'36","reported_seq":52,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535631+0000","last_change":"2024-04-25T22:55:27.524404+0000","last_active":"2024-04-25T22:55:41.535631+0000","last_peered":"2024-04-25T22:55:41.535631+0000","last_clean":"2024-04-25T22:55:41.535631+0000","last_became_active":"2024-04-25T22:55:27.517290+0000","last_became_peered":"2024-04-25T22:55:27.517290+0000","last_unstale":"2024-04-25T22:55:41.535631+0000","last_undegraded":"2024-04-25T22:55:41.535631+0000","last_fullsized":"2024-04-25T22:55:41.535631+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:34.809551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327644,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":343,"num_write":34,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":327644,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"55'163","reported_seq":517,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859336+0000","last_change":"2024-04-25T22:55:35.519401+0000","last_active":"2024-04-25T22:55:41.859336+0000","last_peered":"2024-04-25T22:55:41.859336+0000","last_clean":"2024-04-25T22:55:41.859336+0000","last_became_active":"2024-04-25T22:55:35.518367+0000","last_became_peered":"2024-04-25T22:55:35.518367+0000","last_unstale":"2024-04-25T22:55:41.859336+0000","last_undegraded":"2024-04-25T22:55:41.859336+0000","last_fullsized":"2024-04-25T22:55:41.859336+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:51.343892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297937,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":181,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":282175,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":48,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535954+0000","last_change":"2024-04-25T22:55:27.519726+0000","last_active":"2024-04-25T22:55:41.535954+0000","last_peered":"2024-04-25T22:55:41.535954+0000","last_clean":"2024-04-25T22:55:41.535954+0000","last_became_active":"2024-04-25T22:55:27.518412+0000","last_became_peered":"2024-04-25T22:55:27.518412+0000","last_unstale":"2024-04-25T22:55:41.535954+0000","last_undegraded":"2024-04-25T22:55:41.535954+0000","last_fullsized":"2024-04-25T22:55:41.535954+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:32:35.203827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"51'62","reported_seq":201,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858672+0000","last_change":"2024-04-25T22:51:52.018873+0000","last_active":"2024-04-25T22:55:41.858672+0000","last_peered":"2024-04-25T22:55:41.858672+0000","last_clean":"2024-04-25T22:55:41.858672+0000","last_became_active":"2024-04-25T22:51:52.018300+0000","last_became_peered":"2024-04-25T22:51:52.018300+0000","last_unstale":"2024-04-25T22:55:41.858672+0000","last_undegraded":"2024-04-25T22:55:41.858672+0000","last_fullsized":"2024-04-25T22:55:41.858672+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:25:22.660789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":4122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"55'167","reported_seq":272,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.537064+0000","last_change":"2024-04-25T22:55:32.513689+0000","last_active":"2024-04-25T22:55:41.537064+0000","last_peered":"2024-04-25T22:55:41.537064+0000","last_clean":"2024-04-25T22:55:41.537064+0000","last_became_active":"2024-04-25T22:55:32.513087+0000","last_became_peered":"2024-04-25T22:55:32.513087+0000","last_unstale":"2024-04-25T22:55:41.537064+0000","last_undegraded":"2024-04-25T22:55:41.537064+0000","last_fullsized":"2024-04-25T22:55:41.537064+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:36:56.592254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395473,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":166,"num_write_kb":573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":395432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":150,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536310+0000","last_change":"2024-04-25T22:55:27.517303+0000","last_active":"2024-04-25T22:55:41.536310+0000","last_peered":"2024-04-25T22:55:41.536310+0000","last_clean":"2024-04-25T22:55:41.536310+0000","last_became_active":"2024-04-25T22:55:27.516952+0000","last_became_peered":"2024-04-25T22:55:27.516952+0000","last_unstale":"2024-04-25T22:55:41.536310+0000","last_undegraded":"2024-04-25T22:55:41.536310+0000","last_fullsized":"2024-04-25T22:55:41.536310+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:15:25.939805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":114,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536155+0000","last_change":"2024-04-25T22:55:38.518160+0000","last_active":"2024-04-25T22:55:41.536155+0000","last_peered":"2024-04-25T22:55:41.536155+0000","last_clean":"2024-04-25T22:55:41.536155+0000","last_became_active":"2024-04-25T22:55:38.516294+0000","last_became_peered":"2024-04-25T22:55:38.516294+0000","last_unstale":"2024-04-25T22:55:41.536155+0000","last_undegraded":"2024-04-25T22:55:41.536155+0000","last_fullsized":"2024-04-25T22:55:41.536155+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:50.339431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"55'156","reported_seq":263,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536316+0000","last_change":"2024-04-25T22:55:31.527813+0000","last_active":"2024-04-25T22:55:41.536316+0000","last_peered":"2024-04-25T22:55:41.536316+0000","last_clean":"2024-04-25T22:55:41.536316+0000","last_became_active":"2024-04-25T22:55:31.526666+0000","last_became_peered":"2024-04-25T22:55:31.526666+0000","last_unstale":"2024-04-25T22:55:41.536316+0000","last_undegraded":"2024-04-25T22:55:41.536316+0000","last_fullsized":"2024-04-25T22:55:41.536316+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:18.548926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100051,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":100051,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"52'1","reported_seq":145,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536734+0000","last_change":"2024-04-25T22:55:27.517150+0000","last_active":"2024-04-25T22:55:41.536734+0000","last_peered":"2024-04-25T22:55:41.536734+0000","last_clean":"2024-04-25T22:55:41.536734+0000","last_became_active":"2024-04-25T22:55:27.516760+0000","last_became_peered":"2024-04-25T22:55:27.516760+0000","last_unstale":"2024-04-25T22:55:41.536734+0000","last_undegraded":"2024-04-25T22:55:41.536734+0000","last_fullsized":"2024-04-25T22:55:41.536734+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:20:13.546931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536169+0000","last_change":"2024-04-25T22:55:27.517202+0000","last_active":"2024-04-25T22:55:41.536169+0000","last_peered":"2024-04-25T22:55:41.536169+0000","last_clean":"2024-04-25T22:55:41.536169+0000","last_became_active":"2024-04-25T22:55:27.516272+0000","last_became_peered":"2024-04-25T22:55:27.516272+0000","last_unstale":"2024-04-25T22:55:41.536169+0000","last_undegraded":"2024-04-25T22:55:41.536169+0000","last_fullsized":"2024-04-25T22:55:41.536169+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:43:32.692434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"55'155","reported_seq":292,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858903+0000","last_change":"2024-04-25T22:51:53.026321+0000","last_active":"2024-04-25T22:55:41.858903+0000","last_peered":"2024-04-25T22:55:41.858903+0000","last_clean":"2024-04-25T22:55:41.858903+0000","last_became_active":"2024-04-25T22:51:53.025824+0000","last_became_peered":"2024-04-25T22:51:53.025824+0000","last_unstale":"2024-04-25T22:55:41.858903+0000","last_undegraded":"2024-04-25T22:55:41.858903+0000","last_fullsized":"2024-04-25T22:55:41.858903+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:12:00.793718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67397,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536444+0000","last_change":"2024-04-25T22:55:27.516710+0000","last_active":"2024-04-25T22:55:41.536444+0000","last_peered":"2024-04-25T22:55:41.536444+0000","last_clean":"2024-04-25T22:55:41.536444+0000","last_became_active":"2024-04-25T22:55:27.515536+0000","last_became_peered":"2024-04-25T22:55:27.515536+0000","last_unstale":"2024-04-25T22:55:41.536444+0000","last_undegraded":"2024-04-25T22:55:41.536444+0000","last_fullsized":"2024-04-25T22:55:41.536444+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:42:01.941338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":152,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859759+0000","last_change":"2024-04-25T22:55:27.517692+0000","last_active":"2024-04-25T22:55:41.859759+0000","last_peered":"2024-04-25T22:55:41.859759+0000","last_clean":"2024-04-25T22:55:41.859759+0000","last_became_active":"2024-04-25T22:55:27.517411+0000","last_became_peered":"2024-04-25T22:55:27.517411+0000","last_unstale":"2024-04-25T22:55:41.859759+0000","last_undegraded":"2024-04-25T22:55:41.859759+0000","last_fullsized":"2024-04-25T22:55:41.859759+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:20:09.305694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"55'175","reported_seq":312,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858983+0000","last_change":"2024-04-25T22:51:53.027051+0000","last_active":"2024-04-25T22:55:41.858983+0000","last_peered":"2024-04-25T22:55:41.858983+0000","last_clean":"2024-04-25T22:55:41.858983+0000","last_became_active":"2024-04-25T22:51:53.026458+0000","last_became_peered":"2024-04-25T22:51:53.026458+0000","last_unstale":"2024-04-25T22:55:41.858983+0000","last_undegraded":"2024-04-25T22:55:41.858983+0000","last_fullsized":"2024-04-25T22:55:41.858983+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:11:09.179564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192819,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":52,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536805+0000","last_change":"2024-04-25T22:55:27.519827+0000","last_active":"2024-04-25T22:55:41.536805+0000","last_peered":"2024-04-25T22:55:41.536805+0000","last_clean":"2024-04-25T22:55:41.536805+0000","last_became_active":"2024-04-25T22:55:27.518853+0000","last_became_peered":"2024-04-25T22:55:27.518853+0000","last_unstale":"2024-04-25T22:55:41.536805+0000","last_undegraded":"2024-04-25T22:55:41.536805+0000","last_fullsized":"2024-04-25T22:55:41.536805+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:17:48.076297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":48,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536526+0000","last_change":"2024-04-25T22:55:27.519804+0000","last_active":"2024-04-25T22:55:41.536526+0000","last_peered":"2024-04-25T22:55:41.536526+0000","last_clean":"2024-04-25T22:55:41.536526+0000","last_became_active":"2024-04-25T22:55:27.518183+0000","last_became_peered":"2024-04-25T22:55:27.518183+0000","last_unstale":"2024-04-25T22:55:41.536526+0000","last_undegraded":"2024-04-25T22:55:41.536526+0000","last_fullsized":"2024-04-25T22:55:41.536526+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:36.947733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"55'172","reported_seq":505,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536038+0000","last_change":"2024-04-25T22:55:40.539104+0000","last_active":"2024-04-25T22:55:41.536038+0000","last_peered":"2024-04-25T22:55:41.536038+0000","last_clean":"2024-04-25T22:55:41.536038+0000","last_became_active":"2024-04-25T22:55:40.538335+0000","last_became_peered":"2024-04-25T22:55:40.538335+0000","last_unstale":"2024-04-25T22:55:41.536038+0000","last_undegraded":"2024-04-25T22:55:41.536038+0000","last_fullsized":"2024-04-25T22:55:41.536038+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:45:43.336586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505702,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":1011342,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"56'37","reported_seq":67,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536555+0000","last_change":"2024-04-25T22:55:27.570707+0000","last_active":"2024-04-25T22:55:41.536555+0000","last_peered":"2024-04-25T22:55:41.536555+0000","last_clean":"2024-04-25T22:55:41.536555+0000","last_became_active":"2024-04-25T22:55:27.518193+0000","last_became_peered":"2024-04-25T22:55:27.518193+0000","last_unstale":"2024-04-25T22:55:41.536555+0000","last_undegraded":"2024-04-25T22:55:41.536555+0000","last_fullsized":"2024-04-25T22:55:41.536555+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:17:01.521730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":143,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536823+0000","last_change":"2024-04-25T22:51:47.764288+0000","last_active":"2024-04-25T22:55:41.536823+0000","last_peered":"2024-04-25T22:55:41.536823+0000","last_clean":"2024-04-25T22:55:41.536823+0000","last_became_active":"2024-04-25T22:51:47.763961+0000","last_became_peered":"2024-04-25T22:51:47.763961+0000","last_unstale":"2024-04-25T22:55:41.536823+0000","last_undegraded":"2024-04-25T22:55:41.536823+0000","last_fullsized":"2024-04-25T22:55:41.536823+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:03:07.164842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"55'142","reported_seq":279,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858601+0000","last_change":"2024-04-25T22:51:53.026925+0000","last_active":"2024-04-25T22:55:41.858601+0000","last_peered":"2024-04-25T22:55:41.858601+0000","last_clean":"2024-04-25T22:55:41.858601+0000","last_became_active":"2024-04-25T22:51:53.026419+0000","last_became_peered":"2024-04-25T22:51:53.026419+0000","last_unstale":"2024-04-25T22:55:41.858601+0000","last_undegraded":"2024-04-25T22:55:41.858601+0000","last_fullsized":"2024-04-25T22:55:41.858601+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:49:38.102060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":246196,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"55'162","reported_seq":297,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535896+0000","last_change":"2024-04-25T22:51:53.022222+0000","last_active":"2024-04-25T22:55:41.535896+0000","last_peered":"2024-04-25T22:55:41.535896+0000","last_clean":"2024-04-25T22:55:41.535896+0000","last_became_active":"2024-04-25T22:51:53.021687+0000","last_became_peered":"2024-04-25T22:51:53.021687+0000","last_unstale":"2024-04-25T22:55:41.535896+0000","last_undegraded":"2024-04-25T22:55:41.535896+0000","last_fullsized":"2024-04-25T22:55:41.535896+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:35:06.234402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108265,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"60'43","reported_seq":180,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536366+0000","last_change":"2024-04-25T22:51:52.019928+0000","last_active":"2024-04-25T22:55:41.536366+0000","last_peered":"2024-04-25T22:55:41.536366+0000","last_clean":"2024-04-25T22:55:41.536366+0000","last_became_active":"2024-04-25T22:51:52.019264+0000","last_became_peered":"2024-04-25T22:51:52.019264+0000","last_unstale":"2024-04-25T22:55:41.536366+0000","last_undegraded":"2024-04-25T22:55:41.536366+0000","last_fullsized":"2024-04-25T22:55:41.536366+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:18.136883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"55'146","reported_seq":253,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535922+0000","last_change":"2024-04-25T22:55:31.527757+0000","last_active":"2024-04-25T22:55:41.535922+0000","last_peered":"2024-04-25T22:55:41.535922+0000","last_clean":"2024-04-25T22:55:41.535922+0000","last_became_active":"2024-04-25T22:55:31.526620+0000","last_became_peered":"2024-04-25T22:55:31.526620+0000","last_unstale":"2024-04-25T22:55:41.535922+0000","last_undegraded":"2024-04-25T22:55:41.535922+0000","last_fullsized":"2024-04-25T22:55:41.535922+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:59:41.748950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89309,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":89309,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"53'21","reported_seq":160,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859669+0000","last_change":"2024-04-25T22:51:52.018977+0000","last_active":"2024-04-25T22:55:41.859669+0000","last_peered":"2024-04-25T22:55:41.859669+0000","last_clean":"2024-04-25T22:55:41.859669+0000","last_became_active":"2024-04-25T22:51:52.018519+0000","last_became_peered":"2024-04-25T22:51:52.018519+0000","last_unstale":"2024-04-25T22:55:41.859669+0000","last_undegraded":"2024-04-25T22:55:41.859669+0000","last_fullsized":"2024-04-25T22:55:41.859669+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:53:07.306148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"48'1","reported_seq":115,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536721+0000","last_change":"2024-04-25T22:55:38.517605+0000","last_active":"2024-04-25T22:55:41.536721+0000","last_peered":"2024-04-25T22:55:41.536721+0000","last_clean":"2024-04-25T22:55:41.536721+0000","last_became_active":"2024-04-25T22:55:38.515986+0000","last_became_peered":"2024-04-25T22:55:38.515986+0000","last_unstale":"2024-04-25T22:55:41.536721+0000","last_undegraded":"2024-04-25T22:55:41.536721+0000","last_fullsized":"2024-04-25T22:55:41.536721+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:02:39.264531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"55'171","reported_seq":278,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535896+0000","last_change":"2024-04-25T22:55:30.525999+0000","last_active":"2024-04-25T22:55:41.535896+0000","last_peered":"2024-04-25T22:55:41.535896+0000","last_clean":"2024-04-25T22:55:41.535896+0000","last_became_active":"2024-04-25T22:55:30.525233+0000","last_became_peered":"2024-04-25T22:55:30.525233+0000","last_unstale":"2024-04-25T22:55:41.535896+0000","last_undegraded":"2024-04-25T22:55:41.535896+0000","last_fullsized":"2024-04-25T22:55:41.535896+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:51:14.338988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":332166,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":329490,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"51'2","reported_seq":48,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536941+0000","last_change":"2024-04-25T22:55:27.519530+0000","last_active":"2024-04-25T22:55:41.536941+0000","last_peered":"2024-04-25T22:55:41.536941+0000","last_clean":"2024-04-25T22:55:41.536941+0000","last_became_active":"2024-04-25T22:55:27.518244+0000","last_became_peered":"2024-04-25T22:55:27.518244+0000","last_unstale":"2024-04-25T22:55:41.536941+0000","last_undegraded":"2024-04-25T22:55:41.536941+0000","last_fullsized":"2024-04-25T22:55:41.536941+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:40:24.373575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"55'158","reported_seq":267,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535732+0000","last_change":"2024-04-25T22:55:30.527784+0000","last_active":"2024-04-25T22:55:41.535732+0000","last_peered":"2024-04-25T22:55:41.535732+0000","last_clean":"2024-04-25T22:55:41.535732+0000","last_became_active":"2024-04-25T22:55:30.526853+0000","last_became_peered":"2024-04-25T22:55:30.526853+0000","last_unstale":"2024-04-25T22:55:41.535732+0000","last_undegraded":"2024-04-25T22:55:41.535732+0000","last_fullsized":"2024-04-25T22:55:41.535732+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:19:11.705754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70967,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":70967,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"55'172","reported_seq":309,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859717+0000","last_change":"2024-04-25T22:51:53.029210+0000","last_active":"2024-04-25T22:55:41.859717+0000","last_peered":"2024-04-25T22:55:41.859717+0000","last_clean":"2024-04-25T22:55:41.859717+0000","last_became_active":"2024-04-25T22:51:53.028635+0000","last_became_peered":"2024-04-25T22:51:53.028635+0000","last_unstale":"2024-04-25T22:55:41.859717+0000","last_undegraded":"2024-04-25T22:55:41.859717+0000","last_fullsized":"2024-04-25T22:55:41.859717+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:41.205051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":440592,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"50'1","reported_seq":48,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535599+0000","last_change":"2024-04-25T22:55:27.516136+0000","last_active":"2024-04-25T22:55:41.535599+0000","last_peered":"2024-04-25T22:55:41.535599+0000","last_clean":"2024-04-25T22:55:41.535599+0000","last_became_active":"2024-04-25T22:55:27.515473+0000","last_became_peered":"2024-04-25T22:55:27.515473+0000","last_unstale":"2024-04-25T22:55:41.535599+0000","last_undegraded":"2024-04-25T22:55:41.535599+0000","last_fullsized":"2024-04-25T22:55:41.535599+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:51:59.771248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"55'151","reported_seq":250,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536783+0000","last_change":"2024-04-25T22:55:34.513243+0000","last_active":"2024-04-25T22:55:41.536783+0000","last_peered":"2024-04-25T22:55:41.536783+0000","last_clean":"2024-04-25T22:55:41.536783+0000","last_became_active":"2024-04-25T22:55:34.512137+0000","last_became_peered":"2024-04-25T22:55:34.512137+0000","last_unstale":"2024-04-25T22:55:41.536783+0000","last_undegraded":"2024-04-25T22:55:41.536783+0000","last_fullsized":"2024-04-25T22:55:41.536783+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:06:40.451167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106917,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":97731,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":76,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535673+0000","last_change":"2024-04-25T22:55:37.514177+0000","last_active":"2024-04-25T22:55:41.535673+0000","last_peered":"2024-04-25T22:55:41.535673+0000","last_clean":"2024-04-25T22:55:41.535673+0000","last_became_active":"2024-04-25T22:55:37.513925+0000","last_became_peered":"2024-04-25T22:55:37.513925+0000","last_unstale":"2024-04-25T22:55:41.535673+0000","last_undegraded":"2024-04-25T22:55:41.535673+0000","last_fullsized":"2024-04-25T22:55:41.535673+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:12:09.421061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"55'203","reported_seq":340,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859317+0000","last_change":"2024-04-25T22:51:53.028084+0000","last_active":"2024-04-25T22:55:41.859317+0000","last_peered":"2024-04-25T22:55:41.859317+0000","last_clean":"2024-04-25T22:55:41.859317+0000","last_became_active":"2024-04-25T22:51:53.027541+0000","last_became_peered":"2024-04-25T22:51:53.027541+0000","last_unstale":"2024-04-25T22:55:41.859317+0000","last_undegraded":"2024-04-25T22:55:41.859317+0000","last_fullsized":"2024-04-25T22:55:41.859317+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:28:42.903045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195653,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"48'2","reported_seq":153,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859141+0000","last_change":"2024-04-25T22:55:27.541798+0000","last_active":"2024-04-25T22:55:41.859141+0000","last_peered":"2024-04-25T22:55:41.859141+0000","last_clean":"2024-04-25T22:55:41.859141+0000","last_became_active":"2024-04-25T22:55:27.517718+0000","last_became_peered":"2024-04-25T22:55:27.517718+0000","last_unstale":"2024-04-25T22:55:41.859141+0000","last_undegraded":"2024-04-25T22:55:41.859141+0000","last_fullsized":"2024-04-25T22:55:41.859141+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:48:57.633186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"55'168","reported_seq":524,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858951+0000","last_change":"2024-04-25T22:55:34.514499+0000","last_active":"2024-04-25T22:55:41.858951+0000","last_peered":"2024-04-25T22:55:41.858951+0000","last_clean":"2024-04-25T22:55:41.858951+0000","last_became_active":"2024-04-25T22:55:34.513433+0000","last_became_peered":"2024-04-25T22:55:34.513433+0000","last_unstale":"2024-04-25T22:55:41.858951+0000","last_undegraded":"2024-04-25T22:55:41.858951+0000","last_fullsized":"2024-04-25T22:55:41.858951+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:58:08.177184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151921,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":151921,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"47'5","reported_seq":170,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859179+0000","last_change":"2024-04-25T22:55:37.559449+0000","last_active":"2024-04-25T22:55:41.859179+0000","last_peered":"2024-04-25T22:55:41.859179+0000","last_clean":"2024-04-25T22:55:41.859179+0000","last_became_active":"2024-04-25T22:55:37.516119+0000","last_became_peered":"2024-04-25T22:55:37.516119+0000","last_unstale":"2024-04-25T22:55:41.859179+0000","last_undegraded":"2024-04-25T22:55:41.859179+0000","last_fullsized":"2024-04-25T22:55:41.859179+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:25:42.548782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"55'166","reported_seq":505,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535835+0000","last_change":"2024-04-25T22:55:38.518734+0000","last_active":"2024-04-25T22:55:41.535835+0000","last_peered":"2024-04-25T22:55:41.535835+0000","last_clean":"2024-04-25T22:55:41.535835+0000","last_became_active":"2024-04-25T22:55:38.516260+0000","last_became_peered":"2024-04-25T22:55:38.516260+0000","last_unstale":"2024-04-25T22:55:41.535835+0000","last_undegraded":"2024-04-25T22:55:41.535835+0000","last_fullsized":"2024-04-25T22:55:41.535835+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:25:43.553244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3798024,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":3871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":3798024,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535940+0000","last_change":"2024-04-25T22:55:38.520672+0000","last_active":"2024-04-25T22:55:41.535940+0000","last_peered":"2024-04-25T22:55:41.535940+0000","last_clean":"2024-04-25T22:55:41.535940+0000","last_became_active":"2024-04-25T22:55:38.515776+0000","last_became_peered":"2024-04-25T22:55:38.515776+0000","last_unstale":"2024-04-25T22:55:41.535940+0000","last_undegraded":"2024-04-25T22:55:41.535940+0000","last_fullsized":"2024-04-25T22:55:41.535940+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:53.584300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"55'158","reported_seq":495,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536078+0000","last_change":"2024-04-25T22:55:38.516465+0000","last_active":"2024-04-25T22:55:41.536078+0000","last_peered":"2024-04-25T22:55:41.536078+0000","last_clean":"2024-04-25T22:55:41.536078+0000","last_became_active":"2024-04-25T22:55:38.514732+0000","last_became_peered":"2024-04-25T22:55:38.514732+0000","last_unstale":"2024-04-25T22:55:41.536078+0000","last_undegraded":"2024-04-25T22:55:41.536078+0000","last_fullsized":"2024-04-25T22:55:41.536078+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:42:09.860717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141656,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":141656,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"50'57","reported_seq":196,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859521+0000","last_change":"2024-04-25T22:51:52.019032+0000","last_active":"2024-04-25T22:55:41.859521+0000","last_peered":"2024-04-25T22:55:41.859521+0000","last_clean":"2024-04-25T22:55:41.859521+0000","last_became_active":"2024-04-25T22:51:52.018547+0000","last_became_peered":"2024-04-25T22:51:52.018547+0000","last_unstale":"2024-04-25T22:55:41.859521+0000","last_undegraded":"2024-04-25T22:55:41.859521+0000","last_fullsized":"2024-04-25T22:55:41.859521+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:10:00.056491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":8213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"55'169","reported_seq":535,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859326+0000","last_change":"2024-04-25T22:55:35.518155+0000","last_active":"2024-04-25T22:55:41.859326+0000","last_peered":"2024-04-25T22:55:41.859326+0000","last_clean":"2024-04-25T22:55:41.859326+0000","last_became_active":"2024-04-25T22:55:35.517149+0000","last_became_peered":"2024-04-25T22:55:35.517149+0000","last_unstale":"2024-04-25T22:55:41.859326+0000","last_undegraded":"2024-04-25T22:55:41.859326+0000","last_fullsized":"2024-04-25T22:55:41.859326+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:50.123900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184603,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":194,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":166098,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"48'25","reported_seq":56,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536897+0000","last_change":"2024-04-25T22:55:27.586742+0000","last_active":"2024-04-25T22:55:41.536897+0000","last_peered":"2024-04-25T22:55:41.536897+0000","last_clean":"2024-04-25T22:55:41.536897+0000","last_became_active":"2024-04-25T22:55:27.520617+0000","last_became_peered":"2024-04-25T22:55:27.520617+0000","last_unstale":"2024-04-25T22:55:41.536897+0000","last_undegraded":"2024-04-25T22:55:41.536897+0000","last_fullsized":"2024-04-25T22:55:41.536897+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:58:12.148059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"55'196","reported_seq":594,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535817+0000","last_change":"2024-04-25T22:55:31.526793+0000","last_active":"2024-04-25T22:55:41.535817+0000","last_peered":"2024-04-25T22:55:41.535817+0000","last_clean":"2024-04-25T22:55:41.535817+0000","last_became_active":"2024-04-25T22:55:31.526322+0000","last_became_peered":"2024-04-25T22:55:31.526322+0000","last_unstale":"2024-04-25T22:55:41.535817+0000","last_undegraded":"2024-04-25T22:55:41.535817+0000","last_fullsized":"2024-04-25T22:55:41.535817+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:58.561902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200980,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":211,"num_write_kb":410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":126,"num_bytes_recovered":197679,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"48'7","reported_seq":98,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536679+0000","last_change":"2024-04-25T22:55:37.541050+0000","last_active":"2024-04-25T22:55:41.536679+0000","last_peered":"2024-04-25T22:55:41.536679+0000","last_clean":"2024-04-25T22:55:41.536679+0000","last_became_active":"2024-04-25T22:55:37.516183+0000","last_became_peered":"2024-04-25T22:55:37.516183+0000","last_unstale":"2024-04-25T22:55:41.536679+0000","last_undegraded":"2024-04-25T22:55:41.536679+0000","last_fullsized":"2024-04-25T22:55:41.536679+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:30.075399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8389190,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26691649,"num_objects":3448,"num_object_clones":0,"num_object_copies":6896,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3448,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10583,"num_write_kb":38991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4953,"num_bytes_recovered":24173691,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73056256,"data_stored":53061590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10415,"ondisk_log_size":10415,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":40502861,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":34,"num_read_kb":343,"num_write":470,"num_write_kb":40224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":32113365,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":81068032,"data_stored":81005722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5351,"internal_metadata":0},"log_size":434,"ondisk_log_size":434,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738419,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84816,"kb_used_data":49476,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94287024,"statfs":{"total":96636764160,"available":96549912576,"internally_reserved":0,"allocated":50663424,"data_stored":43767232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":62,"seq":266287972357,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85248,"kb_used_data":45232,"kb_used_omap":6,"kb_used_meta":39993,"kb_avail":94286592,"statfs":{"total":96636764160,"available":96549470208,"internally_reserved":0,"allocated":46317568,"data_stored":38899263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6946,"internal_metadata":40953054},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738419,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":102580,"kb_used_data":58912,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94269260,"statfs":{"total":96636764160,"available":96531722240,"internally_reserved":0,"allocated":60325888,"data_stored":53539649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32145408,"data_stored":32114253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19542016,"data_stored":19530487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5351,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":29380608,"data_stored":29360982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":26918912,"data_stored":20514252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26107904,"data_stored":19048000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20029440,"data_stored":13499338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:55:45.739 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:55:46.078 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:55:46.079 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-25T22:55:46.089 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":195,"stamp":"2024-04-25T22:55:45.987513+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":67784878,"num_objects":3482,"num_object_clones":0,"num_object_copies":6964,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3482,"num_whiteouts":0,"num_read":170,"num_read_kb":461,"num_write":11256,"num_write_kb":82675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4966,"num_bytes_recovered":56287056,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11006,"ondisk_log_size":11006,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":212,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":272644,"kb_used_data":153620,"kb_used_omap":9,"kb_used_meta":118966,"kb_avail":282842876,"statfs":{"total":289910292480,"available":289631105024,"internally_reserved":0,"allocated":157306880,"data_stored":136206144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10136,"internal_metadata":121821288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":209,"num_bytes_recovered":9238667,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.459375"},"pg_stats":[{"pgid":"4.3f","version":"55'160","reported_seq":516,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859594+0000","last_change":"2024-04-25T22:55:34.515388+0000","last_active":"2024-04-25T22:55:41.859594+0000","last_peered":"2024-04-25T22:55:41.859594+0000","last_clean":"2024-04-25T22:55:41.859594+0000","last_became_active":"2024-04-25T22:55:34.514302+0000","last_became_peered":"2024-04-25T22:55:34.514302+0000","last_unstale":"2024-04-25T22:55:41.859594+0000","last_undegraded":"2024-04-25T22:55:41.859594+0000","last_fullsized":"2024-04-25T22:55:41.859594+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:08:19.339484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168293,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":168293,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"55'153","reported_seq":495,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859178+0000","last_change":"2024-04-25T22:55:35.519132+0000","last_active":"2024-04-25T22:55:41.859178+0000","last_peered":"2024-04-25T22:55:41.859178+0000","last_clean":"2024-04-25T22:55:41.859178+0000","last_became_active":"2024-04-25T22:55:35.517561+0000","last_became_peered":"2024-04-25T22:55:35.517561+0000","last_unstale":"2024-04-25T22:55:41.859178+0000","last_undegraded":"2024-04-25T22:55:41.859178+0000","last_fullsized":"2024-04-25T22:55:41.859178+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:02:40.268992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286387,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":286387,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"55'164","reported_seq":238,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536366+0000","last_change":"2024-04-25T22:55:38.519244+0000","last_active":"2024-04-25T22:55:41.536366+0000","last_peered":"2024-04-25T22:55:41.536366+0000","last_clean":"2024-04-25T22:55:41.536366+0000","last_became_active":"2024-04-25T22:55:38.517874+0000","last_became_peered":"2024-04-25T22:55:38.517874+0000","last_unstale":"2024-04-25T22:55:41.536366+0000","last_undegraded":"2024-04-25T22:55:41.536366+0000","last_fullsized":"2024-04-25T22:55:41.536366+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:45:27.635067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130188,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"55'126","reported_seq":423,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536210+0000","last_change":"2024-04-25T22:55:38.516209+0000","last_active":"2024-04-25T22:55:41.536210+0000","last_peered":"2024-04-25T22:55:41.536210+0000","last_clean":"2024-04-25T22:55:41.536210+0000","last_became_active":"2024-04-25T22:55:38.513558+0000","last_became_peered":"2024-04-25T22:55:38.513558+0000","last_unstale":"2024-04-25T22:55:41.536210+0000","last_undegraded":"2024-04-25T22:55:41.536210+0000","last_fullsized":"2024-04-25T22:55:41.536210+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:50.123900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142819,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":135761,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"55'173","reported_seq":559,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859149+0000","last_change":"2024-04-25T22:55:35.517931+0000","last_active":"2024-04-25T22:55:41.859149+0000","last_peered":"2024-04-25T22:55:41.859149+0000","last_clean":"2024-04-25T22:55:41.859149+0000","last_became_active":"2024-04-25T22:55:35.517044+0000","last_became_peered":"2024-04-25T22:55:35.517044+0000","last_unstale":"2024-04-25T22:55:41.859149+0000","last_undegraded":"2024-04-25T22:55:41.859149+0000","last_fullsized":"2024-04-25T22:55:41.859149+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:42.118131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":709662,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":119,"num_bytes_recovered":709653,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"55'173","reported_seq":516,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535750+0000","last_change":"2024-04-25T22:55:38.515187+0000","last_active":"2024-04-25T22:55:41.535750+0000","last_peered":"2024-04-25T22:55:41.535750+0000","last_clean":"2024-04-25T22:55:41.535750+0000","last_became_active":"2024-04-25T22:55:38.513456+0000","last_became_peered":"2024-04-25T22:55:38.513456+0000","last_unstale":"2024-04-25T22:55:41.535750+0000","last_undegraded":"2024-04-25T22:55:41.535750+0000","last_fullsized":"2024-04-25T22:55:41.535750+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:08:19.339484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569466,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":569466,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"55'173","reported_seq":541,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535869+0000","last_change":"2024-04-25T22:55:33.512839+0000","last_active":"2024-04-25T22:55:41.535869+0000","last_peered":"2024-04-25T22:55:41.535869+0000","last_clean":"2024-04-25T22:55:41.535869+0000","last_became_active":"2024-04-25T22:55:33.511961+0000","last_became_peered":"2024-04-25T22:55:33.511961+0000","last_unstale":"2024-04-25T22:55:41.535869+0000","last_undegraded":"2024-04-25T22:55:41.535869+0000","last_fullsized":"2024-04-25T22:55:41.535869+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:54:45.619674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75460,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":111,"num_bytes_recovered":75460,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"55'140","reported_seq":456,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535457+0000","last_change":"2024-04-25T22:55:32.510322+0000","last_active":"2024-04-25T22:55:41.535457+0000","last_peered":"2024-04-25T22:55:41.535457+0000","last_clean":"2024-04-25T22:55:41.535457+0000","last_became_active":"2024-04-25T22:55:32.509908+0000","last_became_peered":"2024-04-25T22:55:32.509908+0000","last_unstale":"2024-04-25T22:55:41.535457+0000","last_undegraded":"2024-04-25T22:55:41.535457+0000","last_fullsized":"2024-04-25T22:55:41.535457+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:16:15.948780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":214453,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":214404,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"55'169","reported_seq":274,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536936+0000","last_change":"2024-04-25T22:55:32.513084+0000","last_active":"2024-04-25T22:55:41.536936+0000","last_peered":"2024-04-25T22:55:41.536936+0000","last_clean":"2024-04-25T22:55:41.536936+0000","last_became_active":"2024-04-25T22:55:32.512447+0000","last_became_peered":"2024-04-25T22:55:32.512447+0000","last_unstale":"2024-04-25T22:55:41.536936+0000","last_undegraded":"2024-04-25T22:55:41.536936+0000","last_fullsized":"2024-04-25T22:55:41.536936+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:16:27.593679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":538374,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":538374,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"55'153","reported_seq":483,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859293+0000","last_change":"2024-04-25T22:55:35.518293+0000","last_active":"2024-04-25T22:55:41.859293+0000","last_peered":"2024-04-25T22:55:41.859293+0000","last_clean":"2024-04-25T22:55:41.859293+0000","last_became_active":"2024-04-25T22:55:35.517506+0000","last_became_peered":"2024-04-25T22:55:35.517506+0000","last_unstale":"2024-04-25T22:55:41.859293+0000","last_undegraded":"2024-04-25T22:55:41.859293+0000","last_fullsized":"2024-04-25T22:55:41.859293+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:42:09.860717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130447,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":123390,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"55'154","reported_seq":258,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536002+0000","last_change":"2024-04-25T22:55:40.538872+0000","last_active":"2024-04-25T22:55:41.536002+0000","last_peered":"2024-04-25T22:55:41.536002+0000","last_clean":"2024-04-25T22:55:41.536002+0000","last_became_active":"2024-04-25T22:55:40.538052+0000","last_became_peered":"2024-04-25T22:55:40.538052+0000","last_unstale":"2024-04-25T22:55:41.536002+0000","last_undegraded":"2024-04-25T22:55:41.536002+0000","last_fullsized":"2024-04-25T22:55:41.536002+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:06.239983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":343806,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":208,"num_bytes_recovered":687612,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"55'141","reported_seq":278,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858898+0000","last_change":"2024-04-25T22:51:53.028006+0000","last_active":"2024-04-25T22:55:41.858898+0000","last_peered":"2024-04-25T22:55:41.858898+0000","last_clean":"2024-04-25T22:55:41.858898+0000","last_became_active":"2024-04-25T22:51:53.027363+0000","last_became_peered":"2024-04-25T22:51:53.027363+0000","last_unstale":"2024-04-25T22:55:41.858898+0000","last_undegraded":"2024-04-25T22:55:41.858898+0000","last_fullsized":"2024-04-25T22:55:41.858898+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:32.923620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125409,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"55'135","reported_seq":459,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858862+0000","last_change":"2024-04-25T22:55:33.512249+0000","last_active":"2024-04-25T22:55:41.858862+0000","last_peered":"2024-04-25T22:55:41.858862+0000","last_clean":"2024-04-25T22:55:41.858862+0000","last_became_active":"2024-04-25T22:55:33.511546+0000","last_became_peered":"2024-04-25T22:55:33.511546+0000","last_unstale":"2024-04-25T22:55:41.858862+0000","last_undegraded":"2024-04-25T22:55:41.858862+0000","last_fullsized":"2024-04-25T22:55:41.858862+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:52:41.758279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":183835,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":183835,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"55'179","reported_seq":314,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535808+0000","last_change":"2024-04-25T22:51:53.022367+0000","last_active":"2024-04-25T22:55:41.535808+0000","last_peered":"2024-04-25T22:55:41.535808+0000","last_clean":"2024-04-25T22:55:41.535808+0000","last_became_active":"2024-04-25T22:51:53.021902+0000","last_became_peered":"2024-04-25T22:51:53.021902+0000","last_unstale":"2024-04-25T22:55:41.535808+0000","last_undegraded":"2024-04-25T22:55:41.535808+0000","last_fullsized":"2024-04-25T22:55:41.535808+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:44:59.401139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153371,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":181,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"55'161","reported_seq":273,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535564+0000","last_change":"2024-04-25T22:55:40.539371+0000","last_active":"2024-04-25T22:55:41.535564+0000","last_peered":"2024-04-25T22:55:41.535564+0000","last_clean":"2024-04-25T22:55:41.535564+0000","last_became_active":"2024-04-25T22:55:40.538095+0000","last_became_peered":"2024-04-25T22:55:40.538095+0000","last_unstale":"2024-04-25T22:55:41.535564+0000","last_undegraded":"2024-04-25T22:55:41.535564+0000","last_fullsized":"2024-04-25T22:55:41.535564+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:57.514231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4276239,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":4418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":4276214,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"55'179","reported_seq":551,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535530+0000","last_change":"2024-04-25T22:55:31.526766+0000","last_active":"2024-04-25T22:55:41.535530+0000","last_peered":"2024-04-25T22:55:41.535530+0000","last_clean":"2024-04-25T22:55:41.535530+0000","last_became_active":"2024-04-25T22:55:31.526271+0000","last_became_peered":"2024-04-25T22:55:31.526271+0000","last_unstale":"2024-04-25T22:55:41.535530+0000","last_undegraded":"2024-04-25T22:55:41.535530+0000","last_fullsized":"2024-04-25T22:55:41.535530+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:48:39.183880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4371943,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":4513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":4363238,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"55'163","reported_seq":268,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536806+0000","last_change":"2024-04-25T22:55:32.513240+0000","last_active":"2024-04-25T22:55:41.536806+0000","last_peered":"2024-04-25T22:55:41.536806+0000","last_clean":"2024-04-25T22:55:41.536806+0000","last_became_active":"2024-04-25T22:55:32.512371+0000","last_became_peered":"2024-04-25T22:55:32.512371+0000","last_unstale":"2024-04-25T22:55:41.536806+0000","last_undegraded":"2024-04-25T22:55:41.536806+0000","last_fullsized":"2024-04-25T22:55:41.536806+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:23.735382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96221,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":87110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"55'147","reported_seq":487,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859496+0000","last_change":"2024-04-25T22:55:35.519379+0000","last_active":"2024-04-25T22:55:41.859496+0000","last_peered":"2024-04-25T22:55:41.859496+0000","last_clean":"2024-04-25T22:55:41.859496+0000","last_became_active":"2024-04-25T22:55:35.518584+0000","last_became_peered":"2024-04-25T22:55:35.518584+0000","last_unstale":"2024-04-25T22:55:41.859496+0000","last_undegraded":"2024-04-25T22:55:41.859496+0000","last_fullsized":"2024-04-25T22:55:41.859496+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:33:50.992444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1432264,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":1532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":1432241,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"55'146","reported_seq":255,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536568+0000","last_change":"2024-04-25T22:55:30.527560+0000","last_active":"2024-04-25T22:55:41.536568+0000","last_peered":"2024-04-25T22:55:41.536568+0000","last_clean":"2024-04-25T22:55:41.536568+0000","last_became_active":"2024-04-25T22:55:30.526745+0000","last_became_peered":"2024-04-25T22:55:30.526745+0000","last_unstale":"2024-04-25T22:55:41.536568+0000","last_undegraded":"2024-04-25T22:55:41.536568+0000","last_fullsized":"2024-04-25T22:55:41.536568+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:40:08.494734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112933,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":112933,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"55'178","reported_seq":548,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536195+0000","last_change":"2024-04-25T22:55:34.512671+0000","last_active":"2024-04-25T22:55:41.536195+0000","last_peered":"2024-04-25T22:55:41.536195+0000","last_clean":"2024-04-25T22:55:41.536195+0000","last_became_active":"2024-04-25T22:55:34.511872+0000","last_became_peered":"2024-04-25T22:55:34.511872+0000","last_unstale":"2024-04-25T22:55:41.536195+0000","last_undegraded":"2024-04-25T22:55:41.536195+0000","last_fullsized":"2024-04-25T22:55:41.536195+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:43:12.293070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124334,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":124334,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"55'158","reported_seq":500,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535980+0000","last_change":"2024-04-25T22:55:34.512430+0000","last_active":"2024-04-25T22:55:41.535980+0000","last_peered":"2024-04-25T22:55:41.535980+0000","last_clean":"2024-04-25T22:55:41.535980+0000","last_became_active":"2024-04-25T22:55:34.511833+0000","last_became_peered":"2024-04-25T22:55:34.511833+0000","last_unstale":"2024-04-25T22:55:41.535980+0000","last_undegraded":"2024-04-25T22:55:41.535980+0000","last_fullsized":"2024-04-25T22:55:41.535980+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:52:03.534174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145029,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":145029,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"55'171","reported_seq":308,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858838+0000","last_change":"2024-04-25T22:51:53.026746+0000","last_active":"2024-04-25T22:55:41.858838+0000","last_peered":"2024-04-25T22:55:41.858838+0000","last_clean":"2024-04-25T22:55:41.858838+0000","last_became_active":"2024-04-25T22:51:53.025938+0000","last_became_peered":"2024-04-25T22:51:53.025938+0000","last_unstale":"2024-04-25T22:55:41.858838+0000","last_undegraded":"2024-04-25T22:55:41.858838+0000","last_fullsized":"2024-04-25T22:55:41.858838+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:38:03.428258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115019,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"55'161","reported_seq":262,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535818+0000","last_change":"2024-04-25T22:55:33.513307+0000","last_active":"2024-04-25T22:55:41.535818+0000","last_peered":"2024-04-25T22:55:41.535818+0000","last_clean":"2024-04-25T22:55:41.535818+0000","last_became_active":"2024-04-25T22:55:33.512160+0000","last_became_peered":"2024-04-25T22:55:33.512160+0000","last_unstale":"2024-04-25T22:55:41.535818+0000","last_undegraded":"2024-04-25T22:55:41.535818+0000","last_fullsized":"2024-04-25T22:55:41.535818+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:57:16.042728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":641227,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":641227,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"55'169","reported_seq":525,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858515+0000","last_change":"2024-04-25T22:55:33.512249+0000","last_active":"2024-04-25T22:55:41.858515+0000","last_peered":"2024-04-25T22:55:41.858515+0000","last_clean":"2024-04-25T22:55:41.858515+0000","last_became_active":"2024-04-25T22:55:33.511463+0000","last_became_peered":"2024-04-25T22:55:33.511463+0000","last_unstale":"2024-04-25T22:55:41.858515+0000","last_undegraded":"2024-04-25T22:55:41.858515+0000","last_fullsized":"2024-04-25T22:55:41.858515+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:54:45.619674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103634,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":189,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":98869,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"55'159","reported_seq":296,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859682+0000","last_change":"2024-04-25T22:51:53.028155+0000","last_active":"2024-04-25T22:55:41.859682+0000","last_peered":"2024-04-25T22:55:41.859682+0000","last_clean":"2024-04-25T22:55:41.859682+0000","last_became_active":"2024-04-25T22:51:53.027867+0000","last_became_peered":"2024-04-25T22:51:53.027867+0000","last_unstale":"2024-04-25T22:55:41.859682+0000","last_undegraded":"2024-04-25T22:55:41.859682+0000","last_fullsized":"2024-04-25T22:55:41.859682+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:43:47.453569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272252,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"55'190","reported_seq":289,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536880+0000","last_change":"2024-04-25T22:55:34.513270+0000","last_active":"2024-04-25T22:55:41.536880+0000","last_peered":"2024-04-25T22:55:41.536880+0000","last_clean":"2024-04-25T22:55:41.536880+0000","last_became_active":"2024-04-25T22:55:34.512320+0000","last_became_peered":"2024-04-25T22:55:34.512320+0000","last_unstale":"2024-04-25T22:55:41.536880+0000","last_undegraded":"2024-04-25T22:55:41.536880+0000","last_fullsized":"2024-04-25T22:55:41.536880+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:37.486013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126403,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":117,"num_bytes_recovered":126342,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"55'151","reported_seq":286,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536427+0000","last_change":"2024-04-25T22:51:53.022893+0000","last_active":"2024-04-25T22:55:41.536427+0000","last_peered":"2024-04-25T22:55:41.536427+0000","last_clean":"2024-04-25T22:55:41.536427+0000","last_became_active":"2024-04-25T22:51:53.022407+0000","last_became_peered":"2024-04-25T22:51:53.022407+0000","last_unstale":"2024-04-25T22:55:41.536427+0000","last_undegraded":"2024-04-25T22:55:41.536427+0000","last_fullsized":"2024-04-25T22:55:41.536427+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:08:44.404718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69245,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"55'147","reported_seq":284,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859212+0000","last_change":"2024-04-25T22:51:53.028447+0000","last_active":"2024-04-25T22:55:41.859212+0000","last_peered":"2024-04-25T22:55:41.859212+0000","last_clean":"2024-04-25T22:55:41.859212+0000","last_became_active":"2024-04-25T22:51:53.027852+0000","last_became_peered":"2024-04-25T22:51:53.027852+0000","last_unstale":"2024-04-25T22:55:41.859212+0000","last_undegraded":"2024-04-25T22:55:41.859212+0000","last_fullsized":"2024-04-25T22:55:41.859212+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:16.187194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192848,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"55'166","reported_seq":267,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535904+0000","last_change":"2024-04-25T22:55:34.514981+0000","last_active":"2024-04-25T22:55:41.535904+0000","last_peered":"2024-04-25T22:55:41.535904+0000","last_clean":"2024-04-25T22:55:41.535904+0000","last_became_active":"2024-04-25T22:55:34.514067+0000","last_became_peered":"2024-04-25T22:55:34.514067+0000","last_unstale":"2024-04-25T22:55:41.535904+0000","last_undegraded":"2024-04-25T22:55:41.535904+0000","last_fullsized":"2024-04-25T22:55:41.535904+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:05:49.273497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239074,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":239074,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"55'191","reported_seq":328,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859081+0000","last_change":"2024-04-25T22:51:53.026997+0000","last_active":"2024-04-25T22:55:41.859081+0000","last_peered":"2024-04-25T22:55:41.859081+0000","last_clean":"2024-04-25T22:55:41.859081+0000","last_became_active":"2024-04-25T22:51:53.026379+0000","last_became_peered":"2024-04-25T22:51:53.026379+0000","last_unstale":"2024-04-25T22:55:41.859081+0000","last_undegraded":"2024-04-25T22:55:41.859081+0000","last_fullsized":"2024-04-25T22:55:41.859081+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:33:24.700106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99668,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"55'193","reported_seq":298,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536272+0000","last_change":"2024-04-25T22:55:32.511886+0000","last_active":"2024-04-25T22:55:41.536272+0000","last_peered":"2024-04-25T22:55:41.536272+0000","last_clean":"2024-04-25T22:55:41.536272+0000","last_became_active":"2024-04-25T22:55:32.509978+0000","last_became_peered":"2024-04-25T22:55:32.509978+0000","last_unstale":"2024-04-25T22:55:41.536272+0000","last_undegraded":"2024-04-25T22:55:41.536272+0000","last_fullsized":"2024-04-25T22:55:41.536272+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:56:47.747527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128069,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":128069,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"55'182","reported_seq":537,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535588+0000","last_change":"2024-04-25T22:55:38.519451+0000","last_active":"2024-04-25T22:55:41.535588+0000","last_peered":"2024-04-25T22:55:41.535588+0000","last_clean":"2024-04-25T22:55:41.535588+0000","last_became_active":"2024-04-25T22:55:38.518412+0000","last_became_peered":"2024-04-25T22:55:38.518412+0000","last_unstale":"2024-04-25T22:55:41.535588+0000","last_undegraded":"2024-04-25T22:55:41.535588+0000","last_fullsized":"2024-04-25T22:55:41.535588+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:27.179735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":586629,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":580754,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"55'156","reported_seq":494,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859060+0000","last_change":"2024-04-25T22:55:33.512918+0000","last_active":"2024-04-25T22:55:41.859060+0000","last_peered":"2024-04-25T22:55:41.859060+0000","last_clean":"2024-04-25T22:55:41.859060+0000","last_became_active":"2024-04-25T22:55:33.512114+0000","last_became_peered":"2024-04-25T22:55:33.512114+0000","last_unstale":"2024-04-25T22:55:41.859060+0000","last_undegraded":"2024-04-25T22:55:41.859060+0000","last_fullsized":"2024-04-25T22:55:41.859060+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:52:03.534174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118861,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":118861,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"60'105","reported_seq":256,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536115+0000","last_change":"2024-04-25T22:55:30.526027+0000","last_active":"2024-04-25T22:55:41.536115+0000","last_peered":"2024-04-25T22:55:41.536115+0000","last_clean":"2024-04-25T22:55:41.536115+0000","last_became_active":"2024-04-25T22:55:30.525469+0000","last_became_peered":"2024-04-25T22:55:30.525469+0000","last_unstale":"2024-04-25T22:55:41.536115+0000","last_undegraded":"2024-04-25T22:55:41.536115+0000","last_fullsized":"2024-04-25T22:55:41.536115+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:18:16.878967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2425045,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":2428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":2425011,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"55'146","reported_seq":472,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859394+0000","last_change":"2024-04-25T22:55:30.525674+0000","last_active":"2024-04-25T22:55:41.859394+0000","last_peered":"2024-04-25T22:55:41.859394+0000","last_clean":"2024-04-25T22:55:41.859394+0000","last_became_active":"2024-04-25T22:55:30.524718+0000","last_became_peered":"2024-04-25T22:55:30.524718+0000","last_unstale":"2024-04-25T22:55:41.859394+0000","last_undegraded":"2024-04-25T22:55:41.859394+0000","last_fullsized":"2024-04-25T22:55:41.859394+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:48:39.183880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67079,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":89,"num_bytes_recovered":67079,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":48,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535977+0000","last_change":"2024-04-25T22:55:27.517626+0000","last_active":"2024-04-25T22:55:41.535977+0000","last_peered":"2024-04-25T22:55:41.535977+0000","last_clean":"2024-04-25T22:55:41.535977+0000","last_became_active":"2024-04-25T22:55:27.517208+0000","last_became_peered":"2024-04-25T22:55:27.517208+0000","last_unstale":"2024-04-25T22:55:41.535977+0000","last_undegraded":"2024-04-25T22:55:41.535977+0000","last_fullsized":"2024-04-25T22:55:41.535977+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:09.249311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"55'186","reported_seq":287,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536662+0000","last_change":"2024-04-25T22:55:33.513626+0000","last_active":"2024-04-25T22:55:41.536662+0000","last_peered":"2024-04-25T22:55:41.536662+0000","last_clean":"2024-04-25T22:55:41.536662+0000","last_became_active":"2024-04-25T22:55:33.512389+0000","last_became_peered":"2024-04-25T22:55:33.512389+0000","last_unstale":"2024-04-25T22:55:41.536662+0000","last_undegraded":"2024-04-25T22:55:41.536662+0000","last_fullsized":"2024-04-25T22:55:41.536662+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:02:53.672517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139986,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":137763,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":139,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859045+0000","last_change":"2024-04-25T22:51:52.018646+0000","last_active":"2024-04-25T22:55:41.859045+0000","last_peered":"2024-04-25T22:55:41.859045+0000","last_clean":"2024-04-25T22:55:41.859045+0000","last_became_active":"2024-04-25T22:51:52.018313+0000","last_became_peered":"2024-04-25T22:51:52.018313+0000","last_unstale":"2024-04-25T22:55:41.859045+0000","last_undegraded":"2024-04-25T22:55:41.859045+0000","last_fullsized":"2024-04-25T22:55:41.859045+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:00:21.688745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"55'167","reported_seq":274,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536676+0000","last_change":"2024-04-25T22:55:30.527435+0000","last_active":"2024-04-25T22:55:41.536676+0000","last_peered":"2024-04-25T22:55:41.536676+0000","last_clean":"2024-04-25T22:55:41.536676+0000","last_became_active":"2024-04-25T22:55:30.526276+0000","last_became_peered":"2024-04-25T22:55:30.526276+0000","last_unstale":"2024-04-25T22:55:41.536676+0000","last_undegraded":"2024-04-25T22:55:41.536676+0000","last_fullsized":"2024-04-25T22:55:41.536676+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:03:39.273168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87849,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":87849,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":145,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535666+0000","last_change":"2024-04-25T22:51:52.021510+0000","last_active":"2024-04-25T22:55:41.535666+0000","last_peered":"2024-04-25T22:55:41.535666+0000","last_clean":"2024-04-25T22:55:41.535666+0000","last_became_active":"2024-04-25T22:51:52.021145+0000","last_became_peered":"2024-04-25T22:51:52.021145+0000","last_unstale":"2024-04-25T22:55:41.535666+0000","last_undegraded":"2024-04-25T22:55:41.535666+0000","last_fullsized":"2024-04-25T22:55:41.535666+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:05.110747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"52'2","reported_seq":139,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536823+0000","last_change":"2024-04-25T22:51:52.021355+0000","last_active":"2024-04-25T22:55:41.536823+0000","last_peered":"2024-04-25T22:55:41.536823+0000","last_clean":"2024-04-25T22:55:41.536823+0000","last_became_active":"2024-04-25T22:51:52.020860+0000","last_became_peered":"2024-04-25T22:51:52.020860+0000","last_unstale":"2024-04-25T22:55:41.536823+0000","last_undegraded":"2024-04-25T22:55:41.536823+0000","last_fullsized":"2024-04-25T22:55:41.536823+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:55.235787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"55'157","reported_seq":294,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858543+0000","last_change":"2024-04-25T22:51:53.029390+0000","last_active":"2024-04-25T22:55:41.858543+0000","last_peered":"2024-04-25T22:55:41.858543+0000","last_clean":"2024-04-25T22:55:41.858543+0000","last_became_active":"2024-04-25T22:51:53.029157+0000","last_became_peered":"2024-04-25T22:51:53.029157+0000","last_unstale":"2024-04-25T22:55:41.858543+0000","last_undegraded":"2024-04-25T22:55:41.858543+0000","last_fullsized":"2024-04-25T22:55:41.858543+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:51:43.808994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190158,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"48'3","reported_seq":142,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859570+0000","last_change":"2024-04-25T22:51:52.018856+0000","last_active":"2024-04-25T22:55:41.859570+0000","last_peered":"2024-04-25T22:55:41.859570+0000","last_clean":"2024-04-25T22:55:41.859570+0000","last_became_active":"2024-04-25T22:51:52.018390+0000","last_became_peered":"2024-04-25T22:51:52.018390+0000","last_unstale":"2024-04-25T22:55:41.859570+0000","last_undegraded":"2024-04-25T22:55:41.859570+0000","last_fullsized":"2024-04-25T22:55:41.859570+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:42:54.430484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"55'171","reported_seq":539,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858599+0000","last_change":"2024-04-25T22:55:31.527677+0000","last_active":"2024-04-25T22:55:41.858599+0000","last_peered":"2024-04-25T22:55:41.858599+0000","last_clean":"2024-04-25T22:55:41.858599+0000","last_became_active":"2024-04-25T22:55:31.527049+0000","last_became_peered":"2024-04-25T22:55:31.527049+0000","last_unstale":"2024-04-25T22:55:41.858599+0000","last_undegraded":"2024-04-25T22:55:41.858599+0000","last_fullsized":"2024-04-25T22:55:41.858599+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:16:15.948780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":315325,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":191,"num_write_kb":549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":110,"num_bytes_recovered":301306,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":45,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536688+0000","last_change":"2024-04-25T22:55:38.519011+0000","last_active":"2024-04-25T22:55:41.536688+0000","last_peered":"2024-04-25T22:55:41.536688+0000","last_clean":"2024-04-25T22:55:41.536688+0000","last_became_active":"2024-04-25T22:55:38.517362+0000","last_became_peered":"2024-04-25T22:55:38.517362+0000","last_unstale":"2024-04-25T22:55:41.536688+0000","last_undegraded":"2024-04-25T22:55:41.536688+0000","last_fullsized":"2024-04-25T22:55:41.536688+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:30:15.580001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"55'153","reported_seq":486,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536056+0000","last_change":"2024-04-25T22:55:38.515892+0000","last_active":"2024-04-25T22:55:41.536056+0000","last_peered":"2024-04-25T22:55:41.536056+0000","last_clean":"2024-04-25T22:55:41.536056+0000","last_became_active":"2024-04-25T22:55:38.514319+0000","last_became_peered":"2024-04-25T22:55:38.514319+0000","last_unstale":"2024-04-25T22:55:41.536056+0000","last_undegraded":"2024-04-25T22:55:41.536056+0000","last_fullsized":"2024-04-25T22:55:41.536056+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:42.118131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97209,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":97196,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"51'1","reported_seq":115,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536541+0000","last_change":"2024-04-25T22:55:38.518279+0000","last_active":"2024-04-25T22:55:41.536541+0000","last_peered":"2024-04-25T22:55:41.536541+0000","last_clean":"2024-04-25T22:55:41.536541+0000","last_became_active":"2024-04-25T22:55:38.516782+0000","last_became_peered":"2024-04-25T22:55:38.516782+0000","last_unstale":"2024-04-25T22:55:41.536541+0000","last_undegraded":"2024-04-25T22:55:41.536541+0000","last_fullsized":"2024-04-25T22:55:41.536541+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:27:46.635381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"55'153","reported_seq":256,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536313+0000","last_change":"2024-04-25T22:55:32.511660+0000","last_active":"2024-04-25T22:55:41.536313+0000","last_peered":"2024-04-25T22:55:41.536313+0000","last_clean":"2024-04-25T22:55:41.536313+0000","last_became_active":"2024-04-25T22:55:32.510402+0000","last_became_peered":"2024-04-25T22:55:32.510402+0000","last_unstale":"2024-04-25T22:55:41.536313+0000","last_undegraded":"2024-04-25T22:55:41.536313+0000","last_fullsized":"2024-04-25T22:55:41.536313+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:13:03.774101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131384,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":131332,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"47'7","reported_seq":56,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536115+0000","last_change":"2024-04-25T22:55:27.566798+0000","last_active":"2024-04-25T22:55:41.536115+0000","last_peered":"2024-04-25T22:55:41.536115+0000","last_clean":"2024-04-25T22:55:41.536115+0000","last_became_active":"2024-04-25T22:55:27.518709+0000","last_became_peered":"2024-04-25T22:55:27.518709+0000","last_unstale":"2024-04-25T22:55:41.536115+0000","last_undegraded":"2024-04-25T22:55:41.536115+0000","last_fullsized":"2024-04-25T22:55:41.536115+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:07:47.758073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"55'174","reported_seq":521,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536332+0000","last_change":"2024-04-25T22:55:38.517785+0000","last_active":"2024-04-25T22:55:41.536332+0000","last_peered":"2024-04-25T22:55:41.536332+0000","last_clean":"2024-04-25T22:55:41.536332+0000","last_became_active":"2024-04-25T22:55:38.514695+0000","last_became_peered":"2024-04-25T22:55:38.514695+0000","last_unstale":"2024-04-25T22:55:41.536332+0000","last_undegraded":"2024-04-25T22:55:41.536332+0000","last_fullsized":"2024-04-25T22:55:41.536332+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:33:50.992444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187245,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":111,"num_bytes_recovered":187245,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":144,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536245+0000","last_change":"2024-04-25T22:55:27.517686+0000","last_active":"2024-04-25T22:55:41.536245+0000","last_peered":"2024-04-25T22:55:41.536245+0000","last_clean":"2024-04-25T22:55:41.536245+0000","last_became_active":"2024-04-25T22:55:27.517404+0000","last_became_peered":"2024-04-25T22:55:27.517404+0000","last_unstale":"2024-04-25T22:55:41.536245+0000","last_undegraded":"2024-04-25T22:55:41.536245+0000","last_fullsized":"2024-04-25T22:55:41.536245+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:11.671572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"55'163","reported_seq":298,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536548+0000","last_change":"2024-04-25T22:51:53.023929+0000","last_active":"2024-04-25T22:55:41.536548+0000","last_peered":"2024-04-25T22:55:41.536548+0000","last_clean":"2024-04-25T22:55:41.536548+0000","last_became_active":"2024-04-25T22:51:53.023405+0000","last_became_peered":"2024-04-25T22:51:53.023405+0000","last_unstale":"2024-04-25T22:55:41.536548+0000","last_undegraded":"2024-04-25T22:55:41.536548+0000","last_fullsized":"2024-04-25T22:55:41.536548+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:35:35.419823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130867,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":156,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859401+0000","last_change":"2024-04-25T22:55:37.516071+0000","last_active":"2024-04-25T22:55:41.859401+0000","last_peered":"2024-04-25T22:55:41.859401+0000","last_clean":"2024-04-25T22:55:41.859401+0000","last_became_active":"2024-04-25T22:55:37.515798+0000","last_became_peered":"2024-04-25T22:55:37.515798+0000","last_unstale":"2024-04-25T22:55:41.859401+0000","last_undegraded":"2024-04-25T22:55:41.859401+0000","last_fullsized":"2024-04-25T22:55:41.859401+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:27:46.635381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"55'139","reported_seq":274,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536510+0000","last_change":"2024-04-25T22:51:53.020574+0000","last_active":"2024-04-25T22:55:41.536510+0000","last_peered":"2024-04-25T22:55:41.536510+0000","last_clean":"2024-04-25T22:55:41.536510+0000","last_became_active":"2024-04-25T22:51:53.019978+0000","last_became_peered":"2024-04-25T22:51:53.019978+0000","last_unstale":"2024-04-25T22:55:41.536510+0000","last_undegraded":"2024-04-25T22:55:41.536510+0000","last_fullsized":"2024-04-25T22:55:41.536510+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:41.205051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197405,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"51'1","reported_seq":147,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858624+0000","last_change":"2024-04-25T22:55:27.517695+0000","last_active":"2024-04-25T22:55:41.858624+0000","last_peered":"2024-04-25T22:55:41.858624+0000","last_clean":"2024-04-25T22:55:41.858624+0000","last_became_active":"2024-04-25T22:55:27.517330+0000","last_became_peered":"2024-04-25T22:55:27.517330+0000","last_unstale":"2024-04-25T22:55:41.858624+0000","last_undegraded":"2024-04-25T22:55:41.858624+0000","last_fullsized":"2024-04-25T22:55:41.858624+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:15:30.181042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"55'145","reported_seq":252,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.537124+0000","last_change":"2024-04-25T22:55:31.528962+0000","last_active":"2024-04-25T22:55:41.537124+0000","last_peered":"2024-04-25T22:55:41.537124+0000","last_clean":"2024-04-25T22:55:41.537124+0000","last_became_active":"2024-04-25T22:55:31.528360+0000","last_became_peered":"2024-04-25T22:55:31.528360+0000","last_unstale":"2024-04-25T22:55:41.537124+0000","last_undegraded":"2024-04-25T22:55:41.537124+0000","last_fullsized":"2024-04-25T22:55:41.537124+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:27:45.223109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165168,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":165116,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":339,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536012+0000","last_change":"2024-04-25T22:51:47.764624+0000","last_active":"2024-04-25T22:55:41.536012+0000","last_peered":"2024-04-25T22:55:41.536012+0000","last_clean":"2024-04-25T22:55:41.536012+0000","last_became_active":"2024-04-25T22:51:47.764176+0000","last_became_peered":"2024-04-25T22:51:47.764176+0000","last_unstale":"2024-04-25T22:55:41.536012+0000","last_undegraded":"2024-04-25T22:55:41.536012+0000","last_fullsized":"2024-04-25T22:55:41.536012+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:59:39.005489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":150,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536222+0000","last_change":"2024-04-25T22:55:27.521219+0000","last_active":"2024-04-25T22:55:41.536222+0000","last_peered":"2024-04-25T22:55:41.536222+0000","last_clean":"2024-04-25T22:55:41.536222+0000","last_became_active":"2024-04-25T22:55:27.520951+0000","last_became_peered":"2024-04-25T22:55:27.520951+0000","last_unstale":"2024-04-25T22:55:41.536222+0000","last_undegraded":"2024-04-25T22:55:41.536222+0000","last_fullsized":"2024-04-25T22:55:41.536222+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:48:53.391950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"51'2","reported_seq":48,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536134+0000","last_change":"2024-04-25T22:55:27.520902+0000","last_active":"2024-04-25T22:55:41.536134+0000","last_peered":"2024-04-25T22:55:41.536134+0000","last_clean":"2024-04-25T22:55:41.536134+0000","last_became_active":"2024-04-25T22:55:27.520466+0000","last_became_peered":"2024-04-25T22:55:27.520466+0000","last_unstale":"2024-04-25T22:55:41.536134+0000","last_undegraded":"2024-04-25T22:55:41.536134+0000","last_fullsized":"2024-04-25T22:55:41.536134+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:18:17.518924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"55'150","reported_seq":285,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536563+0000","last_change":"2024-04-25T22:51:53.024106+0000","last_active":"2024-04-25T22:55:41.536563+0000","last_peered":"2024-04-25T22:55:41.536563+0000","last_clean":"2024-04-25T22:55:41.536563+0000","last_became_active":"2024-04-25T22:51:53.023497+0000","last_became_peered":"2024-04-25T22:51:53.023497+0000","last_unstale":"2024-04-25T22:55:41.536563+0000","last_undegraded":"2024-04-25T22:55:41.536563+0000","last_fullsized":"2024-04-25T22:55:41.536563+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:52:16.918935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":331484,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":143,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536139+0000","last_change":"2024-04-25T22:51:47.764591+0000","last_active":"2024-04-25T22:55:41.536139+0000","last_peered":"2024-04-25T22:55:41.536139+0000","last_clean":"2024-04-25T22:55:41.536139+0000","last_became_active":"2024-04-25T22:51:47.764229+0000","last_became_peered":"2024-04-25T22:51:47.764229+0000","last_unstale":"2024-04-25T22:55:41.536139+0000","last_undegraded":"2024-04-25T22:55:41.536139+0000","last_fullsized":"2024-04-25T22:55:41.536139+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:32.854624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"53'36","reported_seq":52,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535631+0000","last_change":"2024-04-25T22:55:27.524404+0000","last_active":"2024-04-25T22:55:41.535631+0000","last_peered":"2024-04-25T22:55:41.535631+0000","last_clean":"2024-04-25T22:55:41.535631+0000","last_became_active":"2024-04-25T22:55:27.517290+0000","last_became_peered":"2024-04-25T22:55:27.517290+0000","last_unstale":"2024-04-25T22:55:41.535631+0000","last_undegraded":"2024-04-25T22:55:41.535631+0000","last_fullsized":"2024-04-25T22:55:41.535631+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:34.809551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327644,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":343,"num_write":34,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":327644,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"55'163","reported_seq":517,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859336+0000","last_change":"2024-04-25T22:55:35.519401+0000","last_active":"2024-04-25T22:55:41.859336+0000","last_peered":"2024-04-25T22:55:41.859336+0000","last_clean":"2024-04-25T22:55:41.859336+0000","last_became_active":"2024-04-25T22:55:35.518367+0000","last_became_peered":"2024-04-25T22:55:35.518367+0000","last_unstale":"2024-04-25T22:55:41.859336+0000","last_undegraded":"2024-04-25T22:55:41.859336+0000","last_fullsized":"2024-04-25T22:55:41.859336+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:51.343892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297937,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":181,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":282175,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":48,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535954+0000","last_change":"2024-04-25T22:55:27.519726+0000","last_active":"2024-04-25T22:55:41.535954+0000","last_peered":"2024-04-25T22:55:41.535954+0000","last_clean":"2024-04-25T22:55:41.535954+0000","last_became_active":"2024-04-25T22:55:27.518412+0000","last_became_peered":"2024-04-25T22:55:27.518412+0000","last_unstale":"2024-04-25T22:55:41.535954+0000","last_undegraded":"2024-04-25T22:55:41.535954+0000","last_fullsized":"2024-04-25T22:55:41.535954+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:32:35.203827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"51'62","reported_seq":201,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858672+0000","last_change":"2024-04-25T22:51:52.018873+0000","last_active":"2024-04-25T22:55:41.858672+0000","last_peered":"2024-04-25T22:55:41.858672+0000","last_clean":"2024-04-25T22:55:41.858672+0000","last_became_active":"2024-04-25T22:51:52.018300+0000","last_became_peered":"2024-04-25T22:51:52.018300+0000","last_unstale":"2024-04-25T22:55:41.858672+0000","last_undegraded":"2024-04-25T22:55:41.858672+0000","last_fullsized":"2024-04-25T22:55:41.858672+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:25:22.660789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":4122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"55'167","reported_seq":272,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.537064+0000","last_change":"2024-04-25T22:55:32.513689+0000","last_active":"2024-04-25T22:55:41.537064+0000","last_peered":"2024-04-25T22:55:41.537064+0000","last_clean":"2024-04-25T22:55:41.537064+0000","last_became_active":"2024-04-25T22:55:32.513087+0000","last_became_peered":"2024-04-25T22:55:32.513087+0000","last_unstale":"2024-04-25T22:55:41.537064+0000","last_undegraded":"2024-04-25T22:55:41.537064+0000","last_fullsized":"2024-04-25T22:55:41.537064+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:36:56.592254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395473,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":166,"num_write_kb":573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":395432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":150,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536310+0000","last_change":"2024-04-25T22:55:27.517303+0000","last_active":"2024-04-25T22:55:41.536310+0000","last_peered":"2024-04-25T22:55:41.536310+0000","last_clean":"2024-04-25T22:55:41.536310+0000","last_became_active":"2024-04-25T22:55:27.516952+0000","last_became_peered":"2024-04-25T22:55:27.516952+0000","last_unstale":"2024-04-25T22:55:41.536310+0000","last_undegraded":"2024-04-25T22:55:41.536310+0000","last_fullsized":"2024-04-25T22:55:41.536310+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:15:25.939805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":114,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536155+0000","last_change":"2024-04-25T22:55:38.518160+0000","last_active":"2024-04-25T22:55:41.536155+0000","last_peered":"2024-04-25T22:55:41.536155+0000","last_clean":"2024-04-25T22:55:41.536155+0000","last_became_active":"2024-04-25T22:55:38.516294+0000","last_became_peered":"2024-04-25T22:55:38.516294+0000","last_unstale":"2024-04-25T22:55:41.536155+0000","last_undegraded":"2024-04-25T22:55:41.536155+0000","last_fullsized":"2024-04-25T22:55:41.536155+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:50.339431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"55'156","reported_seq":263,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536316+0000","last_change":"2024-04-25T22:55:31.527813+0000","last_active":"2024-04-25T22:55:41.536316+0000","last_peered":"2024-04-25T22:55:41.536316+0000","last_clean":"2024-04-25T22:55:41.536316+0000","last_became_active":"2024-04-25T22:55:31.526666+0000","last_became_peered":"2024-04-25T22:55:31.526666+0000","last_unstale":"2024-04-25T22:55:41.536316+0000","last_undegraded":"2024-04-25T22:55:41.536316+0000","last_fullsized":"2024-04-25T22:55:41.536316+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:18.548926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100051,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":100051,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"52'1","reported_seq":145,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536734+0000","last_change":"2024-04-25T22:55:27.517150+0000","last_active":"2024-04-25T22:55:41.536734+0000","last_peered":"2024-04-25T22:55:41.536734+0000","last_clean":"2024-04-25T22:55:41.536734+0000","last_became_active":"2024-04-25T22:55:27.516760+0000","last_became_peered":"2024-04-25T22:55:27.516760+0000","last_unstale":"2024-04-25T22:55:41.536734+0000","last_undegraded":"2024-04-25T22:55:41.536734+0000","last_fullsized":"2024-04-25T22:55:41.536734+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:20:13.546931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536169+0000","last_change":"2024-04-25T22:55:27.517202+0000","last_active":"2024-04-25T22:55:41.536169+0000","last_peered":"2024-04-25T22:55:41.536169+0000","last_clean":"2024-04-25T22:55:41.536169+0000","last_became_active":"2024-04-25T22:55:27.516272+0000","last_became_peered":"2024-04-25T22:55:27.516272+0000","last_unstale":"2024-04-25T22:55:41.536169+0000","last_undegraded":"2024-04-25T22:55:41.536169+0000","last_fullsized":"2024-04-25T22:55:41.536169+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:43:32.692434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"55'155","reported_seq":292,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858903+0000","last_change":"2024-04-25T22:51:53.026321+0000","last_active":"2024-04-25T22:55:41.858903+0000","last_peered":"2024-04-25T22:55:41.858903+0000","last_clean":"2024-04-25T22:55:41.858903+0000","last_became_active":"2024-04-25T22:51:53.025824+0000","last_became_peered":"2024-04-25T22:51:53.025824+0000","last_unstale":"2024-04-25T22:55:41.858903+0000","last_undegraded":"2024-04-25T22:55:41.858903+0000","last_fullsized":"2024-04-25T22:55:41.858903+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:12:00.793718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67397,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536444+0000","last_change":"2024-04-25T22:55:27.516710+0000","last_active":"2024-04-25T22:55:41.536444+0000","last_peered":"2024-04-25T22:55:41.536444+0000","last_clean":"2024-04-25T22:55:41.536444+0000","last_became_active":"2024-04-25T22:55:27.515536+0000","last_became_peered":"2024-04-25T22:55:27.515536+0000","last_unstale":"2024-04-25T22:55:41.536444+0000","last_undegraded":"2024-04-25T22:55:41.536444+0000","last_fullsized":"2024-04-25T22:55:41.536444+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:42:01.941338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":152,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859759+0000","last_change":"2024-04-25T22:55:27.517692+0000","last_active":"2024-04-25T22:55:41.859759+0000","last_peered":"2024-04-25T22:55:41.859759+0000","last_clean":"2024-04-25T22:55:41.859759+0000","last_became_active":"2024-04-25T22:55:27.517411+0000","last_became_peered":"2024-04-25T22:55:27.517411+0000","last_unstale":"2024-04-25T22:55:41.859759+0000","last_undegraded":"2024-04-25T22:55:41.859759+0000","last_fullsized":"2024-04-25T22:55:41.859759+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:20:09.305694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"55'175","reported_seq":312,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858983+0000","last_change":"2024-04-25T22:51:53.027051+0000","last_active":"2024-04-25T22:55:41.858983+0000","last_peered":"2024-04-25T22:55:41.858983+0000","last_clean":"2024-04-25T22:55:41.858983+0000","last_became_active":"2024-04-25T22:51:53.026458+0000","last_became_peered":"2024-04-25T22:51:53.026458+0000","last_unstale":"2024-04-25T22:55:41.858983+0000","last_undegraded":"2024-04-25T22:55:41.858983+0000","last_fullsized":"2024-04-25T22:55:41.858983+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:11:09.179564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192819,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":52,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536805+0000","last_change":"2024-04-25T22:55:27.519827+0000","last_active":"2024-04-25T22:55:41.536805+0000","last_peered":"2024-04-25T22:55:41.536805+0000","last_clean":"2024-04-25T22:55:41.536805+0000","last_became_active":"2024-04-25T22:55:27.518853+0000","last_became_peered":"2024-04-25T22:55:27.518853+0000","last_unstale":"2024-04-25T22:55:41.536805+0000","last_undegraded":"2024-04-25T22:55:41.536805+0000","last_fullsized":"2024-04-25T22:55:41.536805+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:17:48.076297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":48,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536526+0000","last_change":"2024-04-25T22:55:27.519804+0000","last_active":"2024-04-25T22:55:41.536526+0000","last_peered":"2024-04-25T22:55:41.536526+0000","last_clean":"2024-04-25T22:55:41.536526+0000","last_became_active":"2024-04-25T22:55:27.518183+0000","last_became_peered":"2024-04-25T22:55:27.518183+0000","last_unstale":"2024-04-25T22:55:41.536526+0000","last_undegraded":"2024-04-25T22:55:41.536526+0000","last_fullsized":"2024-04-25T22:55:41.536526+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:36.947733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"55'172","reported_seq":505,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536038+0000","last_change":"2024-04-25T22:55:40.539104+0000","last_active":"2024-04-25T22:55:41.536038+0000","last_peered":"2024-04-25T22:55:41.536038+0000","last_clean":"2024-04-25T22:55:41.536038+0000","last_became_active":"2024-04-25T22:55:40.538335+0000","last_became_peered":"2024-04-25T22:55:40.538335+0000","last_unstale":"2024-04-25T22:55:41.536038+0000","last_undegraded":"2024-04-25T22:55:41.536038+0000","last_fullsized":"2024-04-25T22:55:41.536038+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:45:43.336586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505702,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":1011342,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"56'37","reported_seq":67,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536555+0000","last_change":"2024-04-25T22:55:27.570707+0000","last_active":"2024-04-25T22:55:41.536555+0000","last_peered":"2024-04-25T22:55:41.536555+0000","last_clean":"2024-04-25T22:55:41.536555+0000","last_became_active":"2024-04-25T22:55:27.518193+0000","last_became_peered":"2024-04-25T22:55:27.518193+0000","last_unstale":"2024-04-25T22:55:41.536555+0000","last_undegraded":"2024-04-25T22:55:41.536555+0000","last_fullsized":"2024-04-25T22:55:41.536555+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:17:01.521730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":143,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536823+0000","last_change":"2024-04-25T22:51:47.764288+0000","last_active":"2024-04-25T22:55:41.536823+0000","last_peered":"2024-04-25T22:55:41.536823+0000","last_clean":"2024-04-25T22:55:41.536823+0000","last_became_active":"2024-04-25T22:51:47.763961+0000","last_became_peered":"2024-04-25T22:51:47.763961+0000","last_unstale":"2024-04-25T22:55:41.536823+0000","last_undegraded":"2024-04-25T22:55:41.536823+0000","last_fullsized":"2024-04-25T22:55:41.536823+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:03:07.164842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"55'142","reported_seq":279,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858601+0000","last_change":"2024-04-25T22:51:53.026925+0000","last_active":"2024-04-25T22:55:41.858601+0000","last_peered":"2024-04-25T22:55:41.858601+0000","last_clean":"2024-04-25T22:55:41.858601+0000","last_became_active":"2024-04-25T22:51:53.026419+0000","last_became_peered":"2024-04-25T22:51:53.026419+0000","last_unstale":"2024-04-25T22:55:41.858601+0000","last_undegraded":"2024-04-25T22:55:41.858601+0000","last_fullsized":"2024-04-25T22:55:41.858601+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:49:38.102060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":246196,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"55'162","reported_seq":297,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535896+0000","last_change":"2024-04-25T22:51:53.022222+0000","last_active":"2024-04-25T22:55:41.535896+0000","last_peered":"2024-04-25T22:55:41.535896+0000","last_clean":"2024-04-25T22:55:41.535896+0000","last_became_active":"2024-04-25T22:51:53.021687+0000","last_became_peered":"2024-04-25T22:51:53.021687+0000","last_unstale":"2024-04-25T22:55:41.535896+0000","last_undegraded":"2024-04-25T22:55:41.535896+0000","last_fullsized":"2024-04-25T22:55:41.535896+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:35:06.234402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108265,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"60'43","reported_seq":180,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536366+0000","last_change":"2024-04-25T22:51:52.019928+0000","last_active":"2024-04-25T22:55:41.536366+0000","last_peered":"2024-04-25T22:55:41.536366+0000","last_clean":"2024-04-25T22:55:41.536366+0000","last_became_active":"2024-04-25T22:51:52.019264+0000","last_became_peered":"2024-04-25T22:51:52.019264+0000","last_unstale":"2024-04-25T22:55:41.536366+0000","last_undegraded":"2024-04-25T22:55:41.536366+0000","last_fullsized":"2024-04-25T22:55:41.536366+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:18.136883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"55'146","reported_seq":253,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535922+0000","last_change":"2024-04-25T22:55:31.527757+0000","last_active":"2024-04-25T22:55:41.535922+0000","last_peered":"2024-04-25T22:55:41.535922+0000","last_clean":"2024-04-25T22:55:41.535922+0000","last_became_active":"2024-04-25T22:55:31.526620+0000","last_became_peered":"2024-04-25T22:55:31.526620+0000","last_unstale":"2024-04-25T22:55:41.535922+0000","last_undegraded":"2024-04-25T22:55:41.535922+0000","last_fullsized":"2024-04-25T22:55:41.535922+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:59:41.748950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89309,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":89309,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"53'21","reported_seq":160,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859669+0000","last_change":"2024-04-25T22:51:52.018977+0000","last_active":"2024-04-25T22:55:41.859669+0000","last_peered":"2024-04-25T22:55:41.859669+0000","last_clean":"2024-04-25T22:55:41.859669+0000","last_became_active":"2024-04-25T22:51:52.018519+0000","last_became_peered":"2024-04-25T22:51:52.018519+0000","last_unstale":"2024-04-25T22:55:41.859669+0000","last_undegraded":"2024-04-25T22:55:41.859669+0000","last_fullsized":"2024-04-25T22:55:41.859669+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:53:07.306148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"48'1","reported_seq":115,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536721+0000","last_change":"2024-04-25T22:55:38.517605+0000","last_active":"2024-04-25T22:55:41.536721+0000","last_peered":"2024-04-25T22:55:41.536721+0000","last_clean":"2024-04-25T22:55:41.536721+0000","last_became_active":"2024-04-25T22:55:38.515986+0000","last_became_peered":"2024-04-25T22:55:38.515986+0000","last_unstale":"2024-04-25T22:55:41.536721+0000","last_undegraded":"2024-04-25T22:55:41.536721+0000","last_fullsized":"2024-04-25T22:55:41.536721+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:02:39.264531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"55'171","reported_seq":278,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535896+0000","last_change":"2024-04-25T22:55:30.525999+0000","last_active":"2024-04-25T22:55:41.535896+0000","last_peered":"2024-04-25T22:55:41.535896+0000","last_clean":"2024-04-25T22:55:41.535896+0000","last_became_active":"2024-04-25T22:55:30.525233+0000","last_became_peered":"2024-04-25T22:55:30.525233+0000","last_unstale":"2024-04-25T22:55:41.535896+0000","last_undegraded":"2024-04-25T22:55:41.535896+0000","last_fullsized":"2024-04-25T22:55:41.535896+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:51:14.338988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":332166,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":329490,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"51'2","reported_seq":48,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536941+0000","last_change":"2024-04-25T22:55:27.519530+0000","last_active":"2024-04-25T22:55:41.536941+0000","last_peered":"2024-04-25T22:55:41.536941+0000","last_clean":"2024-04-25T22:55:41.536941+0000","last_became_active":"2024-04-25T22:55:27.518244+0000","last_became_peered":"2024-04-25T22:55:27.518244+0000","last_unstale":"2024-04-25T22:55:41.536941+0000","last_undegraded":"2024-04-25T22:55:41.536941+0000","last_fullsized":"2024-04-25T22:55:41.536941+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:40:24.373575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"55'158","reported_seq":267,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535732+0000","last_change":"2024-04-25T22:55:30.527784+0000","last_active":"2024-04-25T22:55:41.535732+0000","last_peered":"2024-04-25T22:55:41.535732+0000","last_clean":"2024-04-25T22:55:41.535732+0000","last_became_active":"2024-04-25T22:55:30.526853+0000","last_became_peered":"2024-04-25T22:55:30.526853+0000","last_unstale":"2024-04-25T22:55:41.535732+0000","last_undegraded":"2024-04-25T22:55:41.535732+0000","last_fullsized":"2024-04-25T22:55:41.535732+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:19:11.705754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70967,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":70967,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"55'172","reported_seq":309,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859717+0000","last_change":"2024-04-25T22:51:53.029210+0000","last_active":"2024-04-25T22:55:41.859717+0000","last_peered":"2024-04-25T22:55:41.859717+0000","last_clean":"2024-04-25T22:55:41.859717+0000","last_became_active":"2024-04-25T22:51:53.028635+0000","last_became_peered":"2024-04-25T22:51:53.028635+0000","last_unstale":"2024-04-25T22:55:41.859717+0000","last_undegraded":"2024-04-25T22:55:41.859717+0000","last_fullsized":"2024-04-25T22:55:41.859717+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:41.205051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":440592,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"50'1","reported_seq":48,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535599+0000","last_change":"2024-04-25T22:55:27.516136+0000","last_active":"2024-04-25T22:55:41.535599+0000","last_peered":"2024-04-25T22:55:41.535599+0000","last_clean":"2024-04-25T22:55:41.535599+0000","last_became_active":"2024-04-25T22:55:27.515473+0000","last_became_peered":"2024-04-25T22:55:27.515473+0000","last_unstale":"2024-04-25T22:55:41.535599+0000","last_undegraded":"2024-04-25T22:55:41.535599+0000","last_fullsized":"2024-04-25T22:55:41.535599+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:51:59.771248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"55'151","reported_seq":250,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536783+0000","last_change":"2024-04-25T22:55:34.513243+0000","last_active":"2024-04-25T22:55:41.536783+0000","last_peered":"2024-04-25T22:55:41.536783+0000","last_clean":"2024-04-25T22:55:41.536783+0000","last_became_active":"2024-04-25T22:55:34.512137+0000","last_became_peered":"2024-04-25T22:55:34.512137+0000","last_unstale":"2024-04-25T22:55:41.536783+0000","last_undegraded":"2024-04-25T22:55:41.536783+0000","last_fullsized":"2024-04-25T22:55:41.536783+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:06:40.451167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106917,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":97731,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":76,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535673+0000","last_change":"2024-04-25T22:55:37.514177+0000","last_active":"2024-04-25T22:55:41.535673+0000","last_peered":"2024-04-25T22:55:41.535673+0000","last_clean":"2024-04-25T22:55:41.535673+0000","last_became_active":"2024-04-25T22:55:37.513925+0000","last_became_peered":"2024-04-25T22:55:37.513925+0000","last_unstale":"2024-04-25T22:55:41.535673+0000","last_undegraded":"2024-04-25T22:55:41.535673+0000","last_fullsized":"2024-04-25T22:55:41.535673+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:12:09.421061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"55'203","reported_seq":340,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859317+0000","last_change":"2024-04-25T22:51:53.028084+0000","last_active":"2024-04-25T22:55:41.859317+0000","last_peered":"2024-04-25T22:55:41.859317+0000","last_clean":"2024-04-25T22:55:41.859317+0000","last_became_active":"2024-04-25T22:51:53.027541+0000","last_became_peered":"2024-04-25T22:51:53.027541+0000","last_unstale":"2024-04-25T22:55:41.859317+0000","last_undegraded":"2024-04-25T22:55:41.859317+0000","last_fullsized":"2024-04-25T22:55:41.859317+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:28:42.903045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195653,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"48'2","reported_seq":153,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859141+0000","last_change":"2024-04-25T22:55:27.541798+0000","last_active":"2024-04-25T22:55:41.859141+0000","last_peered":"2024-04-25T22:55:41.859141+0000","last_clean":"2024-04-25T22:55:41.859141+0000","last_became_active":"2024-04-25T22:55:27.517718+0000","last_became_peered":"2024-04-25T22:55:27.517718+0000","last_unstale":"2024-04-25T22:55:41.859141+0000","last_undegraded":"2024-04-25T22:55:41.859141+0000","last_fullsized":"2024-04-25T22:55:41.859141+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:48:57.633186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"55'168","reported_seq":524,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858951+0000","last_change":"2024-04-25T22:55:34.514499+0000","last_active":"2024-04-25T22:55:41.858951+0000","last_peered":"2024-04-25T22:55:41.858951+0000","last_clean":"2024-04-25T22:55:41.858951+0000","last_became_active":"2024-04-25T22:55:34.513433+0000","last_became_peered":"2024-04-25T22:55:34.513433+0000","last_unstale":"2024-04-25T22:55:41.858951+0000","last_undegraded":"2024-04-25T22:55:41.858951+0000","last_fullsized":"2024-04-25T22:55:41.858951+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:58:08.177184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151921,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":151921,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"47'5","reported_seq":170,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859179+0000","last_change":"2024-04-25T22:55:37.559449+0000","last_active":"2024-04-25T22:55:41.859179+0000","last_peered":"2024-04-25T22:55:41.859179+0000","last_clean":"2024-04-25T22:55:41.859179+0000","last_became_active":"2024-04-25T22:55:37.516119+0000","last_became_peered":"2024-04-25T22:55:37.516119+0000","last_unstale":"2024-04-25T22:55:41.859179+0000","last_undegraded":"2024-04-25T22:55:41.859179+0000","last_fullsized":"2024-04-25T22:55:41.859179+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:25:42.548782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"55'166","reported_seq":505,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535835+0000","last_change":"2024-04-25T22:55:38.518734+0000","last_active":"2024-04-25T22:55:41.535835+0000","last_peered":"2024-04-25T22:55:41.535835+0000","last_clean":"2024-04-25T22:55:41.535835+0000","last_became_active":"2024-04-25T22:55:38.516260+0000","last_became_peered":"2024-04-25T22:55:38.516260+0000","last_unstale":"2024-04-25T22:55:41.535835+0000","last_undegraded":"2024-04-25T22:55:41.535835+0000","last_fullsized":"2024-04-25T22:55:41.535835+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:25:43.553244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3798024,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":3871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":3798024,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535940+0000","last_change":"2024-04-25T22:55:38.520672+0000","last_active":"2024-04-25T22:55:41.535940+0000","last_peered":"2024-04-25T22:55:41.535940+0000","last_clean":"2024-04-25T22:55:41.535940+0000","last_became_active":"2024-04-25T22:55:38.515776+0000","last_became_peered":"2024-04-25T22:55:38.515776+0000","last_unstale":"2024-04-25T22:55:41.535940+0000","last_undegraded":"2024-04-25T22:55:41.535940+0000","last_fullsized":"2024-04-25T22:55:41.535940+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:53.584300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"55'158","reported_seq":495,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536078+0000","last_change":"2024-04-25T22:55:38.516465+0000","last_active":"2024-04-25T22:55:41.536078+0000","last_peered":"2024-04-25T22:55:41.536078+0000","last_clean":"2024-04-25T22:55:41.536078+0000","last_became_active":"2024-04-25T22:55:38.514732+0000","last_became_peered":"2024-04-25T22:55:38.514732+0000","last_unstale":"2024-04-25T22:55:41.536078+0000","last_undegraded":"2024-04-25T22:55:41.536078+0000","last_fullsized":"2024-04-25T22:55:41.536078+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:42:09.860717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141656,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":141656,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"50'57","reported_seq":196,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859521+0000","last_change":"2024-04-25T22:51:52.019032+0000","last_active":"2024-04-25T22:55:41.859521+0000","last_peered":"2024-04-25T22:55:41.859521+0000","last_clean":"2024-04-25T22:55:41.859521+0000","last_became_active":"2024-04-25T22:51:52.018547+0000","last_became_peered":"2024-04-25T22:51:52.018547+0000","last_unstale":"2024-04-25T22:55:41.859521+0000","last_undegraded":"2024-04-25T22:55:41.859521+0000","last_fullsized":"2024-04-25T22:55:41.859521+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:10:00.056491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":8213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"55'169","reported_seq":535,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859326+0000","last_change":"2024-04-25T22:55:35.518155+0000","last_active":"2024-04-25T22:55:41.859326+0000","last_peered":"2024-04-25T22:55:41.859326+0000","last_clean":"2024-04-25T22:55:41.859326+0000","last_became_active":"2024-04-25T22:55:35.517149+0000","last_became_peered":"2024-04-25T22:55:35.517149+0000","last_unstale":"2024-04-25T22:55:41.859326+0000","last_undegraded":"2024-04-25T22:55:41.859326+0000","last_fullsized":"2024-04-25T22:55:41.859326+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:50.123900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184603,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":194,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":166098,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"48'25","reported_seq":56,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536897+0000","last_change":"2024-04-25T22:55:27.586742+0000","last_active":"2024-04-25T22:55:41.536897+0000","last_peered":"2024-04-25T22:55:41.536897+0000","last_clean":"2024-04-25T22:55:41.536897+0000","last_became_active":"2024-04-25T22:55:27.520617+0000","last_became_peered":"2024-04-25T22:55:27.520617+0000","last_unstale":"2024-04-25T22:55:41.536897+0000","last_undegraded":"2024-04-25T22:55:41.536897+0000","last_fullsized":"2024-04-25T22:55:41.536897+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:58:12.148059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"55'196","reported_seq":594,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535817+0000","last_change":"2024-04-25T22:55:31.526793+0000","last_active":"2024-04-25T22:55:41.535817+0000","last_peered":"2024-04-25T22:55:41.535817+0000","last_clean":"2024-04-25T22:55:41.535817+0000","last_became_active":"2024-04-25T22:55:31.526322+0000","last_became_peered":"2024-04-25T22:55:31.526322+0000","last_unstale":"2024-04-25T22:55:41.535817+0000","last_undegraded":"2024-04-25T22:55:41.535817+0000","last_fullsized":"2024-04-25T22:55:41.535817+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:58.561902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200980,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":211,"num_write_kb":410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":126,"num_bytes_recovered":197679,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"48'7","reported_seq":98,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536679+0000","last_change":"2024-04-25T22:55:37.541050+0000","last_active":"2024-04-25T22:55:41.536679+0000","last_peered":"2024-04-25T22:55:41.536679+0000","last_clean":"2024-04-25T22:55:41.536679+0000","last_became_active":"2024-04-25T22:55:37.516183+0000","last_became_peered":"2024-04-25T22:55:37.516183+0000","last_unstale":"2024-04-25T22:55:41.536679+0000","last_undegraded":"2024-04-25T22:55:41.536679+0000","last_fullsized":"2024-04-25T22:55:41.536679+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:30.075399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8389190,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26691649,"num_objects":3448,"num_object_clones":0,"num_object_copies":6896,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3448,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10583,"num_write_kb":38991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4953,"num_bytes_recovered":24173691,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73056256,"data_stored":53061590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10415,"ondisk_log_size":10415,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":40502861,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":34,"num_read_kb":343,"num_write":470,"num_write_kb":40224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":32113365,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":81068032,"data_stored":81005722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5351,"internal_metadata":0},"log_size":434,"ondisk_log_size":434,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738419,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84816,"kb_used_data":49476,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94287024,"statfs":{"total":96636764160,"available":96549912576,"internally_reserved":0,"allocated":50663424,"data_stored":43767232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":62,"seq":266287972358,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85248,"kb_used_data":45232,"kb_used_omap":6,"kb_used_meta":39993,"kb_avail":94286592,"statfs":{"total":96636764160,"available":96549470208,"internally_reserved":0,"allocated":46317568,"data_stored":38899263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6946,"internal_metadata":40953054},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738419,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":102580,"kb_used_data":58912,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94269260,"statfs":{"total":96636764160,"available":96531722240,"internally_reserved":0,"allocated":60325888,"data_stored":53539649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32145408,"data_stored":32114253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19542016,"data_stored":19530487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5351,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":29380608,"data_stored":29360982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":26918912,"data_stored":20514252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26107904,"data_stored":19048000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20029440,"data_stored":13499338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:55:46.093 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-25T22:55:46.093 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-04-25T22:55:46.441 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-25T22:55:46.451 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T22:55:46.451 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:55:46.754 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:55:46.756 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-25T22:55:46.767 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":195,"stamp":"2024-04-25T22:55:45.987513+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":67784878,"num_objects":3482,"num_object_clones":0,"num_object_copies":6964,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3482,"num_whiteouts":0,"num_read":170,"num_read_kb":461,"num_write":11256,"num_write_kb":82675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4966,"num_bytes_recovered":56287056,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11006,"ondisk_log_size":11006,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":212,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":272644,"kb_used_data":153620,"kb_used_omap":9,"kb_used_meta":118966,"kb_avail":282842876,"statfs":{"total":289910292480,"available":289631105024,"internally_reserved":0,"allocated":157306880,"data_stored":136206144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10136,"internal_metadata":121821288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":209,"num_bytes_recovered":9238667,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.459375"},"pg_stats":[{"pgid":"4.3f","version":"55'160","reported_seq":516,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859594+0000","last_change":"2024-04-25T22:55:34.515388+0000","last_active":"2024-04-25T22:55:41.859594+0000","last_peered":"2024-04-25T22:55:41.859594+0000","last_clean":"2024-04-25T22:55:41.859594+0000","last_became_active":"2024-04-25T22:55:34.514302+0000","last_became_peered":"2024-04-25T22:55:34.514302+0000","last_unstale":"2024-04-25T22:55:41.859594+0000","last_undegraded":"2024-04-25T22:55:41.859594+0000","last_fullsized":"2024-04-25T22:55:41.859594+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:08:19.339484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168293,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":168293,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"55'153","reported_seq":495,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859178+0000","last_change":"2024-04-25T22:55:35.519132+0000","last_active":"2024-04-25T22:55:41.859178+0000","last_peered":"2024-04-25T22:55:41.859178+0000","last_clean":"2024-04-25T22:55:41.859178+0000","last_became_active":"2024-04-25T22:55:35.517561+0000","last_became_peered":"2024-04-25T22:55:35.517561+0000","last_unstale":"2024-04-25T22:55:41.859178+0000","last_undegraded":"2024-04-25T22:55:41.859178+0000","last_fullsized":"2024-04-25T22:55:41.859178+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:02:40.268992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286387,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":286387,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"55'164","reported_seq":238,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536366+0000","last_change":"2024-04-25T22:55:38.519244+0000","last_active":"2024-04-25T22:55:41.536366+0000","last_peered":"2024-04-25T22:55:41.536366+0000","last_clean":"2024-04-25T22:55:41.536366+0000","last_became_active":"2024-04-25T22:55:38.517874+0000","last_became_peered":"2024-04-25T22:55:38.517874+0000","last_unstale":"2024-04-25T22:55:41.536366+0000","last_undegraded":"2024-04-25T22:55:41.536366+0000","last_fullsized":"2024-04-25T22:55:41.536366+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:45:27.635067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130188,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"55'126","reported_seq":423,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536210+0000","last_change":"2024-04-25T22:55:38.516209+0000","last_active":"2024-04-25T22:55:41.536210+0000","last_peered":"2024-04-25T22:55:41.536210+0000","last_clean":"2024-04-25T22:55:41.536210+0000","last_became_active":"2024-04-25T22:55:38.513558+0000","last_became_peered":"2024-04-25T22:55:38.513558+0000","last_unstale":"2024-04-25T22:55:41.536210+0000","last_undegraded":"2024-04-25T22:55:41.536210+0000","last_fullsized":"2024-04-25T22:55:41.536210+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:50.123900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142819,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":135761,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"55'173","reported_seq":559,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859149+0000","last_change":"2024-04-25T22:55:35.517931+0000","last_active":"2024-04-25T22:55:41.859149+0000","last_peered":"2024-04-25T22:55:41.859149+0000","last_clean":"2024-04-25T22:55:41.859149+0000","last_became_active":"2024-04-25T22:55:35.517044+0000","last_became_peered":"2024-04-25T22:55:35.517044+0000","last_unstale":"2024-04-25T22:55:41.859149+0000","last_undegraded":"2024-04-25T22:55:41.859149+0000","last_fullsized":"2024-04-25T22:55:41.859149+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:42.118131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":709662,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":119,"num_bytes_recovered":709653,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"55'173","reported_seq":516,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535750+0000","last_change":"2024-04-25T22:55:38.515187+0000","last_active":"2024-04-25T22:55:41.535750+0000","last_peered":"2024-04-25T22:55:41.535750+0000","last_clean":"2024-04-25T22:55:41.535750+0000","last_became_active":"2024-04-25T22:55:38.513456+0000","last_became_peered":"2024-04-25T22:55:38.513456+0000","last_unstale":"2024-04-25T22:55:41.535750+0000","last_undegraded":"2024-04-25T22:55:41.535750+0000","last_fullsized":"2024-04-25T22:55:41.535750+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:08:19.339484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569466,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":569466,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"55'173","reported_seq":541,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535869+0000","last_change":"2024-04-25T22:55:33.512839+0000","last_active":"2024-04-25T22:55:41.535869+0000","last_peered":"2024-04-25T22:55:41.535869+0000","last_clean":"2024-04-25T22:55:41.535869+0000","last_became_active":"2024-04-25T22:55:33.511961+0000","last_became_peered":"2024-04-25T22:55:33.511961+0000","last_unstale":"2024-04-25T22:55:41.535869+0000","last_undegraded":"2024-04-25T22:55:41.535869+0000","last_fullsized":"2024-04-25T22:55:41.535869+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:54:45.619674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75460,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":111,"num_bytes_recovered":75460,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"55'140","reported_seq":456,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535457+0000","last_change":"2024-04-25T22:55:32.510322+0000","last_active":"2024-04-25T22:55:41.535457+0000","last_peered":"2024-04-25T22:55:41.535457+0000","last_clean":"2024-04-25T22:55:41.535457+0000","last_became_active":"2024-04-25T22:55:32.509908+0000","last_became_peered":"2024-04-25T22:55:32.509908+0000","last_unstale":"2024-04-25T22:55:41.535457+0000","last_undegraded":"2024-04-25T22:55:41.535457+0000","last_fullsized":"2024-04-25T22:55:41.535457+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:16:15.948780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":214453,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":214404,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"55'169","reported_seq":274,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536936+0000","last_change":"2024-04-25T22:55:32.513084+0000","last_active":"2024-04-25T22:55:41.536936+0000","last_peered":"2024-04-25T22:55:41.536936+0000","last_clean":"2024-04-25T22:55:41.536936+0000","last_became_active":"2024-04-25T22:55:32.512447+0000","last_became_peered":"2024-04-25T22:55:32.512447+0000","last_unstale":"2024-04-25T22:55:41.536936+0000","last_undegraded":"2024-04-25T22:55:41.536936+0000","last_fullsized":"2024-04-25T22:55:41.536936+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:16:27.593679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":538374,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":538374,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"55'153","reported_seq":483,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859293+0000","last_change":"2024-04-25T22:55:35.518293+0000","last_active":"2024-04-25T22:55:41.859293+0000","last_peered":"2024-04-25T22:55:41.859293+0000","last_clean":"2024-04-25T22:55:41.859293+0000","last_became_active":"2024-04-25T22:55:35.517506+0000","last_became_peered":"2024-04-25T22:55:35.517506+0000","last_unstale":"2024-04-25T22:55:41.859293+0000","last_undegraded":"2024-04-25T22:55:41.859293+0000","last_fullsized":"2024-04-25T22:55:41.859293+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:42:09.860717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130447,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":123390,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"55'154","reported_seq":258,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536002+0000","last_change":"2024-04-25T22:55:40.538872+0000","last_active":"2024-04-25T22:55:41.536002+0000","last_peered":"2024-04-25T22:55:41.536002+0000","last_clean":"2024-04-25T22:55:41.536002+0000","last_became_active":"2024-04-25T22:55:40.538052+0000","last_became_peered":"2024-04-25T22:55:40.538052+0000","last_unstale":"2024-04-25T22:55:41.536002+0000","last_undegraded":"2024-04-25T22:55:41.536002+0000","last_fullsized":"2024-04-25T22:55:41.536002+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:06.239983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":343806,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":208,"num_bytes_recovered":687612,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"55'141","reported_seq":278,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858898+0000","last_change":"2024-04-25T22:51:53.028006+0000","last_active":"2024-04-25T22:55:41.858898+0000","last_peered":"2024-04-25T22:55:41.858898+0000","last_clean":"2024-04-25T22:55:41.858898+0000","last_became_active":"2024-04-25T22:51:53.027363+0000","last_became_peered":"2024-04-25T22:51:53.027363+0000","last_unstale":"2024-04-25T22:55:41.858898+0000","last_undegraded":"2024-04-25T22:55:41.858898+0000","last_fullsized":"2024-04-25T22:55:41.858898+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:32.923620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125409,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"55'135","reported_seq":459,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858862+0000","last_change":"2024-04-25T22:55:33.512249+0000","last_active":"2024-04-25T22:55:41.858862+0000","last_peered":"2024-04-25T22:55:41.858862+0000","last_clean":"2024-04-25T22:55:41.858862+0000","last_became_active":"2024-04-25T22:55:33.511546+0000","last_became_peered":"2024-04-25T22:55:33.511546+0000","last_unstale":"2024-04-25T22:55:41.858862+0000","last_undegraded":"2024-04-25T22:55:41.858862+0000","last_fullsized":"2024-04-25T22:55:41.858862+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:52:41.758279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":183835,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":183835,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"55'179","reported_seq":314,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535808+0000","last_change":"2024-04-25T22:51:53.022367+0000","last_active":"2024-04-25T22:55:41.535808+0000","last_peered":"2024-04-25T22:55:41.535808+0000","last_clean":"2024-04-25T22:55:41.535808+0000","last_became_active":"2024-04-25T22:51:53.021902+0000","last_became_peered":"2024-04-25T22:51:53.021902+0000","last_unstale":"2024-04-25T22:55:41.535808+0000","last_undegraded":"2024-04-25T22:55:41.535808+0000","last_fullsized":"2024-04-25T22:55:41.535808+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:44:59.401139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153371,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":181,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"55'161","reported_seq":273,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535564+0000","last_change":"2024-04-25T22:55:40.539371+0000","last_active":"2024-04-25T22:55:41.535564+0000","last_peered":"2024-04-25T22:55:41.535564+0000","last_clean":"2024-04-25T22:55:41.535564+0000","last_became_active":"2024-04-25T22:55:40.538095+0000","last_became_peered":"2024-04-25T22:55:40.538095+0000","last_unstale":"2024-04-25T22:55:41.535564+0000","last_undegraded":"2024-04-25T22:55:41.535564+0000","last_fullsized":"2024-04-25T22:55:41.535564+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:57.514231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4276239,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":4418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":4276214,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"55'179","reported_seq":551,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535530+0000","last_change":"2024-04-25T22:55:31.526766+0000","last_active":"2024-04-25T22:55:41.535530+0000","last_peered":"2024-04-25T22:55:41.535530+0000","last_clean":"2024-04-25T22:55:41.535530+0000","last_became_active":"2024-04-25T22:55:31.526271+0000","last_became_peered":"2024-04-25T22:55:31.526271+0000","last_unstale":"2024-04-25T22:55:41.535530+0000","last_undegraded":"2024-04-25T22:55:41.535530+0000","last_fullsized":"2024-04-25T22:55:41.535530+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:48:39.183880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4371943,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":4513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":4363238,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"55'163","reported_seq":268,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536806+0000","last_change":"2024-04-25T22:55:32.513240+0000","last_active":"2024-04-25T22:55:41.536806+0000","last_peered":"2024-04-25T22:55:41.536806+0000","last_clean":"2024-04-25T22:55:41.536806+0000","last_became_active":"2024-04-25T22:55:32.512371+0000","last_became_peered":"2024-04-25T22:55:32.512371+0000","last_unstale":"2024-04-25T22:55:41.536806+0000","last_undegraded":"2024-04-25T22:55:41.536806+0000","last_fullsized":"2024-04-25T22:55:41.536806+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:23.735382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96221,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":87110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"55'147","reported_seq":487,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859496+0000","last_change":"2024-04-25T22:55:35.519379+0000","last_active":"2024-04-25T22:55:41.859496+0000","last_peered":"2024-04-25T22:55:41.859496+0000","last_clean":"2024-04-25T22:55:41.859496+0000","last_became_active":"2024-04-25T22:55:35.518584+0000","last_became_peered":"2024-04-25T22:55:35.518584+0000","last_unstale":"2024-04-25T22:55:41.859496+0000","last_undegraded":"2024-04-25T22:55:41.859496+0000","last_fullsized":"2024-04-25T22:55:41.859496+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:33:50.992444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1432264,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":1532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":1432241,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"55'146","reported_seq":255,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536568+0000","last_change":"2024-04-25T22:55:30.527560+0000","last_active":"2024-04-25T22:55:41.536568+0000","last_peered":"2024-04-25T22:55:41.536568+0000","last_clean":"2024-04-25T22:55:41.536568+0000","last_became_active":"2024-04-25T22:55:30.526745+0000","last_became_peered":"2024-04-25T22:55:30.526745+0000","last_unstale":"2024-04-25T22:55:41.536568+0000","last_undegraded":"2024-04-25T22:55:41.536568+0000","last_fullsized":"2024-04-25T22:55:41.536568+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:40:08.494734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112933,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":112933,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"55'178","reported_seq":548,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536195+0000","last_change":"2024-04-25T22:55:34.512671+0000","last_active":"2024-04-25T22:55:41.536195+0000","last_peered":"2024-04-25T22:55:41.536195+0000","last_clean":"2024-04-25T22:55:41.536195+0000","last_became_active":"2024-04-25T22:55:34.511872+0000","last_became_peered":"2024-04-25T22:55:34.511872+0000","last_unstale":"2024-04-25T22:55:41.536195+0000","last_undegraded":"2024-04-25T22:55:41.536195+0000","last_fullsized":"2024-04-25T22:55:41.536195+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:43:12.293070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124334,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":124334,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"55'158","reported_seq":500,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535980+0000","last_change":"2024-04-25T22:55:34.512430+0000","last_active":"2024-04-25T22:55:41.535980+0000","last_peered":"2024-04-25T22:55:41.535980+0000","last_clean":"2024-04-25T22:55:41.535980+0000","last_became_active":"2024-04-25T22:55:34.511833+0000","last_became_peered":"2024-04-25T22:55:34.511833+0000","last_unstale":"2024-04-25T22:55:41.535980+0000","last_undegraded":"2024-04-25T22:55:41.535980+0000","last_fullsized":"2024-04-25T22:55:41.535980+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:52:03.534174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145029,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":145029,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"55'171","reported_seq":308,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858838+0000","last_change":"2024-04-25T22:51:53.026746+0000","last_active":"2024-04-25T22:55:41.858838+0000","last_peered":"2024-04-25T22:55:41.858838+0000","last_clean":"2024-04-25T22:55:41.858838+0000","last_became_active":"2024-04-25T22:51:53.025938+0000","last_became_peered":"2024-04-25T22:51:53.025938+0000","last_unstale":"2024-04-25T22:55:41.858838+0000","last_undegraded":"2024-04-25T22:55:41.858838+0000","last_fullsized":"2024-04-25T22:55:41.858838+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:38:03.428258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115019,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"55'161","reported_seq":262,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535818+0000","last_change":"2024-04-25T22:55:33.513307+0000","last_active":"2024-04-25T22:55:41.535818+0000","last_peered":"2024-04-25T22:55:41.535818+0000","last_clean":"2024-04-25T22:55:41.535818+0000","last_became_active":"2024-04-25T22:55:33.512160+0000","last_became_peered":"2024-04-25T22:55:33.512160+0000","last_unstale":"2024-04-25T22:55:41.535818+0000","last_undegraded":"2024-04-25T22:55:41.535818+0000","last_fullsized":"2024-04-25T22:55:41.535818+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:57:16.042728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":641227,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":641227,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"55'169","reported_seq":525,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858515+0000","last_change":"2024-04-25T22:55:33.512249+0000","last_active":"2024-04-25T22:55:41.858515+0000","last_peered":"2024-04-25T22:55:41.858515+0000","last_clean":"2024-04-25T22:55:41.858515+0000","last_became_active":"2024-04-25T22:55:33.511463+0000","last_became_peered":"2024-04-25T22:55:33.511463+0000","last_unstale":"2024-04-25T22:55:41.858515+0000","last_undegraded":"2024-04-25T22:55:41.858515+0000","last_fullsized":"2024-04-25T22:55:41.858515+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:54:45.619674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103634,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":189,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":98869,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"55'159","reported_seq":296,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859682+0000","last_change":"2024-04-25T22:51:53.028155+0000","last_active":"2024-04-25T22:55:41.859682+0000","last_peered":"2024-04-25T22:55:41.859682+0000","last_clean":"2024-04-25T22:55:41.859682+0000","last_became_active":"2024-04-25T22:51:53.027867+0000","last_became_peered":"2024-04-25T22:51:53.027867+0000","last_unstale":"2024-04-25T22:55:41.859682+0000","last_undegraded":"2024-04-25T22:55:41.859682+0000","last_fullsized":"2024-04-25T22:55:41.859682+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:43:47.453569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272252,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"55'190","reported_seq":289,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536880+0000","last_change":"2024-04-25T22:55:34.513270+0000","last_active":"2024-04-25T22:55:41.536880+0000","last_peered":"2024-04-25T22:55:41.536880+0000","last_clean":"2024-04-25T22:55:41.536880+0000","last_became_active":"2024-04-25T22:55:34.512320+0000","last_became_peered":"2024-04-25T22:55:34.512320+0000","last_unstale":"2024-04-25T22:55:41.536880+0000","last_undegraded":"2024-04-25T22:55:41.536880+0000","last_fullsized":"2024-04-25T22:55:41.536880+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:37.486013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126403,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":117,"num_bytes_recovered":126342,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"55'151","reported_seq":286,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536427+0000","last_change":"2024-04-25T22:51:53.022893+0000","last_active":"2024-04-25T22:55:41.536427+0000","last_peered":"2024-04-25T22:55:41.536427+0000","last_clean":"2024-04-25T22:55:41.536427+0000","last_became_active":"2024-04-25T22:51:53.022407+0000","last_became_peered":"2024-04-25T22:51:53.022407+0000","last_unstale":"2024-04-25T22:55:41.536427+0000","last_undegraded":"2024-04-25T22:55:41.536427+0000","last_fullsized":"2024-04-25T22:55:41.536427+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:08:44.404718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69245,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"55'147","reported_seq":284,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859212+0000","last_change":"2024-04-25T22:51:53.028447+0000","last_active":"2024-04-25T22:55:41.859212+0000","last_peered":"2024-04-25T22:55:41.859212+0000","last_clean":"2024-04-25T22:55:41.859212+0000","last_became_active":"2024-04-25T22:51:53.027852+0000","last_became_peered":"2024-04-25T22:51:53.027852+0000","last_unstale":"2024-04-25T22:55:41.859212+0000","last_undegraded":"2024-04-25T22:55:41.859212+0000","last_fullsized":"2024-04-25T22:55:41.859212+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:16.187194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192848,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"55'166","reported_seq":267,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535904+0000","last_change":"2024-04-25T22:55:34.514981+0000","last_active":"2024-04-25T22:55:41.535904+0000","last_peered":"2024-04-25T22:55:41.535904+0000","last_clean":"2024-04-25T22:55:41.535904+0000","last_became_active":"2024-04-25T22:55:34.514067+0000","last_became_peered":"2024-04-25T22:55:34.514067+0000","last_unstale":"2024-04-25T22:55:41.535904+0000","last_undegraded":"2024-04-25T22:55:41.535904+0000","last_fullsized":"2024-04-25T22:55:41.535904+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:05:49.273497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239074,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":239074,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"55'191","reported_seq":328,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859081+0000","last_change":"2024-04-25T22:51:53.026997+0000","last_active":"2024-04-25T22:55:41.859081+0000","last_peered":"2024-04-25T22:55:41.859081+0000","last_clean":"2024-04-25T22:55:41.859081+0000","last_became_active":"2024-04-25T22:51:53.026379+0000","last_became_peered":"2024-04-25T22:51:53.026379+0000","last_unstale":"2024-04-25T22:55:41.859081+0000","last_undegraded":"2024-04-25T22:55:41.859081+0000","last_fullsized":"2024-04-25T22:55:41.859081+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:33:24.700106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99668,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"55'193","reported_seq":298,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536272+0000","last_change":"2024-04-25T22:55:32.511886+0000","last_active":"2024-04-25T22:55:41.536272+0000","last_peered":"2024-04-25T22:55:41.536272+0000","last_clean":"2024-04-25T22:55:41.536272+0000","last_became_active":"2024-04-25T22:55:32.509978+0000","last_became_peered":"2024-04-25T22:55:32.509978+0000","last_unstale":"2024-04-25T22:55:41.536272+0000","last_undegraded":"2024-04-25T22:55:41.536272+0000","last_fullsized":"2024-04-25T22:55:41.536272+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:56:47.747527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128069,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":128069,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"55'182","reported_seq":537,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535588+0000","last_change":"2024-04-25T22:55:38.519451+0000","last_active":"2024-04-25T22:55:41.535588+0000","last_peered":"2024-04-25T22:55:41.535588+0000","last_clean":"2024-04-25T22:55:41.535588+0000","last_became_active":"2024-04-25T22:55:38.518412+0000","last_became_peered":"2024-04-25T22:55:38.518412+0000","last_unstale":"2024-04-25T22:55:41.535588+0000","last_undegraded":"2024-04-25T22:55:41.535588+0000","last_fullsized":"2024-04-25T22:55:41.535588+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:27.179735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":586629,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":580754,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"55'156","reported_seq":494,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859060+0000","last_change":"2024-04-25T22:55:33.512918+0000","last_active":"2024-04-25T22:55:41.859060+0000","last_peered":"2024-04-25T22:55:41.859060+0000","last_clean":"2024-04-25T22:55:41.859060+0000","last_became_active":"2024-04-25T22:55:33.512114+0000","last_became_peered":"2024-04-25T22:55:33.512114+0000","last_unstale":"2024-04-25T22:55:41.859060+0000","last_undegraded":"2024-04-25T22:55:41.859060+0000","last_fullsized":"2024-04-25T22:55:41.859060+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:52:03.534174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118861,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":118861,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"60'105","reported_seq":256,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536115+0000","last_change":"2024-04-25T22:55:30.526027+0000","last_active":"2024-04-25T22:55:41.536115+0000","last_peered":"2024-04-25T22:55:41.536115+0000","last_clean":"2024-04-25T22:55:41.536115+0000","last_became_active":"2024-04-25T22:55:30.525469+0000","last_became_peered":"2024-04-25T22:55:30.525469+0000","last_unstale":"2024-04-25T22:55:41.536115+0000","last_undegraded":"2024-04-25T22:55:41.536115+0000","last_fullsized":"2024-04-25T22:55:41.536115+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:18:16.878967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2425045,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":2428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":2425011,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"55'146","reported_seq":472,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859394+0000","last_change":"2024-04-25T22:55:30.525674+0000","last_active":"2024-04-25T22:55:41.859394+0000","last_peered":"2024-04-25T22:55:41.859394+0000","last_clean":"2024-04-25T22:55:41.859394+0000","last_became_active":"2024-04-25T22:55:30.524718+0000","last_became_peered":"2024-04-25T22:55:30.524718+0000","last_unstale":"2024-04-25T22:55:41.859394+0000","last_undegraded":"2024-04-25T22:55:41.859394+0000","last_fullsized":"2024-04-25T22:55:41.859394+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:48:39.183880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67079,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":89,"num_bytes_recovered":67079,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":48,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535977+0000","last_change":"2024-04-25T22:55:27.517626+0000","last_active":"2024-04-25T22:55:41.535977+0000","last_peered":"2024-04-25T22:55:41.535977+0000","last_clean":"2024-04-25T22:55:41.535977+0000","last_became_active":"2024-04-25T22:55:27.517208+0000","last_became_peered":"2024-04-25T22:55:27.517208+0000","last_unstale":"2024-04-25T22:55:41.535977+0000","last_undegraded":"2024-04-25T22:55:41.535977+0000","last_fullsized":"2024-04-25T22:55:41.535977+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:09.249311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"55'186","reported_seq":287,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536662+0000","last_change":"2024-04-25T22:55:33.513626+0000","last_active":"2024-04-25T22:55:41.536662+0000","last_peered":"2024-04-25T22:55:41.536662+0000","last_clean":"2024-04-25T22:55:41.536662+0000","last_became_active":"2024-04-25T22:55:33.512389+0000","last_became_peered":"2024-04-25T22:55:33.512389+0000","last_unstale":"2024-04-25T22:55:41.536662+0000","last_undegraded":"2024-04-25T22:55:41.536662+0000","last_fullsized":"2024-04-25T22:55:41.536662+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:02:53.672517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139986,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":137763,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":139,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859045+0000","last_change":"2024-04-25T22:51:52.018646+0000","last_active":"2024-04-25T22:55:41.859045+0000","last_peered":"2024-04-25T22:55:41.859045+0000","last_clean":"2024-04-25T22:55:41.859045+0000","last_became_active":"2024-04-25T22:51:52.018313+0000","last_became_peered":"2024-04-25T22:51:52.018313+0000","last_unstale":"2024-04-25T22:55:41.859045+0000","last_undegraded":"2024-04-25T22:55:41.859045+0000","last_fullsized":"2024-04-25T22:55:41.859045+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:00:21.688745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"55'167","reported_seq":274,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536676+0000","last_change":"2024-04-25T22:55:30.527435+0000","last_active":"2024-04-25T22:55:41.536676+0000","last_peered":"2024-04-25T22:55:41.536676+0000","last_clean":"2024-04-25T22:55:41.536676+0000","last_became_active":"2024-04-25T22:55:30.526276+0000","last_became_peered":"2024-04-25T22:55:30.526276+0000","last_unstale":"2024-04-25T22:55:41.536676+0000","last_undegraded":"2024-04-25T22:55:41.536676+0000","last_fullsized":"2024-04-25T22:55:41.536676+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:03:39.273168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87849,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":87849,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":145,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535666+0000","last_change":"2024-04-25T22:51:52.021510+0000","last_active":"2024-04-25T22:55:41.535666+0000","last_peered":"2024-04-25T22:55:41.535666+0000","last_clean":"2024-04-25T22:55:41.535666+0000","last_became_active":"2024-04-25T22:51:52.021145+0000","last_became_peered":"2024-04-25T22:51:52.021145+0000","last_unstale":"2024-04-25T22:55:41.535666+0000","last_undegraded":"2024-04-25T22:55:41.535666+0000","last_fullsized":"2024-04-25T22:55:41.535666+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:05.110747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"52'2","reported_seq":139,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536823+0000","last_change":"2024-04-25T22:51:52.021355+0000","last_active":"2024-04-25T22:55:41.536823+0000","last_peered":"2024-04-25T22:55:41.536823+0000","last_clean":"2024-04-25T22:55:41.536823+0000","last_became_active":"2024-04-25T22:51:52.020860+0000","last_became_peered":"2024-04-25T22:51:52.020860+0000","last_unstale":"2024-04-25T22:55:41.536823+0000","last_undegraded":"2024-04-25T22:55:41.536823+0000","last_fullsized":"2024-04-25T22:55:41.536823+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:55.235787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"55'157","reported_seq":294,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858543+0000","last_change":"2024-04-25T22:51:53.029390+0000","last_active":"2024-04-25T22:55:41.858543+0000","last_peered":"2024-04-25T22:55:41.858543+0000","last_clean":"2024-04-25T22:55:41.858543+0000","last_became_active":"2024-04-25T22:51:53.029157+0000","last_became_peered":"2024-04-25T22:51:53.029157+0000","last_unstale":"2024-04-25T22:55:41.858543+0000","last_undegraded":"2024-04-25T22:55:41.858543+0000","last_fullsized":"2024-04-25T22:55:41.858543+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:51:43.808994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190158,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"48'3","reported_seq":142,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859570+0000","last_change":"2024-04-25T22:51:52.018856+0000","last_active":"2024-04-25T22:55:41.859570+0000","last_peered":"2024-04-25T22:55:41.859570+0000","last_clean":"2024-04-25T22:55:41.859570+0000","last_became_active":"2024-04-25T22:51:52.018390+0000","last_became_peered":"2024-04-25T22:51:52.018390+0000","last_unstale":"2024-04-25T22:55:41.859570+0000","last_undegraded":"2024-04-25T22:55:41.859570+0000","last_fullsized":"2024-04-25T22:55:41.859570+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:42:54.430484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"55'171","reported_seq":539,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858599+0000","last_change":"2024-04-25T22:55:31.527677+0000","last_active":"2024-04-25T22:55:41.858599+0000","last_peered":"2024-04-25T22:55:41.858599+0000","last_clean":"2024-04-25T22:55:41.858599+0000","last_became_active":"2024-04-25T22:55:31.527049+0000","last_became_peered":"2024-04-25T22:55:31.527049+0000","last_unstale":"2024-04-25T22:55:41.858599+0000","last_undegraded":"2024-04-25T22:55:41.858599+0000","last_fullsized":"2024-04-25T22:55:41.858599+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:16:15.948780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":315325,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":191,"num_write_kb":549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":110,"num_bytes_recovered":301306,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":45,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536688+0000","last_change":"2024-04-25T22:55:38.519011+0000","last_active":"2024-04-25T22:55:41.536688+0000","last_peered":"2024-04-25T22:55:41.536688+0000","last_clean":"2024-04-25T22:55:41.536688+0000","last_became_active":"2024-04-25T22:55:38.517362+0000","last_became_peered":"2024-04-25T22:55:38.517362+0000","last_unstale":"2024-04-25T22:55:41.536688+0000","last_undegraded":"2024-04-25T22:55:41.536688+0000","last_fullsized":"2024-04-25T22:55:41.536688+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:30:15.580001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"55'153","reported_seq":486,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536056+0000","last_change":"2024-04-25T22:55:38.515892+0000","last_active":"2024-04-25T22:55:41.536056+0000","last_peered":"2024-04-25T22:55:41.536056+0000","last_clean":"2024-04-25T22:55:41.536056+0000","last_became_active":"2024-04-25T22:55:38.514319+0000","last_became_peered":"2024-04-25T22:55:38.514319+0000","last_unstale":"2024-04-25T22:55:41.536056+0000","last_undegraded":"2024-04-25T22:55:41.536056+0000","last_fullsized":"2024-04-25T22:55:41.536056+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:42.118131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97209,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":97196,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"51'1","reported_seq":115,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536541+0000","last_change":"2024-04-25T22:55:38.518279+0000","last_active":"2024-04-25T22:55:41.536541+0000","last_peered":"2024-04-25T22:55:41.536541+0000","last_clean":"2024-04-25T22:55:41.536541+0000","last_became_active":"2024-04-25T22:55:38.516782+0000","last_became_peered":"2024-04-25T22:55:38.516782+0000","last_unstale":"2024-04-25T22:55:41.536541+0000","last_undegraded":"2024-04-25T22:55:41.536541+0000","last_fullsized":"2024-04-25T22:55:41.536541+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:27:46.635381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"55'153","reported_seq":256,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536313+0000","last_change":"2024-04-25T22:55:32.511660+0000","last_active":"2024-04-25T22:55:41.536313+0000","last_peered":"2024-04-25T22:55:41.536313+0000","last_clean":"2024-04-25T22:55:41.536313+0000","last_became_active":"2024-04-25T22:55:32.510402+0000","last_became_peered":"2024-04-25T22:55:32.510402+0000","last_unstale":"2024-04-25T22:55:41.536313+0000","last_undegraded":"2024-04-25T22:55:41.536313+0000","last_fullsized":"2024-04-25T22:55:41.536313+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:13:03.774101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131384,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":131332,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"47'7","reported_seq":56,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536115+0000","last_change":"2024-04-25T22:55:27.566798+0000","last_active":"2024-04-25T22:55:41.536115+0000","last_peered":"2024-04-25T22:55:41.536115+0000","last_clean":"2024-04-25T22:55:41.536115+0000","last_became_active":"2024-04-25T22:55:27.518709+0000","last_became_peered":"2024-04-25T22:55:27.518709+0000","last_unstale":"2024-04-25T22:55:41.536115+0000","last_undegraded":"2024-04-25T22:55:41.536115+0000","last_fullsized":"2024-04-25T22:55:41.536115+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:07:47.758073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"55'174","reported_seq":521,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536332+0000","last_change":"2024-04-25T22:55:38.517785+0000","last_active":"2024-04-25T22:55:41.536332+0000","last_peered":"2024-04-25T22:55:41.536332+0000","last_clean":"2024-04-25T22:55:41.536332+0000","last_became_active":"2024-04-25T22:55:38.514695+0000","last_became_peered":"2024-04-25T22:55:38.514695+0000","last_unstale":"2024-04-25T22:55:41.536332+0000","last_undegraded":"2024-04-25T22:55:41.536332+0000","last_fullsized":"2024-04-25T22:55:41.536332+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:33:50.992444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187245,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":111,"num_bytes_recovered":187245,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":144,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536245+0000","last_change":"2024-04-25T22:55:27.517686+0000","last_active":"2024-04-25T22:55:41.536245+0000","last_peered":"2024-04-25T22:55:41.536245+0000","last_clean":"2024-04-25T22:55:41.536245+0000","last_became_active":"2024-04-25T22:55:27.517404+0000","last_became_peered":"2024-04-25T22:55:27.517404+0000","last_unstale":"2024-04-25T22:55:41.536245+0000","last_undegraded":"2024-04-25T22:55:41.536245+0000","last_fullsized":"2024-04-25T22:55:41.536245+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:11.671572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"55'163","reported_seq":298,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536548+0000","last_change":"2024-04-25T22:51:53.023929+0000","last_active":"2024-04-25T22:55:41.536548+0000","last_peered":"2024-04-25T22:55:41.536548+0000","last_clean":"2024-04-25T22:55:41.536548+0000","last_became_active":"2024-04-25T22:51:53.023405+0000","last_became_peered":"2024-04-25T22:51:53.023405+0000","last_unstale":"2024-04-25T22:55:41.536548+0000","last_undegraded":"2024-04-25T22:55:41.536548+0000","last_fullsized":"2024-04-25T22:55:41.536548+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:35:35.419823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130867,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":156,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859401+0000","last_change":"2024-04-25T22:55:37.516071+0000","last_active":"2024-04-25T22:55:41.859401+0000","last_peered":"2024-04-25T22:55:41.859401+0000","last_clean":"2024-04-25T22:55:41.859401+0000","last_became_active":"2024-04-25T22:55:37.515798+0000","last_became_peered":"2024-04-25T22:55:37.515798+0000","last_unstale":"2024-04-25T22:55:41.859401+0000","last_undegraded":"2024-04-25T22:55:41.859401+0000","last_fullsized":"2024-04-25T22:55:41.859401+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:27:46.635381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"55'139","reported_seq":274,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536510+0000","last_change":"2024-04-25T22:51:53.020574+0000","last_active":"2024-04-25T22:55:41.536510+0000","last_peered":"2024-04-25T22:55:41.536510+0000","last_clean":"2024-04-25T22:55:41.536510+0000","last_became_active":"2024-04-25T22:51:53.019978+0000","last_became_peered":"2024-04-25T22:51:53.019978+0000","last_unstale":"2024-04-25T22:55:41.536510+0000","last_undegraded":"2024-04-25T22:55:41.536510+0000","last_fullsized":"2024-04-25T22:55:41.536510+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:41.205051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197405,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"51'1","reported_seq":147,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858624+0000","last_change":"2024-04-25T22:55:27.517695+0000","last_active":"2024-04-25T22:55:41.858624+0000","last_peered":"2024-04-25T22:55:41.858624+0000","last_clean":"2024-04-25T22:55:41.858624+0000","last_became_active":"2024-04-25T22:55:27.517330+0000","last_became_peered":"2024-04-25T22:55:27.517330+0000","last_unstale":"2024-04-25T22:55:41.858624+0000","last_undegraded":"2024-04-25T22:55:41.858624+0000","last_fullsized":"2024-04-25T22:55:41.858624+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:15:30.181042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"55'145","reported_seq":252,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.537124+0000","last_change":"2024-04-25T22:55:31.528962+0000","last_active":"2024-04-25T22:55:41.537124+0000","last_peered":"2024-04-25T22:55:41.537124+0000","last_clean":"2024-04-25T22:55:41.537124+0000","last_became_active":"2024-04-25T22:55:31.528360+0000","last_became_peered":"2024-04-25T22:55:31.528360+0000","last_unstale":"2024-04-25T22:55:41.537124+0000","last_undegraded":"2024-04-25T22:55:41.537124+0000","last_fullsized":"2024-04-25T22:55:41.537124+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:27:45.223109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165168,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":165116,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":339,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536012+0000","last_change":"2024-04-25T22:51:47.764624+0000","last_active":"2024-04-25T22:55:41.536012+0000","last_peered":"2024-04-25T22:55:41.536012+0000","last_clean":"2024-04-25T22:55:41.536012+0000","last_became_active":"2024-04-25T22:51:47.764176+0000","last_became_peered":"2024-04-25T22:51:47.764176+0000","last_unstale":"2024-04-25T22:55:41.536012+0000","last_undegraded":"2024-04-25T22:55:41.536012+0000","last_fullsized":"2024-04-25T22:55:41.536012+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:59:39.005489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":150,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536222+0000","last_change":"2024-04-25T22:55:27.521219+0000","last_active":"2024-04-25T22:55:41.536222+0000","last_peered":"2024-04-25T22:55:41.536222+0000","last_clean":"2024-04-25T22:55:41.536222+0000","last_became_active":"2024-04-25T22:55:27.520951+0000","last_became_peered":"2024-04-25T22:55:27.520951+0000","last_unstale":"2024-04-25T22:55:41.536222+0000","last_undegraded":"2024-04-25T22:55:41.536222+0000","last_fullsized":"2024-04-25T22:55:41.536222+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:48:53.391950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"51'2","reported_seq":48,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536134+0000","last_change":"2024-04-25T22:55:27.520902+0000","last_active":"2024-04-25T22:55:41.536134+0000","last_peered":"2024-04-25T22:55:41.536134+0000","last_clean":"2024-04-25T22:55:41.536134+0000","last_became_active":"2024-04-25T22:55:27.520466+0000","last_became_peered":"2024-04-25T22:55:27.520466+0000","last_unstale":"2024-04-25T22:55:41.536134+0000","last_undegraded":"2024-04-25T22:55:41.536134+0000","last_fullsized":"2024-04-25T22:55:41.536134+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:18:17.518924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"55'150","reported_seq":285,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536563+0000","last_change":"2024-04-25T22:51:53.024106+0000","last_active":"2024-04-25T22:55:41.536563+0000","last_peered":"2024-04-25T22:55:41.536563+0000","last_clean":"2024-04-25T22:55:41.536563+0000","last_became_active":"2024-04-25T22:51:53.023497+0000","last_became_peered":"2024-04-25T22:51:53.023497+0000","last_unstale":"2024-04-25T22:55:41.536563+0000","last_undegraded":"2024-04-25T22:55:41.536563+0000","last_fullsized":"2024-04-25T22:55:41.536563+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:52:16.918935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":331484,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":143,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536139+0000","last_change":"2024-04-25T22:51:47.764591+0000","last_active":"2024-04-25T22:55:41.536139+0000","last_peered":"2024-04-25T22:55:41.536139+0000","last_clean":"2024-04-25T22:55:41.536139+0000","last_became_active":"2024-04-25T22:51:47.764229+0000","last_became_peered":"2024-04-25T22:51:47.764229+0000","last_unstale":"2024-04-25T22:55:41.536139+0000","last_undegraded":"2024-04-25T22:55:41.536139+0000","last_fullsized":"2024-04-25T22:55:41.536139+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:32.854624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"53'36","reported_seq":52,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535631+0000","last_change":"2024-04-25T22:55:27.524404+0000","last_active":"2024-04-25T22:55:41.535631+0000","last_peered":"2024-04-25T22:55:41.535631+0000","last_clean":"2024-04-25T22:55:41.535631+0000","last_became_active":"2024-04-25T22:55:27.517290+0000","last_became_peered":"2024-04-25T22:55:27.517290+0000","last_unstale":"2024-04-25T22:55:41.535631+0000","last_undegraded":"2024-04-25T22:55:41.535631+0000","last_fullsized":"2024-04-25T22:55:41.535631+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:34.809551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327644,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":343,"num_write":34,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":327644,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"55'163","reported_seq":517,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859336+0000","last_change":"2024-04-25T22:55:35.519401+0000","last_active":"2024-04-25T22:55:41.859336+0000","last_peered":"2024-04-25T22:55:41.859336+0000","last_clean":"2024-04-25T22:55:41.859336+0000","last_became_active":"2024-04-25T22:55:35.518367+0000","last_became_peered":"2024-04-25T22:55:35.518367+0000","last_unstale":"2024-04-25T22:55:41.859336+0000","last_undegraded":"2024-04-25T22:55:41.859336+0000","last_fullsized":"2024-04-25T22:55:41.859336+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:51.343892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297937,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":181,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":282175,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":48,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535954+0000","last_change":"2024-04-25T22:55:27.519726+0000","last_active":"2024-04-25T22:55:41.535954+0000","last_peered":"2024-04-25T22:55:41.535954+0000","last_clean":"2024-04-25T22:55:41.535954+0000","last_became_active":"2024-04-25T22:55:27.518412+0000","last_became_peered":"2024-04-25T22:55:27.518412+0000","last_unstale":"2024-04-25T22:55:41.535954+0000","last_undegraded":"2024-04-25T22:55:41.535954+0000","last_fullsized":"2024-04-25T22:55:41.535954+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:32:35.203827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"51'62","reported_seq":201,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858672+0000","last_change":"2024-04-25T22:51:52.018873+0000","last_active":"2024-04-25T22:55:41.858672+0000","last_peered":"2024-04-25T22:55:41.858672+0000","last_clean":"2024-04-25T22:55:41.858672+0000","last_became_active":"2024-04-25T22:51:52.018300+0000","last_became_peered":"2024-04-25T22:51:52.018300+0000","last_unstale":"2024-04-25T22:55:41.858672+0000","last_undegraded":"2024-04-25T22:55:41.858672+0000","last_fullsized":"2024-04-25T22:55:41.858672+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:25:22.660789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":4122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"55'167","reported_seq":272,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.537064+0000","last_change":"2024-04-25T22:55:32.513689+0000","last_active":"2024-04-25T22:55:41.537064+0000","last_peered":"2024-04-25T22:55:41.537064+0000","last_clean":"2024-04-25T22:55:41.537064+0000","last_became_active":"2024-04-25T22:55:32.513087+0000","last_became_peered":"2024-04-25T22:55:32.513087+0000","last_unstale":"2024-04-25T22:55:41.537064+0000","last_undegraded":"2024-04-25T22:55:41.537064+0000","last_fullsized":"2024-04-25T22:55:41.537064+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:36:56.592254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395473,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":166,"num_write_kb":573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":395432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":150,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536310+0000","last_change":"2024-04-25T22:55:27.517303+0000","last_active":"2024-04-25T22:55:41.536310+0000","last_peered":"2024-04-25T22:55:41.536310+0000","last_clean":"2024-04-25T22:55:41.536310+0000","last_became_active":"2024-04-25T22:55:27.516952+0000","last_became_peered":"2024-04-25T22:55:27.516952+0000","last_unstale":"2024-04-25T22:55:41.536310+0000","last_undegraded":"2024-04-25T22:55:41.536310+0000","last_fullsized":"2024-04-25T22:55:41.536310+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:15:25.939805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":114,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536155+0000","last_change":"2024-04-25T22:55:38.518160+0000","last_active":"2024-04-25T22:55:41.536155+0000","last_peered":"2024-04-25T22:55:41.536155+0000","last_clean":"2024-04-25T22:55:41.536155+0000","last_became_active":"2024-04-25T22:55:38.516294+0000","last_became_peered":"2024-04-25T22:55:38.516294+0000","last_unstale":"2024-04-25T22:55:41.536155+0000","last_undegraded":"2024-04-25T22:55:41.536155+0000","last_fullsized":"2024-04-25T22:55:41.536155+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:50.339431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"55'156","reported_seq":263,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536316+0000","last_change":"2024-04-25T22:55:31.527813+0000","last_active":"2024-04-25T22:55:41.536316+0000","last_peered":"2024-04-25T22:55:41.536316+0000","last_clean":"2024-04-25T22:55:41.536316+0000","last_became_active":"2024-04-25T22:55:31.526666+0000","last_became_peered":"2024-04-25T22:55:31.526666+0000","last_unstale":"2024-04-25T22:55:41.536316+0000","last_undegraded":"2024-04-25T22:55:41.536316+0000","last_fullsized":"2024-04-25T22:55:41.536316+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:18.548926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100051,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":100051,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"52'1","reported_seq":145,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536734+0000","last_change":"2024-04-25T22:55:27.517150+0000","last_active":"2024-04-25T22:55:41.536734+0000","last_peered":"2024-04-25T22:55:41.536734+0000","last_clean":"2024-04-25T22:55:41.536734+0000","last_became_active":"2024-04-25T22:55:27.516760+0000","last_became_peered":"2024-04-25T22:55:27.516760+0000","last_unstale":"2024-04-25T22:55:41.536734+0000","last_undegraded":"2024-04-25T22:55:41.536734+0000","last_fullsized":"2024-04-25T22:55:41.536734+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:20:13.546931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536169+0000","last_change":"2024-04-25T22:55:27.517202+0000","last_active":"2024-04-25T22:55:41.536169+0000","last_peered":"2024-04-25T22:55:41.536169+0000","last_clean":"2024-04-25T22:55:41.536169+0000","last_became_active":"2024-04-25T22:55:27.516272+0000","last_became_peered":"2024-04-25T22:55:27.516272+0000","last_unstale":"2024-04-25T22:55:41.536169+0000","last_undegraded":"2024-04-25T22:55:41.536169+0000","last_fullsized":"2024-04-25T22:55:41.536169+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:43:32.692434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"55'155","reported_seq":292,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858903+0000","last_change":"2024-04-25T22:51:53.026321+0000","last_active":"2024-04-25T22:55:41.858903+0000","last_peered":"2024-04-25T22:55:41.858903+0000","last_clean":"2024-04-25T22:55:41.858903+0000","last_became_active":"2024-04-25T22:51:53.025824+0000","last_became_peered":"2024-04-25T22:51:53.025824+0000","last_unstale":"2024-04-25T22:55:41.858903+0000","last_undegraded":"2024-04-25T22:55:41.858903+0000","last_fullsized":"2024-04-25T22:55:41.858903+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:12:00.793718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67397,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536444+0000","last_change":"2024-04-25T22:55:27.516710+0000","last_active":"2024-04-25T22:55:41.536444+0000","last_peered":"2024-04-25T22:55:41.536444+0000","last_clean":"2024-04-25T22:55:41.536444+0000","last_became_active":"2024-04-25T22:55:27.515536+0000","last_became_peered":"2024-04-25T22:55:27.515536+0000","last_unstale":"2024-04-25T22:55:41.536444+0000","last_undegraded":"2024-04-25T22:55:41.536444+0000","last_fullsized":"2024-04-25T22:55:41.536444+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:42:01.941338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":152,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859759+0000","last_change":"2024-04-25T22:55:27.517692+0000","last_active":"2024-04-25T22:55:41.859759+0000","last_peered":"2024-04-25T22:55:41.859759+0000","last_clean":"2024-04-25T22:55:41.859759+0000","last_became_active":"2024-04-25T22:55:27.517411+0000","last_became_peered":"2024-04-25T22:55:27.517411+0000","last_unstale":"2024-04-25T22:55:41.859759+0000","last_undegraded":"2024-04-25T22:55:41.859759+0000","last_fullsized":"2024-04-25T22:55:41.859759+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:20:09.305694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"55'175","reported_seq":312,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858983+0000","last_change":"2024-04-25T22:51:53.027051+0000","last_active":"2024-04-25T22:55:41.858983+0000","last_peered":"2024-04-25T22:55:41.858983+0000","last_clean":"2024-04-25T22:55:41.858983+0000","last_became_active":"2024-04-25T22:51:53.026458+0000","last_became_peered":"2024-04-25T22:51:53.026458+0000","last_unstale":"2024-04-25T22:55:41.858983+0000","last_undegraded":"2024-04-25T22:55:41.858983+0000","last_fullsized":"2024-04-25T22:55:41.858983+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:11:09.179564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192819,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":52,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536805+0000","last_change":"2024-04-25T22:55:27.519827+0000","last_active":"2024-04-25T22:55:41.536805+0000","last_peered":"2024-04-25T22:55:41.536805+0000","last_clean":"2024-04-25T22:55:41.536805+0000","last_became_active":"2024-04-25T22:55:27.518853+0000","last_became_peered":"2024-04-25T22:55:27.518853+0000","last_unstale":"2024-04-25T22:55:41.536805+0000","last_undegraded":"2024-04-25T22:55:41.536805+0000","last_fullsized":"2024-04-25T22:55:41.536805+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:17:48.076297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":48,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536526+0000","last_change":"2024-04-25T22:55:27.519804+0000","last_active":"2024-04-25T22:55:41.536526+0000","last_peered":"2024-04-25T22:55:41.536526+0000","last_clean":"2024-04-25T22:55:41.536526+0000","last_became_active":"2024-04-25T22:55:27.518183+0000","last_became_peered":"2024-04-25T22:55:27.518183+0000","last_unstale":"2024-04-25T22:55:41.536526+0000","last_undegraded":"2024-04-25T22:55:41.536526+0000","last_fullsized":"2024-04-25T22:55:41.536526+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:36.947733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"55'172","reported_seq":505,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536038+0000","last_change":"2024-04-25T22:55:40.539104+0000","last_active":"2024-04-25T22:55:41.536038+0000","last_peered":"2024-04-25T22:55:41.536038+0000","last_clean":"2024-04-25T22:55:41.536038+0000","last_became_active":"2024-04-25T22:55:40.538335+0000","last_became_peered":"2024-04-25T22:55:40.538335+0000","last_unstale":"2024-04-25T22:55:41.536038+0000","last_undegraded":"2024-04-25T22:55:41.536038+0000","last_fullsized":"2024-04-25T22:55:41.536038+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:45:43.336586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505702,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":1011342,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"56'37","reported_seq":67,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536555+0000","last_change":"2024-04-25T22:55:27.570707+0000","last_active":"2024-04-25T22:55:41.536555+0000","last_peered":"2024-04-25T22:55:41.536555+0000","last_clean":"2024-04-25T22:55:41.536555+0000","last_became_active":"2024-04-25T22:55:27.518193+0000","last_became_peered":"2024-04-25T22:55:27.518193+0000","last_unstale":"2024-04-25T22:55:41.536555+0000","last_undegraded":"2024-04-25T22:55:41.536555+0000","last_fullsized":"2024-04-25T22:55:41.536555+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:17:01.521730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":143,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536823+0000","last_change":"2024-04-25T22:51:47.764288+0000","last_active":"2024-04-25T22:55:41.536823+0000","last_peered":"2024-04-25T22:55:41.536823+0000","last_clean":"2024-04-25T22:55:41.536823+0000","last_became_active":"2024-04-25T22:51:47.763961+0000","last_became_peered":"2024-04-25T22:51:47.763961+0000","last_unstale":"2024-04-25T22:55:41.536823+0000","last_undegraded":"2024-04-25T22:55:41.536823+0000","last_fullsized":"2024-04-25T22:55:41.536823+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:03:07.164842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"55'142","reported_seq":279,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858601+0000","last_change":"2024-04-25T22:51:53.026925+0000","last_active":"2024-04-25T22:55:41.858601+0000","last_peered":"2024-04-25T22:55:41.858601+0000","last_clean":"2024-04-25T22:55:41.858601+0000","last_became_active":"2024-04-25T22:51:53.026419+0000","last_became_peered":"2024-04-25T22:51:53.026419+0000","last_unstale":"2024-04-25T22:55:41.858601+0000","last_undegraded":"2024-04-25T22:55:41.858601+0000","last_fullsized":"2024-04-25T22:55:41.858601+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:49:38.102060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":246196,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"55'162","reported_seq":297,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535896+0000","last_change":"2024-04-25T22:51:53.022222+0000","last_active":"2024-04-25T22:55:41.535896+0000","last_peered":"2024-04-25T22:55:41.535896+0000","last_clean":"2024-04-25T22:55:41.535896+0000","last_became_active":"2024-04-25T22:51:53.021687+0000","last_became_peered":"2024-04-25T22:51:53.021687+0000","last_unstale":"2024-04-25T22:55:41.535896+0000","last_undegraded":"2024-04-25T22:55:41.535896+0000","last_fullsized":"2024-04-25T22:55:41.535896+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:35:06.234402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108265,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"60'43","reported_seq":180,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536366+0000","last_change":"2024-04-25T22:51:52.019928+0000","last_active":"2024-04-25T22:55:41.536366+0000","last_peered":"2024-04-25T22:55:41.536366+0000","last_clean":"2024-04-25T22:55:41.536366+0000","last_became_active":"2024-04-25T22:51:52.019264+0000","last_became_peered":"2024-04-25T22:51:52.019264+0000","last_unstale":"2024-04-25T22:55:41.536366+0000","last_undegraded":"2024-04-25T22:55:41.536366+0000","last_fullsized":"2024-04-25T22:55:41.536366+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:18.136883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"55'146","reported_seq":253,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535922+0000","last_change":"2024-04-25T22:55:31.527757+0000","last_active":"2024-04-25T22:55:41.535922+0000","last_peered":"2024-04-25T22:55:41.535922+0000","last_clean":"2024-04-25T22:55:41.535922+0000","last_became_active":"2024-04-25T22:55:31.526620+0000","last_became_peered":"2024-04-25T22:55:31.526620+0000","last_unstale":"2024-04-25T22:55:41.535922+0000","last_undegraded":"2024-04-25T22:55:41.535922+0000","last_fullsized":"2024-04-25T22:55:41.535922+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:59:41.748950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89309,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":89309,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"53'21","reported_seq":160,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859669+0000","last_change":"2024-04-25T22:51:52.018977+0000","last_active":"2024-04-25T22:55:41.859669+0000","last_peered":"2024-04-25T22:55:41.859669+0000","last_clean":"2024-04-25T22:55:41.859669+0000","last_became_active":"2024-04-25T22:51:52.018519+0000","last_became_peered":"2024-04-25T22:51:52.018519+0000","last_unstale":"2024-04-25T22:55:41.859669+0000","last_undegraded":"2024-04-25T22:55:41.859669+0000","last_fullsized":"2024-04-25T22:55:41.859669+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:53:07.306148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"48'1","reported_seq":115,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536721+0000","last_change":"2024-04-25T22:55:38.517605+0000","last_active":"2024-04-25T22:55:41.536721+0000","last_peered":"2024-04-25T22:55:41.536721+0000","last_clean":"2024-04-25T22:55:41.536721+0000","last_became_active":"2024-04-25T22:55:38.515986+0000","last_became_peered":"2024-04-25T22:55:38.515986+0000","last_unstale":"2024-04-25T22:55:41.536721+0000","last_undegraded":"2024-04-25T22:55:41.536721+0000","last_fullsized":"2024-04-25T22:55:41.536721+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:02:39.264531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"55'171","reported_seq":278,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535896+0000","last_change":"2024-04-25T22:55:30.525999+0000","last_active":"2024-04-25T22:55:41.535896+0000","last_peered":"2024-04-25T22:55:41.535896+0000","last_clean":"2024-04-25T22:55:41.535896+0000","last_became_active":"2024-04-25T22:55:30.525233+0000","last_became_peered":"2024-04-25T22:55:30.525233+0000","last_unstale":"2024-04-25T22:55:41.535896+0000","last_undegraded":"2024-04-25T22:55:41.535896+0000","last_fullsized":"2024-04-25T22:55:41.535896+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:51:14.338988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":332166,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":329490,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"51'2","reported_seq":48,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536941+0000","last_change":"2024-04-25T22:55:27.519530+0000","last_active":"2024-04-25T22:55:41.536941+0000","last_peered":"2024-04-25T22:55:41.536941+0000","last_clean":"2024-04-25T22:55:41.536941+0000","last_became_active":"2024-04-25T22:55:27.518244+0000","last_became_peered":"2024-04-25T22:55:27.518244+0000","last_unstale":"2024-04-25T22:55:41.536941+0000","last_undegraded":"2024-04-25T22:55:41.536941+0000","last_fullsized":"2024-04-25T22:55:41.536941+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:40:24.373575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"55'158","reported_seq":267,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535732+0000","last_change":"2024-04-25T22:55:30.527784+0000","last_active":"2024-04-25T22:55:41.535732+0000","last_peered":"2024-04-25T22:55:41.535732+0000","last_clean":"2024-04-25T22:55:41.535732+0000","last_became_active":"2024-04-25T22:55:30.526853+0000","last_became_peered":"2024-04-25T22:55:30.526853+0000","last_unstale":"2024-04-25T22:55:41.535732+0000","last_undegraded":"2024-04-25T22:55:41.535732+0000","last_fullsized":"2024-04-25T22:55:41.535732+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:19:11.705754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70967,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":70967,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"55'172","reported_seq":309,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859717+0000","last_change":"2024-04-25T22:51:53.029210+0000","last_active":"2024-04-25T22:55:41.859717+0000","last_peered":"2024-04-25T22:55:41.859717+0000","last_clean":"2024-04-25T22:55:41.859717+0000","last_became_active":"2024-04-25T22:51:53.028635+0000","last_became_peered":"2024-04-25T22:51:53.028635+0000","last_unstale":"2024-04-25T22:55:41.859717+0000","last_undegraded":"2024-04-25T22:55:41.859717+0000","last_fullsized":"2024-04-25T22:55:41.859717+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:41.205051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":440592,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"50'1","reported_seq":48,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535599+0000","last_change":"2024-04-25T22:55:27.516136+0000","last_active":"2024-04-25T22:55:41.535599+0000","last_peered":"2024-04-25T22:55:41.535599+0000","last_clean":"2024-04-25T22:55:41.535599+0000","last_became_active":"2024-04-25T22:55:27.515473+0000","last_became_peered":"2024-04-25T22:55:27.515473+0000","last_unstale":"2024-04-25T22:55:41.535599+0000","last_undegraded":"2024-04-25T22:55:41.535599+0000","last_fullsized":"2024-04-25T22:55:41.535599+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:51:59.771248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"55'151","reported_seq":250,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536783+0000","last_change":"2024-04-25T22:55:34.513243+0000","last_active":"2024-04-25T22:55:41.536783+0000","last_peered":"2024-04-25T22:55:41.536783+0000","last_clean":"2024-04-25T22:55:41.536783+0000","last_became_active":"2024-04-25T22:55:34.512137+0000","last_became_peered":"2024-04-25T22:55:34.512137+0000","last_unstale":"2024-04-25T22:55:41.536783+0000","last_undegraded":"2024-04-25T22:55:41.536783+0000","last_fullsized":"2024-04-25T22:55:41.536783+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:06:40.451167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106917,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":97731,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":76,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535673+0000","last_change":"2024-04-25T22:55:37.514177+0000","last_active":"2024-04-25T22:55:41.535673+0000","last_peered":"2024-04-25T22:55:41.535673+0000","last_clean":"2024-04-25T22:55:41.535673+0000","last_became_active":"2024-04-25T22:55:37.513925+0000","last_became_peered":"2024-04-25T22:55:37.513925+0000","last_unstale":"2024-04-25T22:55:41.535673+0000","last_undegraded":"2024-04-25T22:55:41.535673+0000","last_fullsized":"2024-04-25T22:55:41.535673+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:12:09.421061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"55'203","reported_seq":340,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859317+0000","last_change":"2024-04-25T22:51:53.028084+0000","last_active":"2024-04-25T22:55:41.859317+0000","last_peered":"2024-04-25T22:55:41.859317+0000","last_clean":"2024-04-25T22:55:41.859317+0000","last_became_active":"2024-04-25T22:51:53.027541+0000","last_became_peered":"2024-04-25T22:51:53.027541+0000","last_unstale":"2024-04-25T22:55:41.859317+0000","last_undegraded":"2024-04-25T22:55:41.859317+0000","last_fullsized":"2024-04-25T22:55:41.859317+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:28:42.903045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195653,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"48'2","reported_seq":153,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859141+0000","last_change":"2024-04-25T22:55:27.541798+0000","last_active":"2024-04-25T22:55:41.859141+0000","last_peered":"2024-04-25T22:55:41.859141+0000","last_clean":"2024-04-25T22:55:41.859141+0000","last_became_active":"2024-04-25T22:55:27.517718+0000","last_became_peered":"2024-04-25T22:55:27.517718+0000","last_unstale":"2024-04-25T22:55:41.859141+0000","last_undegraded":"2024-04-25T22:55:41.859141+0000","last_fullsized":"2024-04-25T22:55:41.859141+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:48:57.633186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"55'168","reported_seq":524,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858951+0000","last_change":"2024-04-25T22:55:34.514499+0000","last_active":"2024-04-25T22:55:41.858951+0000","last_peered":"2024-04-25T22:55:41.858951+0000","last_clean":"2024-04-25T22:55:41.858951+0000","last_became_active":"2024-04-25T22:55:34.513433+0000","last_became_peered":"2024-04-25T22:55:34.513433+0000","last_unstale":"2024-04-25T22:55:41.858951+0000","last_undegraded":"2024-04-25T22:55:41.858951+0000","last_fullsized":"2024-04-25T22:55:41.858951+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:58:08.177184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151921,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":151921,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"47'5","reported_seq":170,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859179+0000","last_change":"2024-04-25T22:55:37.559449+0000","last_active":"2024-04-25T22:55:41.859179+0000","last_peered":"2024-04-25T22:55:41.859179+0000","last_clean":"2024-04-25T22:55:41.859179+0000","last_became_active":"2024-04-25T22:55:37.516119+0000","last_became_peered":"2024-04-25T22:55:37.516119+0000","last_unstale":"2024-04-25T22:55:41.859179+0000","last_undegraded":"2024-04-25T22:55:41.859179+0000","last_fullsized":"2024-04-25T22:55:41.859179+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:25:42.548782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"55'166","reported_seq":505,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535835+0000","last_change":"2024-04-25T22:55:38.518734+0000","last_active":"2024-04-25T22:55:41.535835+0000","last_peered":"2024-04-25T22:55:41.535835+0000","last_clean":"2024-04-25T22:55:41.535835+0000","last_became_active":"2024-04-25T22:55:38.516260+0000","last_became_peered":"2024-04-25T22:55:38.516260+0000","last_unstale":"2024-04-25T22:55:41.535835+0000","last_undegraded":"2024-04-25T22:55:41.535835+0000","last_fullsized":"2024-04-25T22:55:41.535835+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:25:43.553244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3798024,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":3871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":3798024,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535940+0000","last_change":"2024-04-25T22:55:38.520672+0000","last_active":"2024-04-25T22:55:41.535940+0000","last_peered":"2024-04-25T22:55:41.535940+0000","last_clean":"2024-04-25T22:55:41.535940+0000","last_became_active":"2024-04-25T22:55:38.515776+0000","last_became_peered":"2024-04-25T22:55:38.515776+0000","last_unstale":"2024-04-25T22:55:41.535940+0000","last_undegraded":"2024-04-25T22:55:41.535940+0000","last_fullsized":"2024-04-25T22:55:41.535940+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:53.584300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"55'158","reported_seq":495,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536078+0000","last_change":"2024-04-25T22:55:38.516465+0000","last_active":"2024-04-25T22:55:41.536078+0000","last_peered":"2024-04-25T22:55:41.536078+0000","last_clean":"2024-04-25T22:55:41.536078+0000","last_became_active":"2024-04-25T22:55:38.514732+0000","last_became_peered":"2024-04-25T22:55:38.514732+0000","last_unstale":"2024-04-25T22:55:41.536078+0000","last_undegraded":"2024-04-25T22:55:41.536078+0000","last_fullsized":"2024-04-25T22:55:41.536078+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:42:09.860717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141656,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":141656,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"50'57","reported_seq":196,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859521+0000","last_change":"2024-04-25T22:51:52.019032+0000","last_active":"2024-04-25T22:55:41.859521+0000","last_peered":"2024-04-25T22:55:41.859521+0000","last_clean":"2024-04-25T22:55:41.859521+0000","last_became_active":"2024-04-25T22:51:52.018547+0000","last_became_peered":"2024-04-25T22:51:52.018547+0000","last_unstale":"2024-04-25T22:55:41.859521+0000","last_undegraded":"2024-04-25T22:55:41.859521+0000","last_fullsized":"2024-04-25T22:55:41.859521+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:10:00.056491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":8213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"55'169","reported_seq":535,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859326+0000","last_change":"2024-04-25T22:55:35.518155+0000","last_active":"2024-04-25T22:55:41.859326+0000","last_peered":"2024-04-25T22:55:41.859326+0000","last_clean":"2024-04-25T22:55:41.859326+0000","last_became_active":"2024-04-25T22:55:35.517149+0000","last_became_peered":"2024-04-25T22:55:35.517149+0000","last_unstale":"2024-04-25T22:55:41.859326+0000","last_undegraded":"2024-04-25T22:55:41.859326+0000","last_fullsized":"2024-04-25T22:55:41.859326+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:50.123900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184603,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":194,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":166098,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"48'25","reported_seq":56,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536897+0000","last_change":"2024-04-25T22:55:27.586742+0000","last_active":"2024-04-25T22:55:41.536897+0000","last_peered":"2024-04-25T22:55:41.536897+0000","last_clean":"2024-04-25T22:55:41.536897+0000","last_became_active":"2024-04-25T22:55:27.520617+0000","last_became_peered":"2024-04-25T22:55:27.520617+0000","last_unstale":"2024-04-25T22:55:41.536897+0000","last_undegraded":"2024-04-25T22:55:41.536897+0000","last_fullsized":"2024-04-25T22:55:41.536897+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:58:12.148059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"55'196","reported_seq":594,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535817+0000","last_change":"2024-04-25T22:55:31.526793+0000","last_active":"2024-04-25T22:55:41.535817+0000","last_peered":"2024-04-25T22:55:41.535817+0000","last_clean":"2024-04-25T22:55:41.535817+0000","last_became_active":"2024-04-25T22:55:31.526322+0000","last_became_peered":"2024-04-25T22:55:31.526322+0000","last_unstale":"2024-04-25T22:55:41.535817+0000","last_undegraded":"2024-04-25T22:55:41.535817+0000","last_fullsized":"2024-04-25T22:55:41.535817+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:58.561902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200980,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":211,"num_write_kb":410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":126,"num_bytes_recovered":197679,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"48'7","reported_seq":98,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536679+0000","last_change":"2024-04-25T22:55:37.541050+0000","last_active":"2024-04-25T22:55:41.536679+0000","last_peered":"2024-04-25T22:55:41.536679+0000","last_clean":"2024-04-25T22:55:41.536679+0000","last_became_active":"2024-04-25T22:55:37.516183+0000","last_became_peered":"2024-04-25T22:55:37.516183+0000","last_unstale":"2024-04-25T22:55:41.536679+0000","last_undegraded":"2024-04-25T22:55:41.536679+0000","last_fullsized":"2024-04-25T22:55:41.536679+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:30.075399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8389190,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26691649,"num_objects":3448,"num_object_clones":0,"num_object_copies":6896,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3448,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10583,"num_write_kb":38991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4953,"num_bytes_recovered":24173691,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73056256,"data_stored":53061590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10415,"ondisk_log_size":10415,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":40502861,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":34,"num_read_kb":343,"num_write":470,"num_write_kb":40224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":32113365,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":81068032,"data_stored":81005722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5351,"internal_metadata":0},"log_size":434,"ondisk_log_size":434,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738419,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84816,"kb_used_data":49476,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94287024,"statfs":{"total":96636764160,"available":96549912576,"internally_reserved":0,"allocated":50663424,"data_stored":43767232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":62,"seq":266287972358,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85248,"kb_used_data":45232,"kb_used_omap":6,"kb_used_meta":39993,"kb_avail":94286592,"statfs":{"total":96636764160,"available":96549470208,"internally_reserved":0,"allocated":46317568,"data_stored":38899263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6946,"internal_metadata":40953054},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738419,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":102580,"kb_used_data":58912,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94269260,"statfs":{"total":96636764160,"available":96531722240,"internally_reserved":0,"allocated":60325888,"data_stored":53539649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32145408,"data_stored":32114253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19542016,"data_stored":19530487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5351,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":29380608,"data_stored":29360982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":26918912,"data_stored":20514252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26107904,"data_stored":19048000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20029440,"data_stored":13499338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:55:46.771 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:55:47.107 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:55:47.109 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-25T22:55:47.118 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":195,"stamp":"2024-04-25T22:55:45.987513+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":67784878,"num_objects":3482,"num_object_clones":0,"num_object_copies":6964,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3482,"num_whiteouts":0,"num_read":170,"num_read_kb":461,"num_write":11256,"num_write_kb":82675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4966,"num_bytes_recovered":56287056,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11006,"ondisk_log_size":11006,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":212,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":272644,"kb_used_data":153620,"kb_used_omap":9,"kb_used_meta":118966,"kb_avail":282842876,"statfs":{"total":289910292480,"available":289631105024,"internally_reserved":0,"allocated":157306880,"data_stored":136206144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10136,"internal_metadata":121821288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":209,"num_bytes_recovered":9238667,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.459375"},"pg_stats":[{"pgid":"4.3f","version":"55'160","reported_seq":516,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859594+0000","last_change":"2024-04-25T22:55:34.515388+0000","last_active":"2024-04-25T22:55:41.859594+0000","last_peered":"2024-04-25T22:55:41.859594+0000","last_clean":"2024-04-25T22:55:41.859594+0000","last_became_active":"2024-04-25T22:55:34.514302+0000","last_became_peered":"2024-04-25T22:55:34.514302+0000","last_unstale":"2024-04-25T22:55:41.859594+0000","last_undegraded":"2024-04-25T22:55:41.859594+0000","last_fullsized":"2024-04-25T22:55:41.859594+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:08:19.339484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168293,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":168293,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"55'153","reported_seq":495,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859178+0000","last_change":"2024-04-25T22:55:35.519132+0000","last_active":"2024-04-25T22:55:41.859178+0000","last_peered":"2024-04-25T22:55:41.859178+0000","last_clean":"2024-04-25T22:55:41.859178+0000","last_became_active":"2024-04-25T22:55:35.517561+0000","last_became_peered":"2024-04-25T22:55:35.517561+0000","last_unstale":"2024-04-25T22:55:41.859178+0000","last_undegraded":"2024-04-25T22:55:41.859178+0000","last_fullsized":"2024-04-25T22:55:41.859178+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:02:40.268992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286387,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":286387,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"55'164","reported_seq":238,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536366+0000","last_change":"2024-04-25T22:55:38.519244+0000","last_active":"2024-04-25T22:55:41.536366+0000","last_peered":"2024-04-25T22:55:41.536366+0000","last_clean":"2024-04-25T22:55:41.536366+0000","last_became_active":"2024-04-25T22:55:38.517874+0000","last_became_peered":"2024-04-25T22:55:38.517874+0000","last_unstale":"2024-04-25T22:55:41.536366+0000","last_undegraded":"2024-04-25T22:55:41.536366+0000","last_fullsized":"2024-04-25T22:55:41.536366+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:45:27.635067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130188,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"55'126","reported_seq":423,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536210+0000","last_change":"2024-04-25T22:55:38.516209+0000","last_active":"2024-04-25T22:55:41.536210+0000","last_peered":"2024-04-25T22:55:41.536210+0000","last_clean":"2024-04-25T22:55:41.536210+0000","last_became_active":"2024-04-25T22:55:38.513558+0000","last_became_peered":"2024-04-25T22:55:38.513558+0000","last_unstale":"2024-04-25T22:55:41.536210+0000","last_undegraded":"2024-04-25T22:55:41.536210+0000","last_fullsized":"2024-04-25T22:55:41.536210+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:50.123900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142819,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":135761,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"55'173","reported_seq":559,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859149+0000","last_change":"2024-04-25T22:55:35.517931+0000","last_active":"2024-04-25T22:55:41.859149+0000","last_peered":"2024-04-25T22:55:41.859149+0000","last_clean":"2024-04-25T22:55:41.859149+0000","last_became_active":"2024-04-25T22:55:35.517044+0000","last_became_peered":"2024-04-25T22:55:35.517044+0000","last_unstale":"2024-04-25T22:55:41.859149+0000","last_undegraded":"2024-04-25T22:55:41.859149+0000","last_fullsized":"2024-04-25T22:55:41.859149+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:42.118131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":709662,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":119,"num_bytes_recovered":709653,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"55'173","reported_seq":516,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535750+0000","last_change":"2024-04-25T22:55:38.515187+0000","last_active":"2024-04-25T22:55:41.535750+0000","last_peered":"2024-04-25T22:55:41.535750+0000","last_clean":"2024-04-25T22:55:41.535750+0000","last_became_active":"2024-04-25T22:55:38.513456+0000","last_became_peered":"2024-04-25T22:55:38.513456+0000","last_unstale":"2024-04-25T22:55:41.535750+0000","last_undegraded":"2024-04-25T22:55:41.535750+0000","last_fullsized":"2024-04-25T22:55:41.535750+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:08:19.339484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569466,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":569466,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"55'173","reported_seq":541,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535869+0000","last_change":"2024-04-25T22:55:33.512839+0000","last_active":"2024-04-25T22:55:41.535869+0000","last_peered":"2024-04-25T22:55:41.535869+0000","last_clean":"2024-04-25T22:55:41.535869+0000","last_became_active":"2024-04-25T22:55:33.511961+0000","last_became_peered":"2024-04-25T22:55:33.511961+0000","last_unstale":"2024-04-25T22:55:41.535869+0000","last_undegraded":"2024-04-25T22:55:41.535869+0000","last_fullsized":"2024-04-25T22:55:41.535869+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:54:45.619674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75460,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":111,"num_bytes_recovered":75460,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"55'140","reported_seq":456,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535457+0000","last_change":"2024-04-25T22:55:32.510322+0000","last_active":"2024-04-25T22:55:41.535457+0000","last_peered":"2024-04-25T22:55:41.535457+0000","last_clean":"2024-04-25T22:55:41.535457+0000","last_became_active":"2024-04-25T22:55:32.509908+0000","last_became_peered":"2024-04-25T22:55:32.509908+0000","last_unstale":"2024-04-25T22:55:41.535457+0000","last_undegraded":"2024-04-25T22:55:41.535457+0000","last_fullsized":"2024-04-25T22:55:41.535457+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:16:15.948780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":214453,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":214404,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"55'169","reported_seq":274,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536936+0000","last_change":"2024-04-25T22:55:32.513084+0000","last_active":"2024-04-25T22:55:41.536936+0000","last_peered":"2024-04-25T22:55:41.536936+0000","last_clean":"2024-04-25T22:55:41.536936+0000","last_became_active":"2024-04-25T22:55:32.512447+0000","last_became_peered":"2024-04-25T22:55:32.512447+0000","last_unstale":"2024-04-25T22:55:41.536936+0000","last_undegraded":"2024-04-25T22:55:41.536936+0000","last_fullsized":"2024-04-25T22:55:41.536936+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:16:27.593679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":538374,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":538374,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"55'153","reported_seq":483,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859293+0000","last_change":"2024-04-25T22:55:35.518293+0000","last_active":"2024-04-25T22:55:41.859293+0000","last_peered":"2024-04-25T22:55:41.859293+0000","last_clean":"2024-04-25T22:55:41.859293+0000","last_became_active":"2024-04-25T22:55:35.517506+0000","last_became_peered":"2024-04-25T22:55:35.517506+0000","last_unstale":"2024-04-25T22:55:41.859293+0000","last_undegraded":"2024-04-25T22:55:41.859293+0000","last_fullsized":"2024-04-25T22:55:41.859293+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:42:09.860717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130447,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":123390,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"55'154","reported_seq":258,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536002+0000","last_change":"2024-04-25T22:55:40.538872+0000","last_active":"2024-04-25T22:55:41.536002+0000","last_peered":"2024-04-25T22:55:41.536002+0000","last_clean":"2024-04-25T22:55:41.536002+0000","last_became_active":"2024-04-25T22:55:40.538052+0000","last_became_peered":"2024-04-25T22:55:40.538052+0000","last_unstale":"2024-04-25T22:55:41.536002+0000","last_undegraded":"2024-04-25T22:55:41.536002+0000","last_fullsized":"2024-04-25T22:55:41.536002+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:06.239983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":343806,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":208,"num_bytes_recovered":687612,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"55'141","reported_seq":278,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858898+0000","last_change":"2024-04-25T22:51:53.028006+0000","last_active":"2024-04-25T22:55:41.858898+0000","last_peered":"2024-04-25T22:55:41.858898+0000","last_clean":"2024-04-25T22:55:41.858898+0000","last_became_active":"2024-04-25T22:51:53.027363+0000","last_became_peered":"2024-04-25T22:51:53.027363+0000","last_unstale":"2024-04-25T22:55:41.858898+0000","last_undegraded":"2024-04-25T22:55:41.858898+0000","last_fullsized":"2024-04-25T22:55:41.858898+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:32.923620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125409,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"55'135","reported_seq":459,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858862+0000","last_change":"2024-04-25T22:55:33.512249+0000","last_active":"2024-04-25T22:55:41.858862+0000","last_peered":"2024-04-25T22:55:41.858862+0000","last_clean":"2024-04-25T22:55:41.858862+0000","last_became_active":"2024-04-25T22:55:33.511546+0000","last_became_peered":"2024-04-25T22:55:33.511546+0000","last_unstale":"2024-04-25T22:55:41.858862+0000","last_undegraded":"2024-04-25T22:55:41.858862+0000","last_fullsized":"2024-04-25T22:55:41.858862+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:52:41.758279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":183835,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":183835,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"55'179","reported_seq":314,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535808+0000","last_change":"2024-04-25T22:51:53.022367+0000","last_active":"2024-04-25T22:55:41.535808+0000","last_peered":"2024-04-25T22:55:41.535808+0000","last_clean":"2024-04-25T22:55:41.535808+0000","last_became_active":"2024-04-25T22:51:53.021902+0000","last_became_peered":"2024-04-25T22:51:53.021902+0000","last_unstale":"2024-04-25T22:55:41.535808+0000","last_undegraded":"2024-04-25T22:55:41.535808+0000","last_fullsized":"2024-04-25T22:55:41.535808+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:44:59.401139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153371,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":181,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"55'161","reported_seq":273,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535564+0000","last_change":"2024-04-25T22:55:40.539371+0000","last_active":"2024-04-25T22:55:41.535564+0000","last_peered":"2024-04-25T22:55:41.535564+0000","last_clean":"2024-04-25T22:55:41.535564+0000","last_became_active":"2024-04-25T22:55:40.538095+0000","last_became_peered":"2024-04-25T22:55:40.538095+0000","last_unstale":"2024-04-25T22:55:41.535564+0000","last_undegraded":"2024-04-25T22:55:41.535564+0000","last_fullsized":"2024-04-25T22:55:41.535564+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:57.514231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4276239,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":4418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":4276214,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"55'179","reported_seq":551,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535530+0000","last_change":"2024-04-25T22:55:31.526766+0000","last_active":"2024-04-25T22:55:41.535530+0000","last_peered":"2024-04-25T22:55:41.535530+0000","last_clean":"2024-04-25T22:55:41.535530+0000","last_became_active":"2024-04-25T22:55:31.526271+0000","last_became_peered":"2024-04-25T22:55:31.526271+0000","last_unstale":"2024-04-25T22:55:41.535530+0000","last_undegraded":"2024-04-25T22:55:41.535530+0000","last_fullsized":"2024-04-25T22:55:41.535530+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:48:39.183880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4371943,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":4513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":4363238,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"55'163","reported_seq":268,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536806+0000","last_change":"2024-04-25T22:55:32.513240+0000","last_active":"2024-04-25T22:55:41.536806+0000","last_peered":"2024-04-25T22:55:41.536806+0000","last_clean":"2024-04-25T22:55:41.536806+0000","last_became_active":"2024-04-25T22:55:32.512371+0000","last_became_peered":"2024-04-25T22:55:32.512371+0000","last_unstale":"2024-04-25T22:55:41.536806+0000","last_undegraded":"2024-04-25T22:55:41.536806+0000","last_fullsized":"2024-04-25T22:55:41.536806+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:23.735382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96221,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":87110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"55'147","reported_seq":487,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859496+0000","last_change":"2024-04-25T22:55:35.519379+0000","last_active":"2024-04-25T22:55:41.859496+0000","last_peered":"2024-04-25T22:55:41.859496+0000","last_clean":"2024-04-25T22:55:41.859496+0000","last_became_active":"2024-04-25T22:55:35.518584+0000","last_became_peered":"2024-04-25T22:55:35.518584+0000","last_unstale":"2024-04-25T22:55:41.859496+0000","last_undegraded":"2024-04-25T22:55:41.859496+0000","last_fullsized":"2024-04-25T22:55:41.859496+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:33:50.992444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1432264,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":1532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":1432241,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"55'146","reported_seq":255,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536568+0000","last_change":"2024-04-25T22:55:30.527560+0000","last_active":"2024-04-25T22:55:41.536568+0000","last_peered":"2024-04-25T22:55:41.536568+0000","last_clean":"2024-04-25T22:55:41.536568+0000","last_became_active":"2024-04-25T22:55:30.526745+0000","last_became_peered":"2024-04-25T22:55:30.526745+0000","last_unstale":"2024-04-25T22:55:41.536568+0000","last_undegraded":"2024-04-25T22:55:41.536568+0000","last_fullsized":"2024-04-25T22:55:41.536568+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:40:08.494734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112933,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":112933,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"55'178","reported_seq":548,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536195+0000","last_change":"2024-04-25T22:55:34.512671+0000","last_active":"2024-04-25T22:55:41.536195+0000","last_peered":"2024-04-25T22:55:41.536195+0000","last_clean":"2024-04-25T22:55:41.536195+0000","last_became_active":"2024-04-25T22:55:34.511872+0000","last_became_peered":"2024-04-25T22:55:34.511872+0000","last_unstale":"2024-04-25T22:55:41.536195+0000","last_undegraded":"2024-04-25T22:55:41.536195+0000","last_fullsized":"2024-04-25T22:55:41.536195+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:43:12.293070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124334,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":124334,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"55'158","reported_seq":500,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535980+0000","last_change":"2024-04-25T22:55:34.512430+0000","last_active":"2024-04-25T22:55:41.535980+0000","last_peered":"2024-04-25T22:55:41.535980+0000","last_clean":"2024-04-25T22:55:41.535980+0000","last_became_active":"2024-04-25T22:55:34.511833+0000","last_became_peered":"2024-04-25T22:55:34.511833+0000","last_unstale":"2024-04-25T22:55:41.535980+0000","last_undegraded":"2024-04-25T22:55:41.535980+0000","last_fullsized":"2024-04-25T22:55:41.535980+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:52:03.534174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145029,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":145029,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"55'171","reported_seq":308,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858838+0000","last_change":"2024-04-25T22:51:53.026746+0000","last_active":"2024-04-25T22:55:41.858838+0000","last_peered":"2024-04-25T22:55:41.858838+0000","last_clean":"2024-04-25T22:55:41.858838+0000","last_became_active":"2024-04-25T22:51:53.025938+0000","last_became_peered":"2024-04-25T22:51:53.025938+0000","last_unstale":"2024-04-25T22:55:41.858838+0000","last_undegraded":"2024-04-25T22:55:41.858838+0000","last_fullsized":"2024-04-25T22:55:41.858838+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:38:03.428258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115019,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"55'161","reported_seq":262,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535818+0000","last_change":"2024-04-25T22:55:33.513307+0000","last_active":"2024-04-25T22:55:41.535818+0000","last_peered":"2024-04-25T22:55:41.535818+0000","last_clean":"2024-04-25T22:55:41.535818+0000","last_became_active":"2024-04-25T22:55:33.512160+0000","last_became_peered":"2024-04-25T22:55:33.512160+0000","last_unstale":"2024-04-25T22:55:41.535818+0000","last_undegraded":"2024-04-25T22:55:41.535818+0000","last_fullsized":"2024-04-25T22:55:41.535818+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:57:16.042728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":641227,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":641227,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"55'169","reported_seq":525,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858515+0000","last_change":"2024-04-25T22:55:33.512249+0000","last_active":"2024-04-25T22:55:41.858515+0000","last_peered":"2024-04-25T22:55:41.858515+0000","last_clean":"2024-04-25T22:55:41.858515+0000","last_became_active":"2024-04-25T22:55:33.511463+0000","last_became_peered":"2024-04-25T22:55:33.511463+0000","last_unstale":"2024-04-25T22:55:41.858515+0000","last_undegraded":"2024-04-25T22:55:41.858515+0000","last_fullsized":"2024-04-25T22:55:41.858515+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:54:45.619674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103634,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":189,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":98869,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"55'159","reported_seq":296,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859682+0000","last_change":"2024-04-25T22:51:53.028155+0000","last_active":"2024-04-25T22:55:41.859682+0000","last_peered":"2024-04-25T22:55:41.859682+0000","last_clean":"2024-04-25T22:55:41.859682+0000","last_became_active":"2024-04-25T22:51:53.027867+0000","last_became_peered":"2024-04-25T22:51:53.027867+0000","last_unstale":"2024-04-25T22:55:41.859682+0000","last_undegraded":"2024-04-25T22:55:41.859682+0000","last_fullsized":"2024-04-25T22:55:41.859682+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:43:47.453569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272252,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"55'190","reported_seq":289,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536880+0000","last_change":"2024-04-25T22:55:34.513270+0000","last_active":"2024-04-25T22:55:41.536880+0000","last_peered":"2024-04-25T22:55:41.536880+0000","last_clean":"2024-04-25T22:55:41.536880+0000","last_became_active":"2024-04-25T22:55:34.512320+0000","last_became_peered":"2024-04-25T22:55:34.512320+0000","last_unstale":"2024-04-25T22:55:41.536880+0000","last_undegraded":"2024-04-25T22:55:41.536880+0000","last_fullsized":"2024-04-25T22:55:41.536880+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:37.486013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126403,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":117,"num_bytes_recovered":126342,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"55'151","reported_seq":286,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536427+0000","last_change":"2024-04-25T22:51:53.022893+0000","last_active":"2024-04-25T22:55:41.536427+0000","last_peered":"2024-04-25T22:55:41.536427+0000","last_clean":"2024-04-25T22:55:41.536427+0000","last_became_active":"2024-04-25T22:51:53.022407+0000","last_became_peered":"2024-04-25T22:51:53.022407+0000","last_unstale":"2024-04-25T22:55:41.536427+0000","last_undegraded":"2024-04-25T22:55:41.536427+0000","last_fullsized":"2024-04-25T22:55:41.536427+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:08:44.404718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69245,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"55'147","reported_seq":284,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859212+0000","last_change":"2024-04-25T22:51:53.028447+0000","last_active":"2024-04-25T22:55:41.859212+0000","last_peered":"2024-04-25T22:55:41.859212+0000","last_clean":"2024-04-25T22:55:41.859212+0000","last_became_active":"2024-04-25T22:51:53.027852+0000","last_became_peered":"2024-04-25T22:51:53.027852+0000","last_unstale":"2024-04-25T22:55:41.859212+0000","last_undegraded":"2024-04-25T22:55:41.859212+0000","last_fullsized":"2024-04-25T22:55:41.859212+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:16.187194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192848,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"55'166","reported_seq":267,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535904+0000","last_change":"2024-04-25T22:55:34.514981+0000","last_active":"2024-04-25T22:55:41.535904+0000","last_peered":"2024-04-25T22:55:41.535904+0000","last_clean":"2024-04-25T22:55:41.535904+0000","last_became_active":"2024-04-25T22:55:34.514067+0000","last_became_peered":"2024-04-25T22:55:34.514067+0000","last_unstale":"2024-04-25T22:55:41.535904+0000","last_undegraded":"2024-04-25T22:55:41.535904+0000","last_fullsized":"2024-04-25T22:55:41.535904+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:05:49.273497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239074,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":239074,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"55'191","reported_seq":328,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859081+0000","last_change":"2024-04-25T22:51:53.026997+0000","last_active":"2024-04-25T22:55:41.859081+0000","last_peered":"2024-04-25T22:55:41.859081+0000","last_clean":"2024-04-25T22:55:41.859081+0000","last_became_active":"2024-04-25T22:51:53.026379+0000","last_became_peered":"2024-04-25T22:51:53.026379+0000","last_unstale":"2024-04-25T22:55:41.859081+0000","last_undegraded":"2024-04-25T22:55:41.859081+0000","last_fullsized":"2024-04-25T22:55:41.859081+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:33:24.700106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99668,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"55'193","reported_seq":298,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536272+0000","last_change":"2024-04-25T22:55:32.511886+0000","last_active":"2024-04-25T22:55:41.536272+0000","last_peered":"2024-04-25T22:55:41.536272+0000","last_clean":"2024-04-25T22:55:41.536272+0000","last_became_active":"2024-04-25T22:55:32.509978+0000","last_became_peered":"2024-04-25T22:55:32.509978+0000","last_unstale":"2024-04-25T22:55:41.536272+0000","last_undegraded":"2024-04-25T22:55:41.536272+0000","last_fullsized":"2024-04-25T22:55:41.536272+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:56:47.747527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128069,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":128069,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"55'182","reported_seq":537,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535588+0000","last_change":"2024-04-25T22:55:38.519451+0000","last_active":"2024-04-25T22:55:41.535588+0000","last_peered":"2024-04-25T22:55:41.535588+0000","last_clean":"2024-04-25T22:55:41.535588+0000","last_became_active":"2024-04-25T22:55:38.518412+0000","last_became_peered":"2024-04-25T22:55:38.518412+0000","last_unstale":"2024-04-25T22:55:41.535588+0000","last_undegraded":"2024-04-25T22:55:41.535588+0000","last_fullsized":"2024-04-25T22:55:41.535588+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:27.179735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":586629,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":580754,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"55'156","reported_seq":494,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859060+0000","last_change":"2024-04-25T22:55:33.512918+0000","last_active":"2024-04-25T22:55:41.859060+0000","last_peered":"2024-04-25T22:55:41.859060+0000","last_clean":"2024-04-25T22:55:41.859060+0000","last_became_active":"2024-04-25T22:55:33.512114+0000","last_became_peered":"2024-04-25T22:55:33.512114+0000","last_unstale":"2024-04-25T22:55:41.859060+0000","last_undegraded":"2024-04-25T22:55:41.859060+0000","last_fullsized":"2024-04-25T22:55:41.859060+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:52:03.534174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118861,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":118861,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"60'105","reported_seq":256,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536115+0000","last_change":"2024-04-25T22:55:30.526027+0000","last_active":"2024-04-25T22:55:41.536115+0000","last_peered":"2024-04-25T22:55:41.536115+0000","last_clean":"2024-04-25T22:55:41.536115+0000","last_became_active":"2024-04-25T22:55:30.525469+0000","last_became_peered":"2024-04-25T22:55:30.525469+0000","last_unstale":"2024-04-25T22:55:41.536115+0000","last_undegraded":"2024-04-25T22:55:41.536115+0000","last_fullsized":"2024-04-25T22:55:41.536115+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:18:16.878967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2425045,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":2428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":2425011,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"55'146","reported_seq":472,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859394+0000","last_change":"2024-04-25T22:55:30.525674+0000","last_active":"2024-04-25T22:55:41.859394+0000","last_peered":"2024-04-25T22:55:41.859394+0000","last_clean":"2024-04-25T22:55:41.859394+0000","last_became_active":"2024-04-25T22:55:30.524718+0000","last_became_peered":"2024-04-25T22:55:30.524718+0000","last_unstale":"2024-04-25T22:55:41.859394+0000","last_undegraded":"2024-04-25T22:55:41.859394+0000","last_fullsized":"2024-04-25T22:55:41.859394+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:48:39.183880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67079,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":89,"num_bytes_recovered":67079,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":48,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535977+0000","last_change":"2024-04-25T22:55:27.517626+0000","last_active":"2024-04-25T22:55:41.535977+0000","last_peered":"2024-04-25T22:55:41.535977+0000","last_clean":"2024-04-25T22:55:41.535977+0000","last_became_active":"2024-04-25T22:55:27.517208+0000","last_became_peered":"2024-04-25T22:55:27.517208+0000","last_unstale":"2024-04-25T22:55:41.535977+0000","last_undegraded":"2024-04-25T22:55:41.535977+0000","last_fullsized":"2024-04-25T22:55:41.535977+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:09.249311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"55'186","reported_seq":287,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536662+0000","last_change":"2024-04-25T22:55:33.513626+0000","last_active":"2024-04-25T22:55:41.536662+0000","last_peered":"2024-04-25T22:55:41.536662+0000","last_clean":"2024-04-25T22:55:41.536662+0000","last_became_active":"2024-04-25T22:55:33.512389+0000","last_became_peered":"2024-04-25T22:55:33.512389+0000","last_unstale":"2024-04-25T22:55:41.536662+0000","last_undegraded":"2024-04-25T22:55:41.536662+0000","last_fullsized":"2024-04-25T22:55:41.536662+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:02:53.672517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139986,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":137763,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":139,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859045+0000","last_change":"2024-04-25T22:51:52.018646+0000","last_active":"2024-04-25T22:55:41.859045+0000","last_peered":"2024-04-25T22:55:41.859045+0000","last_clean":"2024-04-25T22:55:41.859045+0000","last_became_active":"2024-04-25T22:51:52.018313+0000","last_became_peered":"2024-04-25T22:51:52.018313+0000","last_unstale":"2024-04-25T22:55:41.859045+0000","last_undegraded":"2024-04-25T22:55:41.859045+0000","last_fullsized":"2024-04-25T22:55:41.859045+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:00:21.688745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"55'167","reported_seq":274,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536676+0000","last_change":"2024-04-25T22:55:30.527435+0000","last_active":"2024-04-25T22:55:41.536676+0000","last_peered":"2024-04-25T22:55:41.536676+0000","last_clean":"2024-04-25T22:55:41.536676+0000","last_became_active":"2024-04-25T22:55:30.526276+0000","last_became_peered":"2024-04-25T22:55:30.526276+0000","last_unstale":"2024-04-25T22:55:41.536676+0000","last_undegraded":"2024-04-25T22:55:41.536676+0000","last_fullsized":"2024-04-25T22:55:41.536676+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:03:39.273168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87849,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":87849,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":145,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535666+0000","last_change":"2024-04-25T22:51:52.021510+0000","last_active":"2024-04-25T22:55:41.535666+0000","last_peered":"2024-04-25T22:55:41.535666+0000","last_clean":"2024-04-25T22:55:41.535666+0000","last_became_active":"2024-04-25T22:51:52.021145+0000","last_became_peered":"2024-04-25T22:51:52.021145+0000","last_unstale":"2024-04-25T22:55:41.535666+0000","last_undegraded":"2024-04-25T22:55:41.535666+0000","last_fullsized":"2024-04-25T22:55:41.535666+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:05.110747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"52'2","reported_seq":139,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536823+0000","last_change":"2024-04-25T22:51:52.021355+0000","last_active":"2024-04-25T22:55:41.536823+0000","last_peered":"2024-04-25T22:55:41.536823+0000","last_clean":"2024-04-25T22:55:41.536823+0000","last_became_active":"2024-04-25T22:51:52.020860+0000","last_became_peered":"2024-04-25T22:51:52.020860+0000","last_unstale":"2024-04-25T22:55:41.536823+0000","last_undegraded":"2024-04-25T22:55:41.536823+0000","last_fullsized":"2024-04-25T22:55:41.536823+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:55.235787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"55'157","reported_seq":294,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858543+0000","last_change":"2024-04-25T22:51:53.029390+0000","last_active":"2024-04-25T22:55:41.858543+0000","last_peered":"2024-04-25T22:55:41.858543+0000","last_clean":"2024-04-25T22:55:41.858543+0000","last_became_active":"2024-04-25T22:51:53.029157+0000","last_became_peered":"2024-04-25T22:51:53.029157+0000","last_unstale":"2024-04-25T22:55:41.858543+0000","last_undegraded":"2024-04-25T22:55:41.858543+0000","last_fullsized":"2024-04-25T22:55:41.858543+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:51:43.808994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190158,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"48'3","reported_seq":142,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859570+0000","last_change":"2024-04-25T22:51:52.018856+0000","last_active":"2024-04-25T22:55:41.859570+0000","last_peered":"2024-04-25T22:55:41.859570+0000","last_clean":"2024-04-25T22:55:41.859570+0000","last_became_active":"2024-04-25T22:51:52.018390+0000","last_became_peered":"2024-04-25T22:51:52.018390+0000","last_unstale":"2024-04-25T22:55:41.859570+0000","last_undegraded":"2024-04-25T22:55:41.859570+0000","last_fullsized":"2024-04-25T22:55:41.859570+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:42:54.430484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"55'171","reported_seq":539,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858599+0000","last_change":"2024-04-25T22:55:31.527677+0000","last_active":"2024-04-25T22:55:41.858599+0000","last_peered":"2024-04-25T22:55:41.858599+0000","last_clean":"2024-04-25T22:55:41.858599+0000","last_became_active":"2024-04-25T22:55:31.527049+0000","last_became_peered":"2024-04-25T22:55:31.527049+0000","last_unstale":"2024-04-25T22:55:41.858599+0000","last_undegraded":"2024-04-25T22:55:41.858599+0000","last_fullsized":"2024-04-25T22:55:41.858599+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:16:15.948780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":315325,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":191,"num_write_kb":549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":110,"num_bytes_recovered":301306,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":45,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536688+0000","last_change":"2024-04-25T22:55:38.519011+0000","last_active":"2024-04-25T22:55:41.536688+0000","last_peered":"2024-04-25T22:55:41.536688+0000","last_clean":"2024-04-25T22:55:41.536688+0000","last_became_active":"2024-04-25T22:55:38.517362+0000","last_became_peered":"2024-04-25T22:55:38.517362+0000","last_unstale":"2024-04-25T22:55:41.536688+0000","last_undegraded":"2024-04-25T22:55:41.536688+0000","last_fullsized":"2024-04-25T22:55:41.536688+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:30:15.580001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"55'153","reported_seq":486,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536056+0000","last_change":"2024-04-25T22:55:38.515892+0000","last_active":"2024-04-25T22:55:41.536056+0000","last_peered":"2024-04-25T22:55:41.536056+0000","last_clean":"2024-04-25T22:55:41.536056+0000","last_became_active":"2024-04-25T22:55:38.514319+0000","last_became_peered":"2024-04-25T22:55:38.514319+0000","last_unstale":"2024-04-25T22:55:41.536056+0000","last_undegraded":"2024-04-25T22:55:41.536056+0000","last_fullsized":"2024-04-25T22:55:41.536056+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:42.118131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97209,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":97196,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"51'1","reported_seq":115,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536541+0000","last_change":"2024-04-25T22:55:38.518279+0000","last_active":"2024-04-25T22:55:41.536541+0000","last_peered":"2024-04-25T22:55:41.536541+0000","last_clean":"2024-04-25T22:55:41.536541+0000","last_became_active":"2024-04-25T22:55:38.516782+0000","last_became_peered":"2024-04-25T22:55:38.516782+0000","last_unstale":"2024-04-25T22:55:41.536541+0000","last_undegraded":"2024-04-25T22:55:41.536541+0000","last_fullsized":"2024-04-25T22:55:41.536541+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:27:46.635381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"55'153","reported_seq":256,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536313+0000","last_change":"2024-04-25T22:55:32.511660+0000","last_active":"2024-04-25T22:55:41.536313+0000","last_peered":"2024-04-25T22:55:41.536313+0000","last_clean":"2024-04-25T22:55:41.536313+0000","last_became_active":"2024-04-25T22:55:32.510402+0000","last_became_peered":"2024-04-25T22:55:32.510402+0000","last_unstale":"2024-04-25T22:55:41.536313+0000","last_undegraded":"2024-04-25T22:55:41.536313+0000","last_fullsized":"2024-04-25T22:55:41.536313+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:13:03.774101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131384,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":131332,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"47'7","reported_seq":56,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536115+0000","last_change":"2024-04-25T22:55:27.566798+0000","last_active":"2024-04-25T22:55:41.536115+0000","last_peered":"2024-04-25T22:55:41.536115+0000","last_clean":"2024-04-25T22:55:41.536115+0000","last_became_active":"2024-04-25T22:55:27.518709+0000","last_became_peered":"2024-04-25T22:55:27.518709+0000","last_unstale":"2024-04-25T22:55:41.536115+0000","last_undegraded":"2024-04-25T22:55:41.536115+0000","last_fullsized":"2024-04-25T22:55:41.536115+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:07:47.758073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"55'174","reported_seq":521,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536332+0000","last_change":"2024-04-25T22:55:38.517785+0000","last_active":"2024-04-25T22:55:41.536332+0000","last_peered":"2024-04-25T22:55:41.536332+0000","last_clean":"2024-04-25T22:55:41.536332+0000","last_became_active":"2024-04-25T22:55:38.514695+0000","last_became_peered":"2024-04-25T22:55:38.514695+0000","last_unstale":"2024-04-25T22:55:41.536332+0000","last_undegraded":"2024-04-25T22:55:41.536332+0000","last_fullsized":"2024-04-25T22:55:41.536332+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:33:50.992444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187245,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":111,"num_bytes_recovered":187245,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":144,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536245+0000","last_change":"2024-04-25T22:55:27.517686+0000","last_active":"2024-04-25T22:55:41.536245+0000","last_peered":"2024-04-25T22:55:41.536245+0000","last_clean":"2024-04-25T22:55:41.536245+0000","last_became_active":"2024-04-25T22:55:27.517404+0000","last_became_peered":"2024-04-25T22:55:27.517404+0000","last_unstale":"2024-04-25T22:55:41.536245+0000","last_undegraded":"2024-04-25T22:55:41.536245+0000","last_fullsized":"2024-04-25T22:55:41.536245+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:11.671572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"55'163","reported_seq":298,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536548+0000","last_change":"2024-04-25T22:51:53.023929+0000","last_active":"2024-04-25T22:55:41.536548+0000","last_peered":"2024-04-25T22:55:41.536548+0000","last_clean":"2024-04-25T22:55:41.536548+0000","last_became_active":"2024-04-25T22:51:53.023405+0000","last_became_peered":"2024-04-25T22:51:53.023405+0000","last_unstale":"2024-04-25T22:55:41.536548+0000","last_undegraded":"2024-04-25T22:55:41.536548+0000","last_fullsized":"2024-04-25T22:55:41.536548+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:35:35.419823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130867,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":156,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859401+0000","last_change":"2024-04-25T22:55:37.516071+0000","last_active":"2024-04-25T22:55:41.859401+0000","last_peered":"2024-04-25T22:55:41.859401+0000","last_clean":"2024-04-25T22:55:41.859401+0000","last_became_active":"2024-04-25T22:55:37.515798+0000","last_became_peered":"2024-04-25T22:55:37.515798+0000","last_unstale":"2024-04-25T22:55:41.859401+0000","last_undegraded":"2024-04-25T22:55:41.859401+0000","last_fullsized":"2024-04-25T22:55:41.859401+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:27:46.635381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"55'139","reported_seq":274,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536510+0000","last_change":"2024-04-25T22:51:53.020574+0000","last_active":"2024-04-25T22:55:41.536510+0000","last_peered":"2024-04-25T22:55:41.536510+0000","last_clean":"2024-04-25T22:55:41.536510+0000","last_became_active":"2024-04-25T22:51:53.019978+0000","last_became_peered":"2024-04-25T22:51:53.019978+0000","last_unstale":"2024-04-25T22:55:41.536510+0000","last_undegraded":"2024-04-25T22:55:41.536510+0000","last_fullsized":"2024-04-25T22:55:41.536510+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:41.205051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197405,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"51'1","reported_seq":147,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858624+0000","last_change":"2024-04-25T22:55:27.517695+0000","last_active":"2024-04-25T22:55:41.858624+0000","last_peered":"2024-04-25T22:55:41.858624+0000","last_clean":"2024-04-25T22:55:41.858624+0000","last_became_active":"2024-04-25T22:55:27.517330+0000","last_became_peered":"2024-04-25T22:55:27.517330+0000","last_unstale":"2024-04-25T22:55:41.858624+0000","last_undegraded":"2024-04-25T22:55:41.858624+0000","last_fullsized":"2024-04-25T22:55:41.858624+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:15:30.181042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"55'145","reported_seq":252,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.537124+0000","last_change":"2024-04-25T22:55:31.528962+0000","last_active":"2024-04-25T22:55:41.537124+0000","last_peered":"2024-04-25T22:55:41.537124+0000","last_clean":"2024-04-25T22:55:41.537124+0000","last_became_active":"2024-04-25T22:55:31.528360+0000","last_became_peered":"2024-04-25T22:55:31.528360+0000","last_unstale":"2024-04-25T22:55:41.537124+0000","last_undegraded":"2024-04-25T22:55:41.537124+0000","last_fullsized":"2024-04-25T22:55:41.537124+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:27:45.223109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165168,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":165116,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":339,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536012+0000","last_change":"2024-04-25T22:51:47.764624+0000","last_active":"2024-04-25T22:55:41.536012+0000","last_peered":"2024-04-25T22:55:41.536012+0000","last_clean":"2024-04-25T22:55:41.536012+0000","last_became_active":"2024-04-25T22:51:47.764176+0000","last_became_peered":"2024-04-25T22:51:47.764176+0000","last_unstale":"2024-04-25T22:55:41.536012+0000","last_undegraded":"2024-04-25T22:55:41.536012+0000","last_fullsized":"2024-04-25T22:55:41.536012+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:59:39.005489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":150,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536222+0000","last_change":"2024-04-25T22:55:27.521219+0000","last_active":"2024-04-25T22:55:41.536222+0000","last_peered":"2024-04-25T22:55:41.536222+0000","last_clean":"2024-04-25T22:55:41.536222+0000","last_became_active":"2024-04-25T22:55:27.520951+0000","last_became_peered":"2024-04-25T22:55:27.520951+0000","last_unstale":"2024-04-25T22:55:41.536222+0000","last_undegraded":"2024-04-25T22:55:41.536222+0000","last_fullsized":"2024-04-25T22:55:41.536222+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:48:53.391950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"51'2","reported_seq":48,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536134+0000","last_change":"2024-04-25T22:55:27.520902+0000","last_active":"2024-04-25T22:55:41.536134+0000","last_peered":"2024-04-25T22:55:41.536134+0000","last_clean":"2024-04-25T22:55:41.536134+0000","last_became_active":"2024-04-25T22:55:27.520466+0000","last_became_peered":"2024-04-25T22:55:27.520466+0000","last_unstale":"2024-04-25T22:55:41.536134+0000","last_undegraded":"2024-04-25T22:55:41.536134+0000","last_fullsized":"2024-04-25T22:55:41.536134+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:18:17.518924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"55'150","reported_seq":285,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536563+0000","last_change":"2024-04-25T22:51:53.024106+0000","last_active":"2024-04-25T22:55:41.536563+0000","last_peered":"2024-04-25T22:55:41.536563+0000","last_clean":"2024-04-25T22:55:41.536563+0000","last_became_active":"2024-04-25T22:51:53.023497+0000","last_became_peered":"2024-04-25T22:51:53.023497+0000","last_unstale":"2024-04-25T22:55:41.536563+0000","last_undegraded":"2024-04-25T22:55:41.536563+0000","last_fullsized":"2024-04-25T22:55:41.536563+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:52:16.918935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":331484,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":143,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536139+0000","last_change":"2024-04-25T22:51:47.764591+0000","last_active":"2024-04-25T22:55:41.536139+0000","last_peered":"2024-04-25T22:55:41.536139+0000","last_clean":"2024-04-25T22:55:41.536139+0000","last_became_active":"2024-04-25T22:51:47.764229+0000","last_became_peered":"2024-04-25T22:51:47.764229+0000","last_unstale":"2024-04-25T22:55:41.536139+0000","last_undegraded":"2024-04-25T22:55:41.536139+0000","last_fullsized":"2024-04-25T22:55:41.536139+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:32.854624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"53'36","reported_seq":52,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535631+0000","last_change":"2024-04-25T22:55:27.524404+0000","last_active":"2024-04-25T22:55:41.535631+0000","last_peered":"2024-04-25T22:55:41.535631+0000","last_clean":"2024-04-25T22:55:41.535631+0000","last_became_active":"2024-04-25T22:55:27.517290+0000","last_became_peered":"2024-04-25T22:55:27.517290+0000","last_unstale":"2024-04-25T22:55:41.535631+0000","last_undegraded":"2024-04-25T22:55:41.535631+0000","last_fullsized":"2024-04-25T22:55:41.535631+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:34.809551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327644,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":343,"num_write":34,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":327644,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"55'163","reported_seq":517,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859336+0000","last_change":"2024-04-25T22:55:35.519401+0000","last_active":"2024-04-25T22:55:41.859336+0000","last_peered":"2024-04-25T22:55:41.859336+0000","last_clean":"2024-04-25T22:55:41.859336+0000","last_became_active":"2024-04-25T22:55:35.518367+0000","last_became_peered":"2024-04-25T22:55:35.518367+0000","last_unstale":"2024-04-25T22:55:41.859336+0000","last_undegraded":"2024-04-25T22:55:41.859336+0000","last_fullsized":"2024-04-25T22:55:41.859336+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:51.343892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297937,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":181,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":282175,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":48,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535954+0000","last_change":"2024-04-25T22:55:27.519726+0000","last_active":"2024-04-25T22:55:41.535954+0000","last_peered":"2024-04-25T22:55:41.535954+0000","last_clean":"2024-04-25T22:55:41.535954+0000","last_became_active":"2024-04-25T22:55:27.518412+0000","last_became_peered":"2024-04-25T22:55:27.518412+0000","last_unstale":"2024-04-25T22:55:41.535954+0000","last_undegraded":"2024-04-25T22:55:41.535954+0000","last_fullsized":"2024-04-25T22:55:41.535954+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:32:35.203827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"51'62","reported_seq":201,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858672+0000","last_change":"2024-04-25T22:51:52.018873+0000","last_active":"2024-04-25T22:55:41.858672+0000","last_peered":"2024-04-25T22:55:41.858672+0000","last_clean":"2024-04-25T22:55:41.858672+0000","last_became_active":"2024-04-25T22:51:52.018300+0000","last_became_peered":"2024-04-25T22:51:52.018300+0000","last_unstale":"2024-04-25T22:55:41.858672+0000","last_undegraded":"2024-04-25T22:55:41.858672+0000","last_fullsized":"2024-04-25T22:55:41.858672+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:25:22.660789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":4122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"55'167","reported_seq":272,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.537064+0000","last_change":"2024-04-25T22:55:32.513689+0000","last_active":"2024-04-25T22:55:41.537064+0000","last_peered":"2024-04-25T22:55:41.537064+0000","last_clean":"2024-04-25T22:55:41.537064+0000","last_became_active":"2024-04-25T22:55:32.513087+0000","last_became_peered":"2024-04-25T22:55:32.513087+0000","last_unstale":"2024-04-25T22:55:41.537064+0000","last_undegraded":"2024-04-25T22:55:41.537064+0000","last_fullsized":"2024-04-25T22:55:41.537064+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:36:56.592254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395473,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":166,"num_write_kb":573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":395432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":150,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536310+0000","last_change":"2024-04-25T22:55:27.517303+0000","last_active":"2024-04-25T22:55:41.536310+0000","last_peered":"2024-04-25T22:55:41.536310+0000","last_clean":"2024-04-25T22:55:41.536310+0000","last_became_active":"2024-04-25T22:55:27.516952+0000","last_became_peered":"2024-04-25T22:55:27.516952+0000","last_unstale":"2024-04-25T22:55:41.536310+0000","last_undegraded":"2024-04-25T22:55:41.536310+0000","last_fullsized":"2024-04-25T22:55:41.536310+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:15:25.939805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":114,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536155+0000","last_change":"2024-04-25T22:55:38.518160+0000","last_active":"2024-04-25T22:55:41.536155+0000","last_peered":"2024-04-25T22:55:41.536155+0000","last_clean":"2024-04-25T22:55:41.536155+0000","last_became_active":"2024-04-25T22:55:38.516294+0000","last_became_peered":"2024-04-25T22:55:38.516294+0000","last_unstale":"2024-04-25T22:55:41.536155+0000","last_undegraded":"2024-04-25T22:55:41.536155+0000","last_fullsized":"2024-04-25T22:55:41.536155+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:50.339431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"55'156","reported_seq":263,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536316+0000","last_change":"2024-04-25T22:55:31.527813+0000","last_active":"2024-04-25T22:55:41.536316+0000","last_peered":"2024-04-25T22:55:41.536316+0000","last_clean":"2024-04-25T22:55:41.536316+0000","last_became_active":"2024-04-25T22:55:31.526666+0000","last_became_peered":"2024-04-25T22:55:31.526666+0000","last_unstale":"2024-04-25T22:55:41.536316+0000","last_undegraded":"2024-04-25T22:55:41.536316+0000","last_fullsized":"2024-04-25T22:55:41.536316+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:18.548926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100051,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":100051,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"52'1","reported_seq":145,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536734+0000","last_change":"2024-04-25T22:55:27.517150+0000","last_active":"2024-04-25T22:55:41.536734+0000","last_peered":"2024-04-25T22:55:41.536734+0000","last_clean":"2024-04-25T22:55:41.536734+0000","last_became_active":"2024-04-25T22:55:27.516760+0000","last_became_peered":"2024-04-25T22:55:27.516760+0000","last_unstale":"2024-04-25T22:55:41.536734+0000","last_undegraded":"2024-04-25T22:55:41.536734+0000","last_fullsized":"2024-04-25T22:55:41.536734+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:20:13.546931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536169+0000","last_change":"2024-04-25T22:55:27.517202+0000","last_active":"2024-04-25T22:55:41.536169+0000","last_peered":"2024-04-25T22:55:41.536169+0000","last_clean":"2024-04-25T22:55:41.536169+0000","last_became_active":"2024-04-25T22:55:27.516272+0000","last_became_peered":"2024-04-25T22:55:27.516272+0000","last_unstale":"2024-04-25T22:55:41.536169+0000","last_undegraded":"2024-04-25T22:55:41.536169+0000","last_fullsized":"2024-04-25T22:55:41.536169+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:43:32.692434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"55'155","reported_seq":292,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858903+0000","last_change":"2024-04-25T22:51:53.026321+0000","last_active":"2024-04-25T22:55:41.858903+0000","last_peered":"2024-04-25T22:55:41.858903+0000","last_clean":"2024-04-25T22:55:41.858903+0000","last_became_active":"2024-04-25T22:51:53.025824+0000","last_became_peered":"2024-04-25T22:51:53.025824+0000","last_unstale":"2024-04-25T22:55:41.858903+0000","last_undegraded":"2024-04-25T22:55:41.858903+0000","last_fullsized":"2024-04-25T22:55:41.858903+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:12:00.793718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67397,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536444+0000","last_change":"2024-04-25T22:55:27.516710+0000","last_active":"2024-04-25T22:55:41.536444+0000","last_peered":"2024-04-25T22:55:41.536444+0000","last_clean":"2024-04-25T22:55:41.536444+0000","last_became_active":"2024-04-25T22:55:27.515536+0000","last_became_peered":"2024-04-25T22:55:27.515536+0000","last_unstale":"2024-04-25T22:55:41.536444+0000","last_undegraded":"2024-04-25T22:55:41.536444+0000","last_fullsized":"2024-04-25T22:55:41.536444+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:42:01.941338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":152,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859759+0000","last_change":"2024-04-25T22:55:27.517692+0000","last_active":"2024-04-25T22:55:41.859759+0000","last_peered":"2024-04-25T22:55:41.859759+0000","last_clean":"2024-04-25T22:55:41.859759+0000","last_became_active":"2024-04-25T22:55:27.517411+0000","last_became_peered":"2024-04-25T22:55:27.517411+0000","last_unstale":"2024-04-25T22:55:41.859759+0000","last_undegraded":"2024-04-25T22:55:41.859759+0000","last_fullsized":"2024-04-25T22:55:41.859759+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:20:09.305694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"55'175","reported_seq":312,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858983+0000","last_change":"2024-04-25T22:51:53.027051+0000","last_active":"2024-04-25T22:55:41.858983+0000","last_peered":"2024-04-25T22:55:41.858983+0000","last_clean":"2024-04-25T22:55:41.858983+0000","last_became_active":"2024-04-25T22:51:53.026458+0000","last_became_peered":"2024-04-25T22:51:53.026458+0000","last_unstale":"2024-04-25T22:55:41.858983+0000","last_undegraded":"2024-04-25T22:55:41.858983+0000","last_fullsized":"2024-04-25T22:55:41.858983+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:11:09.179564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192819,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":52,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536805+0000","last_change":"2024-04-25T22:55:27.519827+0000","last_active":"2024-04-25T22:55:41.536805+0000","last_peered":"2024-04-25T22:55:41.536805+0000","last_clean":"2024-04-25T22:55:41.536805+0000","last_became_active":"2024-04-25T22:55:27.518853+0000","last_became_peered":"2024-04-25T22:55:27.518853+0000","last_unstale":"2024-04-25T22:55:41.536805+0000","last_undegraded":"2024-04-25T22:55:41.536805+0000","last_fullsized":"2024-04-25T22:55:41.536805+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:17:48.076297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":48,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536526+0000","last_change":"2024-04-25T22:55:27.519804+0000","last_active":"2024-04-25T22:55:41.536526+0000","last_peered":"2024-04-25T22:55:41.536526+0000","last_clean":"2024-04-25T22:55:41.536526+0000","last_became_active":"2024-04-25T22:55:27.518183+0000","last_became_peered":"2024-04-25T22:55:27.518183+0000","last_unstale":"2024-04-25T22:55:41.536526+0000","last_undegraded":"2024-04-25T22:55:41.536526+0000","last_fullsized":"2024-04-25T22:55:41.536526+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:36.947733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"55'172","reported_seq":505,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536038+0000","last_change":"2024-04-25T22:55:40.539104+0000","last_active":"2024-04-25T22:55:41.536038+0000","last_peered":"2024-04-25T22:55:41.536038+0000","last_clean":"2024-04-25T22:55:41.536038+0000","last_became_active":"2024-04-25T22:55:40.538335+0000","last_became_peered":"2024-04-25T22:55:40.538335+0000","last_unstale":"2024-04-25T22:55:41.536038+0000","last_undegraded":"2024-04-25T22:55:41.536038+0000","last_fullsized":"2024-04-25T22:55:41.536038+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:45:43.336586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505702,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":1011342,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"56'37","reported_seq":67,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536555+0000","last_change":"2024-04-25T22:55:27.570707+0000","last_active":"2024-04-25T22:55:41.536555+0000","last_peered":"2024-04-25T22:55:41.536555+0000","last_clean":"2024-04-25T22:55:41.536555+0000","last_became_active":"2024-04-25T22:55:27.518193+0000","last_became_peered":"2024-04-25T22:55:27.518193+0000","last_unstale":"2024-04-25T22:55:41.536555+0000","last_undegraded":"2024-04-25T22:55:41.536555+0000","last_fullsized":"2024-04-25T22:55:41.536555+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:17:01.521730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":143,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536823+0000","last_change":"2024-04-25T22:51:47.764288+0000","last_active":"2024-04-25T22:55:41.536823+0000","last_peered":"2024-04-25T22:55:41.536823+0000","last_clean":"2024-04-25T22:55:41.536823+0000","last_became_active":"2024-04-25T22:51:47.763961+0000","last_became_peered":"2024-04-25T22:51:47.763961+0000","last_unstale":"2024-04-25T22:55:41.536823+0000","last_undegraded":"2024-04-25T22:55:41.536823+0000","last_fullsized":"2024-04-25T22:55:41.536823+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:03:07.164842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"55'142","reported_seq":279,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858601+0000","last_change":"2024-04-25T22:51:53.026925+0000","last_active":"2024-04-25T22:55:41.858601+0000","last_peered":"2024-04-25T22:55:41.858601+0000","last_clean":"2024-04-25T22:55:41.858601+0000","last_became_active":"2024-04-25T22:51:53.026419+0000","last_became_peered":"2024-04-25T22:51:53.026419+0000","last_unstale":"2024-04-25T22:55:41.858601+0000","last_undegraded":"2024-04-25T22:55:41.858601+0000","last_fullsized":"2024-04-25T22:55:41.858601+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:49:38.102060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":246196,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"55'162","reported_seq":297,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535896+0000","last_change":"2024-04-25T22:51:53.022222+0000","last_active":"2024-04-25T22:55:41.535896+0000","last_peered":"2024-04-25T22:55:41.535896+0000","last_clean":"2024-04-25T22:55:41.535896+0000","last_became_active":"2024-04-25T22:51:53.021687+0000","last_became_peered":"2024-04-25T22:51:53.021687+0000","last_unstale":"2024-04-25T22:55:41.535896+0000","last_undegraded":"2024-04-25T22:55:41.535896+0000","last_fullsized":"2024-04-25T22:55:41.535896+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:35:06.234402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108265,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"60'43","reported_seq":180,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536366+0000","last_change":"2024-04-25T22:51:52.019928+0000","last_active":"2024-04-25T22:55:41.536366+0000","last_peered":"2024-04-25T22:55:41.536366+0000","last_clean":"2024-04-25T22:55:41.536366+0000","last_became_active":"2024-04-25T22:51:52.019264+0000","last_became_peered":"2024-04-25T22:51:52.019264+0000","last_unstale":"2024-04-25T22:55:41.536366+0000","last_undegraded":"2024-04-25T22:55:41.536366+0000","last_fullsized":"2024-04-25T22:55:41.536366+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:18.136883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"55'146","reported_seq":253,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535922+0000","last_change":"2024-04-25T22:55:31.527757+0000","last_active":"2024-04-25T22:55:41.535922+0000","last_peered":"2024-04-25T22:55:41.535922+0000","last_clean":"2024-04-25T22:55:41.535922+0000","last_became_active":"2024-04-25T22:55:31.526620+0000","last_became_peered":"2024-04-25T22:55:31.526620+0000","last_unstale":"2024-04-25T22:55:41.535922+0000","last_undegraded":"2024-04-25T22:55:41.535922+0000","last_fullsized":"2024-04-25T22:55:41.535922+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:59:41.748950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89309,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":89309,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"53'21","reported_seq":160,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859669+0000","last_change":"2024-04-25T22:51:52.018977+0000","last_active":"2024-04-25T22:55:41.859669+0000","last_peered":"2024-04-25T22:55:41.859669+0000","last_clean":"2024-04-25T22:55:41.859669+0000","last_became_active":"2024-04-25T22:51:52.018519+0000","last_became_peered":"2024-04-25T22:51:52.018519+0000","last_unstale":"2024-04-25T22:55:41.859669+0000","last_undegraded":"2024-04-25T22:55:41.859669+0000","last_fullsized":"2024-04-25T22:55:41.859669+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:53:07.306148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"48'1","reported_seq":115,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536721+0000","last_change":"2024-04-25T22:55:38.517605+0000","last_active":"2024-04-25T22:55:41.536721+0000","last_peered":"2024-04-25T22:55:41.536721+0000","last_clean":"2024-04-25T22:55:41.536721+0000","last_became_active":"2024-04-25T22:55:38.515986+0000","last_became_peered":"2024-04-25T22:55:38.515986+0000","last_unstale":"2024-04-25T22:55:41.536721+0000","last_undegraded":"2024-04-25T22:55:41.536721+0000","last_fullsized":"2024-04-25T22:55:41.536721+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:02:39.264531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"55'171","reported_seq":278,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535896+0000","last_change":"2024-04-25T22:55:30.525999+0000","last_active":"2024-04-25T22:55:41.535896+0000","last_peered":"2024-04-25T22:55:41.535896+0000","last_clean":"2024-04-25T22:55:41.535896+0000","last_became_active":"2024-04-25T22:55:30.525233+0000","last_became_peered":"2024-04-25T22:55:30.525233+0000","last_unstale":"2024-04-25T22:55:41.535896+0000","last_undegraded":"2024-04-25T22:55:41.535896+0000","last_fullsized":"2024-04-25T22:55:41.535896+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:51:14.338988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":332166,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":329490,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"51'2","reported_seq":48,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536941+0000","last_change":"2024-04-25T22:55:27.519530+0000","last_active":"2024-04-25T22:55:41.536941+0000","last_peered":"2024-04-25T22:55:41.536941+0000","last_clean":"2024-04-25T22:55:41.536941+0000","last_became_active":"2024-04-25T22:55:27.518244+0000","last_became_peered":"2024-04-25T22:55:27.518244+0000","last_unstale":"2024-04-25T22:55:41.536941+0000","last_undegraded":"2024-04-25T22:55:41.536941+0000","last_fullsized":"2024-04-25T22:55:41.536941+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:40:24.373575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"55'158","reported_seq":267,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535732+0000","last_change":"2024-04-25T22:55:30.527784+0000","last_active":"2024-04-25T22:55:41.535732+0000","last_peered":"2024-04-25T22:55:41.535732+0000","last_clean":"2024-04-25T22:55:41.535732+0000","last_became_active":"2024-04-25T22:55:30.526853+0000","last_became_peered":"2024-04-25T22:55:30.526853+0000","last_unstale":"2024-04-25T22:55:41.535732+0000","last_undegraded":"2024-04-25T22:55:41.535732+0000","last_fullsized":"2024-04-25T22:55:41.535732+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:19:11.705754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70967,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":70967,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"55'172","reported_seq":309,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859717+0000","last_change":"2024-04-25T22:51:53.029210+0000","last_active":"2024-04-25T22:55:41.859717+0000","last_peered":"2024-04-25T22:55:41.859717+0000","last_clean":"2024-04-25T22:55:41.859717+0000","last_became_active":"2024-04-25T22:51:53.028635+0000","last_became_peered":"2024-04-25T22:51:53.028635+0000","last_unstale":"2024-04-25T22:55:41.859717+0000","last_undegraded":"2024-04-25T22:55:41.859717+0000","last_fullsized":"2024-04-25T22:55:41.859717+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:41.205051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":440592,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"50'1","reported_seq":48,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535599+0000","last_change":"2024-04-25T22:55:27.516136+0000","last_active":"2024-04-25T22:55:41.535599+0000","last_peered":"2024-04-25T22:55:41.535599+0000","last_clean":"2024-04-25T22:55:41.535599+0000","last_became_active":"2024-04-25T22:55:27.515473+0000","last_became_peered":"2024-04-25T22:55:27.515473+0000","last_unstale":"2024-04-25T22:55:41.535599+0000","last_undegraded":"2024-04-25T22:55:41.535599+0000","last_fullsized":"2024-04-25T22:55:41.535599+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:51:59.771248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"55'151","reported_seq":250,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536783+0000","last_change":"2024-04-25T22:55:34.513243+0000","last_active":"2024-04-25T22:55:41.536783+0000","last_peered":"2024-04-25T22:55:41.536783+0000","last_clean":"2024-04-25T22:55:41.536783+0000","last_became_active":"2024-04-25T22:55:34.512137+0000","last_became_peered":"2024-04-25T22:55:34.512137+0000","last_unstale":"2024-04-25T22:55:41.536783+0000","last_undegraded":"2024-04-25T22:55:41.536783+0000","last_fullsized":"2024-04-25T22:55:41.536783+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:06:40.451167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106917,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":97731,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":76,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535673+0000","last_change":"2024-04-25T22:55:37.514177+0000","last_active":"2024-04-25T22:55:41.535673+0000","last_peered":"2024-04-25T22:55:41.535673+0000","last_clean":"2024-04-25T22:55:41.535673+0000","last_became_active":"2024-04-25T22:55:37.513925+0000","last_became_peered":"2024-04-25T22:55:37.513925+0000","last_unstale":"2024-04-25T22:55:41.535673+0000","last_undegraded":"2024-04-25T22:55:41.535673+0000","last_fullsized":"2024-04-25T22:55:41.535673+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:12:09.421061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"55'203","reported_seq":340,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859317+0000","last_change":"2024-04-25T22:51:53.028084+0000","last_active":"2024-04-25T22:55:41.859317+0000","last_peered":"2024-04-25T22:55:41.859317+0000","last_clean":"2024-04-25T22:55:41.859317+0000","last_became_active":"2024-04-25T22:51:53.027541+0000","last_became_peered":"2024-04-25T22:51:53.027541+0000","last_unstale":"2024-04-25T22:55:41.859317+0000","last_undegraded":"2024-04-25T22:55:41.859317+0000","last_fullsized":"2024-04-25T22:55:41.859317+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:28:42.903045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195653,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"48'2","reported_seq":153,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859141+0000","last_change":"2024-04-25T22:55:27.541798+0000","last_active":"2024-04-25T22:55:41.859141+0000","last_peered":"2024-04-25T22:55:41.859141+0000","last_clean":"2024-04-25T22:55:41.859141+0000","last_became_active":"2024-04-25T22:55:27.517718+0000","last_became_peered":"2024-04-25T22:55:27.517718+0000","last_unstale":"2024-04-25T22:55:41.859141+0000","last_undegraded":"2024-04-25T22:55:41.859141+0000","last_fullsized":"2024-04-25T22:55:41.859141+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:48:57.633186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"55'168","reported_seq":524,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858951+0000","last_change":"2024-04-25T22:55:34.514499+0000","last_active":"2024-04-25T22:55:41.858951+0000","last_peered":"2024-04-25T22:55:41.858951+0000","last_clean":"2024-04-25T22:55:41.858951+0000","last_became_active":"2024-04-25T22:55:34.513433+0000","last_became_peered":"2024-04-25T22:55:34.513433+0000","last_unstale":"2024-04-25T22:55:41.858951+0000","last_undegraded":"2024-04-25T22:55:41.858951+0000","last_fullsized":"2024-04-25T22:55:41.858951+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:58:08.177184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151921,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":151921,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"47'5","reported_seq":170,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859179+0000","last_change":"2024-04-25T22:55:37.559449+0000","last_active":"2024-04-25T22:55:41.859179+0000","last_peered":"2024-04-25T22:55:41.859179+0000","last_clean":"2024-04-25T22:55:41.859179+0000","last_became_active":"2024-04-25T22:55:37.516119+0000","last_became_peered":"2024-04-25T22:55:37.516119+0000","last_unstale":"2024-04-25T22:55:41.859179+0000","last_undegraded":"2024-04-25T22:55:41.859179+0000","last_fullsized":"2024-04-25T22:55:41.859179+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:25:42.548782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"55'166","reported_seq":505,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535835+0000","last_change":"2024-04-25T22:55:38.518734+0000","last_active":"2024-04-25T22:55:41.535835+0000","last_peered":"2024-04-25T22:55:41.535835+0000","last_clean":"2024-04-25T22:55:41.535835+0000","last_became_active":"2024-04-25T22:55:38.516260+0000","last_became_peered":"2024-04-25T22:55:38.516260+0000","last_unstale":"2024-04-25T22:55:41.535835+0000","last_undegraded":"2024-04-25T22:55:41.535835+0000","last_fullsized":"2024-04-25T22:55:41.535835+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:25:43.553244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3798024,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":3871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":3798024,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535940+0000","last_change":"2024-04-25T22:55:38.520672+0000","last_active":"2024-04-25T22:55:41.535940+0000","last_peered":"2024-04-25T22:55:41.535940+0000","last_clean":"2024-04-25T22:55:41.535940+0000","last_became_active":"2024-04-25T22:55:38.515776+0000","last_became_peered":"2024-04-25T22:55:38.515776+0000","last_unstale":"2024-04-25T22:55:41.535940+0000","last_undegraded":"2024-04-25T22:55:41.535940+0000","last_fullsized":"2024-04-25T22:55:41.535940+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:53.584300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"55'158","reported_seq":495,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536078+0000","last_change":"2024-04-25T22:55:38.516465+0000","last_active":"2024-04-25T22:55:41.536078+0000","last_peered":"2024-04-25T22:55:41.536078+0000","last_clean":"2024-04-25T22:55:41.536078+0000","last_became_active":"2024-04-25T22:55:38.514732+0000","last_became_peered":"2024-04-25T22:55:38.514732+0000","last_unstale":"2024-04-25T22:55:41.536078+0000","last_undegraded":"2024-04-25T22:55:41.536078+0000","last_fullsized":"2024-04-25T22:55:41.536078+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:42:09.860717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141656,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":141656,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"50'57","reported_seq":196,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859521+0000","last_change":"2024-04-25T22:51:52.019032+0000","last_active":"2024-04-25T22:55:41.859521+0000","last_peered":"2024-04-25T22:55:41.859521+0000","last_clean":"2024-04-25T22:55:41.859521+0000","last_became_active":"2024-04-25T22:51:52.018547+0000","last_became_peered":"2024-04-25T22:51:52.018547+0000","last_unstale":"2024-04-25T22:55:41.859521+0000","last_undegraded":"2024-04-25T22:55:41.859521+0000","last_fullsized":"2024-04-25T22:55:41.859521+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:10:00.056491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":8213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"55'169","reported_seq":535,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859326+0000","last_change":"2024-04-25T22:55:35.518155+0000","last_active":"2024-04-25T22:55:41.859326+0000","last_peered":"2024-04-25T22:55:41.859326+0000","last_clean":"2024-04-25T22:55:41.859326+0000","last_became_active":"2024-04-25T22:55:35.517149+0000","last_became_peered":"2024-04-25T22:55:35.517149+0000","last_unstale":"2024-04-25T22:55:41.859326+0000","last_undegraded":"2024-04-25T22:55:41.859326+0000","last_fullsized":"2024-04-25T22:55:41.859326+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:50.123900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184603,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":194,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":166098,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"48'25","reported_seq":56,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536897+0000","last_change":"2024-04-25T22:55:27.586742+0000","last_active":"2024-04-25T22:55:41.536897+0000","last_peered":"2024-04-25T22:55:41.536897+0000","last_clean":"2024-04-25T22:55:41.536897+0000","last_became_active":"2024-04-25T22:55:27.520617+0000","last_became_peered":"2024-04-25T22:55:27.520617+0000","last_unstale":"2024-04-25T22:55:41.536897+0000","last_undegraded":"2024-04-25T22:55:41.536897+0000","last_fullsized":"2024-04-25T22:55:41.536897+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:58:12.148059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"55'196","reported_seq":594,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535817+0000","last_change":"2024-04-25T22:55:31.526793+0000","last_active":"2024-04-25T22:55:41.535817+0000","last_peered":"2024-04-25T22:55:41.535817+0000","last_clean":"2024-04-25T22:55:41.535817+0000","last_became_active":"2024-04-25T22:55:31.526322+0000","last_became_peered":"2024-04-25T22:55:31.526322+0000","last_unstale":"2024-04-25T22:55:41.535817+0000","last_undegraded":"2024-04-25T22:55:41.535817+0000","last_fullsized":"2024-04-25T22:55:41.535817+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:58.561902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200980,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":211,"num_write_kb":410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":126,"num_bytes_recovered":197679,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"48'7","reported_seq":98,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536679+0000","last_change":"2024-04-25T22:55:37.541050+0000","last_active":"2024-04-25T22:55:41.536679+0000","last_peered":"2024-04-25T22:55:41.536679+0000","last_clean":"2024-04-25T22:55:41.536679+0000","last_became_active":"2024-04-25T22:55:37.516183+0000","last_became_peered":"2024-04-25T22:55:37.516183+0000","last_unstale":"2024-04-25T22:55:41.536679+0000","last_undegraded":"2024-04-25T22:55:41.536679+0000","last_fullsized":"2024-04-25T22:55:41.536679+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:30.075399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8389190,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26691649,"num_objects":3448,"num_object_clones":0,"num_object_copies":6896,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3448,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10583,"num_write_kb":38991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4953,"num_bytes_recovered":24173691,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73056256,"data_stored":53061590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10415,"ondisk_log_size":10415,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":40502861,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":34,"num_read_kb":343,"num_write":470,"num_write_kb":40224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":32113365,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":81068032,"data_stored":81005722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5351,"internal_metadata":0},"log_size":434,"ondisk_log_size":434,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738419,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84816,"kb_used_data":49476,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94287024,"statfs":{"total":96636764160,"available":96549912576,"internally_reserved":0,"allocated":50663424,"data_stored":43767232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":62,"seq":266287972358,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85248,"kb_used_data":45232,"kb_used_omap":6,"kb_used_meta":39993,"kb_avail":94286592,"statfs":{"total":96636764160,"available":96549470208,"internally_reserved":0,"allocated":46317568,"data_stored":38899263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6946,"internal_metadata":40953054},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738419,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":102580,"kb_used_data":58912,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94269260,"statfs":{"total":96636764160,"available":96531722240,"internally_reserved":0,"allocated":60325888,"data_stored":53539649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32145408,"data_stored":32114253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19542016,"data_stored":19530487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5351,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":29380608,"data_stored":29360982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":26918912,"data_stored":20514252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26107904,"data_stored":19048000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20029440,"data_stored":13499338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:55:47.122 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T22:55:47.122 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:55:47.462 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:55:47.465 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-25T22:55:47.468 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":195,"stamp":"2024-04-25T22:55:45.987513+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":67784878,"num_objects":3482,"num_object_clones":0,"num_object_copies":6964,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3482,"num_whiteouts":0,"num_read":170,"num_read_kb":461,"num_write":11256,"num_write_kb":82675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4966,"num_bytes_recovered":56287056,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11006,"ondisk_log_size":11006,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":212,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":272644,"kb_used_data":153620,"kb_used_omap":9,"kb_used_meta":118966,"kb_avail":282842876,"statfs":{"total":289910292480,"available":289631105024,"internally_reserved":0,"allocated":157306880,"data_stored":136206144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10136,"internal_metadata":121821288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":209,"num_bytes_recovered":9238667,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.459375"},"pg_stats":[{"pgid":"4.3f","version":"55'160","reported_seq":516,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859594+0000","last_change":"2024-04-25T22:55:34.515388+0000","last_active":"2024-04-25T22:55:41.859594+0000","last_peered":"2024-04-25T22:55:41.859594+0000","last_clean":"2024-04-25T22:55:41.859594+0000","last_became_active":"2024-04-25T22:55:34.514302+0000","last_became_peered":"2024-04-25T22:55:34.514302+0000","last_unstale":"2024-04-25T22:55:41.859594+0000","last_undegraded":"2024-04-25T22:55:41.859594+0000","last_fullsized":"2024-04-25T22:55:41.859594+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:08:19.339484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168293,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":168293,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"55'153","reported_seq":495,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859178+0000","last_change":"2024-04-25T22:55:35.519132+0000","last_active":"2024-04-25T22:55:41.859178+0000","last_peered":"2024-04-25T22:55:41.859178+0000","last_clean":"2024-04-25T22:55:41.859178+0000","last_became_active":"2024-04-25T22:55:35.517561+0000","last_became_peered":"2024-04-25T22:55:35.517561+0000","last_unstale":"2024-04-25T22:55:41.859178+0000","last_undegraded":"2024-04-25T22:55:41.859178+0000","last_fullsized":"2024-04-25T22:55:41.859178+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:02:40.268992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286387,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":286387,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"55'164","reported_seq":238,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536366+0000","last_change":"2024-04-25T22:55:38.519244+0000","last_active":"2024-04-25T22:55:41.536366+0000","last_peered":"2024-04-25T22:55:41.536366+0000","last_clean":"2024-04-25T22:55:41.536366+0000","last_became_active":"2024-04-25T22:55:38.517874+0000","last_became_peered":"2024-04-25T22:55:38.517874+0000","last_unstale":"2024-04-25T22:55:41.536366+0000","last_undegraded":"2024-04-25T22:55:41.536366+0000","last_fullsized":"2024-04-25T22:55:41.536366+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:45:27.635067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130188,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"55'126","reported_seq":423,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536210+0000","last_change":"2024-04-25T22:55:38.516209+0000","last_active":"2024-04-25T22:55:41.536210+0000","last_peered":"2024-04-25T22:55:41.536210+0000","last_clean":"2024-04-25T22:55:41.536210+0000","last_became_active":"2024-04-25T22:55:38.513558+0000","last_became_peered":"2024-04-25T22:55:38.513558+0000","last_unstale":"2024-04-25T22:55:41.536210+0000","last_undegraded":"2024-04-25T22:55:41.536210+0000","last_fullsized":"2024-04-25T22:55:41.536210+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:50.123900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142819,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":135761,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"55'173","reported_seq":559,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859149+0000","last_change":"2024-04-25T22:55:35.517931+0000","last_active":"2024-04-25T22:55:41.859149+0000","last_peered":"2024-04-25T22:55:41.859149+0000","last_clean":"2024-04-25T22:55:41.859149+0000","last_became_active":"2024-04-25T22:55:35.517044+0000","last_became_peered":"2024-04-25T22:55:35.517044+0000","last_unstale":"2024-04-25T22:55:41.859149+0000","last_undegraded":"2024-04-25T22:55:41.859149+0000","last_fullsized":"2024-04-25T22:55:41.859149+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:42.118131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":709662,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":119,"num_bytes_recovered":709653,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"55'173","reported_seq":516,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535750+0000","last_change":"2024-04-25T22:55:38.515187+0000","last_active":"2024-04-25T22:55:41.535750+0000","last_peered":"2024-04-25T22:55:41.535750+0000","last_clean":"2024-04-25T22:55:41.535750+0000","last_became_active":"2024-04-25T22:55:38.513456+0000","last_became_peered":"2024-04-25T22:55:38.513456+0000","last_unstale":"2024-04-25T22:55:41.535750+0000","last_undegraded":"2024-04-25T22:55:41.535750+0000","last_fullsized":"2024-04-25T22:55:41.535750+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:08:19.339484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569466,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":569466,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"55'173","reported_seq":541,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535869+0000","last_change":"2024-04-25T22:55:33.512839+0000","last_active":"2024-04-25T22:55:41.535869+0000","last_peered":"2024-04-25T22:55:41.535869+0000","last_clean":"2024-04-25T22:55:41.535869+0000","last_became_active":"2024-04-25T22:55:33.511961+0000","last_became_peered":"2024-04-25T22:55:33.511961+0000","last_unstale":"2024-04-25T22:55:41.535869+0000","last_undegraded":"2024-04-25T22:55:41.535869+0000","last_fullsized":"2024-04-25T22:55:41.535869+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:54:45.619674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75460,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":111,"num_bytes_recovered":75460,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"55'140","reported_seq":456,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535457+0000","last_change":"2024-04-25T22:55:32.510322+0000","last_active":"2024-04-25T22:55:41.535457+0000","last_peered":"2024-04-25T22:55:41.535457+0000","last_clean":"2024-04-25T22:55:41.535457+0000","last_became_active":"2024-04-25T22:55:32.509908+0000","last_became_peered":"2024-04-25T22:55:32.509908+0000","last_unstale":"2024-04-25T22:55:41.535457+0000","last_undegraded":"2024-04-25T22:55:41.535457+0000","last_fullsized":"2024-04-25T22:55:41.535457+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:16:15.948780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":214453,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":214404,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"55'169","reported_seq":274,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536936+0000","last_change":"2024-04-25T22:55:32.513084+0000","last_active":"2024-04-25T22:55:41.536936+0000","last_peered":"2024-04-25T22:55:41.536936+0000","last_clean":"2024-04-25T22:55:41.536936+0000","last_became_active":"2024-04-25T22:55:32.512447+0000","last_became_peered":"2024-04-25T22:55:32.512447+0000","last_unstale":"2024-04-25T22:55:41.536936+0000","last_undegraded":"2024-04-25T22:55:41.536936+0000","last_fullsized":"2024-04-25T22:55:41.536936+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:16:27.593679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":538374,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":538374,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"55'153","reported_seq":483,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859293+0000","last_change":"2024-04-25T22:55:35.518293+0000","last_active":"2024-04-25T22:55:41.859293+0000","last_peered":"2024-04-25T22:55:41.859293+0000","last_clean":"2024-04-25T22:55:41.859293+0000","last_became_active":"2024-04-25T22:55:35.517506+0000","last_became_peered":"2024-04-25T22:55:35.517506+0000","last_unstale":"2024-04-25T22:55:41.859293+0000","last_undegraded":"2024-04-25T22:55:41.859293+0000","last_fullsized":"2024-04-25T22:55:41.859293+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:42:09.860717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130447,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":123390,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"55'154","reported_seq":258,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536002+0000","last_change":"2024-04-25T22:55:40.538872+0000","last_active":"2024-04-25T22:55:41.536002+0000","last_peered":"2024-04-25T22:55:41.536002+0000","last_clean":"2024-04-25T22:55:41.536002+0000","last_became_active":"2024-04-25T22:55:40.538052+0000","last_became_peered":"2024-04-25T22:55:40.538052+0000","last_unstale":"2024-04-25T22:55:41.536002+0000","last_undegraded":"2024-04-25T22:55:41.536002+0000","last_fullsized":"2024-04-25T22:55:41.536002+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:06.239983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":343806,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":208,"num_bytes_recovered":687612,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"55'141","reported_seq":278,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858898+0000","last_change":"2024-04-25T22:51:53.028006+0000","last_active":"2024-04-25T22:55:41.858898+0000","last_peered":"2024-04-25T22:55:41.858898+0000","last_clean":"2024-04-25T22:55:41.858898+0000","last_became_active":"2024-04-25T22:51:53.027363+0000","last_became_peered":"2024-04-25T22:51:53.027363+0000","last_unstale":"2024-04-25T22:55:41.858898+0000","last_undegraded":"2024-04-25T22:55:41.858898+0000","last_fullsized":"2024-04-25T22:55:41.858898+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:32.923620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125409,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"55'135","reported_seq":459,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858862+0000","last_change":"2024-04-25T22:55:33.512249+0000","last_active":"2024-04-25T22:55:41.858862+0000","last_peered":"2024-04-25T22:55:41.858862+0000","last_clean":"2024-04-25T22:55:41.858862+0000","last_became_active":"2024-04-25T22:55:33.511546+0000","last_became_peered":"2024-04-25T22:55:33.511546+0000","last_unstale":"2024-04-25T22:55:41.858862+0000","last_undegraded":"2024-04-25T22:55:41.858862+0000","last_fullsized":"2024-04-25T22:55:41.858862+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:52:41.758279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":183835,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":183835,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"55'179","reported_seq":314,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535808+0000","last_change":"2024-04-25T22:51:53.022367+0000","last_active":"2024-04-25T22:55:41.535808+0000","last_peered":"2024-04-25T22:55:41.535808+0000","last_clean":"2024-04-25T22:55:41.535808+0000","last_became_active":"2024-04-25T22:51:53.021902+0000","last_became_peered":"2024-04-25T22:51:53.021902+0000","last_unstale":"2024-04-25T22:55:41.535808+0000","last_undegraded":"2024-04-25T22:55:41.535808+0000","last_fullsized":"2024-04-25T22:55:41.535808+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:44:59.401139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153371,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":181,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"55'161","reported_seq":273,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535564+0000","last_change":"2024-04-25T22:55:40.539371+0000","last_active":"2024-04-25T22:55:41.535564+0000","last_peered":"2024-04-25T22:55:41.535564+0000","last_clean":"2024-04-25T22:55:41.535564+0000","last_became_active":"2024-04-25T22:55:40.538095+0000","last_became_peered":"2024-04-25T22:55:40.538095+0000","last_unstale":"2024-04-25T22:55:41.535564+0000","last_undegraded":"2024-04-25T22:55:41.535564+0000","last_fullsized":"2024-04-25T22:55:41.535564+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:57.514231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4276239,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":4418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":4276214,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"55'179","reported_seq":551,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535530+0000","last_change":"2024-04-25T22:55:31.526766+0000","last_active":"2024-04-25T22:55:41.535530+0000","last_peered":"2024-04-25T22:55:41.535530+0000","last_clean":"2024-04-25T22:55:41.535530+0000","last_became_active":"2024-04-25T22:55:31.526271+0000","last_became_peered":"2024-04-25T22:55:31.526271+0000","last_unstale":"2024-04-25T22:55:41.535530+0000","last_undegraded":"2024-04-25T22:55:41.535530+0000","last_fullsized":"2024-04-25T22:55:41.535530+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:48:39.183880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4371943,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":4513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":4363238,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"55'163","reported_seq":268,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536806+0000","last_change":"2024-04-25T22:55:32.513240+0000","last_active":"2024-04-25T22:55:41.536806+0000","last_peered":"2024-04-25T22:55:41.536806+0000","last_clean":"2024-04-25T22:55:41.536806+0000","last_became_active":"2024-04-25T22:55:32.512371+0000","last_became_peered":"2024-04-25T22:55:32.512371+0000","last_unstale":"2024-04-25T22:55:41.536806+0000","last_undegraded":"2024-04-25T22:55:41.536806+0000","last_fullsized":"2024-04-25T22:55:41.536806+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:23.735382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96221,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":87110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"55'147","reported_seq":487,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859496+0000","last_change":"2024-04-25T22:55:35.519379+0000","last_active":"2024-04-25T22:55:41.859496+0000","last_peered":"2024-04-25T22:55:41.859496+0000","last_clean":"2024-04-25T22:55:41.859496+0000","last_became_active":"2024-04-25T22:55:35.518584+0000","last_became_peered":"2024-04-25T22:55:35.518584+0000","last_unstale":"2024-04-25T22:55:41.859496+0000","last_undegraded":"2024-04-25T22:55:41.859496+0000","last_fullsized":"2024-04-25T22:55:41.859496+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:33:50.992444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1432264,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":1532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":1432241,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"55'146","reported_seq":255,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536568+0000","last_change":"2024-04-25T22:55:30.527560+0000","last_active":"2024-04-25T22:55:41.536568+0000","last_peered":"2024-04-25T22:55:41.536568+0000","last_clean":"2024-04-25T22:55:41.536568+0000","last_became_active":"2024-04-25T22:55:30.526745+0000","last_became_peered":"2024-04-25T22:55:30.526745+0000","last_unstale":"2024-04-25T22:55:41.536568+0000","last_undegraded":"2024-04-25T22:55:41.536568+0000","last_fullsized":"2024-04-25T22:55:41.536568+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:40:08.494734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112933,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":112933,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"55'178","reported_seq":548,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536195+0000","last_change":"2024-04-25T22:55:34.512671+0000","last_active":"2024-04-25T22:55:41.536195+0000","last_peered":"2024-04-25T22:55:41.536195+0000","last_clean":"2024-04-25T22:55:41.536195+0000","last_became_active":"2024-04-25T22:55:34.511872+0000","last_became_peered":"2024-04-25T22:55:34.511872+0000","last_unstale":"2024-04-25T22:55:41.536195+0000","last_undegraded":"2024-04-25T22:55:41.536195+0000","last_fullsized":"2024-04-25T22:55:41.536195+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:43:12.293070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124334,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":124334,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"55'158","reported_seq":500,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535980+0000","last_change":"2024-04-25T22:55:34.512430+0000","last_active":"2024-04-25T22:55:41.535980+0000","last_peered":"2024-04-25T22:55:41.535980+0000","last_clean":"2024-04-25T22:55:41.535980+0000","last_became_active":"2024-04-25T22:55:34.511833+0000","last_became_peered":"2024-04-25T22:55:34.511833+0000","last_unstale":"2024-04-25T22:55:41.535980+0000","last_undegraded":"2024-04-25T22:55:41.535980+0000","last_fullsized":"2024-04-25T22:55:41.535980+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:52:03.534174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145029,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":145029,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"55'171","reported_seq":308,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858838+0000","last_change":"2024-04-25T22:51:53.026746+0000","last_active":"2024-04-25T22:55:41.858838+0000","last_peered":"2024-04-25T22:55:41.858838+0000","last_clean":"2024-04-25T22:55:41.858838+0000","last_became_active":"2024-04-25T22:51:53.025938+0000","last_became_peered":"2024-04-25T22:51:53.025938+0000","last_unstale":"2024-04-25T22:55:41.858838+0000","last_undegraded":"2024-04-25T22:55:41.858838+0000","last_fullsized":"2024-04-25T22:55:41.858838+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:38:03.428258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115019,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"55'161","reported_seq":262,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535818+0000","last_change":"2024-04-25T22:55:33.513307+0000","last_active":"2024-04-25T22:55:41.535818+0000","last_peered":"2024-04-25T22:55:41.535818+0000","last_clean":"2024-04-25T22:55:41.535818+0000","last_became_active":"2024-04-25T22:55:33.512160+0000","last_became_peered":"2024-04-25T22:55:33.512160+0000","last_unstale":"2024-04-25T22:55:41.535818+0000","last_undegraded":"2024-04-25T22:55:41.535818+0000","last_fullsized":"2024-04-25T22:55:41.535818+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:57:16.042728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":641227,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":641227,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"55'169","reported_seq":525,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858515+0000","last_change":"2024-04-25T22:55:33.512249+0000","last_active":"2024-04-25T22:55:41.858515+0000","last_peered":"2024-04-25T22:55:41.858515+0000","last_clean":"2024-04-25T22:55:41.858515+0000","last_became_active":"2024-04-25T22:55:33.511463+0000","last_became_peered":"2024-04-25T22:55:33.511463+0000","last_unstale":"2024-04-25T22:55:41.858515+0000","last_undegraded":"2024-04-25T22:55:41.858515+0000","last_fullsized":"2024-04-25T22:55:41.858515+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:54:45.619674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103634,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":189,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":98869,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"55'159","reported_seq":296,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859682+0000","last_change":"2024-04-25T22:51:53.028155+0000","last_active":"2024-04-25T22:55:41.859682+0000","last_peered":"2024-04-25T22:55:41.859682+0000","last_clean":"2024-04-25T22:55:41.859682+0000","last_became_active":"2024-04-25T22:51:53.027867+0000","last_became_peered":"2024-04-25T22:51:53.027867+0000","last_unstale":"2024-04-25T22:55:41.859682+0000","last_undegraded":"2024-04-25T22:55:41.859682+0000","last_fullsized":"2024-04-25T22:55:41.859682+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:43:47.453569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272252,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"55'190","reported_seq":289,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536880+0000","last_change":"2024-04-25T22:55:34.513270+0000","last_active":"2024-04-25T22:55:41.536880+0000","last_peered":"2024-04-25T22:55:41.536880+0000","last_clean":"2024-04-25T22:55:41.536880+0000","last_became_active":"2024-04-25T22:55:34.512320+0000","last_became_peered":"2024-04-25T22:55:34.512320+0000","last_unstale":"2024-04-25T22:55:41.536880+0000","last_undegraded":"2024-04-25T22:55:41.536880+0000","last_fullsized":"2024-04-25T22:55:41.536880+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:37.486013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126403,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":117,"num_bytes_recovered":126342,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"55'151","reported_seq":286,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536427+0000","last_change":"2024-04-25T22:51:53.022893+0000","last_active":"2024-04-25T22:55:41.536427+0000","last_peered":"2024-04-25T22:55:41.536427+0000","last_clean":"2024-04-25T22:55:41.536427+0000","last_became_active":"2024-04-25T22:51:53.022407+0000","last_became_peered":"2024-04-25T22:51:53.022407+0000","last_unstale":"2024-04-25T22:55:41.536427+0000","last_undegraded":"2024-04-25T22:55:41.536427+0000","last_fullsized":"2024-04-25T22:55:41.536427+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:08:44.404718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69245,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"55'147","reported_seq":284,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859212+0000","last_change":"2024-04-25T22:51:53.028447+0000","last_active":"2024-04-25T22:55:41.859212+0000","last_peered":"2024-04-25T22:55:41.859212+0000","last_clean":"2024-04-25T22:55:41.859212+0000","last_became_active":"2024-04-25T22:51:53.027852+0000","last_became_peered":"2024-04-25T22:51:53.027852+0000","last_unstale":"2024-04-25T22:55:41.859212+0000","last_undegraded":"2024-04-25T22:55:41.859212+0000","last_fullsized":"2024-04-25T22:55:41.859212+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:16.187194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192848,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"55'166","reported_seq":267,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535904+0000","last_change":"2024-04-25T22:55:34.514981+0000","last_active":"2024-04-25T22:55:41.535904+0000","last_peered":"2024-04-25T22:55:41.535904+0000","last_clean":"2024-04-25T22:55:41.535904+0000","last_became_active":"2024-04-25T22:55:34.514067+0000","last_became_peered":"2024-04-25T22:55:34.514067+0000","last_unstale":"2024-04-25T22:55:41.535904+0000","last_undegraded":"2024-04-25T22:55:41.535904+0000","last_fullsized":"2024-04-25T22:55:41.535904+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:05:49.273497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239074,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":239074,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"55'191","reported_seq":328,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859081+0000","last_change":"2024-04-25T22:51:53.026997+0000","last_active":"2024-04-25T22:55:41.859081+0000","last_peered":"2024-04-25T22:55:41.859081+0000","last_clean":"2024-04-25T22:55:41.859081+0000","last_became_active":"2024-04-25T22:51:53.026379+0000","last_became_peered":"2024-04-25T22:51:53.026379+0000","last_unstale":"2024-04-25T22:55:41.859081+0000","last_undegraded":"2024-04-25T22:55:41.859081+0000","last_fullsized":"2024-04-25T22:55:41.859081+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:33:24.700106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99668,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"55'193","reported_seq":298,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536272+0000","last_change":"2024-04-25T22:55:32.511886+0000","last_active":"2024-04-25T22:55:41.536272+0000","last_peered":"2024-04-25T22:55:41.536272+0000","last_clean":"2024-04-25T22:55:41.536272+0000","last_became_active":"2024-04-25T22:55:32.509978+0000","last_became_peered":"2024-04-25T22:55:32.509978+0000","last_unstale":"2024-04-25T22:55:41.536272+0000","last_undegraded":"2024-04-25T22:55:41.536272+0000","last_fullsized":"2024-04-25T22:55:41.536272+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:56:47.747527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128069,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":128069,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"55'182","reported_seq":537,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535588+0000","last_change":"2024-04-25T22:55:38.519451+0000","last_active":"2024-04-25T22:55:41.535588+0000","last_peered":"2024-04-25T22:55:41.535588+0000","last_clean":"2024-04-25T22:55:41.535588+0000","last_became_active":"2024-04-25T22:55:38.518412+0000","last_became_peered":"2024-04-25T22:55:38.518412+0000","last_unstale":"2024-04-25T22:55:41.535588+0000","last_undegraded":"2024-04-25T22:55:41.535588+0000","last_fullsized":"2024-04-25T22:55:41.535588+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:27.179735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":586629,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":580754,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"55'156","reported_seq":494,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859060+0000","last_change":"2024-04-25T22:55:33.512918+0000","last_active":"2024-04-25T22:55:41.859060+0000","last_peered":"2024-04-25T22:55:41.859060+0000","last_clean":"2024-04-25T22:55:41.859060+0000","last_became_active":"2024-04-25T22:55:33.512114+0000","last_became_peered":"2024-04-25T22:55:33.512114+0000","last_unstale":"2024-04-25T22:55:41.859060+0000","last_undegraded":"2024-04-25T22:55:41.859060+0000","last_fullsized":"2024-04-25T22:55:41.859060+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:52:03.534174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118861,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":118861,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"60'105","reported_seq":256,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536115+0000","last_change":"2024-04-25T22:55:30.526027+0000","last_active":"2024-04-25T22:55:41.536115+0000","last_peered":"2024-04-25T22:55:41.536115+0000","last_clean":"2024-04-25T22:55:41.536115+0000","last_became_active":"2024-04-25T22:55:30.525469+0000","last_became_peered":"2024-04-25T22:55:30.525469+0000","last_unstale":"2024-04-25T22:55:41.536115+0000","last_undegraded":"2024-04-25T22:55:41.536115+0000","last_fullsized":"2024-04-25T22:55:41.536115+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:18:16.878967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2425045,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":2428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":2425011,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"55'146","reported_seq":472,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859394+0000","last_change":"2024-04-25T22:55:30.525674+0000","last_active":"2024-04-25T22:55:41.859394+0000","last_peered":"2024-04-25T22:55:41.859394+0000","last_clean":"2024-04-25T22:55:41.859394+0000","last_became_active":"2024-04-25T22:55:30.524718+0000","last_became_peered":"2024-04-25T22:55:30.524718+0000","last_unstale":"2024-04-25T22:55:41.859394+0000","last_undegraded":"2024-04-25T22:55:41.859394+0000","last_fullsized":"2024-04-25T22:55:41.859394+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:48:39.183880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67079,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":89,"num_bytes_recovered":67079,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":48,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535977+0000","last_change":"2024-04-25T22:55:27.517626+0000","last_active":"2024-04-25T22:55:41.535977+0000","last_peered":"2024-04-25T22:55:41.535977+0000","last_clean":"2024-04-25T22:55:41.535977+0000","last_became_active":"2024-04-25T22:55:27.517208+0000","last_became_peered":"2024-04-25T22:55:27.517208+0000","last_unstale":"2024-04-25T22:55:41.535977+0000","last_undegraded":"2024-04-25T22:55:41.535977+0000","last_fullsized":"2024-04-25T22:55:41.535977+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:09.249311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"55'186","reported_seq":287,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536662+0000","last_change":"2024-04-25T22:55:33.513626+0000","last_active":"2024-04-25T22:55:41.536662+0000","last_peered":"2024-04-25T22:55:41.536662+0000","last_clean":"2024-04-25T22:55:41.536662+0000","last_became_active":"2024-04-25T22:55:33.512389+0000","last_became_peered":"2024-04-25T22:55:33.512389+0000","last_unstale":"2024-04-25T22:55:41.536662+0000","last_undegraded":"2024-04-25T22:55:41.536662+0000","last_fullsized":"2024-04-25T22:55:41.536662+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:02:53.672517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139986,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":137763,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":139,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859045+0000","last_change":"2024-04-25T22:51:52.018646+0000","last_active":"2024-04-25T22:55:41.859045+0000","last_peered":"2024-04-25T22:55:41.859045+0000","last_clean":"2024-04-25T22:55:41.859045+0000","last_became_active":"2024-04-25T22:51:52.018313+0000","last_became_peered":"2024-04-25T22:51:52.018313+0000","last_unstale":"2024-04-25T22:55:41.859045+0000","last_undegraded":"2024-04-25T22:55:41.859045+0000","last_fullsized":"2024-04-25T22:55:41.859045+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:00:21.688745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"55'167","reported_seq":274,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536676+0000","last_change":"2024-04-25T22:55:30.527435+0000","last_active":"2024-04-25T22:55:41.536676+0000","last_peered":"2024-04-25T22:55:41.536676+0000","last_clean":"2024-04-25T22:55:41.536676+0000","last_became_active":"2024-04-25T22:55:30.526276+0000","last_became_peered":"2024-04-25T22:55:30.526276+0000","last_unstale":"2024-04-25T22:55:41.536676+0000","last_undegraded":"2024-04-25T22:55:41.536676+0000","last_fullsized":"2024-04-25T22:55:41.536676+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:03:39.273168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87849,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":87849,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":145,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535666+0000","last_change":"2024-04-25T22:51:52.021510+0000","last_active":"2024-04-25T22:55:41.535666+0000","last_peered":"2024-04-25T22:55:41.535666+0000","last_clean":"2024-04-25T22:55:41.535666+0000","last_became_active":"2024-04-25T22:51:52.021145+0000","last_became_peered":"2024-04-25T22:51:52.021145+0000","last_unstale":"2024-04-25T22:55:41.535666+0000","last_undegraded":"2024-04-25T22:55:41.535666+0000","last_fullsized":"2024-04-25T22:55:41.535666+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:05.110747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"52'2","reported_seq":139,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536823+0000","last_change":"2024-04-25T22:51:52.021355+0000","last_active":"2024-04-25T22:55:41.536823+0000","last_peered":"2024-04-25T22:55:41.536823+0000","last_clean":"2024-04-25T22:55:41.536823+0000","last_became_active":"2024-04-25T22:51:52.020860+0000","last_became_peered":"2024-04-25T22:51:52.020860+0000","last_unstale":"2024-04-25T22:55:41.536823+0000","last_undegraded":"2024-04-25T22:55:41.536823+0000","last_fullsized":"2024-04-25T22:55:41.536823+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:55.235787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"55'157","reported_seq":294,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858543+0000","last_change":"2024-04-25T22:51:53.029390+0000","last_active":"2024-04-25T22:55:41.858543+0000","last_peered":"2024-04-25T22:55:41.858543+0000","last_clean":"2024-04-25T22:55:41.858543+0000","last_became_active":"2024-04-25T22:51:53.029157+0000","last_became_peered":"2024-04-25T22:51:53.029157+0000","last_unstale":"2024-04-25T22:55:41.858543+0000","last_undegraded":"2024-04-25T22:55:41.858543+0000","last_fullsized":"2024-04-25T22:55:41.858543+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:51:43.808994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190158,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"48'3","reported_seq":142,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859570+0000","last_change":"2024-04-25T22:51:52.018856+0000","last_active":"2024-04-25T22:55:41.859570+0000","last_peered":"2024-04-25T22:55:41.859570+0000","last_clean":"2024-04-25T22:55:41.859570+0000","last_became_active":"2024-04-25T22:51:52.018390+0000","last_became_peered":"2024-04-25T22:51:52.018390+0000","last_unstale":"2024-04-25T22:55:41.859570+0000","last_undegraded":"2024-04-25T22:55:41.859570+0000","last_fullsized":"2024-04-25T22:55:41.859570+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:42:54.430484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"55'171","reported_seq":539,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858599+0000","last_change":"2024-04-25T22:55:31.527677+0000","last_active":"2024-04-25T22:55:41.858599+0000","last_peered":"2024-04-25T22:55:41.858599+0000","last_clean":"2024-04-25T22:55:41.858599+0000","last_became_active":"2024-04-25T22:55:31.527049+0000","last_became_peered":"2024-04-25T22:55:31.527049+0000","last_unstale":"2024-04-25T22:55:41.858599+0000","last_undegraded":"2024-04-25T22:55:41.858599+0000","last_fullsized":"2024-04-25T22:55:41.858599+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:16:15.948780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":315325,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":191,"num_write_kb":549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":110,"num_bytes_recovered":301306,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":45,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536688+0000","last_change":"2024-04-25T22:55:38.519011+0000","last_active":"2024-04-25T22:55:41.536688+0000","last_peered":"2024-04-25T22:55:41.536688+0000","last_clean":"2024-04-25T22:55:41.536688+0000","last_became_active":"2024-04-25T22:55:38.517362+0000","last_became_peered":"2024-04-25T22:55:38.517362+0000","last_unstale":"2024-04-25T22:55:41.536688+0000","last_undegraded":"2024-04-25T22:55:41.536688+0000","last_fullsized":"2024-04-25T22:55:41.536688+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:30:15.580001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"55'153","reported_seq":486,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536056+0000","last_change":"2024-04-25T22:55:38.515892+0000","last_active":"2024-04-25T22:55:41.536056+0000","last_peered":"2024-04-25T22:55:41.536056+0000","last_clean":"2024-04-25T22:55:41.536056+0000","last_became_active":"2024-04-25T22:55:38.514319+0000","last_became_peered":"2024-04-25T22:55:38.514319+0000","last_unstale":"2024-04-25T22:55:41.536056+0000","last_undegraded":"2024-04-25T22:55:41.536056+0000","last_fullsized":"2024-04-25T22:55:41.536056+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:42.118131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97209,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":97196,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"51'1","reported_seq":115,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536541+0000","last_change":"2024-04-25T22:55:38.518279+0000","last_active":"2024-04-25T22:55:41.536541+0000","last_peered":"2024-04-25T22:55:41.536541+0000","last_clean":"2024-04-25T22:55:41.536541+0000","last_became_active":"2024-04-25T22:55:38.516782+0000","last_became_peered":"2024-04-25T22:55:38.516782+0000","last_unstale":"2024-04-25T22:55:41.536541+0000","last_undegraded":"2024-04-25T22:55:41.536541+0000","last_fullsized":"2024-04-25T22:55:41.536541+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:27:46.635381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"55'153","reported_seq":256,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536313+0000","last_change":"2024-04-25T22:55:32.511660+0000","last_active":"2024-04-25T22:55:41.536313+0000","last_peered":"2024-04-25T22:55:41.536313+0000","last_clean":"2024-04-25T22:55:41.536313+0000","last_became_active":"2024-04-25T22:55:32.510402+0000","last_became_peered":"2024-04-25T22:55:32.510402+0000","last_unstale":"2024-04-25T22:55:41.536313+0000","last_undegraded":"2024-04-25T22:55:41.536313+0000","last_fullsized":"2024-04-25T22:55:41.536313+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:13:03.774101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131384,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":131332,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"47'7","reported_seq":56,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536115+0000","last_change":"2024-04-25T22:55:27.566798+0000","last_active":"2024-04-25T22:55:41.536115+0000","last_peered":"2024-04-25T22:55:41.536115+0000","last_clean":"2024-04-25T22:55:41.536115+0000","last_became_active":"2024-04-25T22:55:27.518709+0000","last_became_peered":"2024-04-25T22:55:27.518709+0000","last_unstale":"2024-04-25T22:55:41.536115+0000","last_undegraded":"2024-04-25T22:55:41.536115+0000","last_fullsized":"2024-04-25T22:55:41.536115+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:07:47.758073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"55'174","reported_seq":521,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536332+0000","last_change":"2024-04-25T22:55:38.517785+0000","last_active":"2024-04-25T22:55:41.536332+0000","last_peered":"2024-04-25T22:55:41.536332+0000","last_clean":"2024-04-25T22:55:41.536332+0000","last_became_active":"2024-04-25T22:55:38.514695+0000","last_became_peered":"2024-04-25T22:55:38.514695+0000","last_unstale":"2024-04-25T22:55:41.536332+0000","last_undegraded":"2024-04-25T22:55:41.536332+0000","last_fullsized":"2024-04-25T22:55:41.536332+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:33:50.992444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187245,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":111,"num_bytes_recovered":187245,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":144,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536245+0000","last_change":"2024-04-25T22:55:27.517686+0000","last_active":"2024-04-25T22:55:41.536245+0000","last_peered":"2024-04-25T22:55:41.536245+0000","last_clean":"2024-04-25T22:55:41.536245+0000","last_became_active":"2024-04-25T22:55:27.517404+0000","last_became_peered":"2024-04-25T22:55:27.517404+0000","last_unstale":"2024-04-25T22:55:41.536245+0000","last_undegraded":"2024-04-25T22:55:41.536245+0000","last_fullsized":"2024-04-25T22:55:41.536245+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:11.671572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"55'163","reported_seq":298,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536548+0000","last_change":"2024-04-25T22:51:53.023929+0000","last_active":"2024-04-25T22:55:41.536548+0000","last_peered":"2024-04-25T22:55:41.536548+0000","last_clean":"2024-04-25T22:55:41.536548+0000","last_became_active":"2024-04-25T22:51:53.023405+0000","last_became_peered":"2024-04-25T22:51:53.023405+0000","last_unstale":"2024-04-25T22:55:41.536548+0000","last_undegraded":"2024-04-25T22:55:41.536548+0000","last_fullsized":"2024-04-25T22:55:41.536548+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:35:35.419823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130867,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":156,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859401+0000","last_change":"2024-04-25T22:55:37.516071+0000","last_active":"2024-04-25T22:55:41.859401+0000","last_peered":"2024-04-25T22:55:41.859401+0000","last_clean":"2024-04-25T22:55:41.859401+0000","last_became_active":"2024-04-25T22:55:37.515798+0000","last_became_peered":"2024-04-25T22:55:37.515798+0000","last_unstale":"2024-04-25T22:55:41.859401+0000","last_undegraded":"2024-04-25T22:55:41.859401+0000","last_fullsized":"2024-04-25T22:55:41.859401+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:27:46.635381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"55'139","reported_seq":274,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536510+0000","last_change":"2024-04-25T22:51:53.020574+0000","last_active":"2024-04-25T22:55:41.536510+0000","last_peered":"2024-04-25T22:55:41.536510+0000","last_clean":"2024-04-25T22:55:41.536510+0000","last_became_active":"2024-04-25T22:51:53.019978+0000","last_became_peered":"2024-04-25T22:51:53.019978+0000","last_unstale":"2024-04-25T22:55:41.536510+0000","last_undegraded":"2024-04-25T22:55:41.536510+0000","last_fullsized":"2024-04-25T22:55:41.536510+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:41.205051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197405,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"51'1","reported_seq":147,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858624+0000","last_change":"2024-04-25T22:55:27.517695+0000","last_active":"2024-04-25T22:55:41.858624+0000","last_peered":"2024-04-25T22:55:41.858624+0000","last_clean":"2024-04-25T22:55:41.858624+0000","last_became_active":"2024-04-25T22:55:27.517330+0000","last_became_peered":"2024-04-25T22:55:27.517330+0000","last_unstale":"2024-04-25T22:55:41.858624+0000","last_undegraded":"2024-04-25T22:55:41.858624+0000","last_fullsized":"2024-04-25T22:55:41.858624+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:15:30.181042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"55'145","reported_seq":252,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.537124+0000","last_change":"2024-04-25T22:55:31.528962+0000","last_active":"2024-04-25T22:55:41.537124+0000","last_peered":"2024-04-25T22:55:41.537124+0000","last_clean":"2024-04-25T22:55:41.537124+0000","last_became_active":"2024-04-25T22:55:31.528360+0000","last_became_peered":"2024-04-25T22:55:31.528360+0000","last_unstale":"2024-04-25T22:55:41.537124+0000","last_undegraded":"2024-04-25T22:55:41.537124+0000","last_fullsized":"2024-04-25T22:55:41.537124+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:27:45.223109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165168,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":165116,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":339,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536012+0000","last_change":"2024-04-25T22:51:47.764624+0000","last_active":"2024-04-25T22:55:41.536012+0000","last_peered":"2024-04-25T22:55:41.536012+0000","last_clean":"2024-04-25T22:55:41.536012+0000","last_became_active":"2024-04-25T22:51:47.764176+0000","last_became_peered":"2024-04-25T22:51:47.764176+0000","last_unstale":"2024-04-25T22:55:41.536012+0000","last_undegraded":"2024-04-25T22:55:41.536012+0000","last_fullsized":"2024-04-25T22:55:41.536012+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:59:39.005489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":150,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536222+0000","last_change":"2024-04-25T22:55:27.521219+0000","last_active":"2024-04-25T22:55:41.536222+0000","last_peered":"2024-04-25T22:55:41.536222+0000","last_clean":"2024-04-25T22:55:41.536222+0000","last_became_active":"2024-04-25T22:55:27.520951+0000","last_became_peered":"2024-04-25T22:55:27.520951+0000","last_unstale":"2024-04-25T22:55:41.536222+0000","last_undegraded":"2024-04-25T22:55:41.536222+0000","last_fullsized":"2024-04-25T22:55:41.536222+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:48:53.391950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"51'2","reported_seq":48,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536134+0000","last_change":"2024-04-25T22:55:27.520902+0000","last_active":"2024-04-25T22:55:41.536134+0000","last_peered":"2024-04-25T22:55:41.536134+0000","last_clean":"2024-04-25T22:55:41.536134+0000","last_became_active":"2024-04-25T22:55:27.520466+0000","last_became_peered":"2024-04-25T22:55:27.520466+0000","last_unstale":"2024-04-25T22:55:41.536134+0000","last_undegraded":"2024-04-25T22:55:41.536134+0000","last_fullsized":"2024-04-25T22:55:41.536134+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:18:17.518924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"55'150","reported_seq":285,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536563+0000","last_change":"2024-04-25T22:51:53.024106+0000","last_active":"2024-04-25T22:55:41.536563+0000","last_peered":"2024-04-25T22:55:41.536563+0000","last_clean":"2024-04-25T22:55:41.536563+0000","last_became_active":"2024-04-25T22:51:53.023497+0000","last_became_peered":"2024-04-25T22:51:53.023497+0000","last_unstale":"2024-04-25T22:55:41.536563+0000","last_undegraded":"2024-04-25T22:55:41.536563+0000","last_fullsized":"2024-04-25T22:55:41.536563+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:52:16.918935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":331484,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":143,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536139+0000","last_change":"2024-04-25T22:51:47.764591+0000","last_active":"2024-04-25T22:55:41.536139+0000","last_peered":"2024-04-25T22:55:41.536139+0000","last_clean":"2024-04-25T22:55:41.536139+0000","last_became_active":"2024-04-25T22:51:47.764229+0000","last_became_peered":"2024-04-25T22:51:47.764229+0000","last_unstale":"2024-04-25T22:55:41.536139+0000","last_undegraded":"2024-04-25T22:55:41.536139+0000","last_fullsized":"2024-04-25T22:55:41.536139+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:32.854624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"53'36","reported_seq":52,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535631+0000","last_change":"2024-04-25T22:55:27.524404+0000","last_active":"2024-04-25T22:55:41.535631+0000","last_peered":"2024-04-25T22:55:41.535631+0000","last_clean":"2024-04-25T22:55:41.535631+0000","last_became_active":"2024-04-25T22:55:27.517290+0000","last_became_peered":"2024-04-25T22:55:27.517290+0000","last_unstale":"2024-04-25T22:55:41.535631+0000","last_undegraded":"2024-04-25T22:55:41.535631+0000","last_fullsized":"2024-04-25T22:55:41.535631+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:34.809551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327644,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":343,"num_write":34,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":327644,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"55'163","reported_seq":517,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859336+0000","last_change":"2024-04-25T22:55:35.519401+0000","last_active":"2024-04-25T22:55:41.859336+0000","last_peered":"2024-04-25T22:55:41.859336+0000","last_clean":"2024-04-25T22:55:41.859336+0000","last_became_active":"2024-04-25T22:55:35.518367+0000","last_became_peered":"2024-04-25T22:55:35.518367+0000","last_unstale":"2024-04-25T22:55:41.859336+0000","last_undegraded":"2024-04-25T22:55:41.859336+0000","last_fullsized":"2024-04-25T22:55:41.859336+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:51.343892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297937,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":181,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":282175,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":48,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535954+0000","last_change":"2024-04-25T22:55:27.519726+0000","last_active":"2024-04-25T22:55:41.535954+0000","last_peered":"2024-04-25T22:55:41.535954+0000","last_clean":"2024-04-25T22:55:41.535954+0000","last_became_active":"2024-04-25T22:55:27.518412+0000","last_became_peered":"2024-04-25T22:55:27.518412+0000","last_unstale":"2024-04-25T22:55:41.535954+0000","last_undegraded":"2024-04-25T22:55:41.535954+0000","last_fullsized":"2024-04-25T22:55:41.535954+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:32:35.203827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"51'62","reported_seq":201,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858672+0000","last_change":"2024-04-25T22:51:52.018873+0000","last_active":"2024-04-25T22:55:41.858672+0000","last_peered":"2024-04-25T22:55:41.858672+0000","last_clean":"2024-04-25T22:55:41.858672+0000","last_became_active":"2024-04-25T22:51:52.018300+0000","last_became_peered":"2024-04-25T22:51:52.018300+0000","last_unstale":"2024-04-25T22:55:41.858672+0000","last_undegraded":"2024-04-25T22:55:41.858672+0000","last_fullsized":"2024-04-25T22:55:41.858672+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:25:22.660789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":4122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"55'167","reported_seq":272,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.537064+0000","last_change":"2024-04-25T22:55:32.513689+0000","last_active":"2024-04-25T22:55:41.537064+0000","last_peered":"2024-04-25T22:55:41.537064+0000","last_clean":"2024-04-25T22:55:41.537064+0000","last_became_active":"2024-04-25T22:55:32.513087+0000","last_became_peered":"2024-04-25T22:55:32.513087+0000","last_unstale":"2024-04-25T22:55:41.537064+0000","last_undegraded":"2024-04-25T22:55:41.537064+0000","last_fullsized":"2024-04-25T22:55:41.537064+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:36:56.592254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395473,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":166,"num_write_kb":573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":395432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":150,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536310+0000","last_change":"2024-04-25T22:55:27.517303+0000","last_active":"2024-04-25T22:55:41.536310+0000","last_peered":"2024-04-25T22:55:41.536310+0000","last_clean":"2024-04-25T22:55:41.536310+0000","last_became_active":"2024-04-25T22:55:27.516952+0000","last_became_peered":"2024-04-25T22:55:27.516952+0000","last_unstale":"2024-04-25T22:55:41.536310+0000","last_undegraded":"2024-04-25T22:55:41.536310+0000","last_fullsized":"2024-04-25T22:55:41.536310+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:15:25.939805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":114,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536155+0000","last_change":"2024-04-25T22:55:38.518160+0000","last_active":"2024-04-25T22:55:41.536155+0000","last_peered":"2024-04-25T22:55:41.536155+0000","last_clean":"2024-04-25T22:55:41.536155+0000","last_became_active":"2024-04-25T22:55:38.516294+0000","last_became_peered":"2024-04-25T22:55:38.516294+0000","last_unstale":"2024-04-25T22:55:41.536155+0000","last_undegraded":"2024-04-25T22:55:41.536155+0000","last_fullsized":"2024-04-25T22:55:41.536155+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:50.339431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"55'156","reported_seq":263,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536316+0000","last_change":"2024-04-25T22:55:31.527813+0000","last_active":"2024-04-25T22:55:41.536316+0000","last_peered":"2024-04-25T22:55:41.536316+0000","last_clean":"2024-04-25T22:55:41.536316+0000","last_became_active":"2024-04-25T22:55:31.526666+0000","last_became_peered":"2024-04-25T22:55:31.526666+0000","last_unstale":"2024-04-25T22:55:41.536316+0000","last_undegraded":"2024-04-25T22:55:41.536316+0000","last_fullsized":"2024-04-25T22:55:41.536316+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:18.548926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100051,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":100051,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"52'1","reported_seq":145,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536734+0000","last_change":"2024-04-25T22:55:27.517150+0000","last_active":"2024-04-25T22:55:41.536734+0000","last_peered":"2024-04-25T22:55:41.536734+0000","last_clean":"2024-04-25T22:55:41.536734+0000","last_became_active":"2024-04-25T22:55:27.516760+0000","last_became_peered":"2024-04-25T22:55:27.516760+0000","last_unstale":"2024-04-25T22:55:41.536734+0000","last_undegraded":"2024-04-25T22:55:41.536734+0000","last_fullsized":"2024-04-25T22:55:41.536734+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:20:13.546931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536169+0000","last_change":"2024-04-25T22:55:27.517202+0000","last_active":"2024-04-25T22:55:41.536169+0000","last_peered":"2024-04-25T22:55:41.536169+0000","last_clean":"2024-04-25T22:55:41.536169+0000","last_became_active":"2024-04-25T22:55:27.516272+0000","last_became_peered":"2024-04-25T22:55:27.516272+0000","last_unstale":"2024-04-25T22:55:41.536169+0000","last_undegraded":"2024-04-25T22:55:41.536169+0000","last_fullsized":"2024-04-25T22:55:41.536169+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:43:32.692434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"55'155","reported_seq":292,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858903+0000","last_change":"2024-04-25T22:51:53.026321+0000","last_active":"2024-04-25T22:55:41.858903+0000","last_peered":"2024-04-25T22:55:41.858903+0000","last_clean":"2024-04-25T22:55:41.858903+0000","last_became_active":"2024-04-25T22:51:53.025824+0000","last_became_peered":"2024-04-25T22:51:53.025824+0000","last_unstale":"2024-04-25T22:55:41.858903+0000","last_undegraded":"2024-04-25T22:55:41.858903+0000","last_fullsized":"2024-04-25T22:55:41.858903+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:12:00.793718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67397,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536444+0000","last_change":"2024-04-25T22:55:27.516710+0000","last_active":"2024-04-25T22:55:41.536444+0000","last_peered":"2024-04-25T22:55:41.536444+0000","last_clean":"2024-04-25T22:55:41.536444+0000","last_became_active":"2024-04-25T22:55:27.515536+0000","last_became_peered":"2024-04-25T22:55:27.515536+0000","last_unstale":"2024-04-25T22:55:41.536444+0000","last_undegraded":"2024-04-25T22:55:41.536444+0000","last_fullsized":"2024-04-25T22:55:41.536444+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:42:01.941338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":152,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859759+0000","last_change":"2024-04-25T22:55:27.517692+0000","last_active":"2024-04-25T22:55:41.859759+0000","last_peered":"2024-04-25T22:55:41.859759+0000","last_clean":"2024-04-25T22:55:41.859759+0000","last_became_active":"2024-04-25T22:55:27.517411+0000","last_became_peered":"2024-04-25T22:55:27.517411+0000","last_unstale":"2024-04-25T22:55:41.859759+0000","last_undegraded":"2024-04-25T22:55:41.859759+0000","last_fullsized":"2024-04-25T22:55:41.859759+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:20:09.305694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"55'175","reported_seq":312,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858983+0000","last_change":"2024-04-25T22:51:53.027051+0000","last_active":"2024-04-25T22:55:41.858983+0000","last_peered":"2024-04-25T22:55:41.858983+0000","last_clean":"2024-04-25T22:55:41.858983+0000","last_became_active":"2024-04-25T22:51:53.026458+0000","last_became_peered":"2024-04-25T22:51:53.026458+0000","last_unstale":"2024-04-25T22:55:41.858983+0000","last_undegraded":"2024-04-25T22:55:41.858983+0000","last_fullsized":"2024-04-25T22:55:41.858983+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:11:09.179564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192819,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":52,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536805+0000","last_change":"2024-04-25T22:55:27.519827+0000","last_active":"2024-04-25T22:55:41.536805+0000","last_peered":"2024-04-25T22:55:41.536805+0000","last_clean":"2024-04-25T22:55:41.536805+0000","last_became_active":"2024-04-25T22:55:27.518853+0000","last_became_peered":"2024-04-25T22:55:27.518853+0000","last_unstale":"2024-04-25T22:55:41.536805+0000","last_undegraded":"2024-04-25T22:55:41.536805+0000","last_fullsized":"2024-04-25T22:55:41.536805+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:17:48.076297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":48,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536526+0000","last_change":"2024-04-25T22:55:27.519804+0000","last_active":"2024-04-25T22:55:41.536526+0000","last_peered":"2024-04-25T22:55:41.536526+0000","last_clean":"2024-04-25T22:55:41.536526+0000","last_became_active":"2024-04-25T22:55:27.518183+0000","last_became_peered":"2024-04-25T22:55:27.518183+0000","last_unstale":"2024-04-25T22:55:41.536526+0000","last_undegraded":"2024-04-25T22:55:41.536526+0000","last_fullsized":"2024-04-25T22:55:41.536526+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:36.947733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"55'172","reported_seq":505,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536038+0000","last_change":"2024-04-25T22:55:40.539104+0000","last_active":"2024-04-25T22:55:41.536038+0000","last_peered":"2024-04-25T22:55:41.536038+0000","last_clean":"2024-04-25T22:55:41.536038+0000","last_became_active":"2024-04-25T22:55:40.538335+0000","last_became_peered":"2024-04-25T22:55:40.538335+0000","last_unstale":"2024-04-25T22:55:41.536038+0000","last_undegraded":"2024-04-25T22:55:41.536038+0000","last_fullsized":"2024-04-25T22:55:41.536038+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:45:43.336586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505702,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":1011342,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"56'37","reported_seq":67,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536555+0000","last_change":"2024-04-25T22:55:27.570707+0000","last_active":"2024-04-25T22:55:41.536555+0000","last_peered":"2024-04-25T22:55:41.536555+0000","last_clean":"2024-04-25T22:55:41.536555+0000","last_became_active":"2024-04-25T22:55:27.518193+0000","last_became_peered":"2024-04-25T22:55:27.518193+0000","last_unstale":"2024-04-25T22:55:41.536555+0000","last_undegraded":"2024-04-25T22:55:41.536555+0000","last_fullsized":"2024-04-25T22:55:41.536555+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:17:01.521730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":143,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536823+0000","last_change":"2024-04-25T22:51:47.764288+0000","last_active":"2024-04-25T22:55:41.536823+0000","last_peered":"2024-04-25T22:55:41.536823+0000","last_clean":"2024-04-25T22:55:41.536823+0000","last_became_active":"2024-04-25T22:51:47.763961+0000","last_became_peered":"2024-04-25T22:51:47.763961+0000","last_unstale":"2024-04-25T22:55:41.536823+0000","last_undegraded":"2024-04-25T22:55:41.536823+0000","last_fullsized":"2024-04-25T22:55:41.536823+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:03:07.164842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"55'142","reported_seq":279,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858601+0000","last_change":"2024-04-25T22:51:53.026925+0000","last_active":"2024-04-25T22:55:41.858601+0000","last_peered":"2024-04-25T22:55:41.858601+0000","last_clean":"2024-04-25T22:55:41.858601+0000","last_became_active":"2024-04-25T22:51:53.026419+0000","last_became_peered":"2024-04-25T22:51:53.026419+0000","last_unstale":"2024-04-25T22:55:41.858601+0000","last_undegraded":"2024-04-25T22:55:41.858601+0000","last_fullsized":"2024-04-25T22:55:41.858601+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:49:38.102060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":246196,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"55'162","reported_seq":297,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535896+0000","last_change":"2024-04-25T22:51:53.022222+0000","last_active":"2024-04-25T22:55:41.535896+0000","last_peered":"2024-04-25T22:55:41.535896+0000","last_clean":"2024-04-25T22:55:41.535896+0000","last_became_active":"2024-04-25T22:51:53.021687+0000","last_became_peered":"2024-04-25T22:51:53.021687+0000","last_unstale":"2024-04-25T22:55:41.535896+0000","last_undegraded":"2024-04-25T22:55:41.535896+0000","last_fullsized":"2024-04-25T22:55:41.535896+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:35:06.234402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108265,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"60'43","reported_seq":180,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536366+0000","last_change":"2024-04-25T22:51:52.019928+0000","last_active":"2024-04-25T22:55:41.536366+0000","last_peered":"2024-04-25T22:55:41.536366+0000","last_clean":"2024-04-25T22:55:41.536366+0000","last_became_active":"2024-04-25T22:51:52.019264+0000","last_became_peered":"2024-04-25T22:51:52.019264+0000","last_unstale":"2024-04-25T22:55:41.536366+0000","last_undegraded":"2024-04-25T22:55:41.536366+0000","last_fullsized":"2024-04-25T22:55:41.536366+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:18.136883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"55'146","reported_seq":253,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535922+0000","last_change":"2024-04-25T22:55:31.527757+0000","last_active":"2024-04-25T22:55:41.535922+0000","last_peered":"2024-04-25T22:55:41.535922+0000","last_clean":"2024-04-25T22:55:41.535922+0000","last_became_active":"2024-04-25T22:55:31.526620+0000","last_became_peered":"2024-04-25T22:55:31.526620+0000","last_unstale":"2024-04-25T22:55:41.535922+0000","last_undegraded":"2024-04-25T22:55:41.535922+0000","last_fullsized":"2024-04-25T22:55:41.535922+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:59:41.748950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89309,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":89309,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"53'21","reported_seq":160,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859669+0000","last_change":"2024-04-25T22:51:52.018977+0000","last_active":"2024-04-25T22:55:41.859669+0000","last_peered":"2024-04-25T22:55:41.859669+0000","last_clean":"2024-04-25T22:55:41.859669+0000","last_became_active":"2024-04-25T22:51:52.018519+0000","last_became_peered":"2024-04-25T22:51:52.018519+0000","last_unstale":"2024-04-25T22:55:41.859669+0000","last_undegraded":"2024-04-25T22:55:41.859669+0000","last_fullsized":"2024-04-25T22:55:41.859669+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:53:07.306148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"48'1","reported_seq":115,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536721+0000","last_change":"2024-04-25T22:55:38.517605+0000","last_active":"2024-04-25T22:55:41.536721+0000","last_peered":"2024-04-25T22:55:41.536721+0000","last_clean":"2024-04-25T22:55:41.536721+0000","last_became_active":"2024-04-25T22:55:38.515986+0000","last_became_peered":"2024-04-25T22:55:38.515986+0000","last_unstale":"2024-04-25T22:55:41.536721+0000","last_undegraded":"2024-04-25T22:55:41.536721+0000","last_fullsized":"2024-04-25T22:55:41.536721+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:02:39.264531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"55'171","reported_seq":278,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535896+0000","last_change":"2024-04-25T22:55:30.525999+0000","last_active":"2024-04-25T22:55:41.535896+0000","last_peered":"2024-04-25T22:55:41.535896+0000","last_clean":"2024-04-25T22:55:41.535896+0000","last_became_active":"2024-04-25T22:55:30.525233+0000","last_became_peered":"2024-04-25T22:55:30.525233+0000","last_unstale":"2024-04-25T22:55:41.535896+0000","last_undegraded":"2024-04-25T22:55:41.535896+0000","last_fullsized":"2024-04-25T22:55:41.535896+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:51:14.338988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":332166,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":329490,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"51'2","reported_seq":48,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536941+0000","last_change":"2024-04-25T22:55:27.519530+0000","last_active":"2024-04-25T22:55:41.536941+0000","last_peered":"2024-04-25T22:55:41.536941+0000","last_clean":"2024-04-25T22:55:41.536941+0000","last_became_active":"2024-04-25T22:55:27.518244+0000","last_became_peered":"2024-04-25T22:55:27.518244+0000","last_unstale":"2024-04-25T22:55:41.536941+0000","last_undegraded":"2024-04-25T22:55:41.536941+0000","last_fullsized":"2024-04-25T22:55:41.536941+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:40:24.373575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"55'158","reported_seq":267,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535732+0000","last_change":"2024-04-25T22:55:30.527784+0000","last_active":"2024-04-25T22:55:41.535732+0000","last_peered":"2024-04-25T22:55:41.535732+0000","last_clean":"2024-04-25T22:55:41.535732+0000","last_became_active":"2024-04-25T22:55:30.526853+0000","last_became_peered":"2024-04-25T22:55:30.526853+0000","last_unstale":"2024-04-25T22:55:41.535732+0000","last_undegraded":"2024-04-25T22:55:41.535732+0000","last_fullsized":"2024-04-25T22:55:41.535732+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:19:11.705754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70967,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":70967,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"55'172","reported_seq":309,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859717+0000","last_change":"2024-04-25T22:51:53.029210+0000","last_active":"2024-04-25T22:55:41.859717+0000","last_peered":"2024-04-25T22:55:41.859717+0000","last_clean":"2024-04-25T22:55:41.859717+0000","last_became_active":"2024-04-25T22:51:53.028635+0000","last_became_peered":"2024-04-25T22:51:53.028635+0000","last_unstale":"2024-04-25T22:55:41.859717+0000","last_undegraded":"2024-04-25T22:55:41.859717+0000","last_fullsized":"2024-04-25T22:55:41.859717+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:41.205051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":440592,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"50'1","reported_seq":48,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535599+0000","last_change":"2024-04-25T22:55:27.516136+0000","last_active":"2024-04-25T22:55:41.535599+0000","last_peered":"2024-04-25T22:55:41.535599+0000","last_clean":"2024-04-25T22:55:41.535599+0000","last_became_active":"2024-04-25T22:55:27.515473+0000","last_became_peered":"2024-04-25T22:55:27.515473+0000","last_unstale":"2024-04-25T22:55:41.535599+0000","last_undegraded":"2024-04-25T22:55:41.535599+0000","last_fullsized":"2024-04-25T22:55:41.535599+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:51:59.771248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"55'151","reported_seq":250,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536783+0000","last_change":"2024-04-25T22:55:34.513243+0000","last_active":"2024-04-25T22:55:41.536783+0000","last_peered":"2024-04-25T22:55:41.536783+0000","last_clean":"2024-04-25T22:55:41.536783+0000","last_became_active":"2024-04-25T22:55:34.512137+0000","last_became_peered":"2024-04-25T22:55:34.512137+0000","last_unstale":"2024-04-25T22:55:41.536783+0000","last_undegraded":"2024-04-25T22:55:41.536783+0000","last_fullsized":"2024-04-25T22:55:41.536783+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:06:40.451167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106917,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":97731,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":76,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535673+0000","last_change":"2024-04-25T22:55:37.514177+0000","last_active":"2024-04-25T22:55:41.535673+0000","last_peered":"2024-04-25T22:55:41.535673+0000","last_clean":"2024-04-25T22:55:41.535673+0000","last_became_active":"2024-04-25T22:55:37.513925+0000","last_became_peered":"2024-04-25T22:55:37.513925+0000","last_unstale":"2024-04-25T22:55:41.535673+0000","last_undegraded":"2024-04-25T22:55:41.535673+0000","last_fullsized":"2024-04-25T22:55:41.535673+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:12:09.421061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"55'203","reported_seq":340,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859317+0000","last_change":"2024-04-25T22:51:53.028084+0000","last_active":"2024-04-25T22:55:41.859317+0000","last_peered":"2024-04-25T22:55:41.859317+0000","last_clean":"2024-04-25T22:55:41.859317+0000","last_became_active":"2024-04-25T22:51:53.027541+0000","last_became_peered":"2024-04-25T22:51:53.027541+0000","last_unstale":"2024-04-25T22:55:41.859317+0000","last_undegraded":"2024-04-25T22:55:41.859317+0000","last_fullsized":"2024-04-25T22:55:41.859317+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:28:42.903045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195653,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"48'2","reported_seq":153,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859141+0000","last_change":"2024-04-25T22:55:27.541798+0000","last_active":"2024-04-25T22:55:41.859141+0000","last_peered":"2024-04-25T22:55:41.859141+0000","last_clean":"2024-04-25T22:55:41.859141+0000","last_became_active":"2024-04-25T22:55:27.517718+0000","last_became_peered":"2024-04-25T22:55:27.517718+0000","last_unstale":"2024-04-25T22:55:41.859141+0000","last_undegraded":"2024-04-25T22:55:41.859141+0000","last_fullsized":"2024-04-25T22:55:41.859141+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:48:57.633186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"55'168","reported_seq":524,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858951+0000","last_change":"2024-04-25T22:55:34.514499+0000","last_active":"2024-04-25T22:55:41.858951+0000","last_peered":"2024-04-25T22:55:41.858951+0000","last_clean":"2024-04-25T22:55:41.858951+0000","last_became_active":"2024-04-25T22:55:34.513433+0000","last_became_peered":"2024-04-25T22:55:34.513433+0000","last_unstale":"2024-04-25T22:55:41.858951+0000","last_undegraded":"2024-04-25T22:55:41.858951+0000","last_fullsized":"2024-04-25T22:55:41.858951+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:58:08.177184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151921,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":151921,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"47'5","reported_seq":170,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859179+0000","last_change":"2024-04-25T22:55:37.559449+0000","last_active":"2024-04-25T22:55:41.859179+0000","last_peered":"2024-04-25T22:55:41.859179+0000","last_clean":"2024-04-25T22:55:41.859179+0000","last_became_active":"2024-04-25T22:55:37.516119+0000","last_became_peered":"2024-04-25T22:55:37.516119+0000","last_unstale":"2024-04-25T22:55:41.859179+0000","last_undegraded":"2024-04-25T22:55:41.859179+0000","last_fullsized":"2024-04-25T22:55:41.859179+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:25:42.548782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"55'166","reported_seq":505,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535835+0000","last_change":"2024-04-25T22:55:38.518734+0000","last_active":"2024-04-25T22:55:41.535835+0000","last_peered":"2024-04-25T22:55:41.535835+0000","last_clean":"2024-04-25T22:55:41.535835+0000","last_became_active":"2024-04-25T22:55:38.516260+0000","last_became_peered":"2024-04-25T22:55:38.516260+0000","last_unstale":"2024-04-25T22:55:41.535835+0000","last_undegraded":"2024-04-25T22:55:41.535835+0000","last_fullsized":"2024-04-25T22:55:41.535835+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:25:43.553244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3798024,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":3871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":3798024,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535940+0000","last_change":"2024-04-25T22:55:38.520672+0000","last_active":"2024-04-25T22:55:41.535940+0000","last_peered":"2024-04-25T22:55:41.535940+0000","last_clean":"2024-04-25T22:55:41.535940+0000","last_became_active":"2024-04-25T22:55:38.515776+0000","last_became_peered":"2024-04-25T22:55:38.515776+0000","last_unstale":"2024-04-25T22:55:41.535940+0000","last_undegraded":"2024-04-25T22:55:41.535940+0000","last_fullsized":"2024-04-25T22:55:41.535940+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:53.584300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"55'158","reported_seq":495,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536078+0000","last_change":"2024-04-25T22:55:38.516465+0000","last_active":"2024-04-25T22:55:41.536078+0000","last_peered":"2024-04-25T22:55:41.536078+0000","last_clean":"2024-04-25T22:55:41.536078+0000","last_became_active":"2024-04-25T22:55:38.514732+0000","last_became_peered":"2024-04-25T22:55:38.514732+0000","last_unstale":"2024-04-25T22:55:41.536078+0000","last_undegraded":"2024-04-25T22:55:41.536078+0000","last_fullsized":"2024-04-25T22:55:41.536078+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:42:09.860717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141656,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":141656,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"50'57","reported_seq":196,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859521+0000","last_change":"2024-04-25T22:51:52.019032+0000","last_active":"2024-04-25T22:55:41.859521+0000","last_peered":"2024-04-25T22:55:41.859521+0000","last_clean":"2024-04-25T22:55:41.859521+0000","last_became_active":"2024-04-25T22:51:52.018547+0000","last_became_peered":"2024-04-25T22:51:52.018547+0000","last_unstale":"2024-04-25T22:55:41.859521+0000","last_undegraded":"2024-04-25T22:55:41.859521+0000","last_fullsized":"2024-04-25T22:55:41.859521+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:10:00.056491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":8213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"55'169","reported_seq":535,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859326+0000","last_change":"2024-04-25T22:55:35.518155+0000","last_active":"2024-04-25T22:55:41.859326+0000","last_peered":"2024-04-25T22:55:41.859326+0000","last_clean":"2024-04-25T22:55:41.859326+0000","last_became_active":"2024-04-25T22:55:35.517149+0000","last_became_peered":"2024-04-25T22:55:35.517149+0000","last_unstale":"2024-04-25T22:55:41.859326+0000","last_undegraded":"2024-04-25T22:55:41.859326+0000","last_fullsized":"2024-04-25T22:55:41.859326+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:50.123900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184603,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":194,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":166098,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"48'25","reported_seq":56,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536897+0000","last_change":"2024-04-25T22:55:27.586742+0000","last_active":"2024-04-25T22:55:41.536897+0000","last_peered":"2024-04-25T22:55:41.536897+0000","last_clean":"2024-04-25T22:55:41.536897+0000","last_became_active":"2024-04-25T22:55:27.520617+0000","last_became_peered":"2024-04-25T22:55:27.520617+0000","last_unstale":"2024-04-25T22:55:41.536897+0000","last_undegraded":"2024-04-25T22:55:41.536897+0000","last_fullsized":"2024-04-25T22:55:41.536897+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:58:12.148059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"55'196","reported_seq":594,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535817+0000","last_change":"2024-04-25T22:55:31.526793+0000","last_active":"2024-04-25T22:55:41.535817+0000","last_peered":"2024-04-25T22:55:41.535817+0000","last_clean":"2024-04-25T22:55:41.535817+0000","last_became_active":"2024-04-25T22:55:31.526322+0000","last_became_peered":"2024-04-25T22:55:31.526322+0000","last_unstale":"2024-04-25T22:55:41.535817+0000","last_undegraded":"2024-04-25T22:55:41.535817+0000","last_fullsized":"2024-04-25T22:55:41.535817+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:58.561902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200980,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":211,"num_write_kb":410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":126,"num_bytes_recovered":197679,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"48'7","reported_seq":98,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536679+0000","last_change":"2024-04-25T22:55:37.541050+0000","last_active":"2024-04-25T22:55:41.536679+0000","last_peered":"2024-04-25T22:55:41.536679+0000","last_clean":"2024-04-25T22:55:41.536679+0000","last_became_active":"2024-04-25T22:55:37.516183+0000","last_became_peered":"2024-04-25T22:55:37.516183+0000","last_unstale":"2024-04-25T22:55:41.536679+0000","last_undegraded":"2024-04-25T22:55:41.536679+0000","last_fullsized":"2024-04-25T22:55:41.536679+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:30.075399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8389190,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26691649,"num_objects":3448,"num_object_clones":0,"num_object_copies":6896,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3448,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10583,"num_write_kb":38991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4953,"num_bytes_recovered":24173691,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73056256,"data_stored":53061590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10415,"ondisk_log_size":10415,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":40502861,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":34,"num_read_kb":343,"num_write":470,"num_write_kb":40224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":32113365,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":81068032,"data_stored":81005722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5351,"internal_metadata":0},"log_size":434,"ondisk_log_size":434,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738419,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84816,"kb_used_data":49476,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94287024,"statfs":{"total":96636764160,"available":96549912576,"internally_reserved":0,"allocated":50663424,"data_stored":43767232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":62,"seq":266287972358,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85248,"kb_used_data":45232,"kb_used_omap":6,"kb_used_meta":39993,"kb_avail":94286592,"statfs":{"total":96636764160,"available":96549470208,"internally_reserved":0,"allocated":46317568,"data_stored":38899263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6946,"internal_metadata":40953054},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738419,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":102580,"kb_used_data":58912,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94269260,"statfs":{"total":96636764160,"available":96531722240,"internally_reserved":0,"allocated":60325888,"data_stored":53539649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32145408,"data_stored":32114253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19542016,"data_stored":19530487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5351,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":29380608,"data_stored":29360982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":26918912,"data_stored":20514252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26107904,"data_stored":19048000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20029440,"data_stored":13499338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:55:47.475 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:55:47.807 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:55:47.807 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":77,"fsid":"5355b70e-3f7d-4bce-8676-89cee61d2089","created":"2024-04-25T22:51:37.688525+0000","modified":"2024-04-25T22:55:41.532205+0000","last_up_change":"2024-04-25T22:55:26.505414+0000","last_in_change":"2024-04-25T22:51:38.491924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:51:45.966439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:51:46.128416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:51:50.648525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:51:51.351497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b785a86a-6391-4a0d-8aec-c2016380832e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6801","nonce":3666753097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6803","nonce":3666753097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6807","nonce":3666753097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6805","nonce":3666753097}]},"public_addr":"172.21.15.110:6801/3666753097","cluster_addr":"172.21.15.110:6803/3666753097","heartbeat_back_addr":"172.21.15.110:6807/3666753097","heartbeat_front_addr":"172.21.15.110:6805/3666753097","state":["exists","up"]},{"osd":1,"uuid":"088b4733-ccbd-41a6-8a31-8d811169c28a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":26,"up_from":62,"up_thru":75,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2239032021},{"type":"v1","addr":"172.21.15.164:6801","nonce":2239032021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2239032021},{"type":"v1","addr":"172.21.15.164:6803","nonce":2239032021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2239032021},{"type":"v1","addr":"172.21.15.164:6807","nonce":2239032021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2239032021},{"type":"v1","addr":"172.21.15.164:6805","nonce":2239032021}]},"public_addr":"172.21.15.164:6801/2239032021","cluster_addr":"172.21.15.164:6803/2239032021","heartbeat_back_addr":"172.21.15.164:6807/2239032021","heartbeat_front_addr":"172.21.15.164:6805/2239032021","state":["exists","up"]},{"osd":2,"uuid":"6a6aad8c-22ac-45c0-baf9-928314e7fef9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6801","nonce":349040881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6803","nonce":349040881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6807","nonce":349040881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6805","nonce":349040881}]},"public_addr":"172.21.15.191:6801/349040881","cluster_addr":"172.21.15.191:6803/349040881","heartbeat_back_addr":"172.21.15.191:6807/349040881","heartbeat_front_addr":"172.21.15.191:6805/349040881","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:51:43.531709+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:51:43.589701+0000","dead_epoch":26},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:51:43.566226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:55:48.821 INFO:tasks.ceph:Scrubbing osd.0 2024-04-25T22:55:48.821 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-25T22:55:48.961 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-04-25T22:55:48.962 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T22:55:48.962 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-04-25T22:55:48.973 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-25T22:55:49.268 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 0 to deep-scrub 2024-04-25T22:55:49.282 INFO:tasks.ceph:Scrubbing osd.1 2024-04-25T22:55:49.282 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-25T22:55:49.408 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-04-25T22:55:49.409 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-04-25T22:55:49.409 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-04-25T22:55:49.420 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-25T22:55:49.720 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 1 to deep-scrub 2024-04-25T22:55:49.734 INFO:tasks.ceph:Scrubbing osd.2 2024-04-25T22:55:49.734 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-25T22:55:49.860 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-04-25T22:55:49.860 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T22:55:49.861 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-04-25T22:55:49.871 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-25T22:55:50.171 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 2 to deep-scrub 2024-04-25T22:55:50.185 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:55:50.483 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:55:50.485 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-25T22:55:50.495 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":197,"stamp":"2024-04-25T22:55:49.988229+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":67784878,"num_objects":3482,"num_object_clones":0,"num_object_copies":6964,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3482,"num_whiteouts":0,"num_read":170,"num_read_kb":461,"num_write":11256,"num_write_kb":82675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4966,"num_bytes_recovered":56287056,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11006,"ondisk_log_size":11006,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":272656,"kb_used_data":153628,"kb_used_omap":9,"kb_used_meta":118966,"kb_avail":282842864,"statfs":{"total":289910292480,"available":289631092736,"internally_reserved":0,"allocated":157315072,"data_stored":136210376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10136,"internal_metadata":121821288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":209,"num_bytes_recovered":9238667,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.455305"},"pg_stats":[{"pgid":"4.3f","version":"55'160","reported_seq":516,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859594+0000","last_change":"2024-04-25T22:55:34.515388+0000","last_active":"2024-04-25T22:55:41.859594+0000","last_peered":"2024-04-25T22:55:41.859594+0000","last_clean":"2024-04-25T22:55:41.859594+0000","last_became_active":"2024-04-25T22:55:34.514302+0000","last_became_peered":"2024-04-25T22:55:34.514302+0000","last_unstale":"2024-04-25T22:55:41.859594+0000","last_undegraded":"2024-04-25T22:55:41.859594+0000","last_fullsized":"2024-04-25T22:55:41.859594+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:08:19.339484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168293,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":168293,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"55'153","reported_seq":495,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859178+0000","last_change":"2024-04-25T22:55:35.519132+0000","last_active":"2024-04-25T22:55:41.859178+0000","last_peered":"2024-04-25T22:55:41.859178+0000","last_clean":"2024-04-25T22:55:41.859178+0000","last_became_active":"2024-04-25T22:55:35.517561+0000","last_became_peered":"2024-04-25T22:55:35.517561+0000","last_unstale":"2024-04-25T22:55:41.859178+0000","last_undegraded":"2024-04-25T22:55:41.859178+0000","last_fullsized":"2024-04-25T22:55:41.859178+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:02:40.268992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286387,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":286387,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"55'164","reported_seq":238,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536366+0000","last_change":"2024-04-25T22:55:38.519244+0000","last_active":"2024-04-25T22:55:41.536366+0000","last_peered":"2024-04-25T22:55:41.536366+0000","last_clean":"2024-04-25T22:55:41.536366+0000","last_became_active":"2024-04-25T22:55:38.517874+0000","last_became_peered":"2024-04-25T22:55:38.517874+0000","last_unstale":"2024-04-25T22:55:41.536366+0000","last_undegraded":"2024-04-25T22:55:41.536366+0000","last_fullsized":"2024-04-25T22:55:41.536366+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:45:27.635067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130188,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"55'126","reported_seq":423,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536210+0000","last_change":"2024-04-25T22:55:38.516209+0000","last_active":"2024-04-25T22:55:41.536210+0000","last_peered":"2024-04-25T22:55:41.536210+0000","last_clean":"2024-04-25T22:55:41.536210+0000","last_became_active":"2024-04-25T22:55:38.513558+0000","last_became_peered":"2024-04-25T22:55:38.513558+0000","last_unstale":"2024-04-25T22:55:41.536210+0000","last_undegraded":"2024-04-25T22:55:41.536210+0000","last_fullsized":"2024-04-25T22:55:41.536210+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:50.123900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142819,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":135761,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"55'173","reported_seq":559,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859149+0000","last_change":"2024-04-25T22:55:35.517931+0000","last_active":"2024-04-25T22:55:41.859149+0000","last_peered":"2024-04-25T22:55:41.859149+0000","last_clean":"2024-04-25T22:55:41.859149+0000","last_became_active":"2024-04-25T22:55:35.517044+0000","last_became_peered":"2024-04-25T22:55:35.517044+0000","last_unstale":"2024-04-25T22:55:41.859149+0000","last_undegraded":"2024-04-25T22:55:41.859149+0000","last_fullsized":"2024-04-25T22:55:41.859149+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:42.118131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":709662,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":119,"num_bytes_recovered":709653,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"55'173","reported_seq":516,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535750+0000","last_change":"2024-04-25T22:55:38.515187+0000","last_active":"2024-04-25T22:55:41.535750+0000","last_peered":"2024-04-25T22:55:41.535750+0000","last_clean":"2024-04-25T22:55:41.535750+0000","last_became_active":"2024-04-25T22:55:38.513456+0000","last_became_peered":"2024-04-25T22:55:38.513456+0000","last_unstale":"2024-04-25T22:55:41.535750+0000","last_undegraded":"2024-04-25T22:55:41.535750+0000","last_fullsized":"2024-04-25T22:55:41.535750+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:08:19.339484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569466,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":569466,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"55'173","reported_seq":541,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535869+0000","last_change":"2024-04-25T22:55:33.512839+0000","last_active":"2024-04-25T22:55:41.535869+0000","last_peered":"2024-04-25T22:55:41.535869+0000","last_clean":"2024-04-25T22:55:41.535869+0000","last_became_active":"2024-04-25T22:55:33.511961+0000","last_became_peered":"2024-04-25T22:55:33.511961+0000","last_unstale":"2024-04-25T22:55:41.535869+0000","last_undegraded":"2024-04-25T22:55:41.535869+0000","last_fullsized":"2024-04-25T22:55:41.535869+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:54:45.619674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75460,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":111,"num_bytes_recovered":75460,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"55'140","reported_seq":456,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535457+0000","last_change":"2024-04-25T22:55:32.510322+0000","last_active":"2024-04-25T22:55:41.535457+0000","last_peered":"2024-04-25T22:55:41.535457+0000","last_clean":"2024-04-25T22:55:41.535457+0000","last_became_active":"2024-04-25T22:55:32.509908+0000","last_became_peered":"2024-04-25T22:55:32.509908+0000","last_unstale":"2024-04-25T22:55:41.535457+0000","last_undegraded":"2024-04-25T22:55:41.535457+0000","last_fullsized":"2024-04-25T22:55:41.535457+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:16:15.948780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":214453,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":214404,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"55'169","reported_seq":274,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536936+0000","last_change":"2024-04-25T22:55:32.513084+0000","last_active":"2024-04-25T22:55:41.536936+0000","last_peered":"2024-04-25T22:55:41.536936+0000","last_clean":"2024-04-25T22:55:41.536936+0000","last_became_active":"2024-04-25T22:55:32.512447+0000","last_became_peered":"2024-04-25T22:55:32.512447+0000","last_unstale":"2024-04-25T22:55:41.536936+0000","last_undegraded":"2024-04-25T22:55:41.536936+0000","last_fullsized":"2024-04-25T22:55:41.536936+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:16:27.593679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":538374,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":538374,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"55'153","reported_seq":483,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859293+0000","last_change":"2024-04-25T22:55:35.518293+0000","last_active":"2024-04-25T22:55:41.859293+0000","last_peered":"2024-04-25T22:55:41.859293+0000","last_clean":"2024-04-25T22:55:41.859293+0000","last_became_active":"2024-04-25T22:55:35.517506+0000","last_became_peered":"2024-04-25T22:55:35.517506+0000","last_unstale":"2024-04-25T22:55:41.859293+0000","last_undegraded":"2024-04-25T22:55:41.859293+0000","last_fullsized":"2024-04-25T22:55:41.859293+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:42:09.860717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130447,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":123390,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"55'154","reported_seq":258,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536002+0000","last_change":"2024-04-25T22:55:40.538872+0000","last_active":"2024-04-25T22:55:41.536002+0000","last_peered":"2024-04-25T22:55:41.536002+0000","last_clean":"2024-04-25T22:55:41.536002+0000","last_became_active":"2024-04-25T22:55:40.538052+0000","last_became_peered":"2024-04-25T22:55:40.538052+0000","last_unstale":"2024-04-25T22:55:41.536002+0000","last_undegraded":"2024-04-25T22:55:41.536002+0000","last_fullsized":"2024-04-25T22:55:41.536002+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:06.239983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":343806,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":208,"num_bytes_recovered":687612,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"55'141","reported_seq":278,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858898+0000","last_change":"2024-04-25T22:51:53.028006+0000","last_active":"2024-04-25T22:55:41.858898+0000","last_peered":"2024-04-25T22:55:41.858898+0000","last_clean":"2024-04-25T22:55:41.858898+0000","last_became_active":"2024-04-25T22:51:53.027363+0000","last_became_peered":"2024-04-25T22:51:53.027363+0000","last_unstale":"2024-04-25T22:55:41.858898+0000","last_undegraded":"2024-04-25T22:55:41.858898+0000","last_fullsized":"2024-04-25T22:55:41.858898+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:02:32.923620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125409,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"55'135","reported_seq":459,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858862+0000","last_change":"2024-04-25T22:55:33.512249+0000","last_active":"2024-04-25T22:55:41.858862+0000","last_peered":"2024-04-25T22:55:41.858862+0000","last_clean":"2024-04-25T22:55:41.858862+0000","last_became_active":"2024-04-25T22:55:33.511546+0000","last_became_peered":"2024-04-25T22:55:33.511546+0000","last_unstale":"2024-04-25T22:55:41.858862+0000","last_undegraded":"2024-04-25T22:55:41.858862+0000","last_fullsized":"2024-04-25T22:55:41.858862+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:52:41.758279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":183835,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":183835,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"55'179","reported_seq":314,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535808+0000","last_change":"2024-04-25T22:51:53.022367+0000","last_active":"2024-04-25T22:55:41.535808+0000","last_peered":"2024-04-25T22:55:41.535808+0000","last_clean":"2024-04-25T22:55:41.535808+0000","last_became_active":"2024-04-25T22:51:53.021902+0000","last_became_peered":"2024-04-25T22:51:53.021902+0000","last_unstale":"2024-04-25T22:55:41.535808+0000","last_undegraded":"2024-04-25T22:55:41.535808+0000","last_fullsized":"2024-04-25T22:55:41.535808+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:44:59.401139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153371,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":181,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"55'161","reported_seq":273,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535564+0000","last_change":"2024-04-25T22:55:40.539371+0000","last_active":"2024-04-25T22:55:41.535564+0000","last_peered":"2024-04-25T22:55:41.535564+0000","last_clean":"2024-04-25T22:55:41.535564+0000","last_became_active":"2024-04-25T22:55:40.538095+0000","last_became_peered":"2024-04-25T22:55:40.538095+0000","last_unstale":"2024-04-25T22:55:41.535564+0000","last_undegraded":"2024-04-25T22:55:41.535564+0000","last_fullsized":"2024-04-25T22:55:41.535564+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:13:57.514231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4276239,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":4418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":4276214,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"55'179","reported_seq":551,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535530+0000","last_change":"2024-04-25T22:55:31.526766+0000","last_active":"2024-04-25T22:55:41.535530+0000","last_peered":"2024-04-25T22:55:41.535530+0000","last_clean":"2024-04-25T22:55:41.535530+0000","last_became_active":"2024-04-25T22:55:31.526271+0000","last_became_peered":"2024-04-25T22:55:31.526271+0000","last_unstale":"2024-04-25T22:55:41.535530+0000","last_undegraded":"2024-04-25T22:55:41.535530+0000","last_fullsized":"2024-04-25T22:55:41.535530+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:48:39.183880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4371943,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":4513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":4363238,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"55'163","reported_seq":268,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536806+0000","last_change":"2024-04-25T22:55:32.513240+0000","last_active":"2024-04-25T22:55:41.536806+0000","last_peered":"2024-04-25T22:55:41.536806+0000","last_clean":"2024-04-25T22:55:41.536806+0000","last_became_active":"2024-04-25T22:55:32.512371+0000","last_became_peered":"2024-04-25T22:55:32.512371+0000","last_unstale":"2024-04-25T22:55:41.536806+0000","last_undegraded":"2024-04-25T22:55:41.536806+0000","last_fullsized":"2024-04-25T22:55:41.536806+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:23.735382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96221,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":87110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"55'147","reported_seq":487,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859496+0000","last_change":"2024-04-25T22:55:35.519379+0000","last_active":"2024-04-25T22:55:41.859496+0000","last_peered":"2024-04-25T22:55:41.859496+0000","last_clean":"2024-04-25T22:55:41.859496+0000","last_became_active":"2024-04-25T22:55:35.518584+0000","last_became_peered":"2024-04-25T22:55:35.518584+0000","last_unstale":"2024-04-25T22:55:41.859496+0000","last_undegraded":"2024-04-25T22:55:41.859496+0000","last_fullsized":"2024-04-25T22:55:41.859496+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:33:50.992444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1432264,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":1532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":1432241,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"55'146","reported_seq":255,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536568+0000","last_change":"2024-04-25T22:55:30.527560+0000","last_active":"2024-04-25T22:55:41.536568+0000","last_peered":"2024-04-25T22:55:41.536568+0000","last_clean":"2024-04-25T22:55:41.536568+0000","last_became_active":"2024-04-25T22:55:30.526745+0000","last_became_peered":"2024-04-25T22:55:30.526745+0000","last_unstale":"2024-04-25T22:55:41.536568+0000","last_undegraded":"2024-04-25T22:55:41.536568+0000","last_fullsized":"2024-04-25T22:55:41.536568+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:40:08.494734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112933,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":112933,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"55'178","reported_seq":548,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536195+0000","last_change":"2024-04-25T22:55:34.512671+0000","last_active":"2024-04-25T22:55:41.536195+0000","last_peered":"2024-04-25T22:55:41.536195+0000","last_clean":"2024-04-25T22:55:41.536195+0000","last_became_active":"2024-04-25T22:55:34.511872+0000","last_became_peered":"2024-04-25T22:55:34.511872+0000","last_unstale":"2024-04-25T22:55:41.536195+0000","last_undegraded":"2024-04-25T22:55:41.536195+0000","last_fullsized":"2024-04-25T22:55:41.536195+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:43:12.293070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124334,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":124334,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"55'158","reported_seq":500,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535980+0000","last_change":"2024-04-25T22:55:34.512430+0000","last_active":"2024-04-25T22:55:41.535980+0000","last_peered":"2024-04-25T22:55:41.535980+0000","last_clean":"2024-04-25T22:55:41.535980+0000","last_became_active":"2024-04-25T22:55:34.511833+0000","last_became_peered":"2024-04-25T22:55:34.511833+0000","last_unstale":"2024-04-25T22:55:41.535980+0000","last_undegraded":"2024-04-25T22:55:41.535980+0000","last_fullsized":"2024-04-25T22:55:41.535980+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:52:03.534174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145029,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":145029,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"55'171","reported_seq":308,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858838+0000","last_change":"2024-04-25T22:51:53.026746+0000","last_active":"2024-04-25T22:55:41.858838+0000","last_peered":"2024-04-25T22:55:41.858838+0000","last_clean":"2024-04-25T22:55:41.858838+0000","last_became_active":"2024-04-25T22:51:53.025938+0000","last_became_peered":"2024-04-25T22:51:53.025938+0000","last_unstale":"2024-04-25T22:55:41.858838+0000","last_undegraded":"2024-04-25T22:55:41.858838+0000","last_fullsized":"2024-04-25T22:55:41.858838+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:38:03.428258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115019,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"55'161","reported_seq":262,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535818+0000","last_change":"2024-04-25T22:55:33.513307+0000","last_active":"2024-04-25T22:55:41.535818+0000","last_peered":"2024-04-25T22:55:41.535818+0000","last_clean":"2024-04-25T22:55:41.535818+0000","last_became_active":"2024-04-25T22:55:33.512160+0000","last_became_peered":"2024-04-25T22:55:33.512160+0000","last_unstale":"2024-04-25T22:55:41.535818+0000","last_undegraded":"2024-04-25T22:55:41.535818+0000","last_fullsized":"2024-04-25T22:55:41.535818+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:57:16.042728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":641227,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":641227,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"55'169","reported_seq":525,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858515+0000","last_change":"2024-04-25T22:55:33.512249+0000","last_active":"2024-04-25T22:55:41.858515+0000","last_peered":"2024-04-25T22:55:41.858515+0000","last_clean":"2024-04-25T22:55:41.858515+0000","last_became_active":"2024-04-25T22:55:33.511463+0000","last_became_peered":"2024-04-25T22:55:33.511463+0000","last_unstale":"2024-04-25T22:55:41.858515+0000","last_undegraded":"2024-04-25T22:55:41.858515+0000","last_fullsized":"2024-04-25T22:55:41.858515+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:54:45.619674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103634,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":189,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":98869,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"55'159","reported_seq":296,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859682+0000","last_change":"2024-04-25T22:51:53.028155+0000","last_active":"2024-04-25T22:55:41.859682+0000","last_peered":"2024-04-25T22:55:41.859682+0000","last_clean":"2024-04-25T22:55:41.859682+0000","last_became_active":"2024-04-25T22:51:53.027867+0000","last_became_peered":"2024-04-25T22:51:53.027867+0000","last_unstale":"2024-04-25T22:55:41.859682+0000","last_undegraded":"2024-04-25T22:55:41.859682+0000","last_fullsized":"2024-04-25T22:55:41.859682+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:43:47.453569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272252,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"55'190","reported_seq":289,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536880+0000","last_change":"2024-04-25T22:55:34.513270+0000","last_active":"2024-04-25T22:55:41.536880+0000","last_peered":"2024-04-25T22:55:41.536880+0000","last_clean":"2024-04-25T22:55:41.536880+0000","last_became_active":"2024-04-25T22:55:34.512320+0000","last_became_peered":"2024-04-25T22:55:34.512320+0000","last_unstale":"2024-04-25T22:55:41.536880+0000","last_undegraded":"2024-04-25T22:55:41.536880+0000","last_fullsized":"2024-04-25T22:55:41.536880+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:37.486013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126403,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":117,"num_bytes_recovered":126342,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"55'151","reported_seq":286,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536427+0000","last_change":"2024-04-25T22:51:53.022893+0000","last_active":"2024-04-25T22:55:41.536427+0000","last_peered":"2024-04-25T22:55:41.536427+0000","last_clean":"2024-04-25T22:55:41.536427+0000","last_became_active":"2024-04-25T22:51:53.022407+0000","last_became_peered":"2024-04-25T22:51:53.022407+0000","last_unstale":"2024-04-25T22:55:41.536427+0000","last_undegraded":"2024-04-25T22:55:41.536427+0000","last_fullsized":"2024-04-25T22:55:41.536427+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:08:44.404718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69245,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"55'147","reported_seq":284,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859212+0000","last_change":"2024-04-25T22:51:53.028447+0000","last_active":"2024-04-25T22:55:41.859212+0000","last_peered":"2024-04-25T22:55:41.859212+0000","last_clean":"2024-04-25T22:55:41.859212+0000","last_became_active":"2024-04-25T22:51:53.027852+0000","last_became_peered":"2024-04-25T22:51:53.027852+0000","last_unstale":"2024-04-25T22:55:41.859212+0000","last_undegraded":"2024-04-25T22:55:41.859212+0000","last_fullsized":"2024-04-25T22:55:41.859212+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:16.187194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192848,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"55'166","reported_seq":267,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535904+0000","last_change":"2024-04-25T22:55:34.514981+0000","last_active":"2024-04-25T22:55:41.535904+0000","last_peered":"2024-04-25T22:55:41.535904+0000","last_clean":"2024-04-25T22:55:41.535904+0000","last_became_active":"2024-04-25T22:55:34.514067+0000","last_became_peered":"2024-04-25T22:55:34.514067+0000","last_unstale":"2024-04-25T22:55:41.535904+0000","last_undegraded":"2024-04-25T22:55:41.535904+0000","last_fullsized":"2024-04-25T22:55:41.535904+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:05:49.273497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239074,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":239074,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"55'191","reported_seq":328,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859081+0000","last_change":"2024-04-25T22:51:53.026997+0000","last_active":"2024-04-25T22:55:41.859081+0000","last_peered":"2024-04-25T22:55:41.859081+0000","last_clean":"2024-04-25T22:55:41.859081+0000","last_became_active":"2024-04-25T22:51:53.026379+0000","last_became_peered":"2024-04-25T22:51:53.026379+0000","last_unstale":"2024-04-25T22:55:41.859081+0000","last_undegraded":"2024-04-25T22:55:41.859081+0000","last_fullsized":"2024-04-25T22:55:41.859081+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:33:24.700106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99668,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"55'193","reported_seq":298,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536272+0000","last_change":"2024-04-25T22:55:32.511886+0000","last_active":"2024-04-25T22:55:41.536272+0000","last_peered":"2024-04-25T22:55:41.536272+0000","last_clean":"2024-04-25T22:55:41.536272+0000","last_became_active":"2024-04-25T22:55:32.509978+0000","last_became_peered":"2024-04-25T22:55:32.509978+0000","last_unstale":"2024-04-25T22:55:41.536272+0000","last_undegraded":"2024-04-25T22:55:41.536272+0000","last_fullsized":"2024-04-25T22:55:41.536272+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:56:47.747527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128069,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":128069,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"55'182","reported_seq":537,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535588+0000","last_change":"2024-04-25T22:55:38.519451+0000","last_active":"2024-04-25T22:55:41.535588+0000","last_peered":"2024-04-25T22:55:41.535588+0000","last_clean":"2024-04-25T22:55:41.535588+0000","last_became_active":"2024-04-25T22:55:38.518412+0000","last_became_peered":"2024-04-25T22:55:38.518412+0000","last_unstale":"2024-04-25T22:55:41.535588+0000","last_undegraded":"2024-04-25T22:55:41.535588+0000","last_fullsized":"2024-04-25T22:55:41.535588+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:27.179735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":586629,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":580754,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"55'156","reported_seq":494,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859060+0000","last_change":"2024-04-25T22:55:33.512918+0000","last_active":"2024-04-25T22:55:41.859060+0000","last_peered":"2024-04-25T22:55:41.859060+0000","last_clean":"2024-04-25T22:55:41.859060+0000","last_became_active":"2024-04-25T22:55:33.512114+0000","last_became_peered":"2024-04-25T22:55:33.512114+0000","last_unstale":"2024-04-25T22:55:41.859060+0000","last_undegraded":"2024-04-25T22:55:41.859060+0000","last_fullsized":"2024-04-25T22:55:41.859060+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:52:03.534174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118861,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":118861,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"60'105","reported_seq":256,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536115+0000","last_change":"2024-04-25T22:55:30.526027+0000","last_active":"2024-04-25T22:55:41.536115+0000","last_peered":"2024-04-25T22:55:41.536115+0000","last_clean":"2024-04-25T22:55:41.536115+0000","last_became_active":"2024-04-25T22:55:30.525469+0000","last_became_peered":"2024-04-25T22:55:30.525469+0000","last_unstale":"2024-04-25T22:55:41.536115+0000","last_undegraded":"2024-04-25T22:55:41.536115+0000","last_fullsized":"2024-04-25T22:55:41.536115+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:18:16.878967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2425045,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":2428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":2425011,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"55'146","reported_seq":472,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859394+0000","last_change":"2024-04-25T22:55:30.525674+0000","last_active":"2024-04-25T22:55:41.859394+0000","last_peered":"2024-04-25T22:55:41.859394+0000","last_clean":"2024-04-25T22:55:41.859394+0000","last_became_active":"2024-04-25T22:55:30.524718+0000","last_became_peered":"2024-04-25T22:55:30.524718+0000","last_unstale":"2024-04-25T22:55:41.859394+0000","last_undegraded":"2024-04-25T22:55:41.859394+0000","last_fullsized":"2024-04-25T22:55:41.859394+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:48:39.183880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67079,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":89,"num_bytes_recovered":67079,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":48,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535977+0000","last_change":"2024-04-25T22:55:27.517626+0000","last_active":"2024-04-25T22:55:41.535977+0000","last_peered":"2024-04-25T22:55:41.535977+0000","last_clean":"2024-04-25T22:55:41.535977+0000","last_became_active":"2024-04-25T22:55:27.517208+0000","last_became_peered":"2024-04-25T22:55:27.517208+0000","last_unstale":"2024-04-25T22:55:41.535977+0000","last_undegraded":"2024-04-25T22:55:41.535977+0000","last_fullsized":"2024-04-25T22:55:41.535977+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:09.249311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"55'186","reported_seq":287,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536662+0000","last_change":"2024-04-25T22:55:33.513626+0000","last_active":"2024-04-25T22:55:41.536662+0000","last_peered":"2024-04-25T22:55:41.536662+0000","last_clean":"2024-04-25T22:55:41.536662+0000","last_became_active":"2024-04-25T22:55:33.512389+0000","last_became_peered":"2024-04-25T22:55:33.512389+0000","last_unstale":"2024-04-25T22:55:41.536662+0000","last_undegraded":"2024-04-25T22:55:41.536662+0000","last_fullsized":"2024-04-25T22:55:41.536662+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:02:53.672517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139986,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":137763,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":139,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859045+0000","last_change":"2024-04-25T22:51:52.018646+0000","last_active":"2024-04-25T22:55:41.859045+0000","last_peered":"2024-04-25T22:55:41.859045+0000","last_clean":"2024-04-25T22:55:41.859045+0000","last_became_active":"2024-04-25T22:51:52.018313+0000","last_became_peered":"2024-04-25T22:51:52.018313+0000","last_unstale":"2024-04-25T22:55:41.859045+0000","last_undegraded":"2024-04-25T22:55:41.859045+0000","last_fullsized":"2024-04-25T22:55:41.859045+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:00:21.688745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"55'167","reported_seq":274,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536676+0000","last_change":"2024-04-25T22:55:30.527435+0000","last_active":"2024-04-25T22:55:41.536676+0000","last_peered":"2024-04-25T22:55:41.536676+0000","last_clean":"2024-04-25T22:55:41.536676+0000","last_became_active":"2024-04-25T22:55:30.526276+0000","last_became_peered":"2024-04-25T22:55:30.526276+0000","last_unstale":"2024-04-25T22:55:41.536676+0000","last_undegraded":"2024-04-25T22:55:41.536676+0000","last_fullsized":"2024-04-25T22:55:41.536676+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:03:39.273168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87849,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":87849,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":145,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535666+0000","last_change":"2024-04-25T22:51:52.021510+0000","last_active":"2024-04-25T22:55:41.535666+0000","last_peered":"2024-04-25T22:55:41.535666+0000","last_clean":"2024-04-25T22:55:41.535666+0000","last_became_active":"2024-04-25T22:51:52.021145+0000","last_became_peered":"2024-04-25T22:51:52.021145+0000","last_unstale":"2024-04-25T22:55:41.535666+0000","last_undegraded":"2024-04-25T22:55:41.535666+0000","last_fullsized":"2024-04-25T22:55:41.535666+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:05.110747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"52'2","reported_seq":139,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536823+0000","last_change":"2024-04-25T22:51:52.021355+0000","last_active":"2024-04-25T22:55:41.536823+0000","last_peered":"2024-04-25T22:55:41.536823+0000","last_clean":"2024-04-25T22:55:41.536823+0000","last_became_active":"2024-04-25T22:51:52.020860+0000","last_became_peered":"2024-04-25T22:51:52.020860+0000","last_unstale":"2024-04-25T22:55:41.536823+0000","last_undegraded":"2024-04-25T22:55:41.536823+0000","last_fullsized":"2024-04-25T22:55:41.536823+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:55.235787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"55'157","reported_seq":294,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858543+0000","last_change":"2024-04-25T22:51:53.029390+0000","last_active":"2024-04-25T22:55:41.858543+0000","last_peered":"2024-04-25T22:55:41.858543+0000","last_clean":"2024-04-25T22:55:41.858543+0000","last_became_active":"2024-04-25T22:51:53.029157+0000","last_became_peered":"2024-04-25T22:51:53.029157+0000","last_unstale":"2024-04-25T22:55:41.858543+0000","last_undegraded":"2024-04-25T22:55:41.858543+0000","last_fullsized":"2024-04-25T22:55:41.858543+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:51:43.808994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190158,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"48'3","reported_seq":142,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859570+0000","last_change":"2024-04-25T22:51:52.018856+0000","last_active":"2024-04-25T22:55:41.859570+0000","last_peered":"2024-04-25T22:55:41.859570+0000","last_clean":"2024-04-25T22:55:41.859570+0000","last_became_active":"2024-04-25T22:51:52.018390+0000","last_became_peered":"2024-04-25T22:51:52.018390+0000","last_unstale":"2024-04-25T22:55:41.859570+0000","last_undegraded":"2024-04-25T22:55:41.859570+0000","last_fullsized":"2024-04-25T22:55:41.859570+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:42:54.430484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"55'171","reported_seq":539,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858599+0000","last_change":"2024-04-25T22:55:31.527677+0000","last_active":"2024-04-25T22:55:41.858599+0000","last_peered":"2024-04-25T22:55:41.858599+0000","last_clean":"2024-04-25T22:55:41.858599+0000","last_became_active":"2024-04-25T22:55:31.527049+0000","last_became_peered":"2024-04-25T22:55:31.527049+0000","last_unstale":"2024-04-25T22:55:41.858599+0000","last_undegraded":"2024-04-25T22:55:41.858599+0000","last_fullsized":"2024-04-25T22:55:41.858599+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:16:15.948780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":315325,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":191,"num_write_kb":549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":110,"num_bytes_recovered":301306,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":45,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536688+0000","last_change":"2024-04-25T22:55:38.519011+0000","last_active":"2024-04-25T22:55:41.536688+0000","last_peered":"2024-04-25T22:55:41.536688+0000","last_clean":"2024-04-25T22:55:41.536688+0000","last_became_active":"2024-04-25T22:55:38.517362+0000","last_became_peered":"2024-04-25T22:55:38.517362+0000","last_unstale":"2024-04-25T22:55:41.536688+0000","last_undegraded":"2024-04-25T22:55:41.536688+0000","last_fullsized":"2024-04-25T22:55:41.536688+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:30:15.580001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"55'153","reported_seq":486,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536056+0000","last_change":"2024-04-25T22:55:38.515892+0000","last_active":"2024-04-25T22:55:41.536056+0000","last_peered":"2024-04-25T22:55:41.536056+0000","last_clean":"2024-04-25T22:55:41.536056+0000","last_became_active":"2024-04-25T22:55:38.514319+0000","last_became_peered":"2024-04-25T22:55:38.514319+0000","last_unstale":"2024-04-25T22:55:41.536056+0000","last_undegraded":"2024-04-25T22:55:41.536056+0000","last_fullsized":"2024-04-25T22:55:41.536056+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:42.118131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97209,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":97196,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"51'1","reported_seq":115,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536541+0000","last_change":"2024-04-25T22:55:38.518279+0000","last_active":"2024-04-25T22:55:41.536541+0000","last_peered":"2024-04-25T22:55:41.536541+0000","last_clean":"2024-04-25T22:55:41.536541+0000","last_became_active":"2024-04-25T22:55:38.516782+0000","last_became_peered":"2024-04-25T22:55:38.516782+0000","last_unstale":"2024-04-25T22:55:41.536541+0000","last_undegraded":"2024-04-25T22:55:41.536541+0000","last_fullsized":"2024-04-25T22:55:41.536541+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:27:46.635381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"55'153","reported_seq":256,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536313+0000","last_change":"2024-04-25T22:55:32.511660+0000","last_active":"2024-04-25T22:55:41.536313+0000","last_peered":"2024-04-25T22:55:41.536313+0000","last_clean":"2024-04-25T22:55:41.536313+0000","last_became_active":"2024-04-25T22:55:32.510402+0000","last_became_peered":"2024-04-25T22:55:32.510402+0000","last_unstale":"2024-04-25T22:55:41.536313+0000","last_undegraded":"2024-04-25T22:55:41.536313+0000","last_fullsized":"2024-04-25T22:55:41.536313+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:13:03.774101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131384,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":131332,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"47'7","reported_seq":56,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536115+0000","last_change":"2024-04-25T22:55:27.566798+0000","last_active":"2024-04-25T22:55:41.536115+0000","last_peered":"2024-04-25T22:55:41.536115+0000","last_clean":"2024-04-25T22:55:41.536115+0000","last_became_active":"2024-04-25T22:55:27.518709+0000","last_became_peered":"2024-04-25T22:55:27.518709+0000","last_unstale":"2024-04-25T22:55:41.536115+0000","last_undegraded":"2024-04-25T22:55:41.536115+0000","last_fullsized":"2024-04-25T22:55:41.536115+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:07:47.758073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"55'174","reported_seq":521,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536332+0000","last_change":"2024-04-25T22:55:38.517785+0000","last_active":"2024-04-25T22:55:41.536332+0000","last_peered":"2024-04-25T22:55:41.536332+0000","last_clean":"2024-04-25T22:55:41.536332+0000","last_became_active":"2024-04-25T22:55:38.514695+0000","last_became_peered":"2024-04-25T22:55:38.514695+0000","last_unstale":"2024-04-25T22:55:41.536332+0000","last_undegraded":"2024-04-25T22:55:41.536332+0000","last_fullsized":"2024-04-25T22:55:41.536332+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:33:50.992444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187245,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":111,"num_bytes_recovered":187245,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":144,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536245+0000","last_change":"2024-04-25T22:55:27.517686+0000","last_active":"2024-04-25T22:55:41.536245+0000","last_peered":"2024-04-25T22:55:41.536245+0000","last_clean":"2024-04-25T22:55:41.536245+0000","last_became_active":"2024-04-25T22:55:27.517404+0000","last_became_peered":"2024-04-25T22:55:27.517404+0000","last_unstale":"2024-04-25T22:55:41.536245+0000","last_undegraded":"2024-04-25T22:55:41.536245+0000","last_fullsized":"2024-04-25T22:55:41.536245+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:11.671572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"55'163","reported_seq":298,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536548+0000","last_change":"2024-04-25T22:51:53.023929+0000","last_active":"2024-04-25T22:55:41.536548+0000","last_peered":"2024-04-25T22:55:41.536548+0000","last_clean":"2024-04-25T22:55:41.536548+0000","last_became_active":"2024-04-25T22:51:53.023405+0000","last_became_peered":"2024-04-25T22:51:53.023405+0000","last_unstale":"2024-04-25T22:55:41.536548+0000","last_undegraded":"2024-04-25T22:55:41.536548+0000","last_fullsized":"2024-04-25T22:55:41.536548+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:35:35.419823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130867,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":156,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859401+0000","last_change":"2024-04-25T22:55:37.516071+0000","last_active":"2024-04-25T22:55:41.859401+0000","last_peered":"2024-04-25T22:55:41.859401+0000","last_clean":"2024-04-25T22:55:41.859401+0000","last_became_active":"2024-04-25T22:55:37.515798+0000","last_became_peered":"2024-04-25T22:55:37.515798+0000","last_unstale":"2024-04-25T22:55:41.859401+0000","last_undegraded":"2024-04-25T22:55:41.859401+0000","last_fullsized":"2024-04-25T22:55:41.859401+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:27:46.635381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"55'139","reported_seq":274,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536510+0000","last_change":"2024-04-25T22:51:53.020574+0000","last_active":"2024-04-25T22:55:41.536510+0000","last_peered":"2024-04-25T22:55:41.536510+0000","last_clean":"2024-04-25T22:55:41.536510+0000","last_became_active":"2024-04-25T22:51:53.019978+0000","last_became_peered":"2024-04-25T22:51:53.019978+0000","last_unstale":"2024-04-25T22:55:41.536510+0000","last_undegraded":"2024-04-25T22:55:41.536510+0000","last_fullsized":"2024-04-25T22:55:41.536510+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:41.205051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197405,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"51'1","reported_seq":147,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858624+0000","last_change":"2024-04-25T22:55:27.517695+0000","last_active":"2024-04-25T22:55:41.858624+0000","last_peered":"2024-04-25T22:55:41.858624+0000","last_clean":"2024-04-25T22:55:41.858624+0000","last_became_active":"2024-04-25T22:55:27.517330+0000","last_became_peered":"2024-04-25T22:55:27.517330+0000","last_unstale":"2024-04-25T22:55:41.858624+0000","last_undegraded":"2024-04-25T22:55:41.858624+0000","last_fullsized":"2024-04-25T22:55:41.858624+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:15:30.181042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"55'145","reported_seq":252,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.537124+0000","last_change":"2024-04-25T22:55:31.528962+0000","last_active":"2024-04-25T22:55:41.537124+0000","last_peered":"2024-04-25T22:55:41.537124+0000","last_clean":"2024-04-25T22:55:41.537124+0000","last_became_active":"2024-04-25T22:55:31.528360+0000","last_became_peered":"2024-04-25T22:55:31.528360+0000","last_unstale":"2024-04-25T22:55:41.537124+0000","last_undegraded":"2024-04-25T22:55:41.537124+0000","last_fullsized":"2024-04-25T22:55:41.537124+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:27:45.223109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165168,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":165116,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":339,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536012+0000","last_change":"2024-04-25T22:51:47.764624+0000","last_active":"2024-04-25T22:55:41.536012+0000","last_peered":"2024-04-25T22:55:41.536012+0000","last_clean":"2024-04-25T22:55:41.536012+0000","last_became_active":"2024-04-25T22:51:47.764176+0000","last_became_peered":"2024-04-25T22:51:47.764176+0000","last_unstale":"2024-04-25T22:55:41.536012+0000","last_undegraded":"2024-04-25T22:55:41.536012+0000","last_fullsized":"2024-04-25T22:55:41.536012+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:59:39.005489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":150,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536222+0000","last_change":"2024-04-25T22:55:27.521219+0000","last_active":"2024-04-25T22:55:41.536222+0000","last_peered":"2024-04-25T22:55:41.536222+0000","last_clean":"2024-04-25T22:55:41.536222+0000","last_became_active":"2024-04-25T22:55:27.520951+0000","last_became_peered":"2024-04-25T22:55:27.520951+0000","last_unstale":"2024-04-25T22:55:41.536222+0000","last_undegraded":"2024-04-25T22:55:41.536222+0000","last_fullsized":"2024-04-25T22:55:41.536222+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:48:53.391950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"51'2","reported_seq":48,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536134+0000","last_change":"2024-04-25T22:55:27.520902+0000","last_active":"2024-04-25T22:55:41.536134+0000","last_peered":"2024-04-25T22:55:41.536134+0000","last_clean":"2024-04-25T22:55:41.536134+0000","last_became_active":"2024-04-25T22:55:27.520466+0000","last_became_peered":"2024-04-25T22:55:27.520466+0000","last_unstale":"2024-04-25T22:55:41.536134+0000","last_undegraded":"2024-04-25T22:55:41.536134+0000","last_fullsized":"2024-04-25T22:55:41.536134+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:18:17.518924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"55'150","reported_seq":285,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536563+0000","last_change":"2024-04-25T22:51:53.024106+0000","last_active":"2024-04-25T22:55:41.536563+0000","last_peered":"2024-04-25T22:55:41.536563+0000","last_clean":"2024-04-25T22:55:41.536563+0000","last_became_active":"2024-04-25T22:51:53.023497+0000","last_became_peered":"2024-04-25T22:51:53.023497+0000","last_unstale":"2024-04-25T22:55:41.536563+0000","last_undegraded":"2024-04-25T22:55:41.536563+0000","last_fullsized":"2024-04-25T22:55:41.536563+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:52:16.918935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":331484,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":143,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536139+0000","last_change":"2024-04-25T22:51:47.764591+0000","last_active":"2024-04-25T22:55:41.536139+0000","last_peered":"2024-04-25T22:55:41.536139+0000","last_clean":"2024-04-25T22:55:41.536139+0000","last_became_active":"2024-04-25T22:51:47.764229+0000","last_became_peered":"2024-04-25T22:51:47.764229+0000","last_unstale":"2024-04-25T22:55:41.536139+0000","last_undegraded":"2024-04-25T22:55:41.536139+0000","last_fullsized":"2024-04-25T22:55:41.536139+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:32.854624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"53'36","reported_seq":52,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535631+0000","last_change":"2024-04-25T22:55:27.524404+0000","last_active":"2024-04-25T22:55:41.535631+0000","last_peered":"2024-04-25T22:55:41.535631+0000","last_clean":"2024-04-25T22:55:41.535631+0000","last_became_active":"2024-04-25T22:55:27.517290+0000","last_became_peered":"2024-04-25T22:55:27.517290+0000","last_unstale":"2024-04-25T22:55:41.535631+0000","last_undegraded":"2024-04-25T22:55:41.535631+0000","last_fullsized":"2024-04-25T22:55:41.535631+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:34.809551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327644,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":343,"num_write":34,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":327644,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"55'163","reported_seq":517,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859336+0000","last_change":"2024-04-25T22:55:35.519401+0000","last_active":"2024-04-25T22:55:41.859336+0000","last_peered":"2024-04-25T22:55:41.859336+0000","last_clean":"2024-04-25T22:55:41.859336+0000","last_became_active":"2024-04-25T22:55:35.518367+0000","last_became_peered":"2024-04-25T22:55:35.518367+0000","last_unstale":"2024-04-25T22:55:41.859336+0000","last_undegraded":"2024-04-25T22:55:41.859336+0000","last_fullsized":"2024-04-25T22:55:41.859336+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:51.343892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297937,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":181,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":282175,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":48,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535954+0000","last_change":"2024-04-25T22:55:27.519726+0000","last_active":"2024-04-25T22:55:41.535954+0000","last_peered":"2024-04-25T22:55:41.535954+0000","last_clean":"2024-04-25T22:55:41.535954+0000","last_became_active":"2024-04-25T22:55:27.518412+0000","last_became_peered":"2024-04-25T22:55:27.518412+0000","last_unstale":"2024-04-25T22:55:41.535954+0000","last_undegraded":"2024-04-25T22:55:41.535954+0000","last_fullsized":"2024-04-25T22:55:41.535954+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:32:35.203827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"51'62","reported_seq":201,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858672+0000","last_change":"2024-04-25T22:51:52.018873+0000","last_active":"2024-04-25T22:55:41.858672+0000","last_peered":"2024-04-25T22:55:41.858672+0000","last_clean":"2024-04-25T22:55:41.858672+0000","last_became_active":"2024-04-25T22:51:52.018300+0000","last_became_peered":"2024-04-25T22:51:52.018300+0000","last_unstale":"2024-04-25T22:55:41.858672+0000","last_undegraded":"2024-04-25T22:55:41.858672+0000","last_fullsized":"2024-04-25T22:55:41.858672+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:25:22.660789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":4122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"55'167","reported_seq":272,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.537064+0000","last_change":"2024-04-25T22:55:32.513689+0000","last_active":"2024-04-25T22:55:41.537064+0000","last_peered":"2024-04-25T22:55:41.537064+0000","last_clean":"2024-04-25T22:55:41.537064+0000","last_became_active":"2024-04-25T22:55:32.513087+0000","last_became_peered":"2024-04-25T22:55:32.513087+0000","last_unstale":"2024-04-25T22:55:41.537064+0000","last_undegraded":"2024-04-25T22:55:41.537064+0000","last_fullsized":"2024-04-25T22:55:41.537064+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:36:56.592254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395473,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":166,"num_write_kb":573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":395432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":150,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536310+0000","last_change":"2024-04-25T22:55:27.517303+0000","last_active":"2024-04-25T22:55:41.536310+0000","last_peered":"2024-04-25T22:55:41.536310+0000","last_clean":"2024-04-25T22:55:41.536310+0000","last_became_active":"2024-04-25T22:55:27.516952+0000","last_became_peered":"2024-04-25T22:55:27.516952+0000","last_unstale":"2024-04-25T22:55:41.536310+0000","last_undegraded":"2024-04-25T22:55:41.536310+0000","last_fullsized":"2024-04-25T22:55:41.536310+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:15:25.939805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":114,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536155+0000","last_change":"2024-04-25T22:55:38.518160+0000","last_active":"2024-04-25T22:55:41.536155+0000","last_peered":"2024-04-25T22:55:41.536155+0000","last_clean":"2024-04-25T22:55:41.536155+0000","last_became_active":"2024-04-25T22:55:38.516294+0000","last_became_peered":"2024-04-25T22:55:38.516294+0000","last_unstale":"2024-04-25T22:55:41.536155+0000","last_undegraded":"2024-04-25T22:55:41.536155+0000","last_fullsized":"2024-04-25T22:55:41.536155+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:50.339431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"55'156","reported_seq":263,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536316+0000","last_change":"2024-04-25T22:55:31.527813+0000","last_active":"2024-04-25T22:55:41.536316+0000","last_peered":"2024-04-25T22:55:41.536316+0000","last_clean":"2024-04-25T22:55:41.536316+0000","last_became_active":"2024-04-25T22:55:31.526666+0000","last_became_peered":"2024-04-25T22:55:31.526666+0000","last_unstale":"2024-04-25T22:55:41.536316+0000","last_undegraded":"2024-04-25T22:55:41.536316+0000","last_fullsized":"2024-04-25T22:55:41.536316+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:18.548926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100051,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":100051,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"52'1","reported_seq":145,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536734+0000","last_change":"2024-04-25T22:55:27.517150+0000","last_active":"2024-04-25T22:55:41.536734+0000","last_peered":"2024-04-25T22:55:41.536734+0000","last_clean":"2024-04-25T22:55:41.536734+0000","last_became_active":"2024-04-25T22:55:27.516760+0000","last_became_peered":"2024-04-25T22:55:27.516760+0000","last_unstale":"2024-04-25T22:55:41.536734+0000","last_undegraded":"2024-04-25T22:55:41.536734+0000","last_fullsized":"2024-04-25T22:55:41.536734+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:20:13.546931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536169+0000","last_change":"2024-04-25T22:55:27.517202+0000","last_active":"2024-04-25T22:55:41.536169+0000","last_peered":"2024-04-25T22:55:41.536169+0000","last_clean":"2024-04-25T22:55:41.536169+0000","last_became_active":"2024-04-25T22:55:27.516272+0000","last_became_peered":"2024-04-25T22:55:27.516272+0000","last_unstale":"2024-04-25T22:55:41.536169+0000","last_undegraded":"2024-04-25T22:55:41.536169+0000","last_fullsized":"2024-04-25T22:55:41.536169+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:43:32.692434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"55'155","reported_seq":292,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858903+0000","last_change":"2024-04-25T22:51:53.026321+0000","last_active":"2024-04-25T22:55:41.858903+0000","last_peered":"2024-04-25T22:55:41.858903+0000","last_clean":"2024-04-25T22:55:41.858903+0000","last_became_active":"2024-04-25T22:51:53.025824+0000","last_became_peered":"2024-04-25T22:51:53.025824+0000","last_unstale":"2024-04-25T22:55:41.858903+0000","last_undegraded":"2024-04-25T22:55:41.858903+0000","last_fullsized":"2024-04-25T22:55:41.858903+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:12:00.793718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67397,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536444+0000","last_change":"2024-04-25T22:55:27.516710+0000","last_active":"2024-04-25T22:55:41.536444+0000","last_peered":"2024-04-25T22:55:41.536444+0000","last_clean":"2024-04-25T22:55:41.536444+0000","last_became_active":"2024-04-25T22:55:27.515536+0000","last_became_peered":"2024-04-25T22:55:27.515536+0000","last_unstale":"2024-04-25T22:55:41.536444+0000","last_undegraded":"2024-04-25T22:55:41.536444+0000","last_fullsized":"2024-04-25T22:55:41.536444+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:42:01.941338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":152,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859759+0000","last_change":"2024-04-25T22:55:27.517692+0000","last_active":"2024-04-25T22:55:41.859759+0000","last_peered":"2024-04-25T22:55:41.859759+0000","last_clean":"2024-04-25T22:55:41.859759+0000","last_became_active":"2024-04-25T22:55:27.517411+0000","last_became_peered":"2024-04-25T22:55:27.517411+0000","last_unstale":"2024-04-25T22:55:41.859759+0000","last_undegraded":"2024-04-25T22:55:41.859759+0000","last_fullsized":"2024-04-25T22:55:41.859759+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:20:09.305694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"55'175","reported_seq":312,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858983+0000","last_change":"2024-04-25T22:51:53.027051+0000","last_active":"2024-04-25T22:55:41.858983+0000","last_peered":"2024-04-25T22:55:41.858983+0000","last_clean":"2024-04-25T22:55:41.858983+0000","last_became_active":"2024-04-25T22:51:53.026458+0000","last_became_peered":"2024-04-25T22:51:53.026458+0000","last_unstale":"2024-04-25T22:55:41.858983+0000","last_undegraded":"2024-04-25T22:55:41.858983+0000","last_fullsized":"2024-04-25T22:55:41.858983+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:11:09.179564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192819,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":52,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536805+0000","last_change":"2024-04-25T22:55:27.519827+0000","last_active":"2024-04-25T22:55:41.536805+0000","last_peered":"2024-04-25T22:55:41.536805+0000","last_clean":"2024-04-25T22:55:41.536805+0000","last_became_active":"2024-04-25T22:55:27.518853+0000","last_became_peered":"2024-04-25T22:55:27.518853+0000","last_unstale":"2024-04-25T22:55:41.536805+0000","last_undegraded":"2024-04-25T22:55:41.536805+0000","last_fullsized":"2024-04-25T22:55:41.536805+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:17:48.076297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":48,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536526+0000","last_change":"2024-04-25T22:55:27.519804+0000","last_active":"2024-04-25T22:55:41.536526+0000","last_peered":"2024-04-25T22:55:41.536526+0000","last_clean":"2024-04-25T22:55:41.536526+0000","last_became_active":"2024-04-25T22:55:27.518183+0000","last_became_peered":"2024-04-25T22:55:27.518183+0000","last_unstale":"2024-04-25T22:55:41.536526+0000","last_undegraded":"2024-04-25T22:55:41.536526+0000","last_fullsized":"2024-04-25T22:55:41.536526+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:36.947733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"55'172","reported_seq":505,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536038+0000","last_change":"2024-04-25T22:55:40.539104+0000","last_active":"2024-04-25T22:55:41.536038+0000","last_peered":"2024-04-25T22:55:41.536038+0000","last_clean":"2024-04-25T22:55:41.536038+0000","last_became_active":"2024-04-25T22:55:40.538335+0000","last_became_peered":"2024-04-25T22:55:40.538335+0000","last_unstale":"2024-04-25T22:55:41.536038+0000","last_undegraded":"2024-04-25T22:55:41.536038+0000","last_fullsized":"2024-04-25T22:55:41.536038+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:45:43.336586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505702,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":1011342,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"56'37","reported_seq":67,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536555+0000","last_change":"2024-04-25T22:55:27.570707+0000","last_active":"2024-04-25T22:55:41.536555+0000","last_peered":"2024-04-25T22:55:41.536555+0000","last_clean":"2024-04-25T22:55:41.536555+0000","last_became_active":"2024-04-25T22:55:27.518193+0000","last_became_peered":"2024-04-25T22:55:27.518193+0000","last_unstale":"2024-04-25T22:55:41.536555+0000","last_undegraded":"2024-04-25T22:55:41.536555+0000","last_fullsized":"2024-04-25T22:55:41.536555+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:17:01.521730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":143,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536823+0000","last_change":"2024-04-25T22:51:47.764288+0000","last_active":"2024-04-25T22:55:41.536823+0000","last_peered":"2024-04-25T22:55:41.536823+0000","last_clean":"2024-04-25T22:55:41.536823+0000","last_became_active":"2024-04-25T22:51:47.763961+0000","last_became_peered":"2024-04-25T22:51:47.763961+0000","last_unstale":"2024-04-25T22:55:41.536823+0000","last_undegraded":"2024-04-25T22:55:41.536823+0000","last_fullsized":"2024-04-25T22:55:41.536823+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:03:07.164842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"55'142","reported_seq":279,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858601+0000","last_change":"2024-04-25T22:51:53.026925+0000","last_active":"2024-04-25T22:55:41.858601+0000","last_peered":"2024-04-25T22:55:41.858601+0000","last_clean":"2024-04-25T22:55:41.858601+0000","last_became_active":"2024-04-25T22:51:53.026419+0000","last_became_peered":"2024-04-25T22:51:53.026419+0000","last_unstale":"2024-04-25T22:55:41.858601+0000","last_undegraded":"2024-04-25T22:55:41.858601+0000","last_fullsized":"2024-04-25T22:55:41.858601+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:49:38.102060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":246196,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"55'162","reported_seq":297,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535896+0000","last_change":"2024-04-25T22:51:53.022222+0000","last_active":"2024-04-25T22:55:41.535896+0000","last_peered":"2024-04-25T22:55:41.535896+0000","last_clean":"2024-04-25T22:55:41.535896+0000","last_became_active":"2024-04-25T22:51:53.021687+0000","last_became_peered":"2024-04-25T22:51:53.021687+0000","last_unstale":"2024-04-25T22:55:41.535896+0000","last_undegraded":"2024-04-25T22:55:41.535896+0000","last_fullsized":"2024-04-25T22:55:41.535896+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:35:06.234402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108265,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"60'43","reported_seq":180,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536366+0000","last_change":"2024-04-25T22:51:52.019928+0000","last_active":"2024-04-25T22:55:41.536366+0000","last_peered":"2024-04-25T22:55:41.536366+0000","last_clean":"2024-04-25T22:55:41.536366+0000","last_became_active":"2024-04-25T22:51:52.019264+0000","last_became_peered":"2024-04-25T22:51:52.019264+0000","last_unstale":"2024-04-25T22:55:41.536366+0000","last_undegraded":"2024-04-25T22:55:41.536366+0000","last_fullsized":"2024-04-25T22:55:41.536366+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:35:18.136883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"55'146","reported_seq":253,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535922+0000","last_change":"2024-04-25T22:55:31.527757+0000","last_active":"2024-04-25T22:55:41.535922+0000","last_peered":"2024-04-25T22:55:41.535922+0000","last_clean":"2024-04-25T22:55:41.535922+0000","last_became_active":"2024-04-25T22:55:31.526620+0000","last_became_peered":"2024-04-25T22:55:31.526620+0000","last_unstale":"2024-04-25T22:55:41.535922+0000","last_undegraded":"2024-04-25T22:55:41.535922+0000","last_fullsized":"2024-04-25T22:55:41.535922+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:59:41.748950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89309,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":89309,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"53'21","reported_seq":160,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859669+0000","last_change":"2024-04-25T22:51:52.018977+0000","last_active":"2024-04-25T22:55:41.859669+0000","last_peered":"2024-04-25T22:55:41.859669+0000","last_clean":"2024-04-25T22:55:41.859669+0000","last_became_active":"2024-04-25T22:51:52.018519+0000","last_became_peered":"2024-04-25T22:51:52.018519+0000","last_unstale":"2024-04-25T22:55:41.859669+0000","last_undegraded":"2024-04-25T22:55:41.859669+0000","last_fullsized":"2024-04-25T22:55:41.859669+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:53:07.306148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"48'1","reported_seq":115,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536721+0000","last_change":"2024-04-25T22:55:38.517605+0000","last_active":"2024-04-25T22:55:41.536721+0000","last_peered":"2024-04-25T22:55:41.536721+0000","last_clean":"2024-04-25T22:55:41.536721+0000","last_became_active":"2024-04-25T22:55:38.515986+0000","last_became_peered":"2024-04-25T22:55:38.515986+0000","last_unstale":"2024-04-25T22:55:41.536721+0000","last_undegraded":"2024-04-25T22:55:41.536721+0000","last_fullsized":"2024-04-25T22:55:41.536721+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:02:39.264531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"55'171","reported_seq":278,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535896+0000","last_change":"2024-04-25T22:55:30.525999+0000","last_active":"2024-04-25T22:55:41.535896+0000","last_peered":"2024-04-25T22:55:41.535896+0000","last_clean":"2024-04-25T22:55:41.535896+0000","last_became_active":"2024-04-25T22:55:30.525233+0000","last_became_peered":"2024-04-25T22:55:30.525233+0000","last_unstale":"2024-04-25T22:55:41.535896+0000","last_undegraded":"2024-04-25T22:55:41.535896+0000","last_fullsized":"2024-04-25T22:55:41.535896+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:51:14.338988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":332166,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":329490,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"51'2","reported_seq":48,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536941+0000","last_change":"2024-04-25T22:55:27.519530+0000","last_active":"2024-04-25T22:55:41.536941+0000","last_peered":"2024-04-25T22:55:41.536941+0000","last_clean":"2024-04-25T22:55:41.536941+0000","last_became_active":"2024-04-25T22:55:27.518244+0000","last_became_peered":"2024-04-25T22:55:27.518244+0000","last_unstale":"2024-04-25T22:55:41.536941+0000","last_undegraded":"2024-04-25T22:55:41.536941+0000","last_fullsized":"2024-04-25T22:55:41.536941+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:40:24.373575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"55'158","reported_seq":267,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535732+0000","last_change":"2024-04-25T22:55:30.527784+0000","last_active":"2024-04-25T22:55:41.535732+0000","last_peered":"2024-04-25T22:55:41.535732+0000","last_clean":"2024-04-25T22:55:41.535732+0000","last_became_active":"2024-04-25T22:55:30.526853+0000","last_became_peered":"2024-04-25T22:55:30.526853+0000","last_unstale":"2024-04-25T22:55:41.535732+0000","last_undegraded":"2024-04-25T22:55:41.535732+0000","last_fullsized":"2024-04-25T22:55:41.535732+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:19:11.705754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70967,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":70967,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"55'172","reported_seq":309,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859717+0000","last_change":"2024-04-25T22:51:53.029210+0000","last_active":"2024-04-25T22:55:41.859717+0000","last_peered":"2024-04-25T22:55:41.859717+0000","last_clean":"2024-04-25T22:55:41.859717+0000","last_became_active":"2024-04-25T22:51:53.028635+0000","last_became_peered":"2024-04-25T22:51:53.028635+0000","last_unstale":"2024-04-25T22:55:41.859717+0000","last_undegraded":"2024-04-25T22:55:41.859717+0000","last_fullsized":"2024-04-25T22:55:41.859717+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:41.205051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":440592,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"50'1","reported_seq":48,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535599+0000","last_change":"2024-04-25T22:55:27.516136+0000","last_active":"2024-04-25T22:55:41.535599+0000","last_peered":"2024-04-25T22:55:41.535599+0000","last_clean":"2024-04-25T22:55:41.535599+0000","last_became_active":"2024-04-25T22:55:27.515473+0000","last_became_peered":"2024-04-25T22:55:27.515473+0000","last_unstale":"2024-04-25T22:55:41.535599+0000","last_undegraded":"2024-04-25T22:55:41.535599+0000","last_fullsized":"2024-04-25T22:55:41.535599+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:51:59.771248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"55'151","reported_seq":250,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536783+0000","last_change":"2024-04-25T22:55:34.513243+0000","last_active":"2024-04-25T22:55:41.536783+0000","last_peered":"2024-04-25T22:55:41.536783+0000","last_clean":"2024-04-25T22:55:41.536783+0000","last_became_active":"2024-04-25T22:55:34.512137+0000","last_became_peered":"2024-04-25T22:55:34.512137+0000","last_unstale":"2024-04-25T22:55:41.536783+0000","last_undegraded":"2024-04-25T22:55:41.536783+0000","last_fullsized":"2024-04-25T22:55:41.536783+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:06:40.451167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106917,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":97731,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":76,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535673+0000","last_change":"2024-04-25T22:55:37.514177+0000","last_active":"2024-04-25T22:55:41.535673+0000","last_peered":"2024-04-25T22:55:41.535673+0000","last_clean":"2024-04-25T22:55:41.535673+0000","last_became_active":"2024-04-25T22:55:37.513925+0000","last_became_peered":"2024-04-25T22:55:37.513925+0000","last_unstale":"2024-04-25T22:55:41.535673+0000","last_undegraded":"2024-04-25T22:55:41.535673+0000","last_fullsized":"2024-04-25T22:55:41.535673+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:12:09.421061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"55'203","reported_seq":340,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859317+0000","last_change":"2024-04-25T22:51:53.028084+0000","last_active":"2024-04-25T22:55:41.859317+0000","last_peered":"2024-04-25T22:55:41.859317+0000","last_clean":"2024-04-25T22:55:41.859317+0000","last_became_active":"2024-04-25T22:51:53.027541+0000","last_became_peered":"2024-04-25T22:51:53.027541+0000","last_unstale":"2024-04-25T22:55:41.859317+0000","last_undegraded":"2024-04-25T22:55:41.859317+0000","last_fullsized":"2024-04-25T22:55:41.859317+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:28:42.903045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195653,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"48'2","reported_seq":153,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859141+0000","last_change":"2024-04-25T22:55:27.541798+0000","last_active":"2024-04-25T22:55:41.859141+0000","last_peered":"2024-04-25T22:55:41.859141+0000","last_clean":"2024-04-25T22:55:41.859141+0000","last_became_active":"2024-04-25T22:55:27.517718+0000","last_became_peered":"2024-04-25T22:55:27.517718+0000","last_unstale":"2024-04-25T22:55:41.859141+0000","last_undegraded":"2024-04-25T22:55:41.859141+0000","last_fullsized":"2024-04-25T22:55:41.859141+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:48:57.633186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"55'168","reported_seq":524,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858951+0000","last_change":"2024-04-25T22:55:34.514499+0000","last_active":"2024-04-25T22:55:41.858951+0000","last_peered":"2024-04-25T22:55:41.858951+0000","last_clean":"2024-04-25T22:55:41.858951+0000","last_became_active":"2024-04-25T22:55:34.513433+0000","last_became_peered":"2024-04-25T22:55:34.513433+0000","last_unstale":"2024-04-25T22:55:41.858951+0000","last_undegraded":"2024-04-25T22:55:41.858951+0000","last_fullsized":"2024-04-25T22:55:41.858951+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:58:08.177184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151921,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":151921,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"47'5","reported_seq":170,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859179+0000","last_change":"2024-04-25T22:55:37.559449+0000","last_active":"2024-04-25T22:55:41.859179+0000","last_peered":"2024-04-25T22:55:41.859179+0000","last_clean":"2024-04-25T22:55:41.859179+0000","last_became_active":"2024-04-25T22:55:37.516119+0000","last_became_peered":"2024-04-25T22:55:37.516119+0000","last_unstale":"2024-04-25T22:55:41.859179+0000","last_undegraded":"2024-04-25T22:55:41.859179+0000","last_fullsized":"2024-04-25T22:55:41.859179+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:25:42.548782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"55'166","reported_seq":505,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535835+0000","last_change":"2024-04-25T22:55:38.518734+0000","last_active":"2024-04-25T22:55:41.535835+0000","last_peered":"2024-04-25T22:55:41.535835+0000","last_clean":"2024-04-25T22:55:41.535835+0000","last_became_active":"2024-04-25T22:55:38.516260+0000","last_became_peered":"2024-04-25T22:55:38.516260+0000","last_unstale":"2024-04-25T22:55:41.535835+0000","last_undegraded":"2024-04-25T22:55:41.535835+0000","last_fullsized":"2024-04-25T22:55:41.535835+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:25:43.553244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3798024,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":3871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":3798024,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535940+0000","last_change":"2024-04-25T22:55:38.520672+0000","last_active":"2024-04-25T22:55:41.535940+0000","last_peered":"2024-04-25T22:55:41.535940+0000","last_clean":"2024-04-25T22:55:41.535940+0000","last_became_active":"2024-04-25T22:55:38.515776+0000","last_became_peered":"2024-04-25T22:55:38.515776+0000","last_unstale":"2024-04-25T22:55:41.535940+0000","last_undegraded":"2024-04-25T22:55:41.535940+0000","last_fullsized":"2024-04-25T22:55:41.535940+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:52:53.584300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"55'158","reported_seq":495,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536078+0000","last_change":"2024-04-25T22:55:38.516465+0000","last_active":"2024-04-25T22:55:41.536078+0000","last_peered":"2024-04-25T22:55:41.536078+0000","last_clean":"2024-04-25T22:55:41.536078+0000","last_became_active":"2024-04-25T22:55:38.514732+0000","last_became_peered":"2024-04-25T22:55:38.514732+0000","last_unstale":"2024-04-25T22:55:41.536078+0000","last_undegraded":"2024-04-25T22:55:41.536078+0000","last_fullsized":"2024-04-25T22:55:41.536078+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:42:09.860717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141656,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":141656,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"50'57","reported_seq":196,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859521+0000","last_change":"2024-04-25T22:51:52.019032+0000","last_active":"2024-04-25T22:55:41.859521+0000","last_peered":"2024-04-25T22:55:41.859521+0000","last_clean":"2024-04-25T22:55:41.859521+0000","last_became_active":"2024-04-25T22:51:52.018547+0000","last_became_peered":"2024-04-25T22:51:52.018547+0000","last_unstale":"2024-04-25T22:55:41.859521+0000","last_undegraded":"2024-04-25T22:55:41.859521+0000","last_fullsized":"2024-04-25T22:55:41.859521+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:10:00.056491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":8213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"55'169","reported_seq":535,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859326+0000","last_change":"2024-04-25T22:55:35.518155+0000","last_active":"2024-04-25T22:55:41.859326+0000","last_peered":"2024-04-25T22:55:41.859326+0000","last_clean":"2024-04-25T22:55:41.859326+0000","last_became_active":"2024-04-25T22:55:35.517149+0000","last_became_peered":"2024-04-25T22:55:35.517149+0000","last_unstale":"2024-04-25T22:55:41.859326+0000","last_undegraded":"2024-04-25T22:55:41.859326+0000","last_fullsized":"2024-04-25T22:55:41.859326+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:50.123900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184603,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":194,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":166098,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"48'25","reported_seq":56,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536897+0000","last_change":"2024-04-25T22:55:27.586742+0000","last_active":"2024-04-25T22:55:41.536897+0000","last_peered":"2024-04-25T22:55:41.536897+0000","last_clean":"2024-04-25T22:55:41.536897+0000","last_became_active":"2024-04-25T22:55:27.520617+0000","last_became_peered":"2024-04-25T22:55:27.520617+0000","last_unstale":"2024-04-25T22:55:41.536897+0000","last_undegraded":"2024-04-25T22:55:41.536897+0000","last_fullsized":"2024-04-25T22:55:41.536897+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:58:12.148059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"55'196","reported_seq":594,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535817+0000","last_change":"2024-04-25T22:55:31.526793+0000","last_active":"2024-04-25T22:55:41.535817+0000","last_peered":"2024-04-25T22:55:41.535817+0000","last_clean":"2024-04-25T22:55:41.535817+0000","last_became_active":"2024-04-25T22:55:31.526322+0000","last_became_peered":"2024-04-25T22:55:31.526322+0000","last_unstale":"2024-04-25T22:55:41.535817+0000","last_undegraded":"2024-04-25T22:55:41.535817+0000","last_fullsized":"2024-04-25T22:55:41.535817+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:58.561902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200980,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":211,"num_write_kb":410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":126,"num_bytes_recovered":197679,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"48'7","reported_seq":98,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536679+0000","last_change":"2024-04-25T22:55:37.541050+0000","last_active":"2024-04-25T22:55:41.536679+0000","last_peered":"2024-04-25T22:55:41.536679+0000","last_clean":"2024-04-25T22:55:41.536679+0000","last_became_active":"2024-04-25T22:55:37.516183+0000","last_became_peered":"2024-04-25T22:55:37.516183+0000","last_unstale":"2024-04-25T22:55:41.536679+0000","last_undegraded":"2024-04-25T22:55:41.536679+0000","last_fullsized":"2024-04-25T22:55:41.536679+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:30.075399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8389190,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26691649,"num_objects":3448,"num_object_clones":0,"num_object_copies":6896,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3448,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10583,"num_write_kb":38991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4953,"num_bytes_recovered":24173691,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73056256,"data_stored":53061590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10415,"ondisk_log_size":10415,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":40502861,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":34,"num_read_kb":343,"num_write":470,"num_write_kb":40224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":32113365,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":81068032,"data_stored":81005722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5351,"internal_metadata":0},"log_size":434,"ondisk_log_size":434,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738420,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84828,"kb_used_data":49484,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94287012,"statfs":{"total":96636764160,"available":96549900288,"internally_reserved":0,"allocated":50671616,"data_stored":43771464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":62,"seq":266287972358,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85248,"kb_used_data":45232,"kb_used_omap":6,"kb_used_meta":39993,"kb_avail":94286592,"statfs":{"total":96636764160,"available":96549470208,"internally_reserved":0,"allocated":46317568,"data_stored":38899263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6946,"internal_metadata":40953054},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738420,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":102580,"kb_used_data":58912,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94269260,"statfs":{"total":96636764160,"available":96531722240,"internally_reserved":0,"allocated":60325888,"data_stored":53539649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32145408,"data_stored":32114253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19542016,"data_stored":19530487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5351,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":29380608,"data_stored":29360982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":26918912,"data_stored":20514252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26107904,"data_stored":19048000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20029440,"data_stored":13499338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:55:50.504 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.504 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.504 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.505 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.505 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.505 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.505 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.505 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.505 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.506 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.506 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.506 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.506 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.506 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.507 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.507 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.507 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.507 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.508 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.508 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.508 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.508 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.508 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.509 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.509 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.509 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.509 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.509 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.509 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.510 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.510 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.510 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.510 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.510 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-25T22:51:50.996034+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.511 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.511 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-25T22:51:50.996034+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.511 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.511 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-25T22:51:50.996034+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.511 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.511 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-25T22:51:50.996034+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.511 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-25T22:51:50.996034+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.512 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.512 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-25T22:51:50.996034+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.512 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.512 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-25T22:51:50.996034+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.512 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.512 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-25T22:51:50.996034+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.512 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.513 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-25T22:51:50.996034+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.513 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.513 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-25T22:51:50.996034+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.513 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.513 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-25T22:51:50.996034+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.513 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.514 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-25T22:51:50.996034+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.514 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.514 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-25T22:51:46.754798+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=46, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.514 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-25T22:51:46.754798+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=46, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.514 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-25T22:51:50.996034+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.515 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.515 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-25T22:51:46.754798+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=46, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.515 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-25T22:51:50.996034+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.515 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.515 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-25T22:51:46.754798+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=46, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.515 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-25T22:51:50.996034+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.516 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.516 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-25T22:51:46.754798+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=46, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.516 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-25T22:51:50.996034+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.516 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.516 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-25T22:51:50.996034+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.516 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-25T22:51:46.754798+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=46, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.517 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.517 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-25T22:51:50.996034+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.517 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-25T22:51:46.754798+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=46, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.517 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.518 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-25T22:51:50.996034+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.518 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-25T22:51:46.754798+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=46, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.518 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.518 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-25T22:51:50.996034+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.519 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-25T22:51:46.754798+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=46, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.519 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.519 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.519 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-25T22:51:50.996034+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.519 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.519 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-25T22:51:50.996034+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.519 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-25T22:51:50.996034+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.520 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.520 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-25T22:51:50.996034+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.520 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.520 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.520 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-25T22:51:50.996034+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.521 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.521 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-25T22:51:50.996034+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.521 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.521 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-25T22:51:50.996034+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.521 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.521 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-25T22:51:50.996034+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.522 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.522 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-25T22:51:50.996034+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.522 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.522 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-25T22:51:50.996034+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.522 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.522 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-25T22:51:50.996034+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.523 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.523 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-25T22:51:50.996034+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:55:50.523 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T22:56:10.524 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:56:10.843 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:56:10.846 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-25T22:56:10.853 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":207,"stamp":"2024-04-25T22:56:09.993410+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":67784878,"num_objects":3482,"num_object_clones":0,"num_object_copies":6964,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3482,"num_whiteouts":0,"num_read":170,"num_read_kb":461,"num_write":11256,"num_write_kb":82675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4966,"num_bytes_recovered":56287056,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12782,"ondisk_log_size":12782,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":269876,"kb_used_data":153628,"kb_used_omap":9,"kb_used_meta":116214,"kb_avail":282845644,"statfs":{"total":289910292480,"available":289633939456,"internally_reserved":0,"allocated":157315072,"data_stored":136210376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10136,"internal_metadata":119003240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003312"},"pg_stats":[{"pgid":"4.3f","version":"77'217","reported_seq":585,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:50.585741+0000","last_change":"2024-04-25T22:55:50.585741+0000","last_active":"2024-04-25T22:55:50.585741+0000","last_peered":"2024-04-25T22:55:50.585741+0000","last_clean":"2024-04-25T22:55:50.585741+0000","last_became_active":"2024-04-25T22:55:34.514302+0000","last_became_peered":"2024-04-25T22:55:34.514302+0000","last_unstale":"2024-04-25T22:55:50.585741+0000","last_undegraded":"2024-04-25T22:55:50.585741+0000","last_fullsized":"2024-04-25T22:55:50.585741+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'217","last_scrub_stamp":"2024-04-25T22:55:50.585625+0000","last_deep_scrub":"77'217","last_deep_scrub_stamp":"2024-04-25T22:55:50.585625+0000","last_clean_scrub_stamp":"2024-04-25T22:55:50.585625+0000","objects_scrubbed":57,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:45:04.825113+0000","scrub_duration":49,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168293,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":168293,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"55'153","reported_seq":497,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:50.172839+0000","last_change":"2024-04-25T22:55:35.519132+0000","last_active":"2024-04-25T22:55:50.172839+0000","last_peered":"2024-04-25T22:55:50.172839+0000","last_clean":"2024-04-25T22:55:50.172839+0000","last_became_active":"2024-04-25T22:55:35.517561+0000","last_became_peered":"2024-04-25T22:55:35.517561+0000","last_unstale":"2024-04-25T22:55:50.172839+0000","last_undegraded":"2024-04-25T22:55:50.172839+0000","last_fullsized":"2024-04-25T22:55:50.172839+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286387,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":286387,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"55'164","reported_seq":239,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536423+0000","last_change":"2024-04-25T22:55:38.519244+0000","last_active":"2024-04-25T22:55:41.536423+0000","last_peered":"2024-04-25T22:55:41.536423+0000","last_clean":"2024-04-25T22:55:41.536423+0000","last_became_active":"2024-04-25T22:55:38.517874+0000","last_became_peered":"2024-04-25T22:55:38.517874+0000","last_unstale":"2024-04-25T22:55:41.536423+0000","last_undegraded":"2024-04-25T22:55:41.536423+0000","last_fullsized":"2024-04-25T22:55:41.536423+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130188,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"77'173","reported_seq":481,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:54.624422+0000","last_change":"2024-04-25T22:55:54.624422+0000","last_active":"2024-04-25T22:55:54.624422+0000","last_peered":"2024-04-25T22:55:54.624422+0000","last_clean":"2024-04-25T22:55:54.624422+0000","last_became_active":"2024-04-25T22:55:38.513558+0000","last_became_peered":"2024-04-25T22:55:38.513558+0000","last_unstale":"2024-04-25T22:55:54.624422+0000","last_undegraded":"2024-04-25T22:55:54.624422+0000","last_fullsized":"2024-04-25T22:55:54.624422+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'173","last_scrub_stamp":"2024-04-25T22:55:54.624271+0000","last_deep_scrub":"77'173","last_deep_scrub_stamp":"2024-04-25T22:55:54.624271+0000","last_clean_scrub_stamp":"2024-04-25T22:55:54.624271+0000","objects_scrubbed":47,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:54:42.553756+0000","scrub_duration":34,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142819,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":135761,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"55'173","reported_seq":560,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859231+0000","last_change":"2024-04-25T22:55:35.517931+0000","last_active":"2024-04-25T22:55:41.859231+0000","last_peered":"2024-04-25T22:55:41.859231+0000","last_clean":"2024-04-25T22:55:41.859231+0000","last_became_active":"2024-04-25T22:55:35.517044+0000","last_became_peered":"2024-04-25T22:55:35.517044+0000","last_unstale":"2024-04-25T22:55:41.859231+0000","last_undegraded":"2024-04-25T22:55:41.859231+0000","last_fullsized":"2024-04-25T22:55:41.859231+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":709662,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":119,"num_bytes_recovered":709653,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"55'173","reported_seq":517,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535806+0000","last_change":"2024-04-25T22:55:38.515187+0000","last_active":"2024-04-25T22:55:41.535806+0000","last_peered":"2024-04-25T22:55:41.535806+0000","last_clean":"2024-04-25T22:55:41.535806+0000","last_became_active":"2024-04-25T22:55:38.513456+0000","last_became_peered":"2024-04-25T22:55:38.513456+0000","last_unstale":"2024-04-25T22:55:41.535806+0000","last_undegraded":"2024-04-25T22:55:41.535806+0000","last_fullsized":"2024-04-25T22:55:41.535806+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569466,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":569466,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"77'228","reported_seq":607,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:03.665207+0000","last_change":"2024-04-25T22:56:03.665255+0000","last_active":"2024-04-25T22:56:03.665207+0000","last_peered":"2024-04-25T22:56:03.665207+0000","last_clean":"2024-04-25T22:56:03.665207+0000","last_became_active":"2024-04-25T22:55:33.511961+0000","last_became_peered":"2024-04-25T22:55:33.511961+0000","last_unstale":"2024-04-25T22:56:03.665207+0000","last_undegraded":"2024-04-25T22:56:03.665207+0000","last_fullsized":"2024-04-25T22:56:03.665207+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'228","last_scrub_stamp":"2024-04-25T22:56:03.665102+0000","last_deep_scrub":"77'228","last_deep_scrub_stamp":"2024-04-25T22:56:03.665102+0000","last_clean_scrub_stamp":"2024-04-25T22:56:03.665102+0000","objects_scrubbed":55,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:31:16.236002+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75460,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":111,"num_bytes_recovered":75460,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"77'180","reported_seq":506,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:01.623980+0000","last_change":"2024-04-25T22:56:01.624031+0000","last_active":"2024-04-25T22:56:01.623980+0000","last_peered":"2024-04-25T22:56:01.623980+0000","last_clean":"2024-04-25T22:56:01.623980+0000","last_became_active":"2024-04-25T22:55:32.509908+0000","last_became_peered":"2024-04-25T22:55:32.509908+0000","last_unstale":"2024-04-25T22:56:01.623980+0000","last_undegraded":"2024-04-25T22:56:01.623980+0000","last_fullsized":"2024-04-25T22:56:01.623980+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'180","last_scrub_stamp":"2024-04-25T22:56:01.623899+0000","last_deep_scrub":"77'180","last_deep_scrub_stamp":"2024-04-25T22:56:01.623899+0000","last_clean_scrub_stamp":"2024-04-25T22:56:01.623899+0000","objects_scrubbed":40,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:48:15.905014+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":214453,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":214404,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"77'226","reported_seq":342,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:02.912759+0000","last_change":"2024-04-25T22:56:02.912791+0000","last_active":"2024-04-25T22:56:02.912759+0000","last_peered":"2024-04-25T22:56:02.912759+0000","last_clean":"2024-04-25T22:56:02.912759+0000","last_became_active":"2024-04-25T22:55:32.512447+0000","last_became_peered":"2024-04-25T22:55:32.512447+0000","last_unstale":"2024-04-25T22:56:02.912759+0000","last_undegraded":"2024-04-25T22:56:02.912759+0000","last_fullsized":"2024-04-25T22:56:02.912759+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'226","last_scrub_stamp":"2024-04-25T22:56:02.912678+0000","last_deep_scrub":"77'226","last_deep_scrub_stamp":"2024-04-25T22:56:02.912678+0000","last_clean_scrub_stamp":"2024-04-25T22:56:02.912678+0000","objects_scrubbed":57,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:14:20.686518+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":538374,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":538374,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"55'153","reported_seq":484,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859356+0000","last_change":"2024-04-25T22:55:35.518293+0000","last_active":"2024-04-25T22:55:41.859356+0000","last_peered":"2024-04-25T22:55:41.859356+0000","last_clean":"2024-04-25T22:55:41.859356+0000","last_became_active":"2024-04-25T22:55:35.517506+0000","last_became_peered":"2024-04-25T22:55:35.517506+0000","last_unstale":"2024-04-25T22:55:41.859356+0000","last_undegraded":"2024-04-25T22:55:41.859356+0000","last_fullsized":"2024-04-25T22:55:41.859356+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130447,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":123390,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"55'154","reported_seq":259,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536062+0000","last_change":"2024-04-25T22:55:40.538872+0000","last_active":"2024-04-25T22:55:41.536062+0000","last_peered":"2024-04-25T22:55:41.536062+0000","last_clean":"2024-04-25T22:55:41.536062+0000","last_became_active":"2024-04-25T22:55:40.538052+0000","last_became_peered":"2024-04-25T22:55:40.538052+0000","last_unstale":"2024-04-25T22:55:41.536062+0000","last_undegraded":"2024-04-25T22:55:41.536062+0000","last_fullsized":"2024-04-25T22:55:41.536062+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":343806,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":208,"num_bytes_recovered":687612,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"77'193","reported_seq":341,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:03.629080+0000","last_change":"2024-04-25T22:56:03.629111+0000","last_active":"2024-04-25T22:56:03.629080+0000","last_peered":"2024-04-25T22:56:03.629080+0000","last_clean":"2024-04-25T22:56:03.629080+0000","last_became_active":"2024-04-25T22:51:53.027363+0000","last_became_peered":"2024-04-25T22:51:53.027363+0000","last_unstale":"2024-04-25T22:56:03.629080+0000","last_undegraded":"2024-04-25T22:56:03.629080+0000","last_fullsized":"2024-04-25T22:56:03.629080+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'193","last_scrub_stamp":"2024-04-25T22:56:03.629005+0000","last_deep_scrub":"77'193","last_deep_scrub_stamp":"2024-04-25T22:56:03.629005+0000","last_clean_scrub_stamp":"2024-04-25T22:56:03.629005+0000","objects_scrubbed":52,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:50.606057+0000","scrub_duration":37,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125409,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"55'135","reported_seq":460,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.858919+0000","last_change":"2024-04-25T22:55:33.512249+0000","last_active":"2024-04-25T22:55:41.858919+0000","last_peered":"2024-04-25T22:55:41.858919+0000","last_clean":"2024-04-25T22:55:41.858919+0000","last_became_active":"2024-04-25T22:55:33.511546+0000","last_became_peered":"2024-04-25T22:55:33.511546+0000","last_unstale":"2024-04-25T22:55:41.858919+0000","last_undegraded":"2024-04-25T22:55:41.858919+0000","last_fullsized":"2024-04-25T22:55:41.858919+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":183835,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":183835,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"55'179","reported_seq":315,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535869+0000","last_change":"2024-04-25T22:51:53.022367+0000","last_active":"2024-04-25T22:55:41.535869+0000","last_peered":"2024-04-25T22:55:41.535869+0000","last_clean":"2024-04-25T22:55:41.535869+0000","last_became_active":"2024-04-25T22:51:53.021902+0000","last_became_peered":"2024-04-25T22:51:53.021902+0000","last_unstale":"2024-04-25T22:55:41.535869+0000","last_undegraded":"2024-04-25T22:55:41.535869+0000","last_fullsized":"2024-04-25T22:55:41.535869+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153371,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":181,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"55'161","reported_seq":274,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535641+0000","last_change":"2024-04-25T22:55:40.539371+0000","last_active":"2024-04-25T22:55:41.535641+0000","last_peered":"2024-04-25T22:55:41.535641+0000","last_clean":"2024-04-25T22:55:41.535641+0000","last_became_active":"2024-04-25T22:55:40.538095+0000","last_became_peered":"2024-04-25T22:55:40.538095+0000","last_unstale":"2024-04-25T22:55:41.535641+0000","last_undegraded":"2024-04-25T22:55:41.535641+0000","last_fullsized":"2024-04-25T22:55:41.535641+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4276239,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":4418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":4276214,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"77'238","reported_seq":621,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:57.608004+0000","last_change":"2024-04-25T22:55:57.608036+0000","last_active":"2024-04-25T22:55:57.608004+0000","last_peered":"2024-04-25T22:55:57.608004+0000","last_clean":"2024-04-25T22:55:57.608004+0000","last_became_active":"2024-04-25T22:55:31.526271+0000","last_became_peered":"2024-04-25T22:55:31.526271+0000","last_unstale":"2024-04-25T22:55:57.608004+0000","last_undegraded":"2024-04-25T22:55:57.608004+0000","last_fullsized":"2024-04-25T22:55:57.608004+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'238","last_scrub_stamp":"2024-04-25T22:55:57.607919+0000","last_deep_scrub":"77'238","last_deep_scrub_stamp":"2024-04-25T22:55:57.607919+0000","last_clean_scrub_stamp":"2024-04-25T22:55:57.607919+0000","objects_scrubbed":59,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:36:26.673180+0000","scrub_duration":45,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4371943,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":4513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":4363238,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"77'206","reported_seq":321,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:04.865461+0000","last_change":"2024-04-25T22:56:04.865500+0000","last_active":"2024-04-25T22:56:04.865461+0000","last_peered":"2024-04-25T22:56:04.865461+0000","last_clean":"2024-04-25T22:56:04.865461+0000","last_became_active":"2024-04-25T22:55:32.512371+0000","last_became_peered":"2024-04-25T22:55:32.512371+0000","last_unstale":"2024-04-25T22:56:04.865461+0000","last_undegraded":"2024-04-25T22:56:04.865461+0000","last_fullsized":"2024-04-25T22:56:04.865461+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'206","last_scrub_stamp":"2024-04-25T22:56:04.865369+0000","last_deep_scrub":"77'206","last_deep_scrub_stamp":"2024-04-25T22:56:04.865369+0000","last_clean_scrub_stamp":"2024-04-25T22:56:04.865369+0000","objects_scrubbed":43,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:18.871070+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96221,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":87110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"55'147","reported_seq":488,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859547+0000","last_change":"2024-04-25T22:55:35.519379+0000","last_active":"2024-04-25T22:55:41.859547+0000","last_peered":"2024-04-25T22:55:41.859547+0000","last_clean":"2024-04-25T22:55:41.859547+0000","last_became_active":"2024-04-25T22:55:35.518584+0000","last_became_peered":"2024-04-25T22:55:35.518584+0000","last_unstale":"2024-04-25T22:55:41.859547+0000","last_undegraded":"2024-04-25T22:55:41.859547+0000","last_fullsized":"2024-04-25T22:55:41.859547+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1432264,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":1532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":1432241,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"77'199","reported_seq":319,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:51.904933+0000","last_change":"2024-04-25T22:55:51.904963+0000","last_active":"2024-04-25T22:55:51.904933+0000","last_peered":"2024-04-25T22:55:51.904933+0000","last_clean":"2024-04-25T22:55:51.904933+0000","last_became_active":"2024-04-25T22:55:30.526745+0000","last_became_peered":"2024-04-25T22:55:30.526745+0000","last_unstale":"2024-04-25T22:55:51.904933+0000","last_undegraded":"2024-04-25T22:55:51.904933+0000","last_fullsized":"2024-04-25T22:55:51.904933+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'199","last_scrub_stamp":"2024-04-25T22:55:51.904847+0000","last_deep_scrub":"77'199","last_deep_scrub_stamp":"2024-04-25T22:55:51.904847+0000","last_clean_scrub_stamp":"2024-04-25T22:55:51.904847+0000","objects_scrubbed":53,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:48:16.767300+0000","scrub_duration":36,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112933,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":112933,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"55'178","reported_seq":549,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536260+0000","last_change":"2024-04-25T22:55:34.512671+0000","last_active":"2024-04-25T22:55:41.536260+0000","last_peered":"2024-04-25T22:55:41.536260+0000","last_clean":"2024-04-25T22:55:41.536260+0000","last_became_active":"2024-04-25T22:55:34.511872+0000","last_became_peered":"2024-04-25T22:55:34.511872+0000","last_unstale":"2024-04-25T22:55:41.536260+0000","last_undegraded":"2024-04-25T22:55:41.536260+0000","last_fullsized":"2024-04-25T22:55:41.536260+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124334,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":124334,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"77'211","reported_seq":564,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:05.689289+0000","last_change":"2024-04-25T22:56:05.689316+0000","last_active":"2024-04-25T22:56:05.689289+0000","last_peered":"2024-04-25T22:56:05.689289+0000","last_clean":"2024-04-25T22:56:05.689289+0000","last_became_active":"2024-04-25T22:55:34.511833+0000","last_became_peered":"2024-04-25T22:55:34.511833+0000","last_unstale":"2024-04-25T22:56:05.689289+0000","last_undegraded":"2024-04-25T22:56:05.689289+0000","last_fullsized":"2024-04-25T22:56:05.689289+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'211","last_scrub_stamp":"2024-04-25T22:56:05.689217+0000","last_deep_scrub":"77'211","last_deep_scrub_stamp":"2024-04-25T22:56:05.689217+0000","last_clean_scrub_stamp":"2024-04-25T22:56:05.689217+0000","objects_scrubbed":53,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:27:05.051314+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145029,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":145029,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"55'171","reported_seq":309,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859051+0000","last_change":"2024-04-25T22:51:53.026746+0000","last_active":"2024-04-25T22:55:41.859051+0000","last_peered":"2024-04-25T22:55:41.859051+0000","last_clean":"2024-04-25T22:55:41.859051+0000","last_became_active":"2024-04-25T22:51:53.025938+0000","last_became_peered":"2024-04-25T22:51:53.025938+0000","last_unstale":"2024-04-25T22:55:41.859051+0000","last_undegraded":"2024-04-25T22:55:41.859051+0000","last_fullsized":"2024-04-25T22:55:41.859051+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115019,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"77'210","reported_seq":321,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:49.915543+0000","last_change":"2024-04-25T22:55:49.915587+0000","last_active":"2024-04-25T22:55:49.915543+0000","last_peered":"2024-04-25T22:55:49.915543+0000","last_clean":"2024-04-25T22:55:49.915543+0000","last_became_active":"2024-04-25T22:55:33.512160+0000","last_became_peered":"2024-04-25T22:55:33.512160+0000","last_unstale":"2024-04-25T22:55:49.915543+0000","last_undegraded":"2024-04-25T22:55:49.915543+0000","last_fullsized":"2024-04-25T22:55:49.915543+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'210","last_scrub_stamp":"2024-04-25T22:55:49.915449+0000","last_deep_scrub":"77'210","last_deep_scrub_stamp":"2024-04-25T22:55:49.915449+0000","last_clean_scrub_stamp":"2024-04-25T22:55:49.915449+0000","objects_scrubbed":49,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:38:33.900833+0000","scrub_duration":36,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":641227,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":641227,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"77'217","reported_seq":583,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:04.640955+0000","last_change":"2024-04-25T22:56:04.641024+0000","last_active":"2024-04-25T22:56:04.640955+0000","last_peered":"2024-04-25T22:56:04.640955+0000","last_clean":"2024-04-25T22:56:04.640955+0000","last_became_active":"2024-04-25T22:55:33.511463+0000","last_became_peered":"2024-04-25T22:55:33.511463+0000","last_unstale":"2024-04-25T22:56:04.640955+0000","last_undegraded":"2024-04-25T22:56:04.640955+0000","last_fullsized":"2024-04-25T22:56:04.640955+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'217","last_scrub_stamp":"2024-04-25T22:56:04.640878+0000","last_deep_scrub":"77'217","last_deep_scrub_stamp":"2024-04-25T22:56:04.640878+0000","last_clean_scrub_stamp":"2024-04-25T22:56:04.640878+0000","objects_scrubbed":48,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:48:18.921993+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103634,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":189,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":98869,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"77'218","reported_seq":366,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:59.612366+0000","last_change":"2024-04-25T22:55:59.612400+0000","last_active":"2024-04-25T22:55:59.612366+0000","last_peered":"2024-04-25T22:55:59.612366+0000","last_clean":"2024-04-25T22:55:59.612366+0000","last_became_active":"2024-04-25T22:51:53.027867+0000","last_became_peered":"2024-04-25T22:51:53.027867+0000","last_unstale":"2024-04-25T22:55:59.612366+0000","last_undegraded":"2024-04-25T22:55:59.612366+0000","last_fullsized":"2024-04-25T22:55:59.612366+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'218","last_scrub_stamp":"2024-04-25T22:55:59.612288+0000","last_deep_scrub":"77'218","last_deep_scrub_stamp":"2024-04-25T22:55:59.612288+0000","last_clean_scrub_stamp":"2024-04-25T22:55:59.612288+0000","objects_scrubbed":59,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:46:01.075914+0000","scrub_duration":36,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272252,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"55'190","reported_seq":290,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536924+0000","last_change":"2024-04-25T22:55:34.513270+0000","last_active":"2024-04-25T22:55:41.536924+0000","last_peered":"2024-04-25T22:55:41.536924+0000","last_clean":"2024-04-25T22:55:41.536924+0000","last_became_active":"2024-04-25T22:55:34.512320+0000","last_became_peered":"2024-04-25T22:55:34.512320+0000","last_unstale":"2024-04-25T22:55:41.536924+0000","last_undegraded":"2024-04-25T22:55:41.536924+0000","last_fullsized":"2024-04-25T22:55:41.536924+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126403,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":117,"num_bytes_recovered":126342,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"55'151","reported_seq":287,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536487+0000","last_change":"2024-04-25T22:51:53.022893+0000","last_active":"2024-04-25T22:55:41.536487+0000","last_peered":"2024-04-25T22:55:41.536487+0000","last_clean":"2024-04-25T22:55:41.536487+0000","last_became_active":"2024-04-25T22:51:53.022407+0000","last_became_peered":"2024-04-25T22:51:53.022407+0000","last_unstale":"2024-04-25T22:55:41.536487+0000","last_undegraded":"2024-04-25T22:55:41.536487+0000","last_fullsized":"2024-04-25T22:55:41.536487+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69245,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"77'195","reported_seq":342,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:57.649727+0000","last_change":"2024-04-25T22:55:57.649775+0000","last_active":"2024-04-25T22:55:57.649727+0000","last_peered":"2024-04-25T22:55:57.649727+0000","last_clean":"2024-04-25T22:55:57.649727+0000","last_became_active":"2024-04-25T22:51:53.027852+0000","last_became_peered":"2024-04-25T22:51:53.027852+0000","last_unstale":"2024-04-25T22:55:57.649727+0000","last_undegraded":"2024-04-25T22:55:57.649727+0000","last_fullsized":"2024-04-25T22:55:57.649727+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'195","last_scrub_stamp":"2024-04-25T22:55:57.649623+0000","last_deep_scrub":"77'195","last_deep_scrub_stamp":"2024-04-25T22:55:57.649623+0000","last_clean_scrub_stamp":"2024-04-25T22:55:57.649623+0000","objects_scrubbed":48,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:54:45.579108+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192848,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"55'166","reported_seq":268,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535990+0000","last_change":"2024-04-25T22:55:34.514981+0000","last_active":"2024-04-25T22:55:41.535990+0000","last_peered":"2024-04-25T22:55:41.535990+0000","last_clean":"2024-04-25T22:55:41.535990+0000","last_became_active":"2024-04-25T22:55:34.514067+0000","last_became_peered":"2024-04-25T22:55:34.514067+0000","last_unstale":"2024-04-25T22:55:41.535990+0000","last_undegraded":"2024-04-25T22:55:41.535990+0000","last_fullsized":"2024-04-25T22:55:41.535990+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239074,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":239074,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"55'191","reported_seq":330,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:50.172645+0000","last_change":"2024-04-25T22:51:53.026997+0000","last_active":"2024-04-25T22:55:50.172645+0000","last_peered":"2024-04-25T22:55:50.172645+0000","last_clean":"2024-04-25T22:55:50.172645+0000","last_became_active":"2024-04-25T22:51:53.026379+0000","last_became_peered":"2024-04-25T22:51:53.026379+0000","last_unstale":"2024-04-25T22:55:50.172645+0000","last_undegraded":"2024-04-25T22:55:50.172645+0000","last_fullsized":"2024-04-25T22:55:50.172645+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99668,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"77'256","reported_seq":372,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:00.942134+0000","last_change":"2024-04-25T22:56:00.942208+0000","last_active":"2024-04-25T22:56:00.942134+0000","last_peered":"2024-04-25T22:56:00.942134+0000","last_clean":"2024-04-25T22:56:00.942134+0000","last_became_active":"2024-04-25T22:55:32.509978+0000","last_became_peered":"2024-04-25T22:55:32.509978+0000","last_unstale":"2024-04-25T22:56:00.942134+0000","last_undegraded":"2024-04-25T22:56:00.942134+0000","last_fullsized":"2024-04-25T22:56:00.942134+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'256","last_scrub_stamp":"2024-04-25T22:56:00.942032+0000","last_deep_scrub":"77'256","last_deep_scrub_stamp":"2024-04-25T22:56:00.942032+0000","last_clean_scrub_stamp":"2024-04-25T22:56:00.942032+0000","objects_scrubbed":63,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:25:05.450727+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128069,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":128069,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"55'182","reported_seq":539,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:49.269859+0000","last_change":"2024-04-25T22:55:38.519451+0000","last_active":"2024-04-25T22:55:49.269859+0000","last_peered":"2024-04-25T22:55:49.269859+0000","last_clean":"2024-04-25T22:55:49.269859+0000","last_became_active":"2024-04-25T22:55:38.518412+0000","last_became_peered":"2024-04-25T22:55:38.518412+0000","last_unstale":"2024-04-25T22:55:49.269859+0000","last_undegraded":"2024-04-25T22:55:49.269859+0000","last_fullsized":"2024-04-25T22:55:49.269859+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":586629,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":580754,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"55'156","reported_seq":495,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859140+0000","last_change":"2024-04-25T22:55:33.512918+0000","last_active":"2024-04-25T22:55:41.859140+0000","last_peered":"2024-04-25T22:55:41.859140+0000","last_clean":"2024-04-25T22:55:41.859140+0000","last_became_active":"2024-04-25T22:55:33.512114+0000","last_became_peered":"2024-04-25T22:55:33.512114+0000","last_unstale":"2024-04-25T22:55:41.859140+0000","last_undegraded":"2024-04-25T22:55:41.859140+0000","last_fullsized":"2024-04-25T22:55:41.859140+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118861,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":118861,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"77'108","reported_seq":268,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:55.641147+0000","last_change":"2024-04-25T22:55:55.641176+0000","last_active":"2024-04-25T22:55:55.641147+0000","last_peered":"2024-04-25T22:55:55.641147+0000","last_clean":"2024-04-25T22:55:55.641147+0000","last_became_active":"2024-04-25T22:55:30.525469+0000","last_became_peered":"2024-04-25T22:55:30.525469+0000","last_unstale":"2024-04-25T22:55:55.641147+0000","last_undegraded":"2024-04-25T22:55:55.641147+0000","last_fullsized":"2024-04-25T22:55:55.641147+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'108","last_scrub_stamp":"2024-04-25T22:55:55.641069+0000","last_deep_scrub":"77'108","last_deep_scrub_stamp":"2024-04-25T22:55:55.641069+0000","last_clean_scrub_stamp":"2024-04-25T22:55:55.641069+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:35:08.836219+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2425045,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":2428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":2425011,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"77'186","reported_seq":522,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:00.614733+0000","last_change":"2024-04-25T22:56:00.614791+0000","last_active":"2024-04-25T22:56:00.614733+0000","last_peered":"2024-04-25T22:56:00.614733+0000","last_clean":"2024-04-25T22:56:00.614733+0000","last_became_active":"2024-04-25T22:55:30.524718+0000","last_became_peered":"2024-04-25T22:55:30.524718+0000","last_unstale":"2024-04-25T22:56:00.614733+0000","last_undegraded":"2024-04-25T22:56:00.614733+0000","last_fullsized":"2024-04-25T22:56:00.614733+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'186","last_scrub_stamp":"2024-04-25T22:56:00.614624+0000","last_deep_scrub":"77'186","last_deep_scrub_stamp":"2024-04-25T22:56:00.614624+0000","last_clean_scrub_stamp":"2024-04-25T22:56:00.614624+0000","objects_scrubbed":40,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:36:29.679884+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67079,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":89,"num_bytes_recovered":67079,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":49,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536030+0000","last_change":"2024-04-25T22:55:27.517626+0000","last_active":"2024-04-25T22:55:41.536030+0000","last_peered":"2024-04-25T22:55:41.536030+0000","last_clean":"2024-04-25T22:55:41.536030+0000","last_became_active":"2024-04-25T22:55:27.517208+0000","last_became_peered":"2024-04-25T22:55:27.517208+0000","last_unstale":"2024-04-25T22:55:41.536030+0000","last_undegraded":"2024-04-25T22:55:41.536030+0000","last_fullsized":"2024-04-25T22:55:41.536030+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"55'186","reported_seq":288,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536706+0000","last_change":"2024-04-25T22:55:33.513626+0000","last_active":"2024-04-25T22:55:41.536706+0000","last_peered":"2024-04-25T22:55:41.536706+0000","last_clean":"2024-04-25T22:55:41.536706+0000","last_became_active":"2024-04-25T22:55:33.512389+0000","last_became_peered":"2024-04-25T22:55:33.512389+0000","last_unstale":"2024-04-25T22:55:41.536706+0000","last_undegraded":"2024-04-25T22:55:41.536706+0000","last_fullsized":"2024-04-25T22:55:41.536706+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139986,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":137763,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":140,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859106+0000","last_change":"2024-04-25T22:51:52.018646+0000","last_active":"2024-04-25T22:55:41.859106+0000","last_peered":"2024-04-25T22:55:41.859106+0000","last_clean":"2024-04-25T22:55:41.859106+0000","last_became_active":"2024-04-25T22:51:52.018313+0000","last_became_peered":"2024-04-25T22:51:52.018313+0000","last_unstale":"2024-04-25T22:55:41.859106+0000","last_undegraded":"2024-04-25T22:55:41.859106+0000","last_fullsized":"2024-04-25T22:55:41.859106+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"77'206","reported_seq":323,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:53.877246+0000","last_change":"2024-04-25T22:55:53.877285+0000","last_active":"2024-04-25T22:55:53.877246+0000","last_peered":"2024-04-25T22:55:53.877246+0000","last_clean":"2024-04-25T22:55:53.877246+0000","last_became_active":"2024-04-25T22:55:30.526276+0000","last_became_peered":"2024-04-25T22:55:30.526276+0000","last_unstale":"2024-04-25T22:55:53.877246+0000","last_undegraded":"2024-04-25T22:55:53.877246+0000","last_fullsized":"2024-04-25T22:55:53.877246+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'206","last_scrub_stamp":"2024-04-25T22:55:53.877171+0000","last_deep_scrub":"77'206","last_deep_scrub_stamp":"2024-04-25T22:55:53.877171+0000","last_clean_scrub_stamp":"2024-04-25T22:55:53.877171+0000","objects_scrubbed":39,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:15:37.908265+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87849,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":87849,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":146,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535721+0000","last_change":"2024-04-25T22:51:52.021510+0000","last_active":"2024-04-25T22:55:41.535721+0000","last_peered":"2024-04-25T22:55:41.535721+0000","last_clean":"2024-04-25T22:55:41.535721+0000","last_became_active":"2024-04-25T22:51:52.021145+0000","last_became_peered":"2024-04-25T22:51:52.021145+0000","last_unstale":"2024-04-25T22:55:41.535721+0000","last_undegraded":"2024-04-25T22:55:41.535721+0000","last_fullsized":"2024-04-25T22:55:41.535721+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"52'2","reported_seq":140,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536880+0000","last_change":"2024-04-25T22:51:52.021355+0000","last_active":"2024-04-25T22:55:41.536880+0000","last_peered":"2024-04-25T22:55:41.536880+0000","last_clean":"2024-04-25T22:55:41.536880+0000","last_became_active":"2024-04-25T22:51:52.020860+0000","last_became_peered":"2024-04-25T22:51:52.020860+0000","last_unstale":"2024-04-25T22:55:41.536880+0000","last_undegraded":"2024-04-25T22:55:41.536880+0000","last_fullsized":"2024-04-25T22:55:41.536880+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"77'212","reported_seq":360,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:53.659346+0000","last_change":"2024-04-25T22:55:53.659379+0000","last_active":"2024-04-25T22:55:53.659346+0000","last_peered":"2024-04-25T22:55:53.659346+0000","last_clean":"2024-04-25T22:55:53.659346+0000","last_became_active":"2024-04-25T22:51:53.029157+0000","last_became_peered":"2024-04-25T22:51:53.029157+0000","last_unstale":"2024-04-25T22:55:53.659346+0000","last_undegraded":"2024-04-25T22:55:53.659346+0000","last_fullsized":"2024-04-25T22:55:53.659346+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'212","last_scrub_stamp":"2024-04-25T22:55:53.659262+0000","last_deep_scrub":"77'212","last_deep_scrub_stamp":"2024-04-25T22:55:53.659262+0000","last_clean_scrub_stamp":"2024-04-25T22:55:53.659262+0000","objects_scrubbed":55,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:23:44.866042+0000","scrub_duration":36,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190158,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"48'3","reported_seq":143,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859633+0000","last_change":"2024-04-25T22:51:52.018856+0000","last_active":"2024-04-25T22:55:41.859633+0000","last_peered":"2024-04-25T22:55:41.859633+0000","last_clean":"2024-04-25T22:55:41.859633+0000","last_became_active":"2024-04-25T22:51:52.018390+0000","last_became_peered":"2024-04-25T22:51:52.018390+0000","last_unstale":"2024-04-25T22:55:41.859633+0000","last_undegraded":"2024-04-25T22:55:41.859633+0000","last_fullsized":"2024-04-25T22:55:41.859633+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"77'225","reported_seq":604,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:02.612487+0000","last_change":"2024-04-25T22:56:02.612518+0000","last_active":"2024-04-25T22:56:02.612487+0000","last_peered":"2024-04-25T22:56:02.612487+0000","last_clean":"2024-04-25T22:56:02.612487+0000","last_became_active":"2024-04-25T22:55:31.527049+0000","last_became_peered":"2024-04-25T22:55:31.527049+0000","last_unstale":"2024-04-25T22:56:02.612487+0000","last_undegraded":"2024-04-25T22:56:02.612487+0000","last_fullsized":"2024-04-25T22:56:02.612487+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'225","last_scrub_stamp":"2024-04-25T22:56:02.612398+0000","last_deep_scrub":"77'225","last_deep_scrub_stamp":"2024-04-25T22:56:02.612398+0000","last_clean_scrub_stamp":"2024-04-25T22:56:02.612398+0000","objects_scrubbed":54,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:11:14.389223+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":315325,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":191,"num_write_kb":549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":110,"num_bytes_recovered":301306,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":46,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536749+0000","last_change":"2024-04-25T22:55:38.519011+0000","last_active":"2024-04-25T22:55:41.536749+0000","last_peered":"2024-04-25T22:55:41.536749+0000","last_clean":"2024-04-25T22:55:41.536749+0000","last_became_active":"2024-04-25T22:55:38.517362+0000","last_became_peered":"2024-04-25T22:55:38.517362+0000","last_unstale":"2024-04-25T22:55:41.536749+0000","last_undegraded":"2024-04-25T22:55:41.536749+0000","last_fullsized":"2024-04-25T22:55:41.536749+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"55'153","reported_seq":487,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536132+0000","last_change":"2024-04-25T22:55:38.515892+0000","last_active":"2024-04-25T22:55:41.536132+0000","last_peered":"2024-04-25T22:55:41.536132+0000","last_clean":"2024-04-25T22:55:41.536132+0000","last_became_active":"2024-04-25T22:55:38.514319+0000","last_became_peered":"2024-04-25T22:55:38.514319+0000","last_unstale":"2024-04-25T22:55:41.536132+0000","last_undegraded":"2024-04-25T22:55:41.536132+0000","last_fullsized":"2024-04-25T22:55:41.536132+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97209,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":97196,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"51'1","reported_seq":124,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:53.567258+0000","last_change":"2024-04-25T22:55:53.567310+0000","last_active":"2024-04-25T22:55:53.567258+0000","last_peered":"2024-04-25T22:55:53.567258+0000","last_clean":"2024-04-25T22:55:53.567258+0000","last_became_active":"2024-04-25T22:55:38.516782+0000","last_became_peered":"2024-04-25T22:55:38.516782+0000","last_unstale":"2024-04-25T22:55:53.567258+0000","last_undegraded":"2024-04-25T22:55:53.567258+0000","last_fullsized":"2024-04-25T22:55:53.567258+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1","last_scrub_stamp":"2024-04-25T22:55:53.567155+0000","last_deep_scrub":"51'1","last_deep_scrub_stamp":"2024-04-25T22:55:53.567155+0000","last_clean_scrub_stamp":"2024-04-25T22:55:53.567155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:01:38.089809+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"77'215","reported_seq":329,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:58.929384+0000","last_change":"2024-04-25T22:55:58.929421+0000","last_active":"2024-04-25T22:55:58.929384+0000","last_peered":"2024-04-25T22:55:58.929384+0000","last_clean":"2024-04-25T22:55:58.929384+0000","last_became_active":"2024-04-25T22:55:32.510402+0000","last_became_peered":"2024-04-25T22:55:32.510402+0000","last_unstale":"2024-04-25T22:55:58.929384+0000","last_undegraded":"2024-04-25T22:55:58.929384+0000","last_fullsized":"2024-04-25T22:55:58.929384+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'215","last_scrub_stamp":"2024-04-25T22:55:58.929297+0000","last_deep_scrub":"77'215","last_deep_scrub_stamp":"2024-04-25T22:55:58.929297+0000","last_clean_scrub_stamp":"2024-04-25T22:55:58.929297+0000","objects_scrubbed":62,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:24:11.093855+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131384,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":131332,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"77'9","reported_seq":67,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:01.923353+0000","last_change":"2024-04-25T22:56:01.923412+0000","last_active":"2024-04-25T22:56:01.923353+0000","last_peered":"2024-04-25T22:56:01.923353+0000","last_clean":"2024-04-25T22:56:01.923353+0000","last_became_active":"2024-04-25T22:55:27.518709+0000","last_became_peered":"2024-04-25T22:55:27.518709+0000","last_unstale":"2024-04-25T22:56:01.923353+0000","last_undegraded":"2024-04-25T22:56:01.923353+0000","last_fullsized":"2024-04-25T22:56:01.923353+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'9","last_scrub_stamp":"2024-04-25T22:56:01.923255+0000","last_deep_scrub":"77'9","last_deep_scrub_stamp":"2024-04-25T22:56:01.923255+0000","last_clean_scrub_stamp":"2024-04-25T22:56:01.923255+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:13.276320+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"77'232","reported_seq":590,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:50.591667+0000","last_change":"2024-04-25T22:55:50.591701+0000","last_active":"2024-04-25T22:55:50.591667+0000","last_peered":"2024-04-25T22:55:50.591667+0000","last_clean":"2024-04-25T22:55:50.591667+0000","last_became_active":"2024-04-25T22:55:38.514695+0000","last_became_peered":"2024-04-25T22:55:38.514695+0000","last_unstale":"2024-04-25T22:55:50.591667+0000","last_undegraded":"2024-04-25T22:55:50.591667+0000","last_fullsized":"2024-04-25T22:55:50.591667+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'232","last_scrub_stamp":"2024-04-25T22:55:50.591565+0000","last_deep_scrub":"77'232","last_deep_scrub_stamp":"2024-04-25T22:55:50.591565+0000","last_clean_scrub_stamp":"2024-04-25T22:55:50.591565+0000","objects_scrubbed":58,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:23:41.798345+0000","scrub_duration":42,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187245,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":111,"num_bytes_recovered":187245,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":153,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:58.557552+0000","last_change":"2024-04-25T22:55:58.557578+0000","last_active":"2024-04-25T22:55:58.557552+0000","last_peered":"2024-04-25T22:55:58.557552+0000","last_clean":"2024-04-25T22:55:58.557552+0000","last_became_active":"2024-04-25T22:55:27.517404+0000","last_became_peered":"2024-04-25T22:55:27.517404+0000","last_unstale":"2024-04-25T22:55:58.557552+0000","last_undegraded":"2024-04-25T22:55:58.557552+0000","last_fullsized":"2024-04-25T22:55:58.557552+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:55:58.557460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:55:58.557460+0000","last_clean_scrub_stamp":"2024-04-25T22:55:58.557460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:35.155047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"55'163","reported_seq":299,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536605+0000","last_change":"2024-04-25T22:51:53.023929+0000","last_active":"2024-04-25T22:55:41.536605+0000","last_peered":"2024-04-25T22:55:41.536605+0000","last_clean":"2024-04-25T22:55:41.536605+0000","last_became_active":"2024-04-25T22:51:53.023405+0000","last_became_peered":"2024-04-25T22:51:53.023405+0000","last_unstale":"2024-04-25T22:55:41.536605+0000","last_undegraded":"2024-04-25T22:55:41.536605+0000","last_fullsized":"2024-04-25T22:55:41.536605+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130867,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":165,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:56.569671+0000","last_change":"2024-04-25T22:55:56.569692+0000","last_active":"2024-04-25T22:55:56.569671+0000","last_peered":"2024-04-25T22:55:56.569671+0000","last_clean":"2024-04-25T22:55:56.569671+0000","last_became_active":"2024-04-25T22:55:37.515798+0000","last_became_peered":"2024-04-25T22:55:37.515798+0000","last_unstale":"2024-04-25T22:55:56.569671+0000","last_undegraded":"2024-04-25T22:55:56.569671+0000","last_fullsized":"2024-04-25T22:55:56.569671+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:55:56.569581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:55:56.569581+0000","last_clean_scrub_stamp":"2024-04-25T22:55:56.569581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:01:41.092235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"55'139","reported_seq":275,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536564+0000","last_change":"2024-04-25T22:51:53.020574+0000","last_active":"2024-04-25T22:55:41.536564+0000","last_peered":"2024-04-25T22:55:41.536564+0000","last_clean":"2024-04-25T22:55:41.536564+0000","last_became_active":"2024-04-25T22:51:53.019978+0000","last_became_peered":"2024-04-25T22:51:53.019978+0000","last_unstale":"2024-04-25T22:55:41.536564+0000","last_undegraded":"2024-04-25T22:55:41.536564+0000","last_fullsized":"2024-04-25T22:55:41.536564+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197405,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"51'1","reported_seq":156,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:54.642180+0000","last_change":"2024-04-25T22:55:54.642205+0000","last_active":"2024-04-25T22:55:54.642180+0000","last_peered":"2024-04-25T22:55:54.642180+0000","last_clean":"2024-04-25T22:55:54.642180+0000","last_became_active":"2024-04-25T22:55:27.517330+0000","last_became_peered":"2024-04-25T22:55:27.517330+0000","last_unstale":"2024-04-25T22:55:54.642180+0000","last_undegraded":"2024-04-25T22:55:54.642180+0000","last_fullsized":"2024-04-25T22:55:54.642180+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1","last_scrub_stamp":"2024-04-25T22:55:54.642058+0000","last_deep_scrub":"51'1","last_deep_scrub_stamp":"2024-04-25T22:55:54.642058+0000","last_clean_scrub_stamp":"2024-04-25T22:55:54.642058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:48:09.797102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"77'196","reported_seq":314,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:56.855476+0000","last_change":"2024-04-25T22:55:56.855502+0000","last_active":"2024-04-25T22:55:56.855476+0000","last_peered":"2024-04-25T22:55:56.855476+0000","last_clean":"2024-04-25T22:55:56.855476+0000","last_became_active":"2024-04-25T22:55:31.528360+0000","last_became_peered":"2024-04-25T22:55:31.528360+0000","last_unstale":"2024-04-25T22:55:56.855476+0000","last_undegraded":"2024-04-25T22:55:56.855476+0000","last_fullsized":"2024-04-25T22:55:56.855476+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'196","last_scrub_stamp":"2024-04-25T22:55:56.855397+0000","last_deep_scrub":"77'196","last_deep_scrub_stamp":"2024-04-25T22:55:56.855397+0000","last_clean_scrub_stamp":"2024-04-25T22:55:56.855397+0000","objects_scrubbed":51,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:57:48.621305+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165168,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":165116,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":341,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:49.269426+0000","last_change":"2024-04-25T22:51:47.764624+0000","last_active":"2024-04-25T22:55:49.269426+0000","last_peered":"2024-04-25T22:55:49.269426+0000","last_clean":"2024-04-25T22:55:49.269426+0000","last_became_active":"2024-04-25T22:51:47.764176+0000","last_became_peered":"2024-04-25T22:51:47.764176+0000","last_unstale":"2024-04-25T22:55:49.269426+0000","last_undegraded":"2024-04-25T22:55:49.269426+0000","last_fullsized":"2024-04-25T22:55:49.269426+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":160,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:56.587621+0000","last_change":"2024-04-25T22:55:56.587621+0000","last_active":"2024-04-25T22:55:56.587621+0000","last_peered":"2024-04-25T22:55:56.587621+0000","last_clean":"2024-04-25T22:55:56.587621+0000","last_became_active":"2024-04-25T22:55:27.520951+0000","last_became_peered":"2024-04-25T22:55:27.520951+0000","last_unstale":"2024-04-25T22:55:56.587621+0000","last_undegraded":"2024-04-25T22:55:56.587621+0000","last_fullsized":"2024-04-25T22:55:56.587621+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:55:56.587508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:55:56.587508+0000","last_clean_scrub_stamp":"2024-04-25T22:55:56.587508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:58.051135+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"51'2","reported_seq":49,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536193+0000","last_change":"2024-04-25T22:55:27.520902+0000","last_active":"2024-04-25T22:55:41.536193+0000","last_peered":"2024-04-25T22:55:41.536193+0000","last_clean":"2024-04-25T22:55:41.536193+0000","last_became_active":"2024-04-25T22:55:27.520466+0000","last_became_peered":"2024-04-25T22:55:27.520466+0000","last_unstale":"2024-04-25T22:55:41.536193+0000","last_undegraded":"2024-04-25T22:55:41.536193+0000","last_fullsized":"2024-04-25T22:55:41.536193+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"77'206","reported_seq":353,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:04.664443+0000","last_change":"2024-04-25T22:56:04.664443+0000","last_active":"2024-04-25T22:56:04.664443+0000","last_peered":"2024-04-25T22:56:04.664443+0000","last_clean":"2024-04-25T22:56:04.664443+0000","last_became_active":"2024-04-25T22:51:53.023497+0000","last_became_peered":"2024-04-25T22:51:53.023497+0000","last_unstale":"2024-04-25T22:56:04.664443+0000","last_undegraded":"2024-04-25T22:56:04.664443+0000","last_fullsized":"2024-04-25T22:56:04.664443+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'206","last_scrub_stamp":"2024-04-25T22:56:04.664319+0000","last_deep_scrub":"77'206","last_deep_scrub_stamp":"2024-04-25T22:56:04.664319+0000","last_clean_scrub_stamp":"2024-04-25T22:56:04.664319+0000","objects_scrubbed":56,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:48:42.470233+0000","scrub_duration":42,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":331484,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":145,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:49.269452+0000","last_change":"2024-04-25T22:51:47.764591+0000","last_active":"2024-04-25T22:55:49.269452+0000","last_peered":"2024-04-25T22:55:49.269452+0000","last_clean":"2024-04-25T22:55:49.269452+0000","last_became_active":"2024-04-25T22:51:47.764229+0000","last_became_peered":"2024-04-25T22:51:47.764229+0000","last_unstale":"2024-04-25T22:55:49.269452+0000","last_undegraded":"2024-04-25T22:55:49.269452+0000","last_fullsized":"2024-04-25T22:55:49.269452+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"77'37","reported_seq":62,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:03.871590+0000","last_change":"2024-04-25T22:56:03.871621+0000","last_active":"2024-04-25T22:56:03.871590+0000","last_peered":"2024-04-25T22:56:03.871590+0000","last_clean":"2024-04-25T22:56:03.871590+0000","last_became_active":"2024-04-25T22:55:27.517290+0000","last_became_peered":"2024-04-25T22:55:27.517290+0000","last_unstale":"2024-04-25T22:56:03.871590+0000","last_undegraded":"2024-04-25T22:56:03.871590+0000","last_fullsized":"2024-04-25T22:56:03.871590+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'37","last_scrub_stamp":"2024-04-25T22:56:03.871504+0000","last_deep_scrub":"77'37","last_deep_scrub_stamp":"2024-04-25T22:56:03.871504+0000","last_clean_scrub_stamp":"2024-04-25T22:56:03.871504+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:19.959347+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327644,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":343,"num_write":34,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":327644,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"55'163","reported_seq":518,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859454+0000","last_change":"2024-04-25T22:55:35.519401+0000","last_active":"2024-04-25T22:55:41.859454+0000","last_peered":"2024-04-25T22:55:41.859454+0000","last_clean":"2024-04-25T22:55:41.859454+0000","last_became_active":"2024-04-25T22:55:35.518367+0000","last_became_peered":"2024-04-25T22:55:35.518367+0000","last_unstale":"2024-04-25T22:55:41.859454+0000","last_undegraded":"2024-04-25T22:55:41.859454+0000","last_fullsized":"2024-04-25T22:55:41.859454+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297937,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":181,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":282175,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":49,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536038+0000","last_change":"2024-04-25T22:55:27.519726+0000","last_active":"2024-04-25T22:55:41.536038+0000","last_peered":"2024-04-25T22:55:41.536038+0000","last_clean":"2024-04-25T22:55:41.536038+0000","last_became_active":"2024-04-25T22:55:27.518412+0000","last_became_peered":"2024-04-25T22:55:27.518412+0000","last_unstale":"2024-04-25T22:55:41.536038+0000","last_undegraded":"2024-04-25T22:55:41.536038+0000","last_fullsized":"2024-04-25T22:55:41.536038+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"51'62","reported_seq":203,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:50.172238+0000","last_change":"2024-04-25T22:51:52.018873+0000","last_active":"2024-04-25T22:55:50.172238+0000","last_peered":"2024-04-25T22:55:50.172238+0000","last_clean":"2024-04-25T22:55:50.172238+0000","last_became_active":"2024-04-25T22:51:52.018300+0000","last_became_peered":"2024-04-25T22:51:52.018300+0000","last_unstale":"2024-04-25T22:55:50.172238+0000","last_undegraded":"2024-04-25T22:55:50.172238+0000","last_fullsized":"2024-04-25T22:55:50.172238+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":4122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"55'167","reported_seq":273,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.537106+0000","last_change":"2024-04-25T22:55:32.513689+0000","last_active":"2024-04-25T22:55:41.537106+0000","last_peered":"2024-04-25T22:55:41.537106+0000","last_clean":"2024-04-25T22:55:41.537106+0000","last_became_active":"2024-04-25T22:55:32.513087+0000","last_became_peered":"2024-04-25T22:55:32.513087+0000","last_unstale":"2024-04-25T22:55:41.537106+0000","last_undegraded":"2024-04-25T22:55:41.537106+0000","last_fullsized":"2024-04-25T22:55:41.537106+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395473,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":166,"num_write_kb":573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":395432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":160,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:00.580456+0000","last_change":"2024-04-25T22:56:00.580456+0000","last_active":"2024-04-25T22:56:00.580456+0000","last_peered":"2024-04-25T22:56:00.580456+0000","last_clean":"2024-04-25T22:56:00.580456+0000","last_became_active":"2024-04-25T22:55:27.516952+0000","last_became_peered":"2024-04-25T22:55:27.516952+0000","last_unstale":"2024-04-25T22:56:00.580456+0000","last_undegraded":"2024-04-25T22:56:00.580456+0000","last_fullsized":"2024-04-25T22:56:00.580456+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:56:00.580330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:56:00.580330+0000","last_clean_scrub_stamp":"2024-04-25T22:56:00.580330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:47.557382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":124,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:49.530959+0000","last_change":"2024-04-25T22:55:49.530959+0000","last_active":"2024-04-25T22:55:49.530959+0000","last_peered":"2024-04-25T22:55:49.530959+0000","last_clean":"2024-04-25T22:55:49.530959+0000","last_became_active":"2024-04-25T22:55:38.516294+0000","last_became_peered":"2024-04-25T22:55:38.516294+0000","last_unstale":"2024-04-25T22:55:49.530959+0000","last_undegraded":"2024-04-25T22:55:49.530959+0000","last_fullsized":"2024-04-25T22:55:49.530959+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:55:49.530819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:55:49.530819+0000","last_clean_scrub_stamp":"2024-04-25T22:55:49.530819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:10:32.958355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"77'212","reported_seq":330,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:54.853393+0000","last_change":"2024-04-25T22:55:54.853423+0000","last_active":"2024-04-25T22:55:54.853393+0000","last_peered":"2024-04-25T22:55:54.853393+0000","last_clean":"2024-04-25T22:55:54.853393+0000","last_became_active":"2024-04-25T22:55:31.526666+0000","last_became_peered":"2024-04-25T22:55:31.526666+0000","last_unstale":"2024-04-25T22:55:54.853393+0000","last_undegraded":"2024-04-25T22:55:54.853393+0000","last_fullsized":"2024-04-25T22:55:54.853393+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'212","last_scrub_stamp":"2024-04-25T22:55:54.853320+0000","last_deep_scrub":"77'212","last_deep_scrub_stamp":"2024-04-25T22:55:54.853320+0000","last_clean_scrub_stamp":"2024-04-25T22:55:54.853320+0000","objects_scrubbed":56,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:21:54.921835+0000","scrub_duration":36,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100051,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":100051,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"52'1","reported_seq":155,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:02.589864+0000","last_change":"2024-04-25T22:56:02.589864+0000","last_active":"2024-04-25T22:56:02.589864+0000","last_peered":"2024-04-25T22:56:02.589864+0000","last_clean":"2024-04-25T22:56:02.589864+0000","last_became_active":"2024-04-25T22:55:27.516760+0000","last_became_peered":"2024-04-25T22:55:27.516760+0000","last_unstale":"2024-04-25T22:56:02.589864+0000","last_undegraded":"2024-04-25T22:56:02.589864+0000","last_fullsized":"2024-04-25T22:56:02.589864+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'1","last_scrub_stamp":"2024-04-25T22:56:02.589755+0000","last_deep_scrub":"52'1","last_deep_scrub_stamp":"2024-04-25T22:56:02.589755+0000","last_clean_scrub_stamp":"2024-04-25T22:56:02.589755+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:06:55.590048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536227+0000","last_change":"2024-04-25T22:55:27.517202+0000","last_active":"2024-04-25T22:55:41.536227+0000","last_peered":"2024-04-25T22:55:41.536227+0000","last_clean":"2024-04-25T22:55:41.536227+0000","last_became_active":"2024-04-25T22:55:27.516272+0000","last_became_peered":"2024-04-25T22:55:27.516272+0000","last_unstale":"2024-04-25T22:55:41.536227+0000","last_undegraded":"2024-04-25T22:55:41.536227+0000","last_fullsized":"2024-04-25T22:55:41.536227+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"55'155","reported_seq":294,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:50.172457+0000","last_change":"2024-04-25T22:51:53.026321+0000","last_active":"2024-04-25T22:55:50.172457+0000","last_peered":"2024-04-25T22:55:50.172457+0000","last_clean":"2024-04-25T22:55:50.172457+0000","last_became_active":"2024-04-25T22:51:53.025824+0000","last_became_peered":"2024-04-25T22:51:53.025824+0000","last_unstale":"2024-04-25T22:55:50.172457+0000","last_undegraded":"2024-04-25T22:55:50.172457+0000","last_fullsized":"2024-04-25T22:55:50.172457+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67397,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":49,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536504+0000","last_change":"2024-04-25T22:55:27.516710+0000","last_active":"2024-04-25T22:55:41.536504+0000","last_peered":"2024-04-25T22:55:41.536504+0000","last_clean":"2024-04-25T22:55:41.536504+0000","last_became_active":"2024-04-25T22:55:27.515536+0000","last_became_peered":"2024-04-25T22:55:27.515536+0000","last_unstale":"2024-04-25T22:55:41.536504+0000","last_undegraded":"2024-04-25T22:55:41.536504+0000","last_fullsized":"2024-04-25T22:55:41.536504+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":162,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:52.582267+0000","last_change":"2024-04-25T22:55:52.582267+0000","last_active":"2024-04-25T22:55:52.582267+0000","last_peered":"2024-04-25T22:55:52.582267+0000","last_clean":"2024-04-25T22:55:52.582267+0000","last_became_active":"2024-04-25T22:55:27.517411+0000","last_became_peered":"2024-04-25T22:55:27.517411+0000","last_unstale":"2024-04-25T22:55:52.582267+0000","last_undegraded":"2024-04-25T22:55:52.582267+0000","last_fullsized":"2024-04-25T22:55:52.582267+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:55:52.582138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:55:52.582138+0000","last_clean_scrub_stamp":"2024-04-25T22:55:52.582138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:31.301317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"77'233","reported_seq":382,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:05.650553+0000","last_change":"2024-04-25T22:56:05.650553+0000","last_active":"2024-04-25T22:56:05.650553+0000","last_peered":"2024-04-25T22:56:05.650553+0000","last_clean":"2024-04-25T22:56:05.650553+0000","last_became_active":"2024-04-25T22:51:53.026458+0000","last_became_peered":"2024-04-25T22:51:53.026458+0000","last_unstale":"2024-04-25T22:56:05.650553+0000","last_undegraded":"2024-04-25T22:56:05.650553+0000","last_fullsized":"2024-04-25T22:56:05.650553+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'233","last_scrub_stamp":"2024-04-25T22:56:05.650442+0000","last_deep_scrub":"77'233","last_deep_scrub_stamp":"2024-04-25T22:56:05.650442+0000","last_clean_scrub_stamp":"2024-04-25T22:56:05.650442+0000","objects_scrubbed":58,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:06:58.650736+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192819,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":53,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536866+0000","last_change":"2024-04-25T22:55:27.519827+0000","last_active":"2024-04-25T22:55:41.536866+0000","last_peered":"2024-04-25T22:55:41.536866+0000","last_clean":"2024-04-25T22:55:41.536866+0000","last_became_active":"2024-04-25T22:55:27.518853+0000","last_became_peered":"2024-04-25T22:55:27.518853+0000","last_unstale":"2024-04-25T22:55:41.536866+0000","last_undegraded":"2024-04-25T22:55:41.536866+0000","last_fullsized":"2024-04-25T22:55:41.536866+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":49,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536581+0000","last_change":"2024-04-25T22:55:27.519804+0000","last_active":"2024-04-25T22:55:41.536581+0000","last_peered":"2024-04-25T22:55:41.536581+0000","last_clean":"2024-04-25T22:55:41.536581+0000","last_became_active":"2024-04-25T22:55:27.518183+0000","last_became_peered":"2024-04-25T22:55:27.518183+0000","last_unstale":"2024-04-25T22:55:41.536581+0000","last_undegraded":"2024-04-25T22:55:41.536581+0000","last_fullsized":"2024-04-25T22:55:41.536581+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"55'172","reported_seq":506,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536113+0000","last_change":"2024-04-25T22:55:40.539104+0000","last_active":"2024-04-25T22:55:41.536113+0000","last_peered":"2024-04-25T22:55:41.536113+0000","last_clean":"2024-04-25T22:55:41.536113+0000","last_became_active":"2024-04-25T22:55:40.538335+0000","last_became_peered":"2024-04-25T22:55:40.538335+0000","last_unstale":"2024-04-25T22:55:41.536113+0000","last_undegraded":"2024-04-25T22:55:41.536113+0000","last_fullsized":"2024-04-25T22:55:41.536113+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505702,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":1011342,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"77'38","reported_seq":77,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:59.886374+0000","last_change":"2024-04-25T22:55:59.886399+0000","last_active":"2024-04-25T22:55:59.886374+0000","last_peered":"2024-04-25T22:55:59.886374+0000","last_clean":"2024-04-25T22:55:59.886374+0000","last_became_active":"2024-04-25T22:55:27.518193+0000","last_became_peered":"2024-04-25T22:55:27.518193+0000","last_unstale":"2024-04-25T22:55:59.886374+0000","last_undegraded":"2024-04-25T22:55:59.886374+0000","last_fullsized":"2024-04-25T22:55:59.886374+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'38","last_scrub_stamp":"2024-04-25T22:55:59.886295+0000","last_deep_scrub":"77'38","last_deep_scrub_stamp":"2024-04-25T22:55:59.886295+0000","last_clean_scrub_stamp":"2024-04-25T22:55:59.886295+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:47.715262+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":144,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536866+0000","last_change":"2024-04-25T22:51:47.764288+0000","last_active":"2024-04-25T22:55:41.536866+0000","last_peered":"2024-04-25T22:55:41.536866+0000","last_clean":"2024-04-25T22:55:41.536866+0000","last_became_active":"2024-04-25T22:51:47.763961+0000","last_became_peered":"2024-04-25T22:51:47.763961+0000","last_unstale":"2024-04-25T22:55:41.536866+0000","last_undegraded":"2024-04-25T22:55:41.536866+0000","last_fullsized":"2024-04-25T22:55:41.536866+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:46.754798+0000","last_clean_scrub_stamp":"2024-04-25T22:51:46.754798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"55'142","reported_seq":281,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:50.172426+0000","last_change":"2024-04-25T22:51:53.026925+0000","last_active":"2024-04-25T22:55:50.172426+0000","last_peered":"2024-04-25T22:55:50.172426+0000","last_clean":"2024-04-25T22:55:50.172426+0000","last_became_active":"2024-04-25T22:51:53.026419+0000","last_became_peered":"2024-04-25T22:51:53.026419+0000","last_unstale":"2024-04-25T22:55:50.172426+0000","last_undegraded":"2024-04-25T22:55:50.172426+0000","last_fullsized":"2024-04-25T22:55:50.172426+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":246196,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"55'162","reported_seq":298,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535998+0000","last_change":"2024-04-25T22:51:53.022222+0000","last_active":"2024-04-25T22:55:41.535998+0000","last_peered":"2024-04-25T22:55:41.535998+0000","last_clean":"2024-04-25T22:55:41.535998+0000","last_became_active":"2024-04-25T22:51:53.021687+0000","last_became_peered":"2024-04-25T22:51:53.021687+0000","last_unstale":"2024-04-25T22:55:41.535998+0000","last_undegraded":"2024-04-25T22:55:41.535998+0000","last_fullsized":"2024-04-25T22:55:41.535998+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108265,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"60'43","reported_seq":181,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536420+0000","last_change":"2024-04-25T22:51:52.019928+0000","last_active":"2024-04-25T22:55:41.536420+0000","last_peered":"2024-04-25T22:55:41.536420+0000","last_clean":"2024-04-25T22:55:41.536420+0000","last_became_active":"2024-04-25T22:51:52.019264+0000","last_became_peered":"2024-04-25T22:51:52.019264+0000","last_unstale":"2024-04-25T22:55:41.536420+0000","last_undegraded":"2024-04-25T22:55:41.536420+0000","last_fullsized":"2024-04-25T22:55:41.536420+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"77'198","reported_seq":316,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:52.879444+0000","last_change":"2024-04-25T22:55:52.879477+0000","last_active":"2024-04-25T22:55:52.879444+0000","last_peered":"2024-04-25T22:55:52.879444+0000","last_clean":"2024-04-25T22:55:52.879444+0000","last_became_active":"2024-04-25T22:55:31.526620+0000","last_became_peered":"2024-04-25T22:55:31.526620+0000","last_unstale":"2024-04-25T22:55:52.879444+0000","last_undegraded":"2024-04-25T22:55:52.879444+0000","last_fullsized":"2024-04-25T22:55:52.879444+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'198","last_scrub_stamp":"2024-04-25T22:55:52.879360+0000","last_deep_scrub":"77'198","last_deep_scrub_stamp":"2024-04-25T22:55:52.879360+0000","last_clean_scrub_stamp":"2024-04-25T22:55:52.879360+0000","objects_scrubbed":52,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:57:55.235548+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89309,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":89309,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"53'21","reported_seq":161,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859726+0000","last_change":"2024-04-25T22:51:52.018977+0000","last_active":"2024-04-25T22:55:41.859726+0000","last_peered":"2024-04-25T22:55:41.859726+0000","last_clean":"2024-04-25T22:55:41.859726+0000","last_became_active":"2024-04-25T22:51:52.018519+0000","last_became_peered":"2024-04-25T22:51:52.018519+0000","last_unstale":"2024-04-25T22:55:41.859726+0000","last_undegraded":"2024-04-25T22:55:41.859726+0000","last_fullsized":"2024-04-25T22:55:41.859726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"48'1","reported_seq":124,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:51.520874+0000","last_change":"2024-04-25T22:55:51.520917+0000","last_active":"2024-04-25T22:55:51.520874+0000","last_peered":"2024-04-25T22:55:51.520874+0000","last_clean":"2024-04-25T22:55:51.520874+0000","last_became_active":"2024-04-25T22:55:38.515986+0000","last_became_peered":"2024-04-25T22:55:38.515986+0000","last_unstale":"2024-04-25T22:55:51.520874+0000","last_undegraded":"2024-04-25T22:55:51.520874+0000","last_fullsized":"2024-04-25T22:55:51.520874+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1","last_scrub_stamp":"2024-04-25T22:55:51.520773+0000","last_deep_scrub":"48'1","last_deep_scrub_stamp":"2024-04-25T22:55:51.520773+0000","last_clean_scrub_stamp":"2024-04-25T22:55:51.520773+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:48:06.675817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"77'236","reported_seq":354,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:55.886996+0000","last_change":"2024-04-25T22:55:55.887042+0000","last_active":"2024-04-25T22:55:55.886996+0000","last_peered":"2024-04-25T22:55:55.886996+0000","last_clean":"2024-04-25T22:55:55.886996+0000","last_became_active":"2024-04-25T22:55:30.525233+0000","last_became_peered":"2024-04-25T22:55:30.525233+0000","last_unstale":"2024-04-25T22:55:55.886996+0000","last_undegraded":"2024-04-25T22:55:55.886996+0000","last_fullsized":"2024-04-25T22:55:55.886996+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'236","last_scrub_stamp":"2024-04-25T22:55:55.886909+0000","last_deep_scrub":"77'236","last_deep_scrub_stamp":"2024-04-25T22:55:55.886909+0000","last_clean_scrub_stamp":"2024-04-25T22:55:55.886909+0000","objects_scrubbed":65,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:07:00.547163+0000","scrub_duration":42,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":332166,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":329490,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"51'2","reported_seq":49,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536991+0000","last_change":"2024-04-25T22:55:27.519530+0000","last_active":"2024-04-25T22:55:41.536991+0000","last_peered":"2024-04-25T22:55:41.536991+0000","last_clean":"2024-04-25T22:55:41.536991+0000","last_became_active":"2024-04-25T22:55:27.518244+0000","last_became_peered":"2024-04-25T22:55:27.518244+0000","last_unstale":"2024-04-25T22:55:41.536991+0000","last_undegraded":"2024-04-25T22:55:41.536991+0000","last_fullsized":"2024-04-25T22:55:41.536991+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"77'208","reported_seq":328,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:50.910764+0000","last_change":"2024-04-25T22:55:50.910790+0000","last_active":"2024-04-25T22:55:50.910764+0000","last_peered":"2024-04-25T22:55:50.910764+0000","last_clean":"2024-04-25T22:55:50.910764+0000","last_became_active":"2024-04-25T22:55:30.526853+0000","last_became_peered":"2024-04-25T22:55:30.526853+0000","last_unstale":"2024-04-25T22:55:50.910764+0000","last_undegraded":"2024-04-25T22:55:50.910764+0000","last_fullsized":"2024-04-25T22:55:50.910764+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'208","last_scrub_stamp":"2024-04-25T22:55:50.910652+0000","last_deep_scrub":"77'208","last_deep_scrub_stamp":"2024-04-25T22:55:50.910652+0000","last_clean_scrub_stamp":"2024-04-25T22:55:50.910652+0000","objects_scrubbed":50,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:21:47.382105+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70967,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":70967,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"77'222","reported_seq":371,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:55.635725+0000","last_change":"2024-04-25T22:55:55.635725+0000","last_active":"2024-04-25T22:55:55.635725+0000","last_peered":"2024-04-25T22:55:55.635725+0000","last_clean":"2024-04-25T22:55:55.635725+0000","last_became_active":"2024-04-25T22:51:53.028635+0000","last_became_peered":"2024-04-25T22:51:53.028635+0000","last_unstale":"2024-04-25T22:55:55.635725+0000","last_undegraded":"2024-04-25T22:55:55.635725+0000","last_fullsized":"2024-04-25T22:55:55.635725+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'222","last_scrub_stamp":"2024-04-25T22:55:55.635582+0000","last_deep_scrub":"77'222","last_deep_scrub_stamp":"2024-04-25T22:55:55.635582+0000","last_clean_scrub_stamp":"2024-04-25T22:55:55.635582+0000","objects_scrubbed":50,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:02.536428+0000","scrub_duration":42,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":440592,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"50'1","reported_seq":49,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535663+0000","last_change":"2024-04-25T22:55:27.516136+0000","last_active":"2024-04-25T22:55:41.535663+0000","last_peered":"2024-04-25T22:55:41.535663+0000","last_clean":"2024-04-25T22:55:41.535663+0000","last_became_active":"2024-04-25T22:55:27.515473+0000","last_became_peered":"2024-04-25T22:55:27.515473+0000","last_unstale":"2024-04-25T22:55:41.535663+0000","last_undegraded":"2024-04-25T22:55:41.535663+0000","last_fullsized":"2024-04-25T22:55:41.535663+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"55'151","reported_seq":251,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536814+0000","last_change":"2024-04-25T22:55:34.513243+0000","last_active":"2024-04-25T22:55:41.536814+0000","last_peered":"2024-04-25T22:55:41.536814+0000","last_clean":"2024-04-25T22:55:41.536814+0000","last_became_active":"2024-04-25T22:55:34.512137+0000","last_became_peered":"2024-04-25T22:55:34.512137+0000","last_unstale":"2024-04-25T22:55:41.536814+0000","last_undegraded":"2024-04-25T22:55:41.536814+0000","last_fullsized":"2024-04-25T22:55:41.536814+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106917,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":97731,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":77,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535729+0000","last_change":"2024-04-25T22:55:37.514177+0000","last_active":"2024-04-25T22:55:41.535729+0000","last_peered":"2024-04-25T22:55:41.535729+0000","last_clean":"2024-04-25T22:55:41.535729+0000","last_became_active":"2024-04-25T22:55:37.513925+0000","last_became_peered":"2024-04-25T22:55:37.513925+0000","last_unstale":"2024-04-25T22:55:41.535729+0000","last_undegraded":"2024-04-25T22:55:41.535729+0000","last_fullsized":"2024-04-25T22:55:41.535729+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"77'263","reported_seq":411,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:01.626542+0000","last_change":"2024-04-25T22:56:01.626594+0000","last_active":"2024-04-25T22:56:01.626542+0000","last_peered":"2024-04-25T22:56:01.626542+0000","last_clean":"2024-04-25T22:56:01.626542+0000","last_became_active":"2024-04-25T22:51:53.027541+0000","last_became_peered":"2024-04-25T22:51:53.027541+0000","last_unstale":"2024-04-25T22:56:01.626542+0000","last_undegraded":"2024-04-25T22:56:01.626542+0000","last_fullsized":"2024-04-25T22:56:01.626542+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'263","last_scrub_stamp":"2024-04-25T22:56:01.626434+0000","last_deep_scrub":"77'263","last_deep_scrub_stamp":"2024-04-25T22:56:01.626434+0000","last_clean_scrub_stamp":"2024-04-25T22:56:01.626434+0000","objects_scrubbed":60,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:38.224020+0000","scrub_duration":49,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195653,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"77'3","reported_seq":163,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:58.589105+0000","last_change":"2024-04-25T22:55:58.589150+0000","last_active":"2024-04-25T22:55:58.589105+0000","last_peered":"2024-04-25T22:55:58.589105+0000","last_clean":"2024-04-25T22:55:58.589105+0000","last_became_active":"2024-04-25T22:55:27.517718+0000","last_became_peered":"2024-04-25T22:55:27.517718+0000","last_unstale":"2024-04-25T22:55:58.589105+0000","last_undegraded":"2024-04-25T22:55:58.589105+0000","last_fullsized":"2024-04-25T22:55:58.589105+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'3","last_scrub_stamp":"2024-04-25T22:55:58.588997+0000","last_deep_scrub":"77'3","last_deep_scrub_stamp":"2024-04-25T22:55:58.588997+0000","last_clean_scrub_stamp":"2024-04-25T22:55:58.588997+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:35:11.784147+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"77'224","reported_seq":591,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:51.611484+0000","last_change":"2024-04-25T22:55:51.611515+0000","last_active":"2024-04-25T22:55:51.611484+0000","last_peered":"2024-04-25T22:55:51.611484+0000","last_clean":"2024-04-25T22:55:51.611484+0000","last_became_active":"2024-04-25T22:55:34.513433+0000","last_became_peered":"2024-04-25T22:55:34.513433+0000","last_unstale":"2024-04-25T22:55:51.611484+0000","last_undegraded":"2024-04-25T22:55:51.611484+0000","last_fullsized":"2024-04-25T22:55:51.611484+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'224","last_scrub_stamp":"2024-04-25T22:55:51.611408+0000","last_deep_scrub":"77'224","last_deep_scrub_stamp":"2024-04-25T22:55:51.611408+0000","last_clean_scrub_stamp":"2024-04-25T22:55:51.611408+0000","objects_scrubbed":56,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:28:09.655049+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151921,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":151921,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"47'5","reported_seq":171,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859423+0000","last_change":"2024-04-25T22:55:37.559449+0000","last_active":"2024-04-25T22:55:41.859423+0000","last_peered":"2024-04-25T22:55:41.859423+0000","last_clean":"2024-04-25T22:55:41.859423+0000","last_became_active":"2024-04-25T22:55:37.516119+0000","last_became_peered":"2024-04-25T22:55:37.516119+0000","last_unstale":"2024-04-25T22:55:41.859423+0000","last_undegraded":"2024-04-25T22:55:41.859423+0000","last_fullsized":"2024-04-25T22:55:41.859423+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"55'166","reported_seq":506,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535916+0000","last_change":"2024-04-25T22:55:38.518734+0000","last_active":"2024-04-25T22:55:41.535916+0000","last_peered":"2024-04-25T22:55:41.535916+0000","last_clean":"2024-04-25T22:55:41.535916+0000","last_became_active":"2024-04-25T22:55:38.516260+0000","last_became_peered":"2024-04-25T22:55:38.516260+0000","last_unstale":"2024-04-25T22:55:41.535916+0000","last_undegraded":"2024-04-25T22:55:41.535916+0000","last_fullsized":"2024-04-25T22:55:41.535916+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3798024,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":3871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":3798024,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":21,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536004+0000","last_change":"2024-04-25T22:55:38.520672+0000","last_active":"2024-04-25T22:55:41.536004+0000","last_peered":"2024-04-25T22:55:41.536004+0000","last_clean":"2024-04-25T22:55:41.536004+0000","last_became_active":"2024-04-25T22:55:38.515776+0000","last_became_peered":"2024-04-25T22:55:38.515776+0000","last_unstale":"2024-04-25T22:55:41.536004+0000","last_undegraded":"2024-04-25T22:55:41.536004+0000","last_fullsized":"2024-04-25T22:55:41.536004+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"77'215","reported_seq":563,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:52.576305+0000","last_change":"2024-04-25T22:55:52.576340+0000","last_active":"2024-04-25T22:55:52.576305+0000","last_peered":"2024-04-25T22:55:52.576305+0000","last_clean":"2024-04-25T22:55:52.576305+0000","last_became_active":"2024-04-25T22:55:38.514732+0000","last_became_peered":"2024-04-25T22:55:38.514732+0000","last_unstale":"2024-04-25T22:55:52.576305+0000","last_undegraded":"2024-04-25T22:55:52.576305+0000","last_fullsized":"2024-04-25T22:55:52.576305+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'215","last_scrub_stamp":"2024-04-25T22:55:52.576225+0000","last_deep_scrub":"77'215","last_deep_scrub_stamp":"2024-04-25T22:55:52.576225+0000","last_clean_scrub_stamp":"2024-04-25T22:55:52.576225+0000","objects_scrubbed":57,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:46:59.477071+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141656,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":141656,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"50'57","reported_seq":197,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859589+0000","last_change":"2024-04-25T22:51:52.019032+0000","last_active":"2024-04-25T22:55:41.859589+0000","last_peered":"2024-04-25T22:55:41.859589+0000","last_clean":"2024-04-25T22:55:41.859589+0000","last_became_active":"2024-04-25T22:51:52.018547+0000","last_became_peered":"2024-04-25T22:51:52.018547+0000","last_unstale":"2024-04-25T22:55:41.859589+0000","last_undegraded":"2024-04-25T22:55:41.859589+0000","last_fullsized":"2024-04-25T22:55:41.859589+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":8213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"55'169","reported_seq":536,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.859430+0000","last_change":"2024-04-25T22:55:35.518155+0000","last_active":"2024-04-25T22:55:41.859430+0000","last_peered":"2024-04-25T22:55:41.859430+0000","last_clean":"2024-04-25T22:55:41.859430+0000","last_became_active":"2024-04-25T22:55:35.517149+0000","last_became_peered":"2024-04-25T22:55:35.517149+0000","last_unstale":"2024-04-25T22:55:41.859430+0000","last_undegraded":"2024-04-25T22:55:41.859430+0000","last_fullsized":"2024-04-25T22:55:41.859430+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184603,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":194,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":166098,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"77'26","reported_seq":66,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:57.865558+0000","last_change":"2024-04-25T22:55:57.865590+0000","last_active":"2024-04-25T22:55:57.865558+0000","last_peered":"2024-04-25T22:55:57.865558+0000","last_clean":"2024-04-25T22:55:57.865558+0000","last_became_active":"2024-04-25T22:55:27.520617+0000","last_became_peered":"2024-04-25T22:55:27.520617+0000","last_unstale":"2024-04-25T22:55:57.865558+0000","last_undegraded":"2024-04-25T22:55:57.865558+0000","last_fullsized":"2024-04-25T22:55:57.865558+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'26","last_scrub_stamp":"2024-04-25T22:55:57.865473+0000","last_deep_scrub":"77'26","last_deep_scrub_stamp":"2024-04-25T22:55:57.865473+0000","last_clean_scrub_stamp":"2024-04-25T22:55:57.865473+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:12.757049+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"77'261","reported_seq":670,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:59.604940+0000","last_change":"2024-04-25T22:55:59.604979+0000","last_active":"2024-04-25T22:55:59.604940+0000","last_peered":"2024-04-25T22:55:59.604940+0000","last_clean":"2024-04-25T22:55:59.604940+0000","last_became_active":"2024-04-25T22:55:31.526322+0000","last_became_peered":"2024-04-25T22:55:31.526322+0000","last_unstale":"2024-04-25T22:55:59.604940+0000","last_undegraded":"2024-04-25T22:55:59.604940+0000","last_fullsized":"2024-04-25T22:55:59.604940+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'261","last_scrub_stamp":"2024-04-25T22:55:59.604843+0000","last_deep_scrub":"77'261","last_deep_scrub_stamp":"2024-04-25T22:55:59.604843+0000","last_clean_scrub_stamp":"2024-04-25T22:55:59.604843+0000","objects_scrubbed":65,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:11:11.381669+0000","scrub_duration":48,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200980,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":211,"num_write_kb":410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":126,"num_bytes_recovered":197679,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"48'7","reported_seq":99,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.536730+0000","last_change":"2024-04-25T22:55:37.541050+0000","last_active":"2024-04-25T22:55:41.536730+0000","last_peered":"2024-04-25T22:55:41.536730+0000","last_clean":"2024-04-25T22:55:41.536730+0000","last_became_active":"2024-04-25T22:55:37.516183+0000","last_became_peered":"2024-04-25T22:55:37.516183+0000","last_unstale":"2024-04-25T22:55:41.536730+0000","last_undegraded":"2024-04-25T22:55:41.536730+0000","last_fullsized":"2024-04-25T22:55:41.536730+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:50.996034+0000","last_clean_scrub_stamp":"2024-04-25T22:51:50.996034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8389190,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26691649,"num_objects":3448,"num_object_clones":0,"num_object_copies":6896,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3448,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10583,"num_write_kb":38991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4953,"num_bytes_recovered":24173691,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73056256,"data_stored":53061590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12182,"ondisk_log_size":12182,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":40502861,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":34,"num_read_kb":343,"num_write":470,"num_write_kb":40224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":32113365,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":81068032,"data_stored":81005722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5351,"internal_metadata":0},"log_size":443,"ondisk_log_size":443,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738424,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88980,"kb_used_data":49484,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94282860,"statfs":{"total":96636764160,"available":96545648640,"internally_reserved":0,"allocated":50671616,"data_stored":43771464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":62,"seq":266287972362,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72760,"kb_used_data":45232,"kb_used_omap":6,"kb_used_meta":27513,"kb_avail":94299080,"statfs":{"total":96636764160,"available":96562257920,"internally_reserved":0,"allocated":46317568,"data_stored":38899263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6946,"internal_metadata":28173534},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738424,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108136,"kb_used_data":58912,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94263704,"statfs":{"total":96636764160,"available":96526032896,"internally_reserved":0,"allocated":60325888,"data_stored":53539649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32145408,"data_stored":32114253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19542016,"data_stored":19530487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5351,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":29380608,"data_stored":29360982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":26918912,"data_stored":20514252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26107904,"data_stored":19048000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20029440,"data_stored":13499338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:56:10.859 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.859 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.860 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.860 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.860 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.860 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.860 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.861 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.861 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.861 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.861 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.861 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.861 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.862 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.862 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.862 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.862 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.862 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.863 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-25T22:51:50.996034+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.863 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.863 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-25T22:51:50.996034+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.863 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-25T22:51:50.996034+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.863 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-25T22:51:50.996034+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.863 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-25T22:51:50.996034+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.864 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-25T22:51:50.996034+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.864 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.864 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.864 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.865 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-25T22:51:46.754798+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=46, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.865 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-25T22:51:50.996034+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.865 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-25T22:51:46.754798+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=46, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.865 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.865 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-25T22:51:46.754798+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=46, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.866 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-25T22:51:50.996034+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.866 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.866 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-25T22:51:46.754798+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=46, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.866 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.866 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-25T22:51:50.996034+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.867 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-25T22:51:50.996034+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.867 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-25T22:51:46.754798+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=46, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.867 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.867 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-25T22:51:46.754798+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=46, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.867 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.867 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.867 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-25T22:51:50.996034+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.868 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-25T22:51:50.996034+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.868 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-25T22:51:50.996034+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.868 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-25T22:51:50.996034+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.868 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.868 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-25T22:51:50.996034+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.869 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-25T22:51:50.996034+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.869 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.869 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-25T22:51:50.996034+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.869 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-25T22:51:50.996034+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.869 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.869 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-25T22:51:50.996034+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=50, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:10.870 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T22:56:30.871 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:56:31.184 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:56:31.186 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-25T22:56:31.195 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":217,"stamp":"2024-04-25T22:56:29.998859+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":67784878,"num_objects":3482,"num_object_clones":0,"num_object_copies":6964,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3482,"num_whiteouts":0,"num_read":170,"num_read_kb":461,"num_write":11256,"num_write_kb":82675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4966,"num_bytes_recovered":56287056,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14437,"ondisk_log_size":14437,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":283764,"kb_used_data":153628,"kb_used_omap":9,"kb_used_meta":130102,"kb_avail":282831756,"statfs":{"total":289910292480,"available":289619718144,"internally_reserved":0,"allocated":157315072,"data_stored":136210376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10136,"internal_metadata":133224552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003359"},"pg_stats":[{"pgid":"4.3f","version":"77'217","reported_seq":585,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:50.585741+0000","last_change":"2024-04-25T22:55:50.585741+0000","last_active":"2024-04-25T22:55:50.585741+0000","last_peered":"2024-04-25T22:55:50.585741+0000","last_clean":"2024-04-25T22:55:50.585741+0000","last_became_active":"2024-04-25T22:55:34.514302+0000","last_became_peered":"2024-04-25T22:55:34.514302+0000","last_unstale":"2024-04-25T22:55:50.585741+0000","last_undegraded":"2024-04-25T22:55:50.585741+0000","last_fullsized":"2024-04-25T22:55:50.585741+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'217","last_scrub_stamp":"2024-04-25T22:55:50.585625+0000","last_deep_scrub":"77'217","last_deep_scrub_stamp":"2024-04-25T22:55:50.585625+0000","last_clean_scrub_stamp":"2024-04-25T22:55:50.585625+0000","objects_scrubbed":57,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:45:04.825113+0000","scrub_duration":49,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168293,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":168293,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"77'203","reported_seq":557,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:20.792834+0000","last_change":"2024-04-25T22:56:20.792868+0000","last_active":"2024-04-25T22:56:20.792834+0000","last_peered":"2024-04-25T22:56:20.792834+0000","last_clean":"2024-04-25T22:56:20.792834+0000","last_became_active":"2024-04-25T22:55:35.517561+0000","last_became_peered":"2024-04-25T22:55:35.517561+0000","last_unstale":"2024-04-25T22:56:20.792834+0000","last_undegraded":"2024-04-25T22:56:20.792834+0000","last_fullsized":"2024-04-25T22:56:20.792834+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'203","last_scrub_stamp":"2024-04-25T22:56:20.792752+0000","last_deep_scrub":"77'203","last_deep_scrub_stamp":"2024-04-25T22:56:20.792752+0000","last_clean_scrub_stamp":"2024-04-25T22:56:20.792752+0000","objects_scrubbed":50,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:44:59.375371+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286387,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":286387,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"77'214","reported_seq":299,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:22.645908+0000","last_change":"2024-04-25T22:56:22.645962+0000","last_active":"2024-04-25T22:56:22.645908+0000","last_peered":"2024-04-25T22:56:22.645908+0000","last_clean":"2024-04-25T22:56:22.645908+0000","last_became_active":"2024-04-25T22:55:38.517874+0000","last_became_peered":"2024-04-25T22:55:38.517874+0000","last_unstale":"2024-04-25T22:56:22.645908+0000","last_undegraded":"2024-04-25T22:56:22.645908+0000","last_fullsized":"2024-04-25T22:56:22.645908+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'214","last_scrub_stamp":"2024-04-25T22:56:22.645808+0000","last_deep_scrub":"77'214","last_deep_scrub_stamp":"2024-04-25T22:56:22.645808+0000","last_clean_scrub_stamp":"2024-04-25T22:56:22.645808+0000","objects_scrubbed":50,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:40.654822+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130188,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"77'173","reported_seq":481,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:54.624422+0000","last_change":"2024-04-25T22:55:54.624422+0000","last_active":"2024-04-25T22:55:54.624422+0000","last_peered":"2024-04-25T22:55:54.624422+0000","last_clean":"2024-04-25T22:55:54.624422+0000","last_became_active":"2024-04-25T22:55:38.513558+0000","last_became_peered":"2024-04-25T22:55:38.513558+0000","last_unstale":"2024-04-25T22:55:54.624422+0000","last_undegraded":"2024-04-25T22:55:54.624422+0000","last_fullsized":"2024-04-25T22:55:54.624422+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'173","last_scrub_stamp":"2024-04-25T22:55:54.624271+0000","last_deep_scrub":"77'173","last_deep_scrub_stamp":"2024-04-25T22:55:54.624271+0000","last_clean_scrub_stamp":"2024-04-25T22:55:54.624271+0000","objects_scrubbed":47,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:54:42.553756+0000","scrub_duration":34,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142819,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":135761,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"77'245","reported_seq":642,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:17.798478+0000","last_change":"2024-04-25T22:56:17.798530+0000","last_active":"2024-04-25T22:56:17.798478+0000","last_peered":"2024-04-25T22:56:17.798478+0000","last_clean":"2024-04-25T22:56:17.798478+0000","last_became_active":"2024-04-25T22:55:35.517044+0000","last_became_peered":"2024-04-25T22:55:35.517044+0000","last_unstale":"2024-04-25T22:56:17.798478+0000","last_undegraded":"2024-04-25T22:56:17.798478+0000","last_fullsized":"2024-04-25T22:56:17.798478+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'245","last_scrub_stamp":"2024-04-25T22:56:17.798398+0000","last_deep_scrub":"77'245","last_deep_scrub_stamp":"2024-04-25T22:56:17.798398+0000","last_clean_scrub_stamp":"2024-04-25T22:56:17.798398+0000","objects_scrubbed":72,"log_size":245,"log_dups_size":0,"ondisk_log_size":245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:14:08.541404+0000","scrub_duration":46,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":709662,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":119,"num_bytes_recovered":709653,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"77'220","reported_seq":573,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:09.713666+0000","last_change":"2024-04-25T22:56:09.713709+0000","last_active":"2024-04-25T22:56:09.713666+0000","last_peered":"2024-04-25T22:56:09.713666+0000","last_clean":"2024-04-25T22:56:09.713666+0000","last_became_active":"2024-04-25T22:55:38.513456+0000","last_became_peered":"2024-04-25T22:55:38.513456+0000","last_unstale":"2024-04-25T22:56:09.713666+0000","last_undegraded":"2024-04-25T22:56:09.713666+0000","last_fullsized":"2024-04-25T22:56:09.713666+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'220","last_scrub_stamp":"2024-04-25T22:56:09.713570+0000","last_deep_scrub":"77'220","last_deep_scrub_stamp":"2024-04-25T22:56:09.713570+0000","last_clean_scrub_stamp":"2024-04-25T22:56:09.713570+0000","objects_scrubbed":47,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:43:37.855744+0000","scrub_duration":37,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569466,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":569466,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"77'228","reported_seq":607,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:03.665207+0000","last_change":"2024-04-25T22:56:03.665255+0000","last_active":"2024-04-25T22:56:03.665207+0000","last_peered":"2024-04-25T22:56:03.665207+0000","last_clean":"2024-04-25T22:56:03.665207+0000","last_became_active":"2024-04-25T22:55:33.511961+0000","last_became_peered":"2024-04-25T22:55:33.511961+0000","last_unstale":"2024-04-25T22:56:03.665207+0000","last_undegraded":"2024-04-25T22:56:03.665207+0000","last_fullsized":"2024-04-25T22:56:03.665207+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'228","last_scrub_stamp":"2024-04-25T22:56:03.665102+0000","last_deep_scrub":"77'228","last_deep_scrub_stamp":"2024-04-25T22:56:03.665102+0000","last_clean_scrub_stamp":"2024-04-25T22:56:03.665102+0000","objects_scrubbed":55,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:31:16.236002+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75460,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":111,"num_bytes_recovered":75460,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"77'180","reported_seq":506,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:01.623980+0000","last_change":"2024-04-25T22:56:01.624031+0000","last_active":"2024-04-25T22:56:01.623980+0000","last_peered":"2024-04-25T22:56:01.623980+0000","last_clean":"2024-04-25T22:56:01.623980+0000","last_became_active":"2024-04-25T22:55:32.509908+0000","last_became_peered":"2024-04-25T22:55:32.509908+0000","last_unstale":"2024-04-25T22:56:01.623980+0000","last_undegraded":"2024-04-25T22:56:01.623980+0000","last_fullsized":"2024-04-25T22:56:01.623980+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'180","last_scrub_stamp":"2024-04-25T22:56:01.623899+0000","last_deep_scrub":"77'180","last_deep_scrub_stamp":"2024-04-25T22:56:01.623899+0000","last_clean_scrub_stamp":"2024-04-25T22:56:01.623899+0000","objects_scrubbed":40,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:48:15.905014+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":214453,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":214404,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"77'226","reported_seq":342,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:02.912759+0000","last_change":"2024-04-25T22:56:02.912791+0000","last_active":"2024-04-25T22:56:02.912759+0000","last_peered":"2024-04-25T22:56:02.912759+0000","last_clean":"2024-04-25T22:56:02.912759+0000","last_became_active":"2024-04-25T22:55:32.512447+0000","last_became_peered":"2024-04-25T22:55:32.512447+0000","last_unstale":"2024-04-25T22:56:02.912759+0000","last_undegraded":"2024-04-25T22:56:02.912759+0000","last_fullsized":"2024-04-25T22:56:02.912759+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'226","last_scrub_stamp":"2024-04-25T22:56:02.912678+0000","last_deep_scrub":"77'226","last_deep_scrub_stamp":"2024-04-25T22:56:02.912678+0000","last_clean_scrub_stamp":"2024-04-25T22:56:02.912678+0000","objects_scrubbed":57,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:14:20.686518+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":538374,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":538374,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"77'201","reported_seq":541,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:19.775006+0000","last_change":"2024-04-25T22:56:19.775052+0000","last_active":"2024-04-25T22:56:19.775006+0000","last_peered":"2024-04-25T22:56:19.775006+0000","last_clean":"2024-04-25T22:56:19.775006+0000","last_became_active":"2024-04-25T22:55:35.517506+0000","last_became_peered":"2024-04-25T22:55:35.517506+0000","last_unstale":"2024-04-25T22:56:19.775006+0000","last_undegraded":"2024-04-25T22:56:19.775006+0000","last_fullsized":"2024-04-25T22:56:19.775006+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'201","last_scrub_stamp":"2024-04-25T22:56:19.774928+0000","last_deep_scrub":"77'201","last_deep_scrub_stamp":"2024-04-25T22:56:19.774928+0000","last_clean_scrub_stamp":"2024-04-25T22:56:19.774928+0000","objects_scrubbed":48,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:06:14.150493+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130447,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":123390,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"77'215","reported_seq":330,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:25.631996+0000","last_change":"2024-04-25T22:56:25.632027+0000","last_active":"2024-04-25T22:56:25.631996+0000","last_peered":"2024-04-25T22:56:25.631996+0000","last_clean":"2024-04-25T22:56:25.631996+0000","last_became_active":"2024-04-25T22:55:40.538052+0000","last_became_peered":"2024-04-25T22:55:40.538052+0000","last_unstale":"2024-04-25T22:56:25.631996+0000","last_undegraded":"2024-04-25T22:56:25.631996+0000","last_fullsized":"2024-04-25T22:56:25.631996+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'215","last_scrub_stamp":"2024-04-25T22:56:25.631919+0000","last_deep_scrub":"77'215","last_deep_scrub_stamp":"2024-04-25T22:56:25.631919+0000","last_clean_scrub_stamp":"2024-04-25T22:56:25.631919+0000","objects_scrubbed":61,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:31:08.790008+0000","scrub_duration":46,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":343806,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":208,"num_bytes_recovered":687612,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"77'193","reported_seq":341,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:03.629080+0000","last_change":"2024-04-25T22:56:03.629111+0000","last_active":"2024-04-25T22:56:03.629080+0000","last_peered":"2024-04-25T22:56:03.629080+0000","last_clean":"2024-04-25T22:56:03.629080+0000","last_became_active":"2024-04-25T22:51:53.027363+0000","last_became_peered":"2024-04-25T22:51:53.027363+0000","last_unstale":"2024-04-25T22:56:03.629080+0000","last_undegraded":"2024-04-25T22:56:03.629080+0000","last_fullsized":"2024-04-25T22:56:03.629080+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'193","last_scrub_stamp":"2024-04-25T22:56:03.629005+0000","last_deep_scrub":"77'193","last_deep_scrub_stamp":"2024-04-25T22:56:03.629005+0000","last_clean_scrub_stamp":"2024-04-25T22:56:03.629005+0000","objects_scrubbed":52,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:50.606057+0000","scrub_duration":37,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125409,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"77'187","reported_seq":522,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:06.668252+0000","last_change":"2024-04-25T22:56:06.668280+0000","last_active":"2024-04-25T22:56:06.668252+0000","last_peered":"2024-04-25T22:56:06.668252+0000","last_clean":"2024-04-25T22:56:06.668252+0000","last_became_active":"2024-04-25T22:55:33.511546+0000","last_became_peered":"2024-04-25T22:55:33.511546+0000","last_unstale":"2024-04-25T22:56:06.668252+0000","last_undegraded":"2024-04-25T22:56:06.668252+0000","last_fullsized":"2024-04-25T22:56:06.668252+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'187","last_scrub_stamp":"2024-04-25T22:56:06.668176+0000","last_deep_scrub":"77'187","last_deep_scrub_stamp":"2024-04-25T22:56:06.668176+0000","last_clean_scrub_stamp":"2024-04-25T22:56:06.668176+0000","objects_scrubbed":52,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:31:19.239076+0000","scrub_duration":34,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":183835,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":183835,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"77'222","reported_seq":367,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:10.670527+0000","last_change":"2024-04-25T22:56:10.670570+0000","last_active":"2024-04-25T22:56:10.670527+0000","last_peered":"2024-04-25T22:56:10.670527+0000","last_clean":"2024-04-25T22:56:10.670527+0000","last_became_active":"2024-04-25T22:51:53.021902+0000","last_became_peered":"2024-04-25T22:51:53.021902+0000","last_unstale":"2024-04-25T22:56:10.670527+0000","last_undegraded":"2024-04-25T22:56:10.670527+0000","last_fullsized":"2024-04-25T22:56:10.670527+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'222","last_scrub_stamp":"2024-04-25T22:56:10.670422+0000","last_deep_scrub":"77'222","last_deep_scrub_stamp":"2024-04-25T22:56:10.670422+0000","last_clean_scrub_stamp":"2024-04-25T22:56:10.670422+0000","objects_scrubbed":43,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:43:55.748454+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153371,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":181,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"55'161","reported_seq":274,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:41.535641+0000","last_change":"2024-04-25T22:55:40.539371+0000","last_active":"2024-04-25T22:55:41.535641+0000","last_peered":"2024-04-25T22:55:41.535641+0000","last_clean":"2024-04-25T22:55:41.535641+0000","last_became_active":"2024-04-25T22:55:40.538095+0000","last_became_peered":"2024-04-25T22:55:40.538095+0000","last_unstale":"2024-04-25T22:55:41.535641+0000","last_undegraded":"2024-04-25T22:55:41.535641+0000","last_fullsized":"2024-04-25T22:55:41.535641+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:51:52.000495+0000","last_clean_scrub_stamp":"2024-04-25T22:51:52.000495+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4276239,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":4418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":4276214,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"77'238","reported_seq":621,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:57.608004+0000","last_change":"2024-04-25T22:55:57.608036+0000","last_active":"2024-04-25T22:55:57.608004+0000","last_peered":"2024-04-25T22:55:57.608004+0000","last_clean":"2024-04-25T22:55:57.608004+0000","last_became_active":"2024-04-25T22:55:31.526271+0000","last_became_peered":"2024-04-25T22:55:31.526271+0000","last_unstale":"2024-04-25T22:55:57.608004+0000","last_undegraded":"2024-04-25T22:55:57.608004+0000","last_fullsized":"2024-04-25T22:55:57.608004+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'238","last_scrub_stamp":"2024-04-25T22:55:57.607919+0000","last_deep_scrub":"77'238","last_deep_scrub_stamp":"2024-04-25T22:55:57.607919+0000","last_clean_scrub_stamp":"2024-04-25T22:55:57.607919+0000","objects_scrubbed":59,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:36:26.673180+0000","scrub_duration":45,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4371943,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":4513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":4363238,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"77'206","reported_seq":321,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:04.865461+0000","last_change":"2024-04-25T22:56:04.865500+0000","last_active":"2024-04-25T22:56:04.865461+0000","last_peered":"2024-04-25T22:56:04.865461+0000","last_clean":"2024-04-25T22:56:04.865461+0000","last_became_active":"2024-04-25T22:55:32.512371+0000","last_became_peered":"2024-04-25T22:55:32.512371+0000","last_unstale":"2024-04-25T22:56:04.865461+0000","last_undegraded":"2024-04-25T22:56:04.865461+0000","last_fullsized":"2024-04-25T22:56:04.865461+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'206","last_scrub_stamp":"2024-04-25T22:56:04.865369+0000","last_deep_scrub":"77'206","last_deep_scrub_stamp":"2024-04-25T22:56:04.865369+0000","last_clean_scrub_stamp":"2024-04-25T22:56:04.865369+0000","objects_scrubbed":43,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:18.871070+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96221,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":87110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"77'202","reported_seq":553,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:21.769408+0000","last_change":"2024-04-25T22:56:21.769450+0000","last_active":"2024-04-25T22:56:21.769408+0000","last_peered":"2024-04-25T22:56:21.769408+0000","last_clean":"2024-04-25T22:56:21.769408+0000","last_became_active":"2024-04-25T22:55:35.518584+0000","last_became_peered":"2024-04-25T22:55:35.518584+0000","last_unstale":"2024-04-25T22:56:21.769408+0000","last_undegraded":"2024-04-25T22:56:21.769408+0000","last_fullsized":"2024-04-25T22:56:21.769408+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'202","last_scrub_stamp":"2024-04-25T22:56:21.769309+0000","last_deep_scrub":"77'202","last_deep_scrub_stamp":"2024-04-25T22:56:21.769309+0000","last_clean_scrub_stamp":"2024-04-25T22:56:21.769309+0000","objects_scrubbed":55,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:37:56.786421+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1432264,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":1532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":1432241,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"77'199","reported_seq":319,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:51.904933+0000","last_change":"2024-04-25T22:55:51.904963+0000","last_active":"2024-04-25T22:55:51.904933+0000","last_peered":"2024-04-25T22:55:51.904933+0000","last_clean":"2024-04-25T22:55:51.904933+0000","last_became_active":"2024-04-25T22:55:30.526745+0000","last_became_peered":"2024-04-25T22:55:30.526745+0000","last_unstale":"2024-04-25T22:55:51.904933+0000","last_undegraded":"2024-04-25T22:55:51.904933+0000","last_fullsized":"2024-04-25T22:55:51.904933+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'199","last_scrub_stamp":"2024-04-25T22:55:51.904847+0000","last_deep_scrub":"77'199","last_deep_scrub_stamp":"2024-04-25T22:55:51.904847+0000","last_clean_scrub_stamp":"2024-04-25T22:55:51.904847+0000","objects_scrubbed":53,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:48:16.767300+0000","scrub_duration":36,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112933,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":112933,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"77'235","reported_seq":617,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:07.721161+0000","last_change":"2024-04-25T22:56:07.721161+0000","last_active":"2024-04-25T22:56:07.721161+0000","last_peered":"2024-04-25T22:56:07.721161+0000","last_clean":"2024-04-25T22:56:07.721161+0000","last_became_active":"2024-04-25T22:55:34.511872+0000","last_became_peered":"2024-04-25T22:55:34.511872+0000","last_unstale":"2024-04-25T22:56:07.721161+0000","last_undegraded":"2024-04-25T22:56:07.721161+0000","last_fullsized":"2024-04-25T22:56:07.721161+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'235","last_scrub_stamp":"2024-04-25T22:56:07.721043+0000","last_deep_scrub":"77'235","last_deep_scrub_stamp":"2024-04-25T22:56:07.721043+0000","last_clean_scrub_stamp":"2024-04-25T22:56:07.721043+0000","objects_scrubbed":57,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:07.413326+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124334,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":124334,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"77'211","reported_seq":565,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:05.689316+0000","last_change":"2024-04-25T22:56:05.689316+0000","last_active":"2024-04-25T22:56:05.689316+0000","last_peered":"2024-04-25T22:56:05.689316+0000","last_clean":"2024-04-25T22:56:05.689316+0000","last_became_active":"2024-04-25T22:55:34.511833+0000","last_became_peered":"2024-04-25T22:55:34.511833+0000","last_unstale":"2024-04-25T22:56:05.689316+0000","last_undegraded":"2024-04-25T22:56:05.689316+0000","last_fullsized":"2024-04-25T22:56:05.689316+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'211","last_scrub_stamp":"2024-04-25T22:56:05.689217+0000","last_deep_scrub":"77'211","last_deep_scrub_stamp":"2024-04-25T22:56:05.689217+0000","last_clean_scrub_stamp":"2024-04-25T22:56:05.689217+0000","objects_scrubbed":53,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:27:05.051314+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145029,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":145029,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"77'229","reported_seq":378,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:14.829487+0000","last_change":"2024-04-25T22:56:14.829487+0000","last_active":"2024-04-25T22:56:14.829487+0000","last_peered":"2024-04-25T22:56:14.829487+0000","last_clean":"2024-04-25T22:56:14.829487+0000","last_became_active":"2024-04-25T22:51:53.025938+0000","last_became_peered":"2024-04-25T22:51:53.025938+0000","last_unstale":"2024-04-25T22:56:14.829487+0000","last_undegraded":"2024-04-25T22:56:14.829487+0000","last_fullsized":"2024-04-25T22:56:14.829487+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'229","last_scrub_stamp":"2024-04-25T22:56:14.829372+0000","last_deep_scrub":"77'229","last_deep_scrub_stamp":"2024-04-25T22:56:14.829372+0000","last_clean_scrub_stamp":"2024-04-25T22:56:14.829372+0000","objects_scrubbed":58,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:05:26.283403+0000","scrub_duration":36,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115019,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"77'210","reported_seq":321,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:49.915543+0000","last_change":"2024-04-25T22:55:49.915587+0000","last_active":"2024-04-25T22:55:49.915543+0000","last_peered":"2024-04-25T22:55:49.915543+0000","last_clean":"2024-04-25T22:55:49.915543+0000","last_became_active":"2024-04-25T22:55:33.512160+0000","last_became_peered":"2024-04-25T22:55:33.512160+0000","last_unstale":"2024-04-25T22:55:49.915543+0000","last_undegraded":"2024-04-25T22:55:49.915543+0000","last_fullsized":"2024-04-25T22:55:49.915543+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'210","last_scrub_stamp":"2024-04-25T22:55:49.915449+0000","last_deep_scrub":"77'210","last_deep_scrub_stamp":"2024-04-25T22:55:49.915449+0000","last_clean_scrub_stamp":"2024-04-25T22:55:49.915449+0000","objects_scrubbed":49,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:38:33.900833+0000","scrub_duration":36,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":641227,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":641227,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"77'217","reported_seq":584,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:04.641024+0000","last_change":"2024-04-25T22:56:04.641024+0000","last_active":"2024-04-25T22:56:04.641024+0000","last_peered":"2024-04-25T22:56:04.641024+0000","last_clean":"2024-04-25T22:56:04.641024+0000","last_became_active":"2024-04-25T22:55:33.511463+0000","last_became_peered":"2024-04-25T22:55:33.511463+0000","last_unstale":"2024-04-25T22:56:04.641024+0000","last_undegraded":"2024-04-25T22:56:04.641024+0000","last_fullsized":"2024-04-25T22:56:04.641024+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'217","last_scrub_stamp":"2024-04-25T22:56:04.640878+0000","last_deep_scrub":"77'217","last_deep_scrub_stamp":"2024-04-25T22:56:04.640878+0000","last_clean_scrub_stamp":"2024-04-25T22:56:04.640878+0000","objects_scrubbed":48,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:48:18.921993+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103634,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":189,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":98869,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"77'218","reported_seq":367,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:59.612400+0000","last_change":"2024-04-25T22:55:59.612400+0000","last_active":"2024-04-25T22:55:59.612400+0000","last_peered":"2024-04-25T22:55:59.612400+0000","last_clean":"2024-04-25T22:55:59.612400+0000","last_became_active":"2024-04-25T22:51:53.027867+0000","last_became_peered":"2024-04-25T22:51:53.027867+0000","last_unstale":"2024-04-25T22:55:59.612400+0000","last_undegraded":"2024-04-25T22:55:59.612400+0000","last_fullsized":"2024-04-25T22:55:59.612400+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'218","last_scrub_stamp":"2024-04-25T22:55:59.612288+0000","last_deep_scrub":"77'218","last_deep_scrub_stamp":"2024-04-25T22:55:59.612288+0000","last_clean_scrub_stamp":"2024-04-25T22:55:59.612288+0000","objects_scrubbed":59,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:46:01.075914+0000","scrub_duration":36,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272252,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"77'250","reported_seq":360,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:17.963250+0000","last_change":"2024-04-25T22:56:17.963279+0000","last_active":"2024-04-25T22:56:17.963250+0000","last_peered":"2024-04-25T22:56:17.963250+0000","last_clean":"2024-04-25T22:56:17.963250+0000","last_became_active":"2024-04-25T22:55:34.512320+0000","last_became_peered":"2024-04-25T22:55:34.512320+0000","last_unstale":"2024-04-25T22:56:17.963250+0000","last_undegraded":"2024-04-25T22:56:17.963250+0000","last_fullsized":"2024-04-25T22:56:17.963250+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'250","last_scrub_stamp":"2024-04-25T22:56:17.963166+0000","last_deep_scrub":"77'250","last_deep_scrub_stamp":"2024-04-25T22:56:17.963166+0000","last_clean_scrub_stamp":"2024-04-25T22:56:17.963166+0000","objects_scrubbed":60,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:08:14.239922+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126403,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":117,"num_bytes_recovered":126342,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"77'199","reported_seq":345,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:08.760180+0000","last_change":"2024-04-25T22:56:08.760180+0000","last_active":"2024-04-25T22:56:08.760180+0000","last_peered":"2024-04-25T22:56:08.760180+0000","last_clean":"2024-04-25T22:56:08.760180+0000","last_became_active":"2024-04-25T22:51:53.022407+0000","last_became_peered":"2024-04-25T22:51:53.022407+0000","last_unstale":"2024-04-25T22:56:08.760180+0000","last_undegraded":"2024-04-25T22:56:08.760180+0000","last_fullsized":"2024-04-25T22:56:08.760180+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'199","last_scrub_stamp":"2024-04-25T22:56:08.759993+0000","last_deep_scrub":"77'199","last_deep_scrub_stamp":"2024-04-25T22:56:08.759993+0000","last_clean_scrub_stamp":"2024-04-25T22:56:08.759993+0000","objects_scrubbed":48,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:49:21.647405+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69245,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"77'195","reported_seq":343,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:57.649775+0000","last_change":"2024-04-25T22:55:57.649775+0000","last_active":"2024-04-25T22:55:57.649775+0000","last_peered":"2024-04-25T22:55:57.649775+0000","last_clean":"2024-04-25T22:55:57.649775+0000","last_became_active":"2024-04-25T22:51:53.027852+0000","last_became_peered":"2024-04-25T22:51:53.027852+0000","last_unstale":"2024-04-25T22:55:57.649775+0000","last_undegraded":"2024-04-25T22:55:57.649775+0000","last_fullsized":"2024-04-25T22:55:57.649775+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'195","last_scrub_stamp":"2024-04-25T22:55:57.649623+0000","last_deep_scrub":"77'195","last_deep_scrub_stamp":"2024-04-25T22:55:57.649623+0000","last_clean_scrub_stamp":"2024-04-25T22:55:57.649623+0000","objects_scrubbed":48,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:54:45.579108+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192848,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"77'223","reported_seq":335,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:18.995101+0000","last_change":"2024-04-25T22:56:18.995139+0000","last_active":"2024-04-25T22:56:18.995101+0000","last_peered":"2024-04-25T22:56:18.995101+0000","last_clean":"2024-04-25T22:56:18.995101+0000","last_became_active":"2024-04-25T22:55:34.514067+0000","last_became_peered":"2024-04-25T22:55:34.514067+0000","last_unstale":"2024-04-25T22:56:18.995101+0000","last_undegraded":"2024-04-25T22:56:18.995101+0000","last_fullsized":"2024-04-25T22:56:18.995101+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'223","last_scrub_stamp":"2024-04-25T22:56:18.995009+0000","last_deep_scrub":"77'223","last_deep_scrub_stamp":"2024-04-25T22:56:18.995009+0000","last_clean_scrub_stamp":"2024-04-25T22:56:18.995009+0000","objects_scrubbed":57,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:52:10.048029+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239074,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":239074,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"77'251","reported_seq":400,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:07.713192+0000","last_change":"2024-04-25T22:56:07.713235+0000","last_active":"2024-04-25T22:56:07.713192+0000","last_peered":"2024-04-25T22:56:07.713192+0000","last_clean":"2024-04-25T22:56:07.713192+0000","last_became_active":"2024-04-25T22:51:53.026379+0000","last_became_peered":"2024-04-25T22:51:53.026379+0000","last_unstale":"2024-04-25T22:56:07.713192+0000","last_undegraded":"2024-04-25T22:56:07.713192+0000","last_fullsized":"2024-04-25T22:56:07.713192+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'251","last_scrub_stamp":"2024-04-25T22:56:07.713115+0000","last_deep_scrub":"77'251","last_deep_scrub_stamp":"2024-04-25T22:56:07.713115+0000","last_clean_scrub_stamp":"2024-04-25T22:56:07.713115+0000","objects_scrubbed":60,"log_size":251,"log_dups_size":0,"ondisk_log_size":251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:48:45.519028+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99668,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"77'256","reported_seq":372,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:00.942134+0000","last_change":"2024-04-25T22:56:00.942208+0000","last_active":"2024-04-25T22:56:00.942134+0000","last_peered":"2024-04-25T22:56:00.942134+0000","last_clean":"2024-04-25T22:56:00.942134+0000","last_became_active":"2024-04-25T22:55:32.509978+0000","last_became_peered":"2024-04-25T22:55:32.509978+0000","last_unstale":"2024-04-25T22:56:00.942134+0000","last_undegraded":"2024-04-25T22:56:00.942134+0000","last_fullsized":"2024-04-25T22:56:00.942134+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'256","last_scrub_stamp":"2024-04-25T22:56:00.942032+0000","last_deep_scrub":"77'256","last_deep_scrub_stamp":"2024-04-25T22:56:00.942032+0000","last_clean_scrub_stamp":"2024-04-25T22:56:00.942032+0000","objects_scrubbed":63,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:25:05.450727+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128069,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":128069,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"77'241","reported_seq":608,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:23.639347+0000","last_change":"2024-04-25T22:56:23.639386+0000","last_active":"2024-04-25T22:56:23.639347+0000","last_peered":"2024-04-25T22:56:23.639347+0000","last_clean":"2024-04-25T22:56:23.639347+0000","last_became_active":"2024-04-25T22:55:38.518412+0000","last_became_peered":"2024-04-25T22:55:38.518412+0000","last_unstale":"2024-04-25T22:56:23.639347+0000","last_undegraded":"2024-04-25T22:56:23.639347+0000","last_fullsized":"2024-04-25T22:56:23.639347+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'241","last_scrub_stamp":"2024-04-25T22:56:23.639263+0000","last_deep_scrub":"77'241","last_deep_scrub_stamp":"2024-04-25T22:56:23.639263+0000","last_clean_scrub_stamp":"2024-04-25T22:56:23.639263+0000","objects_scrubbed":59,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:45:02.201857+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":586629,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":580754,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"77'201","reported_seq":549,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:16.821994+0000","last_change":"2024-04-25T22:56:16.822043+0000","last_active":"2024-04-25T22:56:16.821994+0000","last_peered":"2024-04-25T22:56:16.821994+0000","last_clean":"2024-04-25T22:56:16.821994+0000","last_became_active":"2024-04-25T22:55:33.512114+0000","last_became_peered":"2024-04-25T22:55:33.512114+0000","last_unstale":"2024-04-25T22:56:16.821994+0000","last_undegraded":"2024-04-25T22:56:16.821994+0000","last_fullsized":"2024-04-25T22:56:16.821994+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'201","last_scrub_stamp":"2024-04-25T22:56:16.821898+0000","last_deep_scrub":"77'201","last_deep_scrub_stamp":"2024-04-25T22:56:16.821898+0000","last_clean_scrub_stamp":"2024-04-25T22:56:16.821898+0000","objects_scrubbed":45,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:03:03.916034+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118861,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":118861,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"77'108","reported_seq":268,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:55.641147+0000","last_change":"2024-04-25T22:55:55.641176+0000","last_active":"2024-04-25T22:55:55.641147+0000","last_peered":"2024-04-25T22:55:55.641147+0000","last_clean":"2024-04-25T22:55:55.641147+0000","last_became_active":"2024-04-25T22:55:30.525469+0000","last_became_peered":"2024-04-25T22:55:30.525469+0000","last_unstale":"2024-04-25T22:55:55.641147+0000","last_undegraded":"2024-04-25T22:55:55.641147+0000","last_fullsized":"2024-04-25T22:55:55.641147+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'108","last_scrub_stamp":"2024-04-25T22:55:55.641069+0000","last_deep_scrub":"77'108","last_deep_scrub_stamp":"2024-04-25T22:55:55.641069+0000","last_clean_scrub_stamp":"2024-04-25T22:55:55.641069+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:35:08.836219+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2425045,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":2428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":2425011,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"77'186","reported_seq":522,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:00.614733+0000","last_change":"2024-04-25T22:56:00.614791+0000","last_active":"2024-04-25T22:56:00.614733+0000","last_peered":"2024-04-25T22:56:00.614733+0000","last_clean":"2024-04-25T22:56:00.614733+0000","last_became_active":"2024-04-25T22:55:30.524718+0000","last_became_peered":"2024-04-25T22:55:30.524718+0000","last_unstale":"2024-04-25T22:56:00.614733+0000","last_undegraded":"2024-04-25T22:56:00.614733+0000","last_fullsized":"2024-04-25T22:56:00.614733+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'186","last_scrub_stamp":"2024-04-25T22:56:00.614624+0000","last_deep_scrub":"77'186","last_deep_scrub_stamp":"2024-04-25T22:56:00.614624+0000","last_clean_scrub_stamp":"2024-04-25T22:56:00.614624+0000","objects_scrubbed":40,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:36:29.679884+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67079,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":89,"num_bytes_recovered":67079,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":57,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:09.839257+0000","last_change":"2024-04-25T22:56:09.839277+0000","last_active":"2024-04-25T22:56:09.839257+0000","last_peered":"2024-04-25T22:56:09.839257+0000","last_clean":"2024-04-25T22:56:09.839257+0000","last_became_active":"2024-04-25T22:55:27.517208+0000","last_became_peered":"2024-04-25T22:55:27.517208+0000","last_unstale":"2024-04-25T22:56:09.839257+0000","last_undegraded":"2024-04-25T22:56:09.839257+0000","last_fullsized":"2024-04-25T22:56:09.839257+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:56:09.839176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:56:09.839176+0000","last_clean_scrub_stamp":"2024-04-25T22:56:09.839176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:46:38.198505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"77'240","reported_seq":352,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:15.924091+0000","last_change":"2024-04-25T22:56:15.924121+0000","last_active":"2024-04-25T22:56:15.924091+0000","last_peered":"2024-04-25T22:56:15.924091+0000","last_clean":"2024-04-25T22:56:15.924091+0000","last_became_active":"2024-04-25T22:55:33.512389+0000","last_became_peered":"2024-04-25T22:55:33.512389+0000","last_unstale":"2024-04-25T22:56:15.924091+0000","last_undegraded":"2024-04-25T22:56:15.924091+0000","last_fullsized":"2024-04-25T22:56:15.924091+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'240","last_scrub_stamp":"2024-04-25T22:56:15.924009+0000","last_deep_scrub":"77'240","last_deep_scrub_stamp":"2024-04-25T22:56:15.924009+0000","last_clean_scrub_stamp":"2024-04-25T22:56:15.924009+0000","objects_scrubbed":54,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:36:27.201232+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139986,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":137763,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":148,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:08.683672+0000","last_change":"2024-04-25T22:56:08.683696+0000","last_active":"2024-04-25T22:56:08.683672+0000","last_peered":"2024-04-25T22:56:08.683672+0000","last_clean":"2024-04-25T22:56:08.683672+0000","last_became_active":"2024-04-25T22:51:52.018313+0000","last_became_peered":"2024-04-25T22:51:52.018313+0000","last_unstale":"2024-04-25T22:56:08.683672+0000","last_undegraded":"2024-04-25T22:56:08.683672+0000","last_fullsized":"2024-04-25T22:56:08.683672+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:56:08.683553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:56:08.683553+0000","last_clean_scrub_stamp":"2024-04-25T22:56:08.683553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:27:08.045650+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"77'206","reported_seq":323,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:53.877246+0000","last_change":"2024-04-25T22:55:53.877285+0000","last_active":"2024-04-25T22:55:53.877246+0000","last_peered":"2024-04-25T22:55:53.877246+0000","last_clean":"2024-04-25T22:55:53.877246+0000","last_became_active":"2024-04-25T22:55:30.526276+0000","last_became_peered":"2024-04-25T22:55:30.526276+0000","last_unstale":"2024-04-25T22:55:53.877246+0000","last_undegraded":"2024-04-25T22:55:53.877246+0000","last_fullsized":"2024-04-25T22:55:53.877246+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'206","last_scrub_stamp":"2024-04-25T22:55:53.877171+0000","last_deep_scrub":"77'206","last_deep_scrub_stamp":"2024-04-25T22:55:53.877171+0000","last_clean_scrub_stamp":"2024-04-25T22:55:53.877171+0000","objects_scrubbed":39,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:15:37.908265+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87849,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":87849,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"77'12","reported_seq":158,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:16.651976+0000","last_change":"2024-04-25T22:56:16.652029+0000","last_active":"2024-04-25T22:56:16.651976+0000","last_peered":"2024-04-25T22:56:16.651976+0000","last_clean":"2024-04-25T22:56:16.651976+0000","last_became_active":"2024-04-25T22:51:52.021145+0000","last_became_peered":"2024-04-25T22:51:52.021145+0000","last_unstale":"2024-04-25T22:56:16.651976+0000","last_undegraded":"2024-04-25T22:56:16.651976+0000","last_fullsized":"2024-04-25T22:56:16.651976+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'12","last_scrub_stamp":"2024-04-25T22:56:16.651881+0000","last_deep_scrub":"77'12","last_deep_scrub_stamp":"2024-04-25T22:56:16.651881+0000","last_clean_scrub_stamp":"2024-04-25T22:56:16.651881+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:21.955031+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"77'3","reported_seq":150,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:15.604975+0000","last_change":"2024-04-25T22:56:15.604975+0000","last_active":"2024-04-25T22:56:15.604975+0000","last_peered":"2024-04-25T22:56:15.604975+0000","last_clean":"2024-04-25T22:56:15.604975+0000","last_became_active":"2024-04-25T22:51:52.020860+0000","last_became_peered":"2024-04-25T22:51:52.020860+0000","last_unstale":"2024-04-25T22:56:15.604975+0000","last_undegraded":"2024-04-25T22:56:15.604975+0000","last_fullsized":"2024-04-25T22:56:15.604975+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'3","last_scrub_stamp":"2024-04-25T22:56:15.604836+0000","last_deep_scrub":"77'3","last_deep_scrub_stamp":"2024-04-25T22:56:15.604836+0000","last_clean_scrub_stamp":"2024-04-25T22:56:15.604836+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:06:09.980401+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"77'212","reported_seq":361,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:53.659379+0000","last_change":"2024-04-25T22:55:53.659379+0000","last_active":"2024-04-25T22:55:53.659379+0000","last_peered":"2024-04-25T22:55:53.659379+0000","last_clean":"2024-04-25T22:55:53.659379+0000","last_became_active":"2024-04-25T22:51:53.029157+0000","last_became_peered":"2024-04-25T22:51:53.029157+0000","last_unstale":"2024-04-25T22:55:53.659379+0000","last_undegraded":"2024-04-25T22:55:53.659379+0000","last_fullsized":"2024-04-25T22:55:53.659379+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'212","last_scrub_stamp":"2024-04-25T22:55:53.659262+0000","last_deep_scrub":"77'212","last_deep_scrub_stamp":"2024-04-25T22:55:53.659262+0000","last_clean_scrub_stamp":"2024-04-25T22:55:53.659262+0000","objects_scrubbed":55,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:23:44.866042+0000","scrub_duration":36,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190158,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"77'4","reported_seq":153,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:09.677569+0000","last_change":"2024-04-25T22:56:09.677569+0000","last_active":"2024-04-25T22:56:09.677569+0000","last_peered":"2024-04-25T22:56:09.677569+0000","last_clean":"2024-04-25T22:56:09.677569+0000","last_became_active":"2024-04-25T22:51:52.018390+0000","last_became_peered":"2024-04-25T22:51:52.018390+0000","last_unstale":"2024-04-25T22:56:09.677569+0000","last_undegraded":"2024-04-25T22:56:09.677569+0000","last_fullsized":"2024-04-25T22:56:09.677569+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'4","last_scrub_stamp":"2024-04-25T22:56:09.677451+0000","last_deep_scrub":"77'4","last_deep_scrub_stamp":"2024-04-25T22:56:09.677451+0000","last_clean_scrub_stamp":"2024-04-25T22:56:09.677451+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:46.292219+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"77'225","reported_seq":605,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:02.612518+0000","last_change":"2024-04-25T22:56:02.612518+0000","last_active":"2024-04-25T22:56:02.612518+0000","last_peered":"2024-04-25T22:56:02.612518+0000","last_clean":"2024-04-25T22:56:02.612518+0000","last_became_active":"2024-04-25T22:55:31.527049+0000","last_became_peered":"2024-04-25T22:55:31.527049+0000","last_unstale":"2024-04-25T22:56:02.612518+0000","last_undegraded":"2024-04-25T22:56:02.612518+0000","last_fullsized":"2024-04-25T22:56:02.612518+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'225","last_scrub_stamp":"2024-04-25T22:56:02.612398+0000","last_deep_scrub":"77'225","last_deep_scrub_stamp":"2024-04-25T22:56:02.612398+0000","last_clean_scrub_stamp":"2024-04-25T22:56:02.612398+0000","objects_scrubbed":54,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:11:14.389223+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":315325,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":191,"num_write_kb":549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":110,"num_bytes_recovered":301306,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"77'2","reported_seq":55,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:21.617122+0000","last_change":"2024-04-25T22:56:21.617167+0000","last_active":"2024-04-25T22:56:21.617122+0000","last_peered":"2024-04-25T22:56:21.617122+0000","last_clean":"2024-04-25T22:56:21.617122+0000","last_became_active":"2024-04-25T22:55:38.517362+0000","last_became_peered":"2024-04-25T22:55:38.517362+0000","last_unstale":"2024-04-25T22:56:21.617122+0000","last_undegraded":"2024-04-25T22:56:21.617122+0000","last_fullsized":"2024-04-25T22:56:21.617122+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'2","last_scrub_stamp":"2024-04-25T22:56:21.617018+0000","last_deep_scrub":"77'2","last_deep_scrub_stamp":"2024-04-25T22:56:21.617018+0000","last_clean_scrub_stamp":"2024-04-25T22:56:21.617018+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:28:48.568858+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"77'209","reported_seq":554,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:19.716560+0000","last_change":"2024-04-25T22:56:19.716590+0000","last_active":"2024-04-25T22:56:19.716560+0000","last_peered":"2024-04-25T22:56:19.716560+0000","last_clean":"2024-04-25T22:56:19.716560+0000","last_became_active":"2024-04-25T22:55:38.514319+0000","last_became_peered":"2024-04-25T22:55:38.514319+0000","last_unstale":"2024-04-25T22:56:19.716560+0000","last_undegraded":"2024-04-25T22:56:19.716560+0000","last_fullsized":"2024-04-25T22:56:19.716560+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'209","last_scrub_stamp":"2024-04-25T22:56:19.716482+0000","last_deep_scrub":"77'209","last_deep_scrub_stamp":"2024-04-25T22:56:19.716482+0000","last_clean_scrub_stamp":"2024-04-25T22:56:19.716482+0000","objects_scrubbed":56,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:39:23.711998+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97209,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":97196,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"51'1","reported_seq":125,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:53.567310+0000","last_change":"2024-04-25T22:55:53.567310+0000","last_active":"2024-04-25T22:55:53.567310+0000","last_peered":"2024-04-25T22:55:53.567310+0000","last_clean":"2024-04-25T22:55:53.567310+0000","last_became_active":"2024-04-25T22:55:38.516782+0000","last_became_peered":"2024-04-25T22:55:38.516782+0000","last_unstale":"2024-04-25T22:55:53.567310+0000","last_undegraded":"2024-04-25T22:55:53.567310+0000","last_fullsized":"2024-04-25T22:55:53.567310+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1","last_scrub_stamp":"2024-04-25T22:55:53.567155+0000","last_deep_scrub":"51'1","last_deep_scrub_stamp":"2024-04-25T22:55:53.567155+0000","last_clean_scrub_stamp":"2024-04-25T22:55:53.567155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:01:38.089809+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"77'215","reported_seq":329,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:58.929384+0000","last_change":"2024-04-25T22:55:58.929421+0000","last_active":"2024-04-25T22:55:58.929384+0000","last_peered":"2024-04-25T22:55:58.929384+0000","last_clean":"2024-04-25T22:55:58.929384+0000","last_became_active":"2024-04-25T22:55:32.510402+0000","last_became_peered":"2024-04-25T22:55:32.510402+0000","last_unstale":"2024-04-25T22:55:58.929384+0000","last_undegraded":"2024-04-25T22:55:58.929384+0000","last_fullsized":"2024-04-25T22:55:58.929384+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'215","last_scrub_stamp":"2024-04-25T22:55:58.929297+0000","last_deep_scrub":"77'215","last_deep_scrub_stamp":"2024-04-25T22:55:58.929297+0000","last_clean_scrub_stamp":"2024-04-25T22:55:58.929297+0000","objects_scrubbed":62,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:24:11.093855+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131384,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":131332,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"77'9","reported_seq":67,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:01.923353+0000","last_change":"2024-04-25T22:56:01.923412+0000","last_active":"2024-04-25T22:56:01.923353+0000","last_peered":"2024-04-25T22:56:01.923353+0000","last_clean":"2024-04-25T22:56:01.923353+0000","last_became_active":"2024-04-25T22:55:27.518709+0000","last_became_peered":"2024-04-25T22:55:27.518709+0000","last_unstale":"2024-04-25T22:56:01.923353+0000","last_undegraded":"2024-04-25T22:56:01.923353+0000","last_fullsized":"2024-04-25T22:56:01.923353+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'9","last_scrub_stamp":"2024-04-25T22:56:01.923255+0000","last_deep_scrub":"77'9","last_deep_scrub_stamp":"2024-04-25T22:56:01.923255+0000","last_clean_scrub_stamp":"2024-04-25T22:56:01.923255+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:13.276320+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"77'232","reported_seq":591,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:50.591701+0000","last_change":"2024-04-25T22:55:50.591701+0000","last_active":"2024-04-25T22:55:50.591701+0000","last_peered":"2024-04-25T22:55:50.591701+0000","last_clean":"2024-04-25T22:55:50.591701+0000","last_became_active":"2024-04-25T22:55:38.514695+0000","last_became_peered":"2024-04-25T22:55:38.514695+0000","last_unstale":"2024-04-25T22:55:50.591701+0000","last_undegraded":"2024-04-25T22:55:50.591701+0000","last_fullsized":"2024-04-25T22:55:50.591701+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'232","last_scrub_stamp":"2024-04-25T22:55:50.591565+0000","last_deep_scrub":"77'232","last_deep_scrub_stamp":"2024-04-25T22:55:50.591565+0000","last_clean_scrub_stamp":"2024-04-25T22:55:50.591565+0000","objects_scrubbed":58,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:23:41.798345+0000","scrub_duration":42,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187245,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":111,"num_bytes_recovered":187245,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":154,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:58.557578+0000","last_change":"2024-04-25T22:55:58.557578+0000","last_active":"2024-04-25T22:55:58.557578+0000","last_peered":"2024-04-25T22:55:58.557578+0000","last_clean":"2024-04-25T22:55:58.557578+0000","last_became_active":"2024-04-25T22:55:27.517404+0000","last_became_peered":"2024-04-25T22:55:27.517404+0000","last_unstale":"2024-04-25T22:55:58.557578+0000","last_undegraded":"2024-04-25T22:55:58.557578+0000","last_fullsized":"2024-04-25T22:55:58.557578+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:55:58.557460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:55:58.557460+0000","last_clean_scrub_stamp":"2024-04-25T22:55:58.557460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:35.155047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"77'219","reported_seq":366,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:06.739877+0000","last_change":"2024-04-25T22:56:06.739877+0000","last_active":"2024-04-25T22:56:06.739877+0000","last_peered":"2024-04-25T22:56:06.739877+0000","last_clean":"2024-04-25T22:56:06.739877+0000","last_became_active":"2024-04-25T22:51:53.023405+0000","last_became_peered":"2024-04-25T22:51:53.023405+0000","last_unstale":"2024-04-25T22:56:06.739877+0000","last_undegraded":"2024-04-25T22:56:06.739877+0000","last_fullsized":"2024-04-25T22:56:06.739877+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'219","last_scrub_stamp":"2024-04-25T22:56:06.739758+0000","last_deep_scrub":"77'219","last_deep_scrub_stamp":"2024-04-25T22:56:06.739758+0000","last_clean_scrub_stamp":"2024-04-25T22:56:06.739758+0000","objects_scrubbed":56,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:43.354527+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130867,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":166,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:56.569692+0000","last_change":"2024-04-25T22:55:56.569692+0000","last_active":"2024-04-25T22:55:56.569692+0000","last_peered":"2024-04-25T22:55:56.569692+0000","last_clean":"2024-04-25T22:55:56.569692+0000","last_became_active":"2024-04-25T22:55:37.515798+0000","last_became_peered":"2024-04-25T22:55:37.515798+0000","last_unstale":"2024-04-25T22:55:56.569692+0000","last_undegraded":"2024-04-25T22:55:56.569692+0000","last_fullsized":"2024-04-25T22:55:56.569692+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:55:56.569581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:55:56.569581+0000","last_clean_scrub_stamp":"2024-04-25T22:55:56.569581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:01:41.092235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"77'193","reported_seq":340,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:17.653899+0000","last_change":"2024-04-25T22:56:17.653899+0000","last_active":"2024-04-25T22:56:17.653899+0000","last_peered":"2024-04-25T22:56:17.653899+0000","last_clean":"2024-04-25T22:56:17.653899+0000","last_became_active":"2024-04-25T22:51:53.019978+0000","last_became_peered":"2024-04-25T22:51:53.019978+0000","last_unstale":"2024-04-25T22:56:17.653899+0000","last_undegraded":"2024-04-25T22:56:17.653899+0000","last_fullsized":"2024-04-25T22:56:17.653899+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'193","last_scrub_stamp":"2024-04-25T22:56:17.653782+0000","last_deep_scrub":"77'193","last_deep_scrub_stamp":"2024-04-25T22:56:17.653782+0000","last_clean_scrub_stamp":"2024-04-25T22:56:17.653782+0000","objects_scrubbed":54,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:33:57.590692+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197405,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"51'1","reported_seq":157,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:54.642205+0000","last_change":"2024-04-25T22:55:54.642205+0000","last_active":"2024-04-25T22:55:54.642205+0000","last_peered":"2024-04-25T22:55:54.642205+0000","last_clean":"2024-04-25T22:55:54.642205+0000","last_became_active":"2024-04-25T22:55:27.517330+0000","last_became_peered":"2024-04-25T22:55:27.517330+0000","last_unstale":"2024-04-25T22:55:54.642205+0000","last_undegraded":"2024-04-25T22:55:54.642205+0000","last_fullsized":"2024-04-25T22:55:54.642205+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1","last_scrub_stamp":"2024-04-25T22:55:54.642058+0000","last_deep_scrub":"51'1","last_deep_scrub_stamp":"2024-04-25T22:55:54.642058+0000","last_clean_scrub_stamp":"2024-04-25T22:55:54.642058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:48:09.797102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"77'196","reported_seq":314,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:56.855476+0000","last_change":"2024-04-25T22:55:56.855502+0000","last_active":"2024-04-25T22:55:56.855476+0000","last_peered":"2024-04-25T22:55:56.855476+0000","last_clean":"2024-04-25T22:55:56.855476+0000","last_became_active":"2024-04-25T22:55:31.528360+0000","last_became_peered":"2024-04-25T22:55:31.528360+0000","last_unstale":"2024-04-25T22:55:56.855476+0000","last_undegraded":"2024-04-25T22:55:56.855476+0000","last_fullsized":"2024-04-25T22:55:56.855476+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'196","last_scrub_stamp":"2024-04-25T22:55:56.855397+0000","last_deep_scrub":"77'196","last_deep_scrub_stamp":"2024-04-25T22:55:56.855397+0000","last_clean_scrub_stamp":"2024-04-25T22:55:56.855397+0000","objects_scrubbed":51,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:57:48.621305+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165168,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":165116,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"77'159","reported_seq":351,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:13.594888+0000","last_change":"2024-04-25T22:56:13.594928+0000","last_active":"2024-04-25T22:56:13.594888+0000","last_peered":"2024-04-25T22:56:13.594888+0000","last_clean":"2024-04-25T22:56:13.594888+0000","last_became_active":"2024-04-25T22:51:47.764176+0000","last_became_peered":"2024-04-25T22:51:47.764176+0000","last_unstale":"2024-04-25T22:56:13.594888+0000","last_undegraded":"2024-04-25T22:56:13.594888+0000","last_fullsized":"2024-04-25T22:56:13.594888+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'159","last_scrub_stamp":"2024-04-25T22:56:13.594800+0000","last_deep_scrub":"77'159","last_deep_scrub_stamp":"2024-04-25T22:56:13.594800+0000","last_clean_scrub_stamp":"2024-04-25T22:56:13.594800+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:44.763388+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":160,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:56.587621+0000","last_change":"2024-04-25T22:55:56.587621+0000","last_active":"2024-04-25T22:55:56.587621+0000","last_peered":"2024-04-25T22:55:56.587621+0000","last_clean":"2024-04-25T22:55:56.587621+0000","last_became_active":"2024-04-25T22:55:27.520951+0000","last_became_peered":"2024-04-25T22:55:27.520951+0000","last_unstale":"2024-04-25T22:55:56.587621+0000","last_undegraded":"2024-04-25T22:55:56.587621+0000","last_fullsized":"2024-04-25T22:55:56.587621+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:55:56.587508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:55:56.587508+0000","last_clean_scrub_stamp":"2024-04-25T22:55:56.587508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:58.051135+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"51'2","reported_seq":57,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:05.864843+0000","last_change":"2024-04-25T22:56:05.864908+0000","last_active":"2024-04-25T22:56:05.864843+0000","last_peered":"2024-04-25T22:56:05.864843+0000","last_clean":"2024-04-25T22:56:05.864843+0000","last_became_active":"2024-04-25T22:55:27.520466+0000","last_became_peered":"2024-04-25T22:55:27.520466+0000","last_unstale":"2024-04-25T22:56:05.864843+0000","last_undegraded":"2024-04-25T22:56:05.864843+0000","last_fullsized":"2024-04-25T22:56:05.864843+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'2","last_scrub_stamp":"2024-04-25T22:56:05.864749+0000","last_deep_scrub":"51'2","last_deep_scrub_stamp":"2024-04-25T22:56:05.864749+0000","last_clean_scrub_stamp":"2024-04-25T22:56:05.864749+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:00.641012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"77'206","reported_seq":353,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:04.664443+0000","last_change":"2024-04-25T22:56:04.664443+0000","last_active":"2024-04-25T22:56:04.664443+0000","last_peered":"2024-04-25T22:56:04.664443+0000","last_clean":"2024-04-25T22:56:04.664443+0000","last_became_active":"2024-04-25T22:51:53.023497+0000","last_became_peered":"2024-04-25T22:51:53.023497+0000","last_unstale":"2024-04-25T22:56:04.664443+0000","last_undegraded":"2024-04-25T22:56:04.664443+0000","last_fullsized":"2024-04-25T22:56:04.664443+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'206","last_scrub_stamp":"2024-04-25T22:56:04.664319+0000","last_deep_scrub":"77'206","last_deep_scrub_stamp":"2024-04-25T22:56:04.664319+0000","last_clean_scrub_stamp":"2024-04-25T22:56:04.664319+0000","objects_scrubbed":56,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:48:42.470233+0000","scrub_duration":42,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":331484,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":153,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:12.630835+0000","last_change":"2024-04-25T22:56:12.630894+0000","last_active":"2024-04-25T22:56:12.630835+0000","last_peered":"2024-04-25T22:56:12.630835+0000","last_clean":"2024-04-25T22:56:12.630835+0000","last_became_active":"2024-04-25T22:51:47.764229+0000","last_became_peered":"2024-04-25T22:51:47.764229+0000","last_unstale":"2024-04-25T22:56:12.630835+0000","last_undegraded":"2024-04-25T22:56:12.630835+0000","last_fullsized":"2024-04-25T22:56:12.630835+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:56:12.630739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:56:12.630739+0000","last_clean_scrub_stamp":"2024-04-25T22:56:12.630739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:43:03.487402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"77'37","reported_seq":62,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:03.871590+0000","last_change":"2024-04-25T22:56:03.871621+0000","last_active":"2024-04-25T22:56:03.871590+0000","last_peered":"2024-04-25T22:56:03.871590+0000","last_clean":"2024-04-25T22:56:03.871590+0000","last_became_active":"2024-04-25T22:55:27.517290+0000","last_became_peered":"2024-04-25T22:55:27.517290+0000","last_unstale":"2024-04-25T22:56:03.871590+0000","last_undegraded":"2024-04-25T22:56:03.871590+0000","last_fullsized":"2024-04-25T22:56:03.871590+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'37","last_scrub_stamp":"2024-04-25T22:56:03.871504+0000","last_deep_scrub":"77'37","last_deep_scrub_stamp":"2024-04-25T22:56:03.871504+0000","last_clean_scrub_stamp":"2024-04-25T22:56:03.871504+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:19.959347+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327644,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":343,"num_write":34,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":327644,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"77'218","reported_seq":584,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:22.751507+0000","last_change":"2024-04-25T22:56:22.751536+0000","last_active":"2024-04-25T22:56:22.751507+0000","last_peered":"2024-04-25T22:56:22.751507+0000","last_clean":"2024-04-25T22:56:22.751507+0000","last_became_active":"2024-04-25T22:55:35.518367+0000","last_became_peered":"2024-04-25T22:55:35.518367+0000","last_unstale":"2024-04-25T22:56:22.751507+0000","last_undegraded":"2024-04-25T22:56:22.751507+0000","last_fullsized":"2024-04-25T22:56:22.751507+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'218","last_scrub_stamp":"2024-04-25T22:56:22.751428+0000","last_deep_scrub":"77'218","last_deep_scrub_stamp":"2024-04-25T22:56:22.751428+0000","last_clean_scrub_stamp":"2024-04-25T22:56:22.751428+0000","objects_scrubbed":55,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:41:04.724331+0000","scrub_duration":36,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297937,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":181,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":282175,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":57,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:11.862691+0000","last_change":"2024-04-25T22:56:11.862711+0000","last_active":"2024-04-25T22:56:11.862691+0000","last_peered":"2024-04-25T22:56:11.862691+0000","last_clean":"2024-04-25T22:56:11.862691+0000","last_became_active":"2024-04-25T22:55:27.518412+0000","last_became_peered":"2024-04-25T22:55:27.518412+0000","last_unstale":"2024-04-25T22:56:11.862691+0000","last_undegraded":"2024-04-25T22:56:11.862691+0000","last_fullsized":"2024-04-25T22:56:11.862691+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:56:11.862609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:56:11.862609+0000","last_clean_scrub_stamp":"2024-04-25T22:56:11.862609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:20:55.092925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"77'63","reported_seq":212,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:10.734440+0000","last_change":"2024-04-25T22:56:10.734489+0000","last_active":"2024-04-25T22:56:10.734440+0000","last_peered":"2024-04-25T22:56:10.734440+0000","last_clean":"2024-04-25T22:56:10.734440+0000","last_became_active":"2024-04-25T22:51:52.018300+0000","last_became_peered":"2024-04-25T22:51:52.018300+0000","last_unstale":"2024-04-25T22:56:10.734440+0000","last_undegraded":"2024-04-25T22:56:10.734440+0000","last_fullsized":"2024-04-25T22:56:10.734440+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'63","last_scrub_stamp":"2024-04-25T22:56:10.734336+0000","last_deep_scrub":"77'63","last_deep_scrub_stamp":"2024-04-25T22:56:10.734336+0000","last_clean_scrub_stamp":"2024-04-25T22:56:10.734336+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:10.426618+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":4122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"77'223","reported_seq":339,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:14.919572+0000","last_change":"2024-04-25T22:56:14.919603+0000","last_active":"2024-04-25T22:56:14.919572+0000","last_peered":"2024-04-25T22:56:14.919572+0000","last_clean":"2024-04-25T22:56:14.919572+0000","last_became_active":"2024-04-25T22:55:32.513087+0000","last_became_peered":"2024-04-25T22:55:32.513087+0000","last_unstale":"2024-04-25T22:56:14.919572+0000","last_undegraded":"2024-04-25T22:56:14.919572+0000","last_fullsized":"2024-04-25T22:56:14.919572+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'223","last_scrub_stamp":"2024-04-25T22:56:14.919499+0000","last_deep_scrub":"77'223","last_deep_scrub_stamp":"2024-04-25T22:56:14.919499+0000","last_clean_scrub_stamp":"2024-04-25T22:56:14.919499+0000","objects_scrubbed":56,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:09:57.503296+0000","scrub_duration":42,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395473,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":166,"num_write_kb":573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":395432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":160,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:00.580456+0000","last_change":"2024-04-25T22:56:00.580456+0000","last_active":"2024-04-25T22:56:00.580456+0000","last_peered":"2024-04-25T22:56:00.580456+0000","last_clean":"2024-04-25T22:56:00.580456+0000","last_became_active":"2024-04-25T22:55:27.516952+0000","last_became_peered":"2024-04-25T22:55:27.516952+0000","last_unstale":"2024-04-25T22:56:00.580456+0000","last_undegraded":"2024-04-25T22:56:00.580456+0000","last_fullsized":"2024-04-25T22:56:00.580456+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:56:00.580330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:56:00.580330+0000","last_clean_scrub_stamp":"2024-04-25T22:56:00.580330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:47.557382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":124,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:49.530959+0000","last_change":"2024-04-25T22:55:49.530959+0000","last_active":"2024-04-25T22:55:49.530959+0000","last_peered":"2024-04-25T22:55:49.530959+0000","last_clean":"2024-04-25T22:55:49.530959+0000","last_became_active":"2024-04-25T22:55:38.516294+0000","last_became_peered":"2024-04-25T22:55:38.516294+0000","last_unstale":"2024-04-25T22:55:49.530959+0000","last_undegraded":"2024-04-25T22:55:49.530959+0000","last_fullsized":"2024-04-25T22:55:49.530959+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:55:49.530819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:55:49.530819+0000","last_clean_scrub_stamp":"2024-04-25T22:55:49.530819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:10:32.958355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"77'212","reported_seq":330,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:54.853393+0000","last_change":"2024-04-25T22:55:54.853423+0000","last_active":"2024-04-25T22:55:54.853393+0000","last_peered":"2024-04-25T22:55:54.853393+0000","last_clean":"2024-04-25T22:55:54.853393+0000","last_became_active":"2024-04-25T22:55:31.526666+0000","last_became_peered":"2024-04-25T22:55:31.526666+0000","last_unstale":"2024-04-25T22:55:54.853393+0000","last_undegraded":"2024-04-25T22:55:54.853393+0000","last_fullsized":"2024-04-25T22:55:54.853393+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'212","last_scrub_stamp":"2024-04-25T22:55:54.853320+0000","last_deep_scrub":"77'212","last_deep_scrub_stamp":"2024-04-25T22:55:54.853320+0000","last_clean_scrub_stamp":"2024-04-25T22:55:54.853320+0000","objects_scrubbed":56,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:21:54.921835+0000","scrub_duration":36,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100051,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":100051,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"52'1","reported_seq":155,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:02.589864+0000","last_change":"2024-04-25T22:56:02.589864+0000","last_active":"2024-04-25T22:56:02.589864+0000","last_peered":"2024-04-25T22:56:02.589864+0000","last_clean":"2024-04-25T22:56:02.589864+0000","last_became_active":"2024-04-25T22:55:27.516760+0000","last_became_peered":"2024-04-25T22:55:27.516760+0000","last_unstale":"2024-04-25T22:56:02.589864+0000","last_undegraded":"2024-04-25T22:56:02.589864+0000","last_fullsized":"2024-04-25T22:56:02.589864+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'1","last_scrub_stamp":"2024-04-25T22:56:02.589755+0000","last_deep_scrub":"52'1","last_deep_scrub_stamp":"2024-04-25T22:56:02.589755+0000","last_clean_scrub_stamp":"2024-04-25T22:56:02.589755+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:06:55.590048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":57,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:08.839157+0000","last_change":"2024-04-25T22:56:08.839203+0000","last_active":"2024-04-25T22:56:08.839157+0000","last_peered":"2024-04-25T22:56:08.839157+0000","last_clean":"2024-04-25T22:56:08.839157+0000","last_became_active":"2024-04-25T22:55:27.516272+0000","last_became_peered":"2024-04-25T22:55:27.516272+0000","last_unstale":"2024-04-25T22:56:08.839157+0000","last_undegraded":"2024-04-25T22:56:08.839157+0000","last_fullsized":"2024-04-25T22:56:08.839157+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:56:08.839017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:56:08.839017+0000","last_clean_scrub_stamp":"2024-04-25T22:56:08.839017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:35:32.538093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"77'201","reported_seq":349,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:13.776138+0000","last_change":"2024-04-25T22:56:13.776229+0000","last_active":"2024-04-25T22:56:13.776138+0000","last_peered":"2024-04-25T22:56:13.776138+0000","last_clean":"2024-04-25T22:56:13.776138+0000","last_became_active":"2024-04-25T22:51:53.025824+0000","last_became_peered":"2024-04-25T22:51:53.025824+0000","last_unstale":"2024-04-25T22:56:13.776138+0000","last_undegraded":"2024-04-25T22:56:13.776138+0000","last_fullsized":"2024-04-25T22:56:13.776138+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'201","last_scrub_stamp":"2024-04-25T22:56:13.776036+0000","last_deep_scrub":"77'201","last_deep_scrub_stamp":"2024-04-25T22:56:13.776036+0000","last_clean_scrub_stamp":"2024-04-25T22:56:13.776036+0000","objects_scrubbed":46,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:43:58.854068+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67397,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":57,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:07.821304+0000","last_change":"2024-04-25T22:56:07.821328+0000","last_active":"2024-04-25T22:56:07.821304+0000","last_peered":"2024-04-25T22:56:07.821304+0000","last_clean":"2024-04-25T22:56:07.821304+0000","last_became_active":"2024-04-25T22:55:27.515536+0000","last_became_peered":"2024-04-25T22:55:27.515536+0000","last_unstale":"2024-04-25T22:56:07.821304+0000","last_undegraded":"2024-04-25T22:56:07.821304+0000","last_fullsized":"2024-04-25T22:56:07.821304+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:56:07.821226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:56:07.821226+0000","last_clean_scrub_stamp":"2024-04-25T22:56:07.821226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:56:38.115489+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":162,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:52.582267+0000","last_change":"2024-04-25T22:55:52.582267+0000","last_active":"2024-04-25T22:55:52.582267+0000","last_peered":"2024-04-25T22:55:52.582267+0000","last_clean":"2024-04-25T22:55:52.582267+0000","last_became_active":"2024-04-25T22:55:27.517411+0000","last_became_peered":"2024-04-25T22:55:27.517411+0000","last_unstale":"2024-04-25T22:55:52.582267+0000","last_undegraded":"2024-04-25T22:55:52.582267+0000","last_fullsized":"2024-04-25T22:55:52.582267+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:55:52.582138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:55:52.582138+0000","last_clean_scrub_stamp":"2024-04-25T22:55:52.582138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:31.301317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"77'233","reported_seq":382,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:05.650553+0000","last_change":"2024-04-25T22:56:05.650553+0000","last_active":"2024-04-25T22:56:05.650553+0000","last_peered":"2024-04-25T22:56:05.650553+0000","last_clean":"2024-04-25T22:56:05.650553+0000","last_became_active":"2024-04-25T22:51:53.026458+0000","last_became_peered":"2024-04-25T22:51:53.026458+0000","last_unstale":"2024-04-25T22:56:05.650553+0000","last_undegraded":"2024-04-25T22:56:05.650553+0000","last_fullsized":"2024-04-25T22:56:05.650553+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'233","last_scrub_stamp":"2024-04-25T22:56:05.650442+0000","last_deep_scrub":"77'233","last_deep_scrub_stamp":"2024-04-25T22:56:05.650442+0000","last_clean_scrub_stamp":"2024-04-25T22:56:05.650442+0000","objects_scrubbed":58,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:06:58.650736+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192819,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"77'3","reported_seq":62,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:13.843734+0000","last_change":"2024-04-25T22:56:13.843760+0000","last_active":"2024-04-25T22:56:13.843734+0000","last_peered":"2024-04-25T22:56:13.843734+0000","last_clean":"2024-04-25T22:56:13.843734+0000","last_became_active":"2024-04-25T22:55:27.518853+0000","last_became_peered":"2024-04-25T22:55:27.518853+0000","last_unstale":"2024-04-25T22:56:13.843734+0000","last_undegraded":"2024-04-25T22:56:13.843734+0000","last_fullsized":"2024-04-25T22:56:13.843734+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'3","last_scrub_stamp":"2024-04-25T22:56:13.843657+0000","last_deep_scrub":"77'3","last_deep_scrub_stamp":"2024-04-25T22:56:13.843657+0000","last_clean_scrub_stamp":"2024-04-25T22:56:13.843657+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:01:45.074389+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":57,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:12.823691+0000","last_change":"2024-04-25T22:56:12.823711+0000","last_active":"2024-04-25T22:56:12.823691+0000","last_peered":"2024-04-25T22:56:12.823691+0000","last_clean":"2024-04-25T22:56:12.823691+0000","last_became_active":"2024-04-25T22:55:27.518183+0000","last_became_peered":"2024-04-25T22:55:27.518183+0000","last_unstale":"2024-04-25T22:56:12.823691+0000","last_undegraded":"2024-04-25T22:56:12.823691+0000","last_fullsized":"2024-04-25T22:56:12.823691+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:56:12.823608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:56:12.823608+0000","last_clean_scrub_stamp":"2024-04-25T22:56:12.823608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:08:21.483234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"77'231","reported_seq":575,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:22.078759+0000","last_change":"2024-04-25T22:56:22.078802+0000","last_active":"2024-04-25T22:56:22.078759+0000","last_peered":"2024-04-25T22:56:22.078759+0000","last_clean":"2024-04-25T22:56:22.078759+0000","last_became_active":"2024-04-25T22:55:40.538335+0000","last_became_peered":"2024-04-25T22:55:40.538335+0000","last_unstale":"2024-04-25T22:56:22.078759+0000","last_undegraded":"2024-04-25T22:56:22.078759+0000","last_fullsized":"2024-04-25T22:56:22.078759+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'231","last_scrub_stamp":"2024-04-25T22:56:22.078676+0000","last_deep_scrub":"77'231","last_deep_scrub_stamp":"2024-04-25T22:56:22.078676+0000","last_clean_scrub_stamp":"2024-04-25T22:56:22.078676+0000","objects_scrubbed":59,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:45:00.461312+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505702,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":1011342,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"77'38","reported_seq":77,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:59.886374+0000","last_change":"2024-04-25T22:55:59.886399+0000","last_active":"2024-04-25T22:55:59.886374+0000","last_peered":"2024-04-25T22:55:59.886374+0000","last_clean":"2024-04-25T22:55:59.886374+0000","last_became_active":"2024-04-25T22:55:27.518193+0000","last_became_peered":"2024-04-25T22:55:27.518193+0000","last_unstale":"2024-04-25T22:55:59.886374+0000","last_undegraded":"2024-04-25T22:55:59.886374+0000","last_fullsized":"2024-04-25T22:55:59.886374+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'38","last_scrub_stamp":"2024-04-25T22:55:59.886295+0000","last_deep_scrub":"77'38","last_deep_scrub_stamp":"2024-04-25T22:55:59.886295+0000","last_clean_scrub_stamp":"2024-04-25T22:55:59.886295+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:47.715262+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":153,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:11.623778+0000","last_change":"2024-04-25T22:56:11.623820+0000","last_active":"2024-04-25T22:56:11.623778+0000","last_peered":"2024-04-25T22:56:11.623778+0000","last_clean":"2024-04-25T22:56:11.623778+0000","last_became_active":"2024-04-25T22:51:47.763961+0000","last_became_peered":"2024-04-25T22:51:47.763961+0000","last_unstale":"2024-04-25T22:56:11.623778+0000","last_undegraded":"2024-04-25T22:56:11.623778+0000","last_fullsized":"2024-04-25T22:56:11.623778+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:56:11.623680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:56:11.623680+0000","last_clean_scrub_stamp":"2024-04-25T22:56:11.623680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:05:23.077711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"77'190","reported_seq":338,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:15.774474+0000","last_change":"2024-04-25T22:56:15.774525+0000","last_active":"2024-04-25T22:56:15.774474+0000","last_peered":"2024-04-25T22:56:15.774474+0000","last_clean":"2024-04-25T22:56:15.774474+0000","last_became_active":"2024-04-25T22:51:53.026419+0000","last_became_peered":"2024-04-25T22:51:53.026419+0000","last_unstale":"2024-04-25T22:56:15.774474+0000","last_undegraded":"2024-04-25T22:56:15.774474+0000","last_fullsized":"2024-04-25T22:56:15.774474+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'190","last_scrub_stamp":"2024-04-25T22:56:15.774382+0000","last_deep_scrub":"77'190","last_deep_scrub_stamp":"2024-04-25T22:56:15.774382+0000","last_clean_scrub_stamp":"2024-04-25T22:56:15.774382+0000","objects_scrubbed":48,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:24:59.965938+0000","scrub_duration":30,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":246196,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"77'224","reported_seq":370,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:18.684544+0000","last_change":"2024-04-25T22:56:18.684578+0000","last_active":"2024-04-25T22:56:18.684544+0000","last_peered":"2024-04-25T22:56:18.684544+0000","last_clean":"2024-04-25T22:56:18.684544+0000","last_became_active":"2024-04-25T22:51:53.021687+0000","last_became_peered":"2024-04-25T22:51:53.021687+0000","last_unstale":"2024-04-25T22:56:18.684544+0000","last_undegraded":"2024-04-25T22:56:18.684544+0000","last_fullsized":"2024-04-25T22:56:18.684544+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'224","last_scrub_stamp":"2024-04-25T22:56:18.684457+0000","last_deep_scrub":"77'224","last_deep_scrub_stamp":"2024-04-25T22:56:18.684457+0000","last_clean_scrub_stamp":"2024-04-25T22:56:18.684457+0000","objects_scrubbed":62,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:41:00.657360+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108265,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"77'47","reported_seq":193,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:14.593717+0000","last_change":"2024-04-25T22:56:14.593768+0000","last_active":"2024-04-25T22:56:14.593717+0000","last_peered":"2024-04-25T22:56:14.593717+0000","last_clean":"2024-04-25T22:56:14.593717+0000","last_became_active":"2024-04-25T22:51:52.019264+0000","last_became_peered":"2024-04-25T22:51:52.019264+0000","last_unstale":"2024-04-25T22:56:14.593717+0000","last_undegraded":"2024-04-25T22:56:14.593717+0000","last_fullsized":"2024-04-25T22:56:14.593717+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'47","last_scrub_stamp":"2024-04-25T22:56:14.593605+0000","last_deep_scrub":"77'47","last_deep_scrub_stamp":"2024-04-25T22:56:14.593605+0000","last_clean_scrub_stamp":"2024-04-25T22:56:14.593605+0000","objects_scrubbed":4,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:00:09.529629+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"77'198","reported_seq":316,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:52.879444+0000","last_change":"2024-04-25T22:55:52.879477+0000","last_active":"2024-04-25T22:55:52.879444+0000","last_peered":"2024-04-25T22:55:52.879444+0000","last_clean":"2024-04-25T22:55:52.879444+0000","last_became_active":"2024-04-25T22:55:31.526620+0000","last_became_peered":"2024-04-25T22:55:31.526620+0000","last_unstale":"2024-04-25T22:55:52.879444+0000","last_undegraded":"2024-04-25T22:55:52.879444+0000","last_fullsized":"2024-04-25T22:55:52.879444+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'198","last_scrub_stamp":"2024-04-25T22:55:52.879360+0000","last_deep_scrub":"77'198","last_deep_scrub_stamp":"2024-04-25T22:55:52.879360+0000","last_clean_scrub_stamp":"2024-04-25T22:55:52.879360+0000","objects_scrubbed":52,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:57:55.235548+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89309,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":89309,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"77'23","reported_seq":171,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:11.755020+0000","last_change":"2024-04-25T22:56:11.755064+0000","last_active":"2024-04-25T22:56:11.755020+0000","last_peered":"2024-04-25T22:56:11.755020+0000","last_clean":"2024-04-25T22:56:11.755020+0000","last_became_active":"2024-04-25T22:51:52.018519+0000","last_became_peered":"2024-04-25T22:51:52.018519+0000","last_unstale":"2024-04-25T22:56:11.755020+0000","last_undegraded":"2024-04-25T22:56:11.755020+0000","last_fullsized":"2024-04-25T22:56:11.755020+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'23","last_scrub_stamp":"2024-04-25T22:56:11.754915+0000","last_deep_scrub":"77'23","last_deep_scrub_stamp":"2024-04-25T22:56:11.754915+0000","last_clean_scrub_stamp":"2024-04-25T22:56:11.754915+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:49:24.642327+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"48'1","reported_seq":124,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:51.520874+0000","last_change":"2024-04-25T22:55:51.520917+0000","last_active":"2024-04-25T22:55:51.520874+0000","last_peered":"2024-04-25T22:55:51.520874+0000","last_clean":"2024-04-25T22:55:51.520874+0000","last_became_active":"2024-04-25T22:55:38.515986+0000","last_became_peered":"2024-04-25T22:55:38.515986+0000","last_unstale":"2024-04-25T22:55:51.520874+0000","last_undegraded":"2024-04-25T22:55:51.520874+0000","last_fullsized":"2024-04-25T22:55:51.520874+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1","last_scrub_stamp":"2024-04-25T22:55:51.520773+0000","last_deep_scrub":"48'1","last_deep_scrub_stamp":"2024-04-25T22:55:51.520773+0000","last_clean_scrub_stamp":"2024-04-25T22:55:51.520773+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:48:06.675817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"77'236","reported_seq":354,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:55.886996+0000","last_change":"2024-04-25T22:55:55.887042+0000","last_active":"2024-04-25T22:55:55.886996+0000","last_peered":"2024-04-25T22:55:55.886996+0000","last_clean":"2024-04-25T22:55:55.886996+0000","last_became_active":"2024-04-25T22:55:30.525233+0000","last_became_peered":"2024-04-25T22:55:30.525233+0000","last_unstale":"2024-04-25T22:55:55.886996+0000","last_undegraded":"2024-04-25T22:55:55.886996+0000","last_fullsized":"2024-04-25T22:55:55.886996+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'236","last_scrub_stamp":"2024-04-25T22:55:55.886909+0000","last_deep_scrub":"77'236","last_deep_scrub_stamp":"2024-04-25T22:55:55.886909+0000","last_clean_scrub_stamp":"2024-04-25T22:55:55.886909+0000","objects_scrubbed":65,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:07:00.547163+0000","scrub_duration":42,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":332166,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":329490,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"51'2","reported_seq":57,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:10.853673+0000","last_change":"2024-04-25T22:56:10.853697+0000","last_active":"2024-04-25T22:56:10.853673+0000","last_peered":"2024-04-25T22:56:10.853673+0000","last_clean":"2024-04-25T22:56:10.853673+0000","last_became_active":"2024-04-25T22:55:27.518244+0000","last_became_peered":"2024-04-25T22:55:27.518244+0000","last_unstale":"2024-04-25T22:56:10.853673+0000","last_undegraded":"2024-04-25T22:56:10.853673+0000","last_fullsized":"2024-04-25T22:56:10.853673+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'2","last_scrub_stamp":"2024-04-25T22:56:10.853589+0000","last_deep_scrub":"51'2","last_deep_scrub_stamp":"2024-04-25T22:56:10.853589+0000","last_clean_scrub_stamp":"2024-04-25T22:56:10.853589+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:08:45.545174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"77'208","reported_seq":328,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:50.910764+0000","last_change":"2024-04-25T22:55:50.910790+0000","last_active":"2024-04-25T22:55:50.910764+0000","last_peered":"2024-04-25T22:55:50.910764+0000","last_clean":"2024-04-25T22:55:50.910764+0000","last_became_active":"2024-04-25T22:55:30.526853+0000","last_became_peered":"2024-04-25T22:55:30.526853+0000","last_unstale":"2024-04-25T22:55:50.910764+0000","last_undegraded":"2024-04-25T22:55:50.910764+0000","last_fullsized":"2024-04-25T22:55:50.910764+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'208","last_scrub_stamp":"2024-04-25T22:55:50.910652+0000","last_deep_scrub":"77'208","last_deep_scrub_stamp":"2024-04-25T22:55:50.910652+0000","last_clean_scrub_stamp":"2024-04-25T22:55:50.910652+0000","objects_scrubbed":50,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:21:47.382105+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70967,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":70967,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"77'222","reported_seq":371,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:55.635725+0000","last_change":"2024-04-25T22:55:55.635725+0000","last_active":"2024-04-25T22:55:55.635725+0000","last_peered":"2024-04-25T22:55:55.635725+0000","last_clean":"2024-04-25T22:55:55.635725+0000","last_became_active":"2024-04-25T22:51:53.028635+0000","last_became_peered":"2024-04-25T22:51:53.028635+0000","last_unstale":"2024-04-25T22:55:55.635725+0000","last_undegraded":"2024-04-25T22:55:55.635725+0000","last_fullsized":"2024-04-25T22:55:55.635725+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'222","last_scrub_stamp":"2024-04-25T22:55:55.635582+0000","last_deep_scrub":"77'222","last_deep_scrub_stamp":"2024-04-25T22:55:55.635582+0000","last_clean_scrub_stamp":"2024-04-25T22:55:55.635582+0000","objects_scrubbed":50,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:02.536428+0000","scrub_duration":42,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":440592,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"50'1","reported_seq":57,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:06.846238+0000","last_change":"2024-04-25T22:56:06.846263+0000","last_active":"2024-04-25T22:56:06.846238+0000","last_peered":"2024-04-25T22:56:06.846238+0000","last_clean":"2024-04-25T22:56:06.846238+0000","last_became_active":"2024-04-25T22:55:27.515473+0000","last_became_peered":"2024-04-25T22:55:27.515473+0000","last_unstale":"2024-04-25T22:56:06.846238+0000","last_undegraded":"2024-04-25T22:56:06.846238+0000","last_fullsized":"2024-04-25T22:56:06.846238+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"50'1","last_scrub_stamp":"2024-04-25T22:56:06.846147+0000","last_deep_scrub":"50'1","last_deep_scrub_stamp":"2024-04-25T22:56:06.846147+0000","last_clean_scrub_stamp":"2024-04-25T22:56:06.846147+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:41:50.152631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"77'201","reported_seq":311,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:16.925082+0000","last_change":"2024-04-25T22:56:16.925113+0000","last_active":"2024-04-25T22:56:16.925082+0000","last_peered":"2024-04-25T22:56:16.925082+0000","last_clean":"2024-04-25T22:56:16.925082+0000","last_became_active":"2024-04-25T22:55:34.512137+0000","last_became_peered":"2024-04-25T22:55:34.512137+0000","last_unstale":"2024-04-25T22:56:16.925082+0000","last_undegraded":"2024-04-25T22:56:16.925082+0000","last_fullsized":"2024-04-25T22:56:16.925082+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'201","last_scrub_stamp":"2024-04-25T22:56:16.925002+0000","last_deep_scrub":"77'201","last_deep_scrub_stamp":"2024-04-25T22:56:16.925002+0000","last_clean_scrub_stamp":"2024-04-25T22:56:16.925002+0000","objects_scrubbed":50,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:38:06.651622+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106917,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":97731,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":85,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:19.981734+0000","last_change":"2024-04-25T22:56:19.981769+0000","last_active":"2024-04-25T22:56:19.981734+0000","last_peered":"2024-04-25T22:56:19.981734+0000","last_clean":"2024-04-25T22:56:19.981734+0000","last_became_active":"2024-04-25T22:55:37.513925+0000","last_became_peered":"2024-04-25T22:55:37.513925+0000","last_unstale":"2024-04-25T22:56:19.981734+0000","last_undegraded":"2024-04-25T22:56:19.981734+0000","last_fullsized":"2024-04-25T22:56:19.981734+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:56:19.981622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:56:19.981622+0000","last_clean_scrub_stamp":"2024-04-25T22:56:19.981622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:57:11.603447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"77'263","reported_seq":411,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:01.626542+0000","last_change":"2024-04-25T22:56:01.626594+0000","last_active":"2024-04-25T22:56:01.626542+0000","last_peered":"2024-04-25T22:56:01.626542+0000","last_clean":"2024-04-25T22:56:01.626542+0000","last_became_active":"2024-04-25T22:51:53.027541+0000","last_became_peered":"2024-04-25T22:51:53.027541+0000","last_unstale":"2024-04-25T22:56:01.626542+0000","last_undegraded":"2024-04-25T22:56:01.626542+0000","last_fullsized":"2024-04-25T22:56:01.626542+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'263","last_scrub_stamp":"2024-04-25T22:56:01.626434+0000","last_deep_scrub":"77'263","last_deep_scrub_stamp":"2024-04-25T22:56:01.626434+0000","last_clean_scrub_stamp":"2024-04-25T22:56:01.626434+0000","objects_scrubbed":60,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:38.224020+0000","scrub_duration":49,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195653,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"77'3","reported_seq":163,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:58.589105+0000","last_change":"2024-04-25T22:55:58.589150+0000","last_active":"2024-04-25T22:55:58.589105+0000","last_peered":"2024-04-25T22:55:58.589105+0000","last_clean":"2024-04-25T22:55:58.589105+0000","last_became_active":"2024-04-25T22:55:27.517718+0000","last_became_peered":"2024-04-25T22:55:27.517718+0000","last_unstale":"2024-04-25T22:55:58.589105+0000","last_undegraded":"2024-04-25T22:55:58.589105+0000","last_fullsized":"2024-04-25T22:55:58.589105+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'3","last_scrub_stamp":"2024-04-25T22:55:58.588997+0000","last_deep_scrub":"77'3","last_deep_scrub_stamp":"2024-04-25T22:55:58.588997+0000","last_clean_scrub_stamp":"2024-04-25T22:55:58.588997+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:35:11.784147+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"77'224","reported_seq":591,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:51.611484+0000","last_change":"2024-04-25T22:55:51.611515+0000","last_active":"2024-04-25T22:55:51.611484+0000","last_peered":"2024-04-25T22:55:51.611484+0000","last_clean":"2024-04-25T22:55:51.611484+0000","last_became_active":"2024-04-25T22:55:34.513433+0000","last_became_peered":"2024-04-25T22:55:34.513433+0000","last_unstale":"2024-04-25T22:55:51.611484+0000","last_undegraded":"2024-04-25T22:55:51.611484+0000","last_fullsized":"2024-04-25T22:55:51.611484+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'224","last_scrub_stamp":"2024-04-25T22:55:51.611408+0000","last_deep_scrub":"77'224","last_deep_scrub_stamp":"2024-04-25T22:55:51.611408+0000","last_clean_scrub_stamp":"2024-04-25T22:55:51.611408+0000","objects_scrubbed":56,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:28:09.655049+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151921,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":151921,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"77'6","reported_seq":180,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:23.733731+0000","last_change":"2024-04-25T22:56:23.733791+0000","last_active":"2024-04-25T22:56:23.733731+0000","last_peered":"2024-04-25T22:56:23.733731+0000","last_clean":"2024-04-25T22:56:23.733731+0000","last_became_active":"2024-04-25T22:55:37.516119+0000","last_became_peered":"2024-04-25T22:55:37.516119+0000","last_unstale":"2024-04-25T22:56:23.733731+0000","last_undegraded":"2024-04-25T22:56:23.733731+0000","last_fullsized":"2024-04-25T22:56:23.733731+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'6","last_scrub_stamp":"2024-04-25T22:56:23.733631+0000","last_deep_scrub":"77'6","last_deep_scrub_stamp":"2024-04-25T22:56:23.733631+0000","last_clean_scrub_stamp":"2024-04-25T22:56:23.733631+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:39:27.729146+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"77'215","reported_seq":564,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:20.694060+0000","last_change":"2024-04-25T22:56:20.694118+0000","last_active":"2024-04-25T22:56:20.694060+0000","last_peered":"2024-04-25T22:56:20.694060+0000","last_clean":"2024-04-25T22:56:20.694060+0000","last_became_active":"2024-04-25T22:55:38.516260+0000","last_became_peered":"2024-04-25T22:55:38.516260+0000","last_unstale":"2024-04-25T22:56:20.694060+0000","last_undegraded":"2024-04-25T22:56:20.694060+0000","last_fullsized":"2024-04-25T22:56:20.694060+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'215","last_scrub_stamp":"2024-04-25T22:56:20.693977+0000","last_deep_scrub":"77'215","last_deep_scrub_stamp":"2024-04-25T22:56:20.693977+0000","last_clean_scrub_stamp":"2024-04-25T22:56:20.693977+0000","objects_scrubbed":49,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:08:32.018141+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3798024,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":3871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":3798024,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"77'3","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:24.627487+0000","last_change":"2024-04-25T22:56:24.627543+0000","last_active":"2024-04-25T22:56:24.627487+0000","last_peered":"2024-04-25T22:56:24.627487+0000","last_clean":"2024-04-25T22:56:24.627487+0000","last_became_active":"2024-04-25T22:55:38.515776+0000","last_became_peered":"2024-04-25T22:55:38.515776+0000","last_unstale":"2024-04-25T22:56:24.627487+0000","last_undegraded":"2024-04-25T22:56:24.627487+0000","last_fullsized":"2024-04-25T22:56:24.627487+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'3","last_scrub_stamp":"2024-04-25T22:56:24.627387+0000","last_deep_scrub":"77'3","last_deep_scrub_stamp":"2024-04-25T22:56:24.627387+0000","last_clean_scrub_stamp":"2024-04-25T22:56:24.627387+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:14.643992+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"77'215","reported_seq":563,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:52.576305+0000","last_change":"2024-04-25T22:55:52.576340+0000","last_active":"2024-04-25T22:55:52.576305+0000","last_peered":"2024-04-25T22:55:52.576305+0000","last_clean":"2024-04-25T22:55:52.576305+0000","last_became_active":"2024-04-25T22:55:38.514732+0000","last_became_peered":"2024-04-25T22:55:38.514732+0000","last_unstale":"2024-04-25T22:55:52.576305+0000","last_undegraded":"2024-04-25T22:55:52.576305+0000","last_fullsized":"2024-04-25T22:55:52.576305+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'215","last_scrub_stamp":"2024-04-25T22:55:52.576225+0000","last_deep_scrub":"77'215","last_deep_scrub_stamp":"2024-04-25T22:55:52.576225+0000","last_clean_scrub_stamp":"2024-04-25T22:55:52.576225+0000","objects_scrubbed":57,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:46:59.477071+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141656,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":141656,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"77'60","reported_seq":208,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:12.798678+0000","last_change":"2024-04-25T22:56:12.798728+0000","last_active":"2024-04-25T22:56:12.798678+0000","last_peered":"2024-04-25T22:56:12.798678+0000","last_clean":"2024-04-25T22:56:12.798678+0000","last_became_active":"2024-04-25T22:51:52.018547+0000","last_became_peered":"2024-04-25T22:51:52.018547+0000","last_unstale":"2024-04-25T22:56:12.798678+0000","last_undegraded":"2024-04-25T22:56:12.798678+0000","last_fullsized":"2024-04-25T22:56:12.798678+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'60","last_scrub_stamp":"2024-04-25T22:56:12.798556+0000","last_deep_scrub":"77'60","last_deep_scrub_stamp":"2024-04-25T22:56:12.798556+0000","last_clean_scrub_stamp":"2024-04-25T22:56:12.798556+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:43:40.940730+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":8213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"77'232","reported_seq":609,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:18.766813+0000","last_change":"2024-04-25T22:56:18.766867+0000","last_active":"2024-04-25T22:56:18.766813+0000","last_peered":"2024-04-25T22:56:18.766813+0000","last_clean":"2024-04-25T22:56:18.766813+0000","last_became_active":"2024-04-25T22:55:35.517149+0000","last_became_peered":"2024-04-25T22:55:35.517149+0000","last_unstale":"2024-04-25T22:56:18.766813+0000","last_undegraded":"2024-04-25T22:56:18.766813+0000","last_fullsized":"2024-04-25T22:56:18.766813+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'232","last_scrub_stamp":"2024-04-25T22:56:18.766725+0000","last_deep_scrub":"77'232","last_deep_scrub_stamp":"2024-04-25T22:56:18.766725+0000","last_clean_scrub_stamp":"2024-04-25T22:56:18.766725+0000","objects_scrubbed":63,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:00:13.702749+0000","scrub_duration":37,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184603,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":194,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":166098,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"77'26","reported_seq":66,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:57.865558+0000","last_change":"2024-04-25T22:55:57.865590+0000","last_active":"2024-04-25T22:55:57.865558+0000","last_peered":"2024-04-25T22:55:57.865558+0000","last_clean":"2024-04-25T22:55:57.865558+0000","last_became_active":"2024-04-25T22:55:27.520617+0000","last_became_peered":"2024-04-25T22:55:27.520617+0000","last_unstale":"2024-04-25T22:55:57.865558+0000","last_undegraded":"2024-04-25T22:55:57.865558+0000","last_fullsized":"2024-04-25T22:55:57.865558+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'26","last_scrub_stamp":"2024-04-25T22:55:57.865473+0000","last_deep_scrub":"77'26","last_deep_scrub_stamp":"2024-04-25T22:55:57.865473+0000","last_clean_scrub_stamp":"2024-04-25T22:55:57.865473+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:12.757049+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"77'261","reported_seq":670,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:59.604940+0000","last_change":"2024-04-25T22:55:59.604979+0000","last_active":"2024-04-25T22:55:59.604940+0000","last_peered":"2024-04-25T22:55:59.604940+0000","last_clean":"2024-04-25T22:55:59.604940+0000","last_became_active":"2024-04-25T22:55:31.526322+0000","last_became_peered":"2024-04-25T22:55:31.526322+0000","last_unstale":"2024-04-25T22:55:59.604940+0000","last_undegraded":"2024-04-25T22:55:59.604940+0000","last_fullsized":"2024-04-25T22:55:59.604940+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'261","last_scrub_stamp":"2024-04-25T22:55:59.604843+0000","last_deep_scrub":"77'261","last_deep_scrub_stamp":"2024-04-25T22:55:59.604843+0000","last_clean_scrub_stamp":"2024-04-25T22:55:59.604843+0000","objects_scrubbed":65,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:11:11.381669+0000","scrub_duration":48,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200980,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":211,"num_write_kb":410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":126,"num_bytes_recovered":197679,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"77'10","reported_seq":110,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:21.005241+0000","last_change":"2024-04-25T22:56:21.005269+0000","last_active":"2024-04-25T22:56:21.005241+0000","last_peered":"2024-04-25T22:56:21.005241+0000","last_clean":"2024-04-25T22:56:21.005241+0000","last_became_active":"2024-04-25T22:55:37.516183+0000","last_became_peered":"2024-04-25T22:55:37.516183+0000","last_unstale":"2024-04-25T22:56:21.005241+0000","last_undegraded":"2024-04-25T22:56:21.005241+0000","last_fullsized":"2024-04-25T22:56:21.005241+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'10","last_scrub_stamp":"2024-04-25T22:56:21.005159+0000","last_deep_scrub":"77'10","last_deep_scrub_stamp":"2024-04-25T22:56:21.005159+0000","last_clean_scrub_stamp":"2024-04-25T22:56:21.005159+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:01:41.294892+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8389190,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26691649,"num_objects":3448,"num_object_clones":0,"num_object_copies":6896,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3448,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10583,"num_write_kb":38991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4953,"num_bytes_recovered":24173691,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73056256,"data_stored":53061590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13812,"ondisk_log_size":13812,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":40502861,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":34,"num_read_kb":343,"num_write":470,"num_write_kb":40224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":32113365,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":81068032,"data_stored":81005722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5351,"internal_metadata":0},"log_size":466,"ondisk_log_size":466,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738428,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":94548,"kb_used_data":49484,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94277292,"statfs":{"total":96636764160,"available":96539947008,"internally_reserved":0,"allocated":50671616,"data_stored":43771464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":62,"seq":266287972366,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76920,"kb_used_data":45232,"kb_used_omap":6,"kb_used_meta":31673,"kb_avail":94294920,"statfs":{"total":96636764160,"available":96557998080,"internally_reserved":0,"allocated":46317568,"data_stored":38899263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6946,"internal_metadata":32433374},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738428,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":112296,"kb_used_data":58912,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94259544,"statfs":{"total":96636764160,"available":96521773056,"internally_reserved":0,"allocated":60325888,"data_stored":53539649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32145408,"data_stored":32114253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19542016,"data_stored":19530487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5351,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":29380608,"data_stored":29360982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":26918912,"data_stored":20514252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26107904,"data_stored":19048000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20029440,"data_stored":13499338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:56:31.200 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-25T22:51:52.000495+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=22, tm_min=55, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T22:56:31.201 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T22:56:51.202 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T22:56:51.518 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:56:51.520 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-25T22:56:51.530 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":227,"stamp":"2024-04-25T22:56:50.004235+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":67784878,"num_objects":3482,"num_object_clones":0,"num_object_copies":6964,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3482,"num_whiteouts":0,"num_read":170,"num_read_kb":461,"num_write":11256,"num_write_kb":82675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4966,"num_bytes_recovered":56287056,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14488,"ondisk_log_size":14488,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":283764,"kb_used_data":153628,"kb_used_omap":9,"kb_used_meta":130102,"kb_avail":282831756,"statfs":{"total":289910292480,"available":289619718144,"internally_reserved":0,"allocated":157315072,"data_stored":136210376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10136,"internal_metadata":133224552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003303"},"pg_stats":[{"pgid":"4.3f","version":"77'217","reported_seq":585,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:50.585741+0000","last_change":"2024-04-25T22:55:50.585741+0000","last_active":"2024-04-25T22:55:50.585741+0000","last_peered":"2024-04-25T22:55:50.585741+0000","last_clean":"2024-04-25T22:55:50.585741+0000","last_became_active":"2024-04-25T22:55:34.514302+0000","last_became_peered":"2024-04-25T22:55:34.514302+0000","last_unstale":"2024-04-25T22:55:50.585741+0000","last_undegraded":"2024-04-25T22:55:50.585741+0000","last_fullsized":"2024-04-25T22:55:50.585741+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'217","last_scrub_stamp":"2024-04-25T22:55:50.585625+0000","last_deep_scrub":"77'217","last_deep_scrub_stamp":"2024-04-25T22:55:50.585625+0000","last_clean_scrub_stamp":"2024-04-25T22:55:50.585625+0000","objects_scrubbed":57,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:45:04.825113+0000","scrub_duration":49,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168293,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":168293,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"77'203","reported_seq":557,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:20.792834+0000","last_change":"2024-04-25T22:56:20.792868+0000","last_active":"2024-04-25T22:56:20.792834+0000","last_peered":"2024-04-25T22:56:20.792834+0000","last_clean":"2024-04-25T22:56:20.792834+0000","last_became_active":"2024-04-25T22:55:35.517561+0000","last_became_peered":"2024-04-25T22:55:35.517561+0000","last_unstale":"2024-04-25T22:56:20.792834+0000","last_undegraded":"2024-04-25T22:56:20.792834+0000","last_fullsized":"2024-04-25T22:56:20.792834+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'203","last_scrub_stamp":"2024-04-25T22:56:20.792752+0000","last_deep_scrub":"77'203","last_deep_scrub_stamp":"2024-04-25T22:56:20.792752+0000","last_clean_scrub_stamp":"2024-04-25T22:56:20.792752+0000","objects_scrubbed":50,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:44:59.375371+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286387,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":286387,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"77'214","reported_seq":299,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:22.645908+0000","last_change":"2024-04-25T22:56:22.645962+0000","last_active":"2024-04-25T22:56:22.645908+0000","last_peered":"2024-04-25T22:56:22.645908+0000","last_clean":"2024-04-25T22:56:22.645908+0000","last_became_active":"2024-04-25T22:55:38.517874+0000","last_became_peered":"2024-04-25T22:55:38.517874+0000","last_unstale":"2024-04-25T22:56:22.645908+0000","last_undegraded":"2024-04-25T22:56:22.645908+0000","last_fullsized":"2024-04-25T22:56:22.645908+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'214","last_scrub_stamp":"2024-04-25T22:56:22.645808+0000","last_deep_scrub":"77'214","last_deep_scrub_stamp":"2024-04-25T22:56:22.645808+0000","last_clean_scrub_stamp":"2024-04-25T22:56:22.645808+0000","objects_scrubbed":50,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:40.654822+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130188,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"77'173","reported_seq":481,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:54.624422+0000","last_change":"2024-04-25T22:55:54.624422+0000","last_active":"2024-04-25T22:55:54.624422+0000","last_peered":"2024-04-25T22:55:54.624422+0000","last_clean":"2024-04-25T22:55:54.624422+0000","last_became_active":"2024-04-25T22:55:38.513558+0000","last_became_peered":"2024-04-25T22:55:38.513558+0000","last_unstale":"2024-04-25T22:55:54.624422+0000","last_undegraded":"2024-04-25T22:55:54.624422+0000","last_fullsized":"2024-04-25T22:55:54.624422+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'173","last_scrub_stamp":"2024-04-25T22:55:54.624271+0000","last_deep_scrub":"77'173","last_deep_scrub_stamp":"2024-04-25T22:55:54.624271+0000","last_clean_scrub_stamp":"2024-04-25T22:55:54.624271+0000","objects_scrubbed":47,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:54:42.553756+0000","scrub_duration":34,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142819,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":135761,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"77'245","reported_seq":642,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:17.798478+0000","last_change":"2024-04-25T22:56:17.798530+0000","last_active":"2024-04-25T22:56:17.798478+0000","last_peered":"2024-04-25T22:56:17.798478+0000","last_clean":"2024-04-25T22:56:17.798478+0000","last_became_active":"2024-04-25T22:55:35.517044+0000","last_became_peered":"2024-04-25T22:55:35.517044+0000","last_unstale":"2024-04-25T22:56:17.798478+0000","last_undegraded":"2024-04-25T22:56:17.798478+0000","last_fullsized":"2024-04-25T22:56:17.798478+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'245","last_scrub_stamp":"2024-04-25T22:56:17.798398+0000","last_deep_scrub":"77'245","last_deep_scrub_stamp":"2024-04-25T22:56:17.798398+0000","last_clean_scrub_stamp":"2024-04-25T22:56:17.798398+0000","objects_scrubbed":72,"log_size":245,"log_dups_size":0,"ondisk_log_size":245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:14:08.541404+0000","scrub_duration":46,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":709662,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":119,"num_bytes_recovered":709653,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"77'220","reported_seq":573,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:09.713666+0000","last_change":"2024-04-25T22:56:09.713709+0000","last_active":"2024-04-25T22:56:09.713666+0000","last_peered":"2024-04-25T22:56:09.713666+0000","last_clean":"2024-04-25T22:56:09.713666+0000","last_became_active":"2024-04-25T22:55:38.513456+0000","last_became_peered":"2024-04-25T22:55:38.513456+0000","last_unstale":"2024-04-25T22:56:09.713666+0000","last_undegraded":"2024-04-25T22:56:09.713666+0000","last_fullsized":"2024-04-25T22:56:09.713666+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'220","last_scrub_stamp":"2024-04-25T22:56:09.713570+0000","last_deep_scrub":"77'220","last_deep_scrub_stamp":"2024-04-25T22:56:09.713570+0000","last_clean_scrub_stamp":"2024-04-25T22:56:09.713570+0000","objects_scrubbed":47,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:43:37.855744+0000","scrub_duration":37,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569466,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":569466,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"77'228","reported_seq":607,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:03.665207+0000","last_change":"2024-04-25T22:56:03.665255+0000","last_active":"2024-04-25T22:56:03.665207+0000","last_peered":"2024-04-25T22:56:03.665207+0000","last_clean":"2024-04-25T22:56:03.665207+0000","last_became_active":"2024-04-25T22:55:33.511961+0000","last_became_peered":"2024-04-25T22:55:33.511961+0000","last_unstale":"2024-04-25T22:56:03.665207+0000","last_undegraded":"2024-04-25T22:56:03.665207+0000","last_fullsized":"2024-04-25T22:56:03.665207+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'228","last_scrub_stamp":"2024-04-25T22:56:03.665102+0000","last_deep_scrub":"77'228","last_deep_scrub_stamp":"2024-04-25T22:56:03.665102+0000","last_clean_scrub_stamp":"2024-04-25T22:56:03.665102+0000","objects_scrubbed":55,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:31:16.236002+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75460,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":111,"num_bytes_recovered":75460,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"77'180","reported_seq":506,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:01.623980+0000","last_change":"2024-04-25T22:56:01.624031+0000","last_active":"2024-04-25T22:56:01.623980+0000","last_peered":"2024-04-25T22:56:01.623980+0000","last_clean":"2024-04-25T22:56:01.623980+0000","last_became_active":"2024-04-25T22:55:32.509908+0000","last_became_peered":"2024-04-25T22:55:32.509908+0000","last_unstale":"2024-04-25T22:56:01.623980+0000","last_undegraded":"2024-04-25T22:56:01.623980+0000","last_fullsized":"2024-04-25T22:56:01.623980+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'180","last_scrub_stamp":"2024-04-25T22:56:01.623899+0000","last_deep_scrub":"77'180","last_deep_scrub_stamp":"2024-04-25T22:56:01.623899+0000","last_clean_scrub_stamp":"2024-04-25T22:56:01.623899+0000","objects_scrubbed":40,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:48:15.905014+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":214453,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":214404,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"77'226","reported_seq":342,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:02.912759+0000","last_change":"2024-04-25T22:56:02.912791+0000","last_active":"2024-04-25T22:56:02.912759+0000","last_peered":"2024-04-25T22:56:02.912759+0000","last_clean":"2024-04-25T22:56:02.912759+0000","last_became_active":"2024-04-25T22:55:32.512447+0000","last_became_peered":"2024-04-25T22:55:32.512447+0000","last_unstale":"2024-04-25T22:56:02.912759+0000","last_undegraded":"2024-04-25T22:56:02.912759+0000","last_fullsized":"2024-04-25T22:56:02.912759+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'226","last_scrub_stamp":"2024-04-25T22:56:02.912678+0000","last_deep_scrub":"77'226","last_deep_scrub_stamp":"2024-04-25T22:56:02.912678+0000","last_clean_scrub_stamp":"2024-04-25T22:56:02.912678+0000","objects_scrubbed":57,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:14:20.686518+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":538374,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":538374,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"77'201","reported_seq":542,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:19.775052+0000","last_change":"2024-04-25T22:56:19.775052+0000","last_active":"2024-04-25T22:56:19.775052+0000","last_peered":"2024-04-25T22:56:19.775052+0000","last_clean":"2024-04-25T22:56:19.775052+0000","last_became_active":"2024-04-25T22:55:35.517506+0000","last_became_peered":"2024-04-25T22:55:35.517506+0000","last_unstale":"2024-04-25T22:56:19.775052+0000","last_undegraded":"2024-04-25T22:56:19.775052+0000","last_fullsized":"2024-04-25T22:56:19.775052+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'201","last_scrub_stamp":"2024-04-25T22:56:19.774928+0000","last_deep_scrub":"77'201","last_deep_scrub_stamp":"2024-04-25T22:56:19.774928+0000","last_clean_scrub_stamp":"2024-04-25T22:56:19.774928+0000","objects_scrubbed":48,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:06:14.150493+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130447,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":123390,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"77'215","reported_seq":330,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:25.631996+0000","last_change":"2024-04-25T22:56:25.632027+0000","last_active":"2024-04-25T22:56:25.631996+0000","last_peered":"2024-04-25T22:56:25.631996+0000","last_clean":"2024-04-25T22:56:25.631996+0000","last_became_active":"2024-04-25T22:55:40.538052+0000","last_became_peered":"2024-04-25T22:55:40.538052+0000","last_unstale":"2024-04-25T22:56:25.631996+0000","last_undegraded":"2024-04-25T22:56:25.631996+0000","last_fullsized":"2024-04-25T22:56:25.631996+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'215","last_scrub_stamp":"2024-04-25T22:56:25.631919+0000","last_deep_scrub":"77'215","last_deep_scrub_stamp":"2024-04-25T22:56:25.631919+0000","last_clean_scrub_stamp":"2024-04-25T22:56:25.631919+0000","objects_scrubbed":61,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:31:08.790008+0000","scrub_duration":46,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":343806,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":208,"num_bytes_recovered":687612,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"77'193","reported_seq":342,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:03.629111+0000","last_change":"2024-04-25T22:56:03.629111+0000","last_active":"2024-04-25T22:56:03.629111+0000","last_peered":"2024-04-25T22:56:03.629111+0000","last_clean":"2024-04-25T22:56:03.629111+0000","last_became_active":"2024-04-25T22:51:53.027363+0000","last_became_peered":"2024-04-25T22:51:53.027363+0000","last_unstale":"2024-04-25T22:56:03.629111+0000","last_undegraded":"2024-04-25T22:56:03.629111+0000","last_fullsized":"2024-04-25T22:56:03.629111+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'193","last_scrub_stamp":"2024-04-25T22:56:03.629005+0000","last_deep_scrub":"77'193","last_deep_scrub_stamp":"2024-04-25T22:56:03.629005+0000","last_clean_scrub_stamp":"2024-04-25T22:56:03.629005+0000","objects_scrubbed":52,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:50.606057+0000","scrub_duration":37,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125409,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"77'187","reported_seq":523,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:06.668280+0000","last_change":"2024-04-25T22:56:06.668280+0000","last_active":"2024-04-25T22:56:06.668280+0000","last_peered":"2024-04-25T22:56:06.668280+0000","last_clean":"2024-04-25T22:56:06.668280+0000","last_became_active":"2024-04-25T22:55:33.511546+0000","last_became_peered":"2024-04-25T22:55:33.511546+0000","last_unstale":"2024-04-25T22:56:06.668280+0000","last_undegraded":"2024-04-25T22:56:06.668280+0000","last_fullsized":"2024-04-25T22:56:06.668280+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'187","last_scrub_stamp":"2024-04-25T22:56:06.668176+0000","last_deep_scrub":"77'187","last_deep_scrub_stamp":"2024-04-25T22:56:06.668176+0000","last_clean_scrub_stamp":"2024-04-25T22:56:06.668176+0000","objects_scrubbed":52,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:31:19.239076+0000","scrub_duration":34,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":183835,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":183835,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"77'222","reported_seq":368,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:10.670570+0000","last_change":"2024-04-25T22:56:10.670570+0000","last_active":"2024-04-25T22:56:10.670570+0000","last_peered":"2024-04-25T22:56:10.670570+0000","last_clean":"2024-04-25T22:56:10.670570+0000","last_became_active":"2024-04-25T22:51:53.021902+0000","last_became_peered":"2024-04-25T22:51:53.021902+0000","last_unstale":"2024-04-25T22:56:10.670570+0000","last_undegraded":"2024-04-25T22:56:10.670570+0000","last_fullsized":"2024-04-25T22:56:10.670570+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'222","last_scrub_stamp":"2024-04-25T22:56:10.670422+0000","last_deep_scrub":"77'222","last_deep_scrub_stamp":"2024-04-25T22:56:10.670422+0000","last_clean_scrub_stamp":"2024-04-25T22:56:10.670422+0000","objects_scrubbed":43,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:43:55.748454+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153371,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":181,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"77'212","reported_seq":335,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:26.670322+0000","last_change":"2024-04-25T22:56:26.670348+0000","last_active":"2024-04-25T22:56:26.670322+0000","last_peered":"2024-04-25T22:56:26.670322+0000","last_clean":"2024-04-25T22:56:26.670322+0000","last_became_active":"2024-04-25T22:55:40.538095+0000","last_became_peered":"2024-04-25T22:55:40.538095+0000","last_unstale":"2024-04-25T22:56:26.670322+0000","last_undegraded":"2024-04-25T22:56:26.670322+0000","last_fullsized":"2024-04-25T22:56:26.670322+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'212","last_scrub_stamp":"2024-04-25T22:56:26.670241+0000","last_deep_scrub":"77'212","last_deep_scrub_stamp":"2024-04-25T22:56:26.670241+0000","last_clean_scrub_stamp":"2024-04-25T22:56:26.670241+0000","objects_scrubbed":51,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:39:24.885330+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4276239,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":4418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":4276214,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"77'238","reported_seq":622,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:57.608036+0000","last_change":"2024-04-25T22:55:57.608036+0000","last_active":"2024-04-25T22:55:57.608036+0000","last_peered":"2024-04-25T22:55:57.608036+0000","last_clean":"2024-04-25T22:55:57.608036+0000","last_became_active":"2024-04-25T22:55:31.526271+0000","last_became_peered":"2024-04-25T22:55:31.526271+0000","last_unstale":"2024-04-25T22:55:57.608036+0000","last_undegraded":"2024-04-25T22:55:57.608036+0000","last_fullsized":"2024-04-25T22:55:57.608036+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'238","last_scrub_stamp":"2024-04-25T22:55:57.607919+0000","last_deep_scrub":"77'238","last_deep_scrub_stamp":"2024-04-25T22:55:57.607919+0000","last_clean_scrub_stamp":"2024-04-25T22:55:57.607919+0000","objects_scrubbed":59,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:36:26.673180+0000","scrub_duration":45,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4371943,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":4513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":4363238,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"77'206","reported_seq":321,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:04.865461+0000","last_change":"2024-04-25T22:56:04.865500+0000","last_active":"2024-04-25T22:56:04.865461+0000","last_peered":"2024-04-25T22:56:04.865461+0000","last_clean":"2024-04-25T22:56:04.865461+0000","last_became_active":"2024-04-25T22:55:32.512371+0000","last_became_peered":"2024-04-25T22:55:32.512371+0000","last_unstale":"2024-04-25T22:56:04.865461+0000","last_undegraded":"2024-04-25T22:56:04.865461+0000","last_fullsized":"2024-04-25T22:56:04.865461+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'206","last_scrub_stamp":"2024-04-25T22:56:04.865369+0000","last_deep_scrub":"77'206","last_deep_scrub_stamp":"2024-04-25T22:56:04.865369+0000","last_clean_scrub_stamp":"2024-04-25T22:56:04.865369+0000","objects_scrubbed":43,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:18.871070+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96221,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":87110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"77'202","reported_seq":554,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:21.769450+0000","last_change":"2024-04-25T22:56:21.769450+0000","last_active":"2024-04-25T22:56:21.769450+0000","last_peered":"2024-04-25T22:56:21.769450+0000","last_clean":"2024-04-25T22:56:21.769450+0000","last_became_active":"2024-04-25T22:55:35.518584+0000","last_became_peered":"2024-04-25T22:55:35.518584+0000","last_unstale":"2024-04-25T22:56:21.769450+0000","last_undegraded":"2024-04-25T22:56:21.769450+0000","last_fullsized":"2024-04-25T22:56:21.769450+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'202","last_scrub_stamp":"2024-04-25T22:56:21.769309+0000","last_deep_scrub":"77'202","last_deep_scrub_stamp":"2024-04-25T22:56:21.769309+0000","last_clean_scrub_stamp":"2024-04-25T22:56:21.769309+0000","objects_scrubbed":55,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:37:56.786421+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1432264,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":1532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":1432241,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"77'199","reported_seq":319,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:51.904933+0000","last_change":"2024-04-25T22:55:51.904963+0000","last_active":"2024-04-25T22:55:51.904933+0000","last_peered":"2024-04-25T22:55:51.904933+0000","last_clean":"2024-04-25T22:55:51.904933+0000","last_became_active":"2024-04-25T22:55:30.526745+0000","last_became_peered":"2024-04-25T22:55:30.526745+0000","last_unstale":"2024-04-25T22:55:51.904933+0000","last_undegraded":"2024-04-25T22:55:51.904933+0000","last_fullsized":"2024-04-25T22:55:51.904933+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'199","last_scrub_stamp":"2024-04-25T22:55:51.904847+0000","last_deep_scrub":"77'199","last_deep_scrub_stamp":"2024-04-25T22:55:51.904847+0000","last_clean_scrub_stamp":"2024-04-25T22:55:51.904847+0000","objects_scrubbed":53,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:48:16.767300+0000","scrub_duration":36,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112933,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":112933,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"77'235","reported_seq":617,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:07.721161+0000","last_change":"2024-04-25T22:56:07.721161+0000","last_active":"2024-04-25T22:56:07.721161+0000","last_peered":"2024-04-25T22:56:07.721161+0000","last_clean":"2024-04-25T22:56:07.721161+0000","last_became_active":"2024-04-25T22:55:34.511872+0000","last_became_peered":"2024-04-25T22:55:34.511872+0000","last_unstale":"2024-04-25T22:56:07.721161+0000","last_undegraded":"2024-04-25T22:56:07.721161+0000","last_fullsized":"2024-04-25T22:56:07.721161+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'235","last_scrub_stamp":"2024-04-25T22:56:07.721043+0000","last_deep_scrub":"77'235","last_deep_scrub_stamp":"2024-04-25T22:56:07.721043+0000","last_clean_scrub_stamp":"2024-04-25T22:56:07.721043+0000","objects_scrubbed":57,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:07.413326+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124334,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":124334,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"77'211","reported_seq":565,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:05.689316+0000","last_change":"2024-04-25T22:56:05.689316+0000","last_active":"2024-04-25T22:56:05.689316+0000","last_peered":"2024-04-25T22:56:05.689316+0000","last_clean":"2024-04-25T22:56:05.689316+0000","last_became_active":"2024-04-25T22:55:34.511833+0000","last_became_peered":"2024-04-25T22:55:34.511833+0000","last_unstale":"2024-04-25T22:56:05.689316+0000","last_undegraded":"2024-04-25T22:56:05.689316+0000","last_fullsized":"2024-04-25T22:56:05.689316+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'211","last_scrub_stamp":"2024-04-25T22:56:05.689217+0000","last_deep_scrub":"77'211","last_deep_scrub_stamp":"2024-04-25T22:56:05.689217+0000","last_clean_scrub_stamp":"2024-04-25T22:56:05.689217+0000","objects_scrubbed":53,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:27:05.051314+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145029,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":145029,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"77'229","reported_seq":378,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:14.829487+0000","last_change":"2024-04-25T22:56:14.829487+0000","last_active":"2024-04-25T22:56:14.829487+0000","last_peered":"2024-04-25T22:56:14.829487+0000","last_clean":"2024-04-25T22:56:14.829487+0000","last_became_active":"2024-04-25T22:51:53.025938+0000","last_became_peered":"2024-04-25T22:51:53.025938+0000","last_unstale":"2024-04-25T22:56:14.829487+0000","last_undegraded":"2024-04-25T22:56:14.829487+0000","last_fullsized":"2024-04-25T22:56:14.829487+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'229","last_scrub_stamp":"2024-04-25T22:56:14.829372+0000","last_deep_scrub":"77'229","last_deep_scrub_stamp":"2024-04-25T22:56:14.829372+0000","last_clean_scrub_stamp":"2024-04-25T22:56:14.829372+0000","objects_scrubbed":58,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:05:26.283403+0000","scrub_duration":36,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115019,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"77'210","reported_seq":321,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:49.915543+0000","last_change":"2024-04-25T22:55:49.915587+0000","last_active":"2024-04-25T22:55:49.915543+0000","last_peered":"2024-04-25T22:55:49.915543+0000","last_clean":"2024-04-25T22:55:49.915543+0000","last_became_active":"2024-04-25T22:55:33.512160+0000","last_became_peered":"2024-04-25T22:55:33.512160+0000","last_unstale":"2024-04-25T22:55:49.915543+0000","last_undegraded":"2024-04-25T22:55:49.915543+0000","last_fullsized":"2024-04-25T22:55:49.915543+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'210","last_scrub_stamp":"2024-04-25T22:55:49.915449+0000","last_deep_scrub":"77'210","last_deep_scrub_stamp":"2024-04-25T22:55:49.915449+0000","last_clean_scrub_stamp":"2024-04-25T22:55:49.915449+0000","objects_scrubbed":49,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:38:33.900833+0000","scrub_duration":36,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":641227,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":641227,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"77'217","reported_seq":584,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:04.641024+0000","last_change":"2024-04-25T22:56:04.641024+0000","last_active":"2024-04-25T22:56:04.641024+0000","last_peered":"2024-04-25T22:56:04.641024+0000","last_clean":"2024-04-25T22:56:04.641024+0000","last_became_active":"2024-04-25T22:55:33.511463+0000","last_became_peered":"2024-04-25T22:55:33.511463+0000","last_unstale":"2024-04-25T22:56:04.641024+0000","last_undegraded":"2024-04-25T22:56:04.641024+0000","last_fullsized":"2024-04-25T22:56:04.641024+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'217","last_scrub_stamp":"2024-04-25T22:56:04.640878+0000","last_deep_scrub":"77'217","last_deep_scrub_stamp":"2024-04-25T22:56:04.640878+0000","last_clean_scrub_stamp":"2024-04-25T22:56:04.640878+0000","objects_scrubbed":48,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:48:18.921993+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103634,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":189,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":98869,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"77'218","reported_seq":367,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:59.612400+0000","last_change":"2024-04-25T22:55:59.612400+0000","last_active":"2024-04-25T22:55:59.612400+0000","last_peered":"2024-04-25T22:55:59.612400+0000","last_clean":"2024-04-25T22:55:59.612400+0000","last_became_active":"2024-04-25T22:51:53.027867+0000","last_became_peered":"2024-04-25T22:51:53.027867+0000","last_unstale":"2024-04-25T22:55:59.612400+0000","last_undegraded":"2024-04-25T22:55:59.612400+0000","last_fullsized":"2024-04-25T22:55:59.612400+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'218","last_scrub_stamp":"2024-04-25T22:55:59.612288+0000","last_deep_scrub":"77'218","last_deep_scrub_stamp":"2024-04-25T22:55:59.612288+0000","last_clean_scrub_stamp":"2024-04-25T22:55:59.612288+0000","objects_scrubbed":59,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:46:01.075914+0000","scrub_duration":36,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272252,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"77'250","reported_seq":360,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:17.963250+0000","last_change":"2024-04-25T22:56:17.963279+0000","last_active":"2024-04-25T22:56:17.963250+0000","last_peered":"2024-04-25T22:56:17.963250+0000","last_clean":"2024-04-25T22:56:17.963250+0000","last_became_active":"2024-04-25T22:55:34.512320+0000","last_became_peered":"2024-04-25T22:55:34.512320+0000","last_unstale":"2024-04-25T22:56:17.963250+0000","last_undegraded":"2024-04-25T22:56:17.963250+0000","last_fullsized":"2024-04-25T22:56:17.963250+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'250","last_scrub_stamp":"2024-04-25T22:56:17.963166+0000","last_deep_scrub":"77'250","last_deep_scrub_stamp":"2024-04-25T22:56:17.963166+0000","last_clean_scrub_stamp":"2024-04-25T22:56:17.963166+0000","objects_scrubbed":60,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:08:14.239922+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126403,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":117,"num_bytes_recovered":126342,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"77'199","reported_seq":345,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:08.760180+0000","last_change":"2024-04-25T22:56:08.760180+0000","last_active":"2024-04-25T22:56:08.760180+0000","last_peered":"2024-04-25T22:56:08.760180+0000","last_clean":"2024-04-25T22:56:08.760180+0000","last_became_active":"2024-04-25T22:51:53.022407+0000","last_became_peered":"2024-04-25T22:51:53.022407+0000","last_unstale":"2024-04-25T22:56:08.760180+0000","last_undegraded":"2024-04-25T22:56:08.760180+0000","last_fullsized":"2024-04-25T22:56:08.760180+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'199","last_scrub_stamp":"2024-04-25T22:56:08.759993+0000","last_deep_scrub":"77'199","last_deep_scrub_stamp":"2024-04-25T22:56:08.759993+0000","last_clean_scrub_stamp":"2024-04-25T22:56:08.759993+0000","objects_scrubbed":48,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:49:21.647405+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69245,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"77'195","reported_seq":343,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:57.649775+0000","last_change":"2024-04-25T22:55:57.649775+0000","last_active":"2024-04-25T22:55:57.649775+0000","last_peered":"2024-04-25T22:55:57.649775+0000","last_clean":"2024-04-25T22:55:57.649775+0000","last_became_active":"2024-04-25T22:51:53.027852+0000","last_became_peered":"2024-04-25T22:51:53.027852+0000","last_unstale":"2024-04-25T22:55:57.649775+0000","last_undegraded":"2024-04-25T22:55:57.649775+0000","last_fullsized":"2024-04-25T22:55:57.649775+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'195","last_scrub_stamp":"2024-04-25T22:55:57.649623+0000","last_deep_scrub":"77'195","last_deep_scrub_stamp":"2024-04-25T22:55:57.649623+0000","last_clean_scrub_stamp":"2024-04-25T22:55:57.649623+0000","objects_scrubbed":48,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:54:45.579108+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192848,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"77'223","reported_seq":335,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:18.995101+0000","last_change":"2024-04-25T22:56:18.995139+0000","last_active":"2024-04-25T22:56:18.995101+0000","last_peered":"2024-04-25T22:56:18.995101+0000","last_clean":"2024-04-25T22:56:18.995101+0000","last_became_active":"2024-04-25T22:55:34.514067+0000","last_became_peered":"2024-04-25T22:55:34.514067+0000","last_unstale":"2024-04-25T22:56:18.995101+0000","last_undegraded":"2024-04-25T22:56:18.995101+0000","last_fullsized":"2024-04-25T22:56:18.995101+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'223","last_scrub_stamp":"2024-04-25T22:56:18.995009+0000","last_deep_scrub":"77'223","last_deep_scrub_stamp":"2024-04-25T22:56:18.995009+0000","last_clean_scrub_stamp":"2024-04-25T22:56:18.995009+0000","objects_scrubbed":57,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:52:10.048029+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239074,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":239074,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"77'251","reported_seq":400,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:07.713192+0000","last_change":"2024-04-25T22:56:07.713235+0000","last_active":"2024-04-25T22:56:07.713192+0000","last_peered":"2024-04-25T22:56:07.713192+0000","last_clean":"2024-04-25T22:56:07.713192+0000","last_became_active":"2024-04-25T22:51:53.026379+0000","last_became_peered":"2024-04-25T22:51:53.026379+0000","last_unstale":"2024-04-25T22:56:07.713192+0000","last_undegraded":"2024-04-25T22:56:07.713192+0000","last_fullsized":"2024-04-25T22:56:07.713192+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'251","last_scrub_stamp":"2024-04-25T22:56:07.713115+0000","last_deep_scrub":"77'251","last_deep_scrub_stamp":"2024-04-25T22:56:07.713115+0000","last_clean_scrub_stamp":"2024-04-25T22:56:07.713115+0000","objects_scrubbed":60,"log_size":251,"log_dups_size":0,"ondisk_log_size":251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:48:45.519028+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99668,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"77'256","reported_seq":372,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:00.942134+0000","last_change":"2024-04-25T22:56:00.942208+0000","last_active":"2024-04-25T22:56:00.942134+0000","last_peered":"2024-04-25T22:56:00.942134+0000","last_clean":"2024-04-25T22:56:00.942134+0000","last_became_active":"2024-04-25T22:55:32.509978+0000","last_became_peered":"2024-04-25T22:55:32.509978+0000","last_unstale":"2024-04-25T22:56:00.942134+0000","last_undegraded":"2024-04-25T22:56:00.942134+0000","last_fullsized":"2024-04-25T22:56:00.942134+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'256","last_scrub_stamp":"2024-04-25T22:56:00.942032+0000","last_deep_scrub":"77'256","last_deep_scrub_stamp":"2024-04-25T22:56:00.942032+0000","last_clean_scrub_stamp":"2024-04-25T22:56:00.942032+0000","objects_scrubbed":63,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:25:05.450727+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128069,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":128069,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"77'241","reported_seq":608,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:23.639347+0000","last_change":"2024-04-25T22:56:23.639386+0000","last_active":"2024-04-25T22:56:23.639347+0000","last_peered":"2024-04-25T22:56:23.639347+0000","last_clean":"2024-04-25T22:56:23.639347+0000","last_became_active":"2024-04-25T22:55:38.518412+0000","last_became_peered":"2024-04-25T22:55:38.518412+0000","last_unstale":"2024-04-25T22:56:23.639347+0000","last_undegraded":"2024-04-25T22:56:23.639347+0000","last_fullsized":"2024-04-25T22:56:23.639347+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'241","last_scrub_stamp":"2024-04-25T22:56:23.639263+0000","last_deep_scrub":"77'241","last_deep_scrub_stamp":"2024-04-25T22:56:23.639263+0000","last_clean_scrub_stamp":"2024-04-25T22:56:23.639263+0000","objects_scrubbed":59,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:45:02.201857+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":586629,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":580754,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"77'201","reported_seq":550,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:16.822043+0000","last_change":"2024-04-25T22:56:16.822043+0000","last_active":"2024-04-25T22:56:16.822043+0000","last_peered":"2024-04-25T22:56:16.822043+0000","last_clean":"2024-04-25T22:56:16.822043+0000","last_became_active":"2024-04-25T22:55:33.512114+0000","last_became_peered":"2024-04-25T22:55:33.512114+0000","last_unstale":"2024-04-25T22:56:16.822043+0000","last_undegraded":"2024-04-25T22:56:16.822043+0000","last_fullsized":"2024-04-25T22:56:16.822043+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'201","last_scrub_stamp":"2024-04-25T22:56:16.821898+0000","last_deep_scrub":"77'201","last_deep_scrub_stamp":"2024-04-25T22:56:16.821898+0000","last_clean_scrub_stamp":"2024-04-25T22:56:16.821898+0000","objects_scrubbed":45,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:03:03.916034+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118861,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":118861,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"77'108","reported_seq":269,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:55.641176+0000","last_change":"2024-04-25T22:55:55.641176+0000","last_active":"2024-04-25T22:55:55.641176+0000","last_peered":"2024-04-25T22:55:55.641176+0000","last_clean":"2024-04-25T22:55:55.641176+0000","last_became_active":"2024-04-25T22:55:30.525469+0000","last_became_peered":"2024-04-25T22:55:30.525469+0000","last_unstale":"2024-04-25T22:55:55.641176+0000","last_undegraded":"2024-04-25T22:55:55.641176+0000","last_fullsized":"2024-04-25T22:55:55.641176+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'108","last_scrub_stamp":"2024-04-25T22:55:55.641069+0000","last_deep_scrub":"77'108","last_deep_scrub_stamp":"2024-04-25T22:55:55.641069+0000","last_clean_scrub_stamp":"2024-04-25T22:55:55.641069+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:35:08.836219+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2425045,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":2428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":2425011,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"77'186","reported_seq":523,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:00.614791+0000","last_change":"2024-04-25T22:56:00.614791+0000","last_active":"2024-04-25T22:56:00.614791+0000","last_peered":"2024-04-25T22:56:00.614791+0000","last_clean":"2024-04-25T22:56:00.614791+0000","last_became_active":"2024-04-25T22:55:30.524718+0000","last_became_peered":"2024-04-25T22:55:30.524718+0000","last_unstale":"2024-04-25T22:56:00.614791+0000","last_undegraded":"2024-04-25T22:56:00.614791+0000","last_fullsized":"2024-04-25T22:56:00.614791+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'186","last_scrub_stamp":"2024-04-25T22:56:00.614624+0000","last_deep_scrub":"77'186","last_deep_scrub_stamp":"2024-04-25T22:56:00.614624+0000","last_clean_scrub_stamp":"2024-04-25T22:56:00.614624+0000","objects_scrubbed":40,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:36:29.679884+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67079,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":89,"num_bytes_recovered":67079,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":57,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:09.839257+0000","last_change":"2024-04-25T22:56:09.839277+0000","last_active":"2024-04-25T22:56:09.839257+0000","last_peered":"2024-04-25T22:56:09.839257+0000","last_clean":"2024-04-25T22:56:09.839257+0000","last_became_active":"2024-04-25T22:55:27.517208+0000","last_became_peered":"2024-04-25T22:55:27.517208+0000","last_unstale":"2024-04-25T22:56:09.839257+0000","last_undegraded":"2024-04-25T22:56:09.839257+0000","last_fullsized":"2024-04-25T22:56:09.839257+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:56:09.839176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:56:09.839176+0000","last_clean_scrub_stamp":"2024-04-25T22:56:09.839176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:46:38.198505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"77'240","reported_seq":352,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:15.924091+0000","last_change":"2024-04-25T22:56:15.924121+0000","last_active":"2024-04-25T22:56:15.924091+0000","last_peered":"2024-04-25T22:56:15.924091+0000","last_clean":"2024-04-25T22:56:15.924091+0000","last_became_active":"2024-04-25T22:55:33.512389+0000","last_became_peered":"2024-04-25T22:55:33.512389+0000","last_unstale":"2024-04-25T22:56:15.924091+0000","last_undegraded":"2024-04-25T22:56:15.924091+0000","last_fullsized":"2024-04-25T22:56:15.924091+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'240","last_scrub_stamp":"2024-04-25T22:56:15.924009+0000","last_deep_scrub":"77'240","last_deep_scrub_stamp":"2024-04-25T22:56:15.924009+0000","last_clean_scrub_stamp":"2024-04-25T22:56:15.924009+0000","objects_scrubbed":54,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:36:27.201232+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139986,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":199,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":137763,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":149,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:08.683696+0000","last_change":"2024-04-25T22:56:08.683696+0000","last_active":"2024-04-25T22:56:08.683696+0000","last_peered":"2024-04-25T22:56:08.683696+0000","last_clean":"2024-04-25T22:56:08.683696+0000","last_became_active":"2024-04-25T22:51:52.018313+0000","last_became_peered":"2024-04-25T22:51:52.018313+0000","last_unstale":"2024-04-25T22:56:08.683696+0000","last_undegraded":"2024-04-25T22:56:08.683696+0000","last_fullsized":"2024-04-25T22:56:08.683696+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:56:08.683553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:56:08.683553+0000","last_clean_scrub_stamp":"2024-04-25T22:56:08.683553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:27:08.045650+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"77'206","reported_seq":323,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:53.877246+0000","last_change":"2024-04-25T22:55:53.877285+0000","last_active":"2024-04-25T22:55:53.877246+0000","last_peered":"2024-04-25T22:55:53.877246+0000","last_clean":"2024-04-25T22:55:53.877246+0000","last_became_active":"2024-04-25T22:55:30.526276+0000","last_became_peered":"2024-04-25T22:55:30.526276+0000","last_unstale":"2024-04-25T22:55:53.877246+0000","last_undegraded":"2024-04-25T22:55:53.877246+0000","last_fullsized":"2024-04-25T22:55:53.877246+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'206","last_scrub_stamp":"2024-04-25T22:55:53.877171+0000","last_deep_scrub":"77'206","last_deep_scrub_stamp":"2024-04-25T22:55:53.877171+0000","last_clean_scrub_stamp":"2024-04-25T22:55:53.877171+0000","objects_scrubbed":39,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:15:37.908265+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87849,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":87849,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"77'12","reported_seq":159,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:16.652029+0000","last_change":"2024-04-25T22:56:16.652029+0000","last_active":"2024-04-25T22:56:16.652029+0000","last_peered":"2024-04-25T22:56:16.652029+0000","last_clean":"2024-04-25T22:56:16.652029+0000","last_became_active":"2024-04-25T22:51:52.021145+0000","last_became_peered":"2024-04-25T22:51:52.021145+0000","last_unstale":"2024-04-25T22:56:16.652029+0000","last_undegraded":"2024-04-25T22:56:16.652029+0000","last_fullsized":"2024-04-25T22:56:16.652029+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'12","last_scrub_stamp":"2024-04-25T22:56:16.651881+0000","last_deep_scrub":"77'12","last_deep_scrub_stamp":"2024-04-25T22:56:16.651881+0000","last_clean_scrub_stamp":"2024-04-25T22:56:16.651881+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:21.955031+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"77'3","reported_seq":150,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:15.604975+0000","last_change":"2024-04-25T22:56:15.604975+0000","last_active":"2024-04-25T22:56:15.604975+0000","last_peered":"2024-04-25T22:56:15.604975+0000","last_clean":"2024-04-25T22:56:15.604975+0000","last_became_active":"2024-04-25T22:51:52.020860+0000","last_became_peered":"2024-04-25T22:51:52.020860+0000","last_unstale":"2024-04-25T22:56:15.604975+0000","last_undegraded":"2024-04-25T22:56:15.604975+0000","last_fullsized":"2024-04-25T22:56:15.604975+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'3","last_scrub_stamp":"2024-04-25T22:56:15.604836+0000","last_deep_scrub":"77'3","last_deep_scrub_stamp":"2024-04-25T22:56:15.604836+0000","last_clean_scrub_stamp":"2024-04-25T22:56:15.604836+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:06:09.980401+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"77'212","reported_seq":361,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:53.659379+0000","last_change":"2024-04-25T22:55:53.659379+0000","last_active":"2024-04-25T22:55:53.659379+0000","last_peered":"2024-04-25T22:55:53.659379+0000","last_clean":"2024-04-25T22:55:53.659379+0000","last_became_active":"2024-04-25T22:51:53.029157+0000","last_became_peered":"2024-04-25T22:51:53.029157+0000","last_unstale":"2024-04-25T22:55:53.659379+0000","last_undegraded":"2024-04-25T22:55:53.659379+0000","last_fullsized":"2024-04-25T22:55:53.659379+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'212","last_scrub_stamp":"2024-04-25T22:55:53.659262+0000","last_deep_scrub":"77'212","last_deep_scrub_stamp":"2024-04-25T22:55:53.659262+0000","last_clean_scrub_stamp":"2024-04-25T22:55:53.659262+0000","objects_scrubbed":55,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:23:44.866042+0000","scrub_duration":36,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190158,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"77'4","reported_seq":153,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:09.677569+0000","last_change":"2024-04-25T22:56:09.677569+0000","last_active":"2024-04-25T22:56:09.677569+0000","last_peered":"2024-04-25T22:56:09.677569+0000","last_clean":"2024-04-25T22:56:09.677569+0000","last_became_active":"2024-04-25T22:51:52.018390+0000","last_became_peered":"2024-04-25T22:51:52.018390+0000","last_unstale":"2024-04-25T22:56:09.677569+0000","last_undegraded":"2024-04-25T22:56:09.677569+0000","last_fullsized":"2024-04-25T22:56:09.677569+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'4","last_scrub_stamp":"2024-04-25T22:56:09.677451+0000","last_deep_scrub":"77'4","last_deep_scrub_stamp":"2024-04-25T22:56:09.677451+0000","last_clean_scrub_stamp":"2024-04-25T22:56:09.677451+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:46.292219+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"77'225","reported_seq":605,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:02.612518+0000","last_change":"2024-04-25T22:56:02.612518+0000","last_active":"2024-04-25T22:56:02.612518+0000","last_peered":"2024-04-25T22:56:02.612518+0000","last_clean":"2024-04-25T22:56:02.612518+0000","last_became_active":"2024-04-25T22:55:31.527049+0000","last_became_peered":"2024-04-25T22:55:31.527049+0000","last_unstale":"2024-04-25T22:56:02.612518+0000","last_undegraded":"2024-04-25T22:56:02.612518+0000","last_fullsized":"2024-04-25T22:56:02.612518+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'225","last_scrub_stamp":"2024-04-25T22:56:02.612398+0000","last_deep_scrub":"77'225","last_deep_scrub_stamp":"2024-04-25T22:56:02.612398+0000","last_clean_scrub_stamp":"2024-04-25T22:56:02.612398+0000","objects_scrubbed":54,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:11:14.389223+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":315325,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":191,"num_write_kb":549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":110,"num_bytes_recovered":301306,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"77'2","reported_seq":55,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:21.617122+0000","last_change":"2024-04-25T22:56:21.617167+0000","last_active":"2024-04-25T22:56:21.617122+0000","last_peered":"2024-04-25T22:56:21.617122+0000","last_clean":"2024-04-25T22:56:21.617122+0000","last_became_active":"2024-04-25T22:55:38.517362+0000","last_became_peered":"2024-04-25T22:55:38.517362+0000","last_unstale":"2024-04-25T22:56:21.617122+0000","last_undegraded":"2024-04-25T22:56:21.617122+0000","last_fullsized":"2024-04-25T22:56:21.617122+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'2","last_scrub_stamp":"2024-04-25T22:56:21.617018+0000","last_deep_scrub":"77'2","last_deep_scrub_stamp":"2024-04-25T22:56:21.617018+0000","last_clean_scrub_stamp":"2024-04-25T22:56:21.617018+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:28:48.568858+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"77'209","reported_seq":554,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:19.716560+0000","last_change":"2024-04-25T22:56:19.716590+0000","last_active":"2024-04-25T22:56:19.716560+0000","last_peered":"2024-04-25T22:56:19.716560+0000","last_clean":"2024-04-25T22:56:19.716560+0000","last_became_active":"2024-04-25T22:55:38.514319+0000","last_became_peered":"2024-04-25T22:55:38.514319+0000","last_unstale":"2024-04-25T22:56:19.716560+0000","last_undegraded":"2024-04-25T22:56:19.716560+0000","last_fullsized":"2024-04-25T22:56:19.716560+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'209","last_scrub_stamp":"2024-04-25T22:56:19.716482+0000","last_deep_scrub":"77'209","last_deep_scrub_stamp":"2024-04-25T22:56:19.716482+0000","last_clean_scrub_stamp":"2024-04-25T22:56:19.716482+0000","objects_scrubbed":56,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:39:23.711998+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97209,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":97196,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"51'1","reported_seq":125,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:53.567310+0000","last_change":"2024-04-25T22:55:53.567310+0000","last_active":"2024-04-25T22:55:53.567310+0000","last_peered":"2024-04-25T22:55:53.567310+0000","last_clean":"2024-04-25T22:55:53.567310+0000","last_became_active":"2024-04-25T22:55:38.516782+0000","last_became_peered":"2024-04-25T22:55:38.516782+0000","last_unstale":"2024-04-25T22:55:53.567310+0000","last_undegraded":"2024-04-25T22:55:53.567310+0000","last_fullsized":"2024-04-25T22:55:53.567310+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1","last_scrub_stamp":"2024-04-25T22:55:53.567155+0000","last_deep_scrub":"51'1","last_deep_scrub_stamp":"2024-04-25T22:55:53.567155+0000","last_clean_scrub_stamp":"2024-04-25T22:55:53.567155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:01:38.089809+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"77'215","reported_seq":329,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:58.929384+0000","last_change":"2024-04-25T22:55:58.929421+0000","last_active":"2024-04-25T22:55:58.929384+0000","last_peered":"2024-04-25T22:55:58.929384+0000","last_clean":"2024-04-25T22:55:58.929384+0000","last_became_active":"2024-04-25T22:55:32.510402+0000","last_became_peered":"2024-04-25T22:55:32.510402+0000","last_unstale":"2024-04-25T22:55:58.929384+0000","last_undegraded":"2024-04-25T22:55:58.929384+0000","last_fullsized":"2024-04-25T22:55:58.929384+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'215","last_scrub_stamp":"2024-04-25T22:55:58.929297+0000","last_deep_scrub":"77'215","last_deep_scrub_stamp":"2024-04-25T22:55:58.929297+0000","last_clean_scrub_stamp":"2024-04-25T22:55:58.929297+0000","objects_scrubbed":62,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:24:11.093855+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131384,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":131332,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"77'9","reported_seq":67,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:01.923353+0000","last_change":"2024-04-25T22:56:01.923412+0000","last_active":"2024-04-25T22:56:01.923353+0000","last_peered":"2024-04-25T22:56:01.923353+0000","last_clean":"2024-04-25T22:56:01.923353+0000","last_became_active":"2024-04-25T22:55:27.518709+0000","last_became_peered":"2024-04-25T22:55:27.518709+0000","last_unstale":"2024-04-25T22:56:01.923353+0000","last_undegraded":"2024-04-25T22:56:01.923353+0000","last_fullsized":"2024-04-25T22:56:01.923353+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'9","last_scrub_stamp":"2024-04-25T22:56:01.923255+0000","last_deep_scrub":"77'9","last_deep_scrub_stamp":"2024-04-25T22:56:01.923255+0000","last_clean_scrub_stamp":"2024-04-25T22:56:01.923255+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:13.276320+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"77'232","reported_seq":591,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:50.591701+0000","last_change":"2024-04-25T22:55:50.591701+0000","last_active":"2024-04-25T22:55:50.591701+0000","last_peered":"2024-04-25T22:55:50.591701+0000","last_clean":"2024-04-25T22:55:50.591701+0000","last_became_active":"2024-04-25T22:55:38.514695+0000","last_became_peered":"2024-04-25T22:55:38.514695+0000","last_unstale":"2024-04-25T22:55:50.591701+0000","last_undegraded":"2024-04-25T22:55:50.591701+0000","last_fullsized":"2024-04-25T22:55:50.591701+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'232","last_scrub_stamp":"2024-04-25T22:55:50.591565+0000","last_deep_scrub":"77'232","last_deep_scrub_stamp":"2024-04-25T22:55:50.591565+0000","last_clean_scrub_stamp":"2024-04-25T22:55:50.591565+0000","objects_scrubbed":58,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:23:41.798345+0000","scrub_duration":42,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187245,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":111,"num_bytes_recovered":187245,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":154,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:58.557578+0000","last_change":"2024-04-25T22:55:58.557578+0000","last_active":"2024-04-25T22:55:58.557578+0000","last_peered":"2024-04-25T22:55:58.557578+0000","last_clean":"2024-04-25T22:55:58.557578+0000","last_became_active":"2024-04-25T22:55:27.517404+0000","last_became_peered":"2024-04-25T22:55:27.517404+0000","last_unstale":"2024-04-25T22:55:58.557578+0000","last_undegraded":"2024-04-25T22:55:58.557578+0000","last_fullsized":"2024-04-25T22:55:58.557578+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:55:58.557460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:55:58.557460+0000","last_clean_scrub_stamp":"2024-04-25T22:55:58.557460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:35.155047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"77'219","reported_seq":366,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:06.739877+0000","last_change":"2024-04-25T22:56:06.739877+0000","last_active":"2024-04-25T22:56:06.739877+0000","last_peered":"2024-04-25T22:56:06.739877+0000","last_clean":"2024-04-25T22:56:06.739877+0000","last_became_active":"2024-04-25T22:51:53.023405+0000","last_became_peered":"2024-04-25T22:51:53.023405+0000","last_unstale":"2024-04-25T22:56:06.739877+0000","last_undegraded":"2024-04-25T22:56:06.739877+0000","last_fullsized":"2024-04-25T22:56:06.739877+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'219","last_scrub_stamp":"2024-04-25T22:56:06.739758+0000","last_deep_scrub":"77'219","last_deep_scrub_stamp":"2024-04-25T22:56:06.739758+0000","last_clean_scrub_stamp":"2024-04-25T22:56:06.739758+0000","objects_scrubbed":56,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:43.354527+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130867,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":164,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":166,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:56.569692+0000","last_change":"2024-04-25T22:55:56.569692+0000","last_active":"2024-04-25T22:55:56.569692+0000","last_peered":"2024-04-25T22:55:56.569692+0000","last_clean":"2024-04-25T22:55:56.569692+0000","last_became_active":"2024-04-25T22:55:37.515798+0000","last_became_peered":"2024-04-25T22:55:37.515798+0000","last_unstale":"2024-04-25T22:55:56.569692+0000","last_undegraded":"2024-04-25T22:55:56.569692+0000","last_fullsized":"2024-04-25T22:55:56.569692+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:55:56.569581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:55:56.569581+0000","last_clean_scrub_stamp":"2024-04-25T22:55:56.569581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:01:41.092235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"77'193","reported_seq":340,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:17.653899+0000","last_change":"2024-04-25T22:56:17.653899+0000","last_active":"2024-04-25T22:56:17.653899+0000","last_peered":"2024-04-25T22:56:17.653899+0000","last_clean":"2024-04-25T22:56:17.653899+0000","last_became_active":"2024-04-25T22:51:53.019978+0000","last_became_peered":"2024-04-25T22:51:53.019978+0000","last_unstale":"2024-04-25T22:56:17.653899+0000","last_undegraded":"2024-04-25T22:56:17.653899+0000","last_fullsized":"2024-04-25T22:56:17.653899+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'193","last_scrub_stamp":"2024-04-25T22:56:17.653782+0000","last_deep_scrub":"77'193","last_deep_scrub_stamp":"2024-04-25T22:56:17.653782+0000","last_clean_scrub_stamp":"2024-04-25T22:56:17.653782+0000","objects_scrubbed":54,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:33:57.590692+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197405,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"51'1","reported_seq":157,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:54.642205+0000","last_change":"2024-04-25T22:55:54.642205+0000","last_active":"2024-04-25T22:55:54.642205+0000","last_peered":"2024-04-25T22:55:54.642205+0000","last_clean":"2024-04-25T22:55:54.642205+0000","last_became_active":"2024-04-25T22:55:27.517330+0000","last_became_peered":"2024-04-25T22:55:27.517330+0000","last_unstale":"2024-04-25T22:55:54.642205+0000","last_undegraded":"2024-04-25T22:55:54.642205+0000","last_fullsized":"2024-04-25T22:55:54.642205+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1","last_scrub_stamp":"2024-04-25T22:55:54.642058+0000","last_deep_scrub":"51'1","last_deep_scrub_stamp":"2024-04-25T22:55:54.642058+0000","last_clean_scrub_stamp":"2024-04-25T22:55:54.642058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:48:09.797102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"77'196","reported_seq":314,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:56.855476+0000","last_change":"2024-04-25T22:55:56.855502+0000","last_active":"2024-04-25T22:55:56.855476+0000","last_peered":"2024-04-25T22:55:56.855476+0000","last_clean":"2024-04-25T22:55:56.855476+0000","last_became_active":"2024-04-25T22:55:31.528360+0000","last_became_peered":"2024-04-25T22:55:31.528360+0000","last_unstale":"2024-04-25T22:55:56.855476+0000","last_undegraded":"2024-04-25T22:55:56.855476+0000","last_fullsized":"2024-04-25T22:55:56.855476+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'196","last_scrub_stamp":"2024-04-25T22:55:56.855397+0000","last_deep_scrub":"77'196","last_deep_scrub_stamp":"2024-04-25T22:55:56.855397+0000","last_clean_scrub_stamp":"2024-04-25T22:55:56.855397+0000","objects_scrubbed":51,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:57:48.621305+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165168,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":165116,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"77'159","reported_seq":351,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:13.594888+0000","last_change":"2024-04-25T22:56:13.594928+0000","last_active":"2024-04-25T22:56:13.594888+0000","last_peered":"2024-04-25T22:56:13.594888+0000","last_clean":"2024-04-25T22:56:13.594888+0000","last_became_active":"2024-04-25T22:51:47.764176+0000","last_became_peered":"2024-04-25T22:51:47.764176+0000","last_unstale":"2024-04-25T22:56:13.594888+0000","last_undegraded":"2024-04-25T22:56:13.594888+0000","last_fullsized":"2024-04-25T22:56:13.594888+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'159","last_scrub_stamp":"2024-04-25T22:56:13.594800+0000","last_deep_scrub":"77'159","last_deep_scrub_stamp":"2024-04-25T22:56:13.594800+0000","last_clean_scrub_stamp":"2024-04-25T22:56:13.594800+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:44.763388+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":160,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:56.587621+0000","last_change":"2024-04-25T22:55:56.587621+0000","last_active":"2024-04-25T22:55:56.587621+0000","last_peered":"2024-04-25T22:55:56.587621+0000","last_clean":"2024-04-25T22:55:56.587621+0000","last_became_active":"2024-04-25T22:55:27.520951+0000","last_became_peered":"2024-04-25T22:55:27.520951+0000","last_unstale":"2024-04-25T22:55:56.587621+0000","last_undegraded":"2024-04-25T22:55:56.587621+0000","last_fullsized":"2024-04-25T22:55:56.587621+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:55:56.587508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:55:56.587508+0000","last_clean_scrub_stamp":"2024-04-25T22:55:56.587508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:58.051135+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"51'2","reported_seq":57,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:05.864843+0000","last_change":"2024-04-25T22:56:05.864908+0000","last_active":"2024-04-25T22:56:05.864843+0000","last_peered":"2024-04-25T22:56:05.864843+0000","last_clean":"2024-04-25T22:56:05.864843+0000","last_became_active":"2024-04-25T22:55:27.520466+0000","last_became_peered":"2024-04-25T22:55:27.520466+0000","last_unstale":"2024-04-25T22:56:05.864843+0000","last_undegraded":"2024-04-25T22:56:05.864843+0000","last_fullsized":"2024-04-25T22:56:05.864843+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'2","last_scrub_stamp":"2024-04-25T22:56:05.864749+0000","last_deep_scrub":"51'2","last_deep_scrub_stamp":"2024-04-25T22:56:05.864749+0000","last_clean_scrub_stamp":"2024-04-25T22:56:05.864749+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:40:00.641012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"77'206","reported_seq":353,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:04.664443+0000","last_change":"2024-04-25T22:56:04.664443+0000","last_active":"2024-04-25T22:56:04.664443+0000","last_peered":"2024-04-25T22:56:04.664443+0000","last_clean":"2024-04-25T22:56:04.664443+0000","last_became_active":"2024-04-25T22:51:53.023497+0000","last_became_peered":"2024-04-25T22:51:53.023497+0000","last_unstale":"2024-04-25T22:56:04.664443+0000","last_undegraded":"2024-04-25T22:56:04.664443+0000","last_fullsized":"2024-04-25T22:56:04.664443+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'206","last_scrub_stamp":"2024-04-25T22:56:04.664319+0000","last_deep_scrub":"77'206","last_deep_scrub_stamp":"2024-04-25T22:56:04.664319+0000","last_clean_scrub_stamp":"2024-04-25T22:56:04.664319+0000","objects_scrubbed":56,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:48:42.470233+0000","scrub_duration":42,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":331484,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":153,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:12.630835+0000","last_change":"2024-04-25T22:56:12.630894+0000","last_active":"2024-04-25T22:56:12.630835+0000","last_peered":"2024-04-25T22:56:12.630835+0000","last_clean":"2024-04-25T22:56:12.630835+0000","last_became_active":"2024-04-25T22:51:47.764229+0000","last_became_peered":"2024-04-25T22:51:47.764229+0000","last_unstale":"2024-04-25T22:56:12.630835+0000","last_undegraded":"2024-04-25T22:56:12.630835+0000","last_fullsized":"2024-04-25T22:56:12.630835+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:56:12.630739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:56:12.630739+0000","last_clean_scrub_stamp":"2024-04-25T22:56:12.630739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:43:03.487402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"77'37","reported_seq":62,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:03.871590+0000","last_change":"2024-04-25T22:56:03.871621+0000","last_active":"2024-04-25T22:56:03.871590+0000","last_peered":"2024-04-25T22:56:03.871590+0000","last_clean":"2024-04-25T22:56:03.871590+0000","last_became_active":"2024-04-25T22:55:27.517290+0000","last_became_peered":"2024-04-25T22:55:27.517290+0000","last_unstale":"2024-04-25T22:56:03.871590+0000","last_undegraded":"2024-04-25T22:56:03.871590+0000","last_fullsized":"2024-04-25T22:56:03.871590+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'37","last_scrub_stamp":"2024-04-25T22:56:03.871504+0000","last_deep_scrub":"77'37","last_deep_scrub_stamp":"2024-04-25T22:56:03.871504+0000","last_clean_scrub_stamp":"2024-04-25T22:56:03.871504+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:47:19.959347+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327644,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":343,"num_write":34,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":327644,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"77'218","reported_seq":584,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:22.751507+0000","last_change":"2024-04-25T22:56:22.751536+0000","last_active":"2024-04-25T22:56:22.751507+0000","last_peered":"2024-04-25T22:56:22.751507+0000","last_clean":"2024-04-25T22:56:22.751507+0000","last_became_active":"2024-04-25T22:55:35.518367+0000","last_became_peered":"2024-04-25T22:55:35.518367+0000","last_unstale":"2024-04-25T22:56:22.751507+0000","last_undegraded":"2024-04-25T22:56:22.751507+0000","last_fullsized":"2024-04-25T22:56:22.751507+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'218","last_scrub_stamp":"2024-04-25T22:56:22.751428+0000","last_deep_scrub":"77'218","last_deep_scrub_stamp":"2024-04-25T22:56:22.751428+0000","last_clean_scrub_stamp":"2024-04-25T22:56:22.751428+0000","objects_scrubbed":55,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:41:04.724331+0000","scrub_duration":36,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297937,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":181,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":282175,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":57,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:11.862691+0000","last_change":"2024-04-25T22:56:11.862711+0000","last_active":"2024-04-25T22:56:11.862691+0000","last_peered":"2024-04-25T22:56:11.862691+0000","last_clean":"2024-04-25T22:56:11.862691+0000","last_became_active":"2024-04-25T22:55:27.518412+0000","last_became_peered":"2024-04-25T22:55:27.518412+0000","last_unstale":"2024-04-25T22:56:11.862691+0000","last_undegraded":"2024-04-25T22:56:11.862691+0000","last_fullsized":"2024-04-25T22:56:11.862691+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:56:11.862609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:56:11.862609+0000","last_clean_scrub_stamp":"2024-04-25T22:56:11.862609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:20:55.092925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"77'63","reported_seq":212,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:10.734440+0000","last_change":"2024-04-25T22:56:10.734489+0000","last_active":"2024-04-25T22:56:10.734440+0000","last_peered":"2024-04-25T22:56:10.734440+0000","last_clean":"2024-04-25T22:56:10.734440+0000","last_became_active":"2024-04-25T22:51:52.018300+0000","last_became_peered":"2024-04-25T22:51:52.018300+0000","last_unstale":"2024-04-25T22:56:10.734440+0000","last_undegraded":"2024-04-25T22:56:10.734440+0000","last_fullsized":"2024-04-25T22:56:10.734440+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'63","last_scrub_stamp":"2024-04-25T22:56:10.734336+0000","last_deep_scrub":"77'63","last_deep_scrub_stamp":"2024-04-25T22:56:10.734336+0000","last_clean_scrub_stamp":"2024-04-25T22:56:10.734336+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:10.426618+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":4122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"77'223","reported_seq":339,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:14.919572+0000","last_change":"2024-04-25T22:56:14.919603+0000","last_active":"2024-04-25T22:56:14.919572+0000","last_peered":"2024-04-25T22:56:14.919572+0000","last_clean":"2024-04-25T22:56:14.919572+0000","last_became_active":"2024-04-25T22:55:32.513087+0000","last_became_peered":"2024-04-25T22:55:32.513087+0000","last_unstale":"2024-04-25T22:56:14.919572+0000","last_undegraded":"2024-04-25T22:56:14.919572+0000","last_fullsized":"2024-04-25T22:56:14.919572+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'223","last_scrub_stamp":"2024-04-25T22:56:14.919499+0000","last_deep_scrub":"77'223","last_deep_scrub_stamp":"2024-04-25T22:56:14.919499+0000","last_clean_scrub_stamp":"2024-04-25T22:56:14.919499+0000","objects_scrubbed":56,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:09:57.503296+0000","scrub_duration":42,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395473,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":166,"num_write_kb":573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":395432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":160,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:00.580456+0000","last_change":"2024-04-25T22:56:00.580456+0000","last_active":"2024-04-25T22:56:00.580456+0000","last_peered":"2024-04-25T22:56:00.580456+0000","last_clean":"2024-04-25T22:56:00.580456+0000","last_became_active":"2024-04-25T22:55:27.516952+0000","last_became_peered":"2024-04-25T22:55:27.516952+0000","last_unstale":"2024-04-25T22:56:00.580456+0000","last_undegraded":"2024-04-25T22:56:00.580456+0000","last_fullsized":"2024-04-25T22:56:00.580456+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:56:00.580330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:56:00.580330+0000","last_clean_scrub_stamp":"2024-04-25T22:56:00.580330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:04:47.557382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":124,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:49.530959+0000","last_change":"2024-04-25T22:55:49.530959+0000","last_active":"2024-04-25T22:55:49.530959+0000","last_peered":"2024-04-25T22:55:49.530959+0000","last_clean":"2024-04-25T22:55:49.530959+0000","last_became_active":"2024-04-25T22:55:38.516294+0000","last_became_peered":"2024-04-25T22:55:38.516294+0000","last_unstale":"2024-04-25T22:55:49.530959+0000","last_undegraded":"2024-04-25T22:55:49.530959+0000","last_fullsized":"2024-04-25T22:55:49.530959+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:55:49.530819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:55:49.530819+0000","last_clean_scrub_stamp":"2024-04-25T22:55:49.530819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:10:32.958355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"77'212","reported_seq":330,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:54.853393+0000","last_change":"2024-04-25T22:55:54.853423+0000","last_active":"2024-04-25T22:55:54.853393+0000","last_peered":"2024-04-25T22:55:54.853393+0000","last_clean":"2024-04-25T22:55:54.853393+0000","last_became_active":"2024-04-25T22:55:31.526666+0000","last_became_peered":"2024-04-25T22:55:31.526666+0000","last_unstale":"2024-04-25T22:55:54.853393+0000","last_undegraded":"2024-04-25T22:55:54.853393+0000","last_fullsized":"2024-04-25T22:55:54.853393+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'212","last_scrub_stamp":"2024-04-25T22:55:54.853320+0000","last_deep_scrub":"77'212","last_deep_scrub_stamp":"2024-04-25T22:55:54.853320+0000","last_clean_scrub_stamp":"2024-04-25T22:55:54.853320+0000","objects_scrubbed":56,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:21:54.921835+0000","scrub_duration":36,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100051,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":100051,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"52'1","reported_seq":155,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:02.589864+0000","last_change":"2024-04-25T22:56:02.589864+0000","last_active":"2024-04-25T22:56:02.589864+0000","last_peered":"2024-04-25T22:56:02.589864+0000","last_clean":"2024-04-25T22:56:02.589864+0000","last_became_active":"2024-04-25T22:55:27.516760+0000","last_became_peered":"2024-04-25T22:55:27.516760+0000","last_unstale":"2024-04-25T22:56:02.589864+0000","last_undegraded":"2024-04-25T22:56:02.589864+0000","last_fullsized":"2024-04-25T22:56:02.589864+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'1","last_scrub_stamp":"2024-04-25T22:56:02.589755+0000","last_deep_scrub":"52'1","last_deep_scrub_stamp":"2024-04-25T22:56:02.589755+0000","last_clean_scrub_stamp":"2024-04-25T22:56:02.589755+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:06:55.590048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":57,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:08.839157+0000","last_change":"2024-04-25T22:56:08.839203+0000","last_active":"2024-04-25T22:56:08.839157+0000","last_peered":"2024-04-25T22:56:08.839157+0000","last_clean":"2024-04-25T22:56:08.839157+0000","last_became_active":"2024-04-25T22:55:27.516272+0000","last_became_peered":"2024-04-25T22:55:27.516272+0000","last_unstale":"2024-04-25T22:56:08.839157+0000","last_undegraded":"2024-04-25T22:56:08.839157+0000","last_fullsized":"2024-04-25T22:56:08.839157+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:56:08.839017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:56:08.839017+0000","last_clean_scrub_stamp":"2024-04-25T22:56:08.839017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:35:32.538093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"77'201","reported_seq":349,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:13.776138+0000","last_change":"2024-04-25T22:56:13.776229+0000","last_active":"2024-04-25T22:56:13.776138+0000","last_peered":"2024-04-25T22:56:13.776138+0000","last_clean":"2024-04-25T22:56:13.776138+0000","last_became_active":"2024-04-25T22:51:53.025824+0000","last_became_peered":"2024-04-25T22:51:53.025824+0000","last_unstale":"2024-04-25T22:56:13.776138+0000","last_undegraded":"2024-04-25T22:56:13.776138+0000","last_fullsized":"2024-04-25T22:56:13.776138+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'201","last_scrub_stamp":"2024-04-25T22:56:13.776036+0000","last_deep_scrub":"77'201","last_deep_scrub_stamp":"2024-04-25T22:56:13.776036+0000","last_clean_scrub_stamp":"2024-04-25T22:56:13.776036+0000","objects_scrubbed":46,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:43:58.854068+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67397,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":57,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:07.821304+0000","last_change":"2024-04-25T22:56:07.821328+0000","last_active":"2024-04-25T22:56:07.821304+0000","last_peered":"2024-04-25T22:56:07.821304+0000","last_clean":"2024-04-25T22:56:07.821304+0000","last_became_active":"2024-04-25T22:55:27.515536+0000","last_became_peered":"2024-04-25T22:55:27.515536+0000","last_unstale":"2024-04-25T22:56:07.821304+0000","last_undegraded":"2024-04-25T22:56:07.821304+0000","last_fullsized":"2024-04-25T22:56:07.821304+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:56:07.821226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:56:07.821226+0000","last_clean_scrub_stamp":"2024-04-25T22:56:07.821226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:56:38.115489+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":162,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:52.582267+0000","last_change":"2024-04-25T22:55:52.582267+0000","last_active":"2024-04-25T22:55:52.582267+0000","last_peered":"2024-04-25T22:55:52.582267+0000","last_clean":"2024-04-25T22:55:52.582267+0000","last_became_active":"2024-04-25T22:55:27.517411+0000","last_became_peered":"2024-04-25T22:55:27.517411+0000","last_unstale":"2024-04-25T22:55:52.582267+0000","last_undegraded":"2024-04-25T22:55:52.582267+0000","last_fullsized":"2024-04-25T22:55:52.582267+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:55:52.582138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:55:52.582138+0000","last_clean_scrub_stamp":"2024-04-25T22:55:52.582138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:31.301317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"77'233","reported_seq":382,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:05.650553+0000","last_change":"2024-04-25T22:56:05.650553+0000","last_active":"2024-04-25T22:56:05.650553+0000","last_peered":"2024-04-25T22:56:05.650553+0000","last_clean":"2024-04-25T22:56:05.650553+0000","last_became_active":"2024-04-25T22:51:53.026458+0000","last_became_peered":"2024-04-25T22:51:53.026458+0000","last_unstale":"2024-04-25T22:56:05.650553+0000","last_undegraded":"2024-04-25T22:56:05.650553+0000","last_fullsized":"2024-04-25T22:56:05.650553+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'233","last_scrub_stamp":"2024-04-25T22:56:05.650442+0000","last_deep_scrub":"77'233","last_deep_scrub_stamp":"2024-04-25T22:56:05.650442+0000","last_clean_scrub_stamp":"2024-04-25T22:56:05.650442+0000","objects_scrubbed":58,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:06:58.650736+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192819,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":203,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"77'3","reported_seq":62,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:13.843734+0000","last_change":"2024-04-25T22:56:13.843760+0000","last_active":"2024-04-25T22:56:13.843734+0000","last_peered":"2024-04-25T22:56:13.843734+0000","last_clean":"2024-04-25T22:56:13.843734+0000","last_became_active":"2024-04-25T22:55:27.518853+0000","last_became_peered":"2024-04-25T22:55:27.518853+0000","last_unstale":"2024-04-25T22:56:13.843734+0000","last_undegraded":"2024-04-25T22:56:13.843734+0000","last_fullsized":"2024-04-25T22:56:13.843734+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'3","last_scrub_stamp":"2024-04-25T22:56:13.843657+0000","last_deep_scrub":"77'3","last_deep_scrub_stamp":"2024-04-25T22:56:13.843657+0000","last_clean_scrub_stamp":"2024-04-25T22:56:13.843657+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:01:45.074389+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":57,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:12.823691+0000","last_change":"2024-04-25T22:56:12.823711+0000","last_active":"2024-04-25T22:56:12.823691+0000","last_peered":"2024-04-25T22:56:12.823691+0000","last_clean":"2024-04-25T22:56:12.823691+0000","last_became_active":"2024-04-25T22:55:27.518183+0000","last_became_peered":"2024-04-25T22:55:27.518183+0000","last_unstale":"2024-04-25T22:56:12.823691+0000","last_undegraded":"2024-04-25T22:56:12.823691+0000","last_fullsized":"2024-04-25T22:56:12.823691+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:56:12.823608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:56:12.823608+0000","last_clean_scrub_stamp":"2024-04-25T22:56:12.823608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:08:21.483234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"77'231","reported_seq":575,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:22.078759+0000","last_change":"2024-04-25T22:56:22.078802+0000","last_active":"2024-04-25T22:56:22.078759+0000","last_peered":"2024-04-25T22:56:22.078759+0000","last_clean":"2024-04-25T22:56:22.078759+0000","last_became_active":"2024-04-25T22:55:40.538335+0000","last_became_peered":"2024-04-25T22:55:40.538335+0000","last_unstale":"2024-04-25T22:56:22.078759+0000","last_undegraded":"2024-04-25T22:56:22.078759+0000","last_fullsized":"2024-04-25T22:56:22.078759+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'231","last_scrub_stamp":"2024-04-25T22:56:22.078676+0000","last_deep_scrub":"77'231","last_deep_scrub_stamp":"2024-04-25T22:56:22.078676+0000","last_clean_scrub_stamp":"2024-04-25T22:56:22.078676+0000","objects_scrubbed":59,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:45:00.461312+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505702,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":1011342,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"77'38","reported_seq":77,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:59.886374+0000","last_change":"2024-04-25T22:55:59.886399+0000","last_active":"2024-04-25T22:55:59.886374+0000","last_peered":"2024-04-25T22:55:59.886374+0000","last_clean":"2024-04-25T22:55:59.886374+0000","last_became_active":"2024-04-25T22:55:27.518193+0000","last_became_peered":"2024-04-25T22:55:27.518193+0000","last_unstale":"2024-04-25T22:55:59.886374+0000","last_undegraded":"2024-04-25T22:55:59.886374+0000","last_fullsized":"2024-04-25T22:55:59.886374+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'38","last_scrub_stamp":"2024-04-25T22:55:59.886295+0000","last_deep_scrub":"77'38","last_deep_scrub_stamp":"2024-04-25T22:55:59.886295+0000","last_clean_scrub_stamp":"2024-04-25T22:55:59.886295+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:14:47.715262+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":153,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:11.623778+0000","last_change":"2024-04-25T22:56:11.623820+0000","last_active":"2024-04-25T22:56:11.623778+0000","last_peered":"2024-04-25T22:56:11.623778+0000","last_clean":"2024-04-25T22:56:11.623778+0000","last_became_active":"2024-04-25T22:51:47.763961+0000","last_became_peered":"2024-04-25T22:51:47.763961+0000","last_unstale":"2024-04-25T22:56:11.623778+0000","last_undegraded":"2024-04-25T22:56:11.623778+0000","last_fullsized":"2024-04-25T22:56:11.623778+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:56:11.623680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:56:11.623680+0000","last_clean_scrub_stamp":"2024-04-25T22:56:11.623680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:05:23.077711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"77'190","reported_seq":338,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:15.774474+0000","last_change":"2024-04-25T22:56:15.774525+0000","last_active":"2024-04-25T22:56:15.774474+0000","last_peered":"2024-04-25T22:56:15.774474+0000","last_clean":"2024-04-25T22:56:15.774474+0000","last_became_active":"2024-04-25T22:51:53.026419+0000","last_became_peered":"2024-04-25T22:51:53.026419+0000","last_unstale":"2024-04-25T22:56:15.774474+0000","last_undegraded":"2024-04-25T22:56:15.774474+0000","last_fullsized":"2024-04-25T22:56:15.774474+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'190","last_scrub_stamp":"2024-04-25T22:56:15.774382+0000","last_deep_scrub":"77'190","last_deep_scrub_stamp":"2024-04-25T22:56:15.774382+0000","last_clean_scrub_stamp":"2024-04-25T22:56:15.774382+0000","objects_scrubbed":48,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:24:59.965938+0000","scrub_duration":30,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":246196,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"77'224","reported_seq":371,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:18.684578+0000","last_change":"2024-04-25T22:56:18.684578+0000","last_active":"2024-04-25T22:56:18.684578+0000","last_peered":"2024-04-25T22:56:18.684578+0000","last_clean":"2024-04-25T22:56:18.684578+0000","last_became_active":"2024-04-25T22:51:53.021687+0000","last_became_peered":"2024-04-25T22:51:53.021687+0000","last_unstale":"2024-04-25T22:56:18.684578+0000","last_undegraded":"2024-04-25T22:56:18.684578+0000","last_fullsized":"2024-04-25T22:56:18.684578+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'224","last_scrub_stamp":"2024-04-25T22:56:18.684457+0000","last_deep_scrub":"77'224","last_deep_scrub_stamp":"2024-04-25T22:56:18.684457+0000","last_clean_scrub_stamp":"2024-04-25T22:56:18.684457+0000","objects_scrubbed":62,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:41:00.657360+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108265,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"77'47","reported_seq":194,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:14.593768+0000","last_change":"2024-04-25T22:56:14.593768+0000","last_active":"2024-04-25T22:56:14.593768+0000","last_peered":"2024-04-25T22:56:14.593768+0000","last_clean":"2024-04-25T22:56:14.593768+0000","last_became_active":"2024-04-25T22:51:52.019264+0000","last_became_peered":"2024-04-25T22:51:52.019264+0000","last_unstale":"2024-04-25T22:56:14.593768+0000","last_undegraded":"2024-04-25T22:56:14.593768+0000","last_fullsized":"2024-04-25T22:56:14.593768+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'47","last_scrub_stamp":"2024-04-25T22:56:14.593605+0000","last_deep_scrub":"77'47","last_deep_scrub_stamp":"2024-04-25T22:56:14.593605+0000","last_clean_scrub_stamp":"2024-04-25T22:56:14.593605+0000","objects_scrubbed":4,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:00:09.529629+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"77'198","reported_seq":316,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:52.879444+0000","last_change":"2024-04-25T22:55:52.879477+0000","last_active":"2024-04-25T22:55:52.879444+0000","last_peered":"2024-04-25T22:55:52.879444+0000","last_clean":"2024-04-25T22:55:52.879444+0000","last_became_active":"2024-04-25T22:55:31.526620+0000","last_became_peered":"2024-04-25T22:55:31.526620+0000","last_unstale":"2024-04-25T22:55:52.879444+0000","last_undegraded":"2024-04-25T22:55:52.879444+0000","last_fullsized":"2024-04-25T22:55:52.879444+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'198","last_scrub_stamp":"2024-04-25T22:55:52.879360+0000","last_deep_scrub":"77'198","last_deep_scrub_stamp":"2024-04-25T22:55:52.879360+0000","last_clean_scrub_stamp":"2024-04-25T22:55:52.879360+0000","objects_scrubbed":52,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:57:55.235548+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89309,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":89309,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"77'23","reported_seq":172,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:11.755064+0000","last_change":"2024-04-25T22:56:11.755064+0000","last_active":"2024-04-25T22:56:11.755064+0000","last_peered":"2024-04-25T22:56:11.755064+0000","last_clean":"2024-04-25T22:56:11.755064+0000","last_became_active":"2024-04-25T22:51:52.018519+0000","last_became_peered":"2024-04-25T22:51:52.018519+0000","last_unstale":"2024-04-25T22:56:11.755064+0000","last_undegraded":"2024-04-25T22:56:11.755064+0000","last_fullsized":"2024-04-25T22:56:11.755064+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'23","last_scrub_stamp":"2024-04-25T22:56:11.754915+0000","last_deep_scrub":"77'23","last_deep_scrub_stamp":"2024-04-25T22:56:11.754915+0000","last_clean_scrub_stamp":"2024-04-25T22:56:11.754915+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:49:24.642327+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"48'1","reported_seq":125,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:51.520917+0000","last_change":"2024-04-25T22:55:51.520917+0000","last_active":"2024-04-25T22:55:51.520917+0000","last_peered":"2024-04-25T22:55:51.520917+0000","last_clean":"2024-04-25T22:55:51.520917+0000","last_became_active":"2024-04-25T22:55:38.515986+0000","last_became_peered":"2024-04-25T22:55:38.515986+0000","last_unstale":"2024-04-25T22:55:51.520917+0000","last_undegraded":"2024-04-25T22:55:51.520917+0000","last_fullsized":"2024-04-25T22:55:51.520917+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1","last_scrub_stamp":"2024-04-25T22:55:51.520773+0000","last_deep_scrub":"48'1","last_deep_scrub_stamp":"2024-04-25T22:55:51.520773+0000","last_clean_scrub_stamp":"2024-04-25T22:55:51.520773+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:48:06.675817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"77'236","reported_seq":354,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:55.886996+0000","last_change":"2024-04-25T22:55:55.887042+0000","last_active":"2024-04-25T22:55:55.886996+0000","last_peered":"2024-04-25T22:55:55.886996+0000","last_clean":"2024-04-25T22:55:55.886996+0000","last_became_active":"2024-04-25T22:55:30.525233+0000","last_became_peered":"2024-04-25T22:55:30.525233+0000","last_unstale":"2024-04-25T22:55:55.886996+0000","last_undegraded":"2024-04-25T22:55:55.886996+0000","last_fullsized":"2024-04-25T22:55:55.886996+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'236","last_scrub_stamp":"2024-04-25T22:55:55.886909+0000","last_deep_scrub":"77'236","last_deep_scrub_stamp":"2024-04-25T22:55:55.886909+0000","last_clean_scrub_stamp":"2024-04-25T22:55:55.886909+0000","objects_scrubbed":65,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:07:00.547163+0000","scrub_duration":42,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":332166,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":329490,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"51'2","reported_seq":57,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:10.853673+0000","last_change":"2024-04-25T22:56:10.853697+0000","last_active":"2024-04-25T22:56:10.853673+0000","last_peered":"2024-04-25T22:56:10.853673+0000","last_clean":"2024-04-25T22:56:10.853673+0000","last_became_active":"2024-04-25T22:55:27.518244+0000","last_became_peered":"2024-04-25T22:55:27.518244+0000","last_unstale":"2024-04-25T22:56:10.853673+0000","last_undegraded":"2024-04-25T22:56:10.853673+0000","last_fullsized":"2024-04-25T22:56:10.853673+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'2","last_scrub_stamp":"2024-04-25T22:56:10.853589+0000","last_deep_scrub":"51'2","last_deep_scrub_stamp":"2024-04-25T22:56:10.853589+0000","last_clean_scrub_stamp":"2024-04-25T22:56:10.853589+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:08:45.545174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"77'208","reported_seq":328,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:50.910764+0000","last_change":"2024-04-25T22:55:50.910790+0000","last_active":"2024-04-25T22:55:50.910764+0000","last_peered":"2024-04-25T22:55:50.910764+0000","last_clean":"2024-04-25T22:55:50.910764+0000","last_became_active":"2024-04-25T22:55:30.526853+0000","last_became_peered":"2024-04-25T22:55:30.526853+0000","last_unstale":"2024-04-25T22:55:50.910764+0000","last_undegraded":"2024-04-25T22:55:50.910764+0000","last_fullsized":"2024-04-25T22:55:50.910764+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'208","last_scrub_stamp":"2024-04-25T22:55:50.910652+0000","last_deep_scrub":"77'208","last_deep_scrub_stamp":"2024-04-25T22:55:50.910652+0000","last_clean_scrub_stamp":"2024-04-25T22:55:50.910652+0000","objects_scrubbed":50,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:21:47.382105+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70967,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":70967,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"77'222","reported_seq":371,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:55.635725+0000","last_change":"2024-04-25T22:55:55.635725+0000","last_active":"2024-04-25T22:55:55.635725+0000","last_peered":"2024-04-25T22:55:55.635725+0000","last_clean":"2024-04-25T22:55:55.635725+0000","last_became_active":"2024-04-25T22:51:53.028635+0000","last_became_peered":"2024-04-25T22:51:53.028635+0000","last_unstale":"2024-04-25T22:55:55.635725+0000","last_undegraded":"2024-04-25T22:55:55.635725+0000","last_fullsized":"2024-04-25T22:55:55.635725+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'222","last_scrub_stamp":"2024-04-25T22:55:55.635582+0000","last_deep_scrub":"77'222","last_deep_scrub_stamp":"2024-04-25T22:55:55.635582+0000","last_clean_scrub_stamp":"2024-04-25T22:55:55.635582+0000","objects_scrubbed":50,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:47:02.536428+0000","scrub_duration":42,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":440592,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"50'1","reported_seq":57,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:06.846238+0000","last_change":"2024-04-25T22:56:06.846263+0000","last_active":"2024-04-25T22:56:06.846238+0000","last_peered":"2024-04-25T22:56:06.846238+0000","last_clean":"2024-04-25T22:56:06.846238+0000","last_became_active":"2024-04-25T22:55:27.515473+0000","last_became_peered":"2024-04-25T22:55:27.515473+0000","last_unstale":"2024-04-25T22:56:06.846238+0000","last_undegraded":"2024-04-25T22:56:06.846238+0000","last_fullsized":"2024-04-25T22:56:06.846238+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"50'1","last_scrub_stamp":"2024-04-25T22:56:06.846147+0000","last_deep_scrub":"50'1","last_deep_scrub_stamp":"2024-04-25T22:56:06.846147+0000","last_clean_scrub_stamp":"2024-04-25T22:56:06.846147+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:41:50.152631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"77'201","reported_seq":311,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:16.925082+0000","last_change":"2024-04-25T22:56:16.925113+0000","last_active":"2024-04-25T22:56:16.925082+0000","last_peered":"2024-04-25T22:56:16.925082+0000","last_clean":"2024-04-25T22:56:16.925082+0000","last_became_active":"2024-04-25T22:55:34.512137+0000","last_became_peered":"2024-04-25T22:55:34.512137+0000","last_unstale":"2024-04-25T22:56:16.925082+0000","last_undegraded":"2024-04-25T22:56:16.925082+0000","last_fullsized":"2024-04-25T22:56:16.925082+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'201","last_scrub_stamp":"2024-04-25T22:56:16.925002+0000","last_deep_scrub":"77'201","last_deep_scrub_stamp":"2024-04-25T22:56:16.925002+0000","last_clean_scrub_stamp":"2024-04-25T22:56:16.925002+0000","objects_scrubbed":50,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:38:06.651622+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106917,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":97731,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":85,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:19.981734+0000","last_change":"2024-04-25T22:56:19.981769+0000","last_active":"2024-04-25T22:56:19.981734+0000","last_peered":"2024-04-25T22:56:19.981734+0000","last_clean":"2024-04-25T22:56:19.981734+0000","last_became_active":"2024-04-25T22:55:37.513925+0000","last_became_peered":"2024-04-25T22:55:37.513925+0000","last_unstale":"2024-04-25T22:56:19.981734+0000","last_undegraded":"2024-04-25T22:56:19.981734+0000","last_fullsized":"2024-04-25T22:56:19.981734+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T22:56:19.981622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T22:56:19.981622+0000","last_clean_scrub_stamp":"2024-04-25T22:56:19.981622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:57:11.603447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"77'263","reported_seq":411,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:01.626542+0000","last_change":"2024-04-25T22:56:01.626594+0000","last_active":"2024-04-25T22:56:01.626542+0000","last_peered":"2024-04-25T22:56:01.626542+0000","last_clean":"2024-04-25T22:56:01.626542+0000","last_became_active":"2024-04-25T22:51:53.027541+0000","last_became_peered":"2024-04-25T22:51:53.027541+0000","last_unstale":"2024-04-25T22:56:01.626542+0000","last_undegraded":"2024-04-25T22:56:01.626542+0000","last_fullsized":"2024-04-25T22:56:01.626542+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'263","last_scrub_stamp":"2024-04-25T22:56:01.626434+0000","last_deep_scrub":"77'263","last_deep_scrub_stamp":"2024-04-25T22:56:01.626434+0000","last_clean_scrub_stamp":"2024-04-25T22:56:01.626434+0000","objects_scrubbed":60,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:38.224020+0000","scrub_duration":49,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195653,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"77'3","reported_seq":163,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:58.589105+0000","last_change":"2024-04-25T22:55:58.589150+0000","last_active":"2024-04-25T22:55:58.589105+0000","last_peered":"2024-04-25T22:55:58.589105+0000","last_clean":"2024-04-25T22:55:58.589105+0000","last_became_active":"2024-04-25T22:55:27.517718+0000","last_became_peered":"2024-04-25T22:55:27.517718+0000","last_unstale":"2024-04-25T22:55:58.589105+0000","last_undegraded":"2024-04-25T22:55:58.589105+0000","last_fullsized":"2024-04-25T22:55:58.589105+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'3","last_scrub_stamp":"2024-04-25T22:55:58.588997+0000","last_deep_scrub":"77'3","last_deep_scrub_stamp":"2024-04-25T22:55:58.588997+0000","last_clean_scrub_stamp":"2024-04-25T22:55:58.588997+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:35:11.784147+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"77'224","reported_seq":591,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:51.611484+0000","last_change":"2024-04-25T22:55:51.611515+0000","last_active":"2024-04-25T22:55:51.611484+0000","last_peered":"2024-04-25T22:55:51.611484+0000","last_clean":"2024-04-25T22:55:51.611484+0000","last_became_active":"2024-04-25T22:55:34.513433+0000","last_became_peered":"2024-04-25T22:55:34.513433+0000","last_unstale":"2024-04-25T22:55:51.611484+0000","last_undegraded":"2024-04-25T22:55:51.611484+0000","last_fullsized":"2024-04-25T22:55:51.611484+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'224","last_scrub_stamp":"2024-04-25T22:55:51.611408+0000","last_deep_scrub":"77'224","last_deep_scrub_stamp":"2024-04-25T22:55:51.611408+0000","last_clean_scrub_stamp":"2024-04-25T22:55:51.611408+0000","objects_scrubbed":56,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:28:09.655049+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151921,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":151921,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"77'6","reported_seq":180,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:23.733731+0000","last_change":"2024-04-25T22:56:23.733791+0000","last_active":"2024-04-25T22:56:23.733731+0000","last_peered":"2024-04-25T22:56:23.733731+0000","last_clean":"2024-04-25T22:56:23.733731+0000","last_became_active":"2024-04-25T22:55:37.516119+0000","last_became_peered":"2024-04-25T22:55:37.516119+0000","last_unstale":"2024-04-25T22:56:23.733731+0000","last_undegraded":"2024-04-25T22:56:23.733731+0000","last_fullsized":"2024-04-25T22:56:23.733731+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'6","last_scrub_stamp":"2024-04-25T22:56:23.733631+0000","last_deep_scrub":"77'6","last_deep_scrub_stamp":"2024-04-25T22:56:23.733631+0000","last_clean_scrub_stamp":"2024-04-25T22:56:23.733631+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:39:27.729146+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"77'215","reported_seq":564,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:20.694060+0000","last_change":"2024-04-25T22:56:20.694118+0000","last_active":"2024-04-25T22:56:20.694060+0000","last_peered":"2024-04-25T22:56:20.694060+0000","last_clean":"2024-04-25T22:56:20.694060+0000","last_became_active":"2024-04-25T22:55:38.516260+0000","last_became_peered":"2024-04-25T22:55:38.516260+0000","last_unstale":"2024-04-25T22:56:20.694060+0000","last_undegraded":"2024-04-25T22:56:20.694060+0000","last_fullsized":"2024-04-25T22:56:20.694060+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'215","last_scrub_stamp":"2024-04-25T22:56:20.693977+0000","last_deep_scrub":"77'215","last_deep_scrub_stamp":"2024-04-25T22:56:20.693977+0000","last_clean_scrub_stamp":"2024-04-25T22:56:20.693977+0000","objects_scrubbed":49,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:08:32.018141+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3798024,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":3871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":3798024,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"77'3","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:24.627487+0000","last_change":"2024-04-25T22:56:24.627543+0000","last_active":"2024-04-25T22:56:24.627487+0000","last_peered":"2024-04-25T22:56:24.627487+0000","last_clean":"2024-04-25T22:56:24.627487+0000","last_became_active":"2024-04-25T22:55:38.515776+0000","last_became_peered":"2024-04-25T22:55:38.515776+0000","last_unstale":"2024-04-25T22:56:24.627487+0000","last_undegraded":"2024-04-25T22:56:24.627487+0000","last_fullsized":"2024-04-25T22:56:24.627487+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'3","last_scrub_stamp":"2024-04-25T22:56:24.627387+0000","last_deep_scrub":"77'3","last_deep_scrub_stamp":"2024-04-25T22:56:24.627387+0000","last_clean_scrub_stamp":"2024-04-25T22:56:24.627387+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:54:14.643992+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"77'215","reported_seq":563,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:52.576305+0000","last_change":"2024-04-25T22:55:52.576340+0000","last_active":"2024-04-25T22:55:52.576305+0000","last_peered":"2024-04-25T22:55:52.576305+0000","last_clean":"2024-04-25T22:55:52.576305+0000","last_became_active":"2024-04-25T22:55:38.514732+0000","last_became_peered":"2024-04-25T22:55:38.514732+0000","last_unstale":"2024-04-25T22:55:52.576305+0000","last_undegraded":"2024-04-25T22:55:52.576305+0000","last_fullsized":"2024-04-25T22:55:52.576305+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'215","last_scrub_stamp":"2024-04-25T22:55:52.576225+0000","last_deep_scrub":"77'215","last_deep_scrub_stamp":"2024-04-25T22:55:52.576225+0000","last_clean_scrub_stamp":"2024-04-25T22:55:52.576225+0000","objects_scrubbed":57,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:46:59.477071+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141656,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":141656,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"77'60","reported_seq":208,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:12.798678+0000","last_change":"2024-04-25T22:56:12.798728+0000","last_active":"2024-04-25T22:56:12.798678+0000","last_peered":"2024-04-25T22:56:12.798678+0000","last_clean":"2024-04-25T22:56:12.798678+0000","last_became_active":"2024-04-25T22:51:52.018547+0000","last_became_peered":"2024-04-25T22:51:52.018547+0000","last_unstale":"2024-04-25T22:56:12.798678+0000","last_undegraded":"2024-04-25T22:56:12.798678+0000","last_fullsized":"2024-04-25T22:56:12.798678+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'60","last_scrub_stamp":"2024-04-25T22:56:12.798556+0000","last_deep_scrub":"77'60","last_deep_scrub_stamp":"2024-04-25T22:56:12.798556+0000","last_clean_scrub_stamp":"2024-04-25T22:56:12.798556+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:43:40.940730+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":8213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"77'232","reported_seq":610,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:18.766867+0000","last_change":"2024-04-25T22:56:18.766867+0000","last_active":"2024-04-25T22:56:18.766867+0000","last_peered":"2024-04-25T22:56:18.766867+0000","last_clean":"2024-04-25T22:56:18.766867+0000","last_became_active":"2024-04-25T22:55:35.517149+0000","last_became_peered":"2024-04-25T22:55:35.517149+0000","last_unstale":"2024-04-25T22:56:18.766867+0000","last_undegraded":"2024-04-25T22:56:18.766867+0000","last_fullsized":"2024-04-25T22:56:18.766867+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'232","last_scrub_stamp":"2024-04-25T22:56:18.766725+0000","last_deep_scrub":"77'232","last_deep_scrub_stamp":"2024-04-25T22:56:18.766725+0000","last_clean_scrub_stamp":"2024-04-25T22:56:18.766725+0000","objects_scrubbed":63,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:00:13.702749+0000","scrub_duration":37,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184603,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":194,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":166098,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"77'26","reported_seq":66,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:57.865558+0000","last_change":"2024-04-25T22:55:57.865590+0000","last_active":"2024-04-25T22:55:57.865558+0000","last_peered":"2024-04-25T22:55:57.865558+0000","last_clean":"2024-04-25T22:55:57.865558+0000","last_became_active":"2024-04-25T22:55:27.520617+0000","last_became_peered":"2024-04-25T22:55:27.520617+0000","last_unstale":"2024-04-25T22:55:57.865558+0000","last_undegraded":"2024-04-25T22:55:57.865558+0000","last_fullsized":"2024-04-25T22:55:57.865558+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'26","last_scrub_stamp":"2024-04-25T22:55:57.865473+0000","last_deep_scrub":"77'26","last_deep_scrub_stamp":"2024-04-25T22:55:57.865473+0000","last_clean_scrub_stamp":"2024-04-25T22:55:57.865473+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:10:12.757049+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"77'261","reported_seq":671,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:55:59.604979+0000","last_change":"2024-04-25T22:55:59.604979+0000","last_active":"2024-04-25T22:55:59.604979+0000","last_peered":"2024-04-25T22:55:59.604979+0000","last_clean":"2024-04-25T22:55:59.604979+0000","last_became_active":"2024-04-25T22:55:31.526322+0000","last_became_peered":"2024-04-25T22:55:31.526322+0000","last_unstale":"2024-04-25T22:55:59.604979+0000","last_undegraded":"2024-04-25T22:55:59.604979+0000","last_fullsized":"2024-04-25T22:55:59.604979+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'261","last_scrub_stamp":"2024-04-25T22:55:59.604843+0000","last_deep_scrub":"77'261","last_deep_scrub_stamp":"2024-04-25T22:55:59.604843+0000","last_clean_scrub_stamp":"2024-04-25T22:55:59.604843+0000","objects_scrubbed":65,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:11:11.381669+0000","scrub_duration":48,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200980,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":211,"num_write_kb":410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":126,"num_bytes_recovered":197679,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"77'10","reported_seq":110,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T22:56:21.005241+0000","last_change":"2024-04-25T22:56:21.005269+0000","last_active":"2024-04-25T22:56:21.005241+0000","last_peered":"2024-04-25T22:56:21.005241+0000","last_clean":"2024-04-25T22:56:21.005241+0000","last_became_active":"2024-04-25T22:55:37.516183+0000","last_became_peered":"2024-04-25T22:55:37.516183+0000","last_unstale":"2024-04-25T22:56:21.005241+0000","last_undegraded":"2024-04-25T22:56:21.005241+0000","last_fullsized":"2024-04-25T22:56:21.005241+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"77'10","last_scrub_stamp":"2024-04-25T22:56:21.005159+0000","last_deep_scrub":"77'10","last_deep_scrub_stamp":"2024-04-25T22:56:21.005159+0000","last_clean_scrub_stamp":"2024-04-25T22:56:21.005159+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:01:41.294892+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8389190,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26691649,"num_objects":3448,"num_object_clones":0,"num_object_copies":6896,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3448,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10583,"num_write_kb":38991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4953,"num_bytes_recovered":24173691,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73056256,"data_stored":53061590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13863,"ondisk_log_size":13863,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":40502861,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":34,"num_read_kb":343,"num_write":470,"num_write_kb":40224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":32113365,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":81068032,"data_stored":81005722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5351,"internal_metadata":0},"log_size":466,"ondisk_log_size":466,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738432,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":94548,"kb_used_data":49484,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94277292,"statfs":{"total":96636764160,"available":96539947008,"internally_reserved":0,"allocated":50671616,"data_stored":43771464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":62,"seq":266287972370,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76920,"kb_used_data":45232,"kb_used_omap":6,"kb_used_meta":31673,"kb_avail":94294920,"statfs":{"total":96636764160,"available":96557998080,"internally_reserved":0,"allocated":46317568,"data_stored":38899263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6946,"internal_metadata":32433374},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738432,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":112296,"kb_used_data":58912,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94259544,"statfs":{"total":96636764160,"available":96521773056,"internally_reserved":0,"allocated":60325888,"data_stored":53539649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32145408,"data_stored":32114253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19542016,"data_stored":19530487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5351,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":29380608,"data_stored":29360982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":26918912,"data_stored":20514252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26107904,"data_stored":19048000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20029440,"data_stored":13499338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T22:56:51.536 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-25T22:56:51.886 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T22:56:51.886 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T22:56:52.220 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:56:52.221 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T22:51:52.369470+0000","modified":"2024-04-25T22:51:54.363680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4193":{"gid":4193,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6803/4196269333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":4196269333},{"type":"v1","addr":"172.21.15.52:6803","nonce":4196269333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4193,"qdb_cluster":[4193]},"id":1}]} 2024-04-25T22:56:52.221 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 5 2024-04-25T22:56:52.234 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T22:56:52.565 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:56:52.565 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T22:51:52.369470+0000","modified":"2024-04-25T22:51:54.363680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4193":{"gid":4193,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6803/4196269333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":4196269333},{"type":"v1","addr":"172.21.15.52:6803","nonce":4196269333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4193,"qdb_cluster":[4193]},"id":1}]} 2024-04-25T22:56:52.565 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 5 2024-04-25T22:56:52.578 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T22:56:52.880 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-25T22:56:52.880 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":77,"fsid":"5355b70e-3f7d-4bce-8676-89cee61d2089","created":"2024-04-25T22:51:37.688525+0000","modified":"2024-04-25T22:55:41.532205+0000","last_up_change":"2024-04-25T22:55:26.505414+0000","last_in_change":"2024-04-25T22:51:38.491924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T22:51:45.966439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T22:51:46.128416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T22:51:50.648525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T22:51:51.351497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b785a86a-6391-4a0d-8aec-c2016380832e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6801","nonce":3666753097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6803","nonce":3666753097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6807","nonce":3666753097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3666753097},{"type":"v1","addr":"172.21.15.110:6805","nonce":3666753097}]},"public_addr":"172.21.15.110:6801/3666753097","cluster_addr":"172.21.15.110:6803/3666753097","heartbeat_back_addr":"172.21.15.110:6807/3666753097","heartbeat_front_addr":"172.21.15.110:6805/3666753097","state":["exists","up"]},{"osd":1,"uuid":"088b4733-ccbd-41a6-8a31-8d811169c28a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":26,"up_from":62,"up_thru":75,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2239032021},{"type":"v1","addr":"172.21.15.164:6801","nonce":2239032021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2239032021},{"type":"v1","addr":"172.21.15.164:6803","nonce":2239032021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2239032021},{"type":"v1","addr":"172.21.15.164:6807","nonce":2239032021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2239032021},{"type":"v1","addr":"172.21.15.164:6805","nonce":2239032021}]},"public_addr":"172.21.15.164:6801/2239032021","cluster_addr":"172.21.15.164:6803/2239032021","heartbeat_back_addr":"172.21.15.164:6807/2239032021","heartbeat_front_addr":"172.21.15.164:6805/2239032021","state":["exists","up"]},{"osd":2,"uuid":"6a6aad8c-22ac-45c0-baf9-928314e7fef9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6801","nonce":349040881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6803","nonce":349040881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6807","nonce":349040881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":349040881},{"type":"v1","addr":"172.21.15.191:6805","nonce":349040881}]},"public_addr":"172.21.15.191:6801/349040881","cluster_addr":"172.21.15.191:6803/349040881","heartbeat_back_addr":"172.21.15.191:6807/349040881","heartbeat_front_addr":"172.21.15.191:6805/349040881","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:51:43.531709+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:51:43.589701+0000","dead_epoch":26},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T22:51:43.566226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T22:56:52.894 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T22:56:53.226 INFO:teuthology.orchestra.run.smithi052.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T22:56:53.242 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T22:56:53.267 INFO:tasks.ceph.mds.a.smithi052.stdout:starting mds.a at 2024-04-25T22:56:54.246 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T22:56:55.231 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' removed 2024-04-25T22:56:55.248 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T22:56:56.237 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' removed 2024-04-25T22:56:56.255 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-25T22:56:56.255 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T22:56:56.256 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T22:56:56.265 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T22:56:56.266 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-25T22:56:56.266 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-25T22:56:56.266 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T22:56:56.297 INFO:tasks.ceph.osd.0:Stopped 2024-04-25T22:56:56.298 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-25T22:56:56.298 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T22:56:56.325 INFO:tasks.ceph.osd.1:Stopped 2024-04-25T22:56:56.325 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-25T22:56:56.325 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T22:56:56.363 INFO:tasks.ceph.osd.2:Stopped 2024-04-25T22:56:56.363 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-25T22:56:56.364 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-25T22:56:56.364 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T22:56:56.390 INFO:tasks.ceph.mgr.x:Stopped 2024-04-25T22:56:56.391 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-25T22:56:56.391 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T22:56:56.459 INFO:tasks.ceph.mgr.y:Stopped 2024-04-25T22:56:56.459 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-25T22:56:56.460 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-25T22:56:56.460 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T22:56:56.515 INFO:tasks.ceph.mon.a:Stopped 2024-04-25T22:56:56.515 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-25T22:56:56.515 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T22:56:56.568 INFO:tasks.ceph.mon.b:Stopped 2024-04-25T22:56:56.568 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-25T22:56:56.568 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T22:56:56.620 INFO:tasks.ceph.mon.c:Stopped 2024-04-25T22:56:56.621 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-25T22:56:56.621 DEBUG:teuthology.orchestra.run.smithi052:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MDS_TRIM\)' | egrep -v '\(MDS_SLOW_REQUEST\)' | egrep -v MDS_SLOW_METADATA_IO | egrep -v 'Behind on trimming' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | head -n 1 2024-04-25T22:56:56.698 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi110.front.sepia.ceph.com 2024-04-25T22:56:56.699 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-25T22:56:56.808 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi164.front.sepia.ceph.com 2024-04-25T22:56:56.808 DEBUG:teuthology.orchestra.run.smithi164:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-25T22:56:56.925 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi191.front.sepia.ceph.com 2024-04-25T22:56:56.926 DEBUG:teuthology.orchestra.run.smithi191:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-25T22:56:57.037 INFO:tasks.ceph:Archiving mon data... 2024-04-25T22:56:57.039 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674073/data/mon.a.tgz 2024-04-25T22:56:57.039 DEBUG:teuthology.orchestra.run.smithi052:> mktemp 2024-04-25T22:56:57.056 INFO:teuthology.orchestra.run.smithi052.stdout:/tmp/tmp.bqcWame53q 2024-04-25T22:56:57.056 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.bqcWame53q 2024-04-25T22:56:57.208 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0666 /tmp/tmp.bqcWame53q 2024-04-25T22:56:57.292 DEBUG:teuthology.orchestra.remote:smithi052:/tmp/tmp.bqcWame53q is 369KB 2024-04-25T22:56:57.361 DEBUG:teuthology.orchestra.run.smithi052:> rm -fr /tmp/tmp.bqcWame53q 2024-04-25T22:56:57.376 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674073/data/mon.b.tgz 2024-04-25T22:56:57.376 DEBUG:teuthology.orchestra.run.smithi052:> mktemp 2024-04-25T22:56:57.430 INFO:teuthology.orchestra.run.smithi052.stdout:/tmp/tmp.3UKkS6vFbq 2024-04-25T22:56:57.430 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.3UKkS6vFbq 2024-04-25T22:56:57.599 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0666 /tmp/tmp.3UKkS6vFbq 2024-04-25T22:56:57.681 DEBUG:teuthology.orchestra.remote:smithi052:/tmp/tmp.3UKkS6vFbq is 520KB 2024-04-25T22:56:57.782 DEBUG:teuthology.orchestra.run.smithi052:> rm -fr /tmp/tmp.3UKkS6vFbq 2024-04-25T22:56:57.797 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674073/data/mon.c.tgz 2024-04-25T22:56:57.797 DEBUG:teuthology.orchestra.run.smithi052:> mktemp 2024-04-25T22:56:57.852 INFO:teuthology.orchestra.run.smithi052.stdout:/tmp/tmp.3tjVVlfDWE 2024-04-25T22:56:57.852 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.3tjVVlfDWE 2024-04-25T22:56:58.020 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0666 /tmp/tmp.3tjVVlfDWE 2024-04-25T22:56:58.104 DEBUG:teuthology.orchestra.remote:smithi052:/tmp/tmp.3tjVVlfDWE is 520KB 2024-04-25T22:56:58.203 DEBUG:teuthology.orchestra.run.smithi052:> rm -fr /tmp/tmp.3tjVVlfDWE 2024-04-25T22:56:58.218 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-25T22:56:58.218 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T22:56:58.259 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T22:56:58.262 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T22:56:58.264 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T22:56:58.336 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T22:56:58.353 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T22:56:58.373 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T22:56:58.391 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T22:56:58.391 INFO:tasks.ceph:Archiving crash dumps... 2024-04-25T22:56:58.393 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674073/remote/smithi052/crash 2024-04-25T22:56:58.394 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T22:56:58.418 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674073/remote/smithi110/crash 2024-04-25T22:56:58.419 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T22:56:58.463 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674073/remote/smithi164/crash 2024-04-25T22:56:58.464 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T22:56:58.502 DEBUG:teuthology.misc:Transferring archived files from smithi191:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674073/remote/smithi191/crash 2024-04-25T22:56:58.503 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T22:56:58.540 INFO:tasks.ceph:Compressing logs... 2024-04-25T22:56:58.541 DEBUG:teuthology.orchestra.run.smithi052:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T22:56:58.544 DEBUG:teuthology.orchestra.run.smithi110:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T22:56:58.546 DEBUG:teuthology.orchestra.run.smithi164:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T22:56:58.549 DEBUG:teuthology.orchestra.run.smithi191:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T22:56:58.564 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34210.log 2024-04-25T22:56:58.571 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-25T22:56:58.572 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.777.log 2024-04-25T22:56:58.573 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-25T22:56:58.573 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.777.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.777.log.gz 2024-04-25T22:56:58.615 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-25T22:56:58.615 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28616.log 2024-04-25T22:56:58.615 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28696.log 2024-04-25T22:56:58.616 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.28616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28656.log 2024-04-25T22:56:58.616 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28616.log.gz 2024-04-25T22:56:58.616 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.28696.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28696.log.gz 2024-04-25T22:56:58.616 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.28656.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28656.log.gz 2024-04-25T22:56:58.651 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33053.log 2024-04-25T22:56:58.652 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.34210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31056.log 2024-04-25T22:56:58.652 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34210.log.gz 2024-04-25T22:56:58.652 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.33053.log: /var/log/ceph/ceph-client.admin.44633.log 2024-04-25T22:56:58.652 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33053.log.gz 2024-04-25T22:56:58.652 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.31056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30100.log 2024-04-25T22:56:58.652 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31056.log.gz 2024-04-25T22:56:58.652 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42437.log 2024-04-25T22:56:58.652 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44633.log.gz 2024-04-25T22:56:58.653 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29122.log 2024-04-25T22:56:58.653 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30100.log.gz 2024-04-25T22:56:58.653 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32526.log 2024-04-25T22:56:58.653 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42437.log.gz 2024-04-25T22:56:58.653 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29080.log 2024-04-25T22:56:58.653 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.29122.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29122.log.gz 2024-04-25T22:56:58.653 INFO:teuthology.orchestra.run.smithi052.stderr:gzip/var/log/ceph/ceph-client.admin.32526.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.37879.log 2024-04-25T22:56:58.653 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32526.log.gz 2024-04-25T22:56:58.654 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.29080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30554.log 2024-04-25T22:56:58.654 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29080.log.gz 2024-04-25T22:56:58.654 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.37879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42988.log 2024-04-25T22:56:58.654 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37879.log.gz 2024-04-25T22:56:58.654 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43074.log 2024-04-25T22:56:58.654 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30554.log.gz 2024-04-25T22:56:58.654 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31263.log 2024-04-25T22:56:58.654 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42988.log.gz 2024-04-25T22:56:58.655 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.43074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44084.log 2024-04-25T22:56:58.655 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43074.log.gz 2024-04-25T22:56:58.655 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.31263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30470.log 2024-04-25T22:56:58.655 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31263.log.gz 2024-04-25T22:56:58.655 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30722.log 2024-04-25T22:56:58.655 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44084.log.gz 2024-04-25T22:56:58.655 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30764.log 2024-04-25T22:56:58.655 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30470.log.gz 2024-04-25T22:56:58.656 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28345.log 2024-04-25T22:56:58.656 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30722.log.gz 2024-04-25T22:56:58.656 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32132.log 2024-04-25T22:56:58.656 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30764.log.gz 2024-04-25T22:56:58.656 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.28345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33344.log 2024-04-25T22:56:58.656 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28345.log.gz 2024-04-25T22:56:58.656 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33949.log 2024-04-25T22:56:58.656 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32132.log.gz 2024-04-25T22:56:58.657 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.33344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43499.log 2024-04-25T22:56:58.657 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33344.log.gz 2024-04-25T22:56:58.657 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.33949.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T22:56:58.657 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33949.log.gz 2024-04-25T22:56:58.657 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.43499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35407.log 2024-04-25T22:56:58.657 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43499.log.gz 2024-04-25T22:56:58.657 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33861.log 2024-04-25T22:56:58.657 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.35407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30218.log 2024-04-25T22:56:58.657 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35407.log.gz 2024-04-25T22:56:58.658 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33989.log 2024-04-25T22:56:58.658 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.33861.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33861.log.gz 2024-04-25T22:56:58.658 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28508.log 2024-04-25T22:56:58.658 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30218.log.gz 2024-04-25T22:56:58.658 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.33989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34300.log 2024-04-25T22:56:58.658 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33989.log.gz 2024-04-25T22:56:58.658 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.28508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44549.log 2024-04-25T22:56:58.658 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28508.log.gz 2024-04-25T22:56:58.659 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.34300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29462.log 2024-04-25T22:56:58.659 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34300.log.gz 2024-04-25T22:56:58.659 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44549.log: gzip 94.5% -- replaced with /var/log/ceph/ceph.log.gz -5 2024-04-25T22:56:58.659 INFO:teuthology.orchestra.run.smithi052.stderr: --verbose -- /var/log/ceph/ceph-client.admin.34388.log 2024-04-25T22:56:58.659 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44549.log.gz 2024-04-25T22:56:58.659 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.29462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28401.log 2024-04-25T22:56:58.659 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29462.log.gz 2024-04-25T22:56:58.659 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.34388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42230.log 2024-04-25T22:56:58.660 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34388.log.gz 2024-04-25T22:56:58.660 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.28401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33237.log 2024-04-25T22:56:58.660 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28401.log.gz 2024-04-25T22:56:58.660 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32814.log 2024-04-25T22:56:58.660 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42230.log.gz 2024-04-25T22:56:58.660 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.33237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43625.log 2024-04-25T22:56:58.660 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33237.log.gz 2024-04-25T22:56:58.660 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27969.log 2024-04-25T22:56:58.661 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32814.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32814.log.gz 2024-04-25T22:56:58.661 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.43625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33820.log 2024-04-25T22:56:58.661 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43625.log.gz 2024-04-25T22:56:58.661 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.27969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30890.log 2024-04-25T22:56:58.661 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27969.log.gz 2024-04-25T22:56:58.661 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33343.log 2024-04-25T22:56:58.661 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.33820.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33820.log.gz 2024-04-25T22:56:58.661 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34037.log 2024-04-25T22:56:58.662 INFO:teuthology.orchestra.run.smithi052.stderr: 49.1% -- replaced with /var/log/ceph/ceph-client.admin.30890.log.gz 2024-04-25T22:56:58.662 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.33343.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T22:56:58.662 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33343.log.gz 2024-04-25T22:56:58.662 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28227.log 2024-04-25T22:56:58.662 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.34037.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34037.log.gz 2024-04-25T22:56:58.662 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34430.log 2024-04-25T22:56:58.662 INFO:teuthology.orchestra.run.smithi052.stderr:gzip/var/log/ceph/ceph-client.admin.28227.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.30428.log 2024-04-25T22:56:58.662 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28227.log.gz 2024-04-25T22:56:58.663 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.34430.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.34430.log.gz 2024-04-25T22:56:58.663 INFO:teuthology.orchestra.run.smithi052.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.29838.log 2024-04-25T22:56:58.663 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.30428.log: /var/log/ceph/ceph-client.admin.30260.log 2024-04-25T22:56:58.663 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30428.log.gz 2024-04-25T22:56:58.663 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.29838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29252.log 2024-04-25T22:56:58.663 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29838.log.gz 2024-04-25T22:56:58.663 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45155.log 2024-04-25T22:56:58.663 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30260.log.gz 2024-04-25T22:56:58.664 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.29252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34736.log 2024-04-25T22:56:58.664 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29252.log.gz 2024-04-25T22:56:58.664 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.45155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33596.log 2024-04-25T22:56:58.664 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45155.log.gz 2024-04-25T22:56:58.664 INFO:teuthology.orchestra.run.smithi052.stderr: 95.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T22:56:58.664 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.34736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29711.log 2024-04-25T22:56:58.664 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34736.log.gz 2024-04-25T22:56:58.664 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.33596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32442.log 2024-04-25T22:56:58.665 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33596.log.gz 2024-04-25T22:56:58.665 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.29711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42731.log 2024-04-25T22:56:58.665 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29711.log.gz 2024-04-25T22:56:58.665 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30680.log 2024-04-25T22:56:58.665 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32442.log.gz 2024-04-25T22:56:58.665 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33013.log 2024-04-25T22:56:58.665 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42731.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42731.log.gz 2024-04-25T22:56:58.665 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30302.log 2024-04-25T22:56:58.666 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30680.log.gz 2024-04-25T22:56:58.666 INFO:teuthology.orchestra.run.smithi052.stderr:gzip/var/log/ceph/ceph-client.admin.33013.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.43457.log 2024-04-25T22:56:58.666 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33013.log.gz 2024-04-25T22:56:58.666 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28622.log 2024-04-25T22:56:58.666 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30302.log.gz 2024-04-25T22:56:58.666 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.43457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33907.log 2024-04-25T22:56:58.666 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43457.log.gz 2024-04-25T22:56:58.666 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39771.log 2024-04-25T22:56:58.667 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.28622.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28622.log.gz 2024-04-25T22:56:58.667 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.33907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43707.log 2024-04-25T22:56:58.667 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33907.log.gz 2024-04-25T22:56:58.667 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.39771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34694.log 2024-04-25T22:56:58.667 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39771.log.gz 2024-04-25T22:56:58.667 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34082.log 2024-04-25T22:56:58.667 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.43707.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43707.log.gz 2024-04-25T22:56:58.667 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.34694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32610.log 2024-04-25T22:56:58.668 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34694.log.gz 2024-04-25T22:56:58.668 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.34082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44213.log 2024-04-25T22:56:58.668 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34082.log.gz 2024-04-25T22:56:58.668 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29712.log 2024-04-25T22:56:58.668 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32610.log.gz 2024-04-25T22:56:58.668 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43033.log 2024-04-25T22:56:58.668 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44213.log.gz 2024-04-25T22:56:58.668 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.29712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29168.log 2024-04-25T22:56:58.669 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29712.log.gz 2024-04-25T22:56:58.669 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.43033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34649.log 2024-04-25T22:56:58.669 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43033.log.gz 2024-04-25T22:56:58.669 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.29168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34124.log 2024-04-25T22:56:58.669 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29168.log.gz 2024-04-25T22:56:58.669 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.34649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33555.log 2024-04-25T22:56:58.669 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34649.log.gz 2024-04-25T22:56:58.669 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.34124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45110.log 2024-04-25T22:56:58.669 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34124.log.gz 2024-04-25T22:56:58.670 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.33555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32924.log 2024-04-25T22:56:58.670 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33555.log.gz 2024-04-25T22:56:58.670 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.45110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32746.log 2024-04-25T22:56:58.670 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45110.log.gz 2024-04-25T22:56:58.670 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43284.log 2024-04-25T22:56:58.670 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32924.log.gz 2024-04-25T22:56:58.670 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32698.log 2024-04-25T22:56:58.670 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32746.log.gz 2024-04-25T22:56:58.671 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.43284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44844.log 2024-04-25T22:56:58.671 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43284.log.gz 2024-04-25T22:56:58.671 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29210.log 2024-04-25T22:56:58.671 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32698.log.gz 2024-04-25T22:56:58.671 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43706.log 2024-04-25T22:56:58.671 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44844.log.gz 2024-04-25T22:56:58.671 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.29210.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-25T22:56:58.671 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29210.log.gz 2024-04-25T22:56:58.672 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.43706.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43706.log.gz 2024-04-25T22:56:58.672 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29378.log 2024-04-25T22:56:58.672 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30596.log 2024-04-25T22:56:58.672 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-mgr.y.log: /var/log/ceph/ceph-client.admin.29378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44675.log 2024-04-25T22:56:58.672 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29378.log.gz 2024-04-25T22:56:58.672 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45052.log 2024-04-25T22:56:58.672 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30596.log.gz 2024-04-25T22:56:58.672 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43832.log 2024-04-25T22:56:58.673 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44675.log.gz 2024-04-25T22:56:58.673 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.45052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43331.log 2024-04-25T22:56:58.673 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45052.log.gz 2024-04-25T22:56:58.673 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.43832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43793.log 0.0% 2024-04-25T22:56:58.673 INFO:teuthology.orchestra.run.smithi052.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43832.log.gz 2024-04-25T22:56:58.673 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.43331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32877.log 2024-04-25T22:56:58.673 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43331.log.gz 2024-04-25T22:56:58.673 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.43793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29294.log 2024-04-25T22:56:58.674 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43793.log.gz 2024-04-25T22:56:58.674 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34782.log 2024-04-25T22:56:58.674 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32877.log.gz 2024-04-25T22:56:58.674 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.29294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42485.log 2024-04-25T22:56:58.674 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29294.log.gz 2024-04-25T22:56:58.674 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.34782.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.34782.log.gz 2024-04-25T22:56:58.674 INFO:teuthology.orchestra.run.smithi052.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.32084.log 2024-04-25T22:56:58.674 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44717.log 2024-04-25T22:56:58.674 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42485.log.gz 2024-04-25T22:56:58.675 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31098.log 2024-04-25T22:56:58.675 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32084.log.gz 2024-04-25T22:56:58.675 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35362.log 2024-04-25T22:56:58.675 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44717.log.gz 2024-04-25T22:56:58.675 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.31098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43919.log 2024-04-25T22:56:58.675 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31098.log.gz 2024-04-25T22:56:58.675 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.35362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44381.log 2024-04-25T22:56:58.675 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35362.log.gz 2024-04-25T22:56:58.676 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.43919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34607.log 2024-04-25T22:56:58.676 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43919.log.gz 2024-04-25T22:56:58.676 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29944.log 2024-04-25T22:56:58.676 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44381.log.gz 2024-04-25T22:56:58.676 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.34607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36550.log 2024-04-25T22:56:58.676 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34607.log.gz 2024-04-25T22:56:58.676 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.29944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29588.log 2024-04-25T22:56:58.677 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29944.log.gz 2024-04-25T22:56:58.677 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.36550.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36550.log.gz 2024-04-25T22:56:58.677 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31160.log 2024-04-25T22:56:58.677 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29630.log 2024-04-25T22:56:58.677 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.29588.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29588.log.gz 2024-04-25T22:56:58.677 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.31160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32393.log 2024-04-25T22:56:58.677 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31160.log.gz 2024-04-25T22:56:58.677 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.29630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34343.log 2024-04-25T22:56:58.677 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29630.log.gz 2024-04-25T22:56:58.678 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42585.log 2024-04-25T22:56:58.678 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32393.log.gz 2024-04-25T22:56:58.678 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.34343.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-25T22:56:58.678 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34343.log.gz 2024-04-25T22:56:58.678 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39823.log 2024-04-25T22:56:58.678 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42585.log.gz 2024-04-25T22:56:58.678 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34822.log 2024-04-25T22:56:58.678 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.39823.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-25T22:56:58.679 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39823.log.gz 2024-04-25T22:56:58.679 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.34822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42946.log 0.0% 2024-04-25T22:56:58.679 INFO:teuthology.orchestra.run.smithi052.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34822.log.gz 2024-04-25T22:56:58.679 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28856.log 2024-04-25T22:56:58.679 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42946.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42946.log.gz 2024-04-25T22:56:58.679 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39961.log 2024-04-25T22:56:58.679 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42272.log 2024-04-25T22:56:58.679 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.28856.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28856.log.gz 2024-04-25T22:56:58.680 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.39961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43200.log 2024-04-25T22:56:58.680 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39961.log.gz 2024-04-25T22:56:58.680 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44507.log 2024-04-25T22:56:58.680 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42272.log.gz 2024-04-25T22:56:58.680 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29420.log 2024-04-25T22:56:58.680 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.43200.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43200.log.gz 2024-04-25T22:56:58.680 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44507.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44507.log.gz 2024-04-25T22:56:58.680 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34989.log 2024-04-25T22:56:58.680 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44045.log 2024-04-25T22:56:58.681 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.29420.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29420.log.gz 2024-04-25T22:56:58.681 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.34989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44802.log 2024-04-25T22:56:58.681 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34989.log.gz 2024-04-25T22:56:58.681 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33771.log 2024-04-25T22:56:58.681 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44045.log.gz 2024-04-25T22:56:58.681 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44802.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-25T22:56:58.681 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44802.log.gz 2024-04-25T22:56:58.681 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.33771.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33771.log.gz 2024-04-25T22:56:58.682 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43373.log 2024-04-25T22:56:58.682 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35134.log 2024-04-25T22:56:58.682 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.43373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36737.log 2024-04-25T22:56:58.682 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43373.log.gz 2024-04-25T22:56:58.682 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.35134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44085.log 2024-04-25T22:56:58.682 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35134.log.gz 2024-04-25T22:56:58.682 INFO:teuthology.orchestra.run.smithi052.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-25T22:56:58.682 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.36737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29984.log 2024-04-25T22:56:58.683 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36737.log.gz 2024-04-25T22:56:58.683 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44968.log 2024-04-25T22:56:58.683 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44085.log.gz 2024-04-25T22:56:58.683 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.29984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33729.log 2024-04-25T22:56:58.683 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29984.log.gz 2024-04-25T22:56:58.683 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34516.log 2024-04-25T22:56:58.683 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44968.log.gz 2024-04-25T22:56:58.683 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.33729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42838.log 2024-04-25T22:56:58.683 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33729.log.gz 2024-04-25T22:56:58.684 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.34516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40421.log 2024-04-25T22:56:58.684 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34516.log.gz 2024-04-25T22:56:58.684 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42838.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.32793.log 2024-04-25T22:56:58.684 INFO:teuthology.orchestra.run.smithi052.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42838.log.gz 2024-04-25T22:56:58.684 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.40421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32566.log 2024-04-25T22:56:58.684 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40421.log.gz 2024-04-25T22:56:58.684 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32793.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32793.log.gz 2024-04-25T22:56:58.684 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44884.log 2024-04-25T22:56:58.685 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28772.log 2024-04-25T22:56:58.685 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32566.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32566.log.gz 2024-04-25T22:56:58.685 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44884.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44884.log.gz 2024-04-25T22:56:58.685 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42188.log 2024-04-25T22:56:58.685 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28898.log 2024-04-25T22:56:58.685 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.28772.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28772.log.gz 2024-04-25T22:56:58.685 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32966.log 2024-04-25T22:56:58.685 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42188.log.gz 2024-04-25T22:56:58.685 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.28898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35039.log 2024-04-25T22:56:58.686 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28898.log.gz 2024-04-25T22:56:58.686 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43833.log 2024-04-25T22:56:58.686 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32966.log.gz 2024-04-25T22:56:58.686 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.35039.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35039.log.gz 2024-04-25T22:56:58.686 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27101.log 2024-04-25T22:56:58.686 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28673.log 2024-04-25T22:56:58.686 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.43833.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43833.log.gz 2024-04-25T22:56:58.686 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph.tmp-client.admin.27101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44339.log 2024-04-25T22:56:58.687 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27101.log.gz 2024-04-25T22:56:58.687 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.28673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42354.log 2024-04-25T22:56:58.687 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28673.log.gz 2024-04-25T22:56:58.687 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30176.log 2024-04-25T22:56:58.687 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44339.log.gz 2024-04-25T22:56:58.687 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42354.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42354.log.gz 2024-04-25T22:56:58.687 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32311.log 2024-04-25T22:56:58.687 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42627.log 2024-04-25T22:56:58.688 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30176.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30176.log.gz 2024-04-25T22:56:58.688 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32311.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32311.log.gz 2024-04-25T22:56:58.688 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29798.log 2024-04-25T22:56:58.688 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33642.log 2024-04-25T22:56:58.688 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42627.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42627.log.gz 2024-04-25T22:56:58.688 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.29798.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29798.log.gz 2024-04-25T22:56:58.688 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29336.log 2024-04-25T22:56:58.688 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28445.log 2024-04-25T22:56:58.688 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.33642.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33642.log.gz 2024-04-25T22:56:58.689 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.29336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36051.log 2024-04-25T22:56:58.689 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29336.log.gz 2024-04-25T22:56:58.689 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.28445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44759.log 2024-04-25T22:56:58.689 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28445.log.gz 2024-04-25T22:56:58.689 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34169.log 2024-04-25T22:56:58.689 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.36051.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36051.log.gz 2024-04-25T22:56:58.689 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30806.log 2024-04-25T22:56:58.689 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44759.log.gz 2024-04-25T22:56:58.690 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.34169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30972.log 2024-04-25T22:56:58.690 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34169.log.gz 2024-04-25T22:56:58.690 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44297.log 2024-04-25T22:56:58.690 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30806.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30806.log.gz 2024-04-25T22:56:58.690 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30972.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30972.log.gz -5 2024-04-25T22:56:58.690 INFO:teuthology.orchestra.run.smithi052.stderr: --verbose -- /var/log/ceph/ceph-client.admin.43242.log 2024-04-25T22:56:58.690 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43958.log 2024-04-25T22:56:58.690 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44297.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44297.log.gz 2024-04-25T22:56:58.691 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.43242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34475.log 2024-04-25T22:56:58.691 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43242.log.gz 2024-04-25T22:56:58.691 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.43958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30050.log 2024-04-25T22:56:58.691 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43958.log.gz 2024-04-25T22:56:58.691 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.34475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45197.log 2024-04-25T22:56:58.691 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34475.log.gz 2024-04-25T22:56:58.691 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35301.log 2024-04-25T22:56:58.691 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30050.log.gz 2024-04-25T22:56:58.691 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.45197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44591.log 2024-04-25T22:56:58.692 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45197.log.gz 2024-04-25T22:56:58.692 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.35301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42901.log 2024-04-25T22:56:58.692 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35301.log.gz 2024-04-25T22:56:58.692 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28730.log 2024-04-25T22:56:58.692 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44591.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44591.log.gz 2024-04-25T22:56:58.692 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29710.log 2024-04-25T22:56:58.692 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42901.log.gz 2024-04-25T22:56:58.692 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.28730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34256.log 2024-04-25T22:56:58.693 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28730.log.gz 2024-04-25T22:56:58.693 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31261.log 2024-04-25T22:56:58.693 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.29710.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29710.log.gz 2024-04-25T22:56:58.693 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.34256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33502.log 2024-04-25T22:56:58.693 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34256.log.gz 2024-04-25T22:56:58.693 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.31261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29546.log 2024-04-25T22:56:58.693 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31261.log.gz 2024-04-25T22:56:58.693 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32657.log 2024-04-25T22:56:58.694 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.33502.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33502.log.gz 2024-04-25T22:56:58.694 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.29546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42292.log 2024-04-25T22:56:58.694 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29546.log.gz 2024-04-25T22:56:58.694 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38870.log 2024-04-25T22:56:58.694 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32657.log.gz 2024-04-25T22:56:58.694 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42397.log 2024-04-25T22:56:58.694 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42292.log.gz 2024-04-25T22:56:58.694 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.38870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35175.log 2024-04-25T22:56:58.694 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38870.log.gz 2024-04-25T22:56:58.695 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31262.log 2024-04-25T22:56:58.695 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42397.log.gz 2024-04-25T22:56:58.695 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.35175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32265.log 2024-04-25T22:56:58.695 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35175.log.gz 2024-04-25T22:56:58.695 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.31262.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31262.log.gz 2024-04-25T22:56:58.695 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28814.log 2024-04-25T22:56:58.695 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32173.log 2024-04-25T22:56:58.695 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32265.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32265.log.gz 2024-04-25T22:56:58.696 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.28814.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28814.log.gz 2024-04-25T22:56:58.696 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29924.log 2024-04-25T22:56:58.696 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31366.log 2024-04-25T22:56:58.696 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32173.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32173.log.gz 2024-04-25T22:56:58.696 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.29924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28580.log 2024-04-25T22:56:58.696 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29924.log.gz 2024-04-25T22:56:58.696 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.31366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44465.log 2024-04-25T22:56:58.696 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31366.log.gz 2024-04-25T22:56:58.696 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30638.log 2024-04-25T22:56:58.697 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.28580.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28580.log.gz 2024-04-25T22:56:58.697 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44423.log 2024-04-25T22:56:58.697 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44465.log.gz 2024-04-25T22:56:58.697 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33278.log 2024-04-25T22:56:58.697 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30638.log.gz 2024-04-25T22:56:58.697 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43541.log 2024-04-25T22:56:58.697 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44423.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44423.log.gz 2024-04-25T22:56:58.697 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.33278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33682.log 2024-04-25T22:56:58.698 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33278.log.gz 2024-04-25T22:56:58.698 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.43541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30512.log 2024-04-25T22:56:58.698 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43541.log.gz 2024-04-25T22:56:58.698 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.33682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30386.log 2024-04-25T22:56:58.698 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33682.log.gz 2024-04-25T22:56:58.698 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33411.log 2024-04-25T22:56:58.698 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30512.log.gz 2024-04-25T22:56:58.698 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35222.log 2024-04-25T22:56:58.699 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30386.log.gz 2024-04-25T22:56:58.699 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43583.log 2024-04-25T22:56:58.699 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.33411.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33411.log.gz 2024-04-25T22:56:58.699 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.35222.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35222.log.gz 2024-04-25T22:56:58.699 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29837.log 2024-04-25T22:56:58.699 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28986.log 2024-04-25T22:56:58.699 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.43583.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43583.log.gz 2024-04-25T22:56:58.699 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.29837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29504.log 2024-04-25T22:56:58.700 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29837.log.gz 2024-04-25T22:56:58.700 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44255.log 2024-04-25T22:56:58.700 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.28986.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28986.log.gz 2024-04-25T22:56:58.700 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.29504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37373.log 2024-04-25T22:56:58.700 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29504.log.gz 2024-04-25T22:56:58.700 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29038.log 2024-04-25T22:56:58.700 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44255.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44255.log.gz 2024-04-25T22:56:58.700 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.37373.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-25T22:56:58.700 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37373.log.gz 2024-04-25T22:56:58.701 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.29038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43959.log 2024-04-25T22:56:58.701 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29038.log.gz 2024-04-25T22:56:58.701 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30070.log 2024-04-25T22:56:58.701 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.43959.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43959.log.gz 2024-04-25T22:56:58.701 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43705.log 2024-04-25T22:56:58.701 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42669.log 2024-04-25T22:56:58.701 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30070.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30070.log.gz 2024-04-25T22:56:58.701 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.43705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31014.log 2024-04-25T22:56:58.702 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43705.log.gz 2024-04-25T22:56:58.702 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42669.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42669.log.gz 2024-04-25T22:56:58.702 INFO:teuthology.orchestra.run.smithi052.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.32484.log 2024-04-25T22:56:58.702 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.31014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30848.log 2024-04-25T22:56:58.702 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31014.log.gz 2024-04-25T22:56:58.702 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32484.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32484.log.gz 2024-04-25T22:56:58.702 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33456.log 2024-04-25T22:56:58.702 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42730.log 2024-04-25T22:56:58.703 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30848.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30848.log.gz 2024-04-25T22:56:58.703 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.33456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31956.log 2024-04-25T22:56:58.703 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33456.log.gz 2024-04-25T22:56:58.703 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42543.log 2024-04-25T22:56:58.703 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42730.log.gz 2024-04-25T22:56:58.703 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.31956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35568.log 2024-04-25T22:56:58.703 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31956.log.gz 2024-04-25T22:56:58.703 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28942.log 2024-04-25T22:56:58.704 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42543.log.gz 2024-04-25T22:56:58.704 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5/var/log/ceph/ceph-client.admin.35568.log: --verbose -- /var/log/ceph/ceph-client.admin.35088.log 2024-04-25T22:56:58.704 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35568.log.gz 2024-04-25T22:56:58.704 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.28942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28182.log 2024-04-25T22:56:58.704 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28942.log.gz 2024-04-25T22:56:58.704 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.35088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32222.log 2024-04-25T22:56:58.704 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35088.log.gz 2024-04-25T22:56:58.704 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.28182.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28182.log.gz 2024-04-25T22:56:58.705 INFO:teuthology.orchestra.run.smithi052.stderr: -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-25T22:56:58.705 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45010.log 2024-04-25T22:56:58.705 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32222.log.gz 2024-04-25T22:56:58.705 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35826.log 2024-04-25T22:56:58.705 INFO:teuthology.orchestra.run.smithi052.stderr:gzip/var/log/ceph/ceph-client.admin.45010.log: -5 --verbose -- 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45010.log.gz 2024-04-25T22:56:58.705 INFO:teuthology.orchestra.run.smithi052.stderr: /var/log/ceph/ceph-client.admin.32042.log 2024-04-25T22:56:58.705 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.35826.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35826.log.gz 2024-04-25T22:56:58.705 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33149.log 2024-04-25T22:56:58.706 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33102.log 2024-04-25T22:56:58.706 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32042.log.gz 2024-04-25T22:56:58.706 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.33149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44171.log 2024-04-25T22:56:58.706 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33149.log.gz 2024-04-25T22:56:58.706 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.33102.log: -- /var/log/ceph/ceph-client.admin.34562.log 2024-04-25T22:56:58.706 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33102.log.gz 2024-04-25T22:56:58.706 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44171.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44171.log.gz 2024-04-25T22:56:58.706 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44926.log 2024-04-25T22:56:58.707 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32353.log 2024-04-25T22:56:58.707 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.34562.log: /var/log/ceph/ceph-client.admin.44926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30344.log 2024-04-25T22:56:58.707 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34562.log.gz 2024-04-25T22:56:58.707 INFO:teuthology.orchestra.run.smithi052.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44926.log.gz 2024-04-25T22:56:58.707 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32353.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32353.log.gz 2024-04-25T22:56:58.707 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42751.log 2024-04-25T22:56:58.707 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43415.log 2024-04-25T22:56:58.707 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30344.log: /var/log/ceph/ceph-client.admin.42751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31785.log 2024-04-25T22:56:58.708 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42751.log.gz 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30344.log.gz 2024-04-25T22:56:58.708 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-04-25T22:56:58.708 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.43415.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43415.log.gz 2024-04-25T22:56:58.708 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42093.log 2024-04-25T22:56:58.708 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33191.log 2024-04-25T22:56:58.708 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.0.31785.log: /var/log/ceph/ceph-client.admin.42093.log: 33.3% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42093.log.gz 2024-04-25T22:56:58.708 INFO:teuthology.orchestra.run.smithi052.stderr: -- replaced with /var/log/ceph/ceph-client.0.31785.log.gz 2024-04-25T22:56:58.708 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.33191.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33191.log.gz 2024-04-25T22:56:58.709 INFO:teuthology.orchestra.run.smithi052.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-25T22:56:58.709 INFO:teuthology.orchestra.run.smithi052.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-25T22:56:58.730 INFO:teuthology.orchestra.run.smithi052.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-25T22:56:58.742 INFO:teuthology.orchestra.run.smithi052.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-25T22:56:58.843 INFO:teuthology.orchestra.run.smithi052.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-25T22:56:58.844 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-04-25T22:56:58.844 INFO:teuthology.orchestra.run.smithi052.stderr:real 0m0.289s 2024-04-25T22:56:58.845 INFO:teuthology.orchestra.run.smithi052.stderr:user 0m0.654s 2024-04-25T22:56:58.845 INFO:teuthology.orchestra.run.smithi052.stderr:sys 0m0.122s 2024-04-25T22:56:59.657 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-osd.1.log: 95.2% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-25T22:56:59.659 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-25T22:56:59.659 INFO:teuthology.orchestra.run.smithi164.stderr:real 0m1.098s 2024-04-25T22:56:59.659 INFO:teuthology.orchestra.run.smithi164.stderr:user 0m1.047s 2024-04-25T22:56:59.659 INFO:teuthology.orchestra.run.smithi164.stderr:sys 0m0.050s 2024-04-25T22:57:00.925 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-osd.0.log: 94.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-25T22:57:00.927 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-04-25T22:57:00.927 INFO:teuthology.orchestra.run.smithi110.stderr:real 0m2.366s 2024-04-25T22:57:00.927 INFO:teuthology.orchestra.run.smithi110.stderr:user 0m2.282s 2024-04-25T22:57:00.927 INFO:teuthology.orchestra.run.smithi110.stderr:sys 0m0.091s 2024-04-25T22:57:01.279 INFO:teuthology.orchestra.run.smithi191.stderr: 94.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-25T22:57:01.281 INFO:teuthology.orchestra.run.smithi191.stderr: 2024-04-25T22:57:01.281 INFO:teuthology.orchestra.run.smithi191.stderr:real 0m2.681s 2024-04-25T22:57:01.281 INFO:teuthology.orchestra.run.smithi191.stderr:user 0m2.589s 2024-04-25T22:57:01.281 INFO:teuthology.orchestra.run.smithi191.stderr:sys 0m0.101s 2024-04-25T22:57:01.281 INFO:tasks.ceph:Archiving logs... 2024-04-25T22:57:01.282 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674073/remote/smithi052/log 2024-04-25T22:57:01.283 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T22:57:01.639 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674073/remote/smithi110/log 2024-04-25T22:57:01.640 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T22:57:02.000 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674073/remote/smithi164/log 2024-04-25T22:57:02.001 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T22:57:02.176 DEBUG:teuthology.misc:Transferring archived files from smithi191:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674073/remote/smithi191/log 2024-04-25T22:57:02.176 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T22:57:02.587 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-25T22:57:02.597 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-25T22:57:02.597 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T22:57:02.600 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T22:57:02.603 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T22:57:02.605 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T22:57:02.733 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-25T22:57:02.743 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-25T22:57:02.743 DEBUG:teuthology.orchestra.run.smithi052:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T22:57:02.746 DEBUG:teuthology.orchestra.run.smithi110:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T22:57:02.749 DEBUG:teuthology.orchestra.run.smithi164:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T22:57:02.752 DEBUG:teuthology.orchestra.run.smithi191:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T22:57:02.760 INFO:teuthology.orchestra.run.smithi052.stderr:bash: line 1: ntpq: command not found 2024-04-25T22:57:02.763 INFO:teuthology.orchestra.run.smithi110.stderr:bash: line 1: ntpq: command not found 2024-04-25T22:57:02.765 INFO:teuthology.orchestra.run.smithi164.stderr:bash: line 1: ntpq: command not found 2024-04-25T22:57:02.766 INFO:teuthology.orchestra.run.smithi052.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T22:57:02.766 INFO:teuthology.orchestra.run.smithi052.stdout:=============================================================================== 2024-04-25T22:57:02.767 INFO:teuthology.orchestra.run.smithi052.stdout:^* hv01.front.sepia.ceph.com 3 6 377 59 +1053us[+1057us] +/- 47ms 2024-04-25T22:57:02.767 INFO:teuthology.orchestra.run.smithi052.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 59 -1056us[-1056us] +/- 56ms 2024-04-25T22:57:02.767 INFO:teuthology.orchestra.run.smithi052.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 59 -365us[ -365us] +/- 85ms 2024-04-25T22:57:02.767 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T22:57:02.767 INFO:teuthology.orchestra.run.smithi191.stderr:bash: line 1: ntpq: command not found 2024-04-25T22:57:02.769 INFO:teuthology.orchestra.run.smithi110.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T22:57:02.769 INFO:teuthology.orchestra.run.smithi110.stdout:=============================================================================== 2024-04-25T22:57:02.769 INFO:teuthology.orchestra.run.smithi110.stdout:^* hv01.front.sepia.ceph.com 3 6 377 60 +1067us[+1084us] +/- 47ms 2024-04-25T22:57:02.769 INFO:teuthology.orchestra.run.smithi110.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 60 -1058us[-1041us] +/- 56ms 2024-04-25T22:57:02.770 INFO:teuthology.orchestra.run.smithi110.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 62 -365us[ -348us] +/- 85ms 2024-04-25T22:57:02.770 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T22:57:02.771 INFO:teuthology.orchestra.run.smithi191.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T22:57:02.771 INFO:teuthology.orchestra.run.smithi191.stdout:=============================================================================== 2024-04-25T22:57:02.771 INFO:teuthology.orchestra.run.smithi191.stdout:^* hv01.front.sepia.ceph.com 3 6 377 61 +1056us[+1065us] +/- 47ms 2024-04-25T22:57:02.771 INFO:teuthology.orchestra.run.smithi191.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 60 -1052us[-1052us] +/- 56ms 2024-04-25T22:57:02.771 INFO:teuthology.orchestra.run.smithi191.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 62 -371us[ -362us] +/- 85ms 2024-04-25T22:57:02.771 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T22:57:02.772 INFO:teuthology.orchestra.run.smithi164.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T22:57:02.772 INFO:teuthology.orchestra.run.smithi164.stdout:=============================================================================== 2024-04-25T22:57:02.772 INFO:teuthology.orchestra.run.smithi164.stdout:^* hv01.front.sepia.ceph.com 3 6 37 42 +1014us[+1072us] +/- 47ms 2024-04-25T22:57:02.772 INFO:teuthology.orchestra.run.smithi164.stdout:^+ hv02.front.sepia.ceph.com 3 6 37 42 -1080us[-1080us] +/- 56ms 2024-04-25T22:57:02.773 INFO:teuthology.orchestra.run.smithi164.stdout:^+ hv03.front.sepia.ceph.com 3 6 37 41 -346us[ -346us] +/- 85ms 2024-04-25T22:57:02.773 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv04.front.sepia.ceph.com 0 7 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T22:57:02.774 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-25T22:57:02.785 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-25T22:57:02.786 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-25T22:57:02.858 DEBUG:teuthology.orchestra.run.smithi052:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T22:57:02.929 DEBUG:teuthology.orchestra.run.smithi110:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T22:57:02.998 DEBUG:teuthology.orchestra.run.smithi164:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T22:57:03.110 DEBUG:teuthology.orchestra.run.smithi191:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T22:57:03.177 DEBUG:teuthology.orchestra.run.smithi052:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T22:57:03.208 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T22:57:03.209 DEBUG:teuthology.orchestra.run.smithi110:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T22:57:03.239 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T22:57:03.240 DEBUG:teuthology.orchestra.run.smithi164:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T22:57:03.269 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T22:57:03.270 DEBUG:teuthology.orchestra.run.smithi191:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T22:57:03.297 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T22:57:03.298 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-25T22:57:03.308 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-25T22:57:03.344 INFO:teuthology.task.internal:Duration was 669.619526 seconds 2024-04-25T22:57:03.345 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-25T22:57:03.383 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-25T22:57:03.384 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T22:57:03.386 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T22:57:03.389 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T22:57:03.391 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T22:57:03.428 INFO:teuthology.orchestra.run.smithi052.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T22:57:03.429 INFO:teuthology.orchestra.run.smithi110.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T22:57:03.429 INFO:teuthology.orchestra.run.smithi191.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T22:57:03.447 INFO:teuthology.orchestra.run.smithi164.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T22:57:03.841 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-25T22:57:03.842 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi052.front.sepia.ceph.com 2024-04-25T22:57:03.842 DEBUG:teuthology.orchestra.run.smithi052:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T22:57:03.866 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi110.front.sepia.ceph.com 2024-04-25T22:57:03.867 DEBUG:teuthology.orchestra.run.smithi110:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T22:57:03.893 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi164.front.sepia.ceph.com 2024-04-25T22:57:03.893 DEBUG:teuthology.orchestra.run.smithi164:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T22:57:03.919 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi191.front.sepia.ceph.com 2024-04-25T22:57:03.919 DEBUG:teuthology.orchestra.run.smithi191:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T22:57:03.943 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-25T22:57:03.944 DEBUG:teuthology.orchestra.run.smithi052:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T22:57:03.946 DEBUG:teuthology.orchestra.run.smithi110:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T22:57:03.949 DEBUG:teuthology.orchestra.run.smithi164:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T22:57:03.961 DEBUG:teuthology.orchestra.run.smithi191:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T22:57:04.009 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-25T22:57:04.009 DEBUG:teuthology.orchestra.run.smithi052:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T22:57:04.018 DEBUG:teuthology.orchestra.run.smithi110:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T22:57:04.020 DEBUG:teuthology.orchestra.run.smithi164:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T22:57:04.029 DEBUG:teuthology.orchestra.run.smithi191:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T22:57:04.151 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-25T22:57:04.162 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-25T22:57:04.162 DEBUG:teuthology.orchestra.run.smithi052:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T22:57:04.187 DEBUG:teuthology.orchestra.run.smithi110:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T22:57:04.212 DEBUG:teuthology.orchestra.run.smithi164:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T22:57:04.237 DEBUG:teuthology.orchestra.run.smithi191:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T22:57:04.261 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-25T22:57:04.271 DEBUG:teuthology.orchestra.run.smithi052:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T22:57:04.274 DEBUG:teuthology.orchestra.run.smithi110:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T22:57:04.276 DEBUG:teuthology.orchestra.run.smithi164:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T22:57:04.280 DEBUG:teuthology.orchestra.run.smithi191:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T22:57:04.296 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern = core 2024-04-25T22:57:04.296 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern = core 2024-04-25T22:57:04.316 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern = core 2024-04-25T22:57:04.323 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern = core 2024-04-25T22:57:04.347 DEBUG:teuthology.orchestra.run.smithi052:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T22:57:04.363 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T22:57:04.364 DEBUG:teuthology.orchestra.run.smithi110:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T22:57:04.379 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T22:57:04.380 DEBUG:teuthology.orchestra.run.smithi164:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T22:57:04.397 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T22:57:04.398 DEBUG:teuthology.orchestra.run.smithi191:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T22:57:04.412 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T22:57:04.412 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-25T22:57:04.423 INFO:teuthology.task.internal:Transferring archived files... 2024-04-25T22:57:04.424 DEBUG:teuthology.misc:Transferring archived files from smithi052:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674073/remote/smithi052 2024-04-25T22:57:04.424 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T22:57:04.458 DEBUG:teuthology.misc:Transferring archived files from smithi110:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674073/remote/smithi110 2024-04-25T22:57:04.459 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T22:57:04.490 DEBUG:teuthology.misc:Transferring archived files from smithi164:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674073/remote/smithi164 2024-04-25T22:57:04.491 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T22:57:04.522 DEBUG:teuthology.misc:Transferring archived files from smithi191:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674073/remote/smithi191 2024-04-25T22:57:04.523 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T22:57:04.556 INFO:teuthology.task.internal:Removing archive directory... 2024-04-25T22:57:04.556 DEBUG:teuthology.orchestra.run.smithi052:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T22:57:04.559 DEBUG:teuthology.orchestra.run.smithi110:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T22:57:04.561 DEBUG:teuthology.orchestra.run.smithi164:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T22:57:04.563 DEBUG:teuthology.orchestra.run.smithi191:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T22:57:04.605 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-25T22:57:04.618 INFO:teuthology.task.internal:Not uploading archives. 2024-04-25T22:57:04.618 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-25T22:57:04.653 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-25T22:57:04.653 DEBUG:teuthology.orchestra.run.smithi052:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T22:57:04.656 DEBUG:teuthology.orchestra.run.smithi110:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T22:57:04.658 DEBUG:teuthology.orchestra.run.smithi164:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T22:57:04.660 DEBUG:teuthology.orchestra.run.smithi191:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T22:57:04.669 INFO:teuthology.orchestra.run.smithi052.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 22:57 /home/ubuntu/cephtest 2024-04-25T22:57:04.670 INFO:teuthology.orchestra.run.smithi110.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 22:57 /home/ubuntu/cephtest 2024-04-25T22:57:04.673 INFO:teuthology.orchestra.run.smithi164.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 22:57 /home/ubuntu/cephtest 2024-04-25T22:57:04.674 INFO:teuthology.orchestra.run.smithi191.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 22:57 /home/ubuntu/cephtest 2024-04-25T22:57:04.676 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-25T22:57:04.685 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-25T22:57:04.754 INFO:teuthology.nuke:Checking targets against current locks 2024-04-25T22:57:04.782 DEBUG:teuthology.nuke:shortname: smithi052 2024-04-25T22:57:04.783 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T22:57:04.809 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi052.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674073', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 22:40:08.290162', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDSIcjkrs3fu9z3MaNgNEl/JlLCteLQGWKJlnH/58PrXWPsFPTZsI+fEypo4hx/vij1aB/m7mAzfQl1SxvV6lCg='} 2024-04-25T22:57:04.810 DEBUG:teuthology.nuke:shortname: smithi110 2024-04-25T22:57:04.810 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T22:57:04.835 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi110.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674073', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 22:40:08.291706', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNqPd0uUwDHoFDG/WUPEm8FI2EGSKKRWG2FEChX+x4ZO+tZhK8B90RhZvzQG92A5e0QdX2LZ+QdxfsoctE5a3+o='} 2024-04-25T22:57:04.840 DEBUG:teuthology.nuke:shortname: smithi164 2024-04-25T22:57:04.841 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T22:57:04.867 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi164.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674073', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 22:40:08.293203', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBleoW1Vdqjh/mQnCLfCpLdXKmQ+tsEeKQi8LfSy4bA2QvIoRJPyQKGWtoOseEbcLKQLnN+jnBY7yqVIdGWV7sE='} 2024-04-25T22:57:04.877 INFO:teuthology.orchestra.console.smithi052:Power off 2024-04-25T22:57:04.877 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-25T22:57:04.887 DEBUG:teuthology.nuke:shortname: smithi191 2024-04-25T22:57:04.888 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T22:57:04.899 INFO:teuthology.orchestra.console.smithi110:Power off 2024-04-25T22:57:04.900 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-25T22:57:04.912 DEBUG:teuthology.orchestra.console.smithi052:power off output: Chassis Power Control: Down/Off 2024-04-25T22:57:04.913 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T22:57:04.928 DEBUG:teuthology.orchestra.console.smithi110:power off output: Chassis Power Control: Down/Off 2024-04-25T22:57:04.928 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T22:57:04.939 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi191.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_21:32:02-powercycle-squid-distro-default-smithi/7674073', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 22:40:08.288353', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHyrsHbeOR7s7w3ikPF9nZlOia6bmkuc84Y/HHyyEua2u8+le1UfVxmxRClhWEke2lDqUj1FE/7nbe/DNoErapg='} 2024-04-25T22:57:04.943 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is on 2024-04-25T22:57:04.954 INFO:teuthology.orchestra.console.smithi164:Power off 2024-04-25T22:57:04.955 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-25T22:57:04.969 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on 2024-04-25T22:57:04.978 DEBUG:teuthology.orchestra.console.smithi164:power off output: Chassis Power Control: Down/Off 2024-04-25T22:57:04.978 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T22:57:04.998 INFO:teuthology.orchestra.console.smithi191:Power off 2024-04-25T22:57:04.999 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-25T22:57:05.010 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on 2024-04-25T22:57:05.022 DEBUG:teuthology.orchestra.console.smithi191:power off output: Chassis Power Control: Down/Off 2024-04-25T22:57:05.023 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T22:57:05.053 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2024-04-25T22:57:08.944 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T22:57:08.969 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T22:57:09.011 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T22:57:09.055 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T22:57:09.066 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is on 2024-04-25T22:57:09.080 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on 2024-04-25T22:57:09.124 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on 2024-04-25T22:57:09.166 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2024-04-25T22:57:13.069 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T22:57:13.081 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T22:57:13.126 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T22:57:13.167 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T22:57:13.181 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off 2024-04-25T22:57:13.193 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off 2024-04-25T22:57:13.240 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on 2024-04-25T22:57:13.279 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2024-04-25T22:57:13.282 INFO:teuthology.orchestra.console.smithi052:Power off completed 2024-04-25T22:57:13.294 INFO:teuthology.orchestra.console.smithi110:Power off completed 2024-04-25T22:57:17.245 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T22:57:17.280 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T22:57:17.357 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off 2024-04-25T22:57:17.392 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2024-04-25T22:57:17.458 INFO:teuthology.orchestra.console.smithi164:Power off completed 2024-04-25T22:57:17.494 INFO:teuthology.orchestra.console.smithi191:Power off completed 2024-04-25T22:57:17.600 INFO:teuthology.run:Summary data: description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-low-osd-mem-target powercycle/default supported-distros/centos_latest tasks/cfuse_workunit_suites_fsx thrashosds-health} duration: 669.6195256710052 failure_reason: 'Command failed (workunit test suites/fsx.sh) on smithi052 with status 2: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b22e2ebdeb24376882b7bda2a7329c8cccc2276a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh''' flavor: default owner: scheduled_teuthology@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=af7783a6eb09462e98d499be2ec0b381 status: fail success: false 2024-04-25T22:57:17.600 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T22:57:17.682 INFO:teuthology.run:FAIL